WO2022037463A1 - 一种功能切换入口的确定方法与电子设备 - Google Patents

一种功能切换入口的确定方法与电子设备 Download PDF

Info

Publication number
WO2022037463A1
WO2022037463A1 PCT/CN2021/112128 CN2021112128W WO2022037463A1 WO 2022037463 A1 WO2022037463 A1 WO 2022037463A1 CN 2021112128 W CN2021112128 W CN 2021112128W WO 2022037463 A1 WO2022037463 A1 WO 2022037463A1
Authority
WO
WIPO (PCT)
Prior art keywords
function
control device
software
entry
hardware
Prior art date
Application number
PCT/CN2021/112128
Other languages
English (en)
French (fr)
Inventor
张亚男
王红军
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to US18/022,116 priority Critical patent/US20230308534A1/en
Priority to EP21857558.7A priority patent/EP4195707A4/en
Priority to CN202180051103.9A priority patent/CN115918108B/zh
Publication of WO2022037463A1 publication Critical patent/WO2022037463A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/4183—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by data acquisition, e.g. workpiece identification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/023—Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02—Terminal devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present application relates to the field of electronic devices, and in particular, to a method for determining a function switching entry and an electronic device.
  • All-scenario smart life refers to the ability to control a variety of electronic devices through the control device, so as to realize the flexible use of electronic devices in various scenarios. For example, control the smart speaker to play music through the control device, or the smart air conditioner to adjust the working mode or adjust the temperature.
  • the control device can be a mobile phone commonly used by users. As the control center of the whole-scenario smart life, it can control a variety of electronic devices. At the same time, a variety of electronic devices can also be used as the hardware input of the control device. The hardware capabilities of electronic equipment, improve the function of control equipment.
  • the present application provides a method for determining a function switching entry and an electronic device, so that a control device can utilize the device capabilities of peripheral devices to realize the function of the control device.
  • an embodiment of the present application provides a method for determining a function switching entry, and the method includes the following steps:
  • the control device determines the functional requirements of the currently executed task, detects at least one first peripheral device in the current environment, and determines the capability information of the at least one first peripheral device; then, the control device determines the capability information of the at least one first peripheral device according to the function of the currently executed task
  • the requirement and the capability information of the at least one first peripheral device determine at least one first function switch entry; wherein, the first function switch entry is used to map the function corresponding to the first function switch entry to the at least one function switch entry a first peripheral device; the function corresponding to the first function switching entry is part or all of the functions in the functional requirements of the currently executing task; the control device displays the at least one first function switching entry.
  • the control device can analyze the currently executed task to determine the functional requirements of the currently executed task. For example, if the current control device executes the task of playing a video, the functional requirements of the task are determined to be video output and audio output.
  • the control device detects the first peripheral device, and determines the capability information of the first peripheral device in the current environment.
  • the control device determines that the first function switching entry can be "screen projection" according to the functional requirements of the currently executed task and the capability information of the first peripheral device, so as to determine the function switching entry currently required by the user and supported by the first peripheral device , which is convenient for the user to quickly select the function switching entry, so that the peripheral device can realize the function of the control device, thereby improving the user experience.
  • the control device before the control device determines the functional requirements of the currently executed task, it receives a display instruction, where the display instruction is used to instruct the control device to display a target interface; the control device according to the currently executed task After determining at least one first function switch entry based on the functional requirements of the at least one first peripheral device and the capability information of the at least one first peripheral device, the target interface is displayed; wherein, the target interface includes at least one first function switch entry, and/or , the identifier of the at least one first peripheral device. In this way, at least one first function switching entry determined by the control device is displayed in the target interface, which facilitates the user to select the desired first function switching entry in the target interface and simplifies user operations.
  • the target interface is a multi-device control center interface, and the display instruction is triggered by a user through operating system-level keys or preset gestures; or the target interface is a software-hardware switching interface, and the The display instruction is triggered by the user through a preset button on the application interface.
  • the user can trigger the display of the operating system-level multi-device control center interface or the application-level software and hardware switching interface through a simple operation, which is convenient for the user to view and select the function switching entry at any time without interrupting the current execution of the control device. task.
  • the at least one first function switch entry includes: at least one hardware switch entry, and/or at least one software switch entry.
  • the control device may, but is not limited to, determine the at least one first function switching entry in one or a combination of the following manners:
  • Manner 1 Determine the at least one hardware switch entry according to the hardware function requirements of the currently executing task and the hardware capability information of the at least one first peripheral device;
  • the control device determines the at least one software switching entry according to the software function requirements of the currently executed task and the software capability information of the at least one first peripheral device.
  • the first function switch entry displayed by the control device in the target interface includes at least one hardware switch entry, and/or at least one software switch entry, which is no longer limited to a single screen projection or audio output switch entry, and is a user-friendly interface.
  • the control device determines capability information of a second peripheral device that is currently connected to the control device; and determines the at least one second function switch according to the capability information of the second peripheral device entry, wherein the second function switching entry is used to map the function corresponding to the second function switching entry to the second peripheral device; the function corresponding to the second function switching entry is the function of the currently executing task Some or all of the functionality in a functional requirement.
  • the control device has established a connection with the second peripheral device, at least one second function switch entry corresponding to the capability information of the second peripheral device is displayed to the user, and the function switch entry is determined more flexibly, which is convenient for the user to pass
  • the currently established second peripheral device implements the function of the control device.
  • the target interface further includes the at least one second function switch entry and/or the identifier of the second peripheral device.
  • the control device after the control device displays the target interface, it receives a target switching instruction, where the target switching instruction is used to instruct the control device to map the target function to the target peripheral device; the control device responds to the The target switching instruction implements the target function through the target peripheral device.
  • the control device realizes the target function through the target peripheral device, provides services for the user in combination with the target peripheral device and the control device, and improves the user experience.
  • the target device may be a first peripheral device or a second peripheral device.
  • the target function is a preset hardware function or software function; or the target function is a hardware function or a hardware function determined by the control device according to the hardware capability or software capability of the target peripheral device. software function; or the target function is a hardware function or a software function determined by the control device according to the currently executed task.
  • the control device can analyze the target peripheral equipment and the currently executing task, adjust the target function corresponding to the target switching instruction, and provide users with a more intelligent function switching service.
  • the current task performed by the control device is to play a video
  • the first peripheral device in the current network connection is a smart screen device
  • determine that the functional requirement of the currently performed task is video output, and determine The capability information of the smart screen device is to support playing audio and video
  • it is determined that the first function switching entry is screen projection
  • the current task performed by the control device is to play audio
  • the first peripheral device in the current network connection is a speaker Determine that the functional requirement of the current execution task is audio output, and determine that the capability information of the sound box is to support playing audio; Determine that the first function switching entry is audio output;
  • the current execution task of the control device is K song, so
  • the first peripheral equipment in the current network connection is a smart screen device and a sound box; it is determined that the functional requirements of the current execution task are video output, audio output and audio input, and the capability information of the smart screen device is determined to support playback audio.
  • an embodiment of the present application further provides a method for determining a function switching entry, wherein the control device receives a display instruction, and the display instruction is used to instruct the control device to display a target interface; the control device responds to the display instruction, Displaying the target interface; wherein, the target interface includes at least one function switch entry, and any function switch entry is used to implement the function of the control device through a peripheral device.
  • the target interface is a multi-device control center interface, and the display instruction is triggered by a user through operating system-level keys or preset gestures; or the target interface is a software-hardware switching interface, and the The display instruction is triggered by the user through a preset button on the application interface.
  • the at least one function switch entry includes: at least one hardware switch entry, and/or at least one software switch entry; before the control device displays the target interface, the control device determines the at least one hardware switch entry displayed in the target interface; and/or the control device determines the at least one software switch entry displayed in the target interface.
  • the control device determines the at least one hardware switch entry displayed in the target interface according to at least one of the following ways: the control device detects at least one peripheral device in the current environment , determine the hardware capability of the at least one peripheral device, and determine the at least one hardware switch entry according to the hardware capability of the at least one peripheral device; the control device determines the hardware requirement corresponding to the currently executed task, and determines the hardware requirement according to the hardware requirement The at least one hardware switch entry is determined; the control device determines a first peripheral device that is currently connected to the control device, and determines the at least one hardware switch entry according to the hardware capability of the first peripheral device.
  • the control device determines the at least one software switching entry displayed in the target interface according to at least one of the following ways: the control device detects at least one peripheral device in the current environment , determine the software capability of the at least one peripheral device, and determine the at least one software switch entry according to the software capability of the at least one peripheral device; the control device determines the software requirement corresponding to the currently executed task, and determines the software requirement according to the software requirement The at least one software switch entry is determined; the control device determines a second peripheral device that is currently connected to the control device, and the at least one software switch entry is determined according to the software capability of the second peripheral device.
  • the target interface further includes an identifier of at least one peripheral device; before the control device displays the target interface, the control device detects at least one peripheral device in the current environment, and displays the at least one peripheral device in the current environment. The identifier of the at least one peripheral device is displayed on the target interface.
  • the control device sorts the identifiers of the at least one peripheral device according to the following manner: the control device ranks the at least one peripheral device according to the distance between the peripheral device and the control device. The identifiers of the peripheral devices are sorted; or the control device sorts the identifiers of the at least one peripheral device according to the frequency of use of the peripheral devices; the control device sorts the identifiers of the at least one peripheral device in the The identifier of the at least one peripheral device is displayed on the target interface.
  • the control device after the control device displays the target interface, the control device receives a target switching instruction, where the target switching instruction is used to instruct the control device to implement the control device through a target peripheral device the target function; the control device implements the target function through the target peripheral device in response to the target switching instruction.
  • the target function is a preset hardware function or software function; or the target function is a hardware function or a hardware function determined by the control device according to the hardware capability or software capability of the target peripheral device.
  • software function; or the target function is a hardware function or a software function determined by the control device according to the currently executed task.
  • an embodiment of the present application further provides an electronic device, including a processor and a memory; the memory is used to store one or more computer programs, and when the computer program is executed by the processor, the Electronic device execution: determine the functional requirements of the currently executed task; detect at least one first peripheral device in the current environment, and determine the capability information of the at least one first peripheral device; according to the functional requirements of the currently executed task and the at least one first peripheral device The capability information of a first peripheral device determines at least one first function switch entry; wherein, the first function switch entry is used to map the function corresponding to the first function switch entry to the at least one first peripheral device; The function corresponding to the first function switching entry is part or all of the functions in the functional requirements of the currently executing task; the display screen is used to display the at least one first function switching entry.
  • the electronic device when the computer program is executed by the processor, the electronic device further executes: before determining the functional requirements of the currently executed task, receiving a display instruction; wherein the display instruction is used for Instruct the control device to display a target interface; after the control device determines at least one first function switching entry according to the functional requirements of the currently executed task and the capability information of the at least one first peripheral
  • the target interface is displayed on the device; wherein, the target interface includes at least one first function switching entry, and/or the identifier of the at least one first peripheral device.
  • the target interface is a multi-device control center interface, and the display instruction is triggered by a user through operating system-level keys or preset gestures; or the target interface is a software-hardware switching interface, and the The display instruction is triggered by the user through a preset button on the application interface.
  • the at least one first function switch entry includes: at least one hardware switch entry, and/or at least one software switch entry; when the computer program is executed by the processor, the computer program causes the The electronic device specifically performs: determining the at least one hardware switch entry according to the hardware function requirements of the currently executed task and the hardware capability information of the at least one first peripheral device; and/or, according to the software function requirements of the currently executed task and the Software capability information of at least one first peripheral device determines the at least one software switch entry.
  • the electronic device when the computer program is executed by the processor, the electronic device further executes: determining capability information of a second peripheral device currently establishing a connection with the control device; The capability information of two peripheral devices determines at least one second function switch entry; wherein, the second function switch entry is used to map the function corresponding to the second function switch entry to the second peripheral device; the second function switch entry is used to map the function corresponding to the second function switch entry to the second peripheral device; The function corresponding to the function switching entry is part or all of the functions in the functional requirements of the currently executing task.
  • the electronic device when the computer program is executed by the processor, the electronic device further executes: after the display screen displays the target interface, receiving a target switching instruction, the target switching instruction It is used for instructing the control device to map the target function to the target peripheral device; in response to the target switching instruction, the target function is implemented through the target peripheral device.
  • the target function is a preset hardware function or software function; or the target function is a hardware function or a hardware function determined by the control device according to the hardware capability or software capability of the target peripheral device.
  • software function; or the target function is a hardware function or a software function determined by the control device according to the currently executed task.
  • the current task performed by the control device is to play a video
  • the first peripheral device in the current network connection is a smart screen device
  • the The electronic device specifically performs: determining that the functional requirement of the currently executing task is video output, and determining that the capability information of the smart screen device supports playing audio and video; determining that the first function switching entry is screen projection; or
  • the current task performed by the control device is to play audio, and the first peripheral device in the current network connection is a speaker; when the computer program is executed by the processor, the electronic device is made to specifically execute: determine the current execution The functional requirement of the task is audio output, and the capability information of the speaker is determined to support audio playback; it is determined that the first function switch entry is audio output; or
  • the current task performed by the control device is K song
  • the first peripheral device in the current network connection is a smart screen device and a speaker
  • the electronic device when the computer program is executed by the processor, the electronic device is specifically executed: determine: The functional requirements of the current execution task are video output, audio output and audio input, and the capability information of the smart screen device is determined to support the playback of audio and video, and the capability information of the speaker is determined to support the playback of audio and audio input; Determine that the first function switch entry is screen projection, audio output, and audio input.
  • an embodiment of the present application further provides an electronic device, the electronic device including a module/unit for performing any one of the possible design methods in any of the foregoing aspects.
  • These modules/units can be implemented by hardware or by executing corresponding software by hardware.
  • the embodiments of the present application further provide a computer-readable storage medium, where the computer-readable storage medium includes a computer program, and when the computer program is run on an electronic device, the electronic device is made to perform any one of the above aspects any of the possible design methods.
  • the embodiments of the present application further provide a method including a computer program product that enables the electronic device to perform any one of the possible designs in any of the foregoing aspects when the computer program product runs on a terminal.
  • an embodiment of the present application further provides a chip, where the chip is used to read a computer program stored in a memory and implement any one of the possible design methods in any of the above aspects.
  • an embodiment of the present application further provides a chip system, where the chip system includes a processor, and is configured to support a terminal device to implement any possible design method of any one of the foregoing aspects.
  • the chip system further includes a memory for storing necessary program instructions and data of the terminal device.
  • the chip system may be composed of chips, or may include chips and other discrete devices.
  • FIG. 1 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application
  • FIG. 2 is a schematic diagram of a software structure of an electronic device according to an embodiment of the present application.
  • FIG. 3 is a schematic diagram of an interface of a first multi-device control center provided by an embodiment of the present application
  • FIG. 4 is a schematic diagram of a second multi-device control center interface provided by an embodiment of the present application.
  • 5-6 are schematic diagrams of different display modes of peripheral device areas in a multi-device control center interface provided by an embodiment of the application;
  • Fig. 7-Fig. 13 is a schematic diagram of displaying at least one hardware switching entry in a multi-control device center interface provided by an embodiment of the application;
  • 14a-14c are schematic diagrams of different display styles of peripheral device areas in a multi-device control center interface provided by an embodiment of the application;
  • 15 is a schematic diagram of an interface of a multi-device control center provided by an embodiment of the application after the control device has been connected to peripheral devices;
  • 16-19 are schematic diagrams of displaying at least one software switching entry on a multi-device control center interface provided by an embodiment of the present application.
  • 20-26 are schematic diagrams of different display styles of the software switching entry and the hardware switching entry in the multi-device control center interface provided by an embodiment of the present application;
  • 27-30 are schematic diagrams of different display styles of a multi-device control center interface provided by an embodiment of the application.
  • 31-37 are schematic diagrams of displaying at least one hardware switching entry on a software-hardware switching interface provided by an embodiment of the present application
  • 38-45 are schematic diagrams of displaying at least one software switching entry on a software-hardware switching interface provided by an embodiment of the present application.
  • 46-49 are schematic diagrams of different display styles of a software-hardware switching interface provided by an embodiment of the present application.
  • 50 is a schematic diagram of a software and hardware switching interface triggered and displayed by a user when the control device provided by an embodiment of the application performs a photographing task;
  • 51 is a schematic diagram of a display interface of the control device after a user triggers a target switching instruction when the control device provided by an embodiment of the application performs a photographing task;
  • FIG. 52 is a schematic diagram of a display interface of a smart screen device after a user triggers a target switching instruction when the control device provided by an embodiment of the application performs a photographing task;
  • 53 is a flowchart of a method for determining a function switching entry provided by an embodiment of the present application.
  • 54 is a schematic structural diagram of yet another electronic device provided by an embodiment of the application.
  • FIG. 55 is a schematic structural diagram of another electronic device according to an embodiment of the present application.
  • the Internet of Things refers to the real-time collection of any information that needs to be monitored and connected through various devices and technologies such as information sensors, radio frequency identification technology, global positioning systems, infrared sensors, and laser scanners. , interactive objects or processes, collect all kinds of needed information, realize the ubiquitous connection between objects and objects and objects and people through various possible network access, and realize intelligent perception, identification and management of objects and processes;
  • the Internet of Things is an information carrier based on the Internet, traditional telecommunication networks, etc., which enables all common physical objects that can be independently addressed to form an interconnected network.
  • Electronic devices such as mobile phones, tablets, wearable devices (eg, watches, bracelets, helmets, headphones, necklaces, etc.), in-vehicle devices, augmented reality (AR)/virtual reality (VR) Devices, notebook computers, ultra-mobile personal computers (ultra-mobile personal computers, UMPCs), netbooks, personal digital assistants (personal digital assistants, PDAs), etc.
  • AR augmented reality
  • VR virtual reality
  • notebook computers notebook computers
  • ultra-mobile personal computers ultra-mobile personal computers
  • UMPCs ultra-mobile personal computers
  • netbooks personal digital assistants
  • PDAs personal digital assistants
  • the electronic device may include the following categories: a control device, a peripheral device, and a peripheral device. These types of electronic devices are described below:
  • the control device is an electronic device that controls peripheral devices and peripheral devices, and is generally an electronic device that is often used and carried by a user, such as a smart phone.
  • the user uses the control device to connect the peripheral device or the peripheral device, and the control device can send control instructions to the peripheral device or the peripheral device according to the instruction triggered by the user, so as to realize the control of the peripheral device or the peripheral device.
  • Peripheral devices are commonly used electronic devices, or electronic devices of the same brand as the control device, such as tablet computers, computers, smart screen devices, and speakers.
  • Peripherals are electronic devices that are used infrequently or belong to a different brand from the control device but can interact with the control device, such as speakers, smart cameras, etc.
  • the multi-device control function can realize the control of the peripheral device and/or the peripheral device by the control device, so as to realize the function of the control device through the software and hardware capabilities of the peripheral device and/or the peripheral device.
  • the target interface can be displayed on the display screen according to the display instruction triggered by the user;
  • the target interface in the embodiment of the present application includes a multi-device control center interface and a software-hardware switching interface.
  • the multi-device control center interface may be displayed on the display screen according to the multi-device control center interface display instruction input by the user.
  • the multi-device control center interface displayed by the control device displays the function entry of the control device, the software/hardware switching entry, the identifier of the peripheral device, and the identifier of the peripheral device.
  • the software-hardware switching interface when the multi-device control function of the control device is turned on, if a software-hardware switching interface display instruction input by the user is received while the application is running in the foreground, the software-hardware switching interface can also be displayed on the display screen.
  • the software and hardware switching interface displays the software and hardware switching entrance, the identification of the peripheral device and the identification of the peripheral device.
  • the peripheral device and/or the peripheral device After the peripheral device and/or the peripheral device enables the multi-device control function, it can receive the capability query message sent by the control device, and feed back its hardware capability information or software capability information to the control device according to the capability query message; or the peripheral device And/or the peripheral device can actively broadcast its own hardware capability information or software capability information after enabling the multi-device control function.
  • control device, the peripheral device, and the multi-device control function of the peripheral device may be carried by itself or obtained by installing an application.
  • control device, the peripheral device, and the multi-device control function of the peripheral device can be activated after the power is turned on, or can be activated by the user by operating them.
  • the hardware switch entry is a virtual button displayed on the display screen of the control device and used to trigger the control device to map the function corresponding to the hardware switch entry to the peripheral device.
  • the hardware switching entry of the control device is "screen projection”. After the user clicks "screen projection" on the display screen of the control device, the user selects the peripheral devices used for screen projection, and the control device switches the video corresponding to the hardware switch entry of "screen projection”.
  • the output function is mapped to a peripheral device so that the peripheral device acts as a video output device for the control device.
  • the software switch entry is a virtual button displayed on the display screen of the control device and used to trigger the control device to map the function corresponding to the software switch entry to the peripheral device.
  • the software of the control device switches to the entry "computer mode”.
  • the control device switches the software to the entry "computer mode”. "The software functions displayed in the corresponding computer mode are mapped to the smart screen device, so that the content displayed on the display screen of the current control device is projected to the smart screen device in computer mode.
  • FIG. 1 shows a schematic structural diagram of a possible electronic device 100 to which the display method provided by the embodiment of the present application is applicable.
  • the electronic device 100 may include a processor 110 , an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , a power management module 141 , and a battery 142 , Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Interface 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, Camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • SIM subscriber identification module
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the USB interface 130 is an interface that conforms to the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
  • the wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR).
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • global positioning system global positioning system, GPS
  • global navigation satellite system global navigation satellite system, GLONASS
  • Beidou navigation satellite system beidou navigation satellite system, BDS
  • quasi-zenith satellite system quadsi -zenith satellite system, QZSS
  • SBAS satellite based augmentation systems
  • the display screen 194 is used to display a display interface of an application, such as a viewfinder interface of a camera application.
  • Display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed
  • quantum dot light-emitting diode quantum dot light emitting diodes, QLED
  • the electronic device 100 may include one or N display screens 194 , where N is a positive integer greater than one.
  • the electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the ISP is used to process the data fed back by the camera 193 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and so on.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs.
  • the electronic device 100 can play or record videos of various encoding formats, such as: Moving Picture Experts Group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG Moving Picture Experts Group
  • MPEG2 moving picture experts group
  • MPEG3 MPEG4
  • MPEG4 Moving Picture Experts Group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing the instructions stored in the internal memory 121 .
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area may store the operating system, and the software code of at least one application (eg, iQIYI application, WeChat application, etc.).
  • the storage data area may store data generated during the use of the electronic device 100 (eg, captured images, recorded videos, etc.) and the like.
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. Such as saving pictures, videos and other files in an external memory card.
  • the electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
  • the sensor module 180 may include an acceleration sensor 180A, a distance sensor 180B, a touch sensor 180C, and the like.
  • the acceleration sensor 180A can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes).
  • the magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to recognize the posture of the electronic device 100, and can be used in applications such as horizontal and vertical screen switching, and pedometers.
  • the distance sensor 180B is used to measure the distance.
  • the electronic device 100 can measure the distance through infrared or laser. In some embodiments, the electronic device 100 may utilize the distance sensor 180B to measure distances to determine the distance between other electronic devices and the electronic device 100 .
  • the touch sensor 180C is also called “touch panel”.
  • the touch sensor 180C may be disposed on the display screen 194, and the touch sensor 180C and the display screen 194 form a touch screen, also referred to as “touch screen” or “touch display screen”.
  • the touch sensor 180C is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations may be provided through display screen 194 .
  • the touch sensor 180C may also be disposed on the surface of the electronic device 100 , which is different from the location where the display screen 194 is located.
  • the keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It can also be a touch key.
  • the electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .
  • Motor 191 can generate vibrating cues.
  • the motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.
  • the SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting into the SIM card interface 195 or pulling out from the SIM card interface 195 .
  • FIG. 1 do not constitute a specific limitation on the electronic device 100, and the electronic device provided in this embodiment of the present application may further include more or less components than those shown in the figure, or combine some components, Or split some parts, or different parts arrangement.
  • the combination/connection relationship between the components in FIG. 1 can also be adjusted and modified.
  • FIG. 2 shows a block diagram of a software structure of an electronic device provided by an embodiment of the present application.
  • the software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the Android system is divided into four layers, which are, from top to bottom, an application layer, an application framework layer (framework, FWK), an Android runtime (Android runtime) and a system library, and a kernel layer.
  • the application layer can include a series of application packages. As shown in FIG. 2, the application layer may include camera, settings, skin modules, user interface (UI), third-party applications, and the like. Among them, the three-party applications can include WeChat, QQ, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and so on.
  • UI user interface
  • the three-party applications can include WeChat, QQ, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and so on.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer can include some predefined functions.
  • the application framework layer may include a window manager, a content provider, a view system, a resource manager, a multi-device control function manager, and the like.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • Content providers are used to store and retrieve data and make these data accessible to applications.
  • the data may include video, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. View systems can be used to build applications.
  • a display interface can consist of one or more views.
  • the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the multi-device control function manager can determine the software/hardware switching entry, detect peripheral devices and/or peripheral devices, and control the display of the multi-device control center interface. Wherein, the interface of the multi-device control center displays the function entry of the control device, the software/hardware switching entry, the identifier of the peripheral device and the identifier of the peripheral device.
  • the multi-device control function manager can determine the software/hardware switching entry, detect peripheral devices and/or peripheral devices, and control and display the software-hardware switching interface. Wherein, the software/hardware switching interface displays the software/hardware switching entry, the identifier of the peripheral device and the identifier of the peripheral device.
  • the Android runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
  • the core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • a system library can include multiple functional modules. For example: surface manager (surface manager), media library (media library), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library media library
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.
  • the hardware layer may include various types of sensors, such as acceleration sensors, touch sensors, etc. involved in the embodiments of the present application.
  • the control device in the embodiment of the present application may be the electronic device described in FIG. 1 to FIG. 2 , and the display method of the multi-device control center interface on the control device in the embodiment of the present application may be applied to a full-scenario smart life scene.
  • All-scenario smart life refers to controlling multiple electronic devices through control devices, so as to realize the collaborative work of electronic devices in various scenarios.
  • connecting other electronic devices with strong software/hardware capabilities to the control device can utilize the software/hardware capabilities of various electronic devices to improve user experience.
  • the "1+8+N" strategy can be adopted to improve the user experience for smart life in all scenarios. in:
  • control device 1 represents the control device, which can be an electronic device commonly used by users, such as a mobile phone; the control device, as the control center in the full-scene smart life, is the main entrance for the interaction of various electronic devices in the full-scene smart life.
  • peripheral devices such as personal computer (PC), tablet, smart screen device, speaker, glasses, watch, car machine, and earphone, which are used as auxiliary entrances.
  • PC personal computer
  • tablet smart screen device
  • speaker speaker
  • glasses watch
  • car machine car machine
  • earphone auxiliary entrances
  • N stands for peripherals such as cameras, sweepers, and smart scales, covering five scenarios: mobile office, smart home, sports health, audio-visual entertainment, and smart travel.
  • the control device when the control device is playing a video, the user can click the button corresponding to the screen projection function on the control device, and choose to project the video played on the control device to the smart screen device.
  • the currently playing video data is sent to the smart screen device, and the smart screen device plays according to the received video data to complete the screen projection process.
  • the control device when the control device is playing audio, the user can connect the control device to the speaker in the current environment through operations, and then the control device sends the currently playing audio data to the speaker; the speaker plays the audio file according to the received audio data, thereby Improve the audio playback effect based on your own audio playback advantages.
  • the embodiments of the present application provide a method for determining a function switching entry, so as to provide a flexible way of determining a software/hardware switching entry, and assist a user to conveniently and quickly utilize the software/hardware capabilities of peripheral devices.
  • the user can send a multi-device control center interface display instruction to the control device by pressing keys, touch the display screen or voice input, or by other means, and the control device displays the multi-device control center interface on the display screen after receiving the display instruction.
  • the user can perform a swipe up gesture operation at the bottom of the touch display screen of the control device to trigger the control device to display the multi-device control center interface; or the user can perform a swipe gesture operation at the top of the touch display screen of the control device to trigger the control device to display the multi-device control center interface.
  • Control center interface or the user can perform a swipe gesture operation from the side of the touch screen to trigger the control device to display the multi-device control center interface.
  • the multi-device control center interface can display the identifiers of the current peripheral devices of the control device, as well as the hardware switching entry and software switching entry of the control device, as shown in FIG. 3 and FIG. 4 .
  • the control device can display the multi-device control center interface in a partial area of the display screen. At this time, since the multi-device control center interface does not occupy the entire display area of the display screen, the user can slide up and down by sliding up and down. See more in the multi-device control center interface.
  • the control device may also display the multi-device control center interface in full screen, as shown in FIG. 4 .
  • the multi-device control center interface shown in FIG. 4 is taken as an example for description.
  • the multi-device control center interface may include, but is not limited to, a control device function area, a software and hardware switching entry area, a peripheral device area, and a peripheral device area.
  • the control device function area display includes buttons corresponding to the control device mode, network connection mode, basic settings and other function entrances, such as the "Bluetooth” button, "Airplane Mode” button, and "Torch” button as shown in Figure 4.
  • the software and hardware switching entry area displays the hardware switching entry and software switching entry provided by the control device, such as hardware switching entry such as "screen projection” and "audio output", and software switching entry such as "mirror" and "computer mode”.
  • the control device displays the identifiers of the peripheral devices that can be detected by the current control device in the peripheral device area. For example, the control device displays the icons and/or names of peripheral devices such as "speaker” and “smart screen” in the peripheral device area.
  • the control device displays the identifiers of the peripheral devices that the control device can detect in the peripheral device area, for example, the control device displays the icons and/or names of peripheral devices such as "air purifier" and "speaker” in the peripheral device area.
  • the control device detects the peripheral devices in the current network connection, where the current network connection may be a WiFi network, a local area network, or a Bluetooth network.
  • control device can detect the peripheral devices connected to the same local area network as the control device through WiFi, or the control device can detect the peripheral devices with the Bluetooth function turned on through the Bluetooth connection technology.
  • the control device displays the icons and names of the detected peripheral devices in the peripheral device area of the multi-device control center interface.
  • control device when the control device displays the identifier of the at least one peripheral device in the multi-device control center interface, it can use at least one of the following methods to sort the identifier of the at least one peripheral device:
  • Manner 1 Sort the identifiers of at least one peripheral device according to the distance between the peripheral device and the control device.
  • the control device detects the distance between the peripheral device and the control device, and sorts the detected identifiers of the peripheral device according to the distance between the peripheral device and the control device in descending order.
  • the control device detects that the peripheral devices include smart screen devices, tablets, and speakers. According to the distance between the detected peripheral devices and the control device, they are sorted from near to far into speakers, tablets, and smart screen devices.
  • the multi-device control center interface displayed by the control device is shown in Figure 5, in which, in the peripheral device area of the multi-device control center interface, the identifiers of speakers, tablets, and smart screen devices are displayed sequentially from left to right.
  • the distance between the peripheral device and the control device can be detected according to the following methods:
  • the control device After detecting any peripheral device, the control device obtains the WiFi positioning information of the peripheral device, and determines the distance between the peripheral device and the control device according to the WiFi positioning information of the control device itself and the WiFi positioning information of the peripheral device.
  • the Bluetooth indoor positioning system can locate the control device and the peripheral devices by measuring the signal strength, and send the positioning information to the control device. and peripheral devices, after the control device obtains its own positioning information, it obtains the positioning information of the peripheral devices by interacting with the peripheral devices, and determines the positioning information between the control device and the peripheral devices according to the positioning information of the control device itself and the peripheral devices. distance.
  • the control device can measure the distance between itself and the surrounding devices through the distance sensor.
  • the control device can measure the distance between itself and the surrounding device through infrared, laser or ultrasonic waves.
  • the distance sensor ranging method is introduced: the control device emits ultrasonic waves in the direction of the surrounding equipment, and starts timing at the same time as the emission. , the control device stops timing immediately after receiving the reflected wave. The control device determines the distance between the control device and the surrounding devices according to the propagation speed of the ultrasonic wave in the air and the timing time.
  • the control device captures images including peripheral devices through the camera, and the image sensor of the control device performs depth calculation on the captured images to determine the distance between the control device and the peripheral devices.
  • the image sensor can use the target detection frame to detect peripheral devices, and convert the pixel coordinates in the image into world coordinates according to the coordinate conversion formula, so as to calculate the depth information of the target detection frame corresponding to the peripheral device. The calculated depth information is used as the distance between the control device and the surrounding devices.
  • control device determines the distance between the control device and the peripheral device
  • control device may also determine the distance between itself and the peripheral device in other ways.
  • control device uses multiple methods at the same time to determine the distance between itself and surrounding devices.
  • Manner 2 Sort the identifiers of at least one peripheral device according to the usage frequency of the peripheral devices.
  • the control device records the frequency at which the user selects the peripheral devices, and sorts the detected identifiers of the peripheral devices according to the order of usage frequency from high to low.
  • the control device detects that the peripheral devices include smart screen devices and tablets, and sorts the peripheral devices according to the frequency of the user using the peripheral devices. If the user uses the smart screen more frequently, the peripheral devices are sorted into smart screen devices, flat.
  • the multi-device control center interface displayed by the control device is shown in FIG. 6 , in which, in the multi-device control center interface, peripheral devices sequentially display the signs of the smart screen device and the tablet from left to right.
  • control device may determine the hardware switching entry displayed on the interface of the multi-device control center according to at least one of the following methods:
  • Manner 1 The control device determines at least one hardware switching entry displayed on the interface of the multi-device control center according to the detected hardware capability information of the peripheral devices.
  • the control device determines the hardware switch entry according to the detected hardware capability information of the peripheral device. Specifically, after the control device detects the peripheral device, it simultaneously detects the device information of the peripheral device.
  • the device information of the peripheral device includes the device type, device name, and hardware capability information of the peripheral device.
  • the control device according to the hardware capability information of the peripheral device, Determine the hardware switch entry corresponding to the hardware capability of the peripheral device, and display the determined hardware switch entry on the multi-device control center interface.
  • the control device determines the hardware switch entry according to the hardware capability information fed back by the peripheral device. Specifically, after the control device detects the peripheral device, it sends a hardware capability query message to the peripheral device, and the peripheral device sends hardware capability information to the control device after receiving the hardware capability query message sent by the control device. The hardware capability information of the peripheral device is determined, and the hardware switching entry corresponding to the hardware capability possessed by the peripheral device is determined, and the determined hardware switching entry is displayed on the interface of the multi-device control center.
  • control device After the control device determines the hardware switch entries displayed in the multi-device control center, it sorts the hardware switch entries according to the order of the identifiers of the peripheral devices. or sort the hardware switching entries according to the usage frequency of the hardware switching entries, for example, display the ordering of the software and hardware switching entries with high frequency to the front.
  • Embodiments 1 to 3 uses Embodiments 1 to 3 to further describe how the control device in this embodiment of the present application determines at least one hardware switching entry displayed on the interface of the multi-device control center according to the detected hardware capability information of peripheral devices:
  • Embodiment 1 The control device detects that the peripheral devices include smart screen devices, tablets, and speakers. According to the distance between the detected peripheral devices and the control device, they are sorted from near to far into speakers, tablets, and smart screen devices; detection The hardware capability information of the peripheral device determines the hardware switch entry corresponding to the peripheral device: the hardware capability of the speaker is to play audio and radio; the hardware capability of the tablet and smart screen devices is to have a screen, a camera, and the ability to play audio, etc.; The hardware switch entry corresponding to the device is "screen projection”, “audio output”, “audio input” and “camera switch”; the determined hardware switch entry is sorted according to the frequency of the user's use of the hardware switch entry: “screen projection” , “Audio Output”, “Audio Input”, and “Camera Switching", in this scenario, the multi-device control center interface displayed by the control device is shown in Figure 7.
  • Embodiment 2 The control device detects that the peripheral device has a smart screen device; the hardware capability information that the control device receives feedback from the peripheral device is: the hardware capability of the smart screen device is that it has a screen, can play audio, etc., then determine the hardware corresponding to the peripheral device.
  • the switch entries are "screen projection” and “audio output”; the hardware switch entries are sorted according to the frequency of the user's use of the hardware switch entry: “screen projection” and “audio output”, then in this scenario, the control device displays more
  • the interface of the device control center is shown in Figure 8.
  • the logo of the smart screen device is displayed in the peripheral device area, and the hardware switch entrances of "screen projection” and “audio output” are displayed in sequence from left to right in the software and hardware switching entry area.
  • Example 3 The control device detects that the peripheral devices include smart screen devices and tablets, and sorts the peripheral devices according to the usage frequency of the peripheral devices. If the usage frequency of the smart screen devices is higher, the peripheral devices are sorted into smart screen devices and tablet devices. ;
  • the hardware capability information that the control device receives feedback from peripheral devices is: the hardware capability of the smart screen device is that it has a screen, can play audio, etc., and the hardware capability of the tablet is that it has a screen, can play audio, and has keyboard input capabilities; then determine the peripheral device.
  • the corresponding hardware switching entries are "screen projection”, “audio output” and “keyboard input”; the hardware switching entries are sorted according to the order of peripheral devices, and the strong hardware capabilities of smart screen devices and tablets are corresponding to "with screen”
  • the hardware switching entry "screen projection” is ranked first, then the hardware switching entry can be sorted as follows: “screen projection”, “audio output”, “keyboard input”, then in this scenario, the multi-device control displayed by the control device
  • the center interface is shown in Figure 9. In the peripheral equipment area, the logos of smart screen devices and tablets are displayed in sequence from left to right, and "screen projection", "audio output”, "" Keyboard input” hardware switch entry.
  • the embodiment of the present application can adjust the hardware switching entry displayed on the interface of the multi-device control center according to the detected peripheral device, and display the hardware switching entry related to the detected peripheral device in the multi-device control center interface.
  • the device control center interface it is convenient for the user to select the currently available hardware switch entry, and the user experience is improved.
  • Mode 2 The control device determines at least one hardware switching entry displayed on the interface of the multi-device control center according to the hardware function requirements of the currently executing task.
  • the control device determines the hardware function requirements of the currently executed task and determines at least one hardware switching entry displayed on the multi-device control center interface. If the currently executed task of the control device is a task that interacts with the user, such as a game, then the control device determines the function of the currently executed task. If the requirement is an external gamepad, the control device determines that the hardware switch entry can include "gamepad"; or the control device is currently executing a task that requires screen playback, such as playing a video, then the control device determines that the function requirement of the currently executing task is video output, audio output, the control device determines that the hardware switch entry can include "screen projection" and "audio output".
  • control device determines at least one hardware switching entry displayed on the multi-device control center interface according to the hardware function requirements of the currently executing task with Embodiments 4 to 7:
  • Embodiment 4 The control device currently runs the "K song” application, and when the control device performs the singing task, the control device displays the "K song” application interface as shown in the left figure in Figure 10; the user triggers the multi-device control center interface display instruction, The control device determines that the hardware functional requirements of the currently executed singing task are video output, audio output and audio input, and then determines that the hardware switching entry is "audio output", "audio input” and “screen projection”, as shown on the right in Figure 10, Control the device and display the identification of the peripheral device detected by the control device in the peripheral device area of the multi-device control center interface, and display the hardware switch entry "audio output” and “audio input” in the software and hardware switch entry area of the multi-device control center interface. and "Screencast".
  • Embodiment 5 The control device currently runs the "K song” application, and when the control device performs the task of recording a singing video, the control device displays the "K song video recording” application interface as shown in the left figure in Figure 11; the user is triggering multi-device control.
  • the center interface displays instructions, and the control device determines that the hardware function requirements of the currently executing task of recording singing video are video output, audio output, audio input and video input, and then determine the hardware switching entry as "audio output", "audio input”, “camera”.
  • Switch” and “Screencast” as shown on the right in Figure 11, the control device displays the identification of the peripheral devices detected by the control device in the peripheral device area of the multi-device control center interface, as well as the software and hardware on the multi-device control center interface.
  • the switch entry area displays the hardware switch entries "Audio Output", “Audio Input”, "Camera Switch” and "Screen Casting".
  • Embodiment 6 The control device currently performs a document viewing or document editing task, and when the control device displays the document interface as shown in the left figure in Figure 12, the user triggers a multi-device control center interface display instruction, and the control device determines the hardware of the currently executed task. If the functional requirements are screen display and keyboard input, then determine the hardware switching entry as "screen projection” and "keyboard input", as shown in the right figure in Figure 12, in the peripheral device area of the multi-device control center interface, the control device detects the Peripheral devices, as well as the hardware switch entry "screen projection” and "keyboard input” are displayed in the software and hardware switch entry area of the multi-device control center interface.
  • Embodiment 7 The control device currently runs a game application. As shown in Figure 13, the control device displays a game interface, the user triggers a multi-device control center interface to display an instruction, and the control device determines that the hardware function requirements of the currently executed game task are audio output, external For gamepad, determine the hardware switch entry as "Audio Output” and "Gamepad", and display the identification of peripheral devices detected by the control device in the peripheral device area of the multi-device control center interface, as well as the software and hardware in the multi-device control center interface. The switch entry area shows the hardware switch entry "Audio Out” and "Gamepad".
  • the control device can intelligently analyze the current execution task, and determine the hardware switching entry required for the current execution task according to the hardware function requirements of the current execution task, Therefore, different hardware switching portals are displayed on the multi-device control center interface according to different tasks, which facilitates the user to select the required hardware switching portal, simplifies user operations, and improves user experience.
  • the identification of the peripheral device displayed in the peripheral device area in the multi-device control center interface can also be adjusted.
  • the hardware switching entry required for the currently executing task of playing audio is "audio output" and "audio input”
  • determine that the peripheral device with the hardware capabilities required for the audio playing task is Speakers, as shown in Figure 14a, display the speaker's logo in the peripheral device area of the multi-device control center interface; or as shown in Figure 14b, the speaker's logo in the peripheral device area of the multi-device control center interface is in the front position. display; or as shown in Figure 14c, the logo of the speaker is highlighted in the peripheral device area of the multi-device control center interface, and the logos of other peripheral devices are displayed in the form of dotted lines.
  • the control device determines at least one hardware switch entry displayed on the interface of the multi-device control center according to the hardware capability information of the currently established peripheral devices.
  • the control device After the control device is currently connected to the peripheral device, the user triggers the display of the multi-device control center interface display instruction, the control device determines the peripheral device that has established a connection with the control device, and the identification of the peripheral device that has established connection with the control device is in the peripheral device area.
  • the list is ranked first and highlighted, and the corresponding hardware switch entry is determined according to the hardware capability information of the peripheral device, and the hardware switch entry corresponding to the peripheral device is displayed in the software and hardware switch entry area of the multi-device control center interface. In the software and hardware switching entry area of the central interface, the hardware switching entry corresponding to the peripheral device is sorted and highlighted.
  • the multi-device control center interface of the control device is shown in the left figure in Figure 15.
  • the multi-device control center interface is shown in the right figure in Figure 15. display, the logo of the smart screen device in the peripheral device area is highlighted, and the hardware capability information of the smart screen device is determined to be: support for playing audio and video, then the hardware switch entry is determined to be "screen projection" and "audio output", and the smart screen
  • the hardware switch entry corresponding to the device is ranked first and highlighted, which can more intuitively display the currently connected peripheral device and the hardware capabilities that the peripheral device can provide.
  • control device after the control device detects the peripheral device, it can determine the software switching entry displayed on the interface of the multi-device control center according to at least one of the following methods:
  • Mode 1 The control device determines at least one software switching entry displayed on the interface of the multi-device control center according to the software capability information of the peripheral devices.
  • control device After the control device detects the peripheral device, it determines the software capability information of the peripheral device according to the device attribute of the peripheral device, and determines at least one software switching entry according to the software capability information of the peripheral device;
  • the control device determines the software capability information of the peripheral device as: support for DLNA screen projection, mirroring, and screen expansion and other software functions
  • the software switching entry displayed by the control device in the software and hardware switching entry area of the multi-device control center interface can be: "DLNA screen projection", “mirror”, “screen extension”;
  • the control device determines that the software capability information of the peripheral device is software functions such as supporting task connection or input borrowing.
  • the task connection function By establishing a connection with the peripheral device for the control device, continue to perform the ongoing task of the control device on the peripheral device;
  • the input borrowing function is for the control device to borrow the input content received by the peripheral device, such as the peripheral device outputs the audio output data received by the peripheral device sent to the control device.
  • the software switching entry displayed in the software and hardware switching entry area of the multi-device control center interface can be: "relay”, “data synchronization”, "computer mode”, “ Multi-screen collaboration”.
  • Rule 3 The control device detects that the peripheral device is a device with a small screen, such as a watch, bracelet, glasses, etc., then the control device determines that the software capability information of the peripheral device is software functions such as supporting task connection, then the control device is in the multi-device control center.
  • the software switching entry displayed in the software and hardware switching entry area of the interface can be: "Relay” and "Data Synchronization”.
  • Rule 4 The control device detects that the peripheral device has functions such as noise reduction and intelligent volume adjustment, and determines that the software capability information of the peripheral device supports software functions such as noise reduction and intelligent volume adjustment.
  • the software switch entrance displayed in the hardware switch entrance area can be "Noise Reduction” and “Smart Volume Adjustment”.
  • control device in the embodiment of the present application determines at least one software switching entry displayed on the interface of the multi-device control center according to the detected peripheral devices with Embodiments 8 to 11:
  • Embodiment 8 The control device detects that the peripheral device has a smart screen device, and determines that the attribute of the smart screen device is a large screen.
  • the software switching entry displayed by the control device in the software and hardware switching entry area of the multi-device control center interface can be: "DLNA projection", "mirror” and "screen extension”.
  • Embodiment 9 The control device detects that the peripheral devices include a tablet and a computer, and determines that the tablet and the computer are easy to interact with.
  • the software switching entry displayed by the control device in the software and hardware switching entry area of the multi-device control center interface can be "data synchronization", "multi-screen collaboration” and "computer mode”.
  • Embodiment 10 The control device detects that the peripheral device has a watch, and determines that the attribute of the watch is that the screen is small. As shown in FIG. 18 , the software switching entry displayed by the control device in the software and hardware switching entry area of the multi-device control center interface may be “data synchronization”.
  • Embodiment 11 The control device detects that the peripheral device has earphones, and determines that the earphones have noise reduction function. As shown in Figure 19, the software switch entry displayed by the control device in the software and hardware switch entry area of the multi-device control center interface can be "noise reduction" .
  • Mode 2 The control device determines at least one software switching entry displayed on the interface of the multi-device control center according to the software function requirements corresponding to the currently executed task.
  • the control device determines the software function requirements required for the current task execution according to the currently executed task, and determines the software switching entry corresponding to the software function requirements required for the current task execution. Specifically, the control device can be determined according to at least one of the following rules. At least one software switch entry displayed on the multi-device control center interface:
  • Rule 1 If the task currently performed by the control device is a media playback task, such as playing music, playing video, etc., the control device determines that the software function requirements of the media playback task are audio processing, video processing and other software functions, such as noise reduction, DLNA projection, etc. If the screen is displayed, the software switching entry displayed on the interface of the multi-device control center includes the software switching entry corresponding to screen projection and audio and video playback.
  • the control device determines that the software function requirements of the office task are data processing and other software functions, and then the multi-device control center interface
  • the displayed software switching entry includes the software switching entry corresponding to the task continuation or input borrowing function.
  • the software switching entry includes a software switching entry corresponding to the screen borrowing capability.
  • Embodiments 12 to 14 are used to further describe the manner in which the control device in the embodiment of the present application determines the software switching entry displayed on the interface of the multi-device control center according to the software function requirements of the currently executing task:
  • Embodiment 12 as shown in Figure 20, the task currently performed by the control device is to play a video, the user triggers the multi-device control center interface to display an instruction, and the control device determines that the software switching entry required for the currently executed task of playing the video is "DLNA projection screen”. ”, “Play”, the control device displays the “DLNA projection” and “Play” software switch entries in the software and hardware switch entry area of the multi-device control center interface.
  • Embodiment 13 as shown in Figure 21, the task currently performed by the control device is document editing, the user triggers the multi-device control center interface display instruction, and the control device determines that the software switching entry required for the currently executed document editing task is "relay”, "Data synchronization", the control device displays "relay” and "data synchronization” software switching entry in the software and hardware switching entry area of the multi-device control center interface.
  • Embodiment 14 as shown in Figure 22, the task currently performed by the control device is to display the calendar, the user triggers the multi-device control center interface display instruction, and the control device determines that the software switching entry required for the currently executed display calendar task is "mirror", “Multi-screen collaboration", the control device displays “mirror” and “multi-screen collaboration” software switching entry in the software and hardware switching entry area of the multi-device control center interface.
  • Mode 3 The control device determines at least one software switching entry displayed on the interface of the multi-device control center according to the software capability information of the currently established peripheral devices.
  • the control device After the control device is currently connected to the peripheral devices, the user triggers the multi-device control center interface to display instructions, the control device determines the peripheral devices that have been connected to the control device, and sorts the identifiers of the peripheral devices that have been connected to the control device in the peripheral device area It is displayed in the front and highlighted, and the corresponding software switching entry is determined according to the software capability information of the peripheral device.
  • the software switching entry corresponding to the peripheral device is displayed in the software and hardware switching entry area of the multi-device control center interface, or the In the software and hardware switching entry area of the interface, the software switching entry corresponding to the peripheral device is sorted and highlighted.
  • the software and hardware switching entry area of the multi-device control center interface will preferentially display "multi-screen collaboration", “screen expansion”, “relay”, "computer mode” and other computers that can provide The software switch entry corresponding to the software capability;
  • the software capabilities that the TV can provide such as "mirror”, “DLNA screen projection”, and “computer mode”, will be displayed preferentially in the software and hardware switching entry area of the multi-device control center interface.
  • the software capabilities that the tablet can provide are preferentially displayed in the software and hardware switching entry area of the multi-device control center interface.
  • the software switching corresponding to the software capabilities that the mobile phone can provide such as "mirror”, “relay”, and “screen extension”, will be displayed preferentially in the software and hardware switching entry area of the multi-device control center interface. Entrance.
  • Embodiment 15 uses Embodiment 15 to further describe the manner in which the control device determines the software switching entry displayed on the interface of the multi-device control center according to the software capabilities of the currently established peripheral devices:
  • Embodiment 15 After the user operates the control device and selects the computer, the user triggers the multi-device control center interface display instruction, and the control device determines that the control device and the computer have established a connection, then in this scenario, the multi-device control center interface displayed by the control device is shown in the figure. As shown in 23, the logo of the computer is highlighted in the peripheral device area of the multi-device control center interface, and the software switching entry "multi-screen collaboration", “screen expansion”, “relay”, and "computer mode” are highlighted in the software and hardware switching entry area. .
  • control device can display the hardware switching entry in the software and hardware switching entry area of the multi-device control center interface, as shown in the above-mentioned Embodiments 1 to 7; the control device can display the hardware switching entry area in the software and hardware switching entry area of the multi-device control center interface
  • the software switching entry is displayed, as shown in the above-mentioned Embodiments 8 to 15; the control device can also display the hardware switching entry and the software switching entry simultaneously in the same or different sub-areas in the software and hardware switching entry area of the multi-device control center interface.
  • the software switching entry corresponding to the entry "screen projection" is shown in the dotted box in Figure 24.
  • Another optional way is to display the hardware switching entry and the software switching entry in different sub-areas of the software and hardware switching entry area of the multi-device control center interface. For example, as shown in Figure 25, display hardware in area A. Switching entry, the software switching entry is displayed in area B.
  • Another optional way is to display the hardware switching entry and the software switching entry at the same time in the software and hardware switching entry area of the multi-device control center interface. For example, as shown in Figure 26, after sorting the software switching entry and the hardware switching entry, displayed in the same area.
  • the embodiment of the present application also provides a variety of display styles of the multi-device control center interface.
  • the design concept of the multi-device control center interface in the embodiment of the present application is introduced with the style 1 shown in FIG. 27 , and the area C in FIG. 27 is the control device function. area, the user can set the control device through the shortcut entry of this area.
  • Area D is the software and hardware switching entry area, which is used to display the hardware switching entry and software switching entry of the control device.
  • the buttons displayed in the control device function area and the software and hardware switching entry area are all buttons corresponding to the functions of the control device itself, reflecting the full-scene smart life represented by "1" in the "1+8+N" concept of the full-scene smart life.
  • Control Center - Controls the functionality of the device.
  • the control device displays the identifiers of the currently detected peripheral devices in the area E, and the user can swipe left and right to view or select peripheral devices.
  • the control device displays the identifier of the currently detected peripheral device in the area F, and the user can slide up and down to view or select the peripheral device.
  • the control device displays the identifiers of peripheral devices in the area G of the multi-device control center interface, and displays the software and hardware switching entry in the area H, wherein each software and hardware switching entry corresponds to an expansion button, After the user clicks the expand button, the device list as shown on the right in Figure 28 is triggered to display.
  • the device list is the peripheral devices that have the software and hardware capabilities of the software and hardware switching entry corresponding to the current expand button.
  • the displayed device list is the list of peripheral devices that support audio output; the user selects the target peripheral device in the device list displayed on the touch screen to trigger the target switching instruction, and the control device determines the target switching instruction to pass the target.
  • the peripheral device implements the audio output function of the control device, and the control device uses the target peripheral device selected by the user as the audio output device of the control device.
  • area I in the multi-device control center interface is the software and hardware switching entry area
  • area I is located in the control device functional area
  • area J displays the identifiers of peripheral devices.
  • Pattern 4 as shown in Figure 30, the logo of the peripheral device is displayed in the multi-device control center interface shown in (a) of Figure 30.
  • the display of (b) in Figure 30 is triggered.
  • the control device displays the hardware switching entry on the touch display, and at the same time, the hardware switching entry is displayed on the touch display.
  • the list of peripheral devices corresponding to the hardware switch entry is displayed below. For example, after the user clicks the expand button corresponding to the audio output, the peripheral device list shown in (c) of FIG. 30 is displayed, and the user can select the peripheral device as the audio output device of the control device.
  • the control device runs the application program in the foreground
  • the user triggers the display of the software and hardware switching interface through the preset button in the application; the user sends the software and hardware switching interface display instruction to the control device by clicking the preset button on the touch screen, so that the control device can display the software and hardware switching interface.
  • the control device detects the current peripheral device, and displays the detected identifier of at least one peripheral device in the In the software and hardware switching interface. For example, the control device displays the name of at least one peripheral device detected by the control device in the software and hardware switching interface.
  • the control device adopts the same method as in the above-mentioned operating system-level embodiment, which is not repeated here.
  • control device determines the hardware switching entry and/or software switching entry displayed in the software-hardware switching interface.
  • control device adopts the same method as in the above-mentioned operating system-level embodiment, and details are not repeated here.
  • control device may determine the hardware switching interface displayed on the software-hardware switching interface according to at least one of the following methods.
  • Switch entry :
  • Manner 1 The control device determines at least one hardware switching entry displayed on the software-hardware switching interface according to the detected hardware capability information of the peripheral device.
  • the current touch display screen of the control device displays the interface of the document application program, and the user clicks the "cast screen” button on the document application program interface displayed by the touch screen display to trigger the software and hardware switching interface display instruction , the control device displays the software and hardware switching interface shown in (b) in Figure 31 on the touch screen, and the control device displays the currently detected peripheral devices in the peripheral device area of the software and hardware switching interface.
  • Mode 2 The control device determines at least one hardware switching entry displayed on the software and hardware switching interface according to the hardware function requirements of the currently executing task.
  • the application currently running in the foreground of the control device is the "K song” application, and the currently executed task is recording audio.
  • the hardware switching interface displays the instruction, and the control device displays the software and hardware switching interface on the trigger display screen; as shown in (b) in Figure 32, the control device displays the name of the detected peripheral device in the peripheral device area in the software and hardware switching interface , and determine the hardware switching entry displayed in the software and hardware switching interface according to the currently executed task, if the determined hardware switching entry is "audio output” and "audio input”, then the software shown in (b) in Figure 32
  • the software/hardware switch entry area in the hardware switch interface displays the names of "Audio Output” and "Audio Input”.
  • the audio output selects the smart screen device by default, and the user can modify it manually.
  • the application currently used in the foreground of the control device is the "K song” application, and the currently executed task is to record a singing video.
  • the software and hardware switching interface displays the instruction, and the control device displays the software and hardware switching interface on the trigger display screen; as shown in (b) in Figure 33, the control device displays the detected peripheral device in the peripheral device area in the software and hardware switching interface. and determine the hardware switching entry displayed on the software and hardware switching interface according to the currently executed task.
  • the determined hardware switching entry can be "audio output", “audio input” and “camera”, then in the The software and hardware switching entry area in the software and hardware switching interface shown in (b) displays “audio output”, “audio input” and “camera” hardware switching entry.
  • the audio output defaults to the smart screen device, and the camera defaults to the local front camera that controls the device. The user can manually change the audio output and the peripheral devices used by the camera.
  • the user selects the smart screen device from the peripheral device list corresponding to the camera displayed on the touch screen, triggers the target switching instruction, and controls
  • the device switches the currently used camera to the camera of the smart screen device, sends the request information for borrowing the camera of the smart screen device to the smart screen device, and controls the device to switch the currently used camera to the camera of the smart screen device.
  • trigger the display command to return to the task interface currently executed by the control device
  • the control device displays the task interface on the display screen, and displays the device currently being controlled by the control device on the task interface, as shown in Figure 33.
  • the control device displays the task interface on the display screen, and displays the device currently being controlled by the control device on the task interface, as shown in Figure 33.
  • the name of the smart screen will be displayed on the task interface.
  • the user can click the close button after the name of the smart screen to disconnect the control device and the smart screen device.
  • multiple peripheral devices can be selected as the input or output devices of the control device.
  • the content displayed by the control device is projected to multiple peripheral devices to improve the user's viewing experience; or as shown in Figure 35, the cameras of multiple peripheral devices are selected as the input of the control device, which can record videos from multiple angles in the same space and control the device.
  • a virtual reality (VR) panoramic video is obtained, which improves the playability and practicability of the control device.
  • the live broadcast user can click the "More” button on the touch screen of the current control device to trigger the The "More” interface as shown in (b) in Figure 36 is displayed, and the user clicks the "Director” button in the "More” interface to trigger the display of the camera selection software shown in (c) in Figure 36.
  • the user can select multiple cameras in the device list at the same time, and the control device uses the video captured by the multiple cameras selected by the user as the video input of the control device, as shown in (d) in Figure 36, on the control device display
  • the interface displays the content captured by the cameras of multiple devices in the form of multiple small windows.
  • the control device displays the content in the small window corresponding to the user's click operation on the touch screen in full screen, and reduces the content displayed in the default full screen to the small window for display.
  • the screen captured by the front camera that is displayed in full screen by default on the control device is reduced to displayed in a small window.
  • Mode 3 The control device determines at least one hardware switching entry displayed on the software-hardware switching interface according to the hardware capability information of the currently established peripheral devices.
  • the application program currently running in the foreground of the control device is a document application program.
  • the user triggers the display instruction of the software and hardware switching interface through the "cast screen” button in the application program. If the user triggers the display of the software and hardware switching interface before this time , the display content of the control device has been selected to be projected to the smart screen device, the software and hardware switching interface of this trigger display is shown in the right figure in Figure 37, the smart screen device displays the selected icon, and the "Audio Output" hardware switch entry shows that it is selected Smart screen devices; users can select other devices other than smart screen devices to change the peripheral devices used for screen projection, and users can also manually switch the peripheral devices used by the hardware switch entry.
  • control device may determine at least one displayed on the software and hardware switching interface according to at least one of the following methods.
  • a software switch entry :
  • Manner 1 The control device determines at least one software switching entry displayed on the software and hardware switching interface according to the software capability information of the peripheral device.
  • Embodiments 16 to 19 are used to describe the manner in which the control device in this embodiment of the present application determines the software switching entry displayed on the software and hardware switching interface according to the detected software capability information of peripheral devices:
  • Embodiment 16 The control device detects that the peripheral device has a smart screen device, and determines that the software capability information of the smart screen device is: support for software functions such as DLNA screen projection, mirroring, and screen expansion. As shown in Figure 38, the control device displays the name of the smart screen device in the peripheral device area of the software and hardware switching interface, and displays the software switching entrances of "DLNA screen projection", "mirror” and "screen extension” in the software and hardware switching entry area.
  • Embodiment 17 The control device detects that the peripheral devices include a tablet and a computer, and determines that the software capability information of the tablet and the computer supports software functions such as task connection or input borrowing. As shown in Figure 39, the control device displays the names of the tablet and computer in the peripheral device area of the software and hardware switching interface, and displays the software switching entrances of "data synchronization", "multi-screen collaboration” and "computer mode” in the software and hardware switching entry area .
  • Embodiment 18 The control device detects that the peripheral device has a watch, and determines that the software capability information of the watch is a software function that supports task continuation and the like. As shown in Figure 40, the control device displays the name of the watch in the peripheral device area of the software and hardware switching interface, and displays the "data synchronization" software switching entry in the software and hardware switching entry area of the software and hardware switching interface.
  • Embodiment 19 The control device detects that the peripheral device has earphones, and determines that the software capability information of the earphone has a noise reduction function. As shown in Figure 41, the control device displays the name of the earphone in the peripheral device area in the software and hardware switching interface, and displays the name of the earphone in the software and hardware switching interface. The software and hardware switching entry area of the switching interface displays the "noise reduction" software switching entry.
  • Manner 2 The control device determines at least one software switching entry displayed on the software and hardware switching interface according to the software function requirements corresponding to the currently executed task.
  • Embodiments 20 to 22 are used to describe the manner in which the control device in the embodiment of the present application determines the software switching entry displayed on the software and hardware switching interface according to the software function requirements of the currently executing task:
  • Embodiment 20 as shown in Figure 42, the task currently performed by the control device is to play a video, the user triggers a software-hardware switching interface display instruction on the touch screen display, and the control device determines that the software switching entry required for the currently executing task of playing the video is: "DLNA screen projection” and "play”, the control device displays the "DLNA screen projection” and “play” software switch entrances in the software and hardware switch entry area of the software and hardware switch interface.
  • the task currently performed by the control device is document editing
  • the user triggers a software-hardware switching interface display instruction on the touch screen display
  • the control device determines that the software switching entry required for the currently executing document editing task is: "Relay”, “Data synchronization”, the control device displays “Relay”, “Data synchronization” software switch entry in the software and hardware switch entry area of the software and hardware switch interface.
  • the task currently performed by the control device is to display the calendar
  • the user triggers a software-hardware switching interface display instruction on the touch screen display
  • the control device determines that the currently executed task of displaying the calendar requires the software switching entry to be: "Mirroring" and "Multi-screen collaboration”
  • the control device displays the "Mirroring” and "Multi-screen collaboration” software switching entrances in the software and hardware switching entry area of the software and hardware switching interface.
  • Mode 3 The control device determines at least one software switching entry displayed on the interface of the multi-device control center according to the software capability information of the currently established peripheral devices.
  • the task currently performed by the control device is to view documents
  • the user triggers the software and hardware switching interface display instruction on the touch screen
  • the control device determines that the current control device has established a connection with the smart screen device, then the control device
  • the displayed software and hardware switching interface is shown in the right figure in Figure 45.
  • the icon that the smart screen device has been selected is displayed in the peripheral device area, and the names of other peripheral devices currently detected are displayed, and the software switching entry corresponding to the smart screen device is displayed.
  • "DLNA projection”, "mirror” and “screen extension” are displayed in the front row of the software and hardware switching entry area, and the corresponding software switching entry "multi-screen collaboration" and "relay” corresponding to the tablet are displayed in the rear.
  • the control device After determining the software and hardware switching entry of the control device, the control device displays the software and hardware switching interface, and the embodiment of the present application provides the following four display styles of the software and hardware switching interface:
  • Style 1 After the user triggers the display of the software and hardware switching interface, a list of peripheral devices detected by the control device is displayed. After the user selects a device in the peripheral device list, it triggers the display of various software and hardware switching portals.
  • the user triggers the display of the peripheral device list through the "cast screen" button in the application.
  • the peripheral device list is shown in the left figure in Figure 46.
  • the display is triggered to the right in Figure 46.
  • the control device displays the software and hardware switching interface as shown in Figure 47, including the list of peripheral devices currently detected by the control device and various software and hardware switches. Entrance.
  • Style 3 After the user triggers the display of the hardware switching interface, at least one software and hardware switching entry is displayed, and each software and hardware switching entry corresponds to an expansion button. After the user triggers the expansion button corresponding to the software and hardware switching entry, the display can provide the software and hardware switching entry. A list of devices with corresponding software and hardware functions.
  • the user triggers the display of the software and hardware switching entry interface as shown in the left figure in Figure 48 through the "cast screen" button in the application. After the user clicks the expand button corresponding to the audio output, the display shown in the right figure in Figure 48 is displayed.
  • the user selects the smart screen device in the device list, triggers the target switching instruction, and the control device uses the smart screen device as the audio output device of the control device; at the same time, when the user does not select the device used by the hardware switching portal, the hardware switching portal
  • the hardware switching portal Corresponding to the default options, as shown in the left picture in Figure 48, the default option corresponding to the camera is the front of the camera.
  • the user can also click the display button corresponding to the camera to display the device list, and after the user selects the device, the camera of the device will be selected.
  • the recorded video is used as the video input for the control device.
  • Style 4 After the user triggers the display of the hardware switching interface, the hardware switching entry is displayed according to the above styles 1 to 3. The user clicks the hardware switching entry to trigger the display of the software switching entry corresponding to the hardware switching entry, as shown in the left figure in Figure 49 As shown in the figure, the user clicks on the hardware switch entry of "Projection”, which triggers the display of software switch entries such as "Mirror”, “DLNA Projection", and "Computer Mode” corresponding to "Projection” as shown in the right figure in Figure 49.
  • the control device displays a multi-device control center interface or a software-hardware switching interface
  • the user triggers a target switching instruction
  • the control device determines the target function corresponding to the target switching instruction, and passes the target surrounding
  • the device implements the target function of the control device.
  • the target function corresponding to the target switching instruction has the following situations:
  • the target function is a preset hardware function or software function
  • the control device After receiving the target switching instruction triggered by the user, the control device takes the preset hardware function or software function as the target function. For example, the user clicks the "cast screen” button on the application display interface on the touch screen to control the device to display the device list on the touch screen. The user selects "smart screen” to trigger the target switching instruction, and the control device converts the currently displayed content Cast the screen to the smart screen device. In this scenario, the device is controlled to perform the screencasting function through the "screencast" button in the application, and the target function corresponding to the target switching instruction at this time is the preset screencasting hardware function.
  • the target function is the hardware function or software function determined by the control device according to the hardware capability or software capability of the target peripheral device
  • the control device After the user clicks the preset button on the application program interface on the touch screen, the control device displays a list of peripheral devices on the touch screen, and after the user selects the target peripheral device, the target switching instruction is triggered. If the control device determines that the target peripheral device does not have the hardware capability corresponding to the preset button, the control device determines the hardware capability of the target peripheral device and uses the hardware capability of the target peripheral device as the target function.
  • the control device displays the device list on the touch screen, the user selects "speaker", the control device determines that the speaker does not have screen hardware, And the hardware capability provided by the speaker is audio output, then the control device will automatically use the speaker as the audio output device of the control device.
  • the target function corresponding to the target switching instruction is the audio output hardware function determined according to the hardware capability of the target peripheral device.
  • the target function is the hardware function or software function determined by the control device according to the currently executed task
  • the control device After the user clicks the preset button on the application program interface on the touch screen, the control device displays a list of peripheral devices on the touch screen. After the user selects the target device, the target switching instruction is triggered, and the control device analyzes the currently executed task. Determine the hardware function required by the currently executed task. If the hardware function required by the currently executed task is different from the preset hardware function corresponding to the target switching instruction, the control device takes the hardware function required by the currently executed task as the target function.
  • the control device is currently running the camera application
  • the touch screen of the control device displays a photo-taking interface as shown in (a) in FIG. 50
  • the user triggers the display through the button corresponding to “more options” in the photo-taking interface.
  • the user selects the “cast screen” button in the function list displayed on the touch screen to trigger the display of the hardware switching interface shown in (c) of FIG. 50 .
  • the control device analyzes the currently executed photographing task, and determines that the hardware function required by the currently executed photographing task is the camera photographing function, then By default, the control device uses the camera of the smart screen device to shoot.
  • the camera application interface is displayed on the touch screen of the control device, but the content displayed in the camera application interface is the video file captured by the camera of the smart screen device, and the control device uses the screen projection function to apply the camera to the camera.
  • the interface is projected to the smart screen device.
  • the display content in the camera application interface displayed on the smart screen device is also the video file captured by the local camera of the smart screen device.
  • the user can click the button corresponding to the software function of the camera application on the control device to trigger the control device to call the software function of the camera application, such as the “Add Filter” of the camera application. ”, “beauty” and other software functions; or the user can select the button corresponding to the software function of the camera application displayed on the smart screen device through the controller or somatosensory control of the smart screen device to trigger the target switching instruction; After the user triggers the target switching instruction to call the software function of the camera application, it can be processed according to the following methods:
  • the control device processor invokes the algorithm corresponding to the software function of the camera application, performs image processing on the video file or image captured by the camera of the smart screen device received from the smart screen device, and displays the image-processed video file or image on the touch screen.
  • the control device projects the content currently displayed on the touch screen to the smart screen device, and the smart screen device displays the video file or image after image processing.
  • the control device After the control device projects the camera application interface to the smart screen device, the control device sends the algorithm corresponding to the software function of the camera application to the smart screen device, and the smart screen device saves the received algorithm corresponding to the software function of the camera application to the smart screen
  • the smart screen device invokes the algorithm corresponding to the software function of the camera application, and performs image processing on the video files or images captured by the camera of the smart screen device. Display the processed video file or image on the smart screen device, and at the same time, the smart screen device sends the image-processed video file or image to the control device, and the control device displays the received video file or image to the touch display of the control device on the screen.
  • FIG. 53 it is a flowchart of a method for determining a function switching entry according to an embodiment of the present application, including the following steps:
  • Step S5301 the control device receives a display instruction
  • Step S5302 the control device determines the functional requirements of the currently executing task
  • the current task performed by the control device may be running an application program, displaying a system interface, etc.; for example, the task currently performed by the control device is playing a video. If the control device currently displays a video pause interface at this time, the task currently performed by the control device Still playing video.
  • Step S5303 the control device detects at least one peripheral device in the current environment, and determines capability information of the at least one peripheral device;
  • the capability information of the peripheral device is the software capability or hardware capability of the peripheral device.
  • the peripheral device includes a speaker, and the capability information of the speaker is: supporting functions such as audio output, audio input, and intelligent volume adjustment.
  • control device if the control device has determined at least one peripheral device in the current network connection before receiving the display instruction, the control device can directly determine the capability information of the at least one peripheral device without the need for the current network connection. Peripherals in the device are detected.
  • Step S5304 the control device determines at least one function switching entry according to the functional requirements of the currently executed task and the capability information of at least one peripheral device;
  • Step S5305 the control device displays a target interface containing at least one function switching entry and/or at least one peripheral device identifier
  • Step S5306 the control device receives the target switching instruction
  • the target switching instruction may be an instruction triggered by the user in the target interface, which is used to instruct the control device to map the target function to the target peripheral device.
  • Step S5307 the control device determines the target function corresponding to the target switching instruction
  • control device determines the target function corresponding to the switching instruction
  • Step S5308 the control device implements the target function through the second peripheral device.
  • an embodiment of the present application further provides an electronic device, the electronic device is used to implement the method for determining a function switching entry as described in the above embodiments, as shown in FIG. 54 , in the electronic device 5400 It includes: a processor 5401, a memory 5402 and a display screen 5403, and of course it can also have various peripheral or internal hardware shown in FIG. 1 .
  • the memory 5402 and the processor 5401 are connected to each other.
  • the processor 5401 and the memory 5402 can be connected to each other through a bus;
  • the bus can be a peripheral component interconnect standard (peripheral component interconnect, PCI) bus or an extended industry standard architecture (extended industry standard architecture, EISA) bus, etc.
  • PCI peripheral component interconnect
  • EISA extended industry standard architecture
  • the bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is shown in FIG. 54, but it does not mean that there is only one bus or one type of bus.
  • the memory 5402 is used to store program instructions.
  • program instructions may include program code, which includes instructions for computer operation.
  • the memory 5402 may include random access memory (RAM), and may also include non-volatile memory (non-volatile memory), such as at least one disk storage.
  • the processor 5401 executes the instructions stored in the memory 5402, so that the electronic device 5400 executes: determining the functional requirements of the currently executed task; detecting at least one first peripheral device in the current environment, and determining the at least one first peripheral device.
  • At least one first function switch entry is determined according to the functional requirements of the currently executed task and capability information of the at least one first peripheral device; wherein, the first function switch entry is used to convert the The function corresponding to the first function switch entry is mapped to the at least one first peripheral device; the function corresponding to the first function switch entry is part or all of the functions in the functional requirements of the currently executing task.
  • the display screen 5403 is used to display the at least one first function switch entry.
  • the electronic device when the computer program is executed by the processor 5401, the electronic device further executes: before determining the functional requirements of the currently executed task, receive a display instruction; wherein the display instruction is used to indicate
  • the electronic device 5400 displays a target interface; after determining at least one first function switching entry according to the functional requirements of the currently executed task and the capability information of the at least one first peripheral device, the display screen 5403 displays all the functions.
  • the target interface wherein, the target interface includes at least one first function switching entry, and/or the identifier of the at least one first peripheral device.
  • the target interface is a multi-device control center interface, and the display instruction is triggered by a user through an operating system-level button or a preset gesture; or the target interface is a software-hardware switching interface, and the display instruction Triggered by the user through a preset button on the application interface.
  • the at least one first function switch entry includes: at least one hardware switch entry, and/or at least one software switch entry; when the computer program is executed by the processor 5401, the electronic The device 5400 specifically performs: determining the at least one hardware switch entry according to the hardware function requirements of the currently executed task and the hardware capability information of the at least one first peripheral device; and/or, according to the software function requirements of the currently executed task and the Software capability information of at least one first peripheral device determines the at least one software switch entry.
  • the electronic device 5400 when the computer program is executed by the processor 5401, the electronic device 5400 further executes: determining capability information of a second peripheral device currently establishing a connection with the electronic device 5400; according to the The capability information of the second peripheral device determines at least one second function switch entry; wherein the second function switch entry is used to map the function corresponding to the second function switch entry to the second peripheral device; the first function switch entry is used to map the function corresponding to the second function switch entry to the second peripheral device;
  • the functions corresponding to the two function switching entries are some or all of the functions in the functional requirements of the currently executing task.
  • the electronic device 5400 when the computer program is executed by the processor 5401, the electronic device 5400 further executes: after the display screen displays the target interface, receiving a target switching instruction, the target switching instruction It is used to instruct the electronic device 5400 to map the target function to the target peripheral device; in response to the target switching instruction, the target function is implemented through the target peripheral device.
  • the target function is a preset hardware function or software function; or the target function is a hardware function or software function determined by the electronic device 5400 according to the hardware capability or software capability of the target peripheral device function; or the target function is a hardware function or a software function determined by the electronic device 5400 according to the currently executed task.
  • control device currently performs a task of playing a video
  • first peripheral device in the current network connection is a smart screen device
  • the electronic The device 5400 specifically performs: determining that the functional requirement of the currently executing task is video output, and determining that the capability information of the smart screen device is supporting playback of audio and video; determining that the first function switching entry is screen projection; or
  • the current task performed by the control device is to play audio
  • the first peripheral device in the current network connection is a speaker
  • the electronic device 5400 is made to specifically execute: determine the The functional requirement of the currently executed task is audio output, and the capability information of the speaker is determined to support playback of audio; it is determined that the first function switch entry is audio output; or
  • the current task performed by the control device is K song, and the first peripheral device in the current network connection is a smart screen device and a speaker; when the computer program is executed by the processor 5401, the electronic device 5400 is specifically executed. : determine that the functional requirements of the currently executing task are video output, audio output and audio input, and determine that the capability information of the smart screen device is to support the playback of audio and video, and determine that the capability information of the speaker is to support the playback of audio and audio Input; determine that the first function switch entry is screen projection, audio output and audio input.
  • the present application further provides an electronic device, the electronic device is configured to implement the method for determining a function switching entry as described in the above embodiments.
  • the electronic device 5500 includes: a demand analysis unit 5501 , a detection unit 5502 and a processing unit 5503 . The function of each unit is described below.
  • a requirements analysis unit 5501 used to determine the functional requirements of the currently executed task
  • a detection unit 5502 configured to detect at least one first peripheral device in the current environment, and determine capability information of the at least one first peripheral device;
  • the processing unit 5503 is configured to determine at least one first function switch entry according to the function requirements of the currently executed task and the capability information of the at least one first peripheral device; the first function switch entry is used to The function corresponding to the function switching entry is mapped to the at least one first peripheral device; the function corresponding to the first function switching entry is some or all of the functions in the functional requirements of the currently executing task;
  • a display unit 5504 configured to display the at least one first function switch entry.
  • the terminal device 5500 further includes a receiving unit 5505, the receiving unit 5505 is configured to receive a display instruction; the display unit 5504 is further configured to display a target interface, wherein the target interface includes at least one The first function switch entry, and/or the identifier of the at least one first peripheral device.
  • the target interface is a multi-device control center interface, and the display instruction is triggered by a user through an operating system-level button or a preset gesture; or the target interface is a software-hardware switching interface, and the display instruction Triggered by the user through a preset button on the application interface.
  • the at least one first function switch entry includes: at least one hardware switch entry, and/or at least one software switch entry;
  • the processing unit 5503 is specifically configured to: according to the hardware function requirements of the currently executing task and the hardware capability information of the at least one first peripheral device to determine the at least one hardware switch entry; and/or, determine the at least one hardware switch entry according to the software function requirements of the currently executed task and the software capability information of the at least one first peripheral device At least one software switch entry.
  • the processing unit 5503 is further configured to: determine capability information of a second peripheral device currently establishing a connection with the electronic device 5500; determine at least one second function according to the capability information of the second peripheral device switch entry; wherein, the second function switch entry is used to map the function corresponding to the second function switch entry to the second peripheral device; the function corresponding to the second function switch entry is the currently executing task some or all of the functionality in the functional requirements.
  • the receiving unit 5505 is further configured to receive a target switching instruction; the processing unit 5503 is further configured to respond to the target switching instruction and implement the target function through the target peripheral device.
  • the target function is a preset hardware function or software function; or the target function is a hardware function or software function determined by the electronic device 5500 according to the hardware capability or software capability of the target peripheral device function; or the target function is a hardware function or a software function determined by the electronic device 5500 according to the currently executed task.
  • the current task performed by the control device is to play a video
  • the first peripheral device in the current network connection is a smart screen device
  • the requirement analysis unit 5501 is used to determine the functional requirements of the currently performed task is video output
  • the detection unit 5502 is used to determine that the capability information of the smart screen device is to support playing audio and video
  • the processing unit 5503 is used to determine that the first function switching entry is screen projection; or
  • the current execution task of the control device is to play audio, and the first peripheral device in the current network connection is a sound box; the requirement analysis unit 5501 is used to determine that the functional requirement of the current execution task is audio output; the detection unit 5502 determines that the capability information of the speaker is to support playing audio; the processing unit 5503 is used to determine that the first function switch entry is audio output; or
  • the current execution task of the control device is K song, and the first peripheral device in the current network connection is a smart screen device and a speaker;
  • the demand analysis unit 5501 is used to determine that the functional requirements of the current execution task are video output, Audio output and audio input;
  • the detection unit 5502 is used to determine that the capability information of the smart screen device is to support playback of audio and video, and to determine that the capability information of the speaker is to support playback of audio and audio input;
  • the processing unit 5503 uses It is determined that the first function switching entry is screen projection, audio output and audio input.
  • the embodiments of the present application further provide a computer storage medium, where a computer program is stored in the computer storage medium, and when the computer program is executed by a computer, the computer executes the methods provided by the above embodiments.
  • the embodiments of the present application further provide a chip, where the chip is used to read a computer program stored in a memory to implement the methods provided by the above embodiments.
  • the embodiments of the present application provide a chip system, where the chip system includes a processor for supporting a computer device to implement the functions involved in the control device in the methods provided by the above embodiments.
  • the chip system further includes a memory for storing necessary programs and data of the computer device.
  • the chip system may be composed of chips, or may include chips and other discrete devices.
  • the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
  • computer-usable storage media including, but not limited to, disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions
  • the apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Automation & Control Theory (AREA)
  • Quality & Reliability (AREA)
  • Manufacturing & Machinery (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请实施例提供一种功能切换入口的确定方法与电子设备，用以提供一种灵活的软/硬件切换入口的确定方式，辅助用户方便快捷的利用周边设备的软/硬件能力。在该方法中，控制设备确定当前执行任务的功能需求；并检测当前环境中的至少一个周边设备，确定至少一个周边设备的能力信息；控制设备根据当前执行任务的功能需求和至少一个周边设备的能力信息确定至少一个第一功能切换入口；显示至少一个第一功能切换入口。通过该方法控制设备能够根据当前执行任务需要的功能需求以及周边设备的能力信息确定至少一个功能切换入口，便于用户快捷的选择功能切换入口使周边设备实现该控制设备的功能，从而提升用户体验。

Description

一种功能切换入口的确定方法与电子设备
相关申请的交叉引用
本申请要求在2020年08月20日提交中国专利局、申请号为202010845328.9、申请名称为“一种功能切换入口的确定方法与电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及电子设备领域，尤其涉及一种功能切换入口的确定方法与电子设备。
背景技术
全场景智慧生活是指通过控制设备能够控制多种电子设备，从而实现各种场景下的电子设备的灵活使用。例如，通过控制设备控制智能音箱播放音乐，或智能空调调整工作模式或调整温度。
控制设备可以为用户常用的手机，其作为全场景智慧生活的控制中心，能够对多种电子设备进行控制，同时，多种电子设备也能够作为控制设备的硬件输入，从而结合控制设备与多种电子设备的硬件能力，提升控制设备的功能。
发明内容
本申请提供一种功能切换入口的确定方法与电子设备，用以使控制设备能够利用周边设备的设备能力实现控制设备的功能。
第一方面，本申请实施例提供了一种功能切换入口的确定方法，该方法包括以下步骤：
控制设备确定当前执行任务的功能需求，并检测当前环境中的至少一个第一周边设备，确定所述至少一个第一周边设备的能力信息；然后，所述控制设备根据所述当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口；其中，所述第一功能切换入口用于将所述第一功能切换入口对应的功能映射到所述至少一个第一周边设备；所述第一功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能；控制设备显示所述至少一个第一功能切换入口。
在该方法中，控制设备能够对当前执行任务分析，确定当前执行任务的功能需求，例如，当前控制设备执行播放视频任务，则确定该任务的功能需求为视频输出、音频输出。控制设备对第一周边设备进行检测，确定当前环境中的第一周边设备的能力信息，如检测到第一周边设备包括智慧屏设备，确定智慧屏设备的能力信息为具有屏幕、可播放音/视频，则控制设备根据当前执行任务的功能需求以及第一周边设备的能力信息，确定第一功能切换入口可以为“投屏”，从而能够确定用户当前需要且第一周边设备支持的功能切换入口，便于用户快捷的选择功能切换入口使周边设备实现该控制设备的功能，从而提升用户体验。
在一种可能的设计中，所述控制设备确定当前执行任务的功能需求之前，接收显示指令，所述显示指令用于指示所述控制设备显示目标界面；所述控制设备根据所述当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入 口之后，显示所述目标界面；其中，所述目标界面中包含至少一个第一功能切换入口，和/或，所述至少一个第一周边设备的标识。通过该方式，将控制设备确定的至少一个第一功能切换入口显示在目标界面中，便于用户在目标界面中选择需要的第一功能切换入口，简化用户操作。
在一种可能的设计中，所述目标界面为多设备控制中心界面，所述显示指令为用户通过操作***级按键或预设手势触发的；或者所述目标界面为软硬件切换界面，所述显示指令为用户通过应用界面上的预设按钮触发的。通过该设计，用户通过简便的操作，可以触发显示操作***级的多设备控制中心界面或应用级的软硬件切换界面，方便用户随时查看并选择功能切换入口，而不需要打断控制设备当前执行的任务。
在一种可能的设计中，所述至少一个第一功能切换入口包含：至少一个硬件切换入口，和/或，至少一个软件切换入口。所述控制设备可以但不限于通过以下方式中的一项或组合，确定所述至少一个第一功能切换入口：
方式一：根据当前执行任务的硬件功能需求和所述至少一个第一周边设备的硬件能力信息确定所述至少一个硬件切换入口；
方式二：所述控制设备根据当前执行任务的软件功能需求和所述至少一个第一周边设备的软件能力信息确定所述至少一个软件切换入口。
通过该设计，控制设备在目标界面中显示的第一功能切换入口包括至少一个硬件切换入口，和/或，至少一个软件切换入口，不再局限于单一的投屏或音频输出切换入口，为用户提供多种不同类型的功能切换入口，能够充分利用周边设备的硬件功能或软件功能，结合控制设备与周边设备的功能为用户提供更优的服务。
在一种可能的设计中，所述控制设备确定当前与所述控制设备建立连接的第二周边设备的能力信息；并根据所述第二周边设备的能力信息确定所述至少一个第二功能切换入口，其中，所述第二功能切换入口用于将所述第二功能切换入口对应的功能映射到所述第二周边设备；所述第二功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能。通过该方式，当控制设备当前已与第二周边设备建立连接时，将第二周边设备的能力信息对应的至少一个第二功能切换入口展示给用户，更加灵活的确定功能切换入口，方便用户通过当前已建立连接的第二周边设备实现控制设备的功能。
在一种可能的设计中，所述目标界面中还包含所述至少一个第二功能切换入口和/或所述第二周边设备的标识。
在一种可能的设计中，控制设备显示所述目标界面之后，接收目标切换指令，所述目标切换指令用于指示所述控制设备将目标功能映射到目标周边设备；所述控制设备响应所述目标切换指令，通过所述目标周边设备实现所述目标功能。通过该方式，用户触发目标切换指令后，控制设备通过目标周边设备实现目标功能，结合目标周边设备与控制设备为用户提供服务，提升用户体验。
可以理解的是，所述目标设备可以为第一周边设备，也可以为第二周边设备。
在一种可能的设计中，所述目标功能为预设的硬件功能或软件功能；或所述目标功能为所述控制设备根据所述目标周边设备的硬件能力或软件能力，确定的硬件功能或软件功能；或所述目标功能为所述控制设备根据当前执行的任务确定的硬件功能或软件功能。通过该设计，控制设备能够在接收到用户触发目标切换指令后，对目标周边设备以及当前执行任务进行分析，调整目标切换指令对应的目标功能，为用户提供更加智能的功能切换服 务。
在一种可能的设计中，所述控制设备当前执行任务为播放视频，所述当前网络连接中的第一周边设备为智慧屏设备；确定所述当前执行任务的功能需求为视频输出，并确定所述智慧屏设备的能力信息为支持播放音频与视频；确定第一功能切换入口为投屏；或者所述控制设备当前执行任务为播放音频，所述当前网络连接中的第一周边设备为音箱；确定所述当前执行任务的功能需求为音频输出，并确定所述音箱的能力信息为支持播放音频；确定第一功能切换入口为音频输出；或者所述控制设备当前执行任务为K歌，所述当前网络连接中的第一周边设备为智慧屏设备、音箱；确定所述当前执行任务的功能需求为视频输出、音频输出和音频录入，并确定所述智慧屏设备的能力信息为支持播放音频与视频、确定所述音箱的能力信息为支持播放音频和音频录入；确定第一功能切换入口为投屏、音频输出和音频录入。通过该设计，能够方便快捷的确定当前执行任务需要且周边设备能够提供的第一功能切换入口，简化用户操作，从而提升用户体验。
第二方面，本申请实施例还提供了一种功能切换入口确定方法，控制设备接收显示指令，所述显示指令用于指示所述控制设备显示目标界面；所述控制设备响应所述显示指令，显示所述目标界面；其中，所述目标界面中包含至少一个功能切换入口，任一个功能切换入口用于通过周边设备实现所述控制设备的功能。
在一种可能的设计中，所述目标界面为多设备控制中心界面，所述显示指令为用户通过操作***级按键或预设手势触发的；或者所述目标界面为软硬件切换界面，所述显示指令为用户通过应用界面上的预设按钮触发的。
在一种可能的设计中，所述至少一个功能切换入口包含：至少一个硬件切换入口，和/或，至少一个软件切换入口；在所述控制设备显示所述目标界面之前，所述控制设备确定在所述目标界面中显示的所述至少一个硬件切换入口；和/或，所述控制设备确定在所述目标界面中显示的所述至少一个软件切换入口。
在一种可能的设计中，所述控制设备根据下列方式中的至少一种确定在所述目标界面中显示的所述至少一个硬件切换入口：所述控制设备检测当前环境中的至少一个周边设备，确定所述至少一个周边设备的硬件能力，根据所述至少一个周边设备的硬件能力确定所述至少一个硬件切换入口；所述控制设备确定当前执行的任务对应的硬件需求，根据所述硬件需求确定所述至少一个硬件切换入口；所述控制设备确定当前与所述控制设备建立连接的第一周边设备，根据所述第一周边设备的硬件能力确定所述至少一个硬件切换入口。
在一种可能的设计中，所述控制设备根据下列方式中的至少一种确定在所述目标界面中显示的所述至少一个软件切换入口：所述控制设备检测当前环境中的至少一个周边设备，确定所述至少一个周边设备的软件能力，根据所述至少一个周边设备的软件能力确定所述至少一个软件切换入口；所述控制设备确定当前执行的任务对应的软件需求，根据所述软件需求确定所述至少一个软件切换入口；所述控制设备确定当前与所述控制设备建立连接的第二周边设备，根据所述第二周边设备的软件能力确定所述至少一个软件切换入口。
在一种可能的设计中，所述目标界面还包括至少一个周边设备的标识；在所述控制设备显示所述目标界面之前，所述控制设备检测当前环境中的至少一个周边设备，并在所述目标界面上显示所述至少一个周边设备的标识。
在一种可能的设计中，所述控制设备根据下列方式对所述至少一个周边设备的标识进行排序：所述控制设备根据所述周边设备与所述控制设备之间的距离对所述至少一个周边 设备的标识进行排序；或所述控制设备根据所述周边设备的使用频率对所述至少一个周边设备的标识进行排序；所述控制设备按照所述至少一个周边设备的标识的排序，在所述目标界面上显示所述至少一个周边设备的标识。
在一种可能的设计中，在所述控制设备显示所述目标界面之后，所述控制设备接收目标切换指令，所述目标切换指令用于指示所述控制设备通过目标周边设备实现所述控制设备的目标功能；所述控制设备响应所述目标切换指令，通过所述目标周边设备实现所述目标功能。
在一种可能的设计中，所述目标功能为预设的硬件功能或软件功能；或所述目标功能为所述控制设备根据所述目标周边设备的硬件能力或软件能力，确定的硬件功能或软件功能；或所述目标功能为所述控制设备根据当前执行的任务确定的硬件功能或软件功能。
第三方面，本申请实施例还提供了一种电子设备，包括处理器、存储器；所述存储器用于存储一个或多个计算机程序，所述计算机程序被所述处理器执行时，使得所述电子设备执行：确定当前执行任务的功能需求；检测当前环境中的至少一个第一周边设备，确定所述至少一个第一周边设备的能力信息；根据所述当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口；其中，所述第一功能切换入口用于将所述第一功能切换入口对应的功能映射到所述至少一个第一周边设备；所述第一功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能；所述显示屏用于显示所述至少一个第一功能切换入口。
在一种可能的设计中，所述计算机程序被所述处理器执行时，使得所述电子设备还执行：在确定当前执行任务的功能需求之前，接收显示指令；其中，所述显示指令用于指示所述控制设备显示目标界面；在所述控制设备根据所述当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口之后，在所述显示屏上显示所述目标界面；其中，所述目标界面中包含至少一个第一功能切换入口，和/或，所述至少一个第一周边设备的标识。
在一种可能的设计中，所述目标界面为多设备控制中心界面，所述显示指令为用户通过操作***级按键或预设手势触发的；或者所述目标界面为软硬件切换界面，所述显示指令为用户通过应用界面上的预设按钮触发的。
在一种可能的设计中，所述至少一个第一功能切换入口包含：至少一个硬件切换入口，和/或，至少一个软件切换入口；所述计算机程序被所述处理器执行时，使得所述电子设备具体执行：根据当前执行任务的硬件功能需求和所述至少一个第一周边设备的硬件能力信息确定所述至少一个硬件切换入口；和/或，根据当前执行任务的软件功能需求和所述至少一个第一周边设备的软件能力信息确定所述至少一个软件切换入口。
在一种可能的设计中，所述计算机程序被所述处理器执行时，使得所述电子设备还执行：确定当前与所述控制设备建立连接的第二周边设备的能力信息；根据所述第二周边设备的能力信息确定至少一个第二功能切换入口；其中，所述第二功能切换入口用于将所述第二功能切换入口对应的功能映射到所述第二周边设备；所述第二功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能。
在一种可能的设计中，所述计算机程序被所述处理器执行时，使得所述电子设备还执行：在所述显示屏显示所述目标界面之后，接收目标切换指令，所述目标切换指令用于指示所述控制设备将目标功能映射到目标周边设备；响应所述目标切换指令，通过所述目标 周边设备实现所述目标功能。
在一种可能的设计中，所述目标功能为预设的硬件功能或软件功能；或所述目标功能为所述控制设备根据所述目标周边设备的硬件能力或软件能力，确定的硬件功能或软件功能；或所述目标功能为所述控制设备根据当前执行的任务确定的硬件功能或软件功能。
在一种可能的设计中，所述控制设备当前执行任务为播放视频，所述当前网络连接中的第一周边设备为智慧屏设备；所述计算机程序被所述处理器执行时，使得所述电子设备具体执行：确定所述当前执行任务的功能需求为视频输出，并确定所述智慧屏设备的能力信息为支持播放音频与视频；确定第一功能切换入口为投屏；或者
所述控制设备当前执行任务为播放音频，所述当前网络连接中的第一周边设备为音箱；所述计算机程序被所述处理器执行时，使得所述电子设备具体执行：确定所述当前执行任务的功能需求为音频输出，并确定所述音箱的能力信息为支持播放音频；确定第一功能切换入口为音频输出；或者
所述控制设备当前执行任务为K歌，所述当前网络连接中的第一周边设备为智慧屏设备、音箱；所述计算机程序被所述处理器执行时，使得所述电子设备具体执行：确定所述当前执行任务的功能需求为视频输出、音频输出和音频录入，并确定所述智慧屏设备的能力信息为支持播放音频与视频、确定所述音箱的能力信息为支持播放音频和音频录入；确定第一功能切换入口为投屏、音频输出和音频录入。
第四方面，本申请实施例还提供了一种电子设备，该电子设备包括执行上述任一方面的任意一种可能的设计的方法的模块/单元。这些模块/单元可以通过硬件实现，也可以通过硬件执行相应的软件实现。
第五方面，本申请实施例中还提供一种计算机可读存储介质，所述计算机可读存储介质包括计算机程序，当计算机程序在电子设备上运行时，使得所述电子设备执行上述任一方面的任意一种可能的设计的方法。
第六方面，本申请实施例还提供一种包含计算机程序产品，当所述计算机程序产品在终端上运行时，使得所述电子设备执行上述任一方面的任意一种可能的设计的方法。
第七方面，本申请实施例还提供一种芯片，所述芯片用于读取存储器中存储的计算机程序，实现上述任一方面的任意一种可能的设计的方法。
第八方面，本申请实施例还提供一种芯片***，该芯片***包括处理器，用于支持终端设备实现上述任一方面的任意一种可能的设计的方法。在一种可能的设计中，所述芯片***还包括存储器，所述存储器，用于保存终端设备必要的程序指令和数据。该芯片***，可以由芯片构成，也可以包含芯片和其他分立器件。
附图说明
图1为本申请一实施例提供的电子设备的硬件结构的示意图；
图2为本申请一实施例提供的电子设备的软件结构的示意图；
图3为本申请一实施例提供的第一种多设备控制中心界面示意图；
图4为本申请一实施例提供的第二种多设备控制中心界面示意图；
图5-图6为本申请一实施例提供的多设备控制中心界面中周边设备区域的不同显示方式示意图；
图7-图13为本申请一实施例提供的多控制设备中心界面显示至少一个硬件切换入口 的示意图；
图14a-图14c为本申请一实施例提供的多设备控制中心界面中周边设备区域的不同显示样式示意图；
图15为本申请一实施例提供的控制设备已连接周边设备后的多设备控制中心界面示意图；
图16-图19为本申请一实施例提供的多设备控制中心界面显示至少一个软件切换入口的示意图；
图20-图26为本申请一实施例提供的多设备控制中心界面中软件切换入口与硬件切换入口的不同的显示样式示意图；
图27-图30为本申请一实施例提供的多设备控制中心界面的不同显示样式示意图；
图31-图37为本申请一实施例提供的软硬件切换界面显示至少一个硬件切换入口的示意图；
图38-图45为本申请一实施例提供的一种软硬件切换界面显示至少一个软件切换入口的示意图；
图46-图49为本申请一实施例提供的软硬件切换界面的不同显示样式示意图；
图50为本申请一实施例提供的控制设备执行拍照任务时，用户触发显示的软硬件切换界面示意图；
图51为本申请一实施例提供的控制设备执行拍照任务时，用户触发目标切换指令后的控制设备显示界面示意图；
图52为本申请一实施例提供的控制设备执行拍照任务时，用户触发目标切换指令后的智慧屏设备显示界面示意图；
图53为本申请一实施例提供的一种功能切换入口的确定方法流程图；
图54为本申请一实施例提供的又一种电子设备的结构示意图；
图55为本申请一实施例提供的又一种电子设备的结构示意图。
具体实施方式
以下，对本申请实施例中的部分用语进行解释说明，以便于本领域技术人员理解。
1、物联网(The Internet of Things，IOT)，是指通过各种信息传感器、射频识别技术、全球定位***、红外感应器、激光扫描器等各种装置与技术，实时采集任何需要监控、连接、互动的物体或过程，采集各种需要的信息，通过各类可能的网络接入，实现物与物、物与人的泛在连接，实现对物品和过程的智能化感知、识别和管理；物联网是一个基于互联网、传统电信网等的信息承载体，能让所有能够被独立寻址的普通物理对象形成互联互通的网络。
2、电子设备，诸如手机、平板电脑、可穿戴设备(例如，手表、手环、头盔、耳机、项链等)、车载设备、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)等，本申请实施例对电子设备的具体类型不作任何限制。
在本申请实施例中，电子设备可以包括以下几类：控制设备、周边设备以及***设备。下面分别对这几类电子设备进行说明：
控制设备为对周边设备以及***设备进行控制的电子设备，一般为用户经常使用并随身携带的电子设备，例如智能手机。用户使用控制设备连接周边设备或***设备，控制设备可以根据用户触发的指令，向周边设备或***设备发送控制指令，从而实现对周边设备或***设备的控制。
周边设备为较为常用的电子设备，或与控制设备属于相同品牌的电子设备，如平板电脑、电脑、智慧屏设备、音箱等。
***设备为使用频率较低，或与控制设备属于不同品牌但能够与控制设备进行交互的电子设备，如扬声器、智能相机等。
3、多设备控制功能，能够实现控制设备对周边设备和/或***设备的控制，以通过周边设备和/或***设备的软硬件能力实现控制设备的功能。
当控制设备的多设备控制功能打开后，可以根据用户触发的显示指令，在显示屏中显示目标界面；本申请实施例中目标界面包括多设备控制中心界面和软硬件切换界面。
例如，当控制设备的多设备控制功能打开后，可以根据用户输入的多设备控制中心界面显示指令，在显示屏中显示多设备控制中心界面。其中，控制设备显示的多设备控制中心界面中显示有控制设备的功能入口、软/硬件切换入口、周边设备的标识以及***设备的标识。
或者，在控制设备的多设备控制功能打开的情况下，若在前台运行应用程序过程中接收到用户输入的软硬件切换界面显示指令，还可以在显示屏中显示软硬件切换界面。软硬件切换界面中显示有软硬件切换入口、周边设备的标识以及***设备的标识。
而周边设备和/或***设备在打开多设备控制功能后，可以接收控制设备发送的能力查询消息，并根据该能力查询消息，向控制设备反馈其硬件能力信息或软件能力信息等；或者周边设备和/或***设备可以在打开多设备控制功能后，主动广播自身的硬件能力信息或软件能力信息。
需要说明的是，控制设备、周边设备、***设备的多设备控制功能可以是自身携带的，也可以是通过安装应用获得的。另外，控制设备、周边设备、***设备的多设备控制功能可以打开电源后即启动的，也可以是用户通过对其进行操作启动的。
4、功能切换入口，包括硬件切换入口和软件切换入口。其中：
硬件切换入口，为显示在控制设备的显示屏中，用于触发控制设备将该硬件切换入口对应的功能映射到周边设备的虚拟按钮。例如，控制设备的硬件切换入口“投屏”，用户在控制设备的显示屏中点击“投屏”后，用户选择投屏使用的周边设备，控制设备将“投屏”硬件切换入口对应的视频输出功能映射到周边设备，从而将该周边设备作为控制设备的视频输出设备。
软件切换入口，为显示在控制设备的显示屏中，用于触发控制设备将该软件切换入口对应的功能映射到周边设备的虚拟按钮。例如，控制设备的软件切换入口“电脑模式”，控制设备在投屏到智慧屏设备过程中，用户在控制设备的显示屏中点击“电脑模式”按钮后，控制设备将软件切换入口“电脑模式”对应的电脑模式显示的软件功能映射到智慧屏设备上，从而将当前控制设备显示屏中显示的内容以电脑模式投屏到智慧屏设备上。
下面将结合本申请以下实施例中的附图，对本申请实施例中的技术方案进行详尽描述。
示例性的，图1示出了本申请实施例提供的显示方法适用的一种可能的电子设备100 的结构示意图。如图1所示，电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。其中，控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了***的效率。
USB接口130是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口130可以用于连接充电器为电子设备100充电，也可以用于电子设备100与***设备之间传输数据。充电管理模块140用于从充电器接收充电输入。电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，外部存储器，显示屏194，摄像头193，和无线通信模块160等供电。
电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块150可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星***(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无 线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。
在一些实施例中，电子设备100的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯***(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以包括全球卫星定位***(global positioning system，GPS)，全球导航卫星***(global navigation satellite system，GLONASS)，北斗卫星导航***(beidou navigation satellite system，BDS)，准天顶卫星***(quasi-zenith satellite system，QZSS)和/或星基增强***(satellite based augmentation systems，SBAS)。
显示屏194用于显示应用的显示界面，例如相机应用的取景界面等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，电子设备100可以包括1个或N个显示屏194，N为大于1的正整数。
电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当电子设备100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样，电子设备100可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作***，以及至少一个应用程序(例如爱奇艺应用，微信应用等)的软件代码等。存储数据区可存储电子设备100使用过程中所产生的数据(例如拍摄的图像、录制的视频等)等。此外，内部存储器121可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展电子设备的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将图片，视频等文件保存在外部存储卡中。
电子设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。
其中，传感器模块180可以包括加速度传感器180A，距离传感器180B，触摸传感器180C等。
加速度传感器180A可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备100姿态，应用于横竖屏切换，计步器等应用。
距离传感器180B，用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中，电子设备100可以利用距离传感器180B测距以确定其它电子设备与电子设备100之间的距离。
触摸传感器180C，也称“触控面板”。触摸传感器180C可以设置于显示屏194，由触摸传感器180C与显示屏194组成触摸屏，也称“触控屏”或“触摸显示屏”。触摸传感器180C用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器180C也可以设置于电子设备100的表面，与显示屏194所处的位置不同。
按键190包括开机键，音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入，产生与电子设备100的用户设置以及功能控制有关的键信号输入。马达191可以产生振动提示。马达191可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的触摸操作，可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。SIM卡接口195用于连接SIM卡。SIM卡可以通过***SIM卡接口195，或从SIM卡接口195拔出，实现与电子设备100的接触和分离。
可以理解的是，图1所示的部件并不构成对电子设备100的具体限定，本申请实施例提供的电子设备还可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些 部件，或者不同的部件布置。此外，图1中的部件之间的组合/连接关系也是可以调整修改的。
图2示出了本申请一实施例提供的电子设备的软件结构框图。如图2所示，电子设备的软件结构可以是分层架构，例如可以将软件分成若干个层，每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中，将Android***分为四层，从上至下分别为应用程序层，应用程序框架层(framework，FWK)，安卓运行时(Android runtime)和***库，以及内核层。
应用程序层可以包括一系列应用程序包。如图2所示，应用程序层可以包括相机、设置、皮肤模块、用户界面(user interface，UI)、三方应用程序等。其中，三方应用程序可以包括微信、QQ、图库，日历，通话，地图，导航，WLAN，蓝牙，音乐，视频，短信息等。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层可以包括一些预先定义的函数。如图2所示，应用程序框架层可以包括窗口管理器，内容提供器，视图***，资源管理器，多设备控制功能管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕等。内容提供器用来存放和获取数据，并使这些数据可以被应用程序访问。所述数据可以包括视频，图像，音频，拨打和接听的电话，浏览历史和书签，电话簿等。
视图***包括可视控件，例如显示文字的控件，显示图片的控件等。视图***可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如，包括短信通知图标的显示界面，可以包括显示文字的视图以及显示图片的视图。
资源管理器为应用程序提供各种资源，比如本地化字符串，图标，图片，布局文件，视频文件等等。
针对操作***级，多设备控制功能管理器可以确定软/硬件切换入口，以及检测周边设备和/或***设备，并控制显示多设备控制中心界面。其中，所述多设备控制中心界面中显示有控制设备的功能入口、软/硬件切换入口、周边设备的标识以及***设备的标识。
针对应用级，多设备控制功能管理器可以确定软/硬件切换入口，以及检测周边设备和/或***设备，并控制显示软硬件切换界面。其中，所述软硬件切换界面中显示有软/硬件切换入口、周边设备的标识以及***设备的标识。
Android runtime包括核心库和虚拟机。Android runtime负责安卓***的调度和管理。
核心库包含两部分：一部分是java语言需要调用的功能函数，另一部分是安卓的核心库。应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理，堆栈管理，线程管理，安全和异常的管理，以及垃圾回收等功能。
***库可以包括多个功能模块。例如：表面管理器(surface manager)，媒体库(media libraries)，三维图形处理库(例如：OpenGL ES)，2D图形引擎(例如：SGL)等。
表面管理器用于对显示子***进行管理，并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频，视频格式回放和录制，以及静态图像文件等。媒体库可以支持多种音视频编码格式，例如:MPEG4，H.264，MP3，AAC，AMR，JPG，PNG等。
三维图形处理库用于实现三维图形绘图，图像渲染，合成，和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动，摄像头驱动，音频驱动，传感器驱动。
硬件层可以包括各类传感器，例如本申请实施例中涉及的加速度传感器、触摸传感器等。
本申请实施例中控制设备可以为图1～图2所述的电子设备，本申请实施例中控制设备上的多设备控制中心界面的显示方法可以应用于全场景智慧生活场景中。全场景智慧生活是指通过控制设备对多种电子设备进行控制，从而实现各种场景下的电子设备的协同工作。另外，由于控制设备的硬件功能有限，将其它软/硬件能力较强的电子设备与控制设备连接，能够利用多种电子设备的软/硬件能力，提升用户体验。
具体的，全场景智慧生活可以采用“1+8+N”战略提升用户体验。其中：
1代表控制设备，可以为用户常用的电子设备，如手机；控制设备作为全场景智慧生活中的控制中心，是全场景智慧生活中多种电子设备交互的主入口。
8代表个人计算机(Personal Computer，PC)、平板、智慧屏设备、音箱、眼镜、手表、车机、耳机八种周边设备，作为辅助入口。
N代表摄像头、扫地机、智能秤等***设备，涵盖移动办公、智能家居、运动健康、影音娱乐、智慧出行五大场景模式。
举例来说，控制设备在播放视频时，用户可以点击控制设备上的投屏功能对应的按钮，选择将控制设备上播放的视频投屏到智慧屏设备，控制设备接收到投屏指令后，将当前正在播放的视频数据发送到智慧屏设备，智慧屏设备根据接收到的视频数据进行播放，完成投屏过程。通过投屏功能充分利用智慧屏设备的大屏幕优势，从而使用户获取更好的观看体验。
再例如，控制设备在播放音频时，用户可以通过操作使控制设备连接到当前环境中的音箱，然后控制设备将当前播放的音频数据发送到音箱；音箱根据接收到的音频数据播放音频文件，从而根据自身的音频播放优势，提升音频播放效果。
但随着用户拥有的电子设备越来越多，如音箱、麦克风、智慧屏设备、游戏手柄等，单一的投屏或音频输出功能已经不能满足用户的综合需求。
基于上述问题，本申请实施例提供一种功能切换入口的确定方法，用以提供一种灵活的软/硬件切换入口的确定方式，辅助用户方便快捷的利用周边设备的软/硬件能力。
下面对控制设备操作***级以及应用级的功能切换入口的确定方法分别进行说明：
一、操作***级
用户可以通过按键或触摸显示屏或语音输入，或者通过其他方式向控制设备发送多设备控制中心界面显示指令，控制设备在接收到该显示指令后，在显示屏中显示多设备控制中心界面。例如，用户可以在控制设备的触摸显示屏底部进行上滑手势操作，触发控制设备显示多设备控制中心界面；或者用户可以在控制设备的触摸显示屏顶部进行下滑手势操作，触发控制设备显示多设备控制中心界面；或者用户可以从触摸显示屏侧边进行滑动手 势操作，触发控制设备显示多设备控制中心界面。
其中，多设备控制中心界面能够显示所述控制设备当前的周边设备的标识，以及控制设备的硬件切换入口、软件切换入口等，如图3和图4所示。可选的，如图3所示，控制设备可以在显示屏的部分区域内显示多设备控制中心界面，此时由于多设备控制中心界面并没有占用全部显示屏的显示区域，用户可以通过上下滑动多设备控制中心界面查看更多内容。可选的，控制设备还可以全屏显示多设备控制中心界面，如图4所示。
以图4所示的多设备控制中心界面为例进行说明。多设备控制中心界面可以但不限于包括：控制设备功能区域、软硬件切换入口区域、周边设备区域以及***设备区域。其中，控制设备功能区域显示包括控制设备模式、网络连接方式、基础设置等功能入口对应的按钮，如图4中所示的“蓝牙”按钮、“飞行模式”按钮、“手电筒”按钮等。软硬件切换入口区域显示控制设备提供的硬件切换入口以及软件切换入口，如“投屏”、“音频输出”等硬件切换入口，“镜像”、“电脑模式”等软件切换入口。控制设备在周边设备区域中显示当前控制设备能够检测到的周边设备的标识，例如控制设备在周边设备区域中显示“音箱”、“智慧屏”等周边设备的图标和/或名称。控制设备在***设备区域中显示控制设备能够检测到的***设备的标识，例如控制设备在***设备区域中显示“空气净化器”、“扬声器”等***设备的图标和/或名称。
本申请实施例中，控制设备检测到用户触发的多设备控制中心界面显示指令后，控制设备对当前网络连接中的周边设备进行检测，其中，当前网络连接可以为WiFi网络、局域网或蓝牙网络。
可选的，控制设备可以通过WiFi检测与控制设备连接相同局域网的周边设备，或控制设备可以通过蓝牙连接技术检测开启蓝牙功能的周边设备。控制设备将检测到的周边设备的图标和名称显示到多设备控制中心界面的周边设备区域中。
在一种可能的实施方式中，控制设备在多设备控制中心界面中显示至少一个周边设备的标识时，可以采用下列方式中的至少一种对至少一个周边设备的标识进行排序：
方式1、根据周边设备与控制设备之间的距离对至少一个周边设备的标识进行排序。
控制设备检测周边设备与控制设备之间的距离，按照周边设备与控制设备之间距离从近到远的顺序对检测到的周边设备的标识进行排序。
举例来说，控制设备检测到周边设备有智慧屏设备、平板、音箱，根据检测到的周边设备与控制设备之间的距离按照从近到远进行排序后为音箱、平板以及智慧屏设备。在该场景下，控制设备显示的多设备控制中心界面如图5所示，其中，在多设备控制中心界面中周边设备区域中从左到右依次显示音箱、平板、以及智慧屏设备的标识。
本申请实施例中，可以根据下列方式检测周边设备与控制设备之间的距离：
(1)WiFi定位测距
控制设备在检测到任一个周边设备后，获取该周边设备的WiFi定位信息，根据控制设备自身的WiFi定位信息以及周边设备的WiFi定位信息确定周边设备与控制设备之间的距离。
(2)蓝牙定位测距
在室内安装有蓝牙局域网接入点的场景中，控制设备与周边设备均启动蓝牙功能后，蓝牙室内定位***能够通过测量信号强度对控制设备以及周边设备进行定位，并将定位信 息发送给控制设备和周边设备，控制设备在获取到自身的定位信息后，通过与周边设备进行交互获取周边设备的定位信息，根据控制设备自身的定位信息以及周边设备的定位信息确定控制设备与周边设备之间的距离。
(3)控制设备通过距离传感器测距
在控制设备安装有距离传感器时，控制设备可以通过距离传感器测量自身与周边设备之间的距离，例如，控制设备可以通过红外、激光或超声波测量自身与周边设备之间的距离。具体的，以超声波测距原理为例，对距离传感器测距方式进行介绍：控制设备向周边设备所在方向发射超声波，在发射同时开始计时，超声波在空气中传播，途中碰到周边设备后立即返回，控制设备收到反射波立即停止计时。控制设备根据超声波在空气中传播速度以及计时时间，确定控制设备与周边设备之间的距离。
(4)摄像头测距
控制设备通过摄像头拍摄包括周边设备的图像，控制设备的图像传感器对拍摄得到的图像进行深度计算，确定控制设备与周边设备之间的距离。一种可选的实施方式为，图像传感器可以使用目标检测框检测周边设备，并根据坐标转换公式将图像中的像素坐标转换为世界坐标，从而计算周边设备对应的目标检测框的深度信息，将计算得到的深度信息作为控制设备与周边设备之间的距离。
需要说明的是，本申请实施例并不限定控制设备确定控制设备与周边设备之间的距离的方式，所述控制设备还可以通过其他方式，确定自身与周边设备之间的距离。或者控制设备同时使用多种方式，确定自身与周边设备之间的距离。
方式2、根据周边设备的使用频率对至少一个周边设备的标识进行排序。
控制设备记录用户选择周边设备的频率，按照使用频率从高到低的顺序对检测到的周边设备的标识进行排序。
举例来说，控制设备检测到周边设备有智慧屏设备、平板，根据用户使用周边设备的频率对周边设备排序，如用户使用智慧屏的频率更高，则对周边设备排序后为智慧屏设备、平板。在该场景下，控制设备显示的多设备控制中心界面如图6所示，其中，在多设备控制中心界面中周边设备从左到右依次显示智慧屏设备和平板的标识。
在一种实施方式中，控制设备检测到周边设备后，可以根据下列方式中的至少一种确定多设备控制中心界面显示的硬件切换入口：
方式1、控制设备根据检测到的周边设备的硬件能力信息，确定多设备控制中心界面显示的至少一个硬件切换入口。
一种可能的实现方式，控制设备根据检测到的周边设备的硬件能力信息确定硬件切换入口。具体的，控制设备检测到周边设备后，同时检测该周边设备的设备信息，周边设备的设备信息中包括设备类型、设备名称以及周边设备的硬件能力信息，控制设备根据周边设备的硬件能力信息，确定周边设备具有的硬件能力对应的硬件切换入口，并在多设备控制中心界面显示确定出的硬件切换入口。
另一种可能的实现方式，控制设备根据周边设备反馈的硬件能力信息确定硬件切换入口。具体的，控制设备检测到周边设备后，向周边设备发送硬件能力查询消息，周边设备在接收到控制设备发送的硬件能力查询消息后向控制设备发送硬件能力信息，控制设备根据接收到的周边设备的硬件能力信息，确定周边设备具有的硬件能力对应的硬件切换入口， 并在多设备控制中心界面显示确定出的硬件切换入口。
控制设备确定在多设备控制中心展示的硬件切换入口后，根据周边设备的标识的排序对硬件切换入口进行排序，如将排序靠前的周边设备的较强硬件能力对应的硬件切换入口的排序靠前显示；或根据硬件切换入口的使用频率对硬件切换入口进行排序，如将使用频率高的软硬件切换入口的排序靠前显示。
下面以实施例1～3对本申请实施例控制设备根据检测到的周边设备的硬件能力信息，确定多设备控制中心界面显示的至少一个硬件切换入口进行进一步说明：
实施例1：控制设备检测到周边设备有智慧屏设备、平板、音箱，根据检测到的周边设备与控制设备之间的距离按照从近到远进行排序后为音箱、平板、智慧屏设备；检测周边设备的硬件能力信息，确定周边设备对应的硬件切换入口：音箱的硬件能力为播放音频、收音；平板与智慧屏设备的硬件能力为具有屏幕、具有摄像头、能够播放音频等；则确定出周边设备对应的硬件切换入口为“投屏”、“音频输出”、“音频录入”以及“摄像头切换”；根据用户使用硬件切换入口的频率对确定出的硬件切换入口进行排序为：“投屏”、“音频输出”、“音频录入”、“摄像头切换”，则在该场景下，控制设备显示的多设备控制中心界面如图7所示，在周边设备区域中从左到右依次显示音箱、平板以及智慧屏设备的标识，在软硬件切换入口区域从左到右依次显示“投屏”、“音频输出”、“音频录入”、“摄像头切换”硬件切换入口。
实施例2、控制设备检测到周边设备有智慧屏设备；控制设备接收周边设备反馈的硬件能力信息为：智慧屏设备的硬件能力为具有屏幕、能够播放音频等，则确定出周边设备对应的硬件切换入口为“投屏”以及“音频输出”；根据用户使用硬件切换入口的频率对硬件切换入口进行排序为：“投屏”、“音频输出”，则在该场景下，控制设备显示的多设备控制中心界面如图8所示，在周边设备区域中显示智慧屏设备的标识，在软硬件切换入口区域从左到右依次显示“投屏”、“音频输出”硬件切换入口。
实施例3、控制设备检测到周边设备有智慧屏设备、平板，根据周边设备的使用频率对周边设备排序，如智慧屏设备的使用频率更高，则对周边设备排序后为智慧屏设备、平板；控制设备接收周边设备反馈的硬件能力信息为：智慧屏设备的硬件能力为具有屏幕、能够播放音频等，平板的硬件能力为具有屏幕、能够播放音频、具有键盘输入能力；则确定出周边设备对应的硬件切换入口为“投屏”、“音频输出”以及“键盘输入”；根据周边设备的排序对硬件切换入口进行排序，将智慧屏设备和平板均较强的硬件能力“具有屏幕”对应的硬件切换入口“投屏”排序靠前，则对硬件切换入口进行排序可以为：“投屏”、“音频输出”、“键盘输入”，则在该场景下，控制设备显示的多设备控制中心界面如图9所示，在周边设备区域中从左到右依次显示智慧屏设备、平板的标识，在软硬件切换入口区域从左到右依次显示“投屏”、“音频输出”、“键盘输入”硬件切换入口。
根据上述实施例1～3可以看出，本申请实施例能够根据检测到的周边设备调整在多设备控制中心界面显示的硬件切换入口，将与检测到的周边设备相关的硬件切换入口显示在多设备控制中心界面中，从而能够便于用户选择当前能够使用的硬件切换入口，提升用户体验。
方式2、控制设备根据当前执行任务的硬件功能需求，确定多设备控制中心界面显示的至少一个硬件切换入口。
控制设备确定当前执行任务的硬件功能需求确定多设备控制中心界面显示的至少一 个硬件切换入口，如控制设备当前执行任务为与用户进行交互的任务，例如游戏，则控制设备确定当前执行任务的功能需求为外接游戏手柄，则控制设备确定硬件切换入口可以包括“游戏手柄”；或控制设备当前执行任务为需要屏幕进行播放的任务，例如播放视频，则控制设备确定当前执行任务的功能需求为视频输出、音频输出，则控制设备确定硬件切换入口可以包括“投屏”和“音频输出”。
下面以实施例4～7对控制设备根据当前执行任务的硬件功能需求确定多设备控制中心界面显示的至少一个硬件切换入口的方式进行进一步说明：
实施例4、控制设备当前运行“K歌”应用，控制设备执行唱歌任务时，控制设备显示如图10中左图所示的“K歌”应用界面；用户触发多设备控制中心界面显示指令，控制设备确定当前执行的唱歌任务的硬件功能需求为视频输出、音频输出和音频录入，则确定硬件切换入口为“音频输出”、“音频录入”和“投屏”，如图10中右图，控制设备而在多设备控制中心界面的周边设备区域显示控制设备检测到的周边设备的标识，以及在多设备控制中心界面的软硬件切换入口区域显示硬件切换入口“音频输出”、“音频录入”和“投屏”。
实施例5、控制设备当前运行“K歌”应用，控制设备执行录制唱歌视频任务时，控制设备显示如图11中左图所示的“K歌视频录制”应用界面；用户在触发多设备控制中心界面显示指令，控制设备确定当前执行的录制唱歌视频任务的硬件功能需求为视频输出、音频输出、音频录入和视频录入，则确定硬件切换入口为“音频输出”、“音频录入”、“摄像头切换”和“投屏”，如图11中右图所示，控制设备在多设备控制中心界面的周边设备区域显示控制设备检测到的周边设备的标识，以及在多设备控制中心界面的软硬件切换入口区域显示硬件切换入口“音频输出”、“音频录入”、“摄像头切换”和“投屏”。
实施例6、控制设备当前执行文档查看或文档编辑任务，控制设备显示如图12中左图所示的文档界面时，用户触发多设备控制中心界面显示指令，控制设备确定当前执行的任务的硬件功能需求为屏幕显示和键盘输入，则确定硬件切换入口为“投屏”和“键盘输入”，如图12中右图所示，在多设备控制中心界面的周边设备区域显示控制设备检测到的周边设备，以及在多设备控制中心界面的软硬件切换入口区域显示硬件切换入口“投屏”和“键盘输入”。
实施例7、控制设备当前运行游戏应用，如图13所示，控制设备显示游戏界面，用户触发多设备控制中心界面显示指令，控制设备确定当前执行的游戏任务的硬件功能需求为音频输出、外接游戏手柄，则确定硬件切换入口为“音频输出”和“游戏手柄”，在多设备控制中心界面的周边设备区域显示控制设备检测到的周边设备的标识，以及在多设备控制中心界面的软硬件切换入口区域显示硬件切换入口“音频输出”和“游戏手柄”。
根据以上实施例4～7可以看出，本申请实施例提供的显示方式，控制设备能够对当前执行任务进行智能分析，根据当前执行任务的硬件功能需求确定当前执行任务所需的硬件切换入口，从而根据不同的任务在多设备控制中心界面显示不同的硬件切换入口，方便用户选择需要的硬件切换入口，简化用户操作，提升用户体验。
另外，根据控制设备当前执行的任务，还可以对多设备控制中心界面中周边设备区域显示的周边设备的标识进行调整，如将具有当前执行任务所需的硬件能力的周边设备的标识突出显示，以控制设备当前执行任务为播放音频为例，确定当前执行的播放音频任务需要的硬件切换入口为“音频输出”和“音频录入”，则确定具有播放音频任务所需的硬件 能力的周边设备为音箱，如图14a所示，在多设备控制中心界面的周边设备区域中显示音箱的标识；或如图14b所示，在多设备控制中心界面的周边设备区域中音箱的标识排在靠前位置显示；或如图14c所示，多设备控制中心界面的周边设备区域中突出显示音箱的标识，同时以虚线形式显示其它周边设备的标识。
方式3、控制设备根据当前已建立连接的周边设备的硬件能力信息，确定多设备控制中心界面显示的至少一个硬件切换入口。
控制设备当前已连接周边设备后，用户触发显示多设备控制中心界面显示指令，控制设备确定已与控制设备建立连接的周边设备，将已与控制设备建立连接的周边设备的标识在周边设备区域中排序靠前且突出显示，并根据该周边设备的硬件能力信息确定对应的硬件切换入口，在多设备控制中心界面的软硬件切换入口区域显示该周边设备对应的硬件切换入口，或在多设备控制中心界面的软硬件切换入口区域，将该周边设备对应的硬件切换入口排序靠前并突出显示。
举例来说，在控制设备未连接周边设备时，控制设备的多设备控制中心界面如图15中左图所示，在用户选择智慧屏设备后，多设备控制中心界面如图15中右图所示，周边设备区域中智慧屏设备的标识突出显示，且确定智慧屏设备的硬件能力信息为：支持播放音频与视频，则确定硬件切换入口为“投屏”、“音频输出”，将智慧屏设备对应的硬件切换入口排序靠前并突出显示，能够更加直观展示当前连接的周边设备以及该周边设备能够提供的硬件能力。
在一种实施方式中，控制设备检测到周边设备后，可以根据下列方式中的至少一种确定多设备控制中心界面显示的软件切换入口：
方式1、控制设备根据周边设备软件能力信息，确定在多设备控制中心界面显示的至少一个软件切换入口。
控制设备检测到周边设备后，根据周边设备的设备属性确定周边设备的软件能力信息，根据周边设备的软件能力信息确定至少一个软件切换入口；例如，根据以下规则中的至少一种确定控制设备在多设备控制中心界面显示的软件切换入口：
规则1：控制设备检测到周边设备为屏幕大、交互难度较高的电子设备，如电视、智慧屏设备等，则控制设备确定周边设备的软件能力信息为：支持DLNA投屏、镜像、屏幕扩展等软件功能，控制设备在多设备控制中心界面的软硬件切换入口区域显示的软件切换入口可以为：“DLNA投屏”、“镜像”、“屏幕扩展”；
规则2：控制设备检测到周边设备为易于交互的电子设备，如电脑、平板、手机等，则控制设备确定周边设备的软件能力信息为支持任务接续或输入借用等软件功能，其中，任务接续功能为控制设备通过与周边设备建立连接，在周边设备上继续执行控制设备进行中的任务；输入借用功能为控制设备借用周边设备接收到的输入内容，如周边设备将周边设备接收到的音频输出数据发送给控制设备。则控制设备检测到周边设备为易于交互的电子设备后，在多设备控制中心界面的软硬件切换入口区域显示的软件切换入口可以为：“接力”、“数据同步”、“电脑模式”、“多屏协同”。
规则3：控制设备检测到周边设备为屏幕小的设备，如手表、手环、眼镜等，则控制设备确定周边设备的软件能力信息为支持任务接续等软件功能，则控制设备在多设备控制中心界面的软硬件切换入口区域显示的软件切换入口可以为：“接力”、“数据同步”。
规则4：控制设备检测到周边设备具有降噪、智能音量调节等功能，则确定周边设备的软件能力信息为支持降噪、智能调节音量等软件功能，则控制设备在多设备控制中心界面的软硬件切换入口区域显示的软件切换入口可以为“降噪”、“智能调节音量”。
下面以实施例8～11对本申请实施例控制设备根据检测到的周边设备确定多设备控制中心界面显示的至少一个软件切换入口的方式进行进一步说明：
实施例8、控制设备检测周边设备有智慧屏设备，确定智慧屏设备属性为屏幕大。如图16所示，控制设备在多设备控制中心界面的软硬件切换入口区域显示的软件切换入口可以为：“DLNA投屏”、“镜像”和“屏幕扩展”。
实施例9、控制设备检测周边设备有平板和电脑，确定平板与电脑的属性为易于交互。如图17所示，控制设备在多设备控制中心界面的软硬件切换入口区域显示的软件切换入口可以为“数据同步”、“多屏协同”和“电脑模式”。
实施例10、控制设备检测周边设备有手表，确定手表的属性为屏幕小。如图18所示，控制设备在多设备控制中心界面的软硬件切换入口区域显示的软件切换入口可以为“数据同步”。
实施例11、控制设备检测周边设备有耳机，确定耳机具有降噪功能，如图19所示，控制设备在多设备控制中心界面的软硬件切换入口区域显示的软件切换入口可以为“降噪”。
方式2、控制设备根据当前执行的任务对应的软件功能需求，确定多设备控制中心界面显示的至少一个软件切换入口。
控制设备根据当前执行的任务，确定当前执行任务所需的软件功能需求，并确定当前执行任务所需的软件功能需求对应的软件切换入口，具体可以根据以下规则中的至少一种确定控制设备在多设备控制中心界面显示的至少一个软件切换入口：
规则1、若控制设备当前执行的任务为媒体播放任务，如播放音乐、播放视频等，则控制设备确定媒体播放任务的软件功能需求为音频处理、视频处理等软件功能，如降噪、DLNA投屏，则在多设备控制中心界面显示的软件切换入口包括投屏与播放音视频对应的软件切换入口。
规则2、若控制设备当前执行的任务为办公类任务，如文档查看与编辑、邮件处理等，则控制设备确定办公类任务的软件功能需求为数据处理等软件功能，则在多设备控制中心界面显示的软件切换入口包括任务接续或输入借用功能对应的软件切换入口。
规则3、若控制设备当前执行的任务为显示类任务，如显示桌面、日历等，则控制设备确定显示类任务的软件功能需求为调整显示效果等软件功能，则在多设备控制中心界面显示的软件切换入口包括屏幕借用能力对应的软件切换入口。
下面以实施例12～14对本申请实施例控制设备根据当前执行任务的软件功能需求，确定多设备控制中心界面显示的软件切换入口的方式进行进一步说明：
实施例12、如图20所示，控制设备当前执行的任务为播放视频，用户触发多设备控制中心界面显示指令，控制设备确定当前执行的播放视频任务所需的软件切换入口为“DLNA投屏”、“播放”，控制设备在多设备控制中心界面的软硬件切换入口区域显示“DLNA投屏”、“播放”软件切换入口。
实施例13、如图21所示，控制设备当前执行的任务为文档编辑，用户触发多设备控制中心界面显示指令，控制设备确定当前执行的文档编辑任务所需的软件切换入口为“接 力”、“数据同步”，控制设备在多设备控制中心界面的软硬件切换入口区域显示“接力”、“数据同步”软件切换入口。
实施例14、如图22所示，控制设备当前执行的任务为显示日历，用户触发多设备控制中心界面显示指令，控制设备确定当前执行的显示日历任务所需的软件切换入口为“镜像”、“多屏协同”，控制设备在多设备控制中心界面的软硬件切换入口区域显示“镜像”、“多屏协同”软件切换入口。
方式3、控制设备根据当前已建立连接的周边设备的软件能力信息，确定多设备控制中心界面显示的至少一个软件切换入口。
控制设备当前已连接周边设备后，用户触发多设备控制中心界面显示指令，控制设备确定已与控制设备建立连接的周边设备，将已与控制设备建立连接的周边设备的标识在周边设备区域中排序靠前且突出显示，并根据该周边设备的软件能力信息确定对应的软件切换入口，在多设备控制中心界面的软硬件切换入口区域显示该周边设备对应的软件切换入口，或在多设备控制中心界面的软硬件切换入口区域，将该周边设备对应的软件切换入口排序靠前并突出显示。
例如，用户操作控制设备已选中了电脑，则在多设备控制中心界面的软硬件切换入口区域中优先显示“多屏协同”、“屏幕扩展”、“接力”、“电脑模式”等电脑能够提供的软件能力对应的软件切换入口；
或者，用户操作控制设备已选中了电视，则在多设备控制中心界面的软硬件切换入口区域中优先显示“镜像”、“DLNA投屏”、“电脑模式”等电视能够提供的软件能力对应的软件切换入口；
或者，用户操作控制设备已选中了平板，则在多设备控制中心界面的软硬件切换入口区域中优先显示“多屏协同”、“屏幕扩展”、“接力”等平板能够提供的软件能力对应的软件切换入口；
或者，用户操作控制设备已选中了手机，则在多设备控制中心界面的软硬件切换入口区域中优先显示“镜像”、“接力”、“屏幕扩展”等手机能够提供的软件能力对应的软件切换入口。
下面以实施例15对控制设备根据当前已建立连接的周边设备的软件能力，确定多设备控制中心界面显示的软件切换入口的方式进行进一步说明：
实施例15、用户操作控制设备选中电脑后，用户触发多设备控制中心界面显示指令，控制设备确定控制设备与电脑已建立连接，则在该场景下，控制设备显示的多设备控制中心界面如图23所示，在多设备控制中心界面的周边设备区域突出显示电脑的标识，在软硬件切换入口区域突出显示软件切换入口“多屏协同”、“屏幕扩展”、“接力”、“电脑模式”。
需要说明的是，控制设备可以在多设备控制中心界面的软硬件切换入口区域显示硬件切换入口，如上述实施例1～7所示；控制设备可以在多设备控制中心界面的软硬件切换入口区域显示软件切换入口，如上述实施例8～15所示；控制设备还可以在多设备控制中心界面的软硬件切换入口区域中相同或不同的子区域同时显示硬件切换入口与软件切换入口。
控制设备在软硬件切换入口区域同时显示硬件切换入口与软件切换入口时，一种可选的方式为，由于软件切换入口是基于硬件切换入口实现切换的，如软件切换入口“电脑模式”，需要在用户选择硬件切换入口“投屏”将控制设备显示的内容投屏到周边设备后， 才能通过软件切换入口“电脑模式”实现使用电脑模式进行投屏的功能；如图24所示的多设备控制中心界面，在软硬件切换入口区域中，将软件切换入口放置在对应的硬件切换入口下，用户可以点击硬件切换入口后的展开按钮，触发展示该硬件切换入口对应的软件切换入口，硬件切换入口“投屏”对应的软件切换入口如图24中虚线框所示。另一种可选的方式为，硬件切换入口与软件切换入口分别在多设备控制中心界面的软硬件切换入口区域中的不同子区域进行显示，例如，如图25所示，在区域A显示硬件切换入口，在区域B显示软件切换入口。再一种可选的方式为，在多设备控制中心界面的软硬件切换入口区域同时显示硬件切换入口与软件切换入口，例如，如图26所示，对软件切换入口以及硬件切换入口排序后，在同一区域进行显示。
本申请实施例还提供多种多设备控制中心界面的显示样式，以图27所示的样式1对本申请实施例中多设备控制中心界面的设计理念进行介绍，图27中区域C为控制设备功能区域，用户能够通过该区域的快捷入口对控制设备进行设置。区域D为软硬件切换入口区域，用于显示控制设备的硬件切换入口和软件切换入口。控制设备功能区域和软硬件切换入口区域显示的按钮均为控制设备自身的功能对应的按钮，体现了全场景智慧生活中的“1+8+N”理念中“1”代表的全场景智慧生活的控制中心——控制设备的功能。针对“1+8+N”理念中作为辅助入口的8种周边设备，控制设备将当前检测到的周边设备的标识显示在区域E中，用户能够左右滑动查看或选择周边设备。针对“1+8+N”理念中的N个***设备，控制设备将当前检测到的***设备的标识显示在区域F中，用户能够上下滑动查看或选择***设备。通过上述多设备控制中心，将控制设备作为全场景智慧生活的控制中心，对周边设备进行协调控制，同时能够方便快捷的利用周边设备的软/硬件能力，提升用户使用体验。
如图28所示的样式2，控制设备在多设备控制中心界面中的区域G显示周边设备的标识，在区域H中显示软硬件切换入口，其中，每个软硬件切换入口对应一个展开按钮，用户点击展开按钮后，触发展示如图28中右图所示的设备列表，该设备列表中为具备当前展开按钮对应的软硬件切换入口的软硬件能力的周边设备，如用户点击“音频输出”硬件切换入口对应的展开按钮，显示的设备列表中为支持音频输出的周边设备列表；用户在触摸显示屏显示的设备列表中选择目标周边设备触发目标切换指令，控制设备确定目标切换指令为通过目标周边设备实现控制设备的音频输出功能，则控制设备将用户选择的目标周边设备作为控制设备的音频输出设备。
如图29所示的样式3，多设备控制中心界面中的区域I为软硬件切换入口区域，区域I位于控制设备功能区域内，区域J显示周边设备的标识。
如图30所示的样式4，在图30中的(a)所示的多设备控制中心界面中显示周边设备的标识，用户长按周边设备的标识后，触发展示如图30中的(b)所示的软硬件切换入口界面，用户在点击触摸显示屏显示的软硬件切换入口界面上硬件切换入口对应的展开按钮后，控制设备在触摸显示屏上显示硬件切换入口，同时在硬件切换入口下方显示该硬件切换入口对应的周边设备列表。例如，用户点击音频输出对应的展开按钮后，显示如图30中的(c)所示的周边设备列表，用户能够选择其中的周边设备作为控制设备的音频输出设备。
二、应用级
控制设备在前台运行应用程序时，用户通过应用内的预设按钮触发展示软硬件切换界 面；用户通过点击触摸显示屏上的预设按钮向控制设备发送软硬件切换界面显示指令，以使控制设备在显示屏当前显示的应用界面上显示软硬件切换界面。如用户在触摸显示屏显示的应用程序界面点击“投屏”按钮，控制设备在显示屏上显示软硬件切换界面。
本申请实施例一种可选的实施方式中，用户在应用程序显示界面触发软硬件切换界面显示指令后，控制设备对当前周边设备进行检测，并将检测到的至少一个周边设备的标识显示在软硬件切换界面中。例如控制设备在软硬件切换界面中显示控制设备检测到的至少一个周边设备的名称。具体实施中，控制设备采用与上述操作***级实施例中相同的方法，此处不再赘述。
另外，控制设备在接收到软硬件切换界面显示指令后，确定在软硬件切换界面中显示的硬件切换入口和/或软件切换入口。具体实施中，控制设备采用与上述操作***级实施例中相同的方法，此处也不再赘述。
下面结合附图对本申请实施例中根据不同方式确定软硬件切换界面显示的硬件切换入口进行示例性说明，具体实施中，控制设备可以根据下列方式中的至少一种确定软硬件切换界面显示的硬件切换入口：
方式1、控制设备根据检测到的周边设备的硬件能力信息，确定软硬件切换界面显示的至少一个的硬件切换入口。
如图31中(a)所示，控制设备当前的触摸显示屏上显示文档应用程序的界面，用户在触摸显示屏显示的文档应用程序界面点击“投屏”按钮，触发软硬件切换界面显示指令，控制设备在触摸显示屏上显示如图31中的(b)所示的软硬件切换界面，控制设备在软硬件切换界面中的周边设备区域显示当前检测到的周边设备智慧屏设备、平板、电脑、音箱的名称；控制设备根据检测到的周边设备的硬件能力信息确定硬件切换入口为：“音频输出”和“音频录入”，则在软硬件切换界面的软硬件切换入口区域显示硬件切换入口“音频输出”以及“音频录入”的名称；如图31中的(c)所示，用户在触摸显示屏显示的软硬件切换界面中选择周边设备中的智慧屏设备，控制设备将当前显示的内容投屏到智慧屏设备上，且默认选择智慧屏设备作为控制设备的音频输出设备，用户也可以手动更改音频输出使用的周边设备；在用户需要选择周边设备作为控制设备的音频录入时，用户可以点击硬件切换入口“音频录入”，手动选择音频录入使用的周边设备。
方式2、控制设备根据当前执行任务的硬件功能需求，确定软硬件切换界面显示的至少一个硬件切换入口。
如图32中的(a)所示，控制设备当前前台运行的应用程序为“K歌”应用程序，当前执行的任务为录制音频，用户在触摸显示屏上点击“投屏”按钮，触发软硬件切换界面显示指令，控制设备在触发显示屏上显示软硬件切换界面；如图32中的(b)所示，控制设备在软硬件切换界面内的周边设备区域显示检测到的周边设备的名称，并根据当前执行的任务确定在软硬件切换界面展示的硬件切换入口，如确定出的硬件切换入口为“音频输出”和“音频录入”，则在图32中的(b)所示的软硬件切换界面内的软硬件切换入口区域显示“音频输出”和“音频录入”的名称。如图32中的(c)所示，用户在设备列表中选择智慧屏设备后，音频输出默认选择智慧屏设备，用户可以手动修改。
如图33中的(a)所示，控制设备当前前台运用的应用程序为“K歌”应用程序，当前执行的任务为录制唱歌视频，用户在触摸显示屏上点击“投屏”按钮，触发软硬件切换界面显示指令，控制设备在触发显示屏上显示软硬件切换界面；如图33中的(b)所示， 控制设备而在软硬件切换界面内的周边设备区域显示检测到的周边设备的名称，并根据当前执行的任务确定在软硬件切换界面展示的硬件切换入口，如确定出的硬件切换入口可以为“音频输出”、“音频录入”和“摄像头”，则在图33中的(b)所示的软硬件切换界面内的软硬件切换入口区域显示“音频输出”、“音频录入”和“摄像头”硬件切换入口。如图33中的(c)所示，用户在设备列表中选择智慧屏设备后，音频输出默认选择智慧屏设备，摄像头默认选择控制设备的本机前置摄像头。用户可以手动更改音频输出以及摄像头使用的周边设备，例如图33中的(d)所示，用户在触摸显示屏上显示的摄像头对应的周边设备列表中选择智慧屏设备，触发目标切换指令，控制设备将当前使用的摄像头切换为智慧屏设备的摄像头，并向智慧屏设备发送用于借用智慧屏设备摄像头的请求信息，控制设备将当前使用的摄像头切换为智慧屏设备的摄像头。在用户完成硬件切换设置后，触发返回控制设备当前执行的任务界面的显示指令，控制设备在显示屏上显示任务界面，并在任务界面上显示当前控制设备投屏的设备，如图33中的(e)所示，当前控制设备投屏至智慧屏设备，则在任务界面上显示智慧屏名称，用户点击智慧屏名称后的关闭按钮，可以断开控制设备与智慧屏设备之间的连接。
需要说明的是，本申请实施例中硬件切换入口可以选择多个周边设备作为控制设备的输入或输出设备，如图34所示，选择多个周边设备作为控制设备的投屏设备，能够同时将控制设备显示的内容投屏到多个周边设备，提升用户观看体验；或如图35所示，选择多个周边设备的摄像头作为控制设备的输入，能够对同一空间进行多角度录制视频，控制设备对多角度视频进行合成后得到虚拟现实(Virtual Reality，VR)全景视频，提升控制设备的可玩性与实用性。
举例来说，直播场景下，需要多个摄像头进行拍摄，从而形成导播台；如图36中的(a)所示，直播用户可以点击当前控制设备的触摸显示屏上“更多”按钮，触发显示如图36中的(b)所示的“更多”界面，用户在“更多”界面中点击“导播台”按钮，触发显示如图36中的(c)所示的选择摄像头的软硬件切换界面，用户可以同时选择设备列表中的多个摄像头，控制设备将用户选择的多个摄像头拍摄的视频作为控制设备的视频输入，如图36中的(d)所示，在控制设备显示界面上以多个小窗口的形式显示多个设备摄像头拍摄的内容。用户点击触摸显示屏上显示的小窗口，控制设备将用户点击操作对应的小窗口中的内容全屏显示触摸显示屏上，并将默认全屏显示的内容缩小到小窗口中显示。例如，如图36中的(e)所示，用户点击摄像头3拍摄的画面对应的小窗口后，将摄像头3拍摄的画面全屏显示后，控制设备默认全屏显示的前置摄像头拍摄的画面缩小到小窗口中显示。
方式3、控制设备根据当前已建立连接的周边设备的硬件能力信息，确定软硬件切换界面显示的至少一个硬件切换入口。
如图37所示，控制设备当前前台运行的应用程序为文档应用程序，用户通过应用程序内的“投屏”按钮触发软硬件切换界面显示指令，若用户在本次触发展示软硬件切换界面之前，已经选择将控制设备显示内容投屏到智慧屏设备，则本次触发展示软硬件切换界面如图37中右图所示，智慧屏设备显示选中图标，且“音频输出”硬件切换入口显示选中智慧屏设备；用户可以选择除智慧屏设备以外的其它设备，以更改投屏使用的周边设备，用户也可以手动切换硬件切换入口使用的周边设备。
下面结合附图对本申请实施例中根据不同方式确定软硬件切换界面显示的软件切换 入口进行示例性说明，具体实施中，控制设备可以根据下列方式中的至少一种确定软硬件切换界面显示的至少一个软件切换入口：
方式1、控制设备根据周边设备软件能力信息，确定在软硬件切换界面显示的至少一个软件切换入口。
以实施例16～19对本申请实施例控制设备根据检测到的周边设备的软件能力信息，确定软硬件切换界面显示的软件切换入口的方式进行说明：
实施例16、控制设备检测周边设备有智慧屏设备，确定智慧屏设备的软件能力信息为：支持DLNA投屏、镜像、屏幕扩展等软件功能。如图38所示，控制设备在软硬件切换界面中的周边设备区域显示智慧屏设备的名称，在软硬件切换入口区域显示“DLNA投屏”、“镜像”和“屏幕扩展”软件切换入口。
实施例17、控制设备检测周边设备有平板和电脑，确定平板与电脑的软件能力信息为支持任务接续或输入借用等软件功能。如图39所示，控制设备在软硬件切换界面中的周边设备区域显示平板和电脑的名称，在软硬件切换入口区域显示“数据同步”、“多屏协同”和“电脑模式”软件切换入口。
实施例18、控制设备检测周边设备有手表，确定手表的软件能力信息为支持任务接续等软件功能。如图40所示，控制设备在软硬件切换界面中的周边设备区域显示手表的名称，在软硬件切换界面的软硬件切换入口区域显示“数据同步”软件切换入口。
实施例19、控制设备检测周边设备有耳机，确定耳机的软件能力信息为具有降噪功能，如图41所示，控制设备在软硬件切换界面中的周边设备区域显示耳机的名称，在软硬件切换界面的软硬件切换入口区域显示“降噪”软件切换入口。
方式2、控制设备根据当前执行的任务对应的软件功能需求，确定软硬件切换界面显示的至少一个软件切换入口。
以实施例20～22对本申请实施例控制设备根据当前执行任务的软件功能需求，确定软硬件切换界面显示的软件切换入口的方式进行说明：
实施例20、如图42所示，控制设备当前执行的任务为播放视频，用户在触摸显示屏上触发软硬件切换界面显示指令，控制设备确定当前执行的播放视频任务所需的软件切换入口为“DLNA投屏”、“播放”，控制设备在软硬件切换界面的软硬件切换入口区域显示“DLNA投屏”、“播放”软件切换入口。
实施例21、如图43所示，控制设备当前执行的任务为文档编辑，用户在触摸显示屏上触发软硬件切换界面显示指令，控制设备确定当前执行的文档编辑任务所需的软件切换入口为“接力”、“数据同步”，控制设备在软硬件切换界面的软硬件切换入口区域显示“接力”、“数据同步”软件切换入口。
实施例22、如图44所示，控制设备当前执行的任务为显示日历，用户在触摸显示屏上触发软硬件切换界面显示指令，控制设备确定当前执行的显示日历任务所需的软件切换入口为“镜像”、“多屏协同”，控制设备在软硬件切换界面的软硬件切换入口区域显示“镜像”、“多屏协同”软件切换入口。
方式3、控制设备根据当前已建立连接的周边设备的软件能力信息，确定多设备控制中心界面显示的至少一个软件切换入口。
如图45中左图所示，控制设备当前执行的任务为查看文档，用户在触摸显示屏上触发软硬件切换界面显示指令，控制设备确定当前控制设备已与智慧屏设备建立连接，则控 制设备显示的软硬件切换界面如图45中右图所示，周边设备区域中显示智慧屏设备已被选中的图标，同时显示当前检测到的其它周边设备平板的名称，智慧屏设备对应的软件切换入口“DLNA投屏”、“镜像”以及“屏幕扩展”在软硬件切换入口区域排序靠前显示，平板对应的软件切换入口“多屏协同”、“接力”排序靠后显示。
在确定出在控制设备的软硬件切换入口后，控制设备展示软硬件切换界面，本申请实施例提供以下四种软硬件切换界面的显示样式：
样式1、用户触发展示软硬件切换界面后，显示控制设备检测到的周边设备列表，用户在周边设备列表中选择设备后，触发展示多种软硬件切换入口。
例如，用户通过应用程序内的“投屏”按钮触发展示周边设备列表，周边设备列表如图46中左图所示，用户在周边设备列表中选择智慧屏设备后，触发展示如图46中右图所示的多种软硬件切换入口。
样式2、用户触发展示硬件切换界面后，同时显示控制设备检测到的周边设备列表以及多种软硬件切换入口。
例如，用户通过应用程序内的“投屏”按钮触发展示周边设备列表后，控制设备显示如图47所示的软硬件切换界面，包括控制设备当前检测到的周边设备列表以及多种软硬件切换入口。
样式3、用户触发展示硬件切换界面后，显示至少一个软硬件切换入口，每个软硬件切换入口对应一个展开按钮，用户触发软硬件切换入口对应的展开按钮后，展示能够提供该软硬件切换入口对应的软硬件功能的设备列表。
例如，用户通过应用程序内的“投屏”按钮，触发展示如图48中左图所示的软硬件切换入口界面，用户点击音频输出对应的展开按钮后，展示如图48中右图所示的设备列表，用户在设备列表中选择智慧屏设备，触发目标切换指令，控制设备将智慧屏设备作为控制设备的音频输出设备；同时，在用户未选择硬件切换入口使用的设备时，硬件切换入口对应默认选项，如图48中的左图中，摄像头对应的默认选项为本机前置，用户也可以点击摄像头对应的展示按钮，展示设备列表，并在用户选择设备后，将选择设备的摄像头录制的视频作为控制设备的视频输入。
样式4、用户触发展示硬件切换界面后，根据如上述样式1～样式3方式展示硬件切换入口，用户点击硬件切换入口，触发展示与该硬件切换入口对应的软件切换入口，如图49中左图所示，用户点击“投屏”硬件切换入口，触发展示如图49中右图所示的与“投屏”对应的“镜像”、“DLNA投屏”、“电脑模式”等软件切换入口。
在本申请实施例一种可选的实施方式中，控制设备显示多设备控制中心界面或软硬件切换界面后，用户触发目标切换指令，控制设备确定目标切换指令对应的目标功能，并通过目标周边设备实现控制设备的目标功能。具体实施中，目标切换指令对应的目标功能具有以下几种情况：
1、目标功能为预设的硬件功能或软件功能
控制设备接收到用户触发的目标切换指令后，将预设的硬件功能或软件功能作为所述目标功能。例如，用户在触摸显示屏上点击应用程序显示界面上的“投屏”按钮，控制设备在触摸显示屏上显示设备列表，用户选择“智慧屏”触发目标切换指令，控制设备将当前显示的内容投屏到智慧屏设备上。在该场景下，通过应用程序内的“投屏”按钮，控制 设备执行投屏功能，则此时目标切换指令对应的目标功能为预设的投屏硬件功能。
2、目标功能为控制设备根据目标周边设备的硬件能力或软件能力，确定的硬件功能或软件功能
用户在触摸显示屏上点击应用程序界面上的预设按钮后，控制设备在触摸显示屏上显示周边设备列表，用户选择目标周边设备后，触发目标切换指令。若控制设备确定目标周边设备不具备预设按钮对应的硬件能力，则控制设备确定目标周边设备的硬件能力，并将目标周边设备的硬件能力作为目标功能。
举例来说，用户在触摸显示屏上点击应用程序显示界面上的“投屏”按钮，控制设备在触摸显示屏上显示设备列表，用户选择“音箱”，控制设备确定音箱并不具有屏幕硬件，且音箱提供的硬件能力为音频输出，则控制设备自动将音箱作为控制设备的音频输出设备，在该场景下，通过应用程序内的“投屏”按钮，控制设备执行音频输出功能，则此时目标切换指令对应的目标功能为根据目标周边设备的硬件能力确定的音频输出硬件功能。
3、目标功能为控制设备根据当前执行的任务确定的硬件功能或软件功能
用户在触摸显示屏上点击应用程序界面上的预设按钮后，控制设备在触摸显示屏上显示周边设备列表，用户选择目标设备后，触发目标切换指令，控制设备对当前执行的任务进行分析，确定当前执行的任务所需的硬件功能，若当前执行的任务所需的硬件功能与目标切换指令对应的预设的硬件功能不同，则控制设备将当前执行任务所需的硬件功能作为目标功能。
举例来说，控制设备当前运行相机应用，控制设备的触摸显示屏上显示如图50中的(a)所示的拍照界面，用户通过拍照界面中的“更多选项”对应的按钮触发展示如图50中的(b)所示的功能列表，用户在触摸显示屏上显示的功能列表中选择“投屏”按钮，触发展示如图50中的(c)所示的硬件切换界面。在用户选择将控制设备当前运行的相机应用投屏到智慧屏设备触发目标切换指令后，控制设备对当前执行的拍照任务进行分析，确定当前执行的拍照任务需要的硬件功能为摄像头拍摄功能，则控制设备默认借用智慧屏设备的摄像头进行拍摄。如图51所示，控制设备的触摸显示屏上显示相机应用界面，但该相机应用界面中显示的内容为智慧屏设备的摄像头拍摄到的视频文件，且控制设备通过投屏功能将该相机应用界面投屏到智慧屏设备上，如图52所示，智慧屏设备上显示的相机应用界面中的显示内容也为智慧屏设备的本机摄像头拍摄到的视频文件。
同时，控制设备在将相机应用界面投屏到智慧屏设备上后，用户可以点击控制设备上相机应用的软件功能对应的按钮触发控制设备调用相机应用的软件功能，如相机应用的“添加滤镜”、“美颜”等软件功能对应的按钮；或用户可以通过智慧屏设备的控制器或体感控制等方式选择智慧屏设备上显示的相机应用的软件功能对应的按钮，触发目标切换指令；在用户触发调用相机应用的软件功能的目标切换指令后，可以根据下列方式进行处理：
方式1、控制设备进行处理
控制设备处理器调用相机应用的软件功能对应的算法，对接收到智慧屏设备发送的智慧屏设备的摄像头拍摄的视频文件或图像进行图像处理，并将图像处理后的视频文件或图像显示在触摸显示屏上，同时，控制设备将当前触摸显示屏上显示的内容投屏到智慧屏设备上，智慧屏设备上显示图像处理后的视频文件或图像。
方式2、智慧屏设备进行处理
控制设备将相机应用界面投屏到智慧屏设备后，控制设备将相机应用的软件功能对应 的算法发送到智慧屏设备，智慧屏设备将接收到的相机应用的软件功能对应的算法保存到智慧屏设备的存储器中，在检测到用户触发调用相机应用的软件功能的指令后，智慧屏设备调用相机应用的软件功能对应的算法，对智慧屏设备的摄像头拍摄得到的视频文件或图像进行图像处理，将处理后的视频文件或图像显示在智慧屏设备上，同时智慧屏设备将图像处理后的视频文件或图像发送给控制设备，控制设备将接收到的视频文件或图像显示到控制设备的触摸显示屏上。
如图53所示，为本申请实施例一种功能切换入口的确定方法流程图，包括以下步骤：
步骤S5301、控制设备接收显示指令；
步骤S5302、控制设备确定当前执行任务的功能需求；
需要说明的是，控制设备当前执行任务可以为运行应用程序、显示***界面等；例如，控制设备当前执行的任务为播放视频，若此时控制设备当前显示视频暂停界面，控制设备当前执行的任务仍为播放视频。
具体实施中，控制设备确定当前执行任务的功能需求的方法，可以参见本申请实施例4～7或实施例12～14所述的方法，此处不再赘述。
步骤S5303、控制设备检测当前环境中的至少一个周边设备，确定至少一个周边设备的能力信息；
其中，周边设备的能力信息为周边设备具备的软件能力或硬件能力，例如周边设备包括音箱，则音箱的能力信息为：支持音频输出、音频录入以及智能音量调节等功能。
需要说明的是，具体实施中，若控制设备在接收显示指令之前，已确定当前网络连接中的至少一个周边设备，则控制设备可以直接确定至少一个周边设备的能力信息，而无需对当前网络连接中的周边设备进行检测。
具体实施中，控制设备确定周边设备的能力信息的方法，可以参见本申请实施例1～3或实施例8～11所述的方法，此处不再赘述。
步骤S5304、控制设备根据当前执行任务的功能需求和至少一个周边设备的能力信息确定至少一个功能切换入口；
步骤S5305、控制设备显示包含至少一个功能切换入口和/或至少一个周边设备标识的目标界面；
步骤S5306、控制设备接收目标切换指令；
需要说明的是，目标切换指令可以为用户在目标界面中触发的指令，用于指示控制设备将目标功能映射到目标周边设备。
步骤S5307、控制设备确定目标切换指令对应的目标功能；
具体实施中，控制设备确定切换指令对应的目标功能的方式可以参见上述实施例中确定目标切换指令对应的目标功能的实施方式，此处不再赘述。
步骤S5308、控制设备通过第二周边设备实现目标功能。
基于以上实施例，本申请实施例还提供了一种电子设备，所述电子设备用于实现如上述实施例所述的功能切换入口的确定方法，如图54所示，所述电子设备5400中包括：处理器5401、存储器5402和显示屏5403，当然还可以具有图1所示的各个***或内部硬件。
所述存储器5402与所述处理器5401之间相互连接。可选的，所述处理器5401和所 述存储器5402可以通过总线相互连接；所述总线可以是外设部件互连标准(peripheral component interconnect，PCI)总线或扩展工业标准结构(extended industry standard architecture，EISA)总线等。所述总线可以分为地址总线、数据总线、控制总线等。为便于表示，图54中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。
具体地，所述存储器5402，用于存放程序指令。具体地，程序指令可以包括程序代码，该程序代码包括计算机操作的指令。存储器5402可能包含随机存取存储器(random access memory，RAM)，也可能还包括非易失性存储器(non-volatile memory)，例如至少一个磁盘存储器。所述处理器5401执行所述存储器5402所存放的指令，使得所述电子设备5400执行：确定当前执行任务的功能需求；检测当前环境中的至少一个第一周边设备，确定所述至少一个第一周边设备的能力信息；根据所述当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口；其中，所述第一功能切换入口用于将所述第一功能切换入口对应的功能映射到所述至少一个第一周边设备；所述第一功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能。所述显示屏5403用于显示所述至少一个第一功能切换入口。
在一个实现方式中，所述计算机程序被所述处理器5401执行时，使得所述电子设备还执行：在确定当前执行任务的功能需求之前，接收显示指令；其中，所述显示指令用于指示所述电子设备5400显示目标界面；在根据所述当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口之后，在所述显示屏5403上显示所述目标界面；其中，所述目标界面中包含至少一个第一功能切换入口，和/或，所述至少一个第一周边设备的标识。
在一个实现方式中，所述目标界面为多设备控制中心界面，所述显示指令为用户通过操作***级按键或预设手势触发的；或者所述目标界面为软硬件切换界面，所述显示指令为用户通过应用界面上的预设按钮触发的。
在一个实现方式中，所述至少一个第一功能切换入口包含：至少一个硬件切换入口，和/或，至少一个软件切换入口；所述计算机程序被所述处理器5401执行时，使得所述电子设备5400具体执行：根据当前执行任务的硬件功能需求和所述至少一个第一周边设备的硬件能力信息确定所述至少一个硬件切换入口；和/或，根据当前执行任务的软件功能需求和所述至少一个第一周边设备的软件能力信息确定所述至少一个软件切换入口。
在一个实现方式中，所述计算机程序被所述处理器5401执行时，使得所述电子设备5400还执行：确定当前与所述电子设备5400建立连接的第二周边设备的能力信息；根据所述第二周边设备的能力信息确定至少一个第二功能切换入口；其中，所述第二功能切换入口用于将所述第二功能切换入口对应的功能映射到所述第二周边设备；所述第二功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能。
在一个实现方式中，所述计算机程序被所述处理器5401执行时，使得所述电子设备5400还执行：在所述显示屏显示所述目标界面之后，接收目标切换指令，所述目标切换指令用于指示所述电子设备5400将目标功能映射到目标周边设备；响应所述目标切换指令，通过所述目标周边设备实现所述目标功能。
在一个实现方式中，所述目标功能为预设的硬件功能或软件功能；或所述目标功能为所述电子设备5400根据所述目标周边设备的硬件能力或软件能力，确定的硬件功能或软件功能；或所述目标功能为所述电子设备5400根据当前执行的任务确定的硬件功能或软 件功能。
在一个实现方式中，所述控制设备当前执行任务为播放视频，所述当前网络连接中的第一周边设备为智慧屏设备；所述计算机程序被所述处理器5401执行时，使得所述电子设备5400具体执行：确定所述当前执行任务的功能需求为视频输出，并确定所述智慧屏设备的能力信息为支持播放音频与视频；确定第一功能切换入口为投屏；或者
所述控制设备当前执行任务为播放音频，所述当前网络连接中的第一周边设备为音箱；所述计算机程序被所述处理器5401执行时，使得所述电子设备5400具体执行：确定所述当前执行任务的功能需求为音频输出，并确定所述音箱的能力信息为支持播放音频；确定第一功能切换入口为音频输出；或者
所述控制设备当前执行任务为K歌，所述当前网络连接中的第一周边设备为智慧屏设备、音箱；所述计算机程序被所述处理器5401执行时，使得所述电子设备5400具体执行：确定所述当前执行任务的功能需求为视频输出、音频输出和音频录入，并确定所述智慧屏设备的能力信息为支持播放音频与视频、确定所述音箱的能力信息为支持播放音频和音频录入；确定第一功能切换入口为投屏、音频输出和音频录入。
基于以上实施例，本申请还提供了一种电子设备，所述电子设备用于实现如上述实施例所述的功能切换入口的确定方法。参阅图55所示，所述电子设备5500包括：需求分析单元5501、检测单元5502和处理单元5503。下面对各个单元的功能进行描述。
需求分析单元5501，用于确定当前执行任务的功能需求；
检测单元5502，用于检测当前环境中的至少一个第一周边设备，确定所述至少一个第一周边设备的能力信息；
处理单元5503，用于根据所述当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口；所述第一功能切换入口用于将所述第一功能切换入口对应的功能映射到所述至少一个第一周边设备；所述第一功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能；
显示单元5504，用于显示所述至少一个第一功能切换入口。
在一个实现方式中，所述终端设备5500还包括接收单元5505，所述接收单元5505用于接收显示指令；所述显示单元5504还用于显示目标界面，其中，所述目标界面中包含至少一个第一功能切换入口，和/或，所述至少一个第一周边设备的标识。
在一个实现方式中，所述目标界面为多设备控制中心界面，所述显示指令为用户通过操作***级按键或预设手势触发的；或者所述目标界面为软硬件切换界面，所述显示指令为用户通过应用界面上的预设按钮触发的。
在一个实现方式中，所述至少一个第一功能切换入口包含：至少一个硬件切换入口，和/或，至少一个软件切换入口；所述处理单元5503具体用于：根据当前执行任务的硬件功能需求和所述至少一个第一周边设备的硬件能力信息确定所述至少一个硬件切换入口；和/或，根据当前执行任务的软件功能需求和所述至少一个第一周边设备的软件能力信息确定所述至少一个软件切换入口。
在一个实现方式中，所述处理单元5503还用于：确定当前与所述电子设备5500建立连接的第二周边设备的能力信息；根据所述第二周边设备的能力信息确定至少一个第二功能切换入口；其中，所述第二功能切换入口用于将所述第二功能切换入口对应的功能映射到所述第二周边设备；所述第二功能切换入口对应的功能为所述当前执行任务的功能需求 中的部分或全部功能。
在一个实现方式中，所述接收单元5505还用于接收目标切换指令；所述处理单元5503还用于响应所述目标切换指令，通过所述目标周边设备实现所述目标功能。
在一个实现方式中，所述目标功能为预设的硬件功能或软件功能；或所述目标功能为所述电子设备5500根据所述目标周边设备的硬件能力或软件能力，确定的硬件功能或软件功能；或所述目标功能为所述电子设备5500根据当前执行的任务确定的硬件功能或软件功能。
在一个实现方式中，所述控制设备当前执行任务为播放视频，所述当前网络连接中的第一周边设备为智慧屏设备；所述需求分析单元5501用于确定所述当前执行任务的功能需求为视频输出；所述检测单元5502用于确定所述智慧屏设备的能力信息为支持播放音频与视频；所述处理单元5503用于确定第一功能切换入口为投屏；或者
所述控制设备当前执行任务为播放音频，所述当前网络连接中的第一周边设备为音箱；所述需求分析单元5501用于确定所述当前执行任务的功能需求为音频输出；所述检测单元5502确定所述音箱的能力信息为支持播放音频；所述处理单元5503用于确定第一功能切换入口为音频输出；或者
所述控制设备当前执行任务为K歌，所述当前网络连接中的第一周边设备为智慧屏设备、音箱；所述需求分析单元5501用于确定所述当前执行任务的功能需求为视频输出、音频输出和音频录入；所述检测单元5502用于确定所述智慧屏设备的能力信息为支持播放音频与视频、确定所述音箱的能力信息为支持播放音频和音频录入；所述处理单元5503用于确定第一功能切换入口为投屏、音频输出和音频录入。
基于以上实施例，本申请实施例还提供了一种计算机存储介质，该计算机存储介质中存储有计算机程序，所述计算机程序被计算机执行时，使得计算机执行以上实施例提供的方法。
基于以上实施例，本申请实施例还提供一种芯片，所述芯片用于读取存储器中存储的计算机程序，实现以上实施例提供的方法。
基于以上实施例，本申请实施例提供了一种芯片***，该芯片***包括处理器，用于支持计算机装置实现以上实施例提供的方法中控制设备所涉及的功能。在一种可能的设计中，所述芯片***还包括存储器，所述存储器用于保存该计算机装置必要的程序和数据。该芯片***，可以由芯片构成，也可以包含芯片和其他分立器件。
本领域内的技术人员应明白，本申请的实施例可提供为方法、***、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请的方法、设备(***)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。

Claims (17)

  1. 一种功能切换入口的确定方法，其特征在于，该方法包括：
    确定控制设备当前执行任务的功能需求；
    检测当前网络连接中的至少一个第一周边设备，确定所述至少一个第一周边设备的能力信息；
    根据所述控制设备当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口；其中，所述第一功能切换入口用于将所述第一功能切换入口对应的功能映射到所述至少一个第一周边设备；所述第一功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能；
    显示所述至少一个第一功能切换入口。
  2. 如权利要求1所述的方法，其特征在于，在所述确定控制设备当前执行任务的功能需求之前，还包括：
    接收显示指令；其中，所述显示指令用于指示所述控制设备显示目标界面；
    在所述根据所述控制设备当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口之后，还包括：
    显示所述目标界面；其中，所述目标界面中包含至少一个第一功能切换入口，和/或，所述至少一个第一周边设备的标识。
  3. 如权利要求2所述的方法，其特征在于，所述目标界面为多设备控制中心界面，所述显示指令为用户通过操作***级按键或预设手势触发的；或者
    所述目标界面为软硬件切换界面，所述显示指令为用户通过应用界面上的预设按钮触发的。
  4. 如权利要求1-3任一项所述的方法，其特征在于，所述至少一个第一功能切换入口包含：至少一个硬件切换入口，和/或，至少一个软件切换入口；
    所述根据所述控制设备当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口，包括：
    根据所述控制设备当前执行任务的硬件功能需求和所述至少一个第一周边设备的硬件能力信息确定所述至少一个硬件切换入口；和/或
    根据所述控制设备当前执行任务的软件功能需求和所述至少一个第一周边设备的软件能力信息确定所述至少一个软件切换入口。
  5. 如权利要求1-4任一项所述的方法，其特征在于，该方法还包括：
    确定当前与所述控制设备建立连接的第二周边设备的能力信息；
    根据所述第二周边设备的能力信息确定至少一个第二功能切换入口；其中，所述第二功能切换入口用于将所述第二功能切换入口对应的功能映射到所述第二周边设备；所述第二功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能。
  6. 如权利要求2-5任一项所述的方法，其特征在于，在所述显示所述目标界面之后，还包括：
    接收目标切换指令，所述目标切换指令用于指示所述控制设备将目标功能映射到目标周边设备；
    响应所述目标切换指令，通过所述目标周边设备实现所述目标功能。
  7. 如权利要求6所述的方法，其特征在于，
    所述目标功能为预设的硬件功能或软件功能；或
    所述目标功能为所述控制设备根据所述目标周边设备的硬件能力或软件能力，确定的硬件功能或软件功能；或
    所述目标功能为所述控制设备根据当前执行的任务确定的硬件功能或软件功能。
  8. 如权利要求1所述的方法，其特征在于，所述控制设备当前执行任务为播放视频，所述当前网络连接中的第一周边设备为智慧屏设备；确定所述当前执行任务的功能需求为视频输出，并确定所述智慧屏设备的能力信息为支持播放音频与视频；确定第一功能切换入口为投屏；或者
    所述控制设备当前执行任务为播放音频，所述当前网络连接中的第一周边设备为音箱；确定所述当前执行任务的功能需求为音频输出，并确定所述音箱的能力信息为支持播放音频；确定第一功能切换入口为音频输出；或者
    所述控制设备当前执行任务为K歌，所述当前网络连接中的第一周边设备为智慧屏设备、音箱；确定所述当前执行任务的功能需求为视频输出、音频输出和音频录入，并确定所述智慧屏设备的能力信息为支持播放音频与视频、确定所述音箱的能力信息为支持播放音频和音频录入；确定第一功能切换入口为投屏、音频输出和音频录入。
  9. 一种电子设备，其特征在于，包括处理器、存储器、显示屏；
    所述存储器用于存储一个或多个计算机程序，所述计算机程序被所述处理器执行时，使得所述电子设备执行：
    确定当前执行任务的功能需求；
    检测当前环境中的至少一个第一周边设备，确定所述至少一个第一周边设备的能力信息；
    根据所述当前执行任务的功能需求和所述至少一个第一周边设备的能力信息确定至少一个第一功能切换入口；其中，所述第一功能切换入口用于将所述第一功能切换入口对应的功能映射到所述至少一个第一周边设备；所述第一功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能；
    所述显示屏用于显示所述至少一个第一功能切换入口。
  10. 如权利要求9所述的电子设备，其特征在于，所述计算机程序被所述处理器执行时，使得所述电子设备还执行：
    在确定当前执行任务的功能需求之前，接收显示指令；其中，所述显示指令用于指示所述控制设备显示目标界面；
    在所述控制设备根据所述当前执行任务的功能需求和所述至少一个周边设备的能力信息确定至少一个第一功能切换入口之后，在所述显示屏上显示所述目标界面；其中，所述目标界面中包含至少一个第一功能切换入口，和/或，所述至少一个第一周边设备的标识。
  11. 如权利要求10所述的电子设备，其特征在于，所述目标界面为多设备控制中心界面，所述显示指令为用户通过操作***级按键或预设手势触发的；或者
    所述目标界面为软硬件切换界面，所述显示指令为用户通过应用界面上的预设按钮触发的。
  12. 如权利要求9-11任一项所述的电子设备，其特征在于，所述至少一个第一功能切换入口包含：至少一个硬件切换入口，和/或，至少一个软件切换入口；
    所述计算机程序被所述处理器执行时，使得所述电子设备具体执行：
    根据当前执行任务的硬件功能需求和所述至少一个第一周边设备的硬件能力信息确定所述至少一个硬件切换入口；和/或
    根据当前执行任务的软件功能需求和所述至少一个第一周边设备的软件能力信息确定所述至少一个软件切换入口。
  13. 如权利要求9-12任一项所述的电子设备，其特征在于，所述计算机程序被所述处理器执行时，使得所述电子设备还执行：
    确定当前与所述控制设备建立连接的第二周边设备的能力信息；
    根据所述第一周边设备的能力信息确定至少一个第二功能切换入口；其中，所述第二功能切换入口用于将所述第二功能切换入口对应的功能映射到所述第二周边设备；所述第二功能切换入口对应的功能为所述当前执行任务的功能需求中的部分或全部功能。
  14. 如权利要求10-13任一项所述的电子设备，其特征在于，所述计算机程序被所述处理器执行时，使得所述电子设备还执行：
    在所述显示屏显示所述目标界面之后，接收目标切换指令，所述目标切换指令用于指示所述控制设备将目标功能映射到目标周边设备；响应所述目标切换指令，通过所述目标周边设备实现所述目标功能。
  15. 如权利要求14所述的电子设备，其特征在于，
    所述目标功能为预设的硬件功能或软件功能；或
    所述目标功能为所述控制设备根据所述目标周边设备的硬件能力或软件能力，确定的硬件功能或软件功能；或
    所述目标功能为所述控制设备根据当前执行的任务确定的硬件功能或软件功能。
  16. 如权利要求9所述的电子设备，其特征在于，所述控制设备当前执行任务为播放视频，所述当前网络连接中的第一周边设备为智慧屏设备；所述计算机程序被所述处理器执行时，使得所述电子设备具体执行：确定所述当前执行任务的功能需求为视频输出，并确定所述智慧屏设备的能力信息为支持播放音频与视频；确定第一功能切换入口为投屏；或者
    所述控制设备当前执行任务为播放音频，所述当前网络连接中的第一周边设备为音箱；所述计算机程序被所述处理器执行时，使得所述电子设备具体执行：确定所述当前执行任务的功能需求为音频输出，并确定所述音箱的能力信息为支持播放音频；确定第一功能切换入口为音频输出；或者
    所述控制设备当前执行任务为K歌，所述当前网络连接中的第一周边设备为智慧屏设备、音箱；确定所述当前执行任务的功能需求为视频输出、音频输出和音频录入，并确定所述智慧屏设备的能力信息为支持播放音频与视频、确定所述音箱的能力信息为支持播放音频和音频录入；确定第一功能切换入口为投屏、音频输出和音频录入。
  17. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质包括计算机程序，当计算机程序在电子设备上运行时，使得所述电子设备执行如权利要求1至8任一项所述的方法。
PCT/CN2021/112128 2020-08-20 2021-08-11 一种功能切换入口的确定方法与电子设备 WO2022037463A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US18/022,116 US20230308534A1 (en) 2020-08-20 2021-08-11 Function Switching Entry Determining Method and Electronic Device
EP21857558.7A EP4195707A4 (en) 2020-08-20 2021-08-11 METHOD FOR DETERMINING A FUNCTION SWITCHING INPUT AND ELECTRONIC DEVICE
CN202180051103.9A CN115918108B (zh) 2020-08-20 2021-08-11 一种功能切换入口的确定方法与电子设备

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010845328.9A CN114168235B (zh) 2020-08-20 2020-08-20 一种功能切换入口的确定方法与电子设备
CN202010845328.9 2020-08-20

Publications (1)

Publication Number Publication Date
WO2022037463A1 true WO2022037463A1 (zh) 2022-02-24

Family

ID=80323376

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/112128 WO2022037463A1 (zh) 2020-08-20 2021-08-11 一种功能切换入口的确定方法与电子设备

Country Status (4)

Country Link
US (1) US20230308534A1 (zh)
EP (1) EP4195707A4 (zh)
CN (2) CN114168235B (zh)
WO (1) WO2022037463A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114900386A (zh) * 2022-05-09 2022-08-12 海信视像科技股份有限公司 一种终端设备及数据接力方法

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118113244A (zh) * 2022-03-23 2024-05-31 博泰车联网(南京)有限公司 投屏端和显示端的响应方法、电子设备及存储介质
WO2023216684A1 (zh) * 2022-05-09 2023-11-16 海信视像科技股份有限公司 一种终端设备及数据接力方法
CN115314591A (zh) * 2022-06-30 2022-11-08 华为技术有限公司 设备交互方法、电子设备及计算机可读存储介质
CN115412756A (zh) * 2022-08-29 2022-11-29 北京奇艺世纪科技有限公司 信息投放方法、装置、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106465048A (zh) * 2014-05-21 2017-02-22 高通股份有限公司 响应于经广播的事件通知而触发目标设备上的命令
CN107659712A (zh) * 2017-09-01 2018-02-02 咪咕视讯科技有限公司 一种投屏的方法、装置及存储介质
CN110377250A (zh) * 2019-06-05 2019-10-25 华为技术有限公司 一种投屏场景下的触控方法及电子设备
CN110764679A (zh) * 2019-11-11 2020-02-07 珠海格力电器股份有限公司 电器设备的控制方法、存储介质及处理器
WO2020142293A1 (en) * 2019-01-04 2020-07-09 Apple Inc. User interfaces for content streaming

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102099913B1 (ko) * 2012-12-28 2020-04-10 삼성전자주식회사 애플리케이션 실행 방법 및 시스템
US10992795B2 (en) * 2017-05-16 2021-04-27 Apple Inc. Methods and interfaces for home media control
CN109660842B (zh) * 2018-11-14 2021-06-15 华为技术有限公司 一种播放多媒体数据的方法及电子设备
WO2020155014A1 (zh) * 2019-01-31 2020-08-06 华为技术有限公司 智能家居设备分享***、方法及电子设备
CN109976626A (zh) * 2019-02-19 2019-07-05 华为技术有限公司 一种应用图标的切换方法及电子设备
CN110825301A (zh) * 2019-09-25 2020-02-21 华为技术有限公司 一种界面切换方法及电子设备
CN111404802A (zh) * 2020-02-19 2020-07-10 华为技术有限公司 通知处理***、方法以及电子设备
CN111343698B (zh) * 2020-02-27 2022-04-26 深圳市信锐网科技术有限公司 投屏控制方法、装置、无线控制器及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106465048A (zh) * 2014-05-21 2017-02-22 高通股份有限公司 响应于经广播的事件通知而触发目标设备上的命令
CN107659712A (zh) * 2017-09-01 2018-02-02 咪咕视讯科技有限公司 一种投屏的方法、装置及存储介质
WO2020142293A1 (en) * 2019-01-04 2020-07-09 Apple Inc. User interfaces for content streaming
CN110377250A (zh) * 2019-06-05 2019-10-25 华为技术有限公司 一种投屏场景下的触控方法及电子设备
CN110764679A (zh) * 2019-11-11 2020-02-07 珠海格力电器股份有限公司 电器设备的控制方法、存储介质及处理器

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114900386A (zh) * 2022-05-09 2022-08-12 海信视像科技股份有限公司 一种终端设备及数据接力方法
CN114900386B (zh) * 2022-05-09 2023-10-31 海信视像科技股份有限公司 一种终端设备及数据接力方法

Also Published As

Publication number Publication date
EP4195707A1 (en) 2023-06-14
US20230308534A1 (en) 2023-09-28
CN115918108A (zh) 2023-04-04
CN114168235A (zh) 2022-03-11
CN115918108B (zh) 2023-10-20
CN114168235B (zh) 2024-06-11
EP4195707A4 (en) 2024-06-26

Similar Documents

Publication Publication Date Title
WO2022037463A1 (zh) 一种功能切换入口的确定方法与电子设备
JP7326476B2 (ja) スクリーンショット方法及び電子装置
WO2021078284A1 (zh) 一种内容接续方法及电子设备
WO2021213164A1 (zh) 应用界面交互方法、电子设备和计算机可读存储介质
WO2021036770A1 (zh) 一种分屏处理方法及终端设备
JP7268275B2 (ja) 着信があるときに電子デバイス上に映像を提示するための方法、および電子デバイス
CN112527174B (zh) 一种信息处理方法及电子设备
WO2022042769A2 (zh) 多屏交互的***、方法、装置和介质
WO2022017393A1 (zh) 显示交互***、显示方法及设备
CN112383664B (zh) 一种设备控制方法、第一终端设备、第二终端设备及计算机可读存储介质
CN113935898A (zh) 图像处理方法、***、电子设备及计算机可读存储介质
CN112527222A (zh) 一种信息处理方法及电子设备
WO2023030099A1 (zh) 跨设备交互的方法、装置、投屏***及终端
WO2023005900A1 (zh) 一种投屏方法、电子设备及***
WO2022048453A1 (zh) 解锁方法及电子设备
WO2021037034A1 (zh) 一种应用状态切换方法及终端设备
US20230350629A1 (en) Double-Channel Screen Mirroring Method and Electronic Device
WO2023231697A1 (zh) 一种拍摄方法及相关设备
CN114756184A (zh) 协同显示方法、终端设备及计算机可读存储介质
WO2023045597A1 (zh) 大屏业务的跨设备流转操控方法和装置
WO2022152174A9 (zh) 一种投屏的方法和电子设备
WO2022111701A1 (zh) 投屏方法及***
US12019947B2 (en) Projection method and system
WO2023143171A1 (zh) 一种采集音频的方法及电子设备
WO2024060968A1 (zh) 管理服务卡片的方法和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21857558

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021857558

Country of ref document: EP

Effective date: 20230306

NENP Non-entry into the national phase

Ref country code: DE