WO2021052200A1 - 一种设备能力调度方法及电子设备 - Google Patents

一种设备能力调度方法及电子设备 Download PDF

Info

Publication number
WO2021052200A1
WO2021052200A1 PCT/CN2020/113626 CN2020113626W WO2021052200A1 WO 2021052200 A1 WO2021052200 A1 WO 2021052200A1 CN 2020113626 W CN2020113626 W CN 2020113626W WO 2021052200 A1 WO2021052200 A1 WO 2021052200A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
function
sub
application
capability
Prior art date
Application number
PCT/CN2020/113626
Other languages
English (en)
French (fr)
Inventor
毕晟
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to JP2022517803A priority Critical patent/JP7369281B2/ja
Priority to EP20865462.4A priority patent/EP4024837A4/en
Priority to US17/761,867 priority patent/US20220368792A1/en
Publication of WO2021052200A1 publication Critical patent/WO2021052200A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2838Distribution of signals within a home automation network, e.g. involving splitting/multiplexing signals to/from different paths
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43079Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on multiple devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • H04N21/4518Management of client data or end-user data involving characteristics of one or more peripherals, e.g. peripheral type, software version, amount of memory available or display capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N2007/145Handheld terminals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working

Definitions

  • This application relates to the field of electronic equipment, and in particular to a device capability scheduling method and electronic equipment.
  • various electronic devices such as tablet computers, personal computers (PC), smart TVs, on-board computers, speakers, wireless headsets, smart watches, and virtual reality (VR) devices.
  • PCs are good at computing
  • smart TVs are good at playing videos
  • speakers are good at playing sounds.
  • the mobile phone can establish a wireless connection with different electronic devices and use the capabilities of the corresponding device to realize the corresponding function through the device and bring a good user experience to the user. In other words, the mobile phone can hand over the functions currently needed to be implemented to other devices.
  • users may use the capabilities of different electronic devices. For example, when the user is driving, the mobile phone can establish a wireless connection with the car speakers. In this way, the user can use the audio playback capability of the car speakers to play music on the mobile phone or answer the phone while driving the car. That is, the mobile phone can hand over the functions of playing music or answering calls to the car speakers to realize.
  • the mobile phone can establish a wireless connection with the TV. In this way, the mobile phone can use the video playback capability of the TV to play the video in the mobile phone. That is, the mobile phone can delegate the task of playing video on the mobile phone to the TV.
  • the mobile phone can only select one device for a playback task, that is, it can only implement the functions currently required to be implemented, such as playing video, to a device connected to the mobile phone.
  • the embodiment of the present application provides a device capability scheduling method and electronic device. It solves the problem that the mobile phone can only deliver the functions currently required to be implemented, such as playing video, to a device connected to the mobile phone for implementation.
  • this application provides a device capability scheduling method, including: a first electronic device displays an interface of a first function, the first function includes a first sub-function and a second sub-function, the first sub-function and the second sub-function Different; the first electronic device detects the user's first operation, and in response to the first operation, the first electronic device displays a first interface.
  • the first interface includes: the name of the first sub-function, and the second electronic device corresponding to the first sub-function.
  • the first function may not be running when the first electronic device displays the interface of the first function.
  • the first function is a video call function
  • the interface of the first function is a video call reminder interface, and a video call has not been made.
  • the first function is already running when the first electronic device displays the interface of the first function.
  • the first function is a video playback function
  • the interface of the first function is a video playback interface, and the video is being played at this time.
  • the first electronic device can implement a sub-function of the currently implemented function by scheduling other electronic devices, and then multiple electronic devices can cooperate to implement the function.
  • the first electronic device can schedule multiple electronic devices, so that each electronic device can perform different sub-functions, so that multiple different electronic devices can cooperate to realize one function together. It solves the problem that the electronic device can only deliver the functions that currently need to be implemented, such as playing video, to a device connected to the device to implement it, so that multiple electronic devices can perform different sub-functions, bringing better users Experience.
  • the first interface may further include: the device identifier of the first electronic device corresponding to the second sub-function; after the first electronic device displays the first interface, the above method may further include: The device detects the third operation of the user on the device identification of the first electronic device, and in response to the third operation, the first electronic device executes the second sub-function. In other words, the first electronic device may also schedule itself to implement a sub-function in the first function.
  • the first interface may further include an identification of the first application and an identification of the second application corresponding to the device identification of the second electronic device, where the first application and the second application are installed in In the second electronic device; the second operation in the above method may specifically be a second operation on the identification of the first application; in response to the second operation, the first electronic device sends the identification of the first application to the second electronic device Device, so that the second electronic device uses the first application to perform the first sub-function.
  • the second operation may be the user's application to the application.
  • the identified second operation enables the first electronic device to determine the application on the second electronic device that performs the first sub-function according to the second operation, and the first electronic device can schedule the application on the second electronic device to execute the first sub-function.
  • the second operation in the foregoing method may specifically be: a selection operation on the device identifier of the second electronic device.
  • the first electronic device stores the capability information of the first electronic device; before the first electronic device displays the first interface, the above method further includes: the first electronic device establishes with the second electronic device In a wireless fidelity (Wi-Fi) connection, the first electronic device establishes a Wi-Fi connection with the third electronic device.
  • the first electronic device obtains the capability information and device identification of the second electronic device, and obtains the capability information and device identification of the third electronic device; the first electronic device determines the first sub-function according to the capability information and the first sub-function of the second electronic device The function corresponds to the second electronic device, and it is determined that the second sub-function corresponds to the third electronic device according to the capability information of the third electronic device and the second sub-function.
  • Wi-Fi wireless fidelity
  • the above method may further include: the first electronic device The capability information of the second electronic device is associated and stored with the device identification of the second electronic device, and the capability information of the third electronic device is associated and stored with the device identification of the third electronic device; wherein the capability information includes the capability description of the capability, and the capability description Used to describe the capabilities of the device; the first electronic device determines the capabilities needed to realize the first sub-function and the capabilities needed to realize the second sub-function; the first electronic device describes the capabilities of each device according to the stored capabilities And the capabilities required to realize the first sub-function and the second sub-function, determine the device that can realize the first sub-function and the device that realizes the second sub-function; the first electronic device displays the first interface, including: the first electronic device According to the device capable of realizing the first sub-function and the device realizing the second sub-function, the first interface is displayed.
  • the first electronic device before the first electronic device displays the first interface, the first electronic device already stores the capability information and device identifiers of each electronic device in the same local area network as the first electronic device. In this way, the first electronic device can The devices that can perform each sub-function in the local area network are determined, and the first interface is displayed, so that the user can perform corresponding operations on the first interface as needed, and improve user experience.
  • the first function is a video playback function, and the first sub-function and the second sub-function are respectively one of image playback, audio playback or decoding; or, the first function is a video call function, The first sub-function and the second sub-function are respectively one of displaying images, playing audio, recording or capturing images.
  • the first operation is the user's click operation on the first button that starts the first function on the interface of the first function; or, the first operation is the user's click on the second button in the notification menu bar. Click to operate, where the notification menu bar is displayed superimposed on the interface of the first function.
  • the capability information also includes capability services, different sub-functions call different capability services to achieve; the first electronic device sends the data corresponding to the first sub-function to the second electronic device, so that the first electronic device
  • the second electronic device performs the first sub-function, including: the first electronic device schedules the capability service of the second electronic device, and sends data corresponding to the first sub-function to the second electronic device, so that the second electronic device corresponds to the first sub-function
  • the data operation capability service of executes the first sub-function, wherein the capability information of the first electronic device is pre-configured in the first electronic device; or, it is generated and stored according to the hardware of the first electronic device.
  • the capability information also includes the identification of the application capable of scheduling the capability described in the capability description, and different sub-functions call different applications to implement; the first electronic device sends the data corresponding to the first sub-function To the second electronic device to enable the second electronic device to perform the first sub-function, including: the first electronic device schedules the application of the second electronic device, and sends the data corresponding to the first sub-function to the second electronic device, so that the second electronic device The electronic device uses the application to execute the first sub-function according to the data corresponding to the first sub-function.
  • the first electronic device stores installation instructions of the applications included in the first electronic device, and the installation instructions include the handle of the application and the ability of the application to schedule the first electronic device; the above method further includes: The first electronic device generates and stores the capability information of the first electronic device according to the installation instructions, and the identifier of the application in the capability information is the handle.
  • the present application also provides a device capability scheduling method, including: a second electronic device receives a message sent by the first electronic device requesting execution of the first sub-function; the second electronic device displays a second interface, and the second interface includes : The identification of the first application and the identification of the second application corresponding to the first sub-function; the second electronic device receives the user's third operation of the identification of the first application; in response to the third operation, the second electronic device schedules the first The application performs the first sub-function.
  • the first sub-function is a part of the first function; the first function is a video playback function, and the first sub-function is one of image playback, audio playback or decoding; or, the first function is a video call function, and the first sub-function is The function is: one of displaying images, playing audio, recording or capturing images.
  • the first function is a video playback function
  • the first function includes sub-functions: playing audio, playing images, and decoding. Take, for example, that the first sub-function is to play images.
  • the second electronic device is a TV
  • the TV includes a first video application and a second video application.
  • the first electronic device sends a request message for realizing the sub-function of playing images to the television, and a second interface is displayed on the television.
  • the second interface includes the identification of the first video application and the identification of the second video application .
  • the user wants to select the first video application to play the image, he can perform a third operation on the identification of the first video application in the second interface.
  • the television may receive a third operation of the user on the identification of the first video application, and in response to the third operation, the television dispatches the first video application and runs the first video application to perform the sub-function of playing images.
  • the second interface may also be displayed on the first electronic device, and the first electronic device may receive the user's selection operation of the identification of the application included on the second interface, so that the first electronic device may determine that the user wants to schedule The application on the second electronic device improves the user experience.
  • the present application provides an electronic device.
  • the electronic device includes a memory and one or more processors; the memory is coupled with one or more processors; the memory is used to store program code, and when one or more processors execute the program When the code is used, the electronic device is caused to execute the method of any possible implementation manner in the first aspect described above.
  • this application also provides an electronic device.
  • the electronic device includes a memory and one or more processors; the memory is coupled to the one or more processors; the memory is used to store program codes, and when the one or more processors execute When the program code is used, the electronic device executes the method of the implementation manner of the second aspect.
  • an embodiment of the present application provides a computer storage medium, including program code, which when the program code runs on an electronic device, causes the electronic device to execute the method as in the first aspect and any one of its possible implementation manners.
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the method as in the first aspect and any one of its possible implementation manners.
  • an embodiment of the present application provides a computer storage medium, including program code, which when the program code runs on an electronic device, causes the electronic device to execute the method in the implementation manner of the second aspect.
  • the embodiments of the present application provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute the method in the implementation manner of the second aspect.
  • the electronic device of the third aspect, the fourth aspect and any one of the possible implementation manners thereof, the computer storage medium of the fifth aspect and the seventh aspect, and the computer program product of the sixth aspect and the eighth aspect are provided above
  • the beneficial effects that can be achieved reference may be made to the beneficial effects in the first aspect and any of its possible implementations, which will not be repeated here.
  • FIG. 1 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the application.
  • FIG. 2 is a software framework structure diagram of an electronic device provided by an embodiment of the application.
  • FIG. 3A is a flowchart of a device capability scheduling method provided by an embodiment of the present application.
  • FIG. 3B is a schematic diagram of the architecture of a device provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of a display interface provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of another display interface provided by an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a display of a first interface provided by an embodiment of the present application.
  • FIG. 7A is a schematic diagram of another first interface display provided by an embodiment of the present application.
  • FIG. 7B is a schematic diagram of another first interface display provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of another first interface display provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram of another display interface provided by an embodiment of the present application.
  • FIG. 10 is a schematic diagram of a device capability scheduling process provided by an embodiment of the present application.
  • FIG. 11 is a schematic diagram of another device capability scheduling process provided by an embodiment of the present application.
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the present embodiment, unless otherwise specified, "plurality" means two or more.
  • the electronic device can implement multiple functions, and the function refers to the purpose that the electronic device can provide, which can be implemented by the electronic device by calling the corresponding capabilities.
  • the functions of the electronic device can be implemented by the electronic device by calling software modules and hardware modules with corresponding capabilities.
  • the electronic device can call the software module of the corresponding capability (for example, capability service) and the hardware module of the capability according to the function required by the application to realize the function.
  • the application as a video application as an example.
  • the function of playing video in the video application of the electronic device can be realized by calling the capability service and hardware module of the corresponding capability of the device.
  • a function that the application needs to implement may need to call multiple capabilities of the device's capability services and hardware modules to implement it.
  • the function of playing video in a video application can be divided into multiple sub-functions including: decoding, playing sound and playing images. Different sub-functions can be implemented by calling the capability services and hardware modules of different capabilities of the device.
  • the electronic device can call the capability service of the decoding capability of the electronic device and the hardware module used to realize the decoding to realize the decoding function, call the capability service of the audio playback capability of the electronic device and the speaker, to play the sound, and call the electronic device's capability service.
  • the ability service and display screen of the ability to play images can realize image playback, thereby realizing video playback.
  • the electronic device may have at least one capability, and the electronic device may call capability services of different capabilities and its hardware modules to implement different functions.
  • Different electronic devices have different capabilities.
  • the capabilities of mobile phones include: playing audio, playing images, displaying pictures, ranging, recording, taking images, and taking photos.
  • the capabilities of a TV set include: playing audio, playing images, and so on.
  • the speaker has the ability to play audio.
  • an embodiment of the present application provides a device capability scheduling method, which is applied to a device group, and the electronic devices in the device group are all in the same local area network.
  • the capabilities of each device in the device group may be different, and any device in a device group can schedule capability services and hardware modules corresponding to the capabilities of other devices in the device group to implement corresponding functions.
  • the first electronic device in the device group runs the first application
  • the first application of the first electronic device needs to implement a function (or task).
  • This function can be broken down into multiple sub-functions (or sub-tasks).
  • the first electronic device may schedule different electronic devices in the device group to implement different sub-functions of the function, so as to cooperate to implement the function.
  • the mobile phone, TV and speakers are in the same local area network.
  • the mobile phone can call the decoding capability service of the mobile phone and the hardware module used to realize the decoding to realize the decoding.
  • the first electronic device can schedule multiple different electronic devices in the device group to cooperate and jointly implement the function of the first electronic device.
  • the electronic devices in the device group can play their own “specialties” and bring a better experience to users.
  • the various electronic devices in the device group can be interconnected by means of wireless broadband (Wi-Fi Alliance, WiFi), Bluetooth, or ZigBee network to form a local area network.
  • the electronic devices included in the device group are: mobile phones, TVs, speakers, and tablets. Users can connect mobile phones, TVs, speakers, and tablets to the same WiFi access point. All devices connected to the same WiFi access point form a device group.
  • the mobile phone can be used as a WiFi access point, and tablets, speakers, and TV sets can all be connected to the WiFi access point, and the devices connected to the WiFi access point and the mobile phone form a device group.
  • the electronic devices in the device group in the embodiments of the present application may be mobile phones, tablet computers, desktops, laptops, handheld computers, notebook computers, ultra-mobile personal computers (UMPC), Netbooks, as well as devices such as cellular phones, personal digital assistants (PDAs), augmented reality (AR) ⁇ virtual reality (VR) devices, etc.
  • PDAs personal digital assistants
  • AR augmented reality
  • VR virtual reality
  • FIG. 1 is a schematic structural diagram of an electronic device 100 provided by an embodiment of this application.
  • the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the aforementioned sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, and a touch sensor 180K, Ambient light sensor 180L and bone conduction sensor 180M and other sensors.
  • the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait.
  • AP application processor
  • modem processor modem processor
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100.
  • the controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory can store instructions or data that the processor 110 has just used or used cyclically. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.
  • the processor 110 may include one or more interfaces.
  • the interface can include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter (universal asynchronous) interface.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the interface connection relationship between the modules illustrated in this embodiment is merely a schematic description, and does not constitute a structural limitation of the electronic device 100.
  • the electronic device 100 may also adopt different interface connection modes in the above-mentioned embodiments, or a combination of multiple interface connection modes.
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 140 may receive the charging input of the wired charger through the USB interface 130.
  • the charging management module 140 may receive the wireless charging input through the wireless charging coil of the electronic device 100. While the charging management module 140 charges the battery 142, it can also supply power to the electronic device through the power management module 141.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
  • the wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor.
  • the application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194.
  • the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • BT wireless fidelity
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 may also receive the signal to be sent from the processor 110, perform frequency modulation, amplify it, and convert it into electromagnetic waves to radiate through the antenna 2.
  • the electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, connected to the display 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, and the like.
  • the display screen 194 includes a display panel.
  • the display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active matrix organic light-emitting diode active-matrix organic light-emitting diode
  • active-matrix organic light-emitting diode active-matrix organic light-emitting diode
  • emitting diode AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
  • the electronic device 100 can realize a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the ISP is used to process the data fed back by the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing and is converted into an image visible to the naked eye.
  • ISP can also optimize the image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193.
  • the camera 193 is used to capture still images or videos.
  • the object generates an optical image through the lens and is projected to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal.
  • ISP outputs digital image signals to DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 100 may include one or N cameras 193, and N is a positive integer greater than one.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.
  • MPEG moving picture experts group
  • MPEG2 MPEG2, MPEG3, MPEG4, and so on.
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121.
  • the processor 110 may execute instructions stored in the internal memory 121, and the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function.
  • the data storage area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 100.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
  • the electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal.
  • the audio module 170 can also be used to encode and decode audio signals.
  • the speaker 170A also called “speaker” is used to convert audio electrical signals into sound signals.
  • the receiver 170B also called “earpiece”, is used to convert audio electrical signals into sound signals.
  • the microphone 170C also called “microphone”, “microphone”, is used to convert sound signals into electrical signals.
  • the earphone interface 170D is used to connect wired earphones.
  • the earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal.
  • the pressure sensor 180A may be provided on the display screen 194.
  • the gyro sensor 180B may be used to determine the movement posture of the electronic device 100.
  • the air pressure sensor 180C is used to measure air pressure.
  • the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
  • the magnetic sensor 180D includes a Hall sensor.
  • the electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip holster.
  • the acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and apply to applications such as horizontal and vertical screen switching, pedometers and so on.
  • the electronic device 100 can measure the distance by infrared or laser.
  • the proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector.
  • the ambient light sensor 180L is used to sense the brightness of the ambient light.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the temperature sensor 180J is used to detect temperature.
  • the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute the temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”.
  • the touch sensor 180K is used to detect touch operations acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.
  • the electronic device 100 can detect the touch operation input by the user on the touch screen through the touch sensor 180K, and collect the touch position, touch area, touch direction, and touch time of the touch operation on the touch screen. One or more of. In some embodiments, the electronic device 100 may combine the touch sensor 180K and the pressure sensor 180A to determine the touch position of the touch operation on the touch screen.
  • the button 190 includes a power-on button, a volume button, and so on.
  • the button 190 may be a mechanical button. It can also be a touch button.
  • the electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the electronic device 100.
  • the motor 191 can generate vibration prompts.
  • the motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback.
  • the indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.
  • the SIM card interface 195 is used to connect to the SIM card.
  • the SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
  • the electronic device 100 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1.
  • the SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiment of the present application takes an Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 by way of example.
  • FIG. 2 is a block diagram of the software structure of the electronic device 100 provided by an embodiment of the present application.
  • the layered architecture can divide the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface.
  • the Android system is divided into three layers, from top to bottom as the application layer (referred to as the application layer), the application framework layer (referred to as the framework layer), and the kernel layer (also referred to as the driver layer).
  • the application layer can include a series of application packages.
  • the application package may be applications such as camera, short message, music, phone, video call, first video application, second video application, and service scheduling.
  • the framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the framework layer includes a window manager (WMS) and a bus scheduler.
  • WMS window manager
  • the framework layer may also include a content manager, a phone manager, a resource manager, a notification manager, etc. (not shown in the drawings).
  • the window manager is used to manage window programs.
  • the window manager can obtain the size of the display, determine whether there is a status bar, lock the screen, take a screenshot, etc.
  • the bus scheduler is used to store the capability information of the capabilities of the electronic device.
  • the capability information includes capability description (Action) and capability service (Service), and one capability description corresponds to one capability service. Different capability information corresponds to different capabilities of electronic devices.
  • the capability information includes a capability description (Action) and an identification of an application that can invoke the capability in the electronic device. One capability description may correspond to the identification of one or more applications.
  • the bus scheduler also stores the device identification of the electronic device, which is used to mark the electronic device.
  • the capability information stored on the bus scheduler may include: capability information of the ability to play images, capability information of the ability to display photos, capability information of the capability of playing audio, capability information of the capability of shooting images, capability information of the capability of playing audio, and Ability information of recording capability, etc.
  • the service scheduling when the service scheduling in the application layer is running, the service scheduling can access the capability information stored on the bus scheduler and the device identification of the electronic device.
  • the framework layer may also include installation services.
  • the installation service is used to store and obtain data, and make these data accessible.
  • the data includes the installation instructions of each application, and each application installed on the electronic device needs to write the installation instructions in the installation service.
  • the installation instructions refer to the handle of this application and the capabilities of the electronic device that this application will dispatch.
  • the handle is a special type of smart pointer. When the electronic device schedules other electronic devices to implement corresponding functions, the handle can be used to schedule memory blocks or objects managed by other electronic devices, so that other electronic devices can achieve this function. .
  • the capability information includes the capability description (Action) and the identification of the application capable of invoking the capability in the electronic device.
  • the identification of the application capable of using different capabilities included in the capability information may be determined by Obtained by the bus scheduler.
  • the bus scheduler may obtain the installation instructions of each application in the installation service, and determine the capabilities that each application can call according to the installation instructions of each application, so as to obtain the capabilities of the electronic device.
  • the capability description (Action) of each capability possessed by the electronic device and the identification of the application that can invoke the capability.
  • one capability corresponds to one capability description (Action)
  • one capability may correspond to at least one identifier
  • the identifier may be an application handle.
  • the bus scheduler on the electronic device can be the same as the bus scheduler on other electronic devices in the same local area network.
  • the scheduler performs information sharing.
  • the bus scheduler of each electronic device in the same local area network can obtain and store the capability information of each electronic device in the local area network. For example, the device identities of different electronic devices can be stored in association with their capability information.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display driver, camera driver, audio driver, sensor driver, etc.
  • FIG. 3A is a schematic flowchart of a device capability scheduling method provided by an embodiment of the application.
  • the device group includes the first electronic device, the second electronic device, and the third electronic device as an example.
  • the first electronic device, the second electronic device, and the third electronic device can access the same WiFi.
  • the device group includes a first electronic device, a second electronic device, and a third electronic device, and the first electronic device is a mobile phone, the second electronic device is a TV, and the third electronic device is an audio device as an example.
  • each electronic device in a device group in the same local area network can dispatch capabilities to each other to cooperate to complete corresponding functions.
  • the mobile phone can schedule the corresponding capability of the TV to realize the function of playing images, and the mobile phone can also schedule the corresponding capability of the speaker to realize the function of playing audio.
  • Step 301 Each electronic device in the device group performs data interaction through the bus scheduler, and updates the data in the bus scheduler on each electronic device.
  • all electronic devices in the device group of the same local area network can share data based on the connection with other electronic devices through their respective bus schedulers, so that each electronic device in the device group can obtain the capabilities of other electronic devices information.
  • the bus scheduler of the electronic device stores the capability information that the electronic device has capabilities.
  • the electronic device taking the electronic device as the first electronic device in the above device group, that is, a mobile phone, the mobile phone has the following capabilities: display pictures, play audio, play images, take photos, take images, record sound, and measure distances.
  • the bus scheduler stores the capability information corresponding to the above-mentioned capabilities.
  • the capability information of the capabilities of the first electronic device may be pre-configured in the first electronic device.
  • the capability information of the capabilities of the mobile phone can be pre-configured in the memory of the mobile phone.
  • the bus scheduler of the mobile phone interacts with the memory of the mobile phone to exchange the capabilities The information is registered in the bus scheduler.
  • the capability information of the capabilities of the mobile phone may also be pre-configured in the bus scheduler of the mobile phone when it leaves the factory. As the software in the mobile phone is updated (for example, downloading or deleting applications, updating the operating system, etc.), the capability information can also be updated.
  • the capability information may include capability description (Action) and capability service (Service), and one capability description corresponds to one capability service.
  • the capability description is configured in the mobile phone according to the hardware configuration of the mobile phone, and is used to indicate (or describe) the capabilities of the mobile phone.
  • the capability service is a software module called when the electronic device realizes the corresponding function of the capability.
  • the hardware of a mobile phone may include a display, a speaker, a microphone, a camera, a distance sensor, and so on.
  • the capability description in the capability information of the mobile phone may indicate that the mobile phone has the following capabilities: image display capability, image playback capability, audio playback capability, recording capability, photo shooting capability, image capturing capability, and ranging capability, etc.
  • Each capability indicated by the capability description can correspond to a capability service.
  • the capability information stored on the bus scheduler of the mobile phone includes capability information of the ability to display pictures.
  • the capability description (Action) in the capability information of the capability can be defined as: DEVICE_DISPLAY_PHOTO, and the capability service (Service) can be defined as: display Photo Service.
  • the display Photo Service is a software module used to realize the picture display function.
  • the capability information also includes capability information of the ability to play images.
  • the capability description of the capability can be defined as DEVICE_DISPLAY_IMAGE, and the capability service can be defined as display image Service.
  • the display image Service is a software module used to realize the image playback function.
  • the capability information also includes capability information of the ability to play audio.
  • the capability description of the capability can be defined as DEVICE_PLAY_AUDIO, and the capability service can be defined as play audio Service.
  • the play audio Service is a software module used to implement audio playback functions.
  • the capability information also includes capability information of the ranging capability.
  • the capability description of the capability can be defined as DEVICE_DISTANCE_SENSOR, and the capability service can be defined as distance sensor Service.
  • the distance sensor Service is a software module used to realize the distance measurement function.
  • the capability information also includes capability information of the decoding capability.
  • the capability description of the capability can be defined as DEVICE_DECODE, and the capability service can be defined as decode Service.
  • the decode Service is a software module used to realize the decoding function.
  • the first electronic device may determine the capability information possessed by the first electronic device according to the applications installed in the first electronic device and store it in the bus scheduler of the electronic device.
  • the mobile phone can determine the capabilities that each application can call according to the installation instructions of each application to obtain the capabilities of the mobile phone, and generate a description of each capability of the mobile phone, and the identification of the application that can call the capability .
  • the identifier of the application can be a handle.
  • each application installed on the mobile phone needs to write installation instructions in the installation service.
  • the installation instructions are instructions for the installed applications.
  • the installation instructions include the type of the application, the handle of the application, and the capabilities of the mobile phone that the application will call during the running process.
  • the following applications are installed in the electronic device: a video phone, a first video application, and a second video application.
  • the installation instructions for a video phone are video communication applications, the handle of the video phone, and the capabilities of the mobile phone that the application will call during the running process include the ability to play images, play audio, record, and capture images.
  • the installation instructions of the first video application are video applications, the handle of the first video application, and the capabilities of the mobile phone that the first video application will call during the running process include the ability to play images, the ability to decode video files, and the ability to play audio.
  • the installation instructions of the second video application are video applications, the handle of the second video application, and the capabilities of the mobile phone that the second video application will call during the running process include the ability to play images, the ability to decode video files, and the ability to play audio.
  • the capabilities of the mobile phone include: the ability to play images, the ability to decode video files, the ability to play audio, the ability to record sound, and the ability to capture images.
  • a description of the capabilities of each capability can be generated, such as: playing images, decoding video files, playing audio, recording, and shooting images.
  • the identifier of the application corresponding to each capability description is: the identifier corresponding to the playback image is the handle of the first video application, the handle of the second video application, and the handle of the video phone; decode video The identification corresponding to the file is the handle of the first video application and the handle of the second video application; the identification corresponding to the playback audio is the handle of the first video application, the handle of the second video application, and the handle of the video phone; the identification corresponding to the recording Yes, the handle of the video phone; the identifier corresponding to the captured image is the handle of the video phone.
  • the first electronic device may be scheduled by the second electronic device or the third electronic device to use one of the capabilities of the first electronic device. Therefore, when the second electronic device or the third electronic device schedules the capability in the first electronic device, the application corresponding to any one of the application identifiers of the application corresponding to the capability can be scheduled, so that the first electronic device and the application
  • the application corresponding to the logo is run to achieve the corresponding function. For example, when the application is running, the software module (such as the capability service) and the hardware module of the corresponding capability can be invoked to realize the corresponding function.
  • the second electronic device implements the function of playing a video, and the function of playing the video includes a sub-function of playing an image.
  • the second electronic device may schedule the corresponding application of the first electronic device to implement the sub-function of playing the image.
  • the first video application in the first electronic device can be selected to be scheduled so that the first video application runs.
  • the software module of the first electronic device's ability to play video and its hardware module (such as a display) can be called to realize the sub-function of playing images
  • the second video application in the first electronic device can also be selected to be scheduled. Make the second video application run.
  • the software module of the first electronic device's ability to play video and its hardware module (such as a display) can be called to realize the sub-function of playing images.
  • the first electronic device determines the identity of the application corresponding to the ability according to the ability that the application can call, it needs to determine whether the handle of the application can be dispatched by other devices (such as the second electronic device or the third electronic device) . If the handle of the application can be scheduled by other devices, the first electronic device can add the handle of the application to the identification of the application corresponding to the capability; if the handle of the application refuses to be scheduled by other devices, the application corresponding to the capability Do not increase the handle of the application in the logo. Exemplarily, take the application as "China Merchants Bank" as an example.
  • the installation instructions of the application are: online payment platform, the handle of the application and the capabilities of the application include online payment. And the handle of the application refuses to be called by other devices, the identifier of the application corresponding to the online payment capability in the capability information does not include the handle of "China Merchants Bank".
  • the device identifier of the electronic device is also stored on the bus scheduler, and each electronic device in the device group performs data interaction through the bus scheduler, and further includes: the first electronic device sends the second electronic device in the device group to the second electronic device.
  • the device and the third electronic device send the device identification, and the first electronic device obtains the device identification of the second electronic device and the device identification of the third electronic device.
  • the device identification can be stored in association with the capability information of the electronic device corresponding to the device identification.
  • the device identification can be displayed, so that the user can determine the electronic device to be scheduled according to the device identification.
  • the capability information of the first electronic device includes capability description and capability service. It is assumed that the first electronic device has the following capabilities: ability to display pictures, ability to play audio, ability to play images, ability to take photos, ability to take images, ability to record sound, and ability to measure distances.
  • the bus scheduler of the first electronic device can save the capability information shown in Table 1.
  • the second electronic device may also generate its own capability information according to the above description and store it in the bus scheduler of the second electronic device. It is assumed that the second electronic device has the following capabilities: ability to display pictures, ability to play images, and ability to play audio.
  • the capability information stored on the bus scheduler of the second electronic device includes: capability information for displaying pictures, capability information for playing images, and capability information for playing audio.
  • the third electronic device has the following capabilities: the ability to play audio.
  • the capability information stored on the bus scheduler of the third electronic device includes: capability information for playing audio.
  • each electronic device in the device group exchanges data through the bus scheduler.
  • the capability information stored on the bus scheduler of the first electronic device is It can include not only the capability information of the capabilities of the first electronic device, but also the capability information of the capabilities of the second electronic device and the third electronic device.
  • the first electronic device can associate and store the capability information of its own capabilities with the device identification of the first electronic device, associate the capability information of the second electronic device with the device identification of the second electronic device, and store the third electronic device's capability information in association with the device identification of the second electronic device.
  • the capability information of the capabilities of the device is stored in association with the device identification of the third electronic device.
  • the bus scheduler of the first electronic device may store the capability information shown in Table 2.
  • the second electronic device can also obtain the capability information of the first electronic device and the third electronic device through the data sharing on the bus scheduler
  • the third electronic device can also obtain the first electronic device and the third electronic device through the data sharing of the bus scheduler. Capability information of the second electronic device. It is worth mentioning that if the third electronic device is a speaker, the speaker only has the ability to play audio, and the speaker itself does not need the ability to schedule other devices. When sharing data on the bus scheduler with electronic devices in the same local area network, the speaker It is not necessary to obtain the data of the bus scheduler on other electronic devices.
  • Step 302 The first electronic device displays the interface of the first function, and receives the first operation of the user.
  • the first operation is used to trigger the mobile phone to perform service scheduling.
  • the first function may include multiple sub-functions, such as including a first sub-function, a second sub-function, and so on.
  • the first function is a video call function
  • the video call function may include sub-functions: displaying images, playing audio, recording, and capturing images.
  • the first function is a video playback function
  • the video playback function may include sub-functions: playing images, playing audio, and decoding.
  • the first operation may be a user's click operation on the first button for starting the first function on the interface of the first function described above.
  • the function implemented by the mobile phone is to play video.
  • the mobile phone is running a video application and displays the interface of the video application (the interface of the video application may be the interface of the above-mentioned first function).
  • the first operation may be the user's click operation on the "play" button in the video interface.
  • the above-mentioned first operation may be a user's clicking operation on the "answer" button in the incoming call reminder interface of the video phone (the incoming call reminder interface may be the interface of the aforementioned first function).
  • the first operation may be the user's clicking operation on the "answer” button 402 in the incoming call reminder interface 401 of the video phone shown in FIG. 4.
  • the first operation may also be a user's click operation on the "video call” button used to initiate a video call in the video phone (not shown in the drawings).
  • the first operation may also be a user's click operation on the second button in the notification menu bar, where the notification menu bar is displayed superimposed on the interface of the first function.
  • a button or switch of "service scheduling” can be preset in the mobile phone, and the button or switch of "service scheduling” is the second button.
  • the notification menu bar of the mobile phone may include the button or switch of the "service scheduling”.
  • the first operation may be a click operation of the button or switch of the "service scheduling" by the user.
  • the mobile phone displays the interface of any application, the mobile phone can display the notification menu bar in response to the user's scheduling operation to call up the notification menu bar; the mobile phone can receive the user's click operation on the "service scheduling" in the notification menu bar.
  • the mobile phone when the mobile phone implements the video call function, the mobile phone displays the interface of the video call function, such as the connection interface of the video call.
  • the mobile phone receives the operation to call up the notification menu bar and displays the notification menu bar.
  • the first operation can be a user's click operation on the "service scheduling" button in the notification menu bar, as shown in Figure 5.
  • the function implemented by the mobile phone is to play music.
  • the phone is running a music application, playing music.
  • the user wants to schedule other electronic devices in the device group to play music.
  • the mobile phone receives the operation to call up the notification menu bar and displays the notification menu bar.
  • the first operation can be the user's operation of the "service scheduling" button in the notification menu bar. Click Action.
  • the mobile phone needs to schedule other electronic devices in the device group to implement the current functions of the mobile phone. For example, the mobile phone is running a video application, but is not playing video. The mobile phone displays an interface for browsing video files. If the mobile phone receives the user's first operation, the mobile phone's scheduling capability is the display capability. If the mobile phone receives the user's first operation when playing a video, the mobile phone scheduling capabilities may include: the ability to play images, the ability to play audio, and the ability to decode video files.
  • Step 303 In response to the first operation, the first electronic device displays a first interface.
  • the above-mentioned first function can be decomposed into multiple sub-functions. Different sub-functions can be realized by calling different capability services and hardware modules.
  • the first electronic device may determine the capabilities required to implement each of the multiple sub-functions, according to the capability descriptions of the capabilities of each device stored on the bus scheduler, and the capabilities required to implement each sub-function, Determine the device identification of the device that can implement each sub-function. According to the determined device identification of the device capable of implementing each sub-function, the first electronic device may display a first interface, which may include the name of the sub-function to be implemented and the device identification corresponding to the name of each sub-function .
  • the first function includes a first sub-function and a second sub-function.
  • the first electronic device can determine that the first sub-function corresponds to the second electronic device based on the capability information of the second electronic device and the first sub-function, and can determine that the second sub-function corresponds to the second sub-function based on the capability information of the third electronic device and the second sub-function
  • the third electronic device, so the first interface displayed by the first electronic device may include the device identifier of the second electronic device corresponding to the first sub-function, the name of the second sub-function, and the third electronic device corresponding to the second sub-function Device identification, etc.
  • the second electronic device is a television and the third electronic device is a speaker.
  • the first function currently implemented by the mobile phone is the video call function of the video phone.
  • the first interface displayed by the mobile phone can be as shown in Figure 6, including the names of the sub-functions decomposed by the video call function: display image, play Audio, recording, and shooting images.
  • the device identification corresponding to the name of each sub-function is the display image
  • the device identification corresponding to the sub-function name is the identification of the TV
  • the sub-function name is playing audio
  • the sub-function name corresponds to
  • the device logo is the logo of the TV and the speaker of the speaker, etc.
  • the device identifier corresponding to the name of the sub-function in the first interface may also include the device identifier of the device itself. As shown in FIG. 7A, the device identifier corresponding to the name of the sub-function in the first interface is not only It includes the device identification shown in FIG. 6 above, and may also include the identification of a mobile phone.
  • the first interface includes the name of the sub-function and the device identifier corresponding to the name of the sub-function as an example for description.
  • the content included in the first interface may also be displayed in a corresponding form of each device identifier and the name of the sub-function that can be implemented by the device corresponding to the device identifier.
  • the device identifier is a television
  • the names of the sub-functions corresponding to the device identifier include: image capture, audio playback, image playback, and recording
  • the device identifier is a mobile phone
  • the name of includes, shooting images, playing audio, playing images, and recording
  • the device identifier is a speaker
  • the name of the sub-function corresponding to the device identifier includes, playing audio.
  • the functions being performed by the mobile phone are decomposed into sub-functions, and the name of each sub-function corresponding to the device identification of the device is displayed on the first interface.
  • the user can choose to schedule one or more devices to implement different sub-functions of the function. In this way, the mobile phone can schedule devices with capabilities corresponding to sub-functions in the device group to meet user needs.
  • Step 304 The first electronic device receives a second operation of the user on the first interface, and calls the capability service and hardware module of the corresponding device according to the second operation to implement the corresponding sub-function.
  • the second operation may include: a user's selection operation for the device identifier corresponding to the name of one or more sub-functions.
  • the capability information on the bus scheduler in the mobile phone includes capability description and capability service.
  • the first interface displayed by the mobile phone is shown in Figure 6 or Figure 7A, and the second operation is that the user The selection operation of the corresponding device identification on the first interface.
  • the user's operation of the device identification of the first electronic device may also be referred to as the third operation.
  • the capability information on the bus scheduler in the mobile phone includes the capability description of the capability of the mobile phone and the identification of the application corresponding to the capability.
  • the second electronic device is a TV
  • the third electronic device is a speaker
  • the first interface may be the interface as shown in FIG. 8.
  • the second operation may be a user's selection operation on the interface shown in FIG. 8.
  • the information corresponding to each capability includes not only the device identification, but also the identification of the application that can invoke the capability in the device corresponding to the device identification.
  • the second operation is to Selection operation of the logo applied in the interface.
  • the second electronic device is a TV
  • the third electronic device is a speaker
  • the first interface of the mobile phone is the interface shown in Figure 9 (a)
  • the second operation includes the user's interface shown in Figure 9 (a) The selection operation of the device identification on the interface.
  • the mobile phone can also display a second interface, as shown in FIG. 9(b)
  • the second interface includes the identifier of the application that can call the corresponding capability in the device corresponding to the device identifier.
  • the second operation also includes the user's selection operation of the application identifier on the interface shown in FIG. 9(b).
  • the second operation may also include the user's click operation on the OK button on the first interface, such as the “OK” button in FIG. 6.
  • the above description is based on an example in which the user selects the device identifier in the first interface and displays it on the mobile phone on the second interface.
  • the second interface may also be displayed on the device corresponding to the device identifier selected in the first interface.
  • the first interface is the interface shown in Figure 9(a).
  • the second interface It may be displayed on the TV.
  • the second operation may also include a user's selection operation of the logo applied in the second interface displayed on the TV. It should be noted that if the device has a certain capability that corresponds to only one logo, the logo may not be displayed.
  • the speaker has the ability to play audio, and the audio playback capability corresponds to the application There is only one logo for, if the user selects a speaker in the audio playback capability, there is no need to display on the second interface the logo of the application that can call the audio playback capability in the speaker.
  • the electronic device schedules other electronic devices in the device group according to the user's selection.
  • the display of a TV is relatively large, and the user can choose to use the image playback capability of the TV to realize the image playback function in order to obtain a better visual experience.
  • the sound effect of the speaker is good, and the user can use the audio playback capability of the speaker to realize the sound playback function to obtain a better listening experience.
  • the "specialties" of each electronic device can be better utilized and the user experience can be improved.
  • the mobile phone after receiving the second operation, can determine the device identification that performs the sub-function according to the second operation, and call the capability service and the corresponding hardware module in the device corresponding to the device identification to achieve Corresponding sub-functions.
  • the capability information on the bus scheduler includes capability description (Action) and capability service (Service).
  • Action capability description
  • Service capability service
  • the mobile phone can use the corresponding capability
  • the interface calls the capability service of other device capabilities, and when the capability service is called, the corresponding hardware module is called to cooperate to realize the sub-function.
  • the mobile phone can schedule the service of the ability of displaying pictures of the TV through the interface of the ability of displaying pictures of the TV, and call the TV when the ability of displaying pictures is called. Monitor to achieve the function of displaying pictures.
  • the interface corresponding to the capability service of each capability in the electronic device (for example, a service software development kit (Software Development Kit, SDK)) can be pre-configured in the electronic device, and by scheduling the interface, the electronic device Run the corresponding capability service.
  • the electronic device runs the capability service, the corresponding hardware module is called to realize the corresponding function.
  • the mobile phone needs to realize the function of playing video, which can be broken down into three sub-functions: playing image, playing audio, and decoding.
  • playing video which can be broken down into three sub-functions: playing image, playing audio, and decoding.
  • the mobile phone can schedule the decoding capability service of the mobile phone through the decoding SDK of the mobile phone.
  • the decoding capability service is invoked, the hardware module that realizes the decoding capability can be called to realize the decoding function.
  • the image playback SDK of the electronic device dispatches the image playback capability service of the second electronic device.
  • the display of the second electronic device is called to realize the image playback function, which is played by the third electronic device.
  • the audio SDK dispatches the ability service of the third electronic device's ability to play audio.
  • the speaker of the third electronic device is called to realize the audio playback function.
  • the second electronic device is a TV
  • the third electronic device is a speaker
  • the currently running application of the mobile phone is a video application
  • the mobile phone displays a video playback interface, such as the video playback interface of a video application as shown in Figure 11 (a).
  • the mobile phone receives the user's first operation, such as the user's click operation on the "play" button in the video playback interface.
  • the mobile phone displays a first interface, as shown in FIG. 11(b).
  • the first interface includes the ability to play images and sounds, and the device identification corresponding to the ability.
  • the mobile phone obtains the user's second operation on the first interface.
  • the second operation is the user's selection operation of the TV in the device identification corresponding to the image playback capability, and the selection operation of the speaker in the device identification corresponding to the audio playback capability.
  • the mobile phone dispatches the TV’s video playback capability service through the TV’s video playback SDK.
  • the decoding capability service is called, it calls the TV’s display to realize the image playback sub-function; dispatches the speaker playback through the speaker’s playback audio SDK.
  • the capability service of audio capability when the capability service of playing audio is called, the speaker of the speaker is called to realize the sub-function of audio playback.
  • the capability information on the bus scheduler includes the capability description (Action) and the identification of the application corresponding to the capability.
  • the mobile phone can use The identifier corresponding to the capability, that is, the handle of the application, calls the corresponding application of the other device, and when the application runs on the device, it calls the hardware module of the device to implement the corresponding sub-function.
  • the mobile phone can use the handle of the gallery application on the TV stored on the bus scheduler to call the TV gallery application to make the When the gallery application on the TV is running, the ability to display pictures is called when the gallery application is running, and when the ability to display pictures is called, the display of the TV is called to realize the picture display function.
  • the first electronic device may record the device scheduled by the first electronic device when the corresponding function is implemented this time, and the specific capability of using the device.
  • the information recorded by the mobile phone is: dispatching the decoding ability of the mobile phone, dispatching the image playing ability of the TV, and dispatching the audio playing ability of the speaker.
  • the displayed first interface also includes a button
  • the buttons correspond to scenarios, where the scenario indicates the device scheduled by the mobile phone and the specific capabilities of the device used when the function was implemented last time by the mobile phone.
  • this scenario is specifically scheduling the decoding capability of the mobile phone, scheduling the image playback capability of the TV, and scheduling the audio playback capability of the speakers.
  • the mobile phone decodes, dispatches the TV to realize the function of playing images, and dispatches the speaker to realize the function of playing audio.
  • mutual scheduling can be performed, and the first electronic device can schedule different capabilities of other electronic devices in the same local area network, so that multiple device functions cooperate to realize the functions of the first electronic device.
  • the electronic devices in the device group can play their own “specialties” and bring a better experience to users.
  • the electronic device may include a memory and one or more processors.
  • the memory is coupled to one or more processors.
  • the memory is used to store computer program code, and the computer program code includes computer instructions.
  • the electronic device can execute various functions or steps executed by the mobile phone in the foregoing method embodiments.
  • the structure of the electronic device can refer to the structure of the electronic device 100 shown in FIG. 1.
  • a display device which is characterized in that the device can be applied to an electronic device including the above-mentioned touch screen.
  • the device is used to execute various functions or steps performed by the mobile phone in the above method embodiments.
  • the embodiments of the present application also provide a computer storage medium, the computer storage medium includes computer instructions, when the computer instructions run on the above-mentioned electronic device, the electronic device is caused to perform each function or step performed by the mobile phone in the above-mentioned method embodiment .
  • the embodiments of the present application also provide a computer program product, which when the computer program product runs on a computer, causes the computer to execute each function or step performed by the mobile phone in the above method embodiment.
  • the disclosed device and method can be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be divided. It can be combined or integrated into another device, or some features can be omitted or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate parts may or may not be physically separate.
  • the parts displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art, or all or part of the technical solutions can be embodied in the form of a software product, and the software product is stored in a storage medium. It includes several instructions to make a device (may be a single-chip microcomputer, a chip, etc.) or a processor (processor) execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the foregoing storage media include: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Telephone Function (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请提供一种设备能力调度方法及电子设备,涉及电子设备领域。第一电子设备显示第一功能的界面,第一功能包括第一子功能和第二子功能,第一子功能和第二子功能不同;第一电子设备检测到用户的第一操作,响应于第一操作,第一电子设备显示第一界面,第一界面包括:第一子功能的名称,第一子功能对应的第二电子设备的设备标识,第二子功能的名称,第二子功能对应的第三电子设备的设备标识,其中,第一电子设备、第二电子设备和第三电子设备处于同一局域网;第一电子设备检测到用户对第二电子设备的设备标识的第二操作;响应于第二操作,第一电子设备将第一子功能对应的数据发送到第二电子设备,以使第二电子设备执行第一子功能。

Description

一种设备能力调度方法及电子设备
本申请要求于2019年09月19日提交国家知识产权局、申请号为201910887687.8发明名称为“一种设备能力调度方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及电子设备领域,尤其涉及一种设备能力调度方法及电子设备。
背景技术
随着电子技术的发展与普及,除去手机之外,用户还可能同时拥有其他电子设备。比如,平板电脑、个人计算机(personal computer,PC)、智能电视、车载电脑、音箱、无线耳机、智能手表和虚拟现实(virtual reality,VR)设备等各种电子设备。上述电子设备能力各不相同,比如,PC擅长计算,智能电视播放视频效果好,音箱播放声音效果好。
手机可通过与不同的电子设备建立无线连接,使用对应设备的能力,以通过该设备实现对应功能,给用户带来良好的使用体验。也就是说,手机可将当前需要实现的功能交给其他设备来实现。另外,在不同的场景下,用户可能会使用不同电子设备的能力。比如,用户在开车时,可使手机与车载音箱建立无线连接。这样,用户在驾驶汽车的过程中,可以使用车载音箱的播放音频能力,播放手机上的音乐或接听电话。即手机可将手机上播放音乐或接听电话的功能交给车载音箱来实现。又如,用户在家中观看视频时,可使手机与电视机建立无线连接,这样,手机可使用电视机的播放视频能力,播放手机中的视频。即手机可将手机上播放视频的任务交给电视机来实现。
但是,手机仅能为一个播放任务选择一个设备,即只能将当前需要实现的功能,如播放视频等交给与手机连接的一个设备来实现。
发明内容
本申请实施例提供了一种设备能力调度方法及电子设备。解决了手机仅能将当前需要实现的功能,如播放视频等交给与手机连接的一个设备来实现的问题。
为实现上述技术目的,本申请实施例采用如下技术方案:
第一方面,本申请提供一种设备能力调度方法,包括:第一电子设备显示第一功能的界面,第一功能包括第一子功能和第二子功能,第一子功能和第二子功能不同;第一电子设备检测到用户的第一操作,响应于第一操作,第一电子设备显示第一界面,第一界面包括:第一子功能的名称,第一子功能对应的第二电子设备的设备标识,第二子功能的名称,第二子功能对应的第三电子设备的设备标识,其中,第一电子设备、第二电子设备和第三电子设备处于同一局域网;如果第一电子设备检测到用户的第二操作;响应于第二操作,第一电子设备将第一子功能对应的数据发送到第二电子设备,以使第二电子设备执行第一子功能。
其中,第一电子设备显示第一功能的界面时第一功能可能并没有运行。例如,第一功能是视频通话功能,第一功能的界面是视频来电提醒界面,还未进行视频通话。或者,第一电子设备显示第一功能的界面时第一功能此时已经在运行。例如,第一功能是视频播放功能,第一功能的界面是视频播放界面,此时视频正在播放中。
采用该技术方案,第一电子设备可以将当前实现的功能中的一个子功能通过调度其他电子设备来实现,进而可以使多个电子设备配合实现来该功能。也就是说,第一电子设备可以调度多个电子设备,使每个电子设备可以执行不同的子功能,进而使多个不同电子设备配合共同实现一个功能。解决了电子设备仅能将当前需要实现的功能,如播放视频等交给与该设备连接的一个设备来实现的问题,使得多个电子设备可以执行不同的子功能,为用户带来更好的体验。
在一种可能的实现方式中,第一界面还可以包括:第二子功能对应的第一电子设备的设备标识;在第一电子设备显示第一界面之后,上述方法还可以包括:第一电子设备检测到用户对第一电子设备的设备标识的第三操作,响应于第三操作,第一电子设备执行第二子功能。也就是说,第一电子设备还可以调度自身实现第一功能中的一个子功能。
在另一种可能的实现方式中,第一界面还可以包括,与第二电子设备的设备标识对应的第一应用的标识和第二应用的标识,其中,第一应用和第二应用安装在第二电子设备中;上述方法中的第二操作,具体可以为,对第一应用的标识的第二操作;响应于第二操作,第一电子设备将第一应用的标识发送到第二电子设备,以使第二电子设备使用第一应用执行第一子功能。
可以理解的是,第二电子设备中可能存在多个应用可执行第一子功能,如果第一界面中包括第二电子设备的设备标识对应的应用的标识,第二操作可以是用户对应用的标识的第二操作,使得第一电子设备可以根据第二操作确定出执行该第一子功能的第二电子设备上的应用,第一电子设备可以调度第二电子设备上的应用执行第一子功能,进一步提高用户体验。
在另一种可能的实现方式中,上述方法中的第二操作具体可以为:对第二电子设备的设备标识的选中操作。
在另一种可能的实现方式中,第一电子设备存储有第一电子设备的能力信息;在第一电子设备显示第一界面之前,上述方法还包括:第一电子设备与第二电子设备建立无线保真(Wi-Fi)连接,第一电子设备与第三电子设备建立Wi-Fi连接。第一电子设备获取第二电子设备的能力信息和设备标识,并获取第三电子设备的能力信息和设备标识;第一电子设备根据第二电子设备的能力信息和第一子功能确定第一子功能对应第二电子设备,根据第三电子设备的能力信息和第二子功能确定第二子功能对应第三电子设备。
在另一种可能的实现方式中,第一电子设备获取第二电子设备的能力信息和设备标识,并获取第三电子设备的能力信息和设备标识之后,上述方法还可以包括:第一电子设备将第二电子设备的能力信息与第二电子设备的设备标识关联存储,将第三电子设备的能力信息与第三电子设备的设备标识关联存储;其中,能力信息包括能力的能力描述,能力描述用于描述设备所具备的能力;第一电子设备确定实现第一子功能 所需的能力,及实现第二子功能所需的能力;第一电子设备根据存储的各个设备所具备能力的能力描述和实现第一子功能及第二子功能所需的能力,确定能够实现第一子功能的设备,及实现第二子功能的设备;第一电子设备显示第一界面,包括:第一电子设备根据能够实现第一子功能的设备,及实现第二子功能的设备,显示第一界面。
也就是说,第一电子设备在显示第一界面之前,第一电子设备已经存储有与第一电子设备处于同一局域网中的各个电子设备能力信息及及其设备标识,这样,第一电子设备可以确定出该局域网中能够执行各个子功能的设备,从而显示第一界面,以便用户根据需要在第一界面上进行对应的操作,提高用户体验。
在另一种可能的实现方式中,第一功能为视频播放功能,第一子功能和第二子功能分别为播放图像,播放音频或解码中的一个;或,第一功能为视频通话功能,第一子功能和第二子功能分别为显示图像,播放音频,录音或拍摄图像中的一个。
需要说明的是,此处仅是对第一功能及第一功能包括的子功能的示例,并不局限于上述示例。
在另一种可能的实现方式中,第一操作为用户对第一功能的界面上启动第一功能的第一按钮的点击操作;或,第一操作为用户对通知菜单栏中第二按钮的点击操作,其中,通知菜单栏叠加显示在第一功能的界面之上。
在另一种可能的实现方式中,能力信息还包括能力服务,不同子功能调用不同的能力服务来实现;第一电子设备将第一子功能对应的数据发送到第二电子设备,以使第二电子设备执行第一子功能,包括:第一电子设备调度第二电子设备的能力服务,将第一子功能对应的数据发送到第二电子设备,使第二电子设备根据第一子功能对应的数据运行能力服务,执行第一子功能,其中,第一电子设备的能力信息预先配置在第一电子设备中;或者,是根据第一电子设备所具备的硬件生成并存储的。
在另一种可能的实现方式中,能力信息还包括能够调度能力描述所描述的能力的应用的标识,不同子功能调用不同的应用来实现;第一电子设备将第一子功能对应的数据发送到第二电子设备,以使第二电子设备执行第一子功能,包括:第一电子设备调度第二电子设备的应用,将第一子功能对应的数据发送到第二电子设备,使第二电子设备根据第一子功能对应的数据使用应用执行第一子功能。
在另一种可能的实现方式中,第一电子设备存储有第一电子设备中包括的应用的安装说明,安装说明包括应用的句柄和应用能够调度第一电子设备的能力;上述方法还包括:第一电子设备根据安装说明生成并存储第一电子设备的能力信息,能力信息中的应用的标识是句柄。
第二方面,本申请还提供一种设备能力调度方法,包括:第二电子设备接收第一电子设备发送的请求执行第一子功能的消息;第二电子设备显示第二界面,第二界面包括:与第一子功能对应的第一应用的标识和第二应用的标识;第二电子设备接收用户对第一应用的标识的第三操作;响应于第三操作,第二电子设备调度第一应用执行第一子功能。
其中,第一子功能为第一功能的一部分;第一功能为播放视频功能,第一子功能为播放图像,播放音频或解码中的一个;或者,第一功能为视频通话功能,第一子功能为:显示图像,播放音频,录音或拍摄图像中的一个。
示例性的,第一功能是视频播放功能,第一功能包括的子功能为:播放音频、播放图像和解码。以第一子功能是播放图像为例。假设第二电子设备是电视机,电视机中包括第一视频应用和第二视频应用。响应于第二操作,第一电子设备向电视机发送用于实现播放图像子功能的请求消息,电视机上显示第二界面,第二界面中包括第一视频应用的标识和第二视频应用的标识。如果用户想选择第一视频应用播放图像,则可以对第二界面中第一视频应用的标识进行第三操作。此时,电视机可接收用户对第一视频应用的标识的第三操作,响应于第三操作,电视机调度第一视频应用,运行第一视频应用执行播放图像子功能。
需要说明的是,第二界面也可以显示在第一电子设备上,第一电子设备可以接收用户对第二界面上包括的应用的标识的选择操作,使得第一电子设备可以确定用户想要调度的第二电子设备上的应用,提高用户体验。
第三方面,本申请提供一种电子设备,电子设备包括存储器和一个或多个处理器;存储器和一个或多个处理器耦合;存储器用于存储程序代码,当一个或多个处理器执行程序代码时,使电子设备执行上述第一方面中任一可能的实施方式的方法。
第四方面,本申请还提供一种电子设备,电子设备包括存储器和一个或多个处理器;存储器和一个或多个处理器耦合;存储器用于存储程序代码,当一个或多个处理器执行程序代码时,使电子设备执行上述第二方面的实施方式的方法。
第五方面,本申请实施例提供一种计算机存储介质,包括程序代码,当程序代码在电子设备上运行时,使得电子设备执行如第一方面及其任一种可能的实施方式的方法。
第六方面,本申请实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如第一方面及其任一种可能的实施方式的方法。
第七方面,本申请实施例提供一种计算机存储介质,包括程序代码,当程序代码在电子设备上运行时,使得电子设备执行如第二方面的实施方式的方法。
第八方面,本申请实施例提供一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行如第二方面的实施方式的方法。
可以理解地,上述提供的第三方面、第四方面及其任一种可能的实施方式的电子设备,第五方面及第七方面的计算机存储介质,第六方面及第八方面的计算机程序产品所能达到的有益效果,可参考如第一方面及其任一种可能的实施方式中的有益效果,此处不再赘述。
附图说明
图1为本申请实施例提供的一种电子设备的硬件结构示意图;
图2为本申请实施例提供的一种电子设备的软件框架结构图;
图3A是本申请实施例提供的一种设备能力调度方法的流程图;
图3B是本申请实施例提供的一种设备的架构示意图;
图4是本申请实施例提供的一种显示界面示意图;
图5是本申请实施例提供的另一种显示界面示意图;
图6是本申请实施例提供的一种第一界面的显示示意图;
图7A是本申请实施例提供的另一种第一界面的显示示意图;
图7B是本申请实施例提供的另一种第一界面的显示示意图;
图8是本申请实施例提供的另一种第一界面的显示示意图;
图9是本申请实施例提供的另一种显示界面示意图;
图10是本申请实施例提供的一种设备能力调度过程示意图;
图11是本申请实施例提供的另一种设备能力调度过程示意图。
具体实施方式
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
电子设备可实现多个功能,功能是指电子设备能够提供的用途,可由电子设备调用对应能力来实现。具体的,电子设备的功能可由电子设备通过调用具有对应能力的软件模块和硬件模块实现。例如,电子设备中安装有多个应用,在应用运行的过程中,电子设备可根据应用所需实现的功能调用对应能力的软件模块(如,能力服务)及该能力的硬件模块来实现该功能。如,以应用为视频应用为例。电子设备的视频应用播放视频这个功能,可调用设备对应能力的能力服务及硬件模块来实现。其中,应用所需实现的一个功能可能需调用的设备的多个能力的能力服务及硬件模块来实现。如,继续以视频应用为例。视频应用播放视频这个功能,可分解成多个子功能包括:解码,播放声音和播放图像,不同子功能可以调用设备不同能力的能力服务和硬件模块来实现。具体的:电子设备可调用电子设备的解码能力的能力服务和用于实现解码的硬件模块,来实现解码功能,调用电子设备的播放音频能力的能力服务和扬声器,来播放声音,调用电子设备的播放图像能力的能力服务和显示屏,来实现图像播放,从而实现视频播放。
可以理解的是,电子设备可以具备至少一个能力,电子设备可以调用不同能力的能力服务及其硬件模块来实现不同功能。不同的电子设备所具备的能力会存在差异。例如,手机具备的能力包括:播放音频、播放图像、显示图片、测距、录音、拍摄图像和拍摄照片等。电视机具备的能力包括:播放音频、播放图像等。音箱具备的能力是播放音频。
在某些场景中,用户可能会有使用多个电子设备的能力的需求。为了满足用户同时使用多个电子设备的能力的需求,本申请实施例提供一种设备能力调度方法,该方法应用于设备组,该设备组中的电子设备均处于同一个局域网中。其中,设备组中的每个设备所具备的能力可能不同,一个设备组中的任一个设备可以调度该设备组中其他设备的能力对应的能力服务及其硬件模块,以实现对应的功能。
例如,该设备组中的第一电子设备运行第一应用的过程中,第一电子设备的第一应用需要实现一个功能(或任务)。该功能可以分解为多个子功能(或子任务)。第一电子设备可以调度该设备组中不同电子设备实现该功能的不同子功能,以配合实现该功能。如,手机、电视机和音箱处于同一局域网中,手机的视频应用在播放视频时,手机可调用手机的解码能力的能力服务和用于实现解码的硬件模块来实现解码,还可以调度电视机的播放图像能力的能力服务和显示器来播放图像,调度音箱的播放音频 能力的能力服务和扬声器播放声音,以配合实现手机视频应用视频播放这个功能。
这样,第一电子设备可以调度设备组中多个不同电子设备配合共同实现第一电子设备的功能。由此,使得设备组中的电子设备发挥自己的“特长”,为用户带来更好的体验。
需要理解的是,设备组中的各个电子设备之间可以通过无线宽带(Wi-Fi Alliance,WiFi)、蓝牙或ZigBee网络等方式互连,以组成局域网。例如,设备组中包括的电子设备为:手机、电视机、音箱和平板电脑,用户可以将手机、电视机、音箱和平板电脑均连接到同一个WiFi接入点。接入同一个WiFi接入点的所有设备便组成了一个设备组。或者,手机可作为一个WiFi接入点,平板电脑、音箱和电视机均可以连接至该WiFi接入点,连接至该WiFi接入点的设备与手机便组成一个设备组。
示例性的,本申请实施例中的设备组中的电子设备可以是手机、平板电脑、桌面型、膝上型、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)\虚拟现实(virtual reality,VR)设备等设备,本申请实施例对设备组中电子设备的具体形态不作特殊限制。
下面将结合附图对本申请实施例的实施方式进行详细描述。请参考图1,为本申请实施例提供的一种电子设备100的结构示意图。如图1所示,电子设备100可以包括:处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。
其中,上述传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L和骨传导传感器180M等传感器。
可以理解的是,本实施例示意的结构并不构成对电子设备100的具体限定。在另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了***的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
可以理解的是,本实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,外部存储器,显示屏194,摄像头193,和无线通信模块160等供电。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星***(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。
无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。该显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4 等。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行电子设备100的各种功能应用以及数据处理。例如,在本申请实施例中,处理器110可以通过执行存储在内部存储器121中的指令,内部存储器121可以包括存储程序区和存储数据区。
其中,存储程序区可存储操作***,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。
陀螺仪传感器180B可以用于确定电子设备100的运动姿态。气压传感器180C用于测量气压。在一些实施例中,电子设备100通过气压传感器180C测得的气压值计算海拔高度,辅助定位和导航。
磁传感器180D包括霍尔传感器。电子设备100可以利用磁传感器180D检测翻盖皮套的开合。
加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态,应用于横竖屏切换,计步器等应用。
距离传感器180F,用于测量距离。电子设备100可以通过红外或激光测量距离。接近光传感器180G可以包括例如发光二极管(LED)和光检测器。
环境光传感器180L用于感知环境光亮度。
指纹传感器180H用于采集指纹。
温度传感器180J用于检测温度。在一些实施例中,电子设备100利用温度传感器 180J检测的温度,执行温度处理策略。例如,当温度传感器180J上报的温度超过阈值,电子设备100执行降低位于温度传感器180J附近的处理器的性能,以便降低功耗实施热保护。
触摸传感器180K,也称“触控面板”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于电子设备100的表面,与显示屏194所处的位置不同。
本申请实施例中,电子设备100可以通过触摸传感器180K检测到用户在触摸屏输入的触摸操作,并采集该触摸操作在触摸屏上的触控位置,触控面积,触控方向,以及触控时间等中的一项或多项。在一些实施例中,电子设备100可以通过触摸传感器180K和压力传感器180A结合起来,确定触摸操作在触摸屏的触控位置。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过***SIM卡接口195,或从SIM卡接口195拔出,实现和电子设备100的接触和分离。电子设备100可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡,Micro SIM卡,SIM卡等。
电子设备100的软件***可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以分层架构的Android***为例,示例性说明电子设备100的软件结构。
图2是本申请实施例提供的电子设备100的软件结构框图。分层架构可将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android***分为三层,从上至下分别为应用程序层(简称应用层),应用程序框架层(简称框架层),以及内核层(也称为驱动层)。
其中,应用层可以包括一系列应用程序包。例如,如图2所示,应用程序包可以为相机、短信、音乐、电话、视频电话、第一视频应用、第二视频应用和服务调度等应用程序。
框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。如图2所示,框架层中包括窗口管理器(window manager service,WMS)和总线调度器等。可选的,框架层还可以包括内容管理器、电话管理器,资源管理器,通知管理器等(附图未示出)。
其中,窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
总线调度器用于存放电子设备所具备能力的能力信息。在一些实施例中,能力信息中包括能力描述(Action)和能力服务(Service),一个能力描述与一个能力服务对应。不同能力信息与电子设备的不同能力对应。在另一些实施例中,能力信息中包括能力描述(Action)和电子设备中能够调用该能力的应用的标识,一个能力描述可以与一个或多个应用的标识对应。总线调度器中还存放有该电子设备的设备标识,用于标记该电子设备。
示例性的,总线调度器上存放的能力信息可以包括:播放图像能力的能力信息、显示照片能力的能力信息、播放音频能力的能力信息、拍摄图像能力的能力信息、播放音频能力的能力信息和录音能力的能力信息等。
在一个应用场景中,应用层中的服务调度运行时,服务调度可以访问总线调度器上存放的能力信息和该电子设备的设备标识。
进一步的,框架层还可以包括安装服务。安装服务用于存放和获取数据,并使这些数据可以被访问。该数据包括每个应用的安装说明,每个安装在电子设备上的应用程序都需要在安装服务中写入安装说明。其中,安装说明指的是,本应用的句柄以及本应用会调度的电子设备的能力。需要说明的是,句柄是一种特殊的智能指针,当电子设备调度其他电子设备的能力实现对应功能时,使用句柄可以调度其他电子设备所管理的内存块或对象,使得其他电子设备实现该功能。
本申请一些实施例中,在能力信息中包括能力描述(Action)和电子设备中能够调用该能力的应用的标识的实现方式中,能力信息中包含的能够使用不同能力的应用的标识,可以由总线调度器获得。示例性的,总线调度器可以获取安装服务中每个应用的安装说明,根据每个应用的安装说明,确定每个应用能够调用的能力,以获得电子设备所具备的能力。并生成电子设备所具备的每个能力的能力描述(Action),及能够调用该能力的应用的标识。其中,一个能力对应一个能力描述(Action),一个能力可以对应至少一个标识,该标识可以是应用的句柄。
需要说明的是,当电子设备与至少一个其他电子设备处于同一局域网时,如果其他电子设备也设置有总线调度器,则电子设备上的总线调度器可以与同一局域网中的其他电子设备上的总线调度器进行信息共享。由此一来,处于同一局域网中的每个电子设备的总线调度器上可获得并存储有该局域网中每个电子设备的能力信息。如,可以将不同电子设备的设备标识,与其能力信息关联存储。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动等。
本申请实施例提供一种设备能力调度方法,该方法应用于设备组,图3A为本申请实施例提供的一种设备能力调度方法的流程示意图。其中,本实施例中以该设备组中包括第一电子设备、第二电子设备和第三电子设备为例。如第一电子设备、第二电子设备和第三电子设备可接入同一WiFi。
如图3B所示,为本申请实施例提供的一种设备组的组成示意图。其中,图3B中以设备组包括第一电子设备、第二电子设备和第三电子设备,且第一电子设备是手机, 第二电子设备是电视机,第三电子设备是音响为例示出。
本申请实施例中,处于同一局域网中的设备组中的各个电子设备可以互相调度能力,以配合完成对应功能。例如,结合图3B所示,手机可以调度电视机的对应能力实现播放图像的功能,手机还可以调度音箱的对应能力实现播放音频的功能。以下结合图2及图3B,对本申请实施例进行详细说明。
步骤301:设备组中的各个电子设备通过总线调度器进行数据交互,更新每个电子设备上总线调度器中的数据。
其中,处于同一局域网的设备组内的所有电子设备可通过各自的总线调度器基于与其他电子设备之间的连接,进行数据共享,使得设备组中的每个电子设备可以获取其他电子设备的能力信息。
本申请实施例中,电子设备的总线调度器中存储有电子设备具备能力的能力信息。示例性的,以电子设备是上述设备组中的第一电子设备,即手机为例,手机具备以下能力:显示图片、播放音频、播放图像、拍摄照片、拍摄图像、录音和测距等,手机的总线调度器中存储有上述能力对应的能力信息。
第一种实现方式中,第一电子设备所具备能力的能力信息可以预先配置在第一电子设备中。示例性的,手机所具备能力的能力信息可以预先配置在手机的存储器中,手机在第一次开机运行时,手机的总线调度器与手机的存储器进行信息交互,以将手机所具备能力的能力信息注册在总线调度器中。又示例性的,手机所具备能力的能力信息还可以出厂时预先配置在手机的总线调度器中。随着手机中软件的更新(例如,下载或删除应用,更新操作***等),还可以更新能力信息。
其中,在该实现方式中,能力信息可以包括能力描述(Action)和能力服务(Service),一个能力描述对应一个能力服务。能力描述是根据手机所具备的硬件配置在手机中的,用于指示(或者说描述)手机所具备的能力。能力服务是电子设备实现该能力对应功能时调用的软件模块。例如,手机的硬件可以包括显示器、扬声器、麦克风、摄像头、距离传感器等。手机的能力信息中的能力描述可以指示手机具备以下能力:显示图片能力、播放图像能力、播放音频能力、录音能力、拍摄照片能力、拍摄图像能力和测距能力等。能力描述所指示的每个能力可以对应一个能力服务。
例如,手机的总线调度器上存储的能力信息包括显示图片能力的能力信息。该能力的能力信息中的能力描述(Action)可以定义为:DEVICE_DISPLAY_PHOTO,能力服务(Service)可以定义为:display Photo Service。display Photo Service是用于实现图片显示功能的软件模块。能力信息中还包括播放图像能力的能力信息,该能力的能力描述可以定义为,DEVICE_DISPLAY_IMAGE,能力服务可以定义为,display image Service。display image Service是用于实现图像播放功能的软件模块。能力信息中还包括播放音频能力的能力信息,该能力的能力描述可以定义为,DEVICE_PLAY_AUDIO,能力服务可以定义为,play audio Service。play audio Service是用于实现音频播放功能的软件模块。能力信息中还包括测距能力的能力信息,该能力的能力描述可以定义为,DEVICE_DISTANCE_SENSOR,能力服务可以定义为,distance sensor Service。distance sensor Service是用于实现测距功能的软件模块。能力信息中还包括解码能力的能力信息,该能力的能力描述可以定义为, DEVICE_DECODE,能力服务可以定义为,decode Service。decode Service是用于实现解码功能的软件模块。
第二种实现方式中,第一电子设备可以根据该第一电子设备中已安装的应用,确定出该第一电子设备所具备能力的能力信息并存储在电子设备的总线调度器中。如,手机可以根据每个应用的安装说明确定每个应用能够调用的能力,以获得手机所具备的能力,并生成手机所具备的每个能力的能力描述,及能够调用该能力的应用的标识。应用的标识可以是句柄。
需要说明的是,每个安装在手机的应用都需要在安装服务中写入安装说明。安装说明是对安装的应用的说明,安装说明包括该应用的类型、该应用的句柄和该应用在运行过程中会调用的手机的能力。例如,电子设备中安装有以下应用:视频电话、第一视频应用和第二视频应用。例如,视频电话的安装说明是视频通讯类应用,视频电话的句柄,该应用在运行过程中会调用的手机的能力包括,播放图像能力、播放音频能力、录音能力和拍摄图像能力。第一视频应用的安装说明是视频类应用,第一视频应用的句柄,该第一视频应用在运行过程中会调用的手机的能力包括,播放图像能力,解码视频文件能力和播放音频能力。第二视频应用的安装说明是视频类应用,第二视频应用的句柄,该第二视频应用在运行过程中会调用的手机的能力包括,播放图像能力,解码视频文件能力和播放音频能力。
示例性的,根据上述的安装说明,可以确定出手机的能力包括:播放图像能力、解码视频文件能力、播放音频能力、录音能力和拍摄图像能力。根据手机的能力可以生成每个能力的能力描述,如包括:播放图像、解码视频文件、播放音频、录音和拍摄图像。以应用的标识是应用的句柄为例,每个能力描述对应的应用的标识分别为:播放图像对应的标识是第一视频应用的句柄、第二视频应用的句柄和视频电话的句柄;解码视频文件对应的标识是,第一视频应用的句柄和第二视频应用的句柄;播放音频对应的标识是,第一视频应用的句柄、第二视频应用的句柄和视频电话的句柄;录音对应的标识是,视频电话的句柄;拍摄图像对应的标识是,视频电话的句柄。
可以理解的是,由于第一电子设备中可以安装多个应用,一个能力对应的应用的标识可能不止一个。第一电子设备可能会被第二电子设备或第三电子设备调度,以使用第一电子设备中的一个能力。因此,第二电子设备或第三电子设备调度第一电子设备中的能力时,可以调度该能力对应的应用的标识中的任一个应用的标识对应的应用,使得第一电子设备中与该应用的标识对应的应用运行,以实现对应功能。例如,在该应用运行时,可通过调用对应能力的软件模块(如能力服务)及其硬件模块,以实现对应的功能。
例如,第二电子设备实现播放视频的功能,播放视频的功能包括播放图像子功能。第二电子设备可调度第一电子设备的对应应用实现播放图像的子功能。如,可以选择调度第一电子设备中的第一视频应用,使得第一视频应用运行。在第一视频应用运行时可以调用第一电子设备播放视频能力的软件模块及其硬件模块(如显示器),实现播放图像的子功能,也可以选择调度第一电子设备中的第二视频应用,使得第二视频应用运行。在第二视频应用运行时可以调用第一电子设备播放视频能力的软件模块及其硬件模块(如显示器),实现播放图像的子功能。
需要注意的是,第一电子设备在根据应用能够调用的能力确定该能力对应的应用的标识时,需要判断该应用的句柄是否可以被其他设备(如第二电子设备或第三电子设备)调度。如果该应用的句柄可以被其他设备调度,第一电子设备则可以在该能力对应的应用的标识中增加该应用的句柄;如果该应用的句柄拒绝被其他设备调度,则在该能力对应的应用的标识中不增加该应用的句柄。示例性的,以应用为“招商银行”为例。该应用的安装说明为:网上支付平台,该应用的句柄和该应用的能力包括网上支付。且该应用的句柄拒绝被其他设备调用,则能力信息中的网上支付能力对应的应用的标识中不包括“招商银行”的句柄。
本申请实施例中,总线调度器上还存储了该电子设备的设备标识,设备组中的各个电子设备通过总线调度器进行数据交互,还包括:第一电子设备向设备组中的第二电子设备和第三电子设备发送设备标识,第一电子设备获取第二电子设备的设备标识和第三电子设备的设备标识。在总线调度器中,可将设备标识与该设备标识所对应的电子设备所具备能力的能力信息关联存储。第一电子设备调度第二电子设备或第三电子设备时,可以显示该设备标识,使得用户可以根据设备标识确定想要调度的电子设备。
示例性的,以第一种实现方式为例,第一电子设备的能力信息中包括能力描述和能力服务。假设第一电子设备具备以下能力:显示图片能力、播放音频能力、播放图像能力、拍摄照片能力、拍摄图像能力、录音能力和测距能力。在这种情况下,第一电子设备的总线调度器中可以保存表1所示的能力信息。
表1:第一电子设备中能力信息表
能力描述 能力服务
显示图片能力的能力描述 显示图片能力的能力服务
播放音频能力的能力描述 播放音频能力的能力服务
播放图像能力的能力描述 播放图像能力的能力服务
拍摄照片能力的能力描述 拍摄照片能力的能力服务
拍摄图像能力的能力描述 拍摄图像能力的能力服务
录音能力的能力描述 录音能力的能力服务
测距能力的能力描述 测距能力的能力服务
类似的,第二电子设备也可以根据上述描述生成自身的能力信息并存储在第二电子设备的总线调度器中。假设第二电子设备具备以下能力:显示图片能力,播放图像能力和播放音频能力。第二电子设备的总线调度器上保存的能力信息包括:显示图片的能力信息、播放图像的能力信息和播放音频的能力信息。第三电子设备具备以下能力:播放音频的能力。第三电子设备的总线调度器上保存的能力信息包括:播放音频的能力信息。
以第一电子设备为例,设备组中的各个电子设备通过总线调度器进行数据交互,更新每个电子设备上总线调度中的数据之后,第一电子设备的总线调度器上存储的能力信息则不仅可以包括第一电子设备所具备能力的能力信息,还可以包括第二电子设备和第三电子设备具备能力的能力信息。第一电子设备可将自身所具备能力的能力信息与第一电子设备的设备标识关联存储,将第二电子设备所具备能力的能力信息与第 二电子设备的设备标识关联存储,将第三电子设备所具备能力的能力信息与第三电子设备的设备标识关联存储。例如,第一电子设备的总线调度器中可以保存如表2所示的能力信息。
表2:第一电子设备上的总线调度器进行数据交互之后能力信息表
Figure PCTCN2020113626-appb-000001
类似的,第二电子设备通过总线调度器上的数据共享也可以获得第一电子设备和第三电子设备的能力信息,第三电子设备通过总线调度器的数据共享也可以获得第一电子设备和第二电子设备的能力信息。值得一提的是,如果第三电子设备是音箱,音箱仅具备播放音频能力,且音箱自身不需要调度其他设备的能力,在与同一局域网的电子设备进行总线调度器上的数据共享时,音箱可以不获取其他电子设备上总线调度器的数据。
步骤302:第一电子设备显示第一功能的界面,接收用户的第一操作。第一操作用于触发手机执行服务调度。
其中,第一功能可以包括多个子功能,如包括第一子功能,第二子功能等。例如,第一功能是视频通话功能,视频通话功能可以包括的子功能为:显示图像、播放音频、录音和拍摄图像。又例如,第一功能为视频播放功能,视频播放功能可以包括子功能为:播放图像,播放音频,解码。
示例性的,第一操作可以是用户在上述第一功能的界面上对启动第一功能的第一按钮的点击操作。
例如,假设手机实现的功能为播放视频。手机正在运行视频应用,显示视频应用的界面(该视频应用的界面可以是上述第一功能的界面)。该第一操作可以是用户对视频界面中“播放”按钮点击操作。
又例如,上述第一操作可以是用户对视频电话的来电提醒界面(该来电提醒界面可以是上述第一功能的界面)中“接听”按钮的点击操作。如第一操作可以是用户对图4中所示的视频电话的来电提醒界面401中“接听”按钮402的点击操作。或者,该第一操作还可以是用户对视频电话中用于发起视频通话的“视频通话”按钮的点击操作(附图未示出)。
又示例性的,第一操作也可以为用户对通知菜单栏中第二按钮的点击操作,其中,通知菜单栏叠加显示在第一功能的界面之上。手机中可以预置“服务调度”的按钮或者开关,该“服务调度”的按钮或者开关即为该第二按钮。例如,手机的通知菜单栏可以包括该“服务调度”的按钮或者开关。第一操作可以是用户对该“服务调度”的按钮或者开关的点击操作。其中,手机显示任一应用的界面时,响应于用户对调出通知菜单栏的调度操作手机可以显示通知菜单栏;手机可以接收用户对通知菜单栏中“服务调度”的点击操作。
例如,手机在实现视频通话功能时,手机显示该视频通话功能的界面,如视频电话的接通界面。手机接收到调出通知菜单栏的操作,显示通知菜单栏,第一操作可以是用户对通知菜单栏中“服务调度”按钮的点击操作,如图5所示。
又例如,手机实现的功能是播放音乐。手机正在运行音乐应用,播放音乐。用户想要调度设备组中的其他电子设备实现播放音乐功能,手机接收到调出通知菜单栏的操作,显示通知菜单栏,第一操作可以是用户对通知菜单栏中对“服务调度”按钮的点击操作。
需要注意的是,手机接收到用户的第一操作时,手机需要调度设备组中的其他电子设备实现手机当前的功能。例如,手机正在运行视频应用,但并未播放视频,手机显示的是浏览视频文件的界面,如果手机接收到用户的第一操作,手机调度的能力是显示能力。如果手机在播放视频时,接收到用户的第一操作,手机调度的能力可以包括:播放图像能力、播放音频能力和解码视频文件能力。
步骤303:响应于第一操作,第一电子设备显示第一界面。
其中,上述第一功能可被分解为多个子功能。不同子功能可通过调用不同的能力服务及硬件模块来实现。示例性的,第一电子设备可以确定实现多个子功能中每个子功能所需的能力,根据总线调度器上存储的各个设备所具备能力的能力描述,和实现每个子功能所需的能力,可确定出能够实现每个子功能的设备的设备标识。根据确定出的能够实现每个子功能的设备的设备标识,第一电子设备可显示第一界面,该第一界面中可以包括要实现的子功能的名称和与每个子功能的名称对应的设备标识。例如,第一功能包括第一子功能和第二子功能。第一电子设备根据第二电子设备的能力信息和第一子功能可以确定出第一子功能对应第二电子设备,根据第三电子设备的能力信息和第二子功能可以确定第二子功能对应第三电子设备,因此第一电子设备显示的该第一界面中可以包括第一子功能对应的第二电子设备的设备标识,第二子功能的名称,第二子功能对应的第三电子设备的设备标识等。
示例性的,假设第二电子设备是电视机、第三电子设备是音箱。手机当前实现的第一功能是视频电话的视频通话功能,响应于第一操作,手机显示的第一界面可以如图6所示,包括视频通话功能分解出的子功能的名称:显示图像、播放音频、录音和拍摄图像。以及每个子功能的名称对应的设备标识,如图6中,子功能名称为显示图像,该子功能名称对应的设备标识是电视机的标识,子功能名称为播放音频,该子功能名称对应的设备标识是电视机的标识和音箱的标识等。在其他一些实施例中,第一界面中与子功能的名称对应的设备标识还可以包括设备本身的设备标识,如图7A所示,该第一界面中与子功能的名称对应的设备标识不仅包括上述图6中所示的设备标 识,还可以包括手机的标识。
需要说明的是,上述示例中是以第一界面包括子功能的名称和与子功能的名称对应的设备标识为例进行说明的。在其他一些实施例中,第一界面中包括的内容也可以按照每个设备标识和与该设备标识对应的设备能够实现的子功能的名称的对应形式显示。例如,如图7B所示,设备标识为电视机,与该设备标识对应的子功能的名称包括,拍摄图像、播放音频、播放图像和录音;设备标识为手机,与该设备标识对应的子功能的名称包括,拍摄图像、播放音频、播放图像和录音;设备标识为音箱,与该设备标识对应的子功能的名称包括,播放音频。
值得注意的是,为了满足用户的调度的需求,将手机正在执行的功能分解为子功能,在第一界面显示每个子功能的名称对应设备的设备标识。可以由用户选择调度一个或多个设备来实现该功能的不同子功能。由此,手机可以调度设备组中具备子功能对应的能力的设备,以满足用户需求。
步骤304:第一电子设备接收用户在第一界面的第二操作,根据该第二操作调用对应设备的能力服务及硬件模块,实现对应的子功能。
其中,第二操作可以包括:用户针对一个或多个子功能的名称对应的设备标识的选择操作。
在第一种实现方式中,在手机中总线调度器上的能力信息包括能力描述和能力服务的实现方式中,手机显示的第一界面如图6或图7A所示,第二操作是用户在该第一界面上对对应设备标识的选择操作。在手机显示的第一界面如图7A所示时,也可以将用户对第一电子设备的设备标识的操作的称为第三操作。
在第二种实现方式中,在手机中总线调度器上的能力信息包括手机所具备能力的能力描述和能力对应的应用的标识的实现方式中。
例如,第二电子设备是电视机,第三电子设备是音箱,第一界面可以是如图8所示的界面。第二操作可以是用户在图8所示的界面上的选择操作。其中,图8所示的显示界面中,与每个能力对应的信息不仅包括设备标识,还包括该设备标识对应的设备中可以调用该能力的应用的标识,第二操作是对图8所示界面中应用的标识的选择操作。
又例如,第二电子设备是电视机,第三电子设备是音箱,手机的第一界面是图9中(a)所示的界面,第二操作包括用户在图9中(a)所示的界面上对设备标识的选择操作。在用户对对应设备标识进行选择操作之后,手机还可以显示第二界面,如图9中(b)所示,第二界面中包括该设备标识对应的设备中可以调用对应能力的应用的标识。第二操作还包括用户在图9中(b)所示界面上对应用的标识的选择操作。另外,第二操作还可以包括用户对第一界面上的确定按钮,如图6中的“OK”按钮的点击操作。
上述是以用户在第一界面中选择设备标识之后,在第二界面显示在手机上为例说明的,该第二界面也可以显示在第一界面中选择的设备标识对应的设备上。如,第一界面是图9中(a)所示的界面,在用户在图9中(a)所示的界面上对播放图像能力对应的电视机的设备标识进行选择操作后,第二界面可以显示在电视机上,此时,第二操作还可包括用户对电视机上显示的第二界面中应用的标识的选择操作。需要说明的是,如果该设备具备某个能力仅对应一个标识,则可以不显示该标识,如图9中(a) 所示,音箱具备能力是播放音频能力,且该播放音频能力对应的应用的标识仅有一个,如果播放音频能力中用户选择了音箱,则不需要在第二界面上显示与音箱中可以调用播放音频能力的应用的标识。
值得一提的是,电子设备是根据用户的选择调度设备组中的其他电子设备的。例如,电视机的显示器比较大,用户可选择使用电视机的播放图像能力来实现播放图像功能,以获得更好的视觉体验。音箱的音效好,用户可使用音箱的播放音频能力来实现播放声音功能以获得更好的听觉体验。这样可以更好的发挥各电子设备的“特长”,提高用户体验。
在一种可能的实现方式中,手机接收到第二操作之后,根据第二操作可以确定执行子功能的设备标识,并通过调用该设备标识对应设备中的能力服务和对应的硬件模块,以实现对应的子功能。
本申请实施例中,在总线调度器上的能力信息包括能力描述(Action)和能力服务(Service)的实现方式中,当子功能需要调度其他设备的能力来实现时,手机可通过对应的能力接口调用其他设备能力的能力服务,该能力服务被调用时,调用对应的硬件模块,以配合实现该子功能。例如,手机要通过电视机实现显示图片的功能,则手机可通过电视机的显示图片能力的接口调度电视机的显示图片能力的能力服务,并显示图片能力的能力服务被调用时,调用电视机的显示器,以实现显示图片的功能。其中,电子设备中每个能力的能力服务对应的接口(如称为服务软件工具开发包(Software Development Kit,SDK)可以预先配置在该电子设备中,通过对该接口进行调度,可使得电子设备运行对应能力服务,电子设备运行该能力服务时,调用对应的硬件模块以实现对应功能。
示例性的,手机要实现播放视频的功能,该功能可以分解为:播放图像,播放音频和解码三个子功能。以用户选择使用手机实现解码功能,使用第二电子设备实现播放图像功能,使用第三电子设备实现播放音频功能为例,如图10中所示。手机可在接收到上述第二操作后,可通过手机的解码SDK调度手机的解码能力的能力服务,解码能力的能力服务被调用时,调用实现解码能力的硬件模块,以实现解码功能,通过第二电子设备的播放图像SDK调度第二电子设备的播放图像能力的能力服务,播放图像的能力服务被调用时,调用第二电子设备的显示器,以实现图像播放功能,通过第三电子设备的播放音频SDK调度第三电子设备的播放音频能力的能力服务,音频能力的能力服务被调用时,调用第三电子设备的扬声器,以实现音频播放功能。
例如,第二电子设备是电视机,第三电子设备是音箱,手机当前运行的应用是视频应用,手机显示视频播放的界面,如图11中(a)所示的视频应用的视频播放界面。手机接收到用户的第一操作,如用户对视频播放界面中“播放”按钮的点击操作。手机响应于第一操作,手机显示第一界面,如图11中(b)所示,第一界面中包括的能力是,播放图像和播放声音,以及该能力对应的设备标识。手机获取到用户在第一界面的第二操作,如第二操作是用户对播放图像能力对应的设备标识中的电视机的选择操作,以及对播放音频能力对应的设备标识中音箱的选择操作。手机通过电视机的播放图像SDK调度电视机的播放图像能力的能力服务,解码能力的能力服务被调用时,调用电视机的显示器以实现图像播放子功能;通过音箱的播放音频SDK调度音箱的播放 音频能力的能力服务,播放音频的能力服务被调用时,调用音箱的扬声器以实现音频播放子功能。
本申请实施例中,在总线调度器上的能力信息包括能力描述(Action)和与能力对应的应用的标识的实现方式中,当子功能需要通过调度其他设备的能力来实现时,手机可以通过与该能力对应的标识,即应用的句柄,调用其他设备的对应应用,该应用在该设备上运行时调用该设备的硬件模块以实现对应子功能。例如,电视机安装有图库应用,手机要调度电视机的图库应用实现显示图片功能,则手机可通过总线调度器上存储的电视机上图库应用的句柄,调用电视机的图库应用,使的电视机上的图库应用运行,电视机上图库应用运行时调用显示图片的能力服务,显示图片的能力服务被调用时,调用电视机的显示器以实现图片显示功能。
可选的,在上述步骤执行之后,第一电子设备可以记录本次实现对应功能时,第一电子设备调度的设备,及使用该设备的具体能力。例如,以本次实现的功能是播放视频为例,手机记录的信息为:调度手机的解码能力,调度电视机的播放图像能力,调度音箱的播放音频能力。当用户再次触发使用其他电子设备该配合实现视频播放功能时,如果手机仍然与电视机和音箱处于同一局域网,则手机在接收到第一操作后,显示的第一界面中还包括一按键,该按键与情景对应,其中,情景指示的是手机上一次实现该功能时,手机调度的设备以及使用的该设备的具体能力。如,继续结合上述示例,该情景具体为调度手机的解码能力,调度电视机的播放图像能力,调度音箱的播放音频能力。当用户对该按键进行点击操作后,手机进行解码,调度电视机实现播放图像的功能,调度音箱实现播放音频的功能。
本申请实施例中可以互相调度,第一电子设备可以调度处于同一局域网中的其他电子设备的不同能力,使得多个设备功能配合实现第一电子设备的功能。由此,使得设备组中的电子设备发挥自己的“特长”,为用户带来更好的体验。
本申请另一些实施例提供了一种电子设备,该电子设备可以包括:存储器和一个或多个处理器。存储器和一个或多个处理器耦合。该存储器用于存储计算机程序代码,该计算机程序代码包括计算机指令。当一个或多个处理器执行计算机指令时,使电子设备可执行上述方法实施例中手机执行的各个功能或者步骤。该电子设备的结构可以参考图1所示的电子设备100的结构。
本申请另一些实施例提供一种显示装置,其特征在于,该装置可以应用于包括上述触摸屏的电子设备。该装置用于执行上述方法实施例中手机执行的各个功能或者步骤。
本申请实施例还提供一种计算机存储介质,该计算机存储介质包括计算机指令,当所述计算机指令在上述电子设备上运行时,使得该电子设备执行上述方法实施例中手机执行的各个功能或者步骤。
本申请实施例还提供一种计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行上述方法实施例中手机执行的各个功能或者步骤。
通过以上实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块, 以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (15)

  1. 一种设备能力调度方法,其特征在于,包括:
    第一电子设备显示第一功能的界面,所述第一功能包括第一子功能和第二子功能,所述第一子功能与所述第二子功能不同;
    所述第一电子设备检测到用户的第一操作;
    响应于所述第一操作,所述第一电子设备显示第一界面,所述第一界面包括:所述第一子功能的名称,所述第一子功能对应的第二电子设备的设备标识,所述第二子功能的名称,所述第二子功能对应的第三电子设备的设备标识;其中,所述第二电子设备、所述第三电子设备和所述第一电子设备处于同一局域网;
    所述第一电子设备检测到用户的第二操作;
    响应于所述第二操作,所述第一电子设备将所述第一子功能对应的数据发送到所述第二电子设备,以使所述第二电子设备执行所述第一子功能。
  2. 根据权利要求1所述方法,其特征在于,所述第一界面还包括,所述第二子功能对应的所述第一电子设备的设备标识;
    在所述第一电子设备显示第一界面之后,所述方法还包括:
    所述第一电子设备检测到用户对所述第一电子设备的设备标识的第三操作;
    响应于所述第三操作,所述第一电子设备执行所述第二子功能。
  3. 根据权利要求1或2所述的方法,其特征在于,所述第一界面还包括,与所述第二电子设备的设备标识对应的第一应用的标识和第二应用的标识,其中,所述第一应用和所述第二应用安装在所述第二电子设备中;
    所述第二操作,具体为:对所述第一应用的标识的第二操作;
    响应于所述第二操作,所述第一电子设备将所述第一应用的标识发送到所述第二电子设备,以使所述第二电子设备使用所述第一应用执行所述第一子功能。
  4. 根据权利要求1或2所述的方法,其特征在于,所述第二操作,具体为:对所述第二电子设备的设备标识的选中操作。
  5. 根据权利要求1-4中任一项所述的方法,其特征在于,所述第一电子设备存储有所述第一电子设备的能力信息;
    在所述第一电子设备显示第一界面之前,所述方法还包括:
    所述第一电子设备与所述第二电子设备建立无线保真Wi-Fi连接,所述第一电子设备与所述第三电子设备建立Wi-Fi连接;
    所述第一电子设备获取所述第二电子设备的能力信息和设备标识,并获取所述第三电子设备的能力信息和设备标识;
    所述第一电子设备根据所述第二电子设备的能力信息和所述第一子功能确定所述第一子功能对应所述第二电子设备,根据所述第三电子设备的能力信息和所述第二子功能确定所述第二子功能对应所述第三电子设备。
  6. 根据权利要求1-5中任一项所述的方法,其特征在于,
    所述第一功能为视频播放功能,所述第一子功能和所述第二子功能分别为播放图像,播放音频或解码中的一个;或,
    所述第一功能为视频通话功能,所述第一子功能和所述第二子功能分别为:显示 图像,播放音频,录音或拍摄图像中的一个。
  7. 根据权利要求1-6中任一项所述的方法,其特征在于,
    所述第一操作为用户对所述第一功能的界面上启动所述第一功能的第一按钮的点击操作;或,
    所述第一操作为用户对通知菜单栏中第二按钮的点击操作,其中,所述通知菜单栏叠加显示在所述第一功能的界面之上。
  8. 根据权利要求5所述的方法,其特征在于,所述能力信息还包括能力服务,不同子功能调用不同的能力服务来实现;
    所述第一电子设备将所述第一子功能对应的数据发送到所述第二电子设备,以使所述第二电子设备执行所述第一子功能,包括:
    所述第一电子设备调度所述第二电子设备的能力服务,将所述第一子功能对应的数据发送到所述第二电子设备,使所述第二电子设备根据所述第一子功能对应的数据运行所述能力服务,执行所述第一子功能;
    其中,所述第一电子设备的能力信息预先配置在所述第一电子设备中;或者,是根据所述第一电子设备所具备的硬件生成并存储的。
  9. 一种设备能力调度方法,其特征在于,包括:
    第二电子设备接收第一电子设备发送的请求执行第一子功能的消息;
    所述第二电子设备显示第二界面,所述第二界面包括:与所述第一子功能对应的第一应用的标识和第二应用的标识;
    所述第二电子设备接收用户对所述第一应用的标识的第三操作;
    响应于所述第三操作,所述第二电子设备调度所述第一应用执行所述第一子功能;
    其中,所述第一子功能为第一功能的一部分;
    所述第一功能为视频播放功能,所述第一子功能为播放图像,播放音频或解码中的一个;或者,
    所述第一功能为视频通话功能,所述第一子功能为:显示图像,播放音频,录音或拍摄图像中的一个。
  10. 一种电子设备,其特征在于,所述电子设备包括存储器和一个或多个处理器;所述存储器和所述一个或多个处理器耦合;所述存储器用于存储程序代码,当所述一个或多个处理器执行所述程序代码时,使所述电子设备执行如权利要求1-8中任一项所述的方法。
  11. 一种电子设备,其特征在于,所述电子设备包括存储器和一个或多个处理器;所述存储器和所述一个或多个处理器耦合;所述存储器用于存储程序代码,当所述一个或多个处理器执行所述程序代码时,使所述电子设备执行如权利要求9所述的方法。
  12. 一种计算机存储介质,其特征在于,包括程序代码,当所述程序代码在电子设备上运行时,使得所述电子设备执行如权利要求1-8中任一项所述的方法。
  13. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-8中任一项所述的方法。
  14. 一种计算机存储介质,其特征在于,包括程序代码,当所述程序代码在电子设备上运行时,使得所述电子设备执行如权利要求9所述的方法。
  15. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求9所述的方法。
PCT/CN2020/113626 2019-09-19 2020-09-04 一种设备能力调度方法及电子设备 WO2021052200A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2022517803A JP7369281B2 (ja) 2019-09-19 2020-09-04 デバイス能力スケジューリング方法および電子デバイス
EP20865462.4A EP4024837A4 (en) 2019-09-19 2020-09-04 DEVICE CAPACITY SCHEDULING METHOD AND ELECTRONIC DEVICE
US17/761,867 US20220368792A1 (en) 2019-09-19 2020-09-04 Device Capability Scheduling Method and Electronic Device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910887687.8A CN112615960B (zh) 2019-09-19 2019-09-19 一种设备能力调度方法及电子设备
CN201910887687.8 2019-09-19

Publications (1)

Publication Number Publication Date
WO2021052200A1 true WO2021052200A1 (zh) 2021-03-25

Family

ID=74883879

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/113626 WO2021052200A1 (zh) 2019-09-19 2020-09-04 一种设备能力调度方法及电子设备

Country Status (5)

Country Link
US (1) US20220368792A1 (zh)
EP (1) EP4024837A4 (zh)
JP (1) JP7369281B2 (zh)
CN (3) CN114844978A (zh)
WO (1) WO2021052200A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114356272A (zh) * 2022-03-17 2022-04-15 荣耀终端有限公司 一种数据传输方法及***
CN114629932A (zh) * 2020-12-10 2022-06-14 荣耀终端有限公司 电子设备间的协同方法及电子设备
WO2023045966A1 (zh) * 2021-09-23 2023-03-30 华为技术有限公司 能力共享方法、电子设备以及计算机可读存储介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115250261B (zh) * 2021-04-25 2024-06-04 华为技术有限公司 一种信息的显示方法及电子设备
CN116156044A (zh) * 2021-11-22 2023-05-23 华为技术有限公司 设备协同方法及相关装置
CN116932181A (zh) * 2022-03-30 2023-10-24 华为技术有限公司 一种能力调用方法、***及电子设备
CN117560792A (zh) * 2022-08-05 2024-02-13 荣耀终端有限公司 一种多设备协同方法、电子设备及相关产品

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150097848A1 (en) * 2013-10-08 2015-04-09 Ricoh Company, Ltd. Display apparatus, display system, and program
CN108289340A (zh) * 2016-09-29 2018-07-17 努比亚技术有限公司 一种无线保真投影的设备、***及方法
CN109168038A (zh) * 2018-10-11 2019-01-08 维沃移动通信有限公司 一种资源的处理方法、装置及设备
CN109327607A (zh) * 2018-09-03 2019-02-12 南京理工大学 一种基于智能手机移动授课***
CN110221798A (zh) * 2019-05-29 2019-09-10 华为技术有限公司 一种投屏方法、***及相关装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3730942B2 (ja) * 2002-08-02 2006-01-05 日本電信電話株式会社 ネットワーク動画像配信システム及びこのシステムにおけるクライアント装置
JP2006259839A (ja) * 2005-03-15 2006-09-28 Fujitsu Ltd 統合機能制御プログラム、統合機能制御装置、統合機能制御方法
KR101701859B1 (ko) * 2010-08-13 2017-02-02 엘지전자 주식회사 이동단말기, 디스플레이 장치 및 그 제어 방법
US8792429B2 (en) * 2010-12-14 2014-07-29 Microsoft Corporation Direct connection with side channel control
KR101757870B1 (ko) * 2010-12-16 2017-07-26 엘지전자 주식회사 이동 단말기 및 그 제어방법
US8537753B2 (en) * 2011-03-21 2013-09-17 Broadcom Corporation In-house location based services
KR101370352B1 (ko) * 2011-12-27 2014-03-25 삼성전자주식회사 방송수신용 디스플레이장치 및 신호처리모듈, 방송수신장치 및 방송수신방법
CN106354107A (zh) * 2016-08-26 2017-01-25 厦门印天电子科技有限公司 一种智慧教室控制***及其中控设备
CN107659712A (zh) * 2017-09-01 2018-02-02 咪咕视讯科技有限公司 一种投屏的方法、装置及存储介质
CN107835444B (zh) * 2017-11-16 2019-04-23 百度在线网络技术(北京)有限公司 信息交互方法、装置、音频终端及计算机可读存储介质
CN109660842B (zh) * 2018-11-14 2021-06-15 华为技术有限公司 一种播放多媒体数据的方法及电子设备
CN115379435A (zh) * 2019-08-10 2022-11-22 华为技术有限公司 一种设备能力发现方法及p2p设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150097848A1 (en) * 2013-10-08 2015-04-09 Ricoh Company, Ltd. Display apparatus, display system, and program
CN108289340A (zh) * 2016-09-29 2018-07-17 努比亚技术有限公司 一种无线保真投影的设备、***及方法
CN109327607A (zh) * 2018-09-03 2019-02-12 南京理工大学 一种基于智能手机移动授课***
CN109168038A (zh) * 2018-10-11 2019-01-08 维沃移动通信有限公司 一种资源的处理方法、装置及设备
CN110221798A (zh) * 2019-05-29 2019-09-10 华为技术有限公司 一种投屏方法、***及相关装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4024837A1

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114629932A (zh) * 2020-12-10 2022-06-14 荣耀终端有限公司 电子设备间的协同方法及电子设备
CN114629932B (zh) * 2020-12-10 2023-10-20 荣耀终端有限公司 电子设备间的协同方法、电子设备及存储介质
WO2023045966A1 (zh) * 2021-09-23 2023-03-30 华为技术有限公司 能力共享方法、电子设备以及计算机可读存储介质
CN114356272A (zh) * 2022-03-17 2022-04-15 荣耀终端有限公司 一种数据传输方法及***

Also Published As

Publication number Publication date
US20220368792A1 (en) 2022-11-17
EP4024837A4 (en) 2022-11-02
JP7369281B2 (ja) 2023-10-25
CN114844978A (zh) 2022-08-02
CN114844979A (zh) 2022-08-02
JP2022548734A (ja) 2022-11-21
CN112615960A (zh) 2021-04-06
CN112615960B (zh) 2022-04-12
EP4024837A1 (en) 2022-07-06

Similar Documents

Publication Publication Date Title
WO2021052200A1 (zh) 一种设备能力调度方法及电子设备
WO2021017889A1 (zh) 一种应用于电子设备的视频通话的显示方法及相关装置
WO2021213164A1 (zh) 应用界面交互方法、电子设备和计算机可读存储介质
WO2022257977A1 (zh) 电子设备的投屏方法和电子设备
WO2020119492A1 (zh) 消息处理方法及相关装置
EP4084486B1 (en) Cross-device content projection method, and electronic device
WO2021052204A1 (zh) 基于通讯录的设备发现方法、音视频通信方法及电子设备
WO2021052415A1 (zh) 资源调度方法及电子设备
WO2021253975A1 (zh) 应用程序的权限管理方法、装置和电子设备
CN116360725B (zh) 显示交互***、显示方法及设备
WO2022017474A1 (zh) 任务处理方法及相关装置
CN112130788A (zh) 一种内容分享方法及其装置
WO2020133006A1 (zh) 基于低功耗蓝牙的通信方法及相关装置
WO2023005900A1 (zh) 一种投屏方法、电子设备及***
CN114500732B (zh) 一种界面显示的方法和电子设备、存储介质
CN112437341B (zh) 一种视频流处理方法及电子设备
WO2022143310A1 (zh) 一种双路投屏的方法及电子设备
WO2022188511A1 (zh) 语音助手唤醒方法及装置
WO2022170854A1 (zh) 视频通话的方法与相关设备
WO2023093778A1 (zh) 一种截屏方法及相关装置
CN114647350B (zh) 应用共享方法、电子设备和存储介质
WO2024093703A1 (zh) 一种实例的管理方法、装置、电子设备及存储介质
CN114125738B (zh) 数据传输控制方法及相关装置
WO2024093614A1 (zh) 设备输入方法、***、电子设备及存储介质
WO2024078315A1 (zh) 一种应用控制方法、电子设备和***

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20865462

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022517803

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020865462

Country of ref document: EP

Effective date: 20220330