WO2022007678A1 - 一种打开文件的方法及设备 - Google Patents

一种打开文件的方法及设备 Download PDF

Info

Publication number
WO2022007678A1
WO2022007678A1 PCT/CN2021/103515 CN2021103515W WO2022007678A1 WO 2022007678 A1 WO2022007678 A1 WO 2022007678A1 CN 2021103515 W CN2021103515 W CN 2021103515W WO 2022007678 A1 WO2022007678 A1 WO 2022007678A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
mobile phone
software
user
interface
Prior art date
Application number
PCT/CN2021/103515
Other languages
English (en)
French (fr)
Inventor
唐国卿
李盛
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to JP2023501315A priority Critical patent/JP2023534182A/ja
Priority to US18/004,635 priority patent/US20230273902A1/en
Priority to EP21838439.4A priority patent/EP4167072A4/en
Publication of WO2022007678A1 publication Critical patent/WO2022007678A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/176Support for shared access to files; File sharing support
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1431Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/542Event management; Broadcasting; Multicasting; Notifications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/543User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • H04L65/401Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
    • H04L65/4015Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/54Indexing scheme relating to G06F9/54
    • G06F2209/545Gui
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user

Definitions

  • the present application relates to the field of communication technologies, and in particular, to a method and device for opening a file.
  • a multi-screen collaboration function (or, referred to as a multi-device collaboration function) is provided.
  • files on one device can be opened on another device.
  • the display interface of the mobile phone is displayed on the display screen of the PC, and the display interface of the mobile phone displayed on the PC can also be understood as a screen-casting interface.
  • the user operates on the screen projection interface of the PC. For example, if the user chooses to open file A, the PC can open file A. Or, the user operates on the mobile phone, for example, the user chooses to open file B, and similarly, the PC can open the file B, but the mobile phone does not open the file B.
  • a PC has a larger display screen area, and a user viewing the file on the PC can improve the user's viewing effect.
  • the result is to respond on one of the devices.
  • a mobile phone and a PC perform multi-screen collaboration
  • whether a user operates a mobile phone or a PC to open a file the result is that the file is opened on the PC, but not on the mobile phone.
  • the user actually wants to watch on the mobile phone it is impossible to achieve it according to the current method.
  • the user can only exit the multi-screen collaboration mode in order to open and watch the corresponding content on the mobile phone normally, and this process requires multiple steps. more complicated.
  • Embodiments of the present application provide a method and device for opening a file, which are used to simplify the process of opening a file.
  • a method for opening a file comprising: a first device and a second device enter a multi-screen collaboration mode in a preset manner; the first device displays a first interface and displays the first interface The screen is displayed on the second interface of the second device, the first interface includes at least one file icon, the second interface includes a first interface, and the file corresponding to the at least one file icon is stored in the first device.
  • the first device detects an operation acting on the file icon; the first device determines that the operation acts on the display screen of the first device or the display screen of the second device; when the operation acts on the display screen of the second device When the display screen of the first device is displayed, the first device calls the first application to open the file; when the operation acts on the display screen of the second device, the first device converts the file to the display screen. Metadata is sent to the second device, and the metadata of the file is used to open the file on the second device.
  • the method may be performed by a first device, such as a mobile device, such as a mobile phone, a tablet computer (PAD) or a portable computer, etc.; or, the first device may also be a device with a fixed position, such as a desktop computer with a relatively fixed position, etc. .
  • a mobile device such as a mobile phone, a tablet computer (PAD) or a portable computer, etc.
  • PAD tablet computer
  • portable computer etc.
  • the first device may also be a device with a fixed position, such as a desktop computer with a relatively fixed position, etc.
  • the first device projects a screen to the second device. If the current method is used, the user operates on the first device to open a corresponding file, and the file should be opened on the second device. However, in this embodiment of the present application, if the first device detects that the user's operation acts on the display screen of the first device, the first device can open the file locally, but will not open the file on the second device. If the user's operation acts on the display screen of the first device, it indicates that the user may be currently using the first device, and opening the file on the first device is obviously more convenient for the user to watch.
  • the file can be opened on the first device, the user does not need to exit the multi-screen collaboration mode, and naturally does not need to perform multiple steps, which simplifies the file opening process and reduces the number of device responses. , which helps reduce the power consumption of the device.
  • the first device determines that the user's operation acts on the display screen of the second device, the file can also be opened on the second device. That is, the method provided by the embodiment of the present application can determine the user's current focus according to the user's operation, so as to select a corresponding device to open the file, which is more conducive to the user's viewing and avoids the user's excessive operation steps.
  • the method further includes:
  • the first device receives an update file from the second device, where the update file is the updated first file
  • the first device updates the locally stored file with the update file.
  • the user can edit the file on the second device, for example, the user can modify the file.
  • the modified file may be stored on the second device, and the modified file is called, for example, an update file.
  • the second device can send the update file to the first device, and the first device can use the update file to update the original file stored by the first device, thereby realizing the update of the file.
  • the first device detects an operation acting on the file icon, including:
  • the first device receives event information from the second device, the event information is used to indicate the operation, and the event information includes an identification of the second device.
  • the first device can directly collect the user's operation, or in other words, the first device can capture the user's operation event. Therefore, if the first device can collect the user's operation, It can be determined that the operation acts on the display screen of the first device. However, if the user's operation acts on the display screen of the second device, the first device cannot directly collect the user's operation, but the second device can collect the user's operation. In other words, the second device can capture the user's operation event and obtain the Event information corresponding to the operation event, and the second device can send the event information to the first device.
  • the event information may indicate the operation, or in other words, the event information may describe the operation.
  • the event information may include an identifier of the second device to indicate that the operation corresponding to the event information acts on the second device.
  • the first device determines that the operation acts on the display screen of the second device, including:
  • the first device determines, according to the identifier of the second device, that the operation acts on the display screen of the second device.
  • the event information may include the identifier of the second device, so that the first device obtains the event information and can determine that the operation acts on the display screen of the second device.
  • the event information may further include information such as relative position coordinates of the operation in the first interface displayed by the second device, so that the first device can determine the file corresponding to the user's operation. In this way, the first device can determine the user's operating focus to select a device for opening the file.
  • the first device sends the metadata of the file to the second device, including:
  • the first device synchronizes (or sends) the metadata of the file to the distributed file management system of the second device through the distributed file management system of the first device.
  • a distributed file management system can be set in both the first device and the second device.
  • the distributed file management system can be used to manage files, and the distributed file management system can synchronize the files related to the first device and the second device through the distributed file management system. some information, so the first device can synchronize the metadata of the file through the distributed file management system.
  • the first device may also send the metadata of the file to the second device in other ways, which is not specifically limited.
  • the method before the first device invokes the first application to open the file, the method further includes:
  • the first device outputs prompt information, the prompt information includes one or more options, and the one or more options are used to determine a device that opens the file;
  • the first device detects an operation for selecting a first option of the one or more options, the first option corresponding to the first application.
  • the first device can still output prompt information for the user to choose which device to open the file on. If the file is opened on the first device, the file is opened on the first device according to the user's selection. In this way, the device for opening the file is more in line with the user's needs, and is more conducive to the user's viewing.
  • the first device When the operation acts on the display screen of the first device, the first device outputs prompt information, the prompt information includes one or more options, and the one or more options are used to determine to open the file device of;
  • the first device detects an operation for selecting a second option of the one or more options, the second option indicating opening of the file on the second device;
  • the first device sends metadata of the file to the second device, the metadata of the file being used to open the file on the second device.
  • the first device can still output prompt information for the user to choose which device to open the file on. If the user chooses to open the file on the second device, The file is then opened on the second device according to the user's selection. For example, sometimes the user is operating on the first device, but actually wants to display the corresponding file on the second device for other users to watch. The user can then choose to open it on a portable computer to complete the presentation process. It can be seen that the technical solutions provided by the embodiments of the present application provide the user with a selection opportunity, and it is more convenient for the user to select a suitable device to open the corresponding file.
  • the metadata of the file includes storage path information of the file in the first device.
  • the metadata of the file may include the storage path information of the file in the first device, so that after obtaining the metadata of the file, the second device can obtain the file from the first device according to the storage path information to store the file in the second device. Open the file locally.
  • the metadata of the file further includes one or more of the following: type information of the file, size information of the file, or name of the file.
  • the metadata of the file may also include other information, such as file type information, or file size information, etc., so that the second device can obtain more information about the file .
  • a second communication method includes: a first device and a second device enter a multi-screen collaboration mode in a preset manner; the first device displays a first interface and casts the first interface to a screen On the second interface of the second device, the first interface includes at least one file icon, the second interface includes the first interface, and the file corresponding to the at least one file icon is stored in the a first device; the first device detects an operation acting on the file icon; when the file icon is an icon displayed on the first interface of the first device, the first device calls The first application opens the file; when the file icon is an icon displayed on the second interface, the first device sends the metadata of the file to the second device, and the file's metadata is Metadata is used to open the file on the second device.
  • the method can be performed by a first device, such as a mobile device, such as a mobile phone, a tablet computer, or a portable computer; or, the first device can also be a device with a fixed location, such as a desktop computer with a relatively fixed location.
  • a mobile device such as a mobile phone, a tablet computer, or a portable computer
  • the first device can also be a device with a fixed location, such as a desktop computer with a relatively fixed location.
  • the method further includes:
  • the first device receives an update file from the second device, where the update file is the updated file
  • the first device updates the locally stored file with the update file.
  • the first device detects an operation acting on the file icon, including:
  • the first device receives event information from the second device, where the event information is used to indicate the operation, and the event information includes an identifier of the second device; or,
  • the first device detects event information generated by the operation on the first device.
  • the first device detects the event information generated by the operation on the first device
  • the first device detects the operation on the first device and obtains the event information corresponding to the operation, so it can be considered as the first device.
  • a device detects the event information generated by the operation on the first device; alternatively, it can also be understood that the first device detects the event information corresponding to the operation on the first device. That is, the former understanding is that the first device detects the operation and obtains event information, and the latter understanding is that the first device detects event information, and the event information corresponds to the operation.
  • the first device determines that the file icon is an icon displayed on the second interface, including:
  • the first device determines, according to the identifier of the second device, that the file icon is an icon displayed on the second interface.
  • the first device sends the metadata of the file to the second device, including:
  • the first device sends the metadata of the file to the distributed file management system of the second device through the distributed file management system of the first device.
  • the method before the first device invokes the first application to open the file, the method further includes:
  • the first device outputs prompt information, the prompt information includes one or more options, and the one or more options are used to determine a device that opens the file;
  • the first device detects an operation for selecting a first option of the one or more options, the first option corresponding to the first application.
  • the method further includes:
  • the first device When the file icon is an icon displayed on the first interface, the first device outputs prompt information, where the prompt information includes one or more options, and the one or more options are used to determine whether to open the file. equipment;
  • the first device detects an operation for selecting a second option of the one or more options, the second option indicating opening of the file on the second device;
  • the first device sends metadata of the file to the second device, the metadata of the file being used to open the file on the second device.
  • the metadata of the file includes storage path information of the file in the first device.
  • the metadata of the file further includes one or more of the following: type information of the file, size information of the file, or name of the file.
  • an electronic device in a third aspect, includes a display screen, one or more processors, a memory, and one or more programs. Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform the above-mentioned first aspect or The method provided by any possible implementation manner, or the electronic device is made to perform the method provided by the second aspect or any of the possible implementation manners.
  • an electronic device in a fourth aspect, includes a module/unit for executing the method provided in the first aspect or any possible implementation manner, or the electronic device includes a module/unit for executing the second A module/unit of the method provided by the aspect or any possible implementation manner.
  • a computer-readable storage medium is provided, the computer-readable storage medium is used to store a computer program, and when the computer program runs on a computer, the computer is made to execute the first aspect or any one of the above The method provided by the possible implementation manner, or causing the computer to execute the method provided by the second aspect or any one of the possible implementation manners.
  • a sixth aspect provides a computer program product comprising instructions, the computer program product is used to store a computer program, and when the computer program is run on a computer, the computer is made to execute the first aspect or any one of the above The method provided by the possible implementation manner, or causing the computer to execute the method provided by the second aspect or any one of the possible implementation manners.
  • a seventh aspect provides a communication system, the communication system includes the electronic device of the third aspect, or includes the electronic device of the fourth aspect.
  • the communication system further includes a second device, and the second device is the second device described in the first aspect or various implementation manners, or is the second aspect or various implementation manners the second device in the manner described.
  • the method provided by the embodiment of the present application can determine the user's current focus according to the user's operation, so as to select a corresponding device to open the file, which is more conducive to the user's viewing and avoids the user's excessive operation steps.
  • 1 is a schematic structural diagram of an electronic device
  • Fig. 2 is a schematic diagram of the process of opening a file in a multi-screen collaborative mode at present
  • 3A is a schematic diagram of a desktop of a mobile phone in an embodiment of the application.
  • 3B is a schematic diagram of a user touching a portable computer with a mobile phone in an embodiment of the application
  • 3C is a schematic diagram of displaying a mobile phone image on a portable computer after entering a multi-screen collaboration mode in an embodiment of the application;
  • 4A is a schematic diagram of a user performing a first operation on a screen projection interface 202 displayed on a portable computer in an embodiment of the present application;
  • 4B is a schematic diagram of opening the file 3 on the portable computer in the embodiment of the application.
  • 4C is another schematic diagram of opening the file 3 on the portable computer in the embodiment of the application.
  • 4D is another schematic diagram of opening the file 3 on the portable computer in the embodiment of the application.
  • 5A is a schematic diagram of a user performing a second operation on the mobile phone 100 in an embodiment of the present application
  • 5B is a schematic diagram of opening the file 3 on the mobile phone 100 in the embodiment of the application.
  • FIG. 6 is a schematic diagram of a process of opening a file in a multi-screen collaborative mode in an embodiment of the application
  • FIG. 7A is a schematic diagram of displaying prompt information on the mobile phone 100 according to an embodiment of the present application.
  • FIG. 7B is a schematic diagram of a user operating an option included in the prompt information in an embodiment of the present application.
  • FIG. 7C is another schematic diagram of displaying prompt information on the mobile phone 100 in the embodiment of the application.
  • 7D is another schematic diagram of a user operating an option included in the prompt information in an embodiment of the present application.
  • FIG. 8 is a flowchart of a first method for opening a file provided by an embodiment of the present application.
  • FIG. 9 is a flowchart of a second method for opening a file provided by an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • the application (application, app) involved in this application is a software program that can realize one or more specific functions.
  • multiple applications can be installed in an electronic device.
  • camera application SMS application, MMS application, image application, various mailbox applications, WeChat (WeChat), WhatsApp Messenger, Link (Line), photo sharing (instagram) or Kakao Talk, etc.
  • the application program mentioned below can be an application program installed when the electronic device leaves the factory, or it can be an application program downloaded from the network or obtained from other electronic devices by the user during the use of the electronic device (for example, sent by other electronic devices. s application).
  • the files involved in this application are, for example, multimedia files, such as image files, video files, or audio files; or, can also be text files, such as Microsoft (Microsoft) office files, such as word files, excel files, or powerpoint files. file, etc.; or, it can also be a picture file corresponding to a drawing application, such as a Microsoft office visio file or a photoshop file.
  • multimedia files such as image files, video files, or audio files
  • text files such as Microsoft (Microsoft) office files, such as word files, excel files, or powerpoint files. file, etc.
  • a picture file corresponding to a drawing application such as a Microsoft office visio file or a photoshop file.
  • “at least one” refers to one or more, and “multiple” refers to two or more.
  • “And/or”, describing the association relationship of associated objects, indicates that there can be three kinds of relationships, such as , A and/or B, can indicate: the existence of A alone, the existence of A and B at the same time, the existence of B alone, where A and B can be singular or plural.
  • the character “/” generally indicates that the associated object is a kind of "or ” relationship.
  • “At least one of the following items” or similar expressions refers to any combination of these items, including any combination of single item(s) or plural item(s).
  • a, b, or At least one item (piece) of c which can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
  • ordinal numbers such as “first” and “second” mentioned in the embodiments of the present application are used to distinguish multiple objects, and are not used to limit the size, content, order, and timing of multiple objects , priority or importance, etc.
  • the second file and the second file are only used to distinguish different files, but do not indicate the difference in size, content, priority, or importance of the two files.
  • the technical solutions provided in the present application can be applied in electronic devices, and the following describes electronic devices, graphical user interfaces (GUI) for such electronic devices, and embodiments for using such electronic devices.
  • the electronic device may be a portable electronic device, such as a mobile phone, a PAD, a portable computer, a wearable device with a wireless communication function (such as a smart watch, smart glasses, smart bracelet, or smart helmet, etc.), or in-vehicle equipment, etc.
  • portable electronic devices include, but are not limited to, carry-on Or portable electronic devices with other operating systems.
  • the above-mentioned electronic device may not be a portable device, for example, it may also be a desktop computer, such as a PC, capable of capturing images and running an image compression algorithm to compress the images.
  • FIG. 1 shows a schematic structural diagram of an electronic device 100 .
  • the illustrated electronic device 100 is only an example and that the electronic device 100 may have more or fewer components than those shown, two or more components may be combined, or may have different Parts configuration.
  • the various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
  • the electronic device 100 may include a processor 110 , an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , a power management module 141 , and a battery 142 , Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Interface 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, Camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • a processor 110 an external memory interface 120 , an internal memory 121 , a universal serial bus (USB) interface 130 , a charging management module 140 , a power management module 141 , and a battery 142 , Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receive
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be directly called from the memory, thereby avoiding repeated access, reducing the waiting time of the processor 110, and thus improving the efficiency of the system.
  • the processor 110 may execute the method for opening a file provided by the embodiment of the present application.
  • the embodiment of the present application provides housekeeper software
  • the housekeeper software may be a software module
  • the software module may run on the processor 110
  • the software module may be understood as a computer program.
  • the embodiment of the present application further provides screen projection software
  • the screen projection software may be a software module
  • the software module may run on the processor 110
  • the software module may be understood as a computer program.
  • the housekeeper software and the screen projection software may be the same software module, or the housekeeper software and the screen projection software may also be different software modules.
  • the housekeeper software may be software that runs independently, or may also be part of the system software; similarly, the screen projection software may be software that runs independently, or may also be part of the system software.
  • the processor 110 integrates different devices, such as integrating a CPU and a GPU, the CPU and the GPU can cooperate to execute the methods provided by the embodiments of the present application. For example, in the methods provided by the embodiments of the present application, some algorithms are executed by the CPU, and another part of the algorithms are executed by the GPU Execute for faster processing efficiency.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver ( universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface , and/or Universal Serial Bus (USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transceiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR).
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 .
  • the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 194 is used to display images, videos, and the like.
  • Display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light).
  • LED organic light-emitting diode
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.
  • the electronic device 100 can realize the shooting function, or realize the function of capturing images, through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.
  • the ISP is used to process the data fed back by the camera 193 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and so on.
  • Video codecs are used to compress or decompress digital video.
  • the electronic device 100 may support one or more video codecs.
  • the electronic device 100 can play or record videos of various encoding formats, such as: Moving Picture Experts Group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • MPEG Moving Picture Experts Group
  • MPEG2 moving picture experts group
  • MPEG3 MPEG4
  • MPEG4 Moving Picture Experts Group
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like.
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121, and/or instructions stored in a memory provided in the processor.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. Such as saving pictures, videos and other files in an external memory card.
  • the electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and an environmental sensor Light sensor 180L, bone conduction sensor 180M, etc.
  • the keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It can also be a touch key.
  • the electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 . Motor 191 can generate vibrating cues.
  • the indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.
  • the SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting into the SIM card interface 195 or pulling out from the SIM card interface 195 .
  • FIG. 1 do not constitute a specific limitation to the electronic device 100, and the mobile phone may also include more or less components than those shown in the figure, or combine some components, or disassemble some components, Or a different component arrangement.
  • the combination/connection relationship between the components in FIG. 1 can also be adjusted and modified.
  • the present application provides a first device and a second device.
  • the first device may be implemented as the electronic device 100, or may also be a chip or other functional component provided in the electronic device 100 (in this case, the first device may also be referred to as a first device), or the first device Other implementations are also possible.
  • the second device may be implemented as the electronic device 100, or may also be a chip or other functional components provided in the electronic device 100 (in this case, the second device may also be referred to as a second device), or the second device Other implementations are also possible.
  • one or more of the microphone 170C, the camera 193, the fingerprint sensor 180H, the touch sensor 180K, or the bone conduction sensor 180M shown in FIG. 1 can all collect user operations in this application.
  • the embodiments of the present application may also provide some peripheral input devices to collect user operations.
  • the electronic device 100 is connected to some peripheral input devices, and these peripheral input devices can collect user operations.
  • the peripheral input device includes, for example, a keyboard or a mouse.
  • the present application also provides a multi-screen collaboration system, and the multi-screen collaboration system may include a first device and a second device.
  • the multi-screen collaboration system may also include other devices, for example, three or more devices may also perform multi-screen collaboration.
  • the embodiments of the present application mainly take the multi-screen collaboration process between two devices as an example.
  • the result is a response on one of the devices.
  • a mobile phone and a PC perform multi-screen collaboration
  • the result is that the file is opened on the PC, but not on the mobile phone.
  • the user if the user actually wants to watch on the mobile phone, it is impossible to achieve it according to the current method.
  • the user can only exit the multi-screen collaboration mode in order to open and watch the corresponding content on the mobile phone normally, and this process requires multiple steps. more complicated.
  • FIG. 2 it is a schematic diagram of a process of opening a file in a multi-screen collaboration mode.
  • 1 in FIG. 2 indicates that the user clicks on the file displayed on the display screen of the mobile phone, and the mobile assistant (or called the mobile PC assistant) installed on the mobile phone obtains the user's click operation information and responds to the click.
  • 1 in FIG. 2 indicates that the user clicks on a file displayed in the screen-casting interface of the mobile phone on the display screen of the PC, and the PC Manager installed on the PC obtains the user's click operation information and responds to the click.
  • FIG. 2 in FIG. 2 indicates that the PC manager installed on the PC sends the obtained click operation information of the user to the mobile phone assistant.
  • 3 in Figure 2 indicates that the mobile phone will perform file opening and truncation processing. This is because, according to the normal process, if the mobile phone determines that the user has performed an operation for opening a file on the mobile phone, the mobile phone will respond to the operation and open the corresponding file. However, in the multi-screen collaborative mode, the file can only be opened by the PC, and the mobile phone will not open it. Therefore, the mobile phone needs to truncate the operation that originally needs to be performed to open the file.
  • FIG 4 in Figure 2 represents the path for the mobile phone to obtain the file.
  • the path of the file mentioned here refers to the absolute path of the file, that is, the storage path of the file in the mobile phone.
  • the mobile assistant will create a soft link in the distributed file management system (ming distributed file system, MDFS) in the mobile phone, the soft link points to a storage path, and the storage path is the file in the mobile phone.
  • the storage path for example, the storage path of the file in the secure digital memory card (SD) of the mobile phone or the uniform resource locator (URL) of the file, etc.
  • the soft link is also associated with the metadata of the file, and the metadata of the file includes, for example, the storage path of the file, and of course may also include other contents of the file, such as type information of the file.
  • FIG. 6 in FIG. 2 indicates that the distributed file management system on the mobile phone side synchronizes the metadata of the file to the distributed file management system on the PC side.
  • FIG. 7 in FIG. 2 represents the path for the mobile phone assistant to obtain the soft link created in the distributed file management system.
  • the mobile phone assistant sends the path of the soft link created in the distributed file management system on the mobile phone to the PC housekeeper.
  • the mobile phone assistant can also obtain the metadata of the file, such as type information of the file, etc., and the mobile phone assistant can also send the obtained metadata of the file to the PC housekeeper.
  • FIG. 2 takes the application being a Microsoft office application as an example, which is represented as an “office application” in FIG. 2 .
  • FIG. 2 indicates that the office application opens the soft link according to the path of the soft link.
  • FIG. 13 in FIG. 2 indicates that the distributed file management system on the mobile terminal reads the file actually pointed to by the soft link.
  • the distributed file management system on the mobile phone sends the read file to the distributed file management system on the PC, so that the office application on the PC can open the file.
  • the result is a response on one of the devices.
  • a mobile phone and a PC perform multi-screen collaboration
  • whether a user operates a mobile phone or a PC to open a file the result is that the file is opened on the PC, but not on the mobile phone.
  • the user actually wants to watch on the mobile phone it is impossible to achieve it according to the current method.
  • the user can only exit the multi-screen collaboration mode in order to open and watch the corresponding content on the mobile phone normally, and this process requires multiple steps. more complicated.
  • the device can determine the user's operation focus according to the user's operation, or determine which device the user wants to watch on, so as to select the corresponding device to respond according to the user's intention. In this way, the response result can be made to meet the needs of the user, and the use experience of the user can be improved.
  • the file can be opened on the mobile phone, or if the user operates on the PC to open a file, the file can be opened on the PC side , it can be seen that the user can open and watch the corresponding content on the mobile phone without exiting the multi-screen collaboration mode, which simplifies the user's operation process, and the device does not need to respond multiple times, which helps to save the power consumption of the device.
  • the first device and the second device need to perform multi-screen collaboration.
  • the first device is a mobile phone and the second device is a portable computer.
  • the structure of the mobile phone is, for example, the structure shown in FIG. 1 .
  • the electronic device 100 may also be referred to as a mobile phone 100 .
  • the first device needs to realize the multi-screen collaboration function, for example, it can be realized through the first housekeeper software installed in the first device, and the second device needs to realize multi-screen collaboration, which can be realized through the second housekeeper software installed in the second device. accomplish.
  • the first housekeeper software may be a software module running independently in the first device, or may also be a part of the system software of the first device.
  • the second housekeeper software may be a software module running independently in the second device, or may also be a part of the system software of the second device.
  • the "screen projection software” may also have other names, for example, it may also be called a "screen projection application (APP)” or the like.
  • APP screen projection application
  • the first housekeeper software may also be called a mobile phone assistant or the like.
  • the housekeeper software can also be called other names.
  • the word "housekeeper” itself has no specific meaning, which does not mean that the housekeeper software must manage other software in the device where the housekeeper software is located.
  • a software module and an application may be of the same concept.
  • a mobile phone assistant is a software module and an application. Therefore, "software” can also be replaced by "application (APP)", for example “Housekeeper software” can also be called “housekeeper application”, and "screencasting software”, which can also be called “screencasting application”.
  • an application may include one or more software modules, but a software module cannot be considered an application itself.
  • the housekeeper software is a software module, but not an independent application.
  • the housekeeper software is a software module set in a corresponding application (such as a housekeeper application), or it can also be a software module set in the system software;
  • the screen-casting software is a software module, but not an independent application.
  • the screen-casting software is a software module set in a corresponding application (such as a screen-casting application), or it can also be a software module set in the system software.
  • “application” refers to what the user can call intuitively. For example, icons such as "SMS” and "Application Market" displayed on the display interface of the mobile phone represent corresponding applications.
  • SMS Simple Object Access
  • Application Market displayed on the display interface of the mobile phone
  • FIG. 3A shows a GUI of the mobile phone 100, which is the desktop 201 of the mobile phone.
  • the user wants the mobile phone 100 and the portable computer to perform multi-screen collaboration, the user needs to make both the mobile phone 100 and the portable computer enter the multi-screen collaboration mode.
  • a preset mode may be used, and the preset mode may include multiple operation modes.
  • the user can hold the mobile phone 100 and touch the portable computer, for example, touch the NFC area of the portable computer, then the mobile phone 100 and the portable computer can establish an NFC connection, and both the mobile phone 100 and the portable computer enter the multi-screen collaboration mode,
  • the default method is the "touch" method.
  • 3B mainly illustrates the process of touching the mobile phone 100 with the portable computer, so the display interface of the mobile phone 100 is not drawn in detail.
  • the user can turn on the Bluetooth function of the mobile phone 100 and the portable computer. For example, after the mobile phone 100 turns on the Bluetooth function, it will scan the surrounding Bluetooth devices. If the portable computer is scanned, the mobile phone 100 and the portable computer can establish a Bluetooth connection, and the mobile phone 100 and the All the portable computers enter the multi-screen collaboration mode, and the default mode is the way in which the user turns on the Bluetooth function, or the way in which the mobile phone 100 scans the portable computer. That is, the user only needs to perform one operation (the operation of turning on the Bluetooth function) to not only establish a connection between the two devices, but also make the two devices enter the multi-screen collaboration mode. Alternatively, the user enables the Bluetooth function of the mobile phone 100 and the portable computer.
  • the mobile phone 100 scans the surrounding Bluetooth devices after the Bluetooth function is enabled. If the portable computer is scanned, the mobile phone 100 and the portable computer can establish a Bluetooth connection. After the mobile phone 100 and the portable computer establish a Bluetooth connection, the user performs corresponding operations, so that the mobile phone 100 and the portable computer enter the multi-screen collaboration mode.
  • the portable computer is installed with the second screen projection software, and the mobile phone 100 is installed with the first screen projection software.
  • the operation performed by the user is, for example, the operation of using the first screen projection software to scan the QR code provided by the second screen projection software. When the user performs this operation, it is regarded as the default mode. That is, the user needs to perform at least two operations to establish a connection between the two devices and enter the multi-screen collaboration mode, respectively.
  • the mobile phone 100 and the portable computer can also establish a connection through Wi-Fi or other methods, and enter a multi-screen collaboration mode.
  • the portable computer is installed with the second screen projection software
  • the mobile phone 100 is installed with the first screen projection software.
  • the first screen projection software and the second screen projection software may be two different screen projection software, or may be the same type of screen projection software. software, just installed on a different device.
  • the first screen projection software may be a software module running independently in the mobile phone 100 , or may also be a part of the system software of the mobile phone 100 .
  • the second screen projection software may be a software module running independently in the portable computer, or may also be a part of the system software of the portable computer.
  • the "screen-casting software" may also have other names, for example, it may be called a "screen-casting application" and the like.
  • the screencasting software and the housekeeper software may be the same software module, for example, the first screencasting software and the first housekeeper software may be the same software module, and the second screencasting software and the second housekeeper software may be the same software module; or, The screencasting software and the housekeeper software may be different software modules.
  • the first screencasting software and the first housekeeper software may be different software modules
  • the second screencasting software and the second housekeeper software may be different software modules.
  • the first screen projection software is a part of the system software of the mobile phone 100, and the first housekeeper software is a software module that runs independently in the mobile phone 100 and does not belong to the system software
  • the first screen projection software and the first housekeeper software are Different software modules; for another example, the first screen projection software and the first housekeeper software are both software modules that run independently in the mobile phone 100, but the two are different software modules, and it is also considered that the first screen projection software and the first housekeeper Software is different software modules, etc.
  • the user can open the second screen projection software on the portable computer, and also open the first screen projection software on the mobile phone 100.
  • the second screen projection software on the portable computer can provide a two-dimensional code.
  • the first screen projection software of the portable computer scans the two-dimensional code provided by the second screen projection software of the portable computer, so that the mobile phone 100 and the portable computer can establish a connection and enter the multi-screen collaboration mode, or the user can use the first screen projection on the mobile phone 100.
  • the operation of the software scanning the QR code provided by the second screen projection software of the portable computer is only used for two devices to enter the multi-screen collaboration mode, and the two devices have established a connection before, such as a Bluetooth connection or Wi- Fi connection, etc.
  • the user can log in to the same account on the second screen mirroring software of the portable computer and the first screen mirroring software of the mobile phone 100 , for example, enter the same account on the second screen mirroring software of the portable computer and the first screen mirroring software of the mobile phone 100 .
  • account number and password so that the mobile phone 100 and the portable computer can establish a connection and enter the multi-screen collaboration mode without scanning the QR code.
  • the operation method of entering the same account number and password on the screen software is not limited to the same account on the second screen mirroring software of the portable computer and the first screen mirroring software of the mobile phone 100 .
  • the operation of the user entering the same account number and password on the second screen projection software of the portable computer and the first screen projection software of the mobile phone 100 is only used for the two devices to enter the multi-screen collaboration mode, and the two devices before this A connection has been established, such as a Bluetooth connection or a Wi-Fi connection, etc.
  • the first housekeeper software can capture the operation performed by the user on the first screen projection software, and the first housekeeper software can software) to the first screen projection software; similarly, if the portable computer is installed with the second screen projection software, the second housekeeper software can capture the operations performed by the user on the second screen projection software, and the second housekeeper software
  • the instruction from the mobile phone 100 (or, in other words, from the first housekeeper software) can be sent to the second screen projection software.
  • the user can also make both the mobile phone 100 and the portable computer enter the multi-screen collaboration mode by other means, and the specific means is not limited.
  • the current display interface 202 of the mobile phone 100 will be displayed on the display screen of the portable computer.
  • the screen interface 202 is a mirror image of the display interface of the mobile phone 100
  • the screen projection interface 202 displayed on the portable computer is of the same origin as the display interface of the mobile phone 100 , that is, both originate from the mobile phone 100 .
  • the mobile phone 100 sends the information of the display interface of the mobile phone to the portable computer, so that the portable computer can display the screen projection interface 202 in the same proportion as the display screen of the mobile phone 100 .
  • the user can also perform operations such as zooming in or out on the screen-casting interface 202 to change the area of the screen-casting interface 202, or the user can also perform operations such as dragging and dropping on the screen-casting interface 202 to Change the position of the screen projection interface 202 on the display screen of the portable computer.
  • the user can choose to watch the content on the mobile phone on the side of the portable computer. It brings a better viewing experience to the user; alternatively, the user can also choose to watch the content on the mobile phone on the mobile phone side, and the mobile phone is more portable and can meet the user's demand for viewing at any time.
  • the following describes how to select a device for viewing.
  • the user performs a first operation on the screen projection interface 202 displayed on the portable computer.
  • the first operation is, for example, a touch operation.
  • the first operation is that the user touches "File 3" on the screen projection interface 202 with a finger. ” action on the file icon, which indicates that the user wants to open file 3.
  • the touch sensor on the display screen of the portable computer can collect (or capture) the event information of the first operation, or in other words, the touch sensor on the display screen of the portable computer can capture the first operation of the user, and obtain the corresponding first operation. Event information, which may indicate the first operation.
  • the touch sensor can send the collected event information of the first operation to the second housekeeper software.
  • the event information of the first operation includes, for example, the identifier of the portable computer, and optionally, the location information of the first operation and the like.
  • the position information of the first operation is, for example, the relative position information of the first operation in the screen projection interface 202. In this way, even if the position of the screen projection interface 202 on the display screen of the portable computer is different, the relative position information of the first operation is different. changing.
  • the file corresponding to the first operation can be determined.
  • the first operation may also be a voice control operation, a gesture operation, or other operations such as pressing on the display screen of the portable computer, and the sensors in the portable computer that collect the first operation will also be different.
  • This embodiment of the present application does not limit the type of the first operation.
  • the second housekeeper software sends the event information of the first operation to the first housekeeper software, and the sending method depends on the connection method between the mobile phone 100 and the portable computer, such as NFC or Bluetooth or Wi-Fi or mobile network.
  • the first housekeeper software determines that the event information of the first operation corresponds to the portable computer, that is, determines that the first operation is The operation performed on the portable computer, or in other words, it is determined that the file icon (for example, the file icon "File 3") corresponding to the first operation is located on the display interface of the portable computer. Then, the first housekeeper software can determine the storage path of the file corresponding to the first operation.
  • the first housekeeper software can determine the storage path of the file according to the screen-casting interface.
  • the area conversion ratio between 202 and the display screen 194 of the mobile phone 100, and the relative position information of the first operation can determine the file corresponding to the first operation, such as file 3, so that the first housekeeper software can determine the storage path of file 3 .
  • the first housekeeper software can create a soft link corresponding to the file in the distributed file management system of the mobile phone 100, and the soft link points to the storage path of the file, for example, the soft link points to the storage path of the file in the SD card of the mobile phone or The URL of the file, etc.
  • the soft link is also associated with the metadata of the file.
  • the distributed file management system on the mobile phone 100 side can synchronize the metadata of the file corresponding to the first operation to the distributed file management system on the portable computer side.
  • the metadata of a file can also be called the description information of the file, etc.
  • the metadata of a file includes, for example, the storage path of the file. In addition, optionally, it can also include one or more of the following: The name of the file, the type information of the file, or, the size information of the file.
  • the metadata of a file may include the storage path information of the file; alternatively, the metadata of a file may include the type information of the file and the storage path information of the file; or, the metadata of a file may include the storage path information of the file Size information, the name of the file, the storage path information for the file, and so on.
  • the storage path indicated by the storage path information of a file may refer to the storage path of the file in the mobile phone 100 . In the above example, if the file corresponding to the first operation is file 3, the distributed file management system on the mobile phone 100 can synchronize the metadata of file 3 to the distributed file management system on the portable computer.
  • the first housekeeper software can obtain the path of the soft link created in the distributed file management system of the mobile phone 100, and the first housekeeper software can send the path of the soft link to the second housekeeper software.
  • the first housekeeper software can also obtain the metadata of the file, such as type information of the file, etc., and the first housekeeper software can also send the obtained metadata of the file to the second housekeeper software.
  • the second housekeeper software determines and invokes an application that can open the file according to the type information of the file. For example, the second housekeeper software determines that the second application can open the file.
  • the "second application” may also be called “second software”; or, if "software” and “application” are not If the concepts of the same level cannot be interchanged, it may be considered that one or more software modules are set in the second application.
  • the type information of file 3 indicates that the type of file 3 is an image type
  • the second housekeeper software can determine that the image application can open file 3
  • the type information of file 3 indicates that the type of file 3 is a Microsoft Word document
  • the first The second housekeeper software can determine that the Microsoft office word application can open the file3.
  • the second housekeeper software also sends the path of the soft link to the second application.
  • the second application opens the soft link according to the path of the soft link.
  • the distributed file management system on the portable computer side can obtain the file 3 from the mobile phone 100 according to the metadata corresponding to the soft link, which can be understood as obtaining the data of the file 3 from the mobile phone 100 .
  • the distributed file management system on the portable computer side can acquire the file 3 from the mobile phone 100 according to the storage path information of the file 3 included in the metadata corresponding to the soft link.
  • the second application can open the file 3 .
  • FIG. 4B it is a schematic diagram of file 3 opened on the portable computer.
  • the interface 203 in FIG. 4B represents the interface of file 3 opened on the portable computer.
  • the user can adjust the size of the interface 203.
  • the interface 203 and the screen projection interface 202 can be displayed together.
  • the interface 203 may also cover the screen projection interface 202, as shown in FIG. 4C .
  • the user can set the screen projection interface 202 to "always display on the topmost layer", and part or all of the screen projection interface 202 may also be located in the interface 203, as shown in FIG. 4D .
  • the portable computer can also store the data of the file 3 in the portable computer, for example, the portable computer can store the data of the file 3 in the local file system of the portable computer through the second application, for example, it can be stored as a temporary file.
  • the user can view the file 3 through the second application on the portable computer, and the user can also edit the file 3 through the second application on the portable computer, for example, the content can be deleted, added or modified in the file 3.
  • the file 3 can be saved, and the portable computer can update the stored data of the file 3 to obtain the updated data of the file 3.
  • the updated data of the file 3 can be understood as the updated file 3, which is equivalent to that the portable computer overwrites the original data of the file 3 stored in the portable computer with the updated data of the file 3.
  • the portable computer can send the updated data of the file 3 to the mobile phone 100.
  • the portable computer can synchronize the second file to the distributed file management system of the mobile phone 100 through the distributed file management system of the portable computer, then the mobile phone 100 can use the file 3
  • the updated data overwrites the original data of the file 3 stored in the local file system of the mobile phone 100, thus realizing the update of the file 3.
  • the portable computer can send the update data of file 3 to the mobile phone 100 every time the user updates the file 3, so that the file 3 can be updated in time on the mobile phone side;
  • the update data of the file 3 is sent to the mobile phone 100, so as to reduce the number of times of sending the update data and save the transmission overhead.
  • the portable computer can delete the stored updated data of the file 3, for example, can delete the temporary file to release the storage space.
  • the user after entering the multi-screen collaboration mode, the user operates on the portable computer.
  • the user may continue to operate on the mobile phone 100 .
  • the user may be in a moving state, and it is more convenient to watch the mobile phone 100 during the moving process, or the user is far away from the portable computer, and it is more convenient for the user to watch the mobile phone 100 nearby.
  • the following describes how the device responds when the user operates on the phone.
  • the user performs a second operation on the mobile phone 100 (or may also be referred to as a first operation).
  • the second operation is, for example, a touch operation.
  • the second operation is that the user touches the display interface of the mobile phone with a finger.
  • the "File 3" action on the file icon indicates that the user wants to open file 3.
  • the touch sensor 180K on the display screen 194 of the mobile phone 100 can collect (or detect) the event information of the second operation, or in other words, the touch sensor 180K on the display screen 194 of the mobile phone 100 can capture the second operation and obtain the second operation
  • the event information of the second operation may indicate the second operation.
  • the touch sensor 180K may send the collected event information of the second operation to the first housekeeper software.
  • the event information of the second operation includes, for example, the identifier of the mobile phone 100, and optionally, the location information of the second operation and the like.
  • the position information of the second operation is, for example, the absolute position information of the second operation in the display screen 194 .
  • the first housekeeper software After the first housekeeper software obtains the event information of the second operation, since the event information of the second operation includes the identification of the mobile phone 100, such as from the touch sensor 180K, the first housekeeper software can determine that the event information of the second operation corresponds to the mobile phone 100, That is, it is determined that the second operation is an operation performed on the mobile phone 100 , or in other words, it is determined that the file icon corresponding to the second operation (for example, the file icon “File 3 ”) is located on the display interface of the mobile phone 100 .
  • the first housekeeper software can determine the file corresponding to the second operation, such as file 3, according to the location information of the second operation, and the first housekeeper software can then determine the application that can open file 3 according to the type of file 3, such as the first application .
  • the “first application” may also be referred to as “the first software”; or, if "software” and “application” are not If the concepts of the same level cannot be interchanged, it may be considered that one or more software modules are set in the first application.
  • the second application mentioned above and the first application here may be the same application, for example, both are Microsoft office word applications, just because they are installed in different devices, so the names are different; or, the first application and the second application
  • the applications may also be different applications, for example, the first application is a Microsoft office word application, and the second application is a WPS office word application, but both the first application and the second application can open files of the same type.
  • the first housekeeper software can open the file 3 stored in the local file system of the mobile phone 100 on the mobile phone 100 through the first application.
  • FIG. 5B it is a schematic diagram of opening the file 3 on the mobile phone 100.
  • the interface 204 in FIG. 5B That is, it represents the interface of the file 3 opened on the display screen 194 of the mobile phone 100 .
  • the user can resize the interface 204.
  • the file 3 is opened on the mobile phone 100, but the file 3 will not be opened on the portable computer.
  • the user can view the file 3 through the first application on the mobile phone 100 , and the user can also edit the file 3 through the first application on the mobile phone 100 , such as deleting, adding or modifying content in the file 3 .
  • the file 3 can be saved, and the mobile phone 100 can update the data of the file 3 stored in the local file system of the mobile phone 100.
  • FIG. 6 it is a schematic diagram of a process of opening a file in a multi-screen collaboration mode after using the method provided by the above embodiments of the present application.
  • 1 in FIG. 6 indicates that the user clicks on a file displayed on the display interface of the mobile phone 100, and the first housekeeper software (for example, the mobile phone assistant in FIG. 6) installed on the mobile phone 100 obtains the user's click operation information and responds to the click.
  • 1 in Fig. 6 indicates that the user clicks the file displayed in the screen-casting interface 202 of the mobile phone on the display screen of the portable computer, and the second housekeeper software (for example, PC housekeeper in Fig. 6 ) installed on the portable computer obtains the user's Click action information, and click response.
  • the first housekeeper software may determine the user's focus according to the parameters of the click response. For example, if it is the click operation information sent by the second housekeeper software, the first housekeeper software can set the value of the parameter of the click response to the first value when it responds to the click, and if it is the sensor ( For example, the click operation information sent by the touch sensor 180K, etc.), the first housekeeper software may set the value of the parameter of the click response to the second value when performing the click response. In this way, when the first butler software performs focus judgment, it can determine which device the user's operation is aimed at according to different values of the parameters of the click operation, or can determine which device the user's operation focus is on.
  • the first housekeeper software may perform file opening and truncation processing. This is because the user's operation focus is on the portable computer, so the file needs to be opened on the portable computer, and the file is not opened on the mobile phone 100, so the mobile phone 100 needs to truncate the original operation to open the file.
  • the path of the file mentioned here refers to the absolute path of the file, that is, the storage path of the file in the mobile phone 100 .
  • the first housekeeper software will create a soft link in the distributed file management system in the mobile phone, the soft link points to the first storage path, and the first storage path is the storage path of the file in the mobile phone, for example The storage path of the file in the SD of the mobile phone or the URL of the file, etc.
  • the soft link is also associated with the metadata of the file, and the metadata of the file includes, for example, the storage path of the file, and optionally, the type information of the file and the like.
  • FIG. 7 in FIG. 6 indicates that the distributed file management system on the mobile phone 100 side synchronizes the metadata of the file to the distributed file management system on the portable computer side.
  • FIG. 6 represents the path for the first housekeeper software to obtain the soft link created in the distributed file management system on the mobile phone 100 end.
  • the first housekeeper software sends the path of this soft link created in the distributed file management system of the mobile phone 100 end to the second housekeeper software.
  • the first housekeeper software can also obtain the metadata of the file, such as type information of the file, etc., and the first housekeeper software can also send the obtained metadata of the file to the second housekeeper software.
  • FIG. 6 10 and 11 in FIG. 6 indicate that the second housekeeper software calls the application that can open the file according to the type information of the file, etc.
  • the second housekeeper software also sends the path of the soft link to the application.
  • Figure 6 takes the application as an example of a Microsoft office application.
  • 13 in FIG. 6 indicates that the distributed file management system on the portable computer side requests the distributed file management system on the mobile phone 100 to obtain the corresponding metadata according to the soft link (for example, according to the storage path of the file included in the metadata).
  • the soft link for example, according to the storage path of the file included in the metadata.
  • the distributed file management system on the mobile phone 100 reads the file actually pointed to by the soft link.
  • the distributed file management system on the mobile phone 100 reads the file from the local file system of the mobile phone 100 .
  • the distributed file management system on the mobile phone 100 side also sends the read file to the distributed file management system on the portable computer side, so that the office application on the portable computer side can open the file.
  • the portable computer can also store the data of the file 3 in the portable computer.
  • the portable computer can store the data of the file 3 in the local file system of the portable computer through the second application, for example, it can be stored as a temporary file.
  • the file 3 can be modified, deleted or added through the second application on the portable computer, so that the temporary file stored in the local file system of the portable computer can be updated.
  • the portable computer can send the updated file to the mobile phone 100, so that the mobile phone 100 can update the original file stored in the local file system of the mobile phone 100 according to the updated file.
  • 5 to 14 in FIG. 6 all describe the operations of opening a file on a portable computer.
  • the mobile phone 100 can call an application that can open the file, such as the first application, and then refer to 15 in FIG. 100 of the storage path in the local file system to open the file.
  • the operation is performed on the first device and the operation is performed in the collaborative window (for example, the screen-casting interface 202 ) mirrored by the first device to the second device,
  • the collaborative window for example, the screen-casting interface 202
  • the first device can intelligently select one of the devices to open-edit- By saving the corresponding files, users can complete office needs without leaving or switching the currently focused screen, so as to give users a better preview and editing experience.
  • the mobile phone 100 will open the corresponding file.
  • a method will be introduced. In this method, if the user performs an operation on the mobile phone 100, the mobile phone 100 can provide the user with options, and the user can choose whether to open the corresponding file on the mobile phone 100 or on the portable computer. corresponding file. In this way, the device that finally opens the file is more in line with the needs of the user.
  • the user performs a second operation on the mobile phone 100.
  • the second operation is, for example, a touch operation, and the second operation is used to open the first file.
  • the second operation is that the user touches the file icon "file 3" on the display interface of the mobile phone with a finger, which indicates that the user wants to open file 3.
  • the touch sensor 180K on the display screen 194 of the mobile phone 100 can capture the second operation and obtain event information of the second operation, and the touch sensor 180K can send the event information of the second operation to the first housekeeper software.
  • the event information of the second operation includes, for example, the identifier of the mobile phone 100, and optionally, the location information of the second operation and the like.
  • the position information of the second operation is, for example, the absolute position information of the second operation in the display screen 194 .
  • touch operations involved in this document may be replaced by hover operations, voice commands, and the like.
  • the touch operation is used as an example for description herein, but this does not constitute a limitation on the embodiments of the present application.
  • the first housekeeper software After the first housekeeper software obtains the event information of the second operation, since the event information of the second operation includes the identification of the mobile phone 100, the first housekeeper software can determine that the event information of the second operation corresponds to the mobile phone 100, that is, the second operation is determined. It is an operation that occurs on the mobile phone 100 , or in other words, it is determined that the file icon corresponding to the second operation (for example, the file icon “file 3 ”) is located on the display interface of the mobile phone 100 . Then, the first housekeeper software can output prompt information 205 through the display screen 194 , the prompt information 205 can include one or more options, and the prompt information 205 can be used to determine the device for opening the file 3 . For example, reference may be made to FIG.
  • the prompt information 205 includes four options as an example, one of which is "computer application”, which means to open file 3 on a collaborative device (such as a portable computer), and the remaining three options are "1", "" 2" and "3" represent application 1, application 2, and application 3, respectively. These three applications are all applications on the mobile phone 100 and are also applications that can open file 3.
  • the mobile phone 100 may have one or more applications that can open the first file. If there is only one application on the mobile phone 100 that can open the first file, the prompt message 205 only displays another option besides the option of “application on the computer”.
  • the prompt information 205 can display options corresponding to all applications that can open the first file or some applications in addition to displaying the option of "application on the computer” corresponding options. If the user selects "computer application”, it indicates that the user chooses to open the first file on the collaborative device, and if the user selects any application other than "computer application”, it indicates that the user chooses to open the first file on the mobile phone 100 Open the first file through the application.
  • the user touches the option “computer application” included in the prompt information 205 with his finger, which indicates that the user selects “computer application”, then the distributed file management system on the mobile phone 100 can perform the first operation.
  • the metadata of the corresponding first file is synchronized to the distributed file management system on the portable computer side.
  • the metadata of the file please refer to the previous introduction.
  • the operation process after the portable computer obtains the metadata of the first file reference may also be made to the foregoing description of the process of opening the file 3 on the portable computer.
  • the prompt information 205 output by the mobile phone 100 may not include specific options on the portable computer, that is, the user cannot select specific applications on the portable computer according to the prompt information 205 output by the mobile phone 100 .
  • the user wants to open on the portable computer he can select the option of “computer application”, and the option itself only corresponds to the portable computer, and does not correspond to the specific application on the portable computer.
  • the portable computer selects a corresponding application according to the type of the first file to open the first file.
  • the prompt information 205 output by the mobile phone 100 may also include options on the portable computer.
  • FIG. 7C is a schematic diagram of another prompt message 205 displayed on the display screen 194 of the mobile phone 100 .
  • the prompt information 205 includes five options as an example, and the five options are “1", “2", “3", “4" and "5", respectively representing application 1, application 2, application 3, application 4 and application 5.
  • application 4 and application 5 are applications on the portable computer, and they are also applications that can open file 3, which means that file 3 is opened on a collaborative device (such as a portable computer); application 1, application 2 and application 3 are all mobile phones.
  • the applications on 100 are also applications that can open file 3.
  • FIG. 7C is a schematic diagram of another prompt message 205 displayed on the display screen 194 of the mobile phone 100 .
  • the prompt information 205 includes five options as an example, and the five options are “1", “2", “3", “4" and "5", respectively representing application 1, application 2, application 3, application 4 and application 5.
  • application 4 and application 5 are applications on the portable computer, and they are also applications that can open file 3, which means that file 3 is
  • the display fonts of "4" and "5" are larger and thicker, indicating that application 4 and application 5 are applications on the portable computer, or other prompts can also be used to indicate that the corresponding applications are on the portable computer.
  • application for example, it can display prompt text, etc. In this way, the user can choose which application is used to open the first file on the portable computer, so that the user's viewing experience is better.
  • the user touches the option "1" with his finger, which indicates that the user has selected to open the first file on the mobile phone 100 through the application 1 corresponding to "1"
  • the first housekeeper software can call “1" 1" corresponding to application 1 to open file 3.
  • the technical solutions provided by the embodiments of the present application provide the user with a selection opportunity, and it is more convenient for the user to select a suitable device to open the corresponding file.
  • the collaboration window displayed on the second device is a mirror image of the display interface of the first device. Therefore, according to the existing method, whether the user operates in the collaboration window of the first device or the second device, the operation The processes are all of the same origin, and in the end, they will all actually respond to the user's operation on the second device.
  • the embodiment of the present application is implemented through technology, which breaks the barrier of "same origin".
  • the first device will add a judgment mechanism. For the same file, if the user operates on different devices, it may be processed through different devices. device to open the file, thereby generating a differentiated experience that is different from the current technology, which can give users a better experience.
  • the user does not need to open the corresponding file on the first device after exiting the multi-screen collaboration mode, which simplifies the user's operation steps, reduces the response process of the device, and helps save the power consumption of the device.
  • the embodiments of the present application provide a first method for opening a file, which can be applied to a multi-screen collaboration scenario.
  • the method involves a first device and a second device, and reference may be made to FIG. 1 for the structure of the first device. Please refer to FIG. 8 below to introduce the flow of the method.
  • the first device is a mobile phone 100 and the second device is a portable computer as an example.
  • the mobile phone 100 and the portable computer enter the multi-screen collaboration mode in a preset manner. For example, as long as the connection between the mobile phone 100 and the portable computer is established, the multi-screen collaboration mode will be entered. Then, S801 may also be replaced by the connection between the mobile phone 100 and the portable computer. Alternatively, the mobile phone 100 and the portable computer need to establish a connection first, and then the user performs corresponding operations to make the mobile phone 100 and the portable computer enter the multi-screen collaboration mode.
  • the mobile phone 100 and the portable computer may enter the multi-screen collaboration mode.
  • the user can hold the mobile phone 100 and touch the portable computer, and the two can establish an NFC connection and enter the multi-screen collaboration mode, then the default method is the "touch" method;
  • the content can refer to the previous introduction.
  • a first interface will be displayed on the display screen of the portable computer, and the first interface is a mirror image of the display interface of the mobile phone 100 .
  • the mobile phone 100 displays the first interface
  • the portable computer displays the second interface
  • the mobile phone 100 can project the first interface on the display screen of the portable computer, or in other words, the second interface is projected on the screen.
  • the second interface includes the first interface.
  • the first interface may include at least one file icon, wherein each file icon corresponds to one file, at least one file icon corresponds to at least one file, and at least one file is stored in the mobile phone 100 .
  • a first interface is the screen projection interface 202 shown in FIG. 3C , in which "file 1", "file 2", and "file 3" represent three file icons, and these three file icons correspond to three files , which are file 1, file 2, and file 3, respectively.
  • the user operates on the portable computer, and the portable computer collects the operation of the user, and obtains event information corresponding to the operation.
  • this operation is referred to as a first operation, and the portable computer can capture the first operation and obtain event information of the first operation.
  • the first operation may act on the file icon, for example, the file icon is called the first file icon, and the first file icon may belong to the at least one file icon, that is, the user is included in the second interface displayed by the portable computer
  • the first file icon corresponds to a file, for example, the file is called the first file.
  • the event information of the first operation please refer to the foregoing related content.
  • the first operation is a touch operation, an example of which can be referred to FIG. 4A .
  • the first operation may also be other types of operations, such as gesture operations, voice control operations, or hovering operations.
  • the purpose of the user performing the first operation is to open the first file, so the first operation is an operation for opening the first file.
  • the portable computer sends the event information of the first operation to the mobile phone 100, and the mobile phone 100 receives the event information of the first operation from the portable computer.
  • the mobile phone 100 receives the event information of the first operation, it may also be equivalent to that the mobile phone 100 detects an operation acting on the first file icon.
  • a sensor eg, a touch sensor or other sensor
  • collects event information of the first operation and sends the event information of the first operation to the second housekeeper software installed in the portable computer.
  • the second housekeeper software can send the event information of the first operation to the first housekeeper software installed in the mobile phone 100, and the first housekeeper software receives the event information of the first operation from the second housekeeper software.
  • the first housekeeper software receives the event information of the first operation, which may also be equivalent to the first housekeeper software detecting the operation acting on the first file icon.
  • the mobile phone 100 determines that the event information of the first operation corresponds to the portable computer. In other words, the mobile phone 100 determines that the first operation acts on the portable computer. In other words, the mobile phone 100 determines that the first operation (or, event information of the first operation) acts on the display screen of the portable computer. In other words, the mobile phone 100 determines that the file icon corresponding to the first operation is located on the display interface of the portable computer. Wherein, that the first operation corresponds to the portable computer means that the first operation is an operation performed on the portable computer.
  • the first housekeeper software determines that the event information of the first operation corresponds to the portable computer, that is, determines that the first housekeeper software corresponds to the portable computer.
  • An operation is an operation performed on the portable computer, or in other words, it is determined that the file icon corresponding to the first operation is located on the display interface of the portable computer.
  • the event information of the first operation indicates that the first operation is a touch operation
  • the first housekeeper software can determine that the first operation is an operation performed on the display screen of the portable computer, or, in other words, determine that the file icon corresponding to the first operation is located in the portable computer. on the computer's display interface.
  • the mobile phone 100 determines that the file corresponding to the event information of the first operation is the first file, or the mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation, or the mobile phone 100 determines that the first operation corresponds to the first file. in the first document.
  • the first housekeeper software converts the area according to the area conversion ratio between the first interface and the display screen 194 of the mobile phone 100, and the The relative position information can determine the file corresponding to the first operation, for example, the first file, and the first file is, for example, the aforementioned file 3.
  • the first housekeeper software can determine the storage path of the first file, and the first housekeeper software creates a soft link corresponding to the first file in the distributed file management system of the mobile phone 100, and the soft link points to the storage path of the first file , for example, the soft link points to the storage path of the first file in the SD card of the mobile phone or the URL of the file.
  • the soft link is also associated with the metadata of the first file.
  • the mobile phone 100 sends the metadata of the first file to the portable computer, and the portable computer receives the metadata of the first file from the mobile phone 100 .
  • the metadata of the first file includes, for example, one or more of the following: the name of the first file, type information of the first file, size information of the first file, or storage path information of the first file.
  • the name of the first file includes, for example, one or more of the following: the name of the first file, type information of the first file, size information of the first file, or storage path information of the first file.
  • the distributed file management system on the mobile phone 100 side can synchronize (or send) the metadata of the file corresponding to the first operation to the distributed file management system on the portable computer side.
  • the portable computer determines an application for opening the first file according to the metadata of the first file, for example, it is called a second application.
  • the first housekeeper software can obtain the path of the soft link created in the distributed file management system of the mobile phone 100, and the first housekeeper software can send the path of the soft link to the second housekeeper software.
  • the first housekeeper software can also obtain the metadata of the file, such as type information of the file, etc., and the first housekeeper software can also send the obtained metadata of the file to the second housekeeper software.
  • the second housekeeper software determines and invokes an application that can open the file according to the type information of the file. For example, the second housekeeper software determines that the second application can open the file.
  • the portable computer invokes the second application to open the first file.
  • the first file is acquired from the mobile phone 100, that is, the data of the first file is acquired.
  • the portable computer invokes the second application, and the second application opens the soft link according to the path of the soft link.
  • the distributed file management system on the portable computer side can obtain the first file from the mobile phone 100 according to the metadata corresponding to the soft link, which can be understood as obtaining the data of the first file from the mobile phone 100 .
  • the distributed file management system on the portable computer side can acquire the first file from the mobile phone 100 according to the storage path information of the first file included in the metadata corresponding to the soft link.
  • the second application can open the first file.
  • the portable computer can also store the data of the first file in the portable computer, for example, the portable computer can store the data of the first file in the local file system of the portable computer through the second application, for example, it can be stored as a temporary file .
  • the user edits the first file on the portable computer, and saves the edited first file.
  • the edited first file is, for example, called the second file, or may also be called the update file, etc., and there is no restriction on the name of the file.
  • the user can watch the first file on the portable computer, and can also perform editing operations on the first file on the portable computer, for example, content can be deleted, added or modified in the first file.
  • the portable computer can update the stored first file, or update the data of the first file, obtain the updated data of the first file, and update the first file.
  • the data can be understood as the updated first file, that is, the second file.
  • the portable computer sends the second file to the mobile phone 100, and the mobile phone 100 receives the second file from the portable computer.
  • the portable computer can send the second file to the mobile phone 100.
  • the portable computer can synchronize the second file to the distributed file management system of the mobile phone 100 through the distributed file management system of the portable computer, so that the mobile phone 100 can cover the mobile phone with the second file.
  • the first file stored in the local file system of , so that the update of the first file is realized.
  • the portable computer can send the obtained second file to the mobile phone 100 every time the user updates the first file, so that the first file can be updated in time on the mobile phone; After the file, the obtained second file is sent to the mobile phone 100, so as to reduce the number of times of sending the update data and save the transmission overhead.
  • the portable computer can delete the stored second file to release storage space.
  • the user performs an operation on the mobile phone 100 , and the mobile phone 100 collects the operation of the user and obtains event information corresponding to the operation, or in other words, the mobile phone 100 detects the event information corresponding to the operation.
  • this operation is called the first operation, and the mobile phone 100 can capture the first operation and obtain event information of the first operation.
  • the first operation may act on the file icon, for example, the file icon is called the first file icon, and the first file icon may belong to the at least one file icon, that is, the user is in the first interface displayed on the mobile phone 100.
  • the first operation performed on the first file icon corresponds to a file, for example, the file is called the first file.
  • the mobile phone 100 collects (or detects) the event information of the user's first operation, which is equivalent to the mobile phone 100 detecting the first operation acting on the first file icon.
  • the first operation is a touch operation, an example of which can be referred to FIG. 5A .
  • the first operation may also be other types of operations, such as gesture operation, voice control operation, or hovering operation.
  • the purpose of the user performing the first operation is to open the first file, so the first operation is an operation for opening the first file.
  • the mobile phone 100 determines that the event information of the first operation corresponds to the mobile phone 100 . In other words, the mobile phone 100 determines that the first operation acts on the mobile phone 100 . In other words, the mobile phone 100 determines that the first operation (or, event information of the first operation) acts on the display screen of the mobile phone 100 . In other words, the mobile phone 100 determines that the file icon corresponding to the first operation is located on the display interface of the mobile phone 100 . Wherein, the fact that the first operation corresponds to the mobile phone 100 means that the first operation is an operation performed on the mobile phone 100 .
  • the first housekeeper software can determine that the event information of the first operation corresponds to the mobile phone 100, that is, determine that the first housekeeping software corresponds to the mobile phone 100.
  • the second operation is an operation performed on the mobile phone 100 , or in other words, it is determined that the file icon corresponding to the second operation is located on the display interface of the mobile phone 100 .
  • the event information of the first operation indicates that the first operation is a touch operation
  • the first housekeeper software can determine that the touch operation is an operation performed on the display screen of the mobile phone 100, or in other words, determine that the file icon corresponding to the touch operation is located on the mobile phone 100 on the display interface.
  • the mobile phone 100 determines that the file corresponding to the event information of the first operation is the first file, or the mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation, or the mobile phone 100 determines that the first operation corresponds to the first file. in the first document.
  • the first housekeeper software can determine the file corresponding to the first operation according to the position information of the first operation, such as the first operation file, or in other words, the first housekeeper software can determine the storage path of the first file, for example, the first file is the aforementioned file 3.
  • the mobile phone 100 invokes the first application to open the first file.
  • the first housekeeper software may determine an application that can open the first file, such as the first application, according to the type of the first file.
  • the user edits the first file on the mobile phone 100, and saves the edited first file.
  • the edited first file is called a second file, for example.
  • the user can view the first file on the mobile phone 100, and can also perform editing operations on the first file on the mobile phone 100, such as deleting content, adding content, or modifying content in the first file.
  • the first file can be saved, and the mobile phone 100 can update the first file stored in the memory, or update the data of the first file, and obtain the updated data of the first file.
  • the updated data of can be understood as the updated first file, that is, the second file.
  • S802-S810 and S811-S815 are two parallel schemes, which may not occur at the same time. For example, when the user chooses to operate on the portable computer, S802-S810 can be executed, and if the user chooses to operate on the mobile phone 100, S811-S815 can be executed.
  • the mobile phone 100 can intelligently select one of the devices (such as the mobile phone 100 or the portable computer) to use the mobile phone according to the user's current focus (such as the device targeted by the user's operation). Open-edit-save the corresponding file, users can complete office needs without leaving or switching the currently focused screen, so as to give users a better preview and editing experience.
  • the devices such as the mobile phone 100 or the portable computer
  • the embodiment of the present application also provides a second method for opening a file.
  • the mobile phone 100 can provide the user with an option, and the user chooses whether to open the file on the mobile phone 100.
  • the corresponding file is still opened on the portable computer.
  • the second method for opening a file provided in this embodiment of the present application can be applied to a multi-screen collaboration scenario.
  • the method involves a first device and a second device, and reference may be made to FIG. 1 for the structure of the first device. Please refer to FIG. 9 below to introduce the flow of the method.
  • the first device is a mobile phone 100 and the second device is a portable computer as an example.
  • the S901, the mobile phone 100 and the portable computer enter the multi-screen collaboration mode in a preset manner.
  • the user performs an operation on the portable computer, and the portable computer collects the operation of the user, and obtains event information corresponding to the operation.
  • this operation is referred to as a first operation, and the portable computer can capture the first operation and obtain event information of the first operation.
  • the first operation may act on the file icon, for example, the file icon is called the first file icon, and the first file icon may belong to the at least one file icon, that is, the user is included in the second interface displayed by the portable computer
  • the first file icon corresponds to a file, for example, the file is called the first file.
  • the portable computer sends the event information of the first operation to the mobile phone 100, and the mobile phone 100 receives the event information of the first operation from the portable computer.
  • the mobile phone 100 receives the event information of the first operation, it may also be equivalent to that the mobile phone 100 detects an operation acting on the first file icon.
  • the mobile phone 100 determines that the event information of the first operation corresponds to the portable computer. In other words, the mobile phone 100 determines that the first operation acts on the portable computer. In other words, the mobile phone 100 determines that the first operation (or, event information of the first operation) acts on the display screen of the portable computer. In other words, the mobile phone 100 determines that the file icon corresponding to the first operation is located on the display interface of the portable computer. Wherein, that the first operation corresponds to the portable computer means that the first operation is an operation performed on the portable computer.
  • the mobile phone 100 determines that the file corresponding to the event information of the first operation is the first file, or the mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation, or the mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation. Corresponds to the first file.
  • the mobile phone 100 sends the metadata of the first file to the portable computer, and the portable computer receives the metadata of the first file from the mobile phone 100 .
  • the portable computer determines an application for opening the first file according to the metadata of the first file, for example, referred to as a second application.
  • the portable computer invokes the second application to open the first file.
  • the user edits the first file on the portable computer, and saves the edited first file.
  • the edited first file is, for example, called the second file, or may also be called the update file, etc., and there is no restriction on the name of the file.
  • the portable computer sends the second file to the mobile phone 100, and the mobile phone 100 receives the second file from the portable computer.
  • the user performs an operation on the mobile phone 100 , the mobile phone 100 collects the operation information of the user, and obtains event information corresponding to the operation, or in other words, the mobile phone 100 detects the event information corresponding to the operation.
  • this operation is called the first operation, and the mobile phone 100 can capture the first operation and obtain event information of the first operation.
  • the first operation may act on the file icon, for example, the file icon is called the first file icon, and the first file icon may belong to the at least one file icon, that is, the user is in the first interface displayed on the mobile phone 100.
  • the first operation performed on the first file icon corresponds to a file, for example, the file is called the first file.
  • the mobile phone 100 collects (or detects) the event information of the user's first operation, which is equivalent to the mobile phone 100 detecting the first operation acting on the first file icon.
  • the mobile phone 100 determines that the event information of the first operation corresponds to the mobile phone 100 . In other words, the mobile phone 100 determines that the first operation acts on the mobile phone 100 . In other words, the mobile phone 100 determines that the first operation (or, event information of the first operation) acts on the display screen of the mobile phone 100 . In other words, the mobile phone 100 determines that the file icon corresponding to the first operation is located on the display interface of the mobile phone 100 .
  • the mobile phone 100 outputs prompt information, where the prompt information is used to determine the device for opening the first file.
  • the mobile phone 100 may output prompt information through the display screen 194, and the prompt information may include one or more options, and the one or more options may be used to determine the device to open the first file.
  • the prompt information please refer to FIG. 7A or FIG. 7B .
  • the user selects the first option among the one or more options, and the mobile phone 100 detects an operation for selecting the first option.
  • the touch sensor 180K can detect the operation and collect the event information of the operation. After collecting the event information of the operation, the touch sensor 180K can detect the operation. The event information of the operation can be sent to the first housekeeper software. After receiving the event information of the operation from the touch sensor 180K, the first housekeeper software determines that the user has selected to open the first file on the mobile phone 100 through the application 1 corresponding to "1".
  • the first option corresponds to, for example, a first application, and the first application is installed in the mobile phone 100 , for example.
  • the mobile phone 100 determines that the file corresponding to the event information of the first operation is the first file, or the mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation, or the mobile phone 100 determines that the first operation corresponds to the first file. in the first document.
  • the mobile phone 100 invokes the first application to open the first file.
  • the edited first file is called a second file, for example.
  • the user selects a second option from one or more options included in the prompt information, and the mobile phone 100 detects an operation for selecting the second option.
  • the touch sensor 180K can detect the operation and collect the event information of the operation. After collecting the event information of the operation, touch The sensor 180K may send event information of the operation to the first housekeeper software. After receiving the event information of the operation from the touch sensor 180K, the first housekeeper software determines that the user has selected to open the first file on the portable computer.
  • S906 to S910 may be executed continuously, and details are not repeated here.
  • S902-S910 and S911-S918 and subsequent steps are two parallel solutions, which may not occur at the same time.
  • S902-S910 can be executed, and if the user chooses to operate on the mobile phone 100, S911-S918 and subsequent steps can be executed.
  • the steps S914 to S917 and S918 and subsequent steps are also two parallel solutions, which may not occur at the same time.
  • the steps S918 and subsequent steps can be executed, and if the user chooses to open the first file on the mobile phone 100, the steps S914 to S914 can be executed. S917.
  • the technical solutions provided by the embodiments of the present application provide the user with a selection opportunity, and it is more convenient for the user to select a suitable device to open the corresponding file.
  • a mobile device such as a mobile phone 100 or a portable computer, etc.
  • a mobile device may include a hardware structure and/or a software module, and a hardware structure, a software module, or a hardware structure plus a software module form to achieve the above functions. Whether one of the above functions is performed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.
  • an electronic device for example, a mobile phone (eg, a mobile phone 100 ), a Pad, or a portable computer.
  • the electronic device may include: a touch screen 1001, wherein the touch screen 1001 includes a touch-sensitive surface 1006 and a display screen 1007; an application program 1008; one or more processors 1002; and one or more memories 1003 for storing one or more A program 1004 ; the above-mentioned devices may be connected through one or more communication buses 1005 .
  • the display screen 1007 can be used to display the content of a file in the electronic device; or the display screen 1007 can also be used to display the desktop of the electronic device; or the display screen 1007 can be used to display an image and so on.
  • the electronic device when one or more programs 1004 stored in the memory 1003 are executed by one or more processors 1002, the electronic device can be used to execute the embodiment shown in FIG. 8 or the embodiment shown in FIG. 9 or other corresponding individual steps in the examples.
  • each functional unit in this embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the first acquisition unit and the second acquisition unit may be the same unit or different units.
  • the above-mentioned integrated unit can be implemented in the form of hardware, can also be implemented in the form of software functional units, or can be implemented in the form of hardware combined with software functional units.
  • the term “when” may be interpreted to mean “if” or “after” or “in response to determining" or “in response to detecting" depending on the context.
  • the phrases “in determining" or “if detecting (the stated condition or event)” can be interpreted to mean “if determining" or “in response to determining" or “on detecting (the stated condition or event)” or “in response to the detection of (the stated condition or event)”.
  • the above-mentioned embodiments it may be implemented in whole or in part by software, hardware, firmware or any combination thereof.
  • software it can be implemented in whole or in part in the form of a program product.
  • the program product includes one or more computer instructions. When the program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated.
  • the computer may be a general purpose computer, special purpose computer, computer network, or other programmable device.
  • the computer instructions may be stored in or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server or data center Transmission to another website site, computer, server, or data center by wire (eg, coaxial cable, optical fiber, digital subscriber line) or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media.
  • the usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state drives), and the like.
  • the methods provided by the embodiments of the present application have been introduced from the perspective of a terminal device as an execution subject.
  • the terminal device may include hardware structures and/or software modules, and implement the above functions in the form of hardware structures, software modules, or hardware structures plus software modules. Whether one of the above functions is performed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

本申请涉及一种打开文件的方法及设备。第一设备显示第一界面并将第一界面投屏在第二设备的第二界面上,第一界面上包含至少一个文件图标,第二界面上包括第一界面,至少一个文件图标对应的文件保存于第一设备。第一设备检测到作用于文件图标的操作。当文件图标是显示在第一界面上的图标时,第一设备调用第一应用打开文件;当文件图标是显示在第二界面上的图标时,第一设备将文件的元数据发送给第二设备,文件的元数据用于在第二设备上打开文件。本申请实施例能够在投屏过程中根据用户的操作确定用户当前的关注焦点,从而选择相应的设备打开文件,更有利于用户的观看,避免用户的过多操作步骤。

Description

一种打开文件的方法及设备
相关申请的交叉引用
本申请要求在2020年07月07日提交中国国家知识产权局、申请号为202010648535.5、申请名称为“一种打开文件的方法及设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及通信技术领域,尤其涉及一种打开文件的方法及设备。
背景技术
随着智能终端的发展,一个用户拥有多个智能终端的场景越来越多,例如智能手机、平板电脑(PAD)、或个人计算机(PC)等设备。多设备之间的互联互通给用户带来了较好的体验。
目前,为了提高用户的体验,提供了多屏协同功能(或者,称为多设备协同功能)。在多屏协同功能下,一个设备上的文件可以在另一个设备上打开。例如手机和PC进行多屏协同,则在PC的显示屏上会显示手机的显示界面,在PC上显示的手机的显示界面也可理解为投屏界面。用户在PC的投屏界面上操作,例如用户选择打开文件A,则PC可以打开文件A。或者,用户在手机上操作,例如用户选择打开文件B,同样的,PC可以打开文件B,而手机上并不会打开文件B。PC相对于手机来说显示屏的面积更大,用户在PC上观看该文件,可以提升用户的观看效果。
可以看到,在多屏协同场景下,无论用户在参与多屏协同的哪个设备上操作,结果都是在其中一个设备上进行响应。例如在手机和PC进行多屏协同时,用户无论在手机还是在PC上操作以打开一个文件,结果都是在PC上打开该文件,在手机上不会打开。但如果用户实际是希望在手机上观看,按照目前的方式是无法实现的,用户只能退出多屏协同模式,才能正常在手机上打开并观看相应内容,而这个过程需要多个步骤的操作,较为繁琐。
发明内容
本申请实施例提供一种打开文件的方法及设备,用于简化打开文件的流程。
第一方面,提供一种打开文件的方法,该方法包括:第一设备与第二设备通过预设方式进入多屏协同模式;所述第一设备显示第一界面并将所述第一界面投屏在第二设备的第二界面上,所述第一界面上包含至少一个文件图标,所述第二界面上包括第一界面,所述至少一个文件图标对应的文件保存于所述第一设备;所述第一设备检测到作用于所述文件图标的操作;所述第一设备确定所述操作作用于所述第一设备的显示屏或第二设备的显示屏;当所述操作作用于所述第一设备的显示屏时,所述第一设备调用第一应用打开所述文件;当所述操作作用于所述第二设备的显示屏时,所述第一设备将所述文件的元数据发送给所述第二设备,所述文件的元数据用于在所述第二设备上打开所述文件。
该方法可由第一设备执行,第一设备例如为移动设备,例如手机、平板电脑(PAD) 或便携计算机等;或者,第一设备也可以是位置固定的设备,例如位置相对固定的台式计算机等。
第一设备向第二设备投屏,如果按照目前的方式,则用户在第一设备上操作以打开相应文件,该文件都应该在第二设备上打开。但是在本申请实施例中,如果第一设备检测到用户的操作作用于第一设备的显示屏,则第一设备能够在本地打开文件,不会在第二设备上打开文件。如果用户的操作作用于第一设备的显示屏,表明用户当前可能在使用第一设备,在第一设备上打开该文件,显然更方便用户的观看。通过本申请实施例提供的方式,由于文件能够在第一设备上打开,因此用户无需退出多屏协同模式,自然也无需执行多个步骤,简化了文件的打开流程,也减少了设备的响应次数,有助于减小设备的功耗。而且如果第一设备确定用户的操作作用于第二设备的显示屏,则也能够在第二设备上打开文件。即,本申请实施例提供的方法能够根据用户的操作确定用户当前的关注焦点,从而选择相应的设备打开文件,更有利于用户的观看,避免用户的过多操作步骤。
在一种可能的实施方式中,所述方法还包括:
所述第一设备接收来自所述第二设备的更新文件,所述更新文件为更新后的所述第一文件;
所述第一设备用所述更新文件更新本地存储的所述文件。
如果文件在第二设备上打开,则用户可以在第二设备上对该文件进行编辑操作,例如用户可以修改该文件。用户在对该文件进行编辑操作后,可以在第二设备上存储修改后的文件,修改后的文件例如称为更新文件。则第二设备可将更新文件发送给第一设备,第一设备可以用该更新文件更新第一设备所存储的原文件,从而实现该文件的更新。
在一种可能的实施方式中,所述第一设备检测到作用于所述文件图标的操作,包括:
所述第一设备接收来自所述第二设备的事件信息,所述事件信息用于指示所述操作,且所述事件信息包括所述第二设备的标识。
如果用户的操作是作用于第一设备的显示屏,则第一设备能够直接采集用户的操作,或者说,第一设备能够捕捉用户的操作事件,因此,如果第一设备能够采集用户的操作,就能确定该操作作用于第一设备的显示屏。而如果用户的操作作用于第二设备的显示屏,则第一设备无法直接采集用户的操作,但第二设备可以采集用户的操作,或者说,第二设备能够捕捉用户的操作事件,得到该操作事件对应的事件信息,且第二设备能够将该事件信息发送给第一设备。该事件信息可指示该操作,或者说,该事件信息可描述该操作。该事件信息可包括第二设备的标识,以指示该事件信息对应的操作是作用于第二设备。
在一种可能的实施方式中,所述第一设备确定所述操作作用于所述第二设备的显示屏,包括:
所述第一设备根据所述第二设备的标识,确定所述操作作用于所述第二设备的显示屏。
例如,该事件信息可包括第二设备的标识,从而第一设备获得该事件信息,就能确定该操作作用于第二设备的显示屏。可选的,该事件信息还可以包括该操作在第二设备显示的第一界面内的相对位置坐标等信息,从而第一设备能够确定用户的操作所对应的文件。通过这种方式,第一设备能够确定用户的操作焦点,从而选择用于打开文件的设备。
在一种可能的实施方式中,所述第一设备将所述文件的元数据发送给所述第二设备,包括:
所述第一设备通过所述第一设备的分布式文件管理***,将所述文件的元数据同步到 (或,发送给)所述第二设备的分布式文件管理***。
在第一设备和第二设备中都可以设置分布式文件管理***,分布式文件管理***例如可用于管理文件,则通过分布式文件管理***能够在第一设备和第二设备间同步与文件相关的一些信息,因此第一设备可以通过分布式文件管理***来同步文件的元数据。当然,第一设备也可以通过其他方式来将文件的元数据发送给第二设备,具体的不做限制。
在一种可能的实施方式中,在所述第一设备调用第一应用以打开所述文件之前,还包括:
所述第一设备输出提示信息,所述提示信息包括一个或多个选项,所述一个或多个选项用于确定打开所述文件的设备;
所述第一设备检测到用于选择所述一个或多个选项中的第一选项的操作,所述第一选项对应所述第一应用。
也就是说,即使第一设备确定用户的操作是作用于第一设备的显示屏,第一设备依然能够输出提示信息,以供用户选择究竟在哪个设备上打开文件,如果用户选择在第一设备上打开文件,则根据用户的选择在第一设备上打开文件。通过这种方式,使得打开文件的设备更为符合用户的需求,更有利于用户的观看。
在一种可能的实施方式中,
当所述操作作用于所述第一设备的显示屏时,所述第一设备输出提示信息,所述提示信息包括一个或多个选项,所述一个或多个选项用于确定打开所述文件的设备;
所述第一设备检测到用于选择所述一个或多个选项中的第二选项的操作,所述第二选项用于指示在所述第二设备上打开所述文件;
所述第一设备将所述文件的元数据发送给所述第二设备,所述文件的元数据用于在所述第二设备上打开所述文件。
即使第一设备确定用户的操作是作用于第一设备的显示屏,第一设备依然能够输出提示信息,以供用户选择究竟在哪个设备上打开文件,如果用户选择在第二设备上打开文件,则根据用户的选择在第二设备上打开文件。例如,有时用户虽然是在第一设备上操作,但实际上是希望在第二设备上将相应的文件展示给其他用户观看,如果是这种场景,则通过本申请实施例提供的技术方案,用户就可以选择在便携计算机上打开,从而完成展示过程。可见,通过本申请实施例提供的技术方案,为用户提供了选择机会,更便于用户选择合适的设备打开相应的文件。
在一种可能的实施方式中,所述文件的元数据包括所述文件在所述第一设备中的存储路径信息。
文件的元数据可包括该文件在第一设备中的存储路径信息,从而第二设备在获得文件的元数据后,能够根据该存储路径信息从第一设备中获得该文件,以在第二设备本地打开该文件。
在一种可能的实施方式中,所述文件的元数据还包括如下一项或多项:所述文件的类型信息,所述文件的大小信息,或,所述文件的名称。
文件的元数据除了包括文件在第一设备中的存储路径信息外,还可以包括其他信息,例如文件的类型信息,或文件的大小信息等,以使得第二设备能够获得该文件的更多信息。
第二方面,提供第二种通信方法,该方法包括:第一设备与第二设备通过预设方式进入多屏协同模式;所述第一设备显示第一界面并将所述第一界面投屏在所述第二设备的第 二界面上,所述第一界面上包含至少一个文件图标,所述第二界面上包括所述第一界面,所述至少一个文件图标对应的文件保存于所述第一设备;所述第一设备检测到作用于所述文件图标的操作;当所述文件图标是显示在所述第一设备的所述第一界面上的图标时,所述第一设备调用第一应用打开所述文件;当所述文件图标是显示在所述第二界面上的图标时,所述第一设备将所述文件的元数据发送给所述第二设备,所述文件的元数据用于在所述第二设备上打开所述文件。
该方法可由第一设备执行,第一设备例如为移动设备,例如手机、平板电脑或便携计算机等;或者,第一设备也可以是位置固定的设备,例如位置相对固定的台式计算机等。
在一种可能的实施方式中,所述方法还包括:
所述第一设备接收来自所述第二设备的更新文件,所述更新文件为更新后的所述文件;
所述第一设备用所述更新文件更新本地存储的所述文件。
在一种可能的实施方式中,所述第一设备检测到作用于所述文件图标的操作,包括:
所述第一设备接收来自所述第二设备的事件信息,所述事件信息用于指示所述操作,且所述事件信息包括所述第二设备的标识;或者,
所述第一设备在所述第一设备上检测到所述操作产生的事件信息。
其中,第一设备在第一设备上检测到该操作产生的事件信息,可以理解为,第一设备在第一设备上检测到该操作,并获得该操作对应的事件信息,因此可以认为是第一设备在第一设备上检测到了该操作产生的事件信息;或者,也可以理解为,第一设备在第一设备上检测到了该操作对应的事件信息。即,前一种理解是第一设备检测到了该操作,并获得了事件信息,后一种理解是第一设备检测到了事件信息,该事件信息对应于该操作。
在一种可能的实施方式中,所述第一设备确定所述文件图标是显示在所述第二界面上的图标,包括:
所述第一设备根据所述第二设备的标识,确定所述文件图标是显示在所述第二界面上的图标。
在一种可能的实施方式中,所述第一设备将所述文件的元数据发送给所述第二设备,包括:
所述第一设备通过所述第一设备的分布式文件管理***,将所述文件的元数据发送到所述第二设备的分布式文件管理***。
在一种可能的实施方式中,在所述第一设备调用第一应用以打开所述文件之前,还包括:
所述第一设备输出提示信息,所述提示信息包括一个或多个选项,所述一个或多个选项用于确定打开所述文件的设备;
所述第一设备检测到用于选择所述一个或多个选项中的第一选项的操作,所述第一选项对应所述第一应用。
在一种可能的实施方式中,所述方法还包括:
当所述文件图标是显示在所述第一界面上的图标时,所述第一设备输出提示信息,所述提示信息包括一个或多个选项,所述一个或多个选项用于确定打开所述文件的设备;
所述第一设备检测到用于选择所述一个或多个选项中的第二选项的操作,所述第二选项用于指示在所述第二设备上打开所述文件;
所述第一设备将所述文件的元数据发送给所述第二设备,所述文件的元数据用于在所 述第二设备上打开所述文件。
在一种可能的实施方式中,所述文件的元数据包括所述文件在所述第一设备中的存储路径信息。
在一种可能的实施方式中,所述文件的元数据还包括如下一项或多项:所述文件的类型信息,所述文件的大小信息,或,所述文件的名称。
关于第二方面或第二方面的各种可能的实施方式所带来的技术效果,可参考对于第一方面或相应的实施方式的技术效果的介绍。
第三方面,提供一种电子设备,该电子设备包括显示屏、一个或多个处理器、存储器、以及一个或多个程序。其中,所述一个或多个程序被存储在所述存储器中,所述一个或多个程序包括指令,当所述指令被所述电子设备执行时,使得所述电子设备执行上述第一方面或者任意一种可能的实施方式所提供的方法,或者使得所述电子设备执行上述第二方面或者任意一种可能的实施方式所提供的方法。
第四方面,提供一种电子设备,所述电子设备包括用于执行第一方面或者任意一种可能的实施方式所提供的方法的模块/单元,或者,所述电子设备包括用于执行第二方面或者任意一种可能的实施方式所提供的方法的模块/单元。
第五方面,提供一种计算机可读存储介质,所述计算机可读存储介质用于存储计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行上述第一方面或任意一种可能的实施方式所提供的方法,或者使得所述计算机执行上述第二方面或任意一种可能的实施方式所提供的方法。
第六方面,提供一种包含指令的计算机程序产品,所述计算机程序产品用于存储计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行上述第一方面或的任意一种可能的实施方式所提供的方法,或者使得所述计算机执行上述第二方面或任意一种可能的实施方式所提供的方法。
第七方面,提供一种通信***,所述通信***包括第三方面所述的电子设备,或包括第四方面所述的电子设备。
在一种可选的实施方式中,所述通信***还包括第二设备,所述第二设备为第一方面或各种实施方式所述的第二设备,或为第二方面或各种实施方式所述的第二设备。
本申请实施例提供的方法能够根据用户的操作确定用户当前的关注焦点,从而选择相应的设备打开文件,更有利于用户的观看,避免用户的过多操作步骤。
附图说明
图1为一种电子设备的结构示意图;
图2为目前在多屏协同模式下打开文件的过程的示意图;
图3A为本申请实施例中手机的桌面的示意图;
图3B为本申请实施例中用户用手机碰一碰便携计算机的示意图;
图3C为本申请实施例中进入多屏协同模式后,便携计算机上显示手机镜像的示意图;
图4A为本申请实施例中用户在便携计算机上显示的投屏界面202上进行第一操作的示意图;
图4B为本申请实施例中便携计算机上打开文件3的一种示意图;
图4C为本申请实施例中便携计算机上打开文件3的另一种示意图;
图4D为本申请实施例中便携计算机上打开文件3的又一种示意图;
图5A为本申请实施例中用户在手机100上进行第二操作的示意图;
图5B为本申请实施例中手机100上打开文件3的一种示意图;
图6为本申请实施例中在多屏协同模式下打开文件的过程的示意图;
图7A为本申请实施例中手机100上显示提示信息的一种示意图;
图7B为本申请实施例中用户对提示信息所包括的选项进行操作的一种示意图;
图7C为本申请实施例中手机100上显示提示信息的另一种示意图;
图7D为本申请实施例中用户对提示信息所包括的选项进行操作的另一种示意图;
图8为本申请实施例提供的第一种打开文件的方法的流程图;
图9为本申请实施例提供的第二种打开文件的方法的流程图;
图10为本申请实施例提供的一种电子设备的结构示意图。
具体实施方式
为了使本申请实施例的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施例作进一步地详细描述。
以下,对本申请实施例中的部分用语进行解释说明,以便于本领域技术人员理解。
本申请涉及的应用程序(application,app),为能够实现某项或多项特定功能的软件程序。通常,电子设备中可以安装多个应用程序。例如,相机应用、短信应用、彩信应用、图像应用、各种邮箱应用、微信(WeChat)、WhatsApp Messenger、连我(Line)、照片分享(instagram)或Kakao Talk等。下文中提到的应用程序,可以是电子设备出厂时已安装的应用程序,也可以是用户在使用电子设备的过程中从网络下载或从其他电子设备获取的应用程序(例如,其它电子设备发送的应用程序)。
本申请涉及的文件,例如为多媒体文件,例如图像文件、视频文件或音频文件;或者,也可以是文字类文件,例如微软(Microsoft)工作(office)文件,例如word文件、excel文件、或powerpoint文件等;或者,还可以是画图类应用所对应的图片文件,例如Microsoft office visio文件或photoshop文件等。
本申请实施例中,至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b,或c中的至少一项(个),可以表示:a,b,c,a-b,a-c,b-c,或a-b-c,其中a,b,c可以是单个,也可以是多个。
以及,除非有相反的说明,本申请实施例提及“第一”、“第二”等序数词是用于对多个对象进行区分,不用于限定多个对象的大小、内容、顺序、时序、优先级或者重要程度等。例如,第二文件和第二文件,只是为了区分不同的文件,而并不是表示这两个文件的大小、内容、优先级或者重要程度等的不同。
本申请提供的技术方案可以应用在电子设备中,以下介绍电子设备、用于这样的电子设备的图形用户界面(graphical user interface,GUI)、和用于使用这样的电子设备的实施例。在本申请一些实施例中,电子设备可以是便携式电子设备,诸如手机、PAD、便携计 算机、具备无线通讯功能的可穿戴设备(如智能手表、智能眼镜、智能手环、或智能头盔等)、或车载设备等。便携式电子设备的示例性实施例包括但不限于搭载
Figure PCTCN2021103515-appb-000001
Figure PCTCN2021103515-appb-000002
或者其它操作***的便携式电子设备。还应当理解的是,在本申请其他一些实施例中,上述电子设备也可以不是便携式设备,例如也可以是能够采集图像,并运行图像压缩算法压缩图像的台式计算机,例如PC。
示例性地,图1给出了一种电子设备100的结构示意图。
应理解,图示电子设备100仅是一个范例,并且电子设备100可以具有比图中所示出的更多的或者更少的部件,可以组合两个或更多的部件,或者可以具有不同的部件配置。图中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
如图1所示,电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
下面结合图1对电子设备100的各个部件进行具体的介绍。
处理器110可以包括一个或多个处理单元,例如,处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从存储器中直接调用,从而可避免重复存取,可减少处理器110的等待时间,因而可提高***的效率。
处理器110可以运行本申请实施例提供的打开文件的方法。例如本申请实施例提供管家软件,管家软件可以是软件模块,该软件模块可以运行在处理器110上,该软件模块可以理解为计算机程序。又例如,本申请实施例还提供投屏软件,投屏软件可以是软件模块,该软件模块可以运行在处理器110上,该软件模块可以理解为计算机程序。其中,管家软件和投屏软件可以是同一软件模块,或者,管家软件和投屏软件也可以是不同的软件模块。另外,管家软件可以是单独运行的软件,或者也可以是***软件的一部分;同理,投屏软件可以是单独运行的软件,或者也可以是***软件的一部分。当处理器110集成不同的器件,比如集成CPU和GPU时,CPU和GPU可以配合执行本申请实施例提供的方法,例如本申请实施例提供的方法中部分算法由CPU执行,另一部分算法由GPU执行,以得到 较快的处理效率。
在一些实施例中,处理器110可以包括一个或多个接口。比如,接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星***(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯***(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位***(global positioning system,GPS),全球导航卫星***(global navigation satellite system,GLONASS),北斗卫星导航***(beidou navigation satellite system,BDS),准天顶卫星***(quasi-zenith satellite system,QZSS)和/或星基增强***(satellite based augmentation systems,SBAS)。
可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在本申请另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以通过液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能,或者说实现采集图像的功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
内部存储器121可以用于存储计算机可执行程序代码,可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作***,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存 储在内部存储器121的指令,和/或存储在设置于处理器中的存储器的指令,执行电子设备100的各种功能应用以及数据处理。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将图片,视频等文件保存在外部存储卡中。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
其中,传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。马达191可以产生振动提示。指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。SIM卡接口195用于连接SIM卡。SIM卡可以通过***SIM卡接口195,或从SIM卡接口195拔出,实现与电子设备100的接触和分离。
可以理解的是,图1所示的部件并不构成对电子设备100的具体限定,手机还可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。此外,图1中的部件之间的组合/连接关系也是可以调整修改的。
本申请提供第一设备和第二设备。第一设备例如可实现为电子设备100,或者也可以是设置在电子设备100中的芯片或其他功能部件(在这种情况下,第一设备也可以称为第一装置),或者第一设备也可以有其他的实现形式。第二设备例如可实现为电子设备100,或者也可以是设置在电子设备100中的芯片或其他功能部件(在这种情况下,第二设备也可以称为第二装置),或者第二设备也可以有其他的实现形式。其中,图1所示的麦克风170C,摄像头193,指纹传感器180H,触摸传感器180K,或骨传导传感器180M中的一种或多种,在本申请中均可以采集用户的操作。或者,本申请实施例也可以提供一些外设输入设备来采集用户的操作,例如电子设备100与一些外设输入设备连接,这些外设输入设备能够采集用户的操作。外设输入设备例如包括键盘或鼠标等。
本申请还提供一种多屏协同***,该多屏协同***可包括第一设备和第二设备。当然,该多屏协同***还可以包括其他设备,例如三个或三个以上的设备也可以进行多屏协同。本申请实施例主要以两个设备之间的多屏协同过程为例。
目前,在多屏协同(或者,称为多设备协同)场景下,无论用户在参与多屏协同的哪个设备上操作,结果都是在其中一个设备上进行响应。例如在手机和PC进行多屏协同时,用户无论在手机还是在PC上操作以打开一个文件,结果都是在PC上打开该文件,在手机上不会打开。但如果用户实际是希望在手机上观看,按照目前的方式是无法实现的,用户只能退出多屏协同模式,才能正常在手机上打开并观看相应内容,而这个过程需要多个步骤的操作,较为繁琐。
例如,一个用户使用手机操作,对于手机中的某个文件,需要在个人计算机(personal computer,PC)上打开文件,以供使用PC的用户观看,这样就不必两个用户同时观看手 机,PC的显示屏较大,也能带来较好的观看效果。在这种情况下,手机和PC就可以进入多屏协同模式,手机可在多屏协同模式下打开文件,该文件就会显示在PC上。可参考图2,为在多屏协同模式下打开文件的过程的示意图。
图2中的1,表示用户点击手机显示屏上显示的文件,手机上安装的手机助手(或者,称为手机PC助手)获得用户的点击操作信息,并进行点击响应。或者,图2中的1,表示用户点击PC的显示屏上的手机的投屏界面中显示的文件,PC上安装的PC管家获得用户的点击操作信息,并进行点击响应。
图2中的2,表示PC上安装的PC管家将获得的用户的点击操作信息发送给手机助手。
图2中的3,表示手机将进行文件打开截断处理。这是因为,如果按照正常的流程,手机确定用户进行了用于打开手机上的文件的操作,则手机会响应该操作,并打开相应的文件。但在多屏协同模式下,只能由PC来打开该文件,手机端不会打开,因此手机需要对原本需要进行的打开该文件的操作进行截断。
图2中的4,表示手机获取该文件的路径。这里所述的该文件的路径,是指该文件的绝对路径,即,该文件在手机中的存储路径。
图2中的5,表示手机助手将在手机中的分布式文件管理***(ming distributed file system,MDFS)中创建软链接,该软链接指向一个存储路径,该存储路径为该文件在手机中的存储路径,例如该文件在手机的安全数码卡(secure digital memory card,SD)中的存储路径或该文件的统一资源定位符(uniform resource locator,URL)等。另外,该软链接还与该文件的元数据相关联,该文件的元数据例如包括该文件的存储路径,当然还可能包括该文件的其他内容,例如该文件的类型信息等。
图2中的6,表示手机端的分布式文件管理***将该文件的元数据同步到PC端的分布式文件管理***。
图2中的7,表示手机助手获得分布式文件管理***中创建的软链接的路径。
图2中的8,表示手机助手将手机端的分布式文件管理***中创建的软链接的路径发送给PC管家。另外,手机助手也能够获得该文件的元数据,例如该文件的类型信息等,手机助手也可以将获得的该文件的元数据发送给PC管家。
图2中的9和10,表示PC管家根据该文件的类型信息等,调用能够打开该文件的应用,另外,PC管家也将软链接的路径发给该应用。图2以该应用是Microsoft office应用为例,在图2中表示为“办公应用”。
图2中的11,表示office应用根据该软链接的路径,打开该软链接。
图2中的12,表示PC端的分布式文件管理***根据该软链接对应的元数据(例如根据元数据所包括的该文件的存储路径),到手机端的分布式文件管理***中请求获得该文件。
图2中的13,表示手机端的分布式文件管理***读取该软链接实际指向的文件。另外,手机端的分布式文件管理***将读取的文件发送给PC端的分布式文件管理***,从而PC端的office应用能够打开该文件。
根据如上流程可以看到,目前在多屏协同(或者,称为多设备协同)场景下,无论用户在参与多屏协同的哪个设备上操作,结果都是在其中一个设备上进行响应。例如在手机和PC进行多屏协同时,用户无论在手机还是在PC上操作以打开一个文件,结果都是在PC上打开该文件,在手机上不会打开。但如果用户实际是希望在手机上观看,按照目前的 方式是无法实现的,用户只能退出多屏协同模式,才能正常在手机上打开并观看相应内容,而这个过程需要多个步骤的操作,较为繁琐。
鉴于此,在本申请中,设备可以根据用户的操作确定用户的操作焦点,或者说确定用户究竟希望在哪个设备上观看,从而根据用户的意图来选择相应的设备进行响应。通过这种方式,能够使得响应结果符合用户的需求,提高用户的使用体验。例如在手机和PC进行多屏协同时,用户如果在手机上操作以打开一个文件,则该文件可以在手机上打开,或者用户如果在PC上操作以打开一个文件,该文件可以在PC端打开,可见,用户无需退出多屏协同模式也能在手机上打开并观看相应内容,简化了用户的操作过程,设备也无需响应多次,有助于节省设备的功耗。
下面介绍本申请实施例提供的技术方案。
在本申请实施例中,第一设备和第二设备要进行多屏协同。为了便于理解,在下文的介绍过程中,以第一设备是手机、第二设备是便携计算机为例,手机的结构例如为图1所示的结构,在此意义上来说,图1所示的电子设备100,也可以称为手机100。另外,第一设备要实现多屏协同功能,例如可通过第一设备内安装的第一管家软件来实现,第二设备要实现多屏协同,可通过第二设备内安装的第二管家软件来实现。根据前文的介绍可知,第一管家软件可以是在第一设备中单独运行的软件模块,或者也可以是第一设备的***软件的一部分。第二管家软件可以是在第二设备中单独运行的软件模块,或者也可以是第二设备的***软件的一部分。另外,“投屏软件”也可以有其他名称,例如也可以称为“投屏应用(APP)”等。其中,第一设备如果是手机100,那么第一管家软件也可以称为手机助手等。应理解:管家软件也可以称作其他名称,“管家”这个词本身没有特定含义,并不是说管家软件一定要管理该管家软件所在的设备内的其他软件。
另外,在本申请实施例中,软件模块与应用(APP)可以是同种概念,例如手机助手是软件模块,也是应用,因此,“软件”,也可以替换为“应用(APP)”,例如“管家软件”也可以称为“管家应用”,还有“投屏软件”,也可以称为“投屏应用”。或者,应用可以包括一个或多个软件模块,但不能认为软件模块本身就是应用。例如,管家软件是一个软件模块,但不是独立的应用,可认为管家软件是设置在相应的应用(例如管家应用)中的软件模块,或者也可以是设置在***软件中的软件模块;同理,投屏软件是一个软件模块,但不是独立的应用,可认为投屏软件是设置在相应的应用(例如投屏应用)中的软件模块,或者也可以是设置在***软件中的软件模块。其中,“应用”,是指用户可以直观调用的,例如在手机的显示界面上显示的“短信”、“应用市场”等图标,都代表相应的应用。在下文的介绍过程中,以软件模块与应用是同种概念为例。
图3A示出了手机100的一GUI,该GUI为手机的桌面201。用户希望手机100和便携计算机进行多屏协同,则用户需要使手机100和便携计算机都进入多屏协同模式。要使得手机100和便携计算机进入多屏协同模式,可以通过预设方式,预设方式可以包括多种操作方式。例如参考图3B,用户可手持手机100碰一碰便携计算机,例如碰一碰便携计算机的NFC区域,则手机100和便携计算机可建立NFC连接,且手机100和便携计算机均进入多屏协同模式,则预设方式就是“碰一碰”的方式。即,用户只需进行一个操作(碰一碰操作),就既能在两个设备之间建立连接,又能使得两个设备进入多屏协同模式。其中,图3B主要是示意手机100和便携计算机碰一碰的过程,因此并未详细画出手机100的显示界面。
或者,用户可开启手机100和便携计算机的蓝牙功能,例如手机100在开启蓝牙功能后会扫描周围的蓝牙设备,如果扫描到便携计算机,则手机100和便携计算机可建立蓝牙连接,且手机100和便携计算机均进入多屏协同模式,则预设方式就是用户开启蓝牙功能的方式,或者是手机100扫描便携计算机的方式。即,用户只需进行一个操作(开启蓝牙功能的操作),就既能在两个设备之间建立连接,又能使得两个设备进入多屏协同模式。或者,用户开启手机100和便携计算机的蓝牙功能,例如手机100在开启蓝牙功能后会扫描周围的蓝牙设备,如果扫描到便携计算机,则手机100和便携计算机可建立蓝牙连接。在手机100和便携计算机建立蓝牙连接后,用户再进行相应操作,使得手机100和便携计算机进入多屏协同模式。例如便携计算机安装了第二投屏软件,手机100安装了第一投屏软件,用户所进行的操作,例如为使用第一投屏软件扫描第二投屏软件提供的二维码的操作,而用户进行该操作,就视为预设方式。即,用户需要进行至少两个操作,分别使得两个设备建立连接以及进入多屏协同模式。
或者,手机100和便携计算机也可以通过Wi-Fi或其他方式建立连接,并进入多屏协同模式。
或者,便携计算机安装了第二投屏软件,手机100安装了第一投屏软件,第一投屏软件和第二投屏软件可以是两种不同投屏软件,或者也可以是同一种投屏软件,只是安装在不同的设备上。根据前文的介绍可知,第一投屏软件可以是在手机100中单独运行的软件模块,或者也可以是手机100的***软件的一部分。第二投屏软件可以是在便携计算机中单独运行的软件模块,或者也可以是便携计算机的***软件的一部分。应理解的是,“投屏软件”也可以有其他名称,例如可以称为“投屏应用”等。另外,投屏软件和管家软件可以是同一软件模块,例如,第一投屏软件和第一管家软件可以是同一软件模块,第二投屏软件和第二管家软件可以是同一软件模块;或者,投屏软件和管家软件可以是不同的软件模块,例如,第一投屏软件和第一管家软件可以是不同的软件模块,第二投屏软件和第二管家软件可以是不同的软件模块。例如,第一投屏软件是手机100的***软件的一部分,而第一管家软件是在手机100中单独运行的软件模块,不属于***软件,则认为第一投屏软件和第一管家软件是不同的软件模块;又例如,第一投屏软件和第一管家软件都是在手机100中单独运行的软件模块,但二者是不同的软件模块,也认为第一投屏软件和第一管家软件是不同的软件模块,等等。用户可在便携计算机上打开第二投屏软件,以及在手机100上也打开第一投屏软件,便携计算机上的第二投屏软件可以提供二维码,用户可以用手机100通过手机100上的第一投屏软件扫描便携计算机的第二投屏软件提供的二维码,从而手机100和便携计算机可以建立连接以及均进入多屏协同模式,或者,用户通过手机100上的第一投屏软件扫描便携计算机的第二投屏软件提供的二维码的操作只用于两个设备进入多屏协同模式,而这两个设备在此之前已建立了连接,例如建立了蓝牙连接或Wi-Fi连接等。
或者,用户可以在便携计算机的第二投屏软件和手机100的第一投屏软件上登录同一账户,例如在便携计算机的第二投屏软件和手机100的第一投屏软件上输入相同的账号和密码,这样无需扫描二维码也能使得手机100和便携计算机可以建立连接以及进入多屏协同模式,则预设方式就是用户在便携计算机的第二投屏软件和手机100的第一投屏软件上输入相同的账号和密码的操作的方式。或者,用户在便携计算机的第二投屏软件和手机100的第一投屏软件上输入相同的账号和密码的操作只用于两个设备进入多屏协同模式,而这 两个设备在此之前已建立了连接,例如建立了蓝牙连接或Wi-Fi连接等。
其中,如果手机100安装了第一投屏软件,则第一管家软件能够捕捉用户针对第一投屏软件所进行的操作,以及第一管家软件能够将来自便携计算机(或者说,来自第二管家软件)的指令发送给第一投屏软件;同理,如果便携计算机安装了第二投屏软件,则第二管家软件能够捕捉用户针对第二投屏软件所进行的操作,以及第二管家软件能够将来自手机100(或者说,来自第一管家软件)的指令发送给第二投屏软件。
或者,用户还可以通过其他方式使得手机100和便携计算机均进入多屏协同模式,具体方式不做限制。
另外可参考图3C,在进入多屏协同模式后,便携计算机的显示屏上会显示手机100的当前的显示界面202,该显示界面202也可以称为投屏界面202或者录屏界面202,投屏界面202是手机100的显示界面的镜像,在便携计算机上显示的投屏界面202与手机100的显示界面是同源的,即,都源于手机100。例如,手机100将手机的显示界面的信息发送给便携计算机,从而便携计算机可按照与手机100的显示屏相同大小的比例显示该投屏界面202。在便携计算机显示投屏界面202后,用户也可以对投屏界面202进行放大或缩小等操作,以改变投屏界面202的面积,或者用户还可以对投屏界面202进行拖拽等操作,以改变投屏界面202在便携计算机的显示屏上的位置。
在手机100和便携计算机均进入多屏协同模式后,按照本申请提供的技术方案,用户可以选择在便携计算机侧观看手机上的内容,便携计算机的显示屏的尺寸较大,通过大屏观看能够为用户带来较好的观看体验;或者,用户也可以选择在手机侧观看手机上的内容,手机更便于携带,可满足用户随时观看的需求。下面介绍如何实现选择设备进行观看。
例如,用户在便携计算机上显示的投屏界面202上进行了第一操作,第一操作例如为触摸操作,可参考图4A,第一操作为用户用手指触摸投屏界面202上的“文件3”这一文件图标的操作,这表示用户想要打开文件3。便携计算机的显示屏上的触摸传感器可采集(或,捕捉)第一操作的事件信息,或者说,便携计算机的显示屏上的触摸传感器可捕捉用户的第一操作,并获得第一操作对应的事件信息,该事件信息可指示第一操作。因为第一操作所针对的区域是投屏界面202,因此触摸传感器可将采集的第一操作的事件信息发送给第二管家软件。第一操作的事件信息例如包括便携计算机的标识,可选的,还可以包括第一操作的位置信息等。第一操作的位置信息例如为第一操作在投屏界面202内的相对位置信息,这样,即使投屏界面202在便携计算机的显示屏上的位置不同,而第一操作的相对位置信息是不变的。对于手机100来说,根据手机100的显示屏194与投屏界面202的面积转换比例,以及第一操作的相对位置信息,就可以确定第一操作所对应的文件。
或者,第一操作也可以是声控操作、手势操作、或在便携计算机的显示屏上进行按压的操作等其他操作,则便携计算机内采集第一操作的传感器也会有所不同。本申请实施例对于第一操作的类型不做限制。
第二管家软件将第一操作的事件信息发送给第一管家软件,发送方式取决于手机100和便携计算机之间的连接方式,例如NFC或蓝牙或Wi-Fi或移动网络等。第一管家软件接收第一操作的事件信息后,由于第一操作的事件信息包括便携计算机的标识,因此第一管家软件确定第一操作的事件信息对应于便携计算机,即,确定第一操作是在便携计算机上进行的操作,或者说,确定第一操作对应的文件图标(例如,“文件3”这一文件图标)位于便携计算机的显示界面上。那么,第一管家软件可以确定第一操作对应的文件的存储路 径,例如,第一操作的事件信息包括第一操作在投屏界面202内的相对位置信息,则第一管家软件根据投屏界面202和手机100的显示屏194之间的面积转换比例,以及第一操作的相对位置信息,可以确定第一操作所对应的文件,例如文件3,从而第一管家软件可以确定文件3的存储路径。第一管家软件可以在手机100的分布式文件管理***中创建该文件对应的软链接,该软链接指向该文件的存储路径,例如该软链接指向该文件在手机的SD卡中的存储路径或该文件的URL等。另外,该软链接还与该文件的元数据相关联。手机100端的分布式文件管理***可以将第一操作所对应的文件的元数据同步到便携计算机端的分布式文件管理***。
一个文件的元数据,也可以称为该文件的描述信息等,一个文件的元数据例如包括该文件的存储路径,除此之外,可选的,还可以包括如下的一项或多项:该文件的名称,该文件的类型信息,或,该文件的大小信息。例如,一个文件的元数据可包括该文件的存储路径信息;或者,一个文件的元数据可包括该文件的类型信息和该文件的存储路径信息;或者,一个文件的元数据可包括该文件的大小信息、该文件的名称和该文件的存储路径信息,等等。一个文件的存储路径信息所指示的存储路径,可以是指该文件在手机100中的存储路径。在如上的示例中,第一操作对应的文件为文件3,则手机100端的分布式文件管理***可将文件3的元数据同步到便携计算机端的分布式文件管理***。
第一管家软件可获得手机100端的分布式文件管理***中创建的软链接的路径,第一管家软件可将该软链接的路径发送给第二管家软件。另外,第一管家软件也能够获得该文件的元数据,例如该文件的类型信息等,第一管家软件也可以将获得的该文件的元数据发送给第二管家软件。
第二管家软件根据该文件的类型信息等,确定并调用能够打开该文件的应用,例如第二管家软件确定第二应用能够打开该文件。在本申请实施例中,如果“软件”和“应用”这两个名词可互换,则“第二应用”也可以称为“第二软件”;或者,如果“软件”和“应用”不是同一层级的概念,不能互换,则可认为第二应用内设置了一个或多个软件模块。例如,文件3的类型信息指示文件3的类型为图像类型,则第二管家软件可确定图像应用能够打开文件3;又例如,文件3的类型信息指示文件3的类型为Microsoft Word文档,则第二管家软件可确定Microsoft office word应用能够打开文件3。另外,第二管家软件也将该软链接的路径发送给第二应用。
第二应用根据该软链接的路径,打开该软链接。则,便携计算机端的分布式文件管理***可以根据该软链接对应的元数据,从手机100中获取文件3,对此可以理解为,从手机100中获取文件3的数据。例如,便携计算机端的分布式文件管理***可以根据该软链接对应的元数据所包括的文件3的存储路径信息,从手机100中获取文件3。从而,第二应用就能够打开文件3。
可参考图4B,为便携计算机上打开了文件3的示意图,图4B中的界面203即表示便携计算机上打开的文件3的界面,图4B以文件3是word文件为例。在便携计算机上打开文件后,用户可调整界面203的大小,如图4B中界面203和投屏界面202可一起显示。或者,界面203也可以覆盖投屏界面202,如图4C所示。或者,用户可以将投屏界面202设置为“始终显示在最顶层”,则投屏界面202的部分区域或全部区域也可能位于界面203内,如图4D所示。
在这种方式下,在便携计算机上打开了文件3,则在手机100上不会打开文件3。
另外,便携计算机还可将文件3的数据存储在便携计算机中,例如便携计算机可通过第二应用可将文件3的数据存储在便携计算机的本地文件***中,例如可作为临时文件来存储。
用户可在便携计算机上通过第二应用观看文件3,用户也可以在便携计算机上通过第二应用对文件3进行编辑操作,例如可在文件3中删除内容、增加内容或修改内容等。用户在对文件3操作完毕后,可以保存文件3,则便携计算机可以更新存储的文件3的数据,得到文件3的更新数据。文件3的更新数据可以理解为是更新后的文件3,相当于,便携计算机是用文件3的更新数据覆盖了便携计算机存储的文件3的原数据。便携计算机可以将文件3的更新数据发送给手机100,例如,便携计算机可通过便携计算机的分布式文件管理***将第二文件同步给手机100的分布式文件管理***,则手机100可以用文件3的更新数据覆盖手机100的本地文件***所存储的文件3的原数据,这样就实现了文件3的更新。其中,便携计算机可以在用户每次更新文件3后都将文件3的更新数据发送给手机100,以使得文件3在手机侧能够得到及时更新;或者,便携计算机也可以在用户关闭文件3后再将文件3的更新数据发送给手机100,以减少发送更新数据的次数,节省传输开销。另外,便携计算机在将文件3的更新数据发送给手机100后,便携计算机可以删除存储的文件3的更新数据,例如可删除该临时文件,以释放存储空间。
如上介绍的是在进入多屏协同模式后,用户在便携计算机上进行操作的过程。或者,在进入多屏协同模式后,用户也可能会继续在手机100上进行操作。例如用户可能处于移动状态,在移动过程中观看手机100更为方便,或者用户距离便携计算机较远,用户就近观看手机100更为便利。下面介绍用户在手机上操作的情况下设备如何响应。
例如,用户在手机100上进行了第二操作(或者,也可以称为第一操作),第二操作例如为触摸操作,可参考图5A,第二操作为用户用手指触摸手机的显示界面上的“文件3”这一文件图标的操作,这表示用户想要打开文件3。手机100的显示屏194上的触摸传感器180K可采集(或者,检测)第二操作的事件信息,或者说,手机100的显示屏194上的触摸传感器180K可捕捉第二操作,并获得第二操作的事件信息,第二操作的事件信息可指示第二操作。触摸传感器180K可将采集的第二操作的事件信息发送给第一管家软件。第二操作的事件信息例如包括手机100的标识,可选的,还可以包括第二操作的位置信息等。第二操作的位置信息例如为第二操作在显示屏194内的绝对位置信息。
第一管家软件获得第二操作的事件信息后,由于第二操作的事件信息包括手机100的标识,例如来自触摸传感器180K,因此第一管家软件可确定第二操作的事件信息对应于手机100,即,确定第二操作是在手机100上进行的操作,或者说,确定第二操作对应的文件图标(例如,“文件3”这一文件图标)位于手机100的显示界面上。那么,第一管家软件可以根据第二操作的位置信息确定第二操作所对应的文件,例如文件3,第一管家软件可以再根据文件3的类型确定能够打开文件3的应用,例如第一应用。在本申请实施例中,如果“软件”和“应用”这两个名词可互换,则“第一应用”也可以称为“第一软件”;或者,如果“软件”和“应用”不是同一层级的概念,不能互换,则可认为第一应用内设置了一个或多个软件模块。其中,前文所述的第二应用和这里的第一应用可以是同一种应用,例如均为Microsoft office word应用,只是因为安装在不同的设备中,所以名称不同;或者,第一应用和第二应用也可以是不同的应用,例如第一应用为Microsoft office word应用,第二应用为WPS office word应用,但第一应用和第二应用都能打开同种类型的文件。
接着,第一管家软件可以通过第一应用在手机100上打开手机100的本地文件***中存储的文件3,可参考图5B,为手机100上打开了文件3的示意图,图5B中的界面204即表示手机100的显示屏194上打开的文件3的界面。在手机100上打开文件后,用户可调整界面204的大小。
在这种方式下,在手机100上打开了文件3,则在便携计算机上不会打开文件3。
用户可在手机100上通过第一应用观看文件3,用户也可以在手机100上通过第一应用对文件3进行编辑操作,例如可在文件3中删除内容、增加内容或修改内容等。用户在对文件3操作完毕后,可以保存文件3,则手机100可以更新手机100的本地文件***中所存储的文件3的数据。
可参考图6,为采用本申请实施例如上所提供的方法后,在多屏协同模式下打开文件的过程的一种示意图。
图6中的1,表示用户点击手机100的显示界面上显示的文件,手机100上安装的第一管家软件(例如,图6中的手机助手)获得用户的点击操作信息,并进行点击响应。或者,图6中的1,表示用户点击便携计算机显示屏上的手机的投屏界面202中显示的文件,便携计算机上安装的第二管家软件(例如,图6中的PC管家)获得用户的点击操作信息,并进行点击响应。
图6中的2,表示第二管家软件将获得的用户的点击操作信息发送给第一管家软件。
图6中的3,表示第一管家软件进行焦点判断,即判断用户的操作焦点位于哪里。在本申请实施例中,例如第一管家软件可根据点击响应的参数确定用户的焦点。例如,如果是第二管家软件发来的点击操作信息,则第一管家软件在进行点击响应时,可将点击响应的参数的取值设置为第一值,而如果是手机100内的传感器(例如触摸传感器180K等)发来的点击操作信息,则第一管家软件在进行点击响应时,可将点击响应的参数的取值设置为第二值。这样第一管家软件在进行焦点判断时,根据点击操作的参数的不同取值就可以确定用户的操作究竟针对哪个设备,或者说,能够确定用户的操作焦点位于哪个设备。
图6中的4,就表示第一管家软件根据焦点判断的结果,会进行不同的处理。
如果第一管家软件确定用户的操作焦点位于便携计算机,则第一管家软件可进行文件打开截断处理。这是因为,用户的操作焦点位于便携计算机,因此文件需要在便携计算机上打开,手机100上不打开该文件,因此手机100需要对原本需要进行的打开该文件的操作进行截断。
图6中的5,表示第一管家软件获取该文件的路径。这里所述的该文件的路径,是指该文件的绝对路径,即,该文件在手机100中的存储路径。
图6中的6,表示第一管家软件将在手机中的分布式文件管理***中创建软链接,该软链接指向第一存储路径,第一存储路径为该文件在手机中的存储路径,例如该文件在手机的SD中的存储路径或该文件的URL等。另外,该软链接还与该文件的元数据相关联,该文件的元数据例如包括该文件的存储路径,可选的,还可以包括该文件的类型信息等。
图6中的7,表示手机100端的分布式文件管理***将该文件的元数据同步到便携计算机端的分布式文件管理***。
图6中的8,表示第一管家软件获得手机100端的分布式文件管理***中创建的该软链接的路径。
图6中的9,表示第一管家软件将手机100端的分布式文件管理***中创建的该软链 接的路径发送给第二管家软件。另外,第一管家软件也能够获得该文件的元数据,例如该文件的类型信息等,第一管家软件也可以将获得的该文件的元数据发送给第二管家软件。
图6中的10和11,表示第二管家软件根据该文件的类型信息等,调用能够打开该文件的应用,另外,第二管家软件也将软链接的路径发给该应用。图6以该应用是Microsoft office应用为例。
图6中的12,表示office应用根据该软链接的路径,打开该软链接。
图6中的13,表示便携计算机端的分布式文件管理***根据该软链接对应的元数据(例如根据元数据所包括的该文件的存储路径),到手机100端的分布式文件管理***中请求获得该文件。
图6中的14,表示手机100端的分布式文件管理***读取该软链接实际指向的文件,例如手机100端的分布式文件管理***从手机100的本地文件***中读取该文件。另外,手机100端的分布式文件管理***还将读取的文件发送给便携计算机端的分布式文件管理***,从而便携计算机端的office应用能够打开该文件。另外,便携计算机还可将文件3的数据存储在便携计算机中,例如便携计算机可通过第二应用可将文件3的数据存储在便携计算机的本地文件***中,例如可作为临时文件来存储,用户可以通过便携计算机端的第二应用对文件3进行修改、删除内容或增加内容等操作,则便携计算机的本地文件***存储的该临时文件可以得到更新。在更新后,便携计算机可将更新的文件发送给手机100,使得手机100能够根据该更新的文件更新手机100的本地文件***中存储的原文件。
图6中的5~14介绍的都是在便携计算机上打开文件的操作。或者,如果第一管家软件确定用户的操作焦点位于手机100,那么手机100可以调用能够打开该文件的应用,例如第一应用,接着可参考图6中的15,第一应用根据该文件在手机100的本地文件***中的存储路径打开该文件。
针对第一设备里的同一个文件,采用本申请实施例提供的方法后,在第一设备上操作和在第一设备镜像到第二设备上的协同窗口(例如投屏界面202)内操作,最终的体验效果是不一样的,即使在多屏协同场景下,第一设备也可以根据用户当前的焦点(例如用户的操作所针对的设备),智能地选择通过其中一个设备去打开-编辑-保存相应的文件,用户无需离开或者切换当前聚焦的屏幕,就能够完成办公等需求,以给予用户更佳的预览和编辑体验。
在前面介绍的方式中,如果用户在手机100上进行了操作,则手机100就会打开相应的文件。接下来再介绍一种方式,在这种方式下,如果用户在手机100上进行了操作,手机100可以为用户提供选项,由用户选择是在手机100上打开对应的文件还是在便携计算机上打开对应的文件。通过这种方式,使得最终打开文件的设备更为符合用户的需求。
例如,用户在手机100上进行了第二操作,第二操作例如为触摸操作,第二操作用于打开第一文件。可继续参考图5A,第二操作为用户用手指触摸手机的显示界面上的“文件3”这一文件图标的操作,这表示用户想要打开文件3。手机100的显示屏194上的触摸传感器180K可捕捉第二操作,并获得第二操作的事件信息,触摸传感器180K可将第二操作的事件信息发送给第一管家软件。第二操作的事件信息例如包括手机100的标识,可选的,还可以包括第二操作的位置信息等。第二操作的位置信息例如为第二操作在显示屏194内的绝对位置信息。应理解:本文所涉及的触摸操作可以被悬浮操作,语音指令等替换。本文中以触摸操作为例进行说明,但这并不构成对本申请实施例的限制。
第一管家软件获得第二操作的事件信息后,由于第二操作的事件信息包括手机100的标识,因此第一管家软件可确定第二操作的事件信息对应于手机100,即,确定第二操作是在手机100上发生的操作,或者说,确定第二操作对应的文件图标(例如,“文件3”这一文件图标)位于手机100的显示界面上。那么,第一管家软件可以通过显示屏194输出提示信息205,该提示信息205可包括一个或多个选项,该提示信息205可用于确定打开文件3的设备。例如可参考图7A,为手机100的显示屏194上显示的一种提示信息205的示意图。该提示信息205以包括4个选项为例,其中的一个选项为“电脑端应用”,这表示在协同设备(例如便携计算机)上打开文件3,剩余的3个选项分别为“1”、“2”和“3”,分别代表应用1、应用2和应用3,这3个应用都是手机100上的应用,也都是能够打开文件3的应用。其中,手机100可能有一个或多个应用能打开第一文件,如果手机100上只有一个应用能打开第一文件,则提示信息205除了显示“电脑端应用”这个选项外只显示另一个选项即可;或者,如果手机100上有多个应用能打开第一文件,则提示信息205除了显示“电脑端应用”这个选项之外,可显示能够打开第一文件的全部应用对应的选项或部分应用对应的选项。如果用户选择了“电脑端应用”,则表明用户选择在协同设备上打开第一文件,而用户选择了除“电脑端应用”之外的其他的任意一个应用,则表明用户选择在手机100上通过该应用打开第一文件。
可参考图7B,例如用户用手指触摸了提示信息205包括的“电脑端应用”这一选项,这表明用户选择了“电脑端应用”,则手机100端的分布式文件管理***可以将第一操作所对应的第一文件的元数据同步到便携计算机端的分布式文件管理***。关于文件的元数据,可参考前文的介绍。以及在便携计算机获得第一文件的元数据后的操作过程,也可参考前文对于在便携计算机上打开文件3的过程的介绍。
可选的,在图7A或图7B中,手机100输出的提示信息205可以不包括便携计算机上的具体选项,即,用户无法根据手机100输出的提示信息205选择便携计算机上的具体的应用。例如图7A或图7B中,如果用户要选择在便携计算机上打开,则可以选择“电脑端应用”这个选项,而该选项本身只对应便携计算机,并不对应便携计算机上的具体的应用。如果用户选择在便携计算机上打开,便携计算机再根据第一文件的类型选择相应的应用打开第一文件。或者还有一种方式,手机100所输出的提示信息205也可以包括便携计算机上的选项。例如可参考图7C,为手机100的显示屏194上显示的另一种提示信息205的示意图。该提示信息205以包括5个选项为例,这5个选项分别为“1”、“2”、“3”、“4”和“5”,分别表示应用1、应用2、应用3、应用4和应用5。其中的应用4和应用5是便携计算机上的应用,也都是能够打开文件3的应用,这表示在协同设备(例如便携计算机)上打开文件3;应用1、应用2和应用3都是手机100上的应用,也都是能够打开文件3的应用。在图7B中,“4”和“5”的显示字体较大较粗,表示应用4和应用5是便携计算机上的应用,或者也可以通过其他提示方式来表示相应的应用是便携计算机上的应用,例如可显示提示文字等。通过这种方式,用户可以选择在便携计算机上究竟通过哪种应用来打开第一文件,使得用户的观看体验更好。
或者,可参考图7D,例如用户用手指触摸了“1”这一选项,这表明用户选择了在手机100上通过“1”对应的应用1打开第一文件,则第一管家软件可以调用“1”对应的应用1打开文件3。在第一管家软件调用“1”对应的应用1打开文件3之后的操作过程,也可参考前文对于在手机100上打开文件3的过程的介绍。
例如,有时用户虽然是在手机100上操作,但实际上是希望在便携计算机上将相应的文件展示给其他用户观看,如果是这种场景,则通过本申请实施例提供的技术方案,用户就可以选择在便携计算机上打开,从而完成展示过程。可见,通过本申请实施例提供的技术方案,为用户提供了选择机会,更便于用户选择合适的设备打开相应的文件。
在多屏协同模式下,第二设备上显示的协同窗口是第一设备的显示界面的镜像,所以按照现有的方式,用户无论在第一设备还是在第二设备的协同窗口内操作,操作过程都是同源的,最终也都会在第二设备上真正响应用户的操作。而本申请实施例是通过技术实现,打破了这种“同源”的壁垒,第一设备会增加判断机制,针对同一个文件,如果用户在不同的设备上进行操作,则可能会通过不同的设备来打开该文件,从而产生了区别于当前技术的差异化体验,能够给予用户更好的使用体验。而且用户也不需要在退出多屏协同模式后才能在第一设备上打开相应的文件,简化了用户的操作步骤,也减少了设备的响应过程,有助于节省设备的功耗。
结合上述实施例及相关附图,本申请实施例提供第一种打开文件的方法,该方法可以应用于多屏协同场景中。示例性的,该方法涉及第一设备和第二设备,第一设备的结构可以参考图1。下面请参考图8,介绍该方法的流程。为了更便于理解,在下文的介绍过程中,以第一设备是手机100,第二设备是便携计算机为例。
S801、手机100和便携计算机通过预设方式进入多屏协同模式。例如,手机100和便携计算机只要建立连接就会进入多屏协同模式,那么S801也可以替换为,手机100和便携计算机建立连接。或者,手机100和便携计算机需要先建立连接,之后用户再进行相应的操作,使得手机100和便携计算机进入多屏协同模式,那么在S801之前,手机100和便携计算机需要先建立连接。
手机100和便携计算机要进入多屏协同模式,可以有多种操作方式。例如用户可手持手机100碰一碰便携计算机,二者可建立NFC连接,并进入多屏协同模式,则预设方式就是“碰一碰”的方式;或者预设方式也可以是其他方式,具体内容可参考前文的介绍。
在手机100和便携计算机进入多屏协同模式后,便携计算机的显示屏上会显示第一界面,第一界面是手机100的显示界面的镜像。对此可以理解为,手机100显示第一界面,便携计算机显示第二界面,手机100可将第一界面投屏在便携计算机的显示屏,或者说投屏在第二界面上,则在投屏后,第二界面包括第一界面。第一界面可包含至少一个文件图标,其中的每个文件图标对应一个文件,至少一个文件图标就对应至少一个文件,至少一个文件保存在手机100中。例如一种第一界面为图3C所示的投屏界面202,其中的“文件1”、“文件2”、“文件3”,就表示3个文件图标,这3个文件图标对应3个文件,分别为文件1、文件2和文件3。
关于S801的更多内容,可参考前文的介绍。
S802、用户在便携计算机上进行操作,便携计算机采集用户的操作,并获得该操作对应的事件信息。例如将该操作称为第一操作,便携计算机可捕捉第一操作,并获得第一操作的事件信息。第一操作可以作用于文件图标,例如将该文件图标称为第一文件图标,第一文件图标可以属于所述的至少一个文件图标,即,用户是在便携计算机显示的第二界面内包括的第一界面内的第一文件图标上进行的第一操作。其中,第一文件图标对应一个文件,例如将该文件称为第一文件。关于第一操作的事件信息的介绍,可参考前文相关内容。
例如第一操作为触摸操作,对此的示例可参考图4A。或者第一操作也可以是其他类型 的操作,例如手势操作或声控操作或悬浮操作等。用户进行第一操作的目的是为了打开第一文件,因此第一操作是用于打开第一文件的操作。
关于S802的更多内容,可参考前文的介绍。
S803、便携计算机将第一操作的事件信息发送给手机100,手机100接收来自便携计算机的第一操作的事件信息。手机100接收第一操作的事件信息,也可以相当于手机100检测到作用于第一文件图标的操作。
例如,便携计算机内的传感器(例如触摸传感器或其他传感器)采集第一操作的事件信息,将第一操作的事件信息发送给便携计算机内安装的第二管家软件。第二管家软件可将第一操作的事件信息发送给手机100内安装的第一管家软件,则第一管家软件接收来自第二管家软件的第一操作的事件信息。第一管家软件接收第一操作的事件信息,也可以相当于第一管家软件检测到作用于第一文件图标的操作。
关于S803的更多内容,可参考前文的介绍。
S804、手机100确定第一操作的事件信息对应于便携计算机。或者说,手机100确定第一操作作用于便携计算机。或者说,手机100确定第一操作(或,第一操作的事件信息)作用于便携计算机的显示屏。或者说,手机100确定第一操作对应的文件图标位于便携计算机的显示界面上。其中,第一操作对应于便携计算机是指,第一操作是在便携计算机上进行的操作。
例如,第一管家软件接收第一操作的事件信息后,由于第一操作的事件信息包括第二设备的标识,因此第一管家软件确定第一操作的事件信息对应于便携计算机,即,确定第一操作是在便携计算机上进行的操作,或者说,确定第一操作对应的文件图标位于便携计算机的显示界面上。例如,第一操作的事件信息表明第一操作是触摸操作,第一管家软件可确定第一操作是在便携计算机的显示屏上进行的操作,或者说,确定第一操作对应的文件图标位于便携计算机的显示界面上。
关于S804的更多内容,可参考前文的介绍。
S805、手机100确定第一操作的事件信息对应的文件为第一文件,或者说,手机100确定第一操作的事件信息对应的第一文件的存储路径,或者说,手机100确定第一操作对应于第一文件。
例如,第一操作的事件信息包括第一操作在第一界面内的相对位置信息,则第一管家软件根据第一界面和手机100的显示屏194之间的面积转换比例,以及第一操作的相对位置信息,可以确定第一操作所对应的文件,例如为第一文件,第一文件例如为前文所述的文件3。另外,第一管家软件可以确定第一文件的存储路径,且,第一管家软件在手机100的分布式文件管理***中创建第一文件对应的软链接,该软链接指向第一文件的存储路径,例如该软链接指向第一文件在手机的SD卡中的存储路径或该文件的URL等。另外,该软链接还与第一文件的元数据相关联。
关于S805的更多内容,可参考前文的介绍。
S806、手机100将第一文件的元数据发送给便携计算机,便携计算机接收来自手机100的第一文件的元数据。
第一文件的元数据例如包括如下的一项或多项:第一文件的名称,第一文件的类型信息,第一文件的大小信息,或,第一文件的存储路径信息。关于第一文件的元数据的更多介绍,可参考前文。
例如,手机100端的分布式文件管理***可以将第一操作所对应的文件的元数据同步(或,发送)到便携计算机端的分布式文件管理***。
关于S806的更多内容,可参考前文的介绍。
S807、便携计算机根据第一文件的元数据确定用于打开第一文件的应用,例如称为第二应用。
第一管家软件可获得手机100端的分布式文件管理***中创建的软链接的路径,第一管家软件可将该软链接的路径发送给第二管家软件。另外,第一管家软件也能够获得该文件的元数据,例如该文件的类型信息等,第一管家软件也可以将获得的该文件的元数据发送给第二管家软件。第二管家软件根据该文件的类型信息等,确定并调用能够打开该文件的应用,例如第二管家软件确定第二应用能够打开该文件。
关于S807的更多内容,可参考前文的介绍。
S808、便携计算机调用第二应用,以打开第一文件。
根据第一文件的元数据,从手机100中获取第一文件,即,获取第一文件的数据。
便携计算机调用第二应用,第二应用根据该软链接的路径,打开该软链接。则,便携计算机端的分布式文件管理***可以根据该软链接对应的元数据,从手机100中获取第一文件,对此可以理解为,从手机100中获取第一文件的数据。例如,便携计算机端的分布式文件管理***可以根据该软链接对应的元数据所包括的第一文件的存储路径信息,从手机100中获取第一文件。从而,第二应用就能够打开第一文件。另外,便携计算机还可将第一文件的数据存储在便携计算机中,例如便携计算机可通过第二应用可将第一文件的数据存储在便携计算机的本地文件***中,例如可作为临时文件来存储。
关于第二管家软件打开第一文件的示例,可参考图4B~图4D中的任一个附图。
关于S808的更多内容,可参考前文的介绍。
S809、用户在便携计算机上编辑第一文件,并保存编辑后的第一文件。编辑后的第一文件例如称为第二文件,或者也可以称为更新文件等,对于该文件的名称不做限制。
用户可在便携计算机上观看第一文件,也可以在便携计算机上对第一文件进行编辑操作,例如可在第一文件中删除内容、增加内容或修改内容等。用户在对第一文件操作完毕后,可以保存第一文件,则便携计算机可以更新所存储的第一文件,或者说更新第一文件的数据,得到第一文件的更新数据,第一文件的更新数据可以理解为是更新后的第一文件,也就是第二文件。
关于S809的更多内容,可参考前文的介绍。
S810、便携计算机将第二文件发送给手机100,手机100接收来自便携计算机的第二文件。
便携计算机可以将第二文件发送给手机100,例如便携计算机可通过便携计算机的分布式文件管理***将第二文件同步给手机100的分布式文件管理***,从而手机100可以用第二文件覆盖手机的本地文件***所存储的第一文件,这样就实现了第一文件的更新。其中,便携计算机可以在用户每次更新第一文件后都将得到的第二文件发送给手机100,以使得第一文件在手机侧能够得到及时更新;或者,便携计算机也可以在用户关闭第一文件后再将得到的第二文件发送给手机100,以减少发送更新数据的次数,节省传输开销。
另外,便携计算机在将第二文件发送给手机100后,便携计算机可以删除存储的第二文件,以释放存储空间。
关于S810的更多内容,可参考前文的介绍。
S811、用户在手机100上进行操作,手机100采集用户的操作,并获得该操作对应的事件信息,或者说,手机100检测到该操作对应的事件信息。例如将该操作称为第一操作,手机100可捕捉第一操作,并获得第一操作的事件信息。第一操作可以作用于文件图标,例如将该文件图标称为第一文件图标,第一文件图标可以属于所述的至少一个文件图标,即,用户是在手机100上显示的第一界面内的第一文件图标上进行的第一操作。其中,第一文件图标对应一个文件,例如将该文件称为第一文件。
手机100采集(或,检测)用户的第一操作的事件信息,也就相当于手机100检测到作用于第一文件图标的第一操作。
例如第一操作为触摸操作,对此的示例可参考图5A。或者第一操作也可以是其他类型的操作,例如手势操作或声控操作或悬浮操作等。用户进行第一操作的目的是为了打开第一文件,因此第一操作是用于打开第一文件的操作。
关于S811的更多内容,可参考前文的介绍。
S812、手机100确定第一操作的事件信息对应于手机100。或者说,手机100确定第一操作作用于手机100。或者说,手机100确定第一操作(或,第一操作的事件信息)作用于手机100的显示屏。或者说,手机100确定第一操作对应的文件图标位于手机100的显示界面上。其中,第一操作对应于手机100是指,第一操作是在手机100上进行的操作。
例如,第一管家软件获得第一操作的事件信息后,由于第一操作的事件信息包括手机100的标识,因此第一管家软件可确定第一操作的事件信息对应于手机100,即,确定第二操作是在手机100上进行的操作,或者说,确定第二操作对应的文件图标位于手机100的显示界面上。例如,第一操作的事件信息表明第一操作是触摸操作,第一管家软件可确定该触摸操作是在手机100的显示屏上进行的操作,或者说,确定该触摸操作对应的文件图标位于手机100的显示界面上。
关于S812的更多内容,可参考前文的介绍。
S813、手机100确定第一操作的事件信息对应的文件为第一文件,或者说,手机100确定第一操作的事件信息对应的第一文件的存储路径,或者说,手机100确定第一操作对应于第一文件。
例如,第一操作的事件信息包括第一操作在手机的显示界面内的绝对位置信息,则第一管家软件根据第一操作的位置信息,可以确定第一操作所对应的文件,例如为第一文件,或者说,第一管家软件可确定第一文件的存储路径,第一文件例如为前文所述的文件3。
关于S813的更多内容,可参考前文的介绍。
S814、手机100调用第一应用,以打开第一文件。
例如,第一管家软件可以根据第一文件的类型确定能够打开第一文件的应用,例如第一应用。
关于S814的更多内容,可参考前文的介绍。
S815、用户在手机100上编辑第一文件,并保存编辑后的第一文件。编辑后的第一文件例如称为第二文件。
关于S815的更多内容,可参考前文的介绍。
用户可在手机100上观看第一文件,也可以在手机100上对第一文件进行编辑操作,例如可在第一文件中删除内容、增加内容或修改内容等。用户在对第一文件操作完毕后, 可以保存第一文件,则手机100可以更新内存中所存储的第一文件,或者说更新第一文件的数据,得到第一文件的更新数据,第一文件的更新数据可以理解为是更新后的第一文件,也就是第二文件。
其中,S802~S810和S811~S815是两种并列的方案,可能并不会同时发生。例如用户在进行操作时,如果选择了在便携计算机上进行操作,则可执行S802~S810,而如果用户选择了在手机100上进行操作,则可执行S811~S815。
针对第一设备里的同一个文件,采用本申请实施例提供的方法后,在手机100上操作和在手机100镜像到便携计算机上的协同窗口(例如投屏界面202)内操作,最终的体验效果是不一样的,即使在多屏协同场景下,手机100也可以根据用户当前的焦点(例如用户的操作所针对的设备),智能地选择通过其中一个设备(例如手机100或便携计算机)去打开-编辑-保存相应的文件,用户无需离开或者切换当前聚焦的屏幕,就能够完成办公等需求,以给予用户更佳的预览和编辑体验。
在第一种打开文件的方法中,如果用户在手机100上进行了操作,则手机100就会打开相应的文件。接下来,本申请实施例还提供第二种打开文件的方法,在这种方法中,如果用户在手机100上进行了操作,手机100可以为用户提供选项,由用户选择是在手机100上打开对应的文件还是在便携计算机上打开对应的文件。本申请实施例提供的第二种打开文件的方法可以应用于多屏协同场景中。示例性的,该方法涉及第一设备和第二设备,第一设备的结构可以参考图1。下面请参考图9,介绍该方法的流程。为了更便于理解,在下文的介绍过程中,以第一设备是手机100,第二设备是便携计算机为例。
S901、手机100和便携计算机通过预设方式进入多屏协同模式。
关于S901的更多内容,可参考图8所示的实施例中的S801,或可参考前文的介绍。
S902、用户在便携计算机上进行操作,便携计算机采集用户的操作,并获得该操作对应的事件信息。例如将该操作称为第一操作,便携计算机可捕捉第一操作,并获得第一操作的事件信息。第一操作可以作用于文件图标,例如将该文件图标称为第一文件图标,第一文件图标可以属于所述的至少一个文件图标,即,用户是在便携计算机显示的第二界面内包括的第一界面内的第一文件图标上进行的第一操作。其中,第一文件图标对应一个文件,例如将该文件称为第一文件。
关于S902的更多内容,可参考图8所示的实施例中的S802,或可参考前文的介绍。
S903、便携计算机将第一操作的事件信息发送给手机100,手机100接收来自便携计算机的第一操作的事件信息。手机100接收第一操作的事件信息,也可以相当于手机100检测到作用于第一文件图标的操作。
关于S903的更多内容,可参考图8所示的实施例中的S803,或可参考前文的介绍。
S904、手机100确定第一操作的事件信息对应于便携计算机。或者说,手机100确定第一操作作用于便携计算机。或者说,手机100确定第一操作(或,第一操作的事件信息)作用于便携计算机的显示屏。或者说,手机100确定第一操作对应的文件图标位于便携计算机的显示界面上。其中,第一操作对应于便携计算机是指,第一操作是在便携计算机上进行的操作。
关于S904的更多内容,可参考图8所示的实施例中的S804,或可参考前文的介绍。
S905、手机100确定第一操作的事件信息对应的文件为第一文件,或者说,手机100确定第一操作的事件信息对应的第一文件的存储路径,或者说,手机100确定第一操作的 对应于第一文件。
关于S905的更多内容,可参考图8所示的实施例中的S805,或可参考前文的介绍。
S906、手机100将第一文件的元数据发送给便携计算机,便携计算机接收来自手机100的第一文件的元数据。
关于S906的更多内容,可参考图8所示的实施例中的S806,或可参考前文的介绍。
S907、便携计算机根据第一文件的元数据确定用于打开第一文件的应用,例如称为第二应用。
关于S907的更多内容,可参考图8所示的实施例中的S807,或可参考前文的介绍。
S908、便携计算机调用第二应用,以打开第一文件。
关于S908的更多内容,可参考图8所示的实施例中的S808,或可参考前文的介绍。
S909、用户在便携计算机上编辑第一文件,并保存编辑后的第一文件。编辑后的第一文件例如称为第二文件,或者也可以称为更新文件等,对于该文件的名称不做限制。
关于S909的更多内容,可参考图8所示的实施例中的S809,或可参考前文的介绍。
S910、便携计算机将第二文件发送给手机100,手机100接收来自便携计算机的第二文件。
关于S910的更多内容,可参考图8所示的实施例中的S810,或可参考前文的介绍。
S911、用户在手机100上进行操作,手机100采集用户的操作信息,并获得该操作对应的事件信息,或者说,手机100检测到该操作对应的事件信息。例如将该操作称为第一操作,手机100可捕捉第一操作,并获得第一操作的事件信息。第一操作可以作用于文件图标,例如将该文件图标称为第一文件图标,第一文件图标可以属于所述的至少一个文件图标,即,用户是在手机100上显示的第一界面内的第一文件图标上进行的第一操作。其中,第一文件图标对应一个文件,例如将该文件称为第一文件。
手机100采集(或,检测)用户的第一操作的事件信息,也就相当于手机100检测到作用于第一文件图标的第一操作。
关于S911的更多内容,可参考图8所示的实施例中的S811,或可参考前文的介绍。
S912、手机100确定第一操作的事件信息对应于手机100。或者说,手机100确定第一操作作用于手机100。或者说,手机100确定第一操作(或,第一操作的事件信息)作用于手机100的显示屏。或者说,手机100确定第一操作对应的文件图标位于手机100的显示界面上。
关于S912的更多内容,可参考图8所示的实施例中的S812,或可参考前文的介绍。
S913、手机100输出提示信息,该提示信息用于确定打开第一文件的设备。
例如,手机100可通过显示屏194输出提示信息,该提示信息可包括一个或多个选项,所述一个或多个选项可用于确定打开第一文件的设备。该提示信息的示例可参考图7A或图7B。
关于S913的更多内容,可参考前文的介绍。
S914、用户选择了该一个或多个选项中的第一选项,手机100检测到用于选择第一选项的操作。
例如可继续参考图7D,用户用手指触摸了“1”这一选项,则触摸传感器180K可检测到该操作,并可以采集该操作的事件信息,在采集该操作的事件信息后,触摸传感器180K可将该操作的事件信息发送给第一管家软件。第一管家软件接收来自触摸传感器180K的 该操作的事件信息后,确定用户选择了在手机100上通过“1”对应的应用1打开第一文件。
第一选项例如对应第一应用,第一应用例如安装在手机100中。
关于S914的更多内容,可参考前文的介绍。
S915、手机100确定第一操作的事件信息对应的文件为第一文件,或者说,手机100确定第一操作的事件信息对应的第一文件的存储路径,或者说,手机100确定第一操作对应于第一文件。
关于S915的更多内容,可参考图8所示的实施例中的S813,或可参考前文的介绍。
S916、手机100调用第一应用,以打开第一文件。
关于S916的更多内容,可参考图8所示的实施例中的S814,或可参考前文的介绍。
S917、用户在手机100上编辑第一文件,并保存编辑后的第一文件。编辑后的第一文件例如称为第二文件。
关于S917的更多内容,可参考图8所示的实施例中的S815,或可参考前文的介绍。
S918、用户选择了提示信息包括的一个或多个选项中的第二选项,手机100检测到用于选择第二选项的操作。
例如可继续参考图7B,用户用手指触摸了“电脑端应用”这一选项,则触摸传感器180K可检测到该操作,并可以采集该操作的事件信息,在采集该操作的事件信息后,触摸传感器180K可将该操作的事件信息发送给第一管家软件。第一管家软件接收来自触摸传感器180K的该操作的事件信息后,确定用户选择了在便携计算机上打开第一文件。
关于S918的更多内容,可参考前文的介绍。
在执行S918之后,可继续执行S906~S910,不再多赘述。
其中,S902~S910和S911~S918及之后的步骤是两种并列的方案,可能并不会同时发生。例如用户在进行操作时,如果选择了在便携计算机上进行操作,则可执行S902~S910,而如果用户选择了在手机100上进行操作,则可执行S911~S918及之后的步骤。另外,S914~S917和S918及之后的步骤,也是两种并列的方案,可能并不会同时发生。例如用户在根据提示信息进行操作时,如果选择了在便携计算机上打开第一文件,则可执行S918及之后的步骤,而如果用户选择了在手机100上打开第一文件,则可执行S914~S917。
例如,有时用户虽然是在手机100上操作,但实际上是希望在便携计算机上将相应的文件展示给其他用户观看,如果是这种场景,则通过本申请实施例提供的技术方案,用户就可以选择在便携计算机上打开,从而完成展示过程。可见,通过本申请实施例提供的技术方案,为用户提供了选择机会,更便于用户选择合适的设备打开相应的文件。
上述本申请提供的实施例中,从手机100和便携计算机作为执行主体的角度对本申请实施例提供的方法进行了介绍。为了实现上述本申请实施例提供的方法中的各功能,移动设备(例如手机100或便携计算机等)可以包括硬件结构和/或软件模块,以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行,取决于技术方案的特定应用和设计约束条件。
如图10所示,本申请另外一些实施例公开了一种电子设备,该电子设备例如为手机(例如手机100)、或Pad、或便携计算机等。该电子设备可以包括:触摸屏1001,其中,所述触摸屏1001包括触敏表面1006和显示屏1007;应用程序1008;一个或多个处理器 1002;一个或多个存储器1003,用于存储一个或多个程序1004;上述各器件可以通过一个或多个通信总线1005连接。所述显示屏1007可以用于显示电子设备中的某个文件的内容;或者所述显示屏1007还可以用于显示电子设备的桌面;或者所述显示屏1007可以用于显示一个图像等等。
其中,当存储器1003中存储的一个或多个程序1004被一个或多个处理器1002执行时,电子设备可以用于执行如图8所示的实施例或图9所示的实施例或其他相应实施例中的各个步骤。
需要说明的是,本申请实施例中对单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。本发明实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。例如,上述实施例中,第一获取单元和第二获取单元可以是同一个单元,也不同的单元。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现,也可以采用硬件结合软件功能单元的形式实现。
上述实施例中所用,根据上下文,术语“当…时”可以被解释为意思是“如果…”或“在…后”或“响应于确定…”或“响应于检测到…”。类似地,根据上下文,短语“在确定…时”或“如果检测到(所陈述的条件或事件)”可以被解释为意思是“如果确定…”或“响应于确定…”或“在检测到(所陈述的条件或事件)时”或“响应于检测到(所陈述的条件或事件)”。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以程序产品的形式实现。所述程序产品包括一个或多个计算机指令。在计算机上加载和执行所述程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程设备。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如DVD)、或者半导体介质(例如固态硬盘)等。
为了解释的目的,前面的描述是通过参考具体实施例来进行描述的。然而,上面的示例性的讨论并非意图是详尽的,也并非意图要将本申请限制到所公开的精确形式。根据以上教导内容,很多修改形式和变型形式都是可能的。选择和描述实施例是为了充分阐明本申请的原理及其实际应用,以由此使得本领域的其他技术人员能够充分利用具有适合于所构想的特定用途的各种修改的本申请以及各种实施例。
上述本申请提供的实施例中,从终端设备作为执行主体的角度对本申请实施例提供的方法进行了介绍。为了实现上述本申请实施例提供的方法中的各功能,终端设备可以包括硬件结构和/或软件模块,以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行,取决于技术方案的特定应用和设计约束条件。

Claims (11)

  1. 一种打开文件的方法,其特征在于,包括:
    第一设备与第二设备通过预设方式进入多屏协同模式;
    所述第一设备显示第一界面并将所述第一界面投屏在所述第二设备的第二界面上,所述第一界面上包含至少一个文件图标,所述第二界面上包括所述第一界面,所述至少一个文件图标对应的文件保存于所述第一设备;
    所述第一设备检测到作用于所述文件图标的操作;
    当所述文件图标是显示在所述第一界面上的图标时,所述第一设备调用第一应用打开所述文件;
    当所述文件图标是显示在所述第二界面上的图标时,所述第一设备将所述文件的元数据发送给所述第二设备,所述文件的元数据用于在所述第二设备上打开所述文件。
  2. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    所述第一设备接收来自所述第二设备的更新文件,所述更新文件为更新后的所述文件;
    所述第一设备用所述更新文件更新本地存储的所述文件。
  3. 根据权利要求1或2所述的方法,其特征在于,所述第一设备检测到作用于所述文件图标的操作,包括:
    所述第一设备接收来自所述第二设备的事件信息,所述事件信息用于指示所述操作,且所述事件信息包括所述第二设备的标识;或者,
    所述第一设备在所述第一设备上检测到所述操作产生的事件信息。
  4. 根据权利要求3所述的方法,其特征在于,所述第一设备确定所述文件图标是显示在所述第二界面上的图标,包括:
    所述第一设备根据所述第二设备的标识,确定所述文件图标是显示在所述第二界面上的图标。
  5. 根据权利要求1~4任一项所述的方法,其特征在于,所述第一设备将所述文件的元数据发送给所述第二设备,包括:
    所述第一设备通过所述第一设备的分布式文件管理***,将所述文件的元数据发送给所述第二设备的分布式文件管理***。
  6. 根据权利要求1~5任一项所述的方法,其特征在于,在所述第一设备调用第一应用以打开所述文件之前,还包括:
    所述第一设备输出提示信息,所述提示信息包括一个或多个选项,所述一个或多个选项用于确定打开所述文件的设备;
    所述第一设备检测到用于选择所述一个或多个选项中的第一选项的操作,所述第一选项对应所述第一应用。
  7. 根据权利要求1~6任一项所述的方法,其特征在于,所述方法还包括:
    当所述文件图标是显示在所述第一界面上的图标时,所述第一设备输出提示信息,所述提示信息包括一个或多个选项,所述一个或多个选项用于确定打开所述文件的设备;
    所述第一设备检测到用于选择所述一个或多个选项中的第二选项的操作,所述第二选项用于指示在所述第二设备上打开所述文件;
    所述第一设备将所述文件的元数据发送给所述第二设备,所述文件的元数据用于在所 述第二设备上打开所述文件。
  8. 根据权利要求1~7任一项所述的方法,其特征在于,所述文件的元数据包括所述文件在所述第一设备中的存储路径信息。
  9. 根据权利要求8所述的方法,其特征在于,所述文件的元数据还包括如下一项或多项:所述文件的类型信息,所述文件的大小信息,或,所述文件的名称。
  10. 一种电子设备,其特征在于,包括:显示屏,一个或多个处理器,存储器,以及,一个或多个程序;其中,所述一个或多个程序被存储在所述存储器中,所述一个或多个程序包括指令,当所述指令被所述电子设备执行时,使得所述电子设备执行如权利要求1~9中任意一项所述的方法。
  11. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质用于存储计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行如权利要求1~9中任意一项所述的方法。
PCT/CN2021/103515 2020-07-07 2021-06-30 一种打开文件的方法及设备 WO2022007678A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2023501315A JP2023534182A (ja) 2020-07-07 2021-06-30 ファイルを開く方法およびデバイス
US18/004,635 US20230273902A1 (en) 2020-07-07 2021-06-30 File Opening Method and Device
EP21838439.4A EP4167072A4 (en) 2020-07-07 2021-06-30 FILE OPENING METHOD AND DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010648535.5 2020-07-07
CN202010648535.5A CN113918104A (zh) 2020-07-07 2020-07-07 一种打开文件的方法及设备

Publications (1)

Publication Number Publication Date
WO2022007678A1 true WO2022007678A1 (zh) 2022-01-13

Family

ID=79231572

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/103515 WO2022007678A1 (zh) 2020-07-07 2021-06-30 一种打开文件的方法及设备

Country Status (5)

Country Link
US (1) US20230273902A1 (zh)
EP (1) EP4167072A4 (zh)
JP (1) JP2023534182A (zh)
CN (3) CN113918104A (zh)
WO (1) WO2022007678A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022242281A1 (zh) * 2021-05-20 2022-11-24 Oppo广东移动通信有限公司 文件保存方法、装置、电子设备以及存储介质

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114579237A (zh) * 2022-02-28 2022-06-03 联想(北京)有限公司 资源对象处理方法、装置及电子设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150319200A1 (en) * 2014-05-02 2015-11-05 Voxypad Inc. Natural User Interface for Remote Communication: An Interactive Collaboration System that allows Co-drawing Pad, Co-browsing/sharing Web/Document Files Using Session Initial Protocol (SIP)/Short Message Peer-to-Peer Protocol (SMPP) to Wake Up Remote Devices
US20170024100A1 (en) * 2015-07-24 2017-01-26 Coscreen, Inc. Frictionless Interface for Virtual Collaboration, Communication and Cloud Computing
CN109739450A (zh) * 2018-04-08 2019-05-10 北京字节跳动网络技术有限公司 一种交互方法及装置
CN110618971A (zh) * 2019-09-12 2019-12-27 联想(北京)有限公司 信息交互方法和电子设备
CN110716906A (zh) * 2016-08-19 2020-01-21 联想(北京)有限公司 一种文件查看方法、电子设备及文件查看装置
CN111158543A (zh) * 2019-12-24 2020-05-15 华为技术有限公司 一种文件处理方法、电子设备、***和存储介质
CN111327769A (zh) * 2020-02-25 2020-06-23 北京小米移动软件有限公司 多屏互动方法及装置、存储介质

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8605048B2 (en) * 2010-11-05 2013-12-10 Bluespace Corporation Method and apparatus for controlling multimedia contents in realtime fashion
CN102810102A (zh) * 2011-06-03 2012-12-05 宏碁股份有限公司 文件共享操作的方法
US10291721B2 (en) * 2011-07-15 2019-05-14 Vmware, Inc. Remote document signing
US9250928B2 (en) * 2011-10-18 2016-02-02 Mcafee, Inc. Cooperative mobile analytics
US9811241B2 (en) * 2014-09-17 2017-11-07 International Business Machines Corporation Shared inter-operational control among multiple computing devices
CN104506650B (zh) * 2015-01-04 2018-07-03 华为技术有限公司 一种用户设备协同控制方法、用户设备以及通信***
US20160371048A1 (en) * 2015-06-16 2016-12-22 T1V, Inc. Remote gesture control, input monitor, systems including the same, and associated methods
CN109669657B (zh) * 2018-12-26 2023-06-02 亮风台(上海)信息科技有限公司 一种用于进行远程文档协作的方法与设备

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150319200A1 (en) * 2014-05-02 2015-11-05 Voxypad Inc. Natural User Interface for Remote Communication: An Interactive Collaboration System that allows Co-drawing Pad, Co-browsing/sharing Web/Document Files Using Session Initial Protocol (SIP)/Short Message Peer-to-Peer Protocol (SMPP) to Wake Up Remote Devices
US20170024100A1 (en) * 2015-07-24 2017-01-26 Coscreen, Inc. Frictionless Interface for Virtual Collaboration, Communication and Cloud Computing
CN110716906A (zh) * 2016-08-19 2020-01-21 联想(北京)有限公司 一种文件查看方法、电子设备及文件查看装置
CN109739450A (zh) * 2018-04-08 2019-05-10 北京字节跳动网络技术有限公司 一种交互方法及装置
CN110618971A (zh) * 2019-09-12 2019-12-27 联想(北京)有限公司 信息交互方法和电子设备
CN111158543A (zh) * 2019-12-24 2020-05-15 华为技术有限公司 一种文件处理方法、电子设备、***和存储介质
CN111327769A (zh) * 2020-02-25 2020-06-23 北京小米移动软件有限公司 多屏互动方法及装置、存储介质

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
BILI_40067450131: "Experience of Huawei Notebook Multi-Screen Collaboration 2.0 File Opening", BILIBILI, 17 April 2020 (2020-04-17), pages 1 - 5, XP055890567, Retrieved from the Internet <URL:https://www.bilibili.com/video/av327754719/> *
See also references of EP4167072A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022242281A1 (zh) * 2021-05-20 2022-11-24 Oppo广东移动通信有限公司 文件保存方法、装置、电子设备以及存储介质

Also Published As

Publication number Publication date
US20230273902A1 (en) 2023-08-31
EP4167072A1 (en) 2023-04-19
EP4167072A4 (en) 2023-12-20
CN116027997A (zh) 2023-04-28
JP2023534182A (ja) 2023-08-08
CN113946302B (zh) 2022-10-25
CN113946302A (zh) 2022-01-18
CN113918104A (zh) 2022-01-11

Similar Documents

Publication Publication Date Title
CN109660842B (zh) 一种播放多媒体数据的方法及电子设备
WO2021013158A1 (zh) 显示方法及相关装置
WO2021078284A1 (zh) 一种内容接续方法及电子设备
US20220342850A1 (en) Data transmission method and related device
WO2021139768A1 (zh) 跨设备任务处理的交互方法、电子设备及存储介质
WO2022100305A1 (zh) 画面跨设备显示方法与装置、电子设备
WO2020134872A1 (zh) 一种消息处理的方法、相关装置及***
WO2021037227A1 (zh) 一种图像处理方法、电子设备及云服务器
CN112486363A (zh) 一种跨设备的内容分享方法、电子设备及***
WO2022100304A1 (zh) 应用内容跨设备流转方法与装置、电子设备
CN112527174B (zh) 一种信息处理方法及电子设备
WO2021037146A1 (zh) 一种移动终端的文件共享方法及设备
WO2022007678A1 (zh) 一种打开文件的方法及设备
WO2022042769A2 (zh) 多屏交互的***、方法、装置和介质
WO2022127661A1 (zh) 应用共享方法、电子设备和存储介质
WO2022001619A1 (zh) 一种截屏方法及电子设备
CN112130788A (zh) 一种内容分享方法及其装置
WO2021238967A1 (zh) 一种内容分享的方法、装置及***
WO2022078295A1 (zh) 一种设备推荐方法及电子设备
WO2022166618A1 (zh) 一种投屏的方法和电子设备
WO2023273543A1 (zh) 一种文件夹管理方法及装置
WO2023029916A1 (zh) 批注展示方法、装置、终端设备及可读存储介质
WO2023169237A1 (zh) 一种截屏方法、电子设备及***
WO2023231893A1 (zh) 光标显示的方法及电子设备
WO2022166386A1 (zh) 图像显示方法、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21838439

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023501315

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2021838439

Country of ref document: EP

Effective date: 20230113

NENP Non-entry into the national phase

Ref country code: DE