WO2023224705A1 - Focus synchronization across incompatible operating systems - Google Patents

Focus synchronization across incompatible operating systems Download PDF

Info

Publication number
WO2023224705A1
WO2023224705A1 PCT/US2023/013463 US2023013463W WO2023224705A1 WO 2023224705 A1 WO2023224705 A1 WO 2023224705A1 US 2023013463 W US2023013463 W US 2023013463W WO 2023224705 A1 WO2023224705 A1 WO 2023224705A1
Authority
WO
WIPO (PCT)
Prior art keywords
application
focus
operating system
guest
proxy
Prior art date
Application number
PCT/US2023/013463
Other languages
French (fr)
Inventor
Nick Eubanks
Zarana Kiran DESAI
Philip John NACHREINER
Original Assignee
Microsoft Technology Licensing, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/846,820 external-priority patent/US20230376336A1/en
Application filed by Microsoft Technology Licensing, Llc filed Critical Microsoft Technology Licensing, Llc
Publication of WO2023224705A1 publication Critical patent/WO2023224705A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation

Definitions

  • Native software applications are written for a single operating system (OS) and do not automatically run on other operating systems.
  • OS operating system
  • ANDROID does not automatically run on WINDOWS.
  • Running applications from different operating systems allows interactions between applications that would otherwise be impossible. For example, a user may be able to “drag and drop” content between a WINDOWS application and an ANDROID application if the applications were simultaneously running in the same desktop in a compatible way.
  • Another advantage includes simply increasing the number of available applications that can run on a particular operating system.
  • a native WINDOWS version of a legacy ANDROID application may not be available, so it would be desirable to seamlessly and naturally run the legacy ANDROID application on a WINDOWS device.
  • Virtual machines (VMs) and emulators allow a guest operating system to execute on the same computing device as a host operating system.
  • applications in the host operating system and the guest operating system do not typically interoperate as well as two applications designed for the same operating system. For example, even if cut and paste is enabled between native applications and guest applications, drag and drop may not be.
  • applications running on different operating systems operate differently and may appear differently to users. For example, application appearances may be different due to different OS-provided “chrome” - e.g., borders, menus, and other OS-provided user interface (UI) components. Applications may also operate differently due to different UI idioms and conventions. For example, cut and paste is performed with different keyboard combinations on WINDOWS and MACOS. Using an application running in an emulator or virtual machine also degrades the user experience by bringing the guest OS’s entire desktop into view when switching to the guest application, unnecessarily occluding part of the host OS’s desktop.
  • a proxy application running on a primary operating system presents a guest application running in a secondary OS as if it was native to the primary OS.
  • User interface events received by the proxy application are forwarded to the corresponding guest application.
  • Each OS independently identifies which application currently has focus.
  • focus is synchronized by setting and maintaining the focus of the secondary OS to the corresponding guest application.
  • the focus of the secondary OS is set to a stub placeholder application. Keeping focus synchronized prevents user interface events received by the proxy application from being forwarded to the wrong application on the secondary OS.
  • the primary OS and the secondary OS operate concurrently on the same computing device.
  • the computing device may operate a hypervisor with the primary OS as a host OS and the secondary OS as a guest OS.
  • the focus of the primary OS controls the focus of the secondary OS, and so in this configuration the host OS determines the focus of the guest OS.
  • An application hosting engine running on the primary OS may present the guest application in the proxy application. Specifically, the application hosting engine renders guest application content in a window of the proxy application, making the guest application appear as if it were native to the host OS.
  • the application hosting engine also forwards user interface (UI) commands received by the proxy application to the guest application, allowing a user to control the guest application from a user interface of the host OS.
  • UI user interface
  • focus is synchronized between the primary OS and the secondary OS by making the focus of the secondary OS conform to the focus of the primary OS. Deferring to the focus of the primary OS eliminates ambiguity and race conditions caused by treating both operating systems as equals or by failing to actively manage focus at all.
  • UI commands forwarded to the secondary OS are received by the application that has focus. As such, maintaining a correspondence between the focus of the operating systems ensures that UI commands are forwarded from the proxy application to the correct guest application. If the focus of the secondary OS were to change, UI commands would be forwarded to the newly focused application, and the connection between the proxy application and the guest application would be broken.
  • One technique used to synchronize focus occurs when the proxy application gains focus in the primary OS.
  • the application hosting engine In response to the proxy application gaining focus in the primary OS, the application hosting engine explicitly gives focus of the secondary OS to the corresponding guest application. For example, the application hosting engine may send a command to the secondary OS to set focus to the guest application.
  • Another technique used to synchronize focus occurs when the proxy application loses focus to a non-proxy application. Allowing the focus of the secondary OS to remain on the guest application of the previously focused proxy application would break focus synchronization. For example, a UI event organically caused by the secondary OS would be forwarded to the guest application and processed. The UI event would be processed by the guest application as if it has focus, while user expectations are that the guest application no longer has focus. To avoid this, and other scenarios, the application hosting engine sets the focus of the secondary OS to a stub placeholder application. Giving the focus of the secondary OS to the placeholder application maintains focus synchronization and focus primacy of the primary OS.
  • a third technique for synchronizing focus detects when the focused application differs between the two operating systems.
  • the application hosting engine registers with the secondary OS to receive a notification when an application running on the secondary OS is brought into focus. When this notification is received, the application hosting engine checks if the primary OS focus is already on a corresponding proxy application. If it is, there is nothing to do, as focus is already synchronized. However, if the primary OS is not focused on a corresponding proxy application, the application hosting engine will instruct the secondary OS to set focus according to the application currently focused by the primary OS. If the application currently focused by the primary OS is a proxy application, the application hosting engine will set the focus of the secondary OS to the corresponding guest application. If the application currently focused by the primary OS is not a proxy application - i.e. it is a native application - the application hosting engine will give the focus of the secondary OS to the placeholder application.
  • each OS may continue to rely on the expectation that it is solely in control of a single focused application. Any confusion that might have occurred when focus moves from an application running natively on one OS to an application running natively on the other OS is removed.
  • the resulting behavior improves human-computer interaction by meeting the expectations of a user operating applications as if they were seamlessly integrated, even if some of the applications actually run natively on a different operating system.
  • computer programming and other resources are conserved, as in some configurations, neither operating system requires changes to take advantage of these techniques, nor do the applications running in either operating system.
  • guest applications are dynamically rebuilt, at compile time or at run time, to include the disclosed functionality.
  • computer processing and other resources are conserved because input directed to a proxy application on the primary OS is provided to the proper guest application on the guest OS directly, without requiring additional duplicative input.
  • FIG. 1A illustrates an application hosting engine rendering a proxy application that contains content generated by a guest application.
  • FIG. IB illustrates an input command received by the proxy application.
  • FIG. 1C illustrates the input command of FIG. IB as forwarded to the guest application by the application hosting engine.
  • FIG. 2A illustrates a guest application and corresponding proxy application with synchronized focus.
  • FIG. 2B illustrates shifting focus on the primary OS to an application that is native to the primary OS while focus on the secondary OS remains unchanged.
  • FIG. 2C illustrates an application hosting engine setting the focus of the secondary OS to a placeholder application.
  • FIG. 2D illustrates the secondary operating system raising an event indicating that the placeholder application has moved to the front.
  • FIG. 3A illustrates a guest chat application being launched from the primary OS.
  • FIG. 3B illustrates the secondary operation system raising an event indicating that the guest chat application has moved to the front.
  • FIG. 3C illustrates the application hosting engine creating a proxy chat application for the newly launched guest chat application.
  • FIG. 4A illustrates what may happen after the state depicted in FIG. 3B if proxy photo application is given focus before the application hosting engine is aware that guest chat application was brought into focus.
  • FIG. 4B illustrates application hosting engine giving the focus of the secondary operation system to the guest photo application while, concurrently, the application hosting engine is notified that the guest chat application was moved to the front.
  • FIG. 4C illustrates creating a proxy chat application, without giving it focus.
  • FIG. 5 A illustrates minimizing proxy photo application.
  • FIG. 5B illustrates the proxy chat application gaining the focus of the primary OS while sending the guest photo application to the back.
  • FIG. 5C illustrates the placeholder application obtaining the focus of the secondary OS.
  • FIG. 5D illustrates giving the focus of secondary OS to the guest chat application, synchronizing focus with the primary OS.
  • FIG. 5E illustrates click restoring the proxy photo application.
  • FIG. 5F illustrates synchronizing focus by setting the focus of the secondary OS to the guest photo application.
  • FIG. 6 is a flow diagram of an example method for synchronizing focus across incompatible operating systems.
  • FIG. 7 is a computer architecture diagram illustrating an illustrative computer hardware and software architecture for a computing system capable of implementing aspects of the techniques and technologies presented herein.
  • FIG. 8 is a diagram illustrating a distributed computing environment capable of implementing aspects of the techniques and technologies presented herein.
  • a secondary ANDROID-based application may be presented within a WINDOWS desktop, adopting the UI idioms of WINDOWS, interacting with other native WINDOWS applications, and otherwise acting like a native WINDOWS application.
  • the ANDROID operating system is run within a virtual machine (VM) and the ANDROID-based guest application is run in a desktop of the ANDROID VM.
  • VM virtual machine
  • a proxy application is created within the WINDOWS desktop that displays the graphics rendered by the guest application. User input and other interactions with the proxy application are forwarded to the guest application.
  • Operating systems typically only support direct user interaction with one application at a time. Specifically, user input from a keyboard, mouse, finger, voice or other input mechanism is sent to a “focused application".
  • the focused application may also be referred to as a foreground application or an active application, and is typically distinguished visually from background applications that do not receive user input. For example, the operating system may render a focused application with a different title bar color than non-focused applications. Setting the focus of an operating system refers to selecting which application receives user input.
  • references to a focused application also refer to a focused window, or whatever aspect of a GUI the operating system directs user input to.
  • the single application model is a number of techniques, technologies, and patterns that enable applications running in a secondary OS to be displayed and interacted with in a primary OS with the appearance and behaviors of an application that executes natively on the primary OS.
  • the application hosting engine may be unaware of the change of focus in the secondary OS from the word processing application window to the popup window. As such, the application hosting engine may forward an input event from the proxy word processing application (e.g., text entry or formatting, menu selection) to the secondary OS, expecting it will be handled by the word processing application. Instead, the input event will be forwarded to the pop-up reminder, as this is the application in the secondary OS that actually has focus. Sending an input command to the wrong application may fail silently, cause data loss, or result in other unexpected behavior.
  • the proxy word processing application e.g., text entry or formatting, menu selection
  • applications typically consist of one or more windows, and that input events are sent to and processed by windows within an application.
  • input event interacting with an application it is understood to also refer to an input event interacting with a window of an application.
  • the primary OS launches the guest application by sending a “launch application” command to the secondary OS.
  • This command is asynchronous in that as soon as it has been issued, the primary OS returns focus to the previous application that had focus.
  • the secondary OS begins launching the guest application, initializes the guest application, and provides focus to the guest application.
  • the guest application renders a user interface into a buffer provided by the primary OS, which becomes visible to the user in a proxy application.
  • any user input commands will continue to be directed to the previous application and not to the proxy of the guest application that was recently launched. This can cause confusion if the user expects to interact with the recently launched application as soon as it is displayed.
  • This type of confusion can happen any time the secondary OS is asked to bring a first guest application into focus asynchronously - e.g., when restoring a first proxy application that has been minimized.
  • a second application in the primary OS may gain focus. If the second application is a native application, then user expectations will be met because UI commands are not forwarded from native applications, and so it does not matter when the first guest application is brought into focus on the secondary OS.
  • the application hosting engine will tell the secondary OS to bring the second guest application into focus.
  • the result is a race - the first guest application, which was asked to be restored asynchronously, may come into focus first, only to lose focus to the second guest application. In this case, user expectations are met, because the second application and the corresponding second guest application will both be in focus.
  • the second guest application will come into focus first, only to lose focus to the restored first guest application. If this happens, focus synchronization is lost - i.e., the first guest application in the secondary OS will have focus while the second application will still have focus in the primary OS. As a result, input commands would be forwarded to the wrong guest application.
  • the techniques disclosed herein synchronize focus between two operating systems that run concurrently as part of a single application model.
  • One of the operating systems is selected as a primary OS where focus is considered absolute.
  • the secondary OS is then managed such that focus is reflected from the primary operating system.
  • the primary OS is a host OS and the secondary OS is a guest OS that executes on a hypervisor or other virtual machine.
  • One technique used to synchronize focus is to launch a stub placeholder application in the secondary OS. Then, if a native application running within the primary OS- i.e., an application with no counterpart in the secondary OS - gains focus, an application hosting engine will cause the secondary OS to give focus to the placeholder.
  • the placeholder application may be managed exclusively by the application hosting engine, such that it cannot unexpectedly obtain focus in the secondary OS.
  • Another technique used to synchronize focus occurs when a proxy application gains focus in the primary OS. When this happens, the application hosting engine explicitly gives focus to the corresponding guest application.
  • a third technique for synchronizing focus detects when the focused application differs between the two operating systems.
  • the application hosting engine registers with the secondary OS to receive a notification when an application is brought into focus. When this notification is received, the application hosting engine checks if the primary OS focus is already on a corresponding proxy application. If it is, there is nothing to do, as focus is already in sync. However, if a different application within the primary OS has focus, the application hosting engine will instruct the secondary OS to set focus to a guest application corresponding to the different application. If there is no guest application corresponding to the different application, then the placeholder application will be given focus.
  • each OS may continue to rely on the expectation that it is solely in control of a single focused application. Any confusion that might have occurred when focus moves from an application running natively on one OS to an application running natively on the other OS is removed.
  • computer programming and other resources are conserved, as neither operating system requires changes to take advantage of these techniques, nor do the applications running in either operating system.
  • the resulting behavior improves human-computer interaction by meeting the expectations of a user operating applications as if they were seamlessly integrated, even if some of the applications are actually run natively on a different operating system.
  • computer processing and other resources are conserved, as input directed to a proxy application on the primary OS is provided to the proper guest application on the secondary OS in the first instance, without requiring additional duplicative input.
  • FIG. 1A illustrates an application hosting engine 150 rendering a proxy application 114 that contains content generated by a guest application 124.
  • Computing device 102 executes host operating system (OS) 110, which displays host operating desktop 112 on a display 160.
  • OS host operating system
  • Guest operating system 120 is concurrently executing on computing device 102.
  • Guest OS 120 may be running within a hypervisor, virtual machine, emulator, or the like.
  • Guest OS 120 renders content to guest OS desktop 122, which is also configured to render content to display 160.
  • guest OS desktop 122 and host OS desktop 112 often have the same dimensions, resolution, and other properties. However, desktop dimensions, resolutions, and scales do not have to match in order to implement focus synchronization.
  • Guest application 124 is running on guest OS 120. Guest application 124 renders content that would ordinarily be displayed by guest OS 120 on guest OS desktop 122. However, in order to create the impression that guest application 124 is a native application running on host OS 110 and allow increased functionality between guest application 124 and native applications running on host OS 110, application hosting engine 150 renders the content generated by guest application 124 in proxy application 114.
  • Proxy application 114 appears on host OS desktop 112 and operates and appears as a true native application of host OS 110.
  • application hosting engine 150 only renders content generated by guest OS 120 that is associated with a guest application that is proxied in host OS 110. That guest OS 120 does not actually render to display 160 is indicated by dashed lines of guest OS desktop 122 and guest application 124.
  • guest OS 120 renders content to a pseudo display device that does not actually render content to a screen.
  • application hosting engine 150 provides guest application 124 with a graphics buffer into which content from guest application 124 is rendered. Proxy application 114 may then use this buffer when rendering content to host OS desktop 112.
  • FIG. IB illustrates an input command 146 received by the proxy application 114.
  • Input command 146 may be a mouse click, keyboard input, touch input, voice command, automation command, the invocation of an operating system user interface application programming interface (API), or any other technique for controlling the proxy application 114.
  • Input command 146 may be the beginning of a sequence of input commands, such as a double click, drag and drop, hover, or other user interface idiom.
  • FIG. 1C illustrates the input command 146 as provided to the guest application 124 by the application hosting engine 150.
  • Application hosting engine 150 provides input command 146 to guest application 124 as input command 156.
  • Input command 156 maybe a direct copy of input command 146 or a translation to one or more corresponding input commands recognized by applications running on guest OS 120. For example, if proxy application 114 receives a mouse click event at coordinates (200, 250), application hosting engine 150 may create a mouse click event with coordinates (200, 250) but that is formatted for applications running on guest OS 120. Application hosting engine 150 may then forward the newly created event to proxy application 114. Alternatively, application hosting engine 150 may invoke an automation API, OS API, or an application-specific API to cause guest application 124 to perform a function equivalent to the function that input command 146 is expected to perform.
  • FIG. 2 A illustrates a guest photo application 124 and a corresponding proxy photo application 114 with synchronized focus. As illustrated, focus is indicated by the thick borders around proxy photo application 114 and guest photo application 124.
  • Proxy photo application 114 executes on primary operating system desktop 212 of primary operating system 210.
  • Primary operating system 210 may be a host operating system similar to host operating system 110 described above in conjunction with FIG 1A.
  • Native spreadsheet application 218 is also executing on primary OS desktop 212.
  • Native spreadsheet application 218 executes on primary OS 210 directly, and is not a proxy application to a corresponding guest application.
  • a taskbar 219 located at the bottom of primary OS desktop 212 contains icons of running applications.
  • Chat application icon 216 may be activated to launch a chat application. Chat application icon 216 may be a desktop icon or a taskbar 219 icon; or the chat application may be accessed in another manner (e.g., start menu, voice command, automation, other programmatic manipulation). If chat application icon 216 is associated with a native chat application, then activating it would simply launch the associated application. However, chat application icon 216 may be associated with a guest application that executes within secondary operating system 220. In this scenario, activating chat application icon 216 causes application hosting engine 150 to send an application launch command to secondary operating system 220. The application launch command causes secondary operating system 220 to launch a guest chat application.
  • Secondary operating system 220 renders secondary operating system desktop 222.
  • Guest photo application 124 has the focus of secondary operating system 220, as indicated by the thick border.
  • the dashed lines around guest photo application 124 indicate that the content drawn by guest photo application 124 is not rendered to the display by the guest photo application 124 directly. Instead, content drawn by the guest photo application 124 is rendered by corresponding proxy photo application 114.
  • Placeholder application 226 is a stub application launched by application hosting engine 150 to hold the focus of secondary operating system 220 when primary operating system 210 has given focus to a native application. This enables focus synchronization by allowing a guest application on secondary operating system 220 to have focus only when a corresponding proxy application on primary operating system 210 has focus. Placeholder application 226 does not render any content.
  • Application hosting engine 150 includes values associated with currently focused primary operating system application 252 and currently focused guest operating system application 254. These values hold identifiers of the applications that are currently in focus in their respective operating systems. As illustrated, photo application 114 currently has the focus of primary operating system 210, and photo application 124 currently has the focus of secondary operating system 220. These values are updated in response to events generated by the operating systems 210 and 220, as discussed in more detail below.
  • FIG. 2B illustrates shifting focus in the primary OS 210 to an application 218 that is native to the primary OS 210 while focus in the secondary OS 220 remains unchanged.
  • focus has shifted to native spreadsheet application 218.
  • the focus may have shifted in response to a user input command such as a mouse click, keyboard command, voice command, touch gesture, or the like.
  • the focus also may have shifted as a result of automation or other programmatic manipulation.
  • the primary operating system 210 generates set focus event 260, which application hosting engine 150 receives and uses to determine that native spreadsheet application 218 now has the focus of primary operating system 210.
  • the value of currently focused primary OS app 252 is updated accordingly.
  • the focus of secondary operating system 220 remains on guest photo application 124.
  • set focus event 260 is processed synchronously by application hosting engine 150, ensuring that changes made to the focus of secondary operating system 220 are made before a user is able to change the focus of primary OS 210 again.
  • set focus event 260 is processed asynchronously by application hosting engine 150.
  • FIG. 2C illustrates application hosting engine 150 setting the focus of the secondary OS to a placeholder application.
  • application hosting engine 150 sends set focus command 270 to secondary operating system 220.
  • secondary operating system 220 gives the focus to placeholder application 226, as illustrated by the thick border around placeholder application 226.
  • Application hosting engine 150 has also updated the value of currently focused guest OS app 254 to store an identifier of placeholder 226.
  • Application hosting engine 150 sets the focus of secondary operating system 220 to placeholder application 226 so that the focus of the operating systems remains synchronized.
  • FIG. 2D illustrates the secondary operating system raising an event 262 indicating that the placeholder application 226 has moved to the front.
  • Some operating systems use a stack metaphor for arranging applications. The application on the front of the stack is visible, occluding any other applications behind it in the stack. Applications may be moved forward or backward in the stack, or moved to the front or the back of the stack. Furthermore, these operating systems may raise events when applications are moved within the stack.
  • Application hosting engine 150 registers to receive “AppMovedToFront” events so that it may know when an application on secondary operating system 220 has been moved to the front of the application stack - and therefore has received the focus of secondary OS 220.
  • AppMovedToFront event 262 indicates to application hosting engine 150 that placeholder application 226 has the focus of secondary OS 220. If the set focus command 270 was issued asynchronously, it is possible that the focus of primary OS 210 changed from the time the asynchronous command was given and the time that AppMovedToFront event 262 is received by application hosting engine 150. As illustrated, AppMovedToFront event 262 is received by application hosting engine 150 before any change of focus to primary OS 210. Application hosting engine 150 determines if the focus of primary OS 210 has changed. Since it has not, no further action is required and focus synchronization is maintained.
  • FIG. 3 A illustrates a guest chat application 324 being launched from the primary OS 210.
  • click 302 on chat application icon 216 causes application hosting engine to send a command to secondary operating system 220 to launch guest chat application 324.
  • This command is asynchronous, and the focus of primary OS 210 remains on native application 218.
  • guest chat application 324 will receive the focus of secondary operating system 220.
  • Application hosting engine 150 does not know when the launch of guest chat application 324 will complete, or when guest chat application 324 will receive the focus of secondary OS 220.
  • FIG. 3B illustrates the secondary operating system 220 raising an event 364 indicating that the guest chat application 324 has moved to the front - i.e., that guest chat app 324 has received the focus of secondary operating system 220.
  • application hosting engine 150 updates the value of currently focused guest OS app 254 to store a reference to chat app 324.
  • FIG. 3C illustrates the application hosting engine 150 creating a proxy chat application 314 for the newly launched guest chat application 324.
  • application hosting engine 150 sends a create and set focus command 372 to primary OS 210.
  • Primary OS 210 responds by launching proxy chat application 314 and giving it focus.
  • proxy chat application 314 is an instance of an application deployed with and designed to interact with application hosting engine 150 to render content generated by guest chat application 324 and to forward input commands to guest chat application 324. Focus synchronicity is maintained by ensuring that proxy chat application 314 and corresponding guest chat application 324 both have the focus of their respective operating systems.
  • FIG. 3C illustrates what happens when the asynchronous launching of a guest application completes and synchronizes focus with primary operating system 210 without interruption. However, it is possible that in the intervening time the focus of primary OS 210 will have changed. This scenario is discussed below in conjunction with FIGS. 4A-4C.
  • FIG. 4A illustrates what may happen after the state depicted in FIG. 3B if proxy photo application 114 was given focus before the application hosting engine 150 is aware that guest chat application 324 was brought into focus. Specifically, a user may have clicked on proxy photo application 114 before the create and set focus command 372 was received by application hosting engine 150, or even, as illustrated, before it was sent. In response to setting the focus of primary OS 210 to proxy photo application 114, set focus event 466 is provided to application hosting engine 150. Application hosting engine 150 stores an identifier of photo app 114 in currently focused primary OS app 252. At the time depicted by FIG. 4A, the focus of secondary OS 220 remains on guest chat application 324.
  • FIG. 4B illustrates application hosting engine 150 giving the focus of secondary operation system 220 to guest photo application 124 while, concurrently, application hosting engine 150 is notified that the guest chat application was moved to the front.
  • Set focus command 474 is sent to secondary OS 220 to give guest photo application 124 focus. This results in focus synchronicity, as guest photo application 124 and proxy photo application 114 both have focus on their respective operating systems.
  • AppMovedToFront event 468 indicates that guest chat application 324 was moved to the front of the application stack - even though focus has since been transferred away. The order in which set focus command 474 and AppMovedToFront event 468 are processed is indeterminate. As illustrated, set focus command 474 was processed while AppMovedToFront event 468 is in flight.
  • AppMovedToFront event 468 was sent and even received by application hosting engine 150 before set focus command 474 was received and/or processed by secondary OS 220.
  • the application focused by the primary application is chosen, and the focus of the secondary OS is set to match.
  • FIG. 4C illustrates creating a proxy chat application 314, without giving it focus.
  • Proxy chat application 314 is not given focus because proxy photo application 114 was given focus by the user after launching guest chat application 324.
  • Application hosting engine 150 sends create command 372 to primary operating system 210.
  • Application hosting engine 150 knows that the proxy photo application 114 has the focus of primary operating system 210. Accordingly, proxy chat application 314 is created and displayed, but not given the focus of primary OS 210.
  • FIG. 5A illustrates minimizing proxy photo application 114.
  • Minimizing and restoring proxy applications is another scenario in which a corresponding guest application is asynchronously brought to front. Similar to the scenario in which an application is launched, there is potential for a race if the focus of the primary OS 210 changes before the guest application is restored.
  • minimization click 502 causes proxy photo application 114 to be minimized, losing focus.
  • Primary OS 210 sends remove focus event 560 to application hosting engine 150.
  • FIG. 5B illustrates the proxy chat application 314 gaining the focus of the primary OS 210 while sending the guest photo application 124 to the back.
  • Primary OS 210 automatically gives focus to a different application when proxy photo application 114 is minimized. As illustrated, focus is returned to proxy chat application 314.
  • Primary OS 210 sends a has focus event 562 to application hosting engine 150, indicating that proxy chat application 314 now has focus.
  • Application hosting engine 150 updates currently focused primary OS app 252 accordingly.
  • application hosting engine sends a send to back command 572 to secondary OS 220.
  • application hosting engine 150 updates currently focused guest OS app 254 when sending the send to back command 572.
  • application hosting engine 150 may also send a “send to front” command as part of or along with the send to back command 572 to indicate which application should replace guest photo application 124 as having focus.
  • application hosting engine 150 waits to receive a “move app to front” event confirming that the focus has changed before performing the update.
  • FIG. 5C illustrates the placeholder application 226 obtaining the focus of the secondary OS 220.
  • second operating system 220 moved guest photo application 124 to the back of the application stack - i.e., guest photo application 124 now has the lowest Z order and is occluded by any overlapping windows.
  • secondary OS 220 selected placeholder application 226 to receive the focus consequently, secondary OS 220 sends AppMovedToFront event 564 to application hosting engine 150.
  • FIG. 5C occurs in the context of minimizing proxy photo application 114.
  • a guest application may unexpectedly gain the focus of secondary OS 220.
  • a pop up generated by secondary OS 220 may appear unexpectedly, such as a reminder to download a system update.
  • FIGS. 5C- 5F apply to these other scenarios as well.
  • FIG. 5D illustrates giving the focus of secondary OS 220 to the guest chat application 324, synchronizing focus with the primary OS 210.
  • application hosting engine determines that primary OS 210 has given the focus to a proxy application - in this case proxy chat application 314.
  • Application hosting engine 150 provides send to front command 574 to secondary OS 220, causing guest chat application 324 to obtain focus. This ensures focus synchronicity as the corresponding proxy application 314 also has focus of primary OS 210.
  • Allowing placeholder application 226 to continue to have focus of secondary OS 220 while proxy chat application 314 has the focus of primary OS 210 would break focus synchronicity.
  • focus synchronicity is achieved when a native application has the focus of primary OS 210 and placeholder application 226 has the focus of secondary OS 220.
  • Focus synchronicity is only otherwise achieved when a guest application and corresponding proxy application have the focus of their respective operating systems. As such, allowing a proxy application to have focus in primary OS 210 while the placeholder application 226 has focus of the secondary OS 220 breaks focus synchronicity.
  • FIG. 5E illustrates click 522 restoring the proxy photo application 314. Restoring proxy photo application 314 brings it back into focus.
  • Primary OS 210 provides set focus event 566 to application hosting engine 150, which updates currently focused primary OS app 252.
  • FIG. 5F illustrates synchronizing focus by setting the focus of the secondary OS 220 to the guest photo application 124.
  • Application hosting engine 150 provides set focus event 568 to secondary OS 220, causing guest photo application 124 to be brought into focus.
  • Restoring a minimized proxy application introduces another race - while not depicted, a user could activate native application 218 before guest photo application 124 is brought into focus. Left unchecked, this would break focus synchronicity. In this scenario, application hosting engine 150 would detect the change in focus of the primary OS 210 and reflect this change in the secondary OS 220 by bringing placeholder application 226 back into focus.
  • FIG. 6 aspects of a routine for synchronizing focus across incompatible operating systems is shown and described.
  • the processes discussed in this disclosure are delineated as separate operations represented as independent blocks. However, these separately delineated operations should not be construed as necessarily order dependent in their performance.
  • the order in which the process is described is not intended to be construed as a limitation, and any number of the described process blocks may be combined in any order to implement the process or an alternate process. Moreover, it is also possible that one or more of the provided operations is modified or omitted.
  • routine 600 begins at operation 602 where a second guest application 324 is launched on secondary OS 220.
  • the second guest application 324 may have been launched by activating icon 216, for example.
  • an indication 466 is received that first proxy application 114 has gained the focus of the primary operating system 210. This could happen in response to a user clicking on proxy photo application 114, for example.
  • application hosting engine 150 sets the focus of the secondary OS 220 to a first guest application 124 that corresponds to the first proxy application 114.
  • a second proxy application 314 is created on the primary OS 210 that corresponds to the second guest application 324 without giving focus to the second proxy application 314.
  • the particular implementation of the technologies disclosed herein is a matter of choice dependent on the performance and other requirements of a computing device. Accordingly, the logical operations described herein are referred to variously as states, operations, structural devices, acts, or modules. These states, operations, structural devices, acts, and modules can be implemented in hardware, software, firmware, in special-purpose digital logic, and any combination thereof. It should be appreciated that more or fewer operations can be performed than shown in the figures and described herein. These operations can also be performed in a different order than those described herein.
  • the logical operations described herein are implemented (1) as a sequence of computer implemented acts or program modules running on a computing system and/or (2) as interconnected machine logic circuits or circuit modules within the computing system.
  • the implementation is a matter of choice dependent on the performance and other requirements of the computing system.
  • the logical operations described herein are referred to variously as states, operations, structural devices, acts, or modules. These operations, structural devices, acts, and modules may be implemented in software, in firmware, in special purpose digital logic, and any combination thereof.
  • routine 600 is described herein as being implemented, at least in part, by modules running the features disclosed herein can be a dynamically linked library (DLL), a statically linked library, functionality produced by an application programing interface (API), a compiled program, an interpreted program, a script or any other executable set of instructions.
  • DLL dynamically linked library
  • API application programing interface
  • Data can be stored in a data structure in one or more memory components. Data can be retrieved from the data structure by addressing links or references to the data structure.
  • routine 600 may be also implemented in many other ways.
  • routine 600 may be implemented, at least in part, by a processor of another remote computer or a local circuit.
  • one or more of the operations of the routine 600 may alternatively or additionally be implemented, at least in part, by a chipset working alone or in conjunction with other software modules.
  • one or more modules of a computing system can receive and/or process the data disclosed herein. Any service, circuit or application suitable for providing the techniques disclosed herein can be used in operations described herein. FIG.
  • FIG. 7 shows additional details of an example computer architecture 700 for a device, such as a computer or a server configured as part of the systems described herein, capable of executing computer instructions (e.g., a module or a program component described herein).
  • the computer architecture 700 illustrated in FIG. 7 includes processing unit(s) 702, a system memory 704, including a random-access memory 706 (“RAM”) and a read-only memory (“ROM”) 708, and a system bus 710 that couples the memory 704 to the processing unit(s) 702.
  • RAM random-access memory
  • ROM read-only memory
  • Processing unit(s) 702 can represent, for example, a CPU-type processing unit, a GPU-type processing unit, a field-programmable gate array (FPGA), another class of digital signal processor (DSP), or other hardware logic components that may, in some instances, be driven by a CPU.
  • FPGA field-programmable gate array
  • DSP digital signal processor
  • illustrative types of hardware logic components that can be used include Application-Specific Integrated Circuits (ASICs), Application-Specific Standard Products (ASSPs), System-on-a-Chip Systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.
  • ASICs Application-Specific Integrated Circuits
  • ASSPs Application-Specific Standard Products
  • SOCs System-on-a-Chip Systems
  • CPLDs Complex Programmable Logic Devices
  • the computer architecture 700 further includes a mass storage device 712 for storing an operating system 714, application(s) 716, modules 718, and other data described herein.
  • the mass storage device 712 is connected to processing unit(s) 702 through a mass storage controller connected to the bus 710.
  • the mass storage device 712 and its associated computer- readable media provide non-volatile storage for the computer architecture 700.
  • computer-readable media can be any available computer-readable storage media or communication media that can be accessed by the computer architecture 700.
  • Computer-readable media can include computer-readable storage media and/or communication media.
  • Computer-readable storage media can include one or more of volatile memory, nonvolatile memory, and/or other persistent and/or auxiliary computer storage media, removable and nonremovable computer storage media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules, or other data.
  • computer storage media includes tangible and/or physical forms of media included in a device and/or hardware component that is part of a device or external to a device, including but not limited to random access memory (RAM), static random-access memory (SRAM), dynamic random-access memory (DRAM), phase change memory (PCM), read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable readonly memory (EEPROM), flash memory, compact disc read-only memory (CD-ROM), digital versatile disks (DVDs), optical cards or other optical storage media, magnetic cassettes, magnetic tape, magnetic disk storage, magnetic cards or other magnetic storage devices or media, solid- state memory devices, storage arrays, network attached storage, storage area networks, hosted computer storage or any other storage memory, storage device, and/or storage medium that can be used to store and maintain information for access by a computing device.
  • RAM random access memory
  • SRAM static random-access memory
  • DRAM dynamic random-access memory
  • PCM phase change memory
  • ROM read-only memory
  • communication media can embody computer- readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave, or other transmission mechanism.
  • computer storage media does not include communication media. That is, computer-readable storage media does not include communications media consisting solely of a modulated data signal, a carrier wave, or a propagated signal, per se.
  • the computer architecture 700 may operate in a networked environment using logical connections to remote computers through the network 720.
  • the computer architecture 700 may connect to the network 720 through a network interface unit 722 connected to the bus 710.
  • the computer architecture 700 also may include an input/output controller 724 for receiving and processing input from a number of other devices, including a keyboard, mouse, touch, or electronic stylus or pen. Similarly, the input/output controller 724 may provide output to a display screen, a printer, or other type of output device.
  • the processing unit(s) 702 may be constructed from any number of transistors or other discrete circuit elements, which may individually or collectively assume any number of states. More specifically, the processing unit(s) 702 may operate as a finite-state machine, in response to executable instructions contained within the software modules disclosed herein. These computer-executable instructions may transform the processing unit(s) 702 by specifying how the processing unit(s) 702 transition between states, thereby transforming the transistors or other discrete hardware elements constituting the processing unit(s) 702.
  • FIG. 8 depicts an illustrative distributed computing environment 800 capable of executing the software components described herein.
  • the distributed computing environment 800 illustrated in FIG. 8 can be utilized to execute any aspects of the software components presented herein.
  • the distributed computing environment 800 can be utilized to execute aspects of the software components described herein.
  • the distributed computing environment 800 can include a computing environment 802 operating on, in communication with, or as part of the network 804.
  • the network 804 can include various access networks.
  • One or more client devices 806A-806N (hereinafter referred to collectively and/or generically as “clients 806” and also referred to herein as computing devices 806) can communicate with the computing environment 802 via the network 804.
  • the clients 806 include a computing device 806A such as a laptop computer, a desktop computer, or other computing device; a slate or tablet computing device (“tablet computing device”) 806B; a mobile computing device 806C such as a mobile telephone, a smart phone, or other mobile computing device; a server computer 806D; and/or other devices 806N. It should be understood that any number of clients 806 can communicate with the computing environment 802.
  • the computing environment 802 includes servers 808, data storage 810, and one or more network interfaces 812.
  • the servers 808 can host various services, virtual machines, portals, and/or other resources.
  • the servers 808 host virtual machines 814, Web portals 816, mailbox services 818, storage services 820, and/or, social networking services 822.
  • the servers 808 also can host other services, applications, portals, and/or other resources (“other resources”) 824.
  • the computing environment 802 can include the data storage 810.
  • the functionality of the data storage 810 is provided by one or more databases operating on, or in communication with, the network 804.
  • the functionality of the data storage 810 also can be provided by one or more servers configured to host data for the computing environment 802.
  • the data storage 810 can include, host, or provide one or more real or virtual datastores 826A-826N (hereinafter referred to collectively and/or generically as “datastores 826”).
  • the datastores 826 are configured to host data used or created by the servers 808 and/or other data.
  • the datastores 826 also can host or store web page documents, word documents, presentation documents, data structures, algorithms for execution by a recommendation engine, and/or other data utilized by any application program. Aspects of the datastores 826 may be associated with a service for storing files.
  • the computing environment 802 can communicate with, or be accessed by, the network interfaces 812.
  • the network interfaces 812 can include various types of network hardware and software for supporting communications between two or more computing devices including, but not limited to, the computing devices and the servers. It should be appreciated that the network interfaces 812 also may be utilized to connect to other types of networks and/or computer systems.
  • the distributed computing environment 800 described herein can provide any aspects of the software elements described herein with any number of virtual computing resources and/or other distributed computing functionality that can be configured to execute any aspects of the software components disclosed herein.
  • the distributed computing environment 800 provides the software functionality described herein as a service to the computing devices.
  • the computing devices can include real or virtual machines including, but not limited to, server computers, web servers, personal computers, mobile computing devices, smart phones, and/or other devices.
  • the concepts and technologies disclosed herein enable any device configured to access the distributed computing environment 800 to utilize the functionality described herein for providing the techniques disclosed herein, among other aspects.
  • Example 1 A method comprising: initiating (302, 502) an asynchronous operation on a secondary operating system (220) that sets a focus of the secondary operating system (220) to a guest application (324); before the asynchronous operation completes, receiving an indication (466) that an application (114, 218) running on a primary operating system (210) has gained a focus of the primary operating system (210); receiving an indication (364) that the guest application (324) has gained the focus of the secondary operating system (220); and in response to the indication (364) that the guest application (324) has gained the focus of the secondary operating system (220), setting the focus of the secondary operating system (220) to another application (124, 226) running on the secondary operating system (220) that corresponds to the application (114, 218) running on the primary operating system (210).
  • Example 2 The method of Example 1, wherein the asynchronous operation comprises launching the guest application.
  • Example 3 The method of Example 2, further comprising: creating a proxy application running on the primary operating system that corresponds to the guest application without giving the focus of the primary operating system to the proxy application, wherein content generated by the guest application is rendered by the proxy application and wherein user interface commands received by the proxy application are forwarded to the guest application.
  • Example 4 The method of Example 1, wherein the asynchronous operation comprises restoring the guest application from a minimized state.
  • Example 5 The method of Example 1, wherein the application running on the primary operating system comprises a second proxy application, and wherein the other application running on the secondary operating system comprises a second guest application.
  • Example 6 The method of Example 1, wherein the application running on the primary operating system comprises a native application, and wherein the other application running on the secondary operating system comprises a placeholder application.
  • Example 7 The method of Example 6, wherein the placeholder application receives user interface events originating from the secondary operating system.
  • Example 8 The method of Example 1, wherein the primary operating system runs on a computing device, wherein the secondary operating system comprises a guest operating system running on a virtual machine, and wherein the virtual machine runs on the computing device.
  • Example 9 The method of Example 1, wherein the asynchronous operation is initiated in response to user input received by the primary operating system.
  • Example 10 The method of Example 1, further comprising: registering to receive an indication when an individual application gains a focus of a secondary operating system.
  • Example 11 A computing device comprising: one or more processors; a memory in communication with the one or more processors, the memory having computer-readable instructions stored thereupon which, when executed by the one or more processors, cause the computing device to: register to receive indications when a focus of a secondary operating system (220) changes, wherein a proxy application (114) having a focus of a primary operating system (210) displays content rendered by a guest application (124) that has the focus of the secondary operating system (210), and wherein user interface commands received by the proxy application (114) are forwarded to the guest application (124); receiving an indication that the focus of the secondary operating system (220) changed; and setting the focus of the secondary operating system (220) to the guest application (124).
  • Example 12 The computing device of Example 11, wherein the indication that the focus of the secondary operating system changed is received from the secondary operating system.
  • Example 13 The computing device of Example 11, wherein the focus of the secondary operating system is set back to the guest application in response to a determination that the proxy application continues to have the focus of the primary operating system.
  • Example 14 The computing device of Example 11, wherein the focus of the secondary operating system changed to an application launched independently by the secondary operating system.
  • Example 15 A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to: receive an indication of a focus of a primary operating system (210) changing from a proxy application (114) to a native application (218), wherein the proxy application (114) displays content rendered by a guest application (124) having the focus of the secondary operating system (210) and wherein user interface commands received by the proxy application (114) are forwarded to the guest application (124) when the guest application (124) has the focus of the secondary operating system (220); and setting a focus of the secondary operating system (220) to a placeholder application.
  • Example 16 The computer-readable storage medium of Example 15, wherein the instructions further cause the processor to: launch the placeholder application on the secondary operating system.
  • Example 17 The computer-readable storage medium of Example 15, wherein the native application does not proxy a guest application running in the secondary operating system.
  • Example 18 The computer-readable storage medium of Example 15, wherein user interface events of the secondary operating system are sent to the placeholder application while the placeholder application has the focus of the secondary operating system.
  • Example 19 The computer-readable storage medium of Example 15, wherein the instructions further cause the processor to: receive an indication that the proxy application has the focus of the primary operating system; and set the focus of the secondary operating system to the guest application.
  • Example 20 The computer-readable storage medium of Example 15, wherein an individual application having the focus of the primary operating system is provided with user input received by the primary operating system.
  • any reference to “first,” “second,” etc. elements within the Summary and/or Detailed Description is not intended to and should not be construed to necessarily correspond to any reference of “first,” “second,” etc. elements of the claims. Rather, any use of “first” and “second” within the Summary, Detailed Description, and/or claims may be used to distinguish between two different instances of the same element.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)

Abstract

The techniques disclosed herein synchronize focus between two operating systems that run concurrently. A proxy application running on a primary operating system (OS) presents a guest application running in a secondary OS as if it was native to the primary OS. User interface events received by the proxy application are forwarded to the corresponding guest application. Each OS independently identifies which application currently has focus. When the primary OS is focused on a proxy application, focus is synchronized by setting and maintaining the focus of the secondary OS to the corresponding guest application. When the primary OS is not focused on a proxy application, the focus of the secondary OS is set to a stub placeholder application. Keeping focus synchronized prevents user interface events received by the proxy application from being forwarded to the wrong application on the secondary OS.

Description

FOCUS SYNCHRONIZATION ACROSS INCOMPATIBLE OPERATING SYSTEMS
BACKGROUND
Native software applications are written for a single operating system (OS) and do not automatically run on other operating systems. For example, an application written for ANDROID does not automatically run on WINDOWS. However, there are many advantages to running applications designed for different operating systems simultaneously on the same operating system. Running applications from different operating systems allows interactions between applications that would otherwise be impossible. For example, a user may be able to “drag and drop” content between a WINDOWS application and an ANDROID application if the applications were simultaneously running in the same desktop in a compatible way. Another advantage includes simply increasing the number of available applications that can run on a particular operating system. For example, when migrating a business from an ANDROID platform to a WINDOWS platform, a native WINDOWS version of a legacy ANDROID application may not be available, so it would be desirable to seamlessly and naturally run the legacy ANDROID application on a WINDOWS device.
Virtual machines (VMs) and emulators allow a guest operating system to execute on the same computing device as a host operating system. However, applications in the host operating system and the guest operating system do not typically interoperate as well as two applications designed for the same operating system. For example, even if cut and paste is enabled between native applications and guest applications, drag and drop may not be. Furthermore, applications running on different operating systems operate differently and may appear differently to users. For example, application appearances may be different due to different OS-provided “chrome” - e.g., borders, menus, and other OS-provided user interface (UI) components. Applications may also operate differently due to different UI idioms and conventions. For example, cut and paste is performed with different keyboard combinations on WINDOWS and MACOS. Using an application running in an emulator or virtual machine also degrades the user experience by bringing the guest OS’s entire desktop into view when switching to the guest application, unnecessarily occluding part of the host OS’s desktop.
It is with respect to these and other considerations that the disclosure made herein is presented.
SUMMARY
The techniques disclosed herein synchronize focus between two operating systems that run concurrently. A proxy application running on a primary operating system (OS) presents a guest application running in a secondary OS as if it was native to the primary OS. User interface events received by the proxy application are forwarded to the corresponding guest application. Each OS independently identifies which application currently has focus. When the primary OS is focused on a proxy application, focus is synchronized by setting and maintaining the focus of the secondary OS to the corresponding guest application. When the primary OS is not focused on a proxy application, the focus of the secondary OS is set to a stub placeholder application. Keeping focus synchronized prevents user interface events received by the proxy application from being forwarded to the wrong application on the secondary OS.
In some configurations, the primary OS and the secondary OS operate concurrently on the same computing device. For example, the computing device may operate a hypervisor with the primary OS as a host OS and the secondary OS as a guest OS. The focus of the primary OS controls the focus of the secondary OS, and so in this configuration the host OS determines the focus of the guest OS. An application hosting engine running on the primary OS may present the guest application in the proxy application. Specifically, the application hosting engine renders guest application content in a window of the proxy application, making the guest application appear as if it were native to the host OS. The application hosting engine also forwards user interface (UI) commands received by the proxy application to the guest application, allowing a user to control the guest application from a user interface of the host OS. As a result, the guest application appears as if it was running natively on the host OS, seamlessly integrated with applications running natively on the host OS.
In some configurations, focus is synchronized between the primary OS and the secondary OS by making the focus of the secondary OS conform to the focus of the primary OS. Deferring to the focus of the primary OS eliminates ambiguity and race conditions caused by treating both operating systems as equals or by failing to actively manage focus at all. In some configurations, UI commands forwarded to the secondary OS are received by the application that has focus. As such, maintaining a correspondence between the focus of the operating systems ensures that UI commands are forwarded from the proxy application to the correct guest application. If the focus of the secondary OS were to change, UI commands would be forwarded to the newly focused application, and the connection between the proxy application and the guest application would be broken.
One technique used to synchronize focus occurs when the proxy application gains focus in the primary OS. In response to the proxy application gaining focus in the primary OS, the application hosting engine explicitly gives focus of the secondary OS to the corresponding guest application. For example, the application hosting engine may send a command to the secondary OS to set focus to the guest application.
Another technique used to synchronize focus occurs when the proxy application loses focus to a non-proxy application. Allowing the focus of the secondary OS to remain on the guest application of the previously focused proxy application would break focus synchronization. For example, a UI event organically caused by the secondary OS would be forwarded to the guest application and processed. The UI event would be processed by the guest application as if it has focus, while user expectations are that the guest application no longer has focus. To avoid this, and other scenarios, the application hosting engine sets the focus of the secondary OS to a stub placeholder application. Giving the focus of the secondary OS to the placeholder application maintains focus synchronization and focus primacy of the primary OS.
A third technique for synchronizing focus detects when the focused application differs between the two operating systems. In some configurations, the application hosting engine registers with the secondary OS to receive a notification when an application running on the secondary OS is brought into focus. When this notification is received, the application hosting engine checks if the primary OS focus is already on a corresponding proxy application. If it is, there is nothing to do, as focus is already synchronized. However, if the primary OS is not focused on a corresponding proxy application, the application hosting engine will instruct the secondary OS to set focus according to the application currently focused by the primary OS. If the application currently focused by the primary OS is a proxy application, the application hosting engine will set the focus of the secondary OS to the corresponding guest application. If the application currently focused by the primary OS is not a proxy application - i.e. it is a native application - the application hosting engine will give the focus of the secondary OS to the placeholder application.
By synchronizing focus across the primary and secondary OS, each OS may continue to rely on the expectation that it is solely in control of a single focused application. Any confusion that might have occurred when focus moves from an application running natively on one OS to an application running natively on the other OS is removed. The resulting behavior improves human-computer interaction by meeting the expectations of a user operating applications as if they were seamlessly integrated, even if some of the applications actually run natively on a different operating system. Further, computer programming and other resources are conserved, as in some configurations, neither operating system requires changes to take advantage of these techniques, nor do the applications running in either operating system. In other configurations, guest applications are dynamically rebuilt, at compile time or at run time, to include the disclosed functionality. Moreover, computer processing and other resources are conserved because input directed to a proxy application on the primary OS is provided to the proper guest application on the guest OS directly, without requiring additional duplicative input.
Features and technical benefits other than those explicitly described above will be apparent from a reading of the following Detailed Description and a review of the associated drawings. This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. The term “techniques,” for instance, may refer to system(s), method(s), computer-readable instructions, module(s), algorithms, hardware logic, and/or operation(s) as permitted by the context described above and throughout the document.
BRIEF DESCRIPTION OF THE DRAWINGS
The Detailed Description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same reference numbers in different figures indicate similar or identical items. References made to individual items of a plurality of items can use a reference number with a letter of a sequence of letters to refer to each individual item. Generic references to the items may use the specific reference number without the sequence of letters.
FIG. 1A illustrates an application hosting engine rendering a proxy application that contains content generated by a guest application.
FIG. IB illustrates an input command received by the proxy application.
FIG. 1C illustrates the input command of FIG. IB as forwarded to the guest application by the application hosting engine.
FIG. 2A illustrates a guest application and corresponding proxy application with synchronized focus.
FIG. 2B illustrates shifting focus on the primary OS to an application that is native to the primary OS while focus on the secondary OS remains unchanged.
FIG. 2C illustrates an application hosting engine setting the focus of the secondary OS to a placeholder application.
FIG. 2D illustrates the secondary operating system raising an event indicating that the placeholder application has moved to the front.
FIG. 3A illustrates a guest chat application being launched from the primary OS.
FIG. 3B illustrates the secondary operation system raising an event indicating that the guest chat application has moved to the front.
FIG. 3C illustrates the application hosting engine creating a proxy chat application for the newly launched guest chat application.
FIG. 4A illustrates what may happen after the state depicted in FIG. 3B if proxy photo application is given focus before the application hosting engine is aware that guest chat application was brought into focus.
FIG. 4B illustrates application hosting engine giving the focus of the secondary operation system to the guest photo application while, concurrently, the application hosting engine is notified that the guest chat application was moved to the front.
FIG. 4C illustrates creating a proxy chat application, without giving it focus.
FIG. 5 A illustrates minimizing proxy photo application.
FIG. 5B illustrates the proxy chat application gaining the focus of the primary OS while sending the guest photo application to the back.
FIG. 5C illustrates the placeholder application obtaining the focus of the secondary OS.
FIG. 5D illustrates giving the focus of secondary OS to the guest chat application, synchronizing focus with the primary OS.
FIG. 5E illustrates click restoring the proxy photo application.
FIG. 5F illustrates synchronizing focus by setting the focus of the secondary OS to the guest photo application.
FIG. 6 is a flow diagram of an example method for synchronizing focus across incompatible operating systems.
FIG. 7 is a computer architecture diagram illustrating an illustrative computer hardware and software architecture for a computing system capable of implementing aspects of the techniques and technologies presented herein.
FIG. 8 is a diagram illustrating a distributed computing environment capable of implementing aspects of the techniques and technologies presented herein.
DETAILED DESCRIPTION
To address the above and other issues, techniques have been developed to present an individual application running on a secondary operating system as if it was native to the primary operating system. For example, a secondary ANDROID-based application may be presented within a WINDOWS desktop, adopting the UI idioms of WINDOWS, interacting with other native WINDOWS applications, and otherwise acting like a native WINDOWS application. To accomplish this, the ANDROID operating system is run within a virtual machine (VM) and the ANDROID-based guest application is run in a desktop of the ANDROID VM. A proxy application is created within the WINDOWS desktop that displays the graphics rendered by the guest application. User input and other interactions with the proxy application are forwarded to the guest application.
Operating systems typically only support direct user interaction with one application at a time. Specifically, user input from a keyboard, mouse, finger, voice or other input mechanism is sent to a “focused application". The focused application may also be referred to as a foreground application or an active application, and is typically distinguished visually from background applications that do not receive user input. For example, the operating system may render a focused application with a different title bar color than non-focused applications. Setting the focus of an operating system refers to selecting which application receives user input. Throughout this document, references to a focused application also refer to a focused window, or whatever aspect of a GUI the operating system directs user input to.
However, problems can arise when two operating systems are participating together in a single application model, and each operating system expects to be in complete control over a single focused application. For example, although a proxied application in the primary OS and a corresponding guest application in the secondary OS may each be in focus in their respective OS, a pop-up may unexpectedly occur in the secondary OS, taking focus away from the guest application. When this happens, focus becomes out of sync between the two operating systems. As a result, commands sent to the secondary OS may be received by the wrong application. As referred to herein, the single application model is a number of techniques, technologies, and patterns that enable applications running in a secondary OS to be displayed and interacted with in a primary OS with the appearance and behaviors of an application that executes natively on the primary OS.
For example, if the guest application is a word processing application, and a pop-up is presented reminding the user to install a system update, the application hosting engine may be unaware of the change of focus in the secondary OS from the word processing application window to the popup window. As such, the application hosting engine may forward an input event from the proxy word processing application (e.g., text entry or formatting, menu selection) to the secondary OS, expecting it will be handled by the word processing application. Instead, the input event will be forwarded to the pop-up reminder, as this is the application in the secondary OS that actually has focus. Sending an input command to the wrong application may fail silently, cause data loss, or result in other unexpected behavior. Throughout this document, reference is made to input received by an application, sending input to an application, and other interactions with applications. It is understood that applications typically consist of one or more windows, and that input events are sent to and processed by windows within an application. As such, whenever reference is made to an input event interacting with an application, it is understood to also refer to an input event interacting with a window of an application.
Conversely, confusion may be caused when a guest application unexpectedly gains focus. This can happen when launching the guest application from the primary operating system. The primary OS launches the guest application by sending a “launch application” command to the secondary OS. This command is asynchronous in that as soon as it has been issued, the primary OS returns focus to the previous application that had focus. Meanwhile, the secondary OS begins launching the guest application, initializes the guest application, and provides focus to the guest application. In some configurations, the guest application renders a user interface into a buffer provided by the primary OS, which becomes visible to the user in a proxy application. However, since the focus of the primary OS already reverted back to the previous application, any user input commands will continue to be directed to the previous application and not to the proxy of the guest application that was recently launched. This can cause confusion if the user expects to interact with the recently launched application as soon as it is displayed.
This type of confusion can happen any time the secondary OS is asked to bring a first guest application into focus asynchronously - e.g., when restoring a first proxy application that has been minimized. In between the time the command is issued and the time the first guest application is brought into focus in the secondary OS, a second application in the primary OS may gain focus. If the second application is a native application, then user expectations will be met because UI commands are not forwarded from native applications, and so it does not matter when the first guest application is brought into focus on the secondary OS.
However, if the second application is a proxy application for a second guest application, the application hosting engine will tell the secondary OS to bring the second guest application into focus. The result is a race - the first guest application, which was asked to be restored asynchronously, may come into focus first, only to lose focus to the second guest application. In this case, user expectations are met, because the second application and the corresponding second guest application will both be in focus. However, it is also possible that the second guest application will come into focus first, only to lose focus to the restored first guest application. If this happens, focus synchronization is lost - i.e., the first guest application in the secondary OS will have focus while the second application will still have focus in the primary OS. As a result, input commands would be forwarded to the wrong guest application.
The techniques disclosed herein synchronize focus between two operating systems that run concurrently as part of a single application model. One of the operating systems is selected as a primary OS where focus is considered absolute. The secondary OS is then managed such that focus is reflected from the primary operating system. In some embodiments, the primary OS is a host OS and the secondary OS is a guest OS that executes on a hypervisor or other virtual machine. One technique used to synchronize focus is to launch a stub placeholder application in the secondary OS. Then, if a native application running within the primary OS- i.e., an application with no counterpart in the secondary OS - gains focus, an application hosting engine will cause the secondary OS to give focus to the placeholder. The placeholder application may be managed exclusively by the application hosting engine, such that it cannot unexpectedly obtain focus in the secondary OS.
Another technique used to synchronize focus occurs when a proxy application gains focus in the primary OS. When this happens, the application hosting engine explicitly gives focus to the corresponding guest application.
A third technique for synchronizing focus detects when the focused application differs between the two operating systems. In some configurations, the application hosting engine registers with the secondary OS to receive a notification when an application is brought into focus. When this notification is received, the application hosting engine checks if the primary OS focus is already on a corresponding proxy application. If it is, there is nothing to do, as focus is already in sync. However, if a different application within the primary OS has focus, the application hosting engine will instruct the secondary OS to set focus to a guest application corresponding to the different application. If there is no guest application corresponding to the different application, then the placeholder application will be given focus.
By synchronizing focus across the primary and secondary OS, each OS may continue to rely on the expectation that it is solely in control of a single focused application. Any confusion that might have occurred when focus moves from an application running natively on one OS to an application running natively on the other OS is removed. Further, computer programming and other resources are conserved, as neither operating system requires changes to take advantage of these techniques, nor do the applications running in either operating system. The resulting behavior improves human-computer interaction by meeting the expectations of a user operating applications as if they were seamlessly integrated, even if some of the applications are actually run natively on a different operating system. Moreover, computer processing and other resources are conserved, as input directed to a proxy application on the primary OS is provided to the proper guest application on the secondary OS in the first instance, without requiring additional duplicative input.
FIG. 1A illustrates an application hosting engine 150 rendering a proxy application 114 that contains content generated by a guest application 124. Computing device 102 executes host operating system (OS) 110, which displays host operating desktop 112 on a display 160. Guest operating system 120 is concurrently executing on computing device 102. Guest OS 120 may be running within a hypervisor, virtual machine, emulator, or the like.
Guest OS 120 renders content to guest OS desktop 122, which is also configured to render content to display 160. As such, guest OS desktop 122 and host OS desktop 112 often have the same dimensions, resolution, and other properties. However, desktop dimensions, resolutions, and scales do not have to match in order to implement focus synchronization. Guest application 124 is running on guest OS 120. Guest application 124 renders content that would ordinarily be displayed by guest OS 120 on guest OS desktop 122. However, in order to create the impression that guest application 124 is a native application running on host OS 110 and allow increased functionality between guest application 124 and native applications running on host OS 110, application hosting engine 150 renders the content generated by guest application 124 in proxy application 114. Proxy application 114 appears on host OS desktop 112 and operates and appears as a true native application of host OS 110. In some configurations, application hosting engine 150 only renders content generated by guest OS 120 that is associated with a guest application that is proxied in host OS 110. That guest OS 120 does not actually render to display 160 is indicated by dashed lines of guest OS desktop 122 and guest application 124. In some configurations, guest OS 120 renders content to a pseudo display device that does not actually render content to a screen. In some configurations, application hosting engine 150 provides guest application 124 with a graphics buffer into which content from guest application 124 is rendered. Proxy application 114 may then use this buffer when rendering content to host OS desktop 112. Since guest OS 120 and host OS 110 are configured to use the same display 160, screen coordinates 126 and 116 are the same. As proxy application 114 is moved around host OS desktop 112, application hosting engine 150 will move guest application 124 to the corresponding location within guest OS desktop 122. Similarly, in some embodiments, as proxy application 114 is resized within host desktop 112, application hosting engine 150 will resize guest application 124 to the same width and height. In other embodiments, application hosting engine 150 may keep guest application 124 a constant size while allowing proxy application 134 to be resized. Updating the size and location of guest application 124 in this way is referred to herein as synchronizing size and location of proxy application 114 and guest application 124.
FIG. IB illustrates an input command 146 received by the proxy application 114. Input command 146 may be a mouse click, keyboard input, touch input, voice command, automation command, the invocation of an operating system user interface application programming interface (API), or any other technique for controlling the proxy application 114. Input command 146 may be the beginning of a sequence of input commands, such as a double click, drag and drop, hover, or other user interface idiom.
FIG. 1C illustrates the input command 146 as provided to the guest application 124 by the application hosting engine 150. Application hosting engine 150 provides input command 146 to guest application 124 as input command 156. Input command 156 maybe a direct copy of input command 146 or a translation to one or more corresponding input commands recognized by applications running on guest OS 120. For example, if proxy application 114 receives a mouse click event at coordinates (200, 250), application hosting engine 150 may create a mouse click event with coordinates (200, 250) but that is formatted for applications running on guest OS 120. Application hosting engine 150 may then forward the newly created event to proxy application 114. Alternatively, application hosting engine 150 may invoke an automation API, OS API, or an application-specific API to cause guest application 124 to perform a function equivalent to the function that input command 146 is expected to perform.
FIG. 2 A illustrates a guest photo application 124 and a corresponding proxy photo application 114 with synchronized focus. As illustrated, focus is indicated by the thick borders around proxy photo application 114 and guest photo application 124. Proxy photo application 114 executes on primary operating system desktop 212 of primary operating system 210. Primary operating system 210 may be a host operating system similar to host operating system 110 described above in conjunction with FIG 1A. Native spreadsheet application 218 is also executing on primary OS desktop 212. Native spreadsheet application 218 executes on primary OS 210 directly, and is not a proxy application to a corresponding guest application. A taskbar 219 located at the bottom of primary OS desktop 212 contains icons of running applications.
Chat application icon 216 may be activated to launch a chat application. Chat application icon 216 may be a desktop icon or a taskbar 219 icon; or the chat application may be accessed in another manner (e.g., start menu, voice command, automation, other programmatic manipulation). If chat application icon 216 is associated with a native chat application, then activating it would simply launch the associated application. However, chat application icon 216 may be associated with a guest application that executes within secondary operating system 220. In this scenario, activating chat application icon 216 causes application hosting engine 150 to send an application launch command to secondary operating system 220. The application launch command causes secondary operating system 220 to launch a guest chat application.
Secondary operating system 220 renders secondary operating system desktop 222. Guest photo application 124 has the focus of secondary operating system 220, as indicated by the thick border. The dashed lines around guest photo application 124 indicate that the content drawn by guest photo application 124 is not rendered to the display by the guest photo application 124 directly. Instead, content drawn by the guest photo application 124 is rendered by corresponding proxy photo application 114.
Placeholder application 226 is a stub application launched by application hosting engine 150 to hold the focus of secondary operating system 220 when primary operating system 210 has given focus to a native application. This enables focus synchronization by allowing a guest application on secondary operating system 220 to have focus only when a corresponding proxy application on primary operating system 210 has focus. Placeholder application 226 does not render any content.
Application hosting engine 150 includes values associated with currently focused primary operating system application 252 and currently focused guest operating system application 254. These values hold identifiers of the applications that are currently in focus in their respective operating systems. As illustrated, photo application 114 currently has the focus of primary operating system 210, and photo application 124 currently has the focus of secondary operating system 220. These values are updated in response to events generated by the operating systems 210 and 220, as discussed in more detail below.
FIG. 2B illustrates shifting focus in the primary OS 210 to an application 218 that is native to the primary OS 210 while focus in the secondary OS 220 remains unchanged. Specifically, focus has shifted to native spreadsheet application 218. The focus may have shifted in response to a user input command such as a mouse click, keyboard command, voice command, touch gesture, or the like. The focus also may have shifted as a result of automation or other programmatic manipulation.
The primary operating system 210 generates set focus event 260, which application hosting engine 150 receives and uses to determine that native spreadsheet application 218 now has the focus of primary operating system 210. The value of currently focused primary OS app 252 is updated accordingly. At the time depicted by FIG. 2B, the focus of secondary operating system 220 remains on guest photo application 124. In some configurations, set focus event 260 is processed synchronously by application hosting engine 150, ensuring that changes made to the focus of secondary operating system 220 are made before a user is able to change the focus of primary OS 210 again. In other configurations, set focus event 260 is processed asynchronously by application hosting engine 150.
FIG. 2C illustrates application hosting engine 150 setting the focus of the secondary OS to a placeholder application. Specifically, application hosting engine 150 sends set focus command 270 to secondary operating system 220. In response, secondary operating system 220 gives the focus to placeholder application 226, as illustrated by the thick border around placeholder application 226. Application hosting engine 150 has also updated the value of currently focused guest OS app 254 to store an identifier of placeholder 226. Application hosting engine 150 sets the focus of secondary operating system 220 to placeholder application 226 so that the focus of the operating systems remains synchronized.
FIG. 2D illustrates the secondary operating system raising an event 262 indicating that the placeholder application 226 has moved to the front. Some operating systems use a stack metaphor for arranging applications. The application on the front of the stack is visible, occluding any other applications behind it in the stack. Applications may be moved forward or backward in the stack, or moved to the front or the back of the stack. Furthermore, these operating systems may raise events when applications are moved within the stack. Application hosting engine 150 registers to receive “AppMovedToFront” events so that it may know when an application on secondary operating system 220 has been moved to the front of the application stack - and therefore has received the focus of secondary OS 220. As illustrated, AppMovedToFront event 262 indicates to application hosting engine 150 that placeholder application 226 has the focus of secondary OS 220. If the set focus command 270 was issued asynchronously, it is possible that the focus of primary OS 210 changed from the time the asynchronous command was given and the time that AppMovedToFront event 262 is received by application hosting engine 150. As illustrated, AppMovedToFront event 262 is received by application hosting engine 150 before any change of focus to primary OS 210. Application hosting engine 150 determines if the focus of primary OS 210 has changed. Since it has not, no further action is required and focus synchronization is maintained.
FIG. 3 A illustrates a guest chat application 324 being launched from the primary OS 210. Specifically, click 302 on chat application icon 216 causes application hosting engine to send a command to secondary operating system 220 to launch guest chat application 324. This command is asynchronous, and the focus of primary OS 210 remains on native application 218.
Once it is launched, guest chat application 324 will receive the focus of secondary operating system 220. Application hosting engine 150 does not know when the launch of guest chat application 324 will complete, or when guest chat application 324 will receive the focus of secondary OS 220.
FIG. 3B illustrates the secondary operating system 220 raising an event 364 indicating that the guest chat application 324 has moved to the front - i.e., that guest chat app 324 has received the focus of secondary operating system 220. In response, application hosting engine 150 updates the value of currently focused guest OS app 254 to store a reference to chat app 324.
FIG. 3C illustrates the application hosting engine 150 creating a proxy chat application 314 for the newly launched guest chat application 324. Specifically, application hosting engine 150 sends a create and set focus command 372 to primary OS 210. Primary OS 210 responds by launching proxy chat application 314 and giving it focus. In some configurations, proxy chat application 314 is an instance of an application deployed with and designed to interact with application hosting engine 150 to render content generated by guest chat application 324 and to forward input commands to guest chat application 324. Focus synchronicity is maintained by ensuring that proxy chat application 314 and corresponding guest chat application 324 both have the focus of their respective operating systems.
FIG. 3C illustrates what happens when the asynchronous launching of a guest application completes and synchronizes focus with primary operating system 210 without interruption. However, it is possible that in the intervening time the focus of primary OS 210 will have changed. This scenario is discussed below in conjunction with FIGS. 4A-4C.
FIG. 4A illustrates what may happen after the state depicted in FIG. 3B if proxy photo application 114 was given focus before the application hosting engine 150 is aware that guest chat application 324 was brought into focus. Specifically, a user may have clicked on proxy photo application 114 before the create and set focus command 372 was received by application hosting engine 150, or even, as illustrated, before it was sent. In response to setting the focus of primary OS 210 to proxy photo application 114, set focus event 466 is provided to application hosting engine 150. Application hosting engine 150 stores an identifier of photo app 114 in currently focused primary OS app 252. At the time depicted by FIG. 4A, the focus of secondary OS 220 remains on guest chat application 324.
FIG. 4B illustrates application hosting engine 150 giving the focus of secondary operation system 220 to guest photo application 124 while, concurrently, application hosting engine 150 is notified that the guest chat application was moved to the front. Set focus command 474 is sent to secondary OS 220 to give guest photo application 124 focus. This results in focus synchronicity, as guest photo application 124 and proxy photo application 114 both have focus on their respective operating systems. AppMovedToFront event 468 indicates that guest chat application 324 was moved to the front of the application stack - even though focus has since been transferred away. The order in which set focus command 474 and AppMovedToFront event 468 are processed is indeterminate. As illustrated, set focus command 474 was processed while AppMovedToFront event 468 is in flight. However, it is just as possible that AppMovedToFront event 468 was sent and even received by application hosting engine 150 before set focus command 474 was received and/or processed by secondary OS 220. In some configurations, where there is a conflict as to which application has the focus, the application focused by the primary application is chosen, and the focus of the secondary OS is set to match.
FIG. 4C illustrates creating a proxy chat application 314, without giving it focus. Proxy chat application 314 is not given focus because proxy photo application 114 was given focus by the user after launching guest chat application 324. Application hosting engine 150 sends create command 372 to primary operating system 210. Application hosting engine 150 knows that the proxy photo application 114 has the focus of primary operating system 210. Accordingly, proxy chat application 314 is created and displayed, but not given the focus of primary OS 210.
FIG. 5A illustrates minimizing proxy photo application 114. Minimizing and restoring proxy applications is another scenario in which a corresponding guest application is asynchronously brought to front. Similar to the scenario in which an application is launched, there is potential for a race if the focus of the primary OS 210 changes before the guest application is restored.
As illustrated, minimization click 502 causes proxy photo application 114 to be minimized, losing focus. Primary OS 210 sends remove focus event 560 to application hosting engine 150.
FIG. 5B illustrates the proxy chat application 314 gaining the focus of the primary OS 210 while sending the guest photo application 124 to the back. Primary OS 210 automatically gives focus to a different application when proxy photo application 114 is minimized. As illustrated, focus is returned to proxy chat application 314. Primary OS 210 sends a has focus event 562 to application hosting engine 150, indicating that proxy chat application 314 now has focus. Application hosting engine 150 updates currently focused primary OS app 252 accordingly. In response to the change in focus of primary OS 210, application hosting engine sends a send to back command 572 to secondary OS 220.
As illustrated, in some configurations, application hosting engine updates currently focused guest OS app 254 when sending the send to back command 572. In this configuration, application hosting engine 150 may also send a “send to front” command as part of or along with the send to back command 572 to indicate which application should replace guest photo application 124 as having focus. In other configurations, application hosting engine 150 waits to receive a “move app to front” event confirming that the focus has changed before performing the update.
FIG. 5C illustrates the placeholder application 226 obtaining the focus of the secondary OS 220. In response to the send to back command 572, second operating system 220 moved guest photo application 124 to the back of the application stack - i.e., guest photo application 124 now has the lowest Z order and is occluded by any overlapping windows. As illustrated, secondary OS 220 selected placeholder application 226 to receive the focus, consequently, secondary OS 220 sends AppMovedToFront event 564 to application hosting engine 150.
The scenario depicted in FIG. 5C occurs in the context of minimizing proxy photo application 114. However, there are other situations in which a guest application may unexpectedly gain the focus of secondary OS 220. For example, a pop up generated by secondary OS 220 may appear unexpectedly, such as a reminder to download a system update. The steps depicted in FIGS. 5C- 5F apply to these other scenarios as well.
FIG. 5D illustrates giving the focus of secondary OS 220 to the guest chat application 324, synchronizing focus with the primary OS 210. In response to the AppMovedToFront event 564, application hosting engine determines that primary OS 210 has given the focus to a proxy application - in this case proxy chat application 314. Application hosting engine 150 provides send to front command 574 to secondary OS 220, causing guest chat application 324 to obtain focus. This ensures focus synchronicity as the corresponding proxy application 314 also has focus of primary OS 210.
Allowing placeholder application 226 to continue to have focus of secondary OS 220 while proxy chat application 314 has the focus of primary OS 210 would break focus synchronicity. Specifically, focus synchronicity is achieved when a native application has the focus of primary OS 210 and placeholder application 226 has the focus of secondary OS 220. Focus synchronicity is only otherwise achieved when a guest application and corresponding proxy application have the focus of their respective operating systems. As such, allowing a proxy application to have focus in primary OS 210 while the placeholder application 226 has focus of the secondary OS 220 breaks focus synchronicity.
FIG. 5E illustrates click 522 restoring the proxy photo application 314. Restoring proxy photo application 314 brings it back into focus. Primary OS 210 provides set focus event 566 to application hosting engine 150, which updates currently focused primary OS app 252.
FIG. 5F illustrates synchronizing focus by setting the focus of the secondary OS 220 to the guest photo application 124. Application hosting engine 150 provides set focus event 568 to secondary OS 220, causing guest photo application 124 to be brought into focus.
Restoring a minimized proxy application introduces another race - while not depicted, a user could activate native application 218 before guest photo application 124 is brought into focus. Left unchecked, this would break focus synchronicity. In this scenario, application hosting engine 150 would detect the change in focus of the primary OS 210 and reflect this change in the secondary OS 220 by bringing placeholder application 226 back into focus.
Turning now to FIG. 6, aspects of a routine for synchronizing focus across incompatible operating systems is shown and described. For ease of understanding, the processes discussed in this disclosure are delineated as separate operations represented as independent blocks. However, these separately delineated operations should not be construed as necessarily order dependent in their performance. The order in which the process is described is not intended to be construed as a limitation, and any number of the described process blocks may be combined in any order to implement the process or an alternate process. Moreover, it is also possible that one or more of the provided operations is modified or omitted.
With reference to FIG. 6, routine 600 begins at operation 602 where a second guest application 324 is launched on secondary OS 220. The second guest application 324 may have been launched by activating icon 216, for example.
Next at operation 604, an indication 466 is received that first proxy application 114 has gained the focus of the primary operating system 210. This could happen in response to a user clicking on proxy photo application 114, for example.
Next at operation 606, an indication 364 that the second guest application 324 has gained focus of the secondary operating system 220 is received.
Next at operation 608, application hosting engine 150 sets the focus of the secondary OS 220 to a first guest application 124 that corresponds to the first proxy application 114.
Proceeding to operation 610, a second proxy application 314 is created on the primary OS 210 that corresponds to the second guest application 324 without giving focus to the second proxy application 314. The particular implementation of the technologies disclosed herein is a matter of choice dependent on the performance and other requirements of a computing device. Accordingly, the logical operations described herein are referred to variously as states, operations, structural devices, acts, or modules. These states, operations, structural devices, acts, and modules can be implemented in hardware, software, firmware, in special-purpose digital logic, and any combination thereof. It should be appreciated that more or fewer operations can be performed than shown in the figures and described herein. These operations can also be performed in a different order than those described herein.
It also should be understood that the illustrated methods can end at any time and need not be performed in their entireties. Some or all operations of the methods, and/or substantially equivalent operations, can be performed by execution of computer-readable instructions included on a computer- storage media, as defined below. The term “computer-readable instructions,” and variants thereof, as used in the description and claims, is used expansively herein to include routines, applications, application modules, program modules, programs, components, data structures, algorithms, and the like. Computer-readable instructions can be implemented on various system configurations, including single-processor or multiprocessor systems, minicomputers, mainframe computers, personal computers, hand-held computing devices, microprocessor-based, programmable consumer electronics, combinations thereof, and the like.
Thus, it should be appreciated that the logical operations described herein are implemented (1) as a sequence of computer implemented acts or program modules running on a computing system and/or (2) as interconnected machine logic circuits or circuit modules within the computing system. The implementation is a matter of choice dependent on the performance and other requirements of the computing system. Accordingly, the logical operations described herein are referred to variously as states, operations, structural devices, acts, or modules. These operations, structural devices, acts, and modules may be implemented in software, in firmware, in special purpose digital logic, and any combination thereof.
For example, the operations of the routine 600 are described herein as being implemented, at least in part, by modules running the features disclosed herein can be a dynamically linked library (DLL), a statically linked library, functionality produced by an application programing interface (API), a compiled program, an interpreted program, a script or any other executable set of instructions. Data can be stored in a data structure in one or more memory components. Data can be retrieved from the data structure by addressing links or references to the data structure.
Although the following illustration refers to the components of the figures, it should be appreciated that the operations of the routine 600 may be also implemented in many other ways. For example, the routine 600 may be implemented, at least in part, by a processor of another remote computer or a local circuit. In addition, one or more of the operations of the routine 600 may alternatively or additionally be implemented, at least in part, by a chipset working alone or in conjunction with other software modules. In the example described below, one or more modules of a computing system can receive and/or process the data disclosed herein. Any service, circuit or application suitable for providing the techniques disclosed herein can be used in operations described herein. FIG. 7 shows additional details of an example computer architecture 700 for a device, such as a computer or a server configured as part of the systems described herein, capable of executing computer instructions (e.g., a module or a program component described herein). The computer architecture 700 illustrated in FIG. 7 includes processing unit(s) 702, a system memory 704, including a random-access memory 706 (“RAM”) and a read-only memory (“ROM”) 708, and a system bus 710 that couples the memory 704 to the processing unit(s) 702.
Processing unit(s), such as processing unit(s) 702, can represent, for example, a CPU-type processing unit, a GPU-type processing unit, a field-programmable gate array (FPGA), another class of digital signal processor (DSP), or other hardware logic components that may, in some instances, be driven by a CPU. For example, and without limitation, illustrative types of hardware logic components that can be used include Application-Specific Integrated Circuits (ASICs), Application-Specific Standard Products (ASSPs), System-on-a-Chip Systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.
A basic input/output system containing the basic routines that help to transfer information between elements within the computer architecture 700, such as during startup, is stored in the ROM 708. The computer architecture 700 further includes a mass storage device 712 for storing an operating system 714, application(s) 716, modules 718, and other data described herein.
The mass storage device 712 is connected to processing unit(s) 702 through a mass storage controller connected to the bus 710. The mass storage device 712 and its associated computer- readable media provide non-volatile storage for the computer architecture 700. Although the description of computer-readable media contained herein refers to a mass storage device, it should be appreciated by those skilled in the art that computer-readable media can be any available computer-readable storage media or communication media that can be accessed by the computer architecture 700.
Computer-readable media can include computer-readable storage media and/or communication media. Computer-readable storage media can include one or more of volatile memory, nonvolatile memory, and/or other persistent and/or auxiliary computer storage media, removable and nonremovable computer storage media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules, or other data. Thus, computer storage media includes tangible and/or physical forms of media included in a device and/or hardware component that is part of a device or external to a device, including but not limited to random access memory (RAM), static random-access memory (SRAM), dynamic random-access memory (DRAM), phase change memory (PCM), read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable readonly memory (EEPROM), flash memory, compact disc read-only memory (CD-ROM), digital versatile disks (DVDs), optical cards or other optical storage media, magnetic cassettes, magnetic tape, magnetic disk storage, magnetic cards or other magnetic storage devices or media, solid- state memory devices, storage arrays, network attached storage, storage area networks, hosted computer storage or any other storage memory, storage device, and/or storage medium that can be used to store and maintain information for access by a computing device.
In contrast to computer-readable storage media, communication media can embody computer- readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave, or other transmission mechanism. As defined herein, computer storage media does not include communication media. That is, computer-readable storage media does not include communications media consisting solely of a modulated data signal, a carrier wave, or a propagated signal, per se.
According to various configurations, the computer architecture 700 may operate in a networked environment using logical connections to remote computers through the network 720. The computer architecture 700 may connect to the network 720 through a network interface unit 722 connected to the bus 710. The computer architecture 700 also may include an input/output controller 724 for receiving and processing input from a number of other devices, including a keyboard, mouse, touch, or electronic stylus or pen. Similarly, the input/output controller 724 may provide output to a display screen, a printer, or other type of output device.
It should be appreciated that the software components described herein may, when loaded into the processing unit(s) 702 and executed, transform the processing unit(s) 702 and the overall computer architecture 700 from a general-purpose computing system into a special-purpose computing system customized to facilitate the functionality presented herein. The processing unit(s) 702 may be constructed from any number of transistors or other discrete circuit elements, which may individually or collectively assume any number of states. More specifically, the processing unit(s) 702 may operate as a finite-state machine, in response to executable instructions contained within the software modules disclosed herein. These computer-executable instructions may transform the processing unit(s) 702 by specifying how the processing unit(s) 702 transition between states, thereby transforming the transistors or other discrete hardware elements constituting the processing unit(s) 702.
FIG. 8 depicts an illustrative distributed computing environment 800 capable of executing the software components described herein. Thus, the distributed computing environment 800 illustrated in FIG. 8 can be utilized to execute any aspects of the software components presented herein. For example, the distributed computing environment 800 can be utilized to execute aspects of the software components described herein.
Accordingly, the distributed computing environment 800 can include a computing environment 802 operating on, in communication with, or as part of the network 804. The network 804 can include various access networks. One or more client devices 806A-806N (hereinafter referred to collectively and/or generically as “clients 806” and also referred to herein as computing devices 806) can communicate with the computing environment 802 via the network 804. In one illustrated configuration, the clients 806 include a computing device 806A such as a laptop computer, a desktop computer, or other computing device; a slate or tablet computing device (“tablet computing device”) 806B; a mobile computing device 806C such as a mobile telephone, a smart phone, or other mobile computing device; a server computer 806D; and/or other devices 806N. It should be understood that any number of clients 806 can communicate with the computing environment 802.
In various examples, the computing environment 802 includes servers 808, data storage 810, and one or more network interfaces 812. The servers 808 can host various services, virtual machines, portals, and/or other resources. In the illustrated configuration, the servers 808 host virtual machines 814, Web portals 816, mailbox services 818, storage services 820, and/or, social networking services 822. As shown in FIG. 8 the servers 808 also can host other services, applications, portals, and/or other resources (“other resources”) 824.
As mentioned above, the computing environment 802 can include the data storage 810. According to various implementations, the functionality of the data storage 810 is provided by one or more databases operating on, or in communication with, the network 804. The functionality of the data storage 810 also can be provided by one or more servers configured to host data for the computing environment 802. The data storage 810 can include, host, or provide one or more real or virtual datastores 826A-826N (hereinafter referred to collectively and/or generically as “datastores 826”). The datastores 826 are configured to host data used or created by the servers 808 and/or other data. That is, the datastores 826 also can host or store web page documents, word documents, presentation documents, data structures, algorithms for execution by a recommendation engine, and/or other data utilized by any application program. Aspects of the datastores 826 may be associated with a service for storing files.
The computing environment 802 can communicate with, or be accessed by, the network interfaces 812. The network interfaces 812 can include various types of network hardware and software for supporting communications between two or more computing devices including, but not limited to, the computing devices and the servers. It should be appreciated that the network interfaces 812 also may be utilized to connect to other types of networks and/or computer systems.
It should be understood that the distributed computing environment 800 described herein can provide any aspects of the software elements described herein with any number of virtual computing resources and/or other distributed computing functionality that can be configured to execute any aspects of the software components disclosed herein. According to various implementations of the concepts and technologies disclosed herein, the distributed computing environment 800 provides the software functionality described herein as a service to the computing devices. It should be understood that the computing devices can include real or virtual machines including, but not limited to, server computers, web servers, personal computers, mobile computing devices, smart phones, and/or other devices. As such, various configurations of the concepts and technologies disclosed herein enable any device configured to access the distributed computing environment 800 to utilize the functionality described herein for providing the techniques disclosed herein, among other aspects.
The present disclosure is supplemented by the following example clauses.
Example 1 : A method comprising: initiating (302, 502) an asynchronous operation on a secondary operating system (220) that sets a focus of the secondary operating system (220) to a guest application (324); before the asynchronous operation completes, receiving an indication (466) that an application (114, 218) running on a primary operating system (210) has gained a focus of the primary operating system (210); receiving an indication (364) that the guest application (324) has gained the focus of the secondary operating system (220); and in response to the indication (364) that the guest application (324) has gained the focus of the secondary operating system (220), setting the focus of the secondary operating system (220) to another application (124, 226) running on the secondary operating system (220) that corresponds to the application (114, 218) running on the primary operating system (210).
Example 2: The method of Example 1, wherein the asynchronous operation comprises launching the guest application.
Example 3: The method of Example 2, further comprising: creating a proxy application running on the primary operating system that corresponds to the guest application without giving the focus of the primary operating system to the proxy application, wherein content generated by the guest application is rendered by the proxy application and wherein user interface commands received by the proxy application are forwarded to the guest application.
Example 4: The method of Example 1, wherein the asynchronous operation comprises restoring the guest application from a minimized state.
Example 5: The method of Example 1, wherein the application running on the primary operating system comprises a second proxy application, and wherein the other application running on the secondary operating system comprises a second guest application.
Example 6: The method of Example 1, wherein the application running on the primary operating system comprises a native application, and wherein the other application running on the secondary operating system comprises a placeholder application.
Example 7: The method of Example 6, wherein the placeholder application receives user interface events originating from the secondary operating system.
Example 8: The method of Example 1, wherein the primary operating system runs on a computing device, wherein the secondary operating system comprises a guest operating system running on a virtual machine, and wherein the virtual machine runs on the computing device.
Example 9: The method of Example 1, wherein the asynchronous operation is initiated in response to user input received by the primary operating system.
Example 10: The method of Example 1, further comprising: registering to receive an indication when an individual application gains a focus of a secondary operating system.
Example 11 : A computing device comprising: one or more processors; a memory in communication with the one or more processors, the memory having computer-readable instructions stored thereupon which, when executed by the one or more processors, cause the computing device to: register to receive indications when a focus of a secondary operating system (220) changes, wherein a proxy application (114) having a focus of a primary operating system (210) displays content rendered by a guest application (124) that has the focus of the secondary operating system (210), and wherein user interface commands received by the proxy application (114) are forwarded to the guest application (124); receiving an indication that the focus of the secondary operating system (220) changed; and setting the focus of the secondary operating system (220) to the guest application (124).
Example 12: The computing device of Example 11, wherein the indication that the focus of the secondary operating system changed is received from the secondary operating system.
Example 13: The computing device of Example 11, wherein the focus of the secondary operating system is set back to the guest application in response to a determination that the proxy application continues to have the focus of the primary operating system.
Example 14: The computing device of Example 11, wherein the focus of the secondary operating system changed to an application launched independently by the secondary operating system.
Example 15: A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to: receive an indication of a focus of a primary operating system (210) changing from a proxy application (114) to a native application (218), wherein the proxy application (114) displays content rendered by a guest application (124) having the focus of the secondary operating system (210) and wherein user interface commands received by the proxy application (114) are forwarded to the guest application (124) when the guest application (124) has the focus of the secondary operating system (220); and setting a focus of the secondary operating system (220) to a placeholder application.
Example 16: The computer-readable storage medium of Example 15, wherein the instructions further cause the processor to: launch the placeholder application on the secondary operating system.
Example 17: The computer-readable storage medium of Example 15, wherein the native application does not proxy a guest application running in the secondary operating system.
Example 18: The computer-readable storage medium of Example 15, wherein user interface events of the secondary operating system are sent to the placeholder application while the placeholder application has the focus of the secondary operating system.
Example 19: The computer-readable storage medium of Example 15, wherein the instructions further cause the processor to: receive an indication that the proxy application has the focus of the primary operating system; and set the focus of the secondary operating system to the guest application.
Example 20: The computer-readable storage medium of Example 15, wherein an individual application having the focus of the primary operating system is provided with user input received by the primary operating system.
While certain example embodiments have been described, these embodiments have been presented by way of example only and are not intended to limit the scope of the inventions disclosed herein. Thus, nothing in the foregoing description is intended to imply that any particular feature, characteristic, step, module, or block is necessary or indispensable. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions disclosed herein. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of certain of the inventions disclosed herein.
It should be appreciated that any reference to “first,” “second,” etc. elements within the Summary and/or Detailed Description is not intended to and should not be construed to necessarily correspond to any reference of “first,” “second,” etc. elements of the claims. Rather, any use of “first” and “second” within the Summary, Detailed Description, and/or claims may be used to distinguish between two different instances of the same element.
In closing, although the various techniques have been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended representations is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed subject matter.

Claims

1. A method comprising: initiating an asynchronous operation on a secondary operating system that sets a focus of the secondary operating system to a guest application ; before the asynchronous operation completes, receiving an indication that an application running on a primary operating system has gained a focus of the primary operating system; receiving an indication that the guest application has gained the focus of the secondary operating system; and in response to the indication that the guest application has gained the focus of the secondary operating system, setting the focus of the secondary operating system to another application running on the secondary operating system that corresponds to the application running on the primary operating system.
2. The method of claim 1, wherein the asynchronous operation comprises launching the guest application.
3. The method of claim 2, further comprising: creating a proxy application running on the primary operating system that corresponds to the guest application without giving the focus of the primary operating system to the proxy application, wherein content generated by the guest application is rendered by the proxy application and wherein user interface commands received by the proxy application are forwarded to the guest application.
4. The method of claim 1, wherein the asynchronous operation comprises restoring the guest application from a minimized state.
5. The method of claim 1, wherein the application running on the primary operating system comprises a second proxy application, and wherein the other application running on the secondary operating system comprises a second guest application.
6. The method of claim 1, wherein the application running on the primary operating system comprises a native application, and wherein the other application running on the secondary operating system comprises a placeholder application.
7. The method of claim 1, further comprising: registering to receive an indication when an individual application gains a focus of a secondary operating system.
8. A computing device comprising: one or more processors; a memory in communication with the one or more processors, the memory having computer-readable instructions stored thereupon which, when executed by the one or more processors, cause the computing device to: register to receive indications when a focus of a secondary operating system changes, wherein a proxy application having a focus of a primary operating system displays content rendered by a guest application that has the focus of the secondary operating system, and wherein user interface commands received by the proxy application are forwarded to the guest application; receiving an indication that the focus of the secondary operating system changed; and setting the focus of the secondary operating system to the guest application.
9. The computing device of claim 8, wherein the indication that the focus of the secondary operating system changed is received from the secondary operating system.
10. The computing device of claim 8, wherein the focus of the secondary operating system is set back to the guest application in response to a determination that the proxy application continues to have the focus of the primary operating system.
11. The computing device of claim 8, wherein the focus of the secondary operating system changed to an application launched independently by the secondary operating system.
12. A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to: receive an indication of a focus of a primary operating system changing from a proxy application to a native application, wherein the proxy application displays content rendered by a guest application having the focus of the secondary operating system and wherein user interface commands received by the proxy application are forwarded to the guest application when the guest application has the focus of the secondary operating system; and setting a focus of the secondary operating system to a placeholder application.
13. The computer-readable storage medium of claim 12, wherein the instructions further cause the processor to: launch the placeholder application on the secondary operating system.
14. The computer-readable storage medium of claim 12, wherein user interface events of the secondary operating system are sent to the placeholder application while the placeholder application has the focus of the secondary operating system.
15. The computer-readable storage medium of claim 12, wherein the instructions further cause the processor to: receive an indication that the proxy application has the focus of the primary operating system; and set the focus of the secondary operating system to the guest application.
PCT/US2023/013463 2022-05-20 2023-02-21 Focus synchronization across incompatible operating systems WO2023224705A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202263344505P 2022-05-20 2022-05-20
US63/344,505 2022-05-20
US17/846,820 2022-06-22
US17/846,820 US20230376336A1 (en) 2022-05-20 2022-06-22 Focus synchronization across incompatible operating systems

Publications (1)

Publication Number Publication Date
WO2023224705A1 true WO2023224705A1 (en) 2023-11-23

Family

ID=85724951

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2023/013463 WO2023224705A1 (en) 2022-05-20 2023-02-21 Focus synchronization across incompatible operating systems

Country Status (1)

Country Link
WO (1) WO2023224705A1 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160294918A1 (en) * 2015-03-31 2016-10-06 Dell Products, Lp Content Sharing and Storage of a Plurality of Remotely Connected Computing Devices in Physical or Virtualized Space

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160294918A1 (en) * 2015-03-31 2016-10-06 Dell Products, Lp Content Sharing and Storage of a Plurality of Remotely Connected Computing Devices in Physical or Virtualized Space

Similar Documents

Publication Publication Date Title
US9588657B1 (en) Seamless integration of non-native windows with dynamically scalable resolution into host operating system
US9317195B1 (en) Seamless integration of non-native windows with dynamically scalable resolution into host operating system
US10200453B2 (en) Reverse seamless integration between local and remote computing environments
US9032026B2 (en) Methods and systems for providing, by a remote machine, access to a desk band associated with a resource executing on a local machine
US7975236B1 (en) Seamless integration of non-native application into host operating system
US9588637B2 (en) Transparent user interface integration between local and remote computing environments
EP2891038B1 (en) Reverse seamless integration between local and remote computing environments
US8819180B2 (en) Integrated handset browser settings
US8387048B1 (en) Seamless integration, migration and installation of non-native application into native operating system
WO2016155388A1 (en) Method and device for installing and running application
WO2023197656A1 (en) Interface element positioning method, electronic device and storage medium
US9804872B1 (en) Method for emulation of a virtual OS bookmark on a host desktop
US20230376336A1 (en) Focus synchronization across incompatible operating systems
WO2023224705A1 (en) Focus synchronization across incompatible operating systems
US11010212B2 (en) System and method for supporting and negotiating multiple API versions across multiple products
US11947860B2 (en) Mapping incompatible windowing topographies across operating systems
WO2023224682A1 (en) Setting simultaneous focus across multiple operating systems
US20240053996A1 (en) Bridging ui elements across multiple operating systems
WO2023224681A1 (en) Mapping incompatible windowing topographies across operating systems
WO2024039477A1 (en) Bridging ui elements across multiple operating systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23712642

Country of ref document: EP

Kind code of ref document: A1