CN116456018A - Window interaction method and electronic device - Google Patents
Window interaction method and electronic device Download PDFInfo
- Publication number
- CN116456018A CN116456018A CN202210114776.0A CN202210114776A CN116456018A CN 116456018 A CN116456018 A CN 116456018A CN 202210114776 A CN202210114776 A CN 202210114776A CN 116456018 A CN116456018 A CN 116456018A
- Authority
- CN
- China
- Prior art keywords
- window
- display
- interface
- application
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000003993 interaction Effects 0.000 title claims abstract description 33
- 239000000725 suspension Substances 0.000 claims abstract description 193
- 238000007667 floating Methods 0.000 claims abstract description 78
- 238000013519 translation Methods 0.000 claims description 23
- 230000015654 memory Effects 0.000 claims description 21
- 230000004044 response Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 14
- 238000007726 management method Methods 0.000 description 72
- 239000004984 smart glass Substances 0.000 description 52
- GRRMZXFOOGQMFA-UHFFFAOYSA-J YoYo-1 Chemical compound [I-].[I-].[I-].[I-].C12=CC=CC=C2C(C=C2N(C3=CC=CC=C3O2)C)=CC=[N+]1CCC[N+](C)(C)CCC[N+](C)(C)CCC[N+](C1=CC=CC=C11)=CC=C1C=C1N(C)C2=CC=CC=C2O1 GRRMZXFOOGQMFA-UHFFFAOYSA-J 0.000 description 45
- 238000012545 processing Methods 0.000 description 31
- 239000010410 layer Substances 0.000 description 25
- 230000000694 effects Effects 0.000 description 22
- 238000010586 diagram Methods 0.000 description 19
- 230000006870 function Effects 0.000 description 17
- 230000001960 triggered effect Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000013461 design Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 239000000835 fiber Substances 0.000 description 3
- 230000003447 ipsilateral effect Effects 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 230000008034 disappearance Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000013468 resource allocation Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000012792 core layer Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72466—User interfaces specially adapted for cordless or mobile telephones with selection means, e.g. keys, having functions defined by the mode or the status of the device
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Environmental & Geological Engineering (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application provides a window interaction method and electronic equipment, and the method is applied to the electronic equipment and comprises the following steps: the electronic equipment displays a first interface of a first application; the first interface comprises a first suspension ball control; responsive to a first operation in the first interface, the electronic device displays a first floating window; and when the position of the first floating window is not overlapped with the position of the first floating ball control, the electronic equipment continuously displays the first floating ball control and the first floating window. Therefore, when the positions of the windows are overlapped, the electronic equipment can set a proper display mode for the windows, so that the windows are prevented from being in conflict, and the normal use of the windows by a user is further realized.
Description
The present application claims priority from the chinese patent office, application number 202210023812.2, application name "window interaction method and electronic device," filed on 1 month 10 2022, the entire contents of which are incorporated herein by reference.
Technical Field
The application relates to the technical field of terminals, in particular to a window interaction method and electronic equipment.
Background
With the popularization and development of the internet, the functional demands of electronic devices are becoming more and more diverse. For example, to meet a user's use needs for multiple functions, more electronic devices may support multiple windows displayed in the same interface. For example, the user may trigger the display of a hover sphere corresponding to the translation function by copying text to be translated, and the user may also trigger the display of a smart multi-window (or dock), side-bar, etc.) by sliding inward along the side edges of the screen.
Under normal conditions, when a user triggers the intelligent multi-window in the process of displaying the suspension ball, the position of the suspension ball overlaps with the position of the intelligent multi-window, so that the suspension ball collides with the intelligent multi-window, and the normal use of the suspension ball or the intelligent multi-window by the user is affected.
Disclosure of Invention
The embodiment of the application provides a window interaction method and electronic equipment, which enable the electronic equipment to set a proper display mode for a window when a plurality of windows are overlapped, avoid the plurality of windows from conflicting, and further enable a user to normally use the window.
In a first aspect, an embodiment of the present application provides a window interaction method, applied to an electronic device, where the method includes: the electronic equipment displays a first interface of a first application; the first interface comprises a first suspension ball control; responsive to a first operation in the first interface, the electronic device displays a first floating window; and when the position of the first floating window is not overlapped with the position of the first floating ball control, the electronic equipment continuously displays the first floating ball control and the first floating window. Therefore, when the positions of the windows are overlapped, the electronic equipment can set a proper display mode for the windows, so that the windows are prevented from being in conflict, and the normal use of the windows by a user is further realized.
In one possible implementation, the method further includes: and when the position of the first suspension window is overlapped with the position of the first suspension ball control, the electronic equipment cancels the display of the first suspension ball control. Therefore, when the positions of the windows are overlapped, the electronic equipment can avoid the collision of the windows by canceling the display method of the suspension ball.
In one possible implementation, the method further includes: responsive to an operation to cancel displaying the first floating window, the electronic device cancels displaying the floating window; the electronic equipment determines the duration from the cancel of the display of the first suspension ball control to the cancel of the display of the first suspension window; and when the duration does not exceed the first time threshold, the electronic equipment displays the first suspension ball control. Thus, the user can avoid displaying the floating window for a long time when the subsequent display of the floating ball is required.
In one possible implementation, the first floating window includes a control for opening the second application, and the method further includes: responsive to operation of the control for opening the second application, the electronic device displays a second interface; the second interface comprises a second floating window corresponding to the second application. Thus, the user can also open the second application by triggering the second floating window when the second application needs to be used.
In one possible implementation, the position of the first suspension window does not overlap with the position of the first suspension ball control, including: the position of the first suspension window and the position of the first suspension ball control are respectively positioned at two sides of a screen of the electronic equipment.
In one possible implementation, the position of the first suspension window does not overlap with the position of the first suspension ball control, including: the position of the first suspension window and the position of the first suspension ball control are positioned on the same side of the screen of the electronic equipment, and the position of the first suspension ball control is not overlapped with the position of a first area corresponding to the first suspension window; the first region includes a first floating window. Therefore, the electronic equipment can set the positions of the suspension window and the suspension ball according to the self requirements, and collision is avoided.
In one possible implementation, the size of the first region is related to the number of application controls included in the first floating window.
In one possible implementation, in response to a first operation in a first interface, the electronic device displays a first floating window comprising: responding to a first operation in a first interface, and displaying a first floating window by the electronic equipment when the electronic equipment determines that the position of the first operation is outside a second area corresponding to a first floating ball control; the second region includes a first hover ball control. Therefore, when the user needs to trigger the floating window according to the self requirement, the user can trigger the floating window far away from the floating ball, and the experience of using the floating window and the floating ball is improved.
In one possible implementation, the method further includes: in response to a second operation in the first interface, the electronic device continues to display the first hover ball control when the electronic device determines that the location at which the second operation is located is within the second area. Therefore, when the user needs to trigger the floating window according to the self requirement, the user can trigger the floating window far away from the floating ball, and the experience of using the floating window and the floating ball is improved.
In one possible implementation, the electronic device displays a first interface of a first application, including: the electronic equipment displays a third interface of the first application; the third interface comprises a first text; responsive to a third operation on the first text, the electronic device displays a first control; the first control comprises a copying option and a translation option; in response to a fourth operation of the copy option, the electronic device displays a third hover ball control; when the electronic device does not receive the operation for the third hover ball control within the first time threshold, the electronic device cancels the display of the third hover ball control and displays the first interface of the first application. Thus, the user can conveniently call out the suspension ball by copying the characters.
In a second aspect, an embodiment of the present application provides a window interaction method, a display unit, configured to display a first interface of a first application; the first interface comprises a first suspension ball control; a display unit for displaying a first floating window in response to a first operation in a first interface; and when the position of the first floating window is not overlapped with the position of the first floating ball control, the display unit is used for continuously displaying the first floating ball control and the first floating window.
In one possible implementation, the processing unit is configured to cancel displaying the first hover ball control when the position of the first hover window overlaps the position of the first hover ball control.
In one possible implementation, in response to the operation to cancel the display of the first floating window, the processing unit is configured to cancel the display of the floating window; the processing unit is also used for determining the duration from the cancel of the display of the first suspension ball control to the cancel of the display of the first suspension window; and when the duration does not exceed the first time threshold, the display unit is used for displaying the first suspension ball control.
In one possible implementation, the first floating window includes a control for opening the second application, and the display unit is used for displaying the second interface in response to the operation of the control for opening the second application; the second interface comprises a second floating window corresponding to the second application.
In one possible implementation, the position of the first suspension window does not overlap with the position of the first suspension ball control, including: the position of the first suspension window and the position of the first suspension ball control are respectively positioned at two sides of a screen of the electronic equipment.
In one possible implementation, the position of the first suspension window does not overlap with the position of the first suspension ball control, including: the position of the first suspension window and the position of the first suspension ball control are positioned on the same side of the screen of the electronic equipment, and the position of the first suspension ball control is not overlapped with the position of a first area corresponding to the first suspension window; the first region includes a first floating window.
In one possible implementation, the size of the first region is related to the number of application controls included in the first floating window.
In one possible implementation manner, in response to a first operation in the first interface, when the electronic device determines that the position of the first operation is outside a second area corresponding to the first hover ball control, a display unit is used for displaying a first hover window; the second region includes a first hover ball control.
In one possible implementation, in response to the second operation in the first interface, when the electronic device determines that the location of the second operation is within the second area, the display unit is configured to continue displaying the first hover ball control.
In one possible implementation, the display unit is configured to display a third interface of the first application; the third interface comprises a first text; a display unit for displaying a first control in response to a third operation on the first text; the first control comprises a copying option and a translation option; a display unit for displaying a third hover ball control in response to a fourth operation of the copy option; and when the electronic equipment does not receive the operation for the third hover ball control within the first time threshold, the processing unit is used for canceling the display of the third hover ball control and displaying a first interface of the first application.
Any implementation manner of the second aspect and the second aspect corresponds to any implementation manner of the first aspect and the first aspect, respectively. The technical effects corresponding to the second aspect and any implementation manner of the second aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, which are not described herein.
In a third aspect, embodiments of the present application provide a computer-readable storage medium having a computer program stored therein, which when run on a computer, causes the computer to perform the method of any of the first aspects.
Any implementation manner of the third aspect and any implementation manner of the third aspect corresponds to any implementation manner of the first aspect and any implementation manner of the first aspect, respectively. The technical effects corresponding to the third aspect and any implementation manner of the third aspect may be referred to the technical effects corresponding to the first aspect and any implementation manner of the first aspect, which are not described herein.
In a fourth aspect, embodiments of the present application provide a computer program product comprising a computer program which, when run on a computer, causes the computer to perform the method of any one of the first aspects.
Any implementation manner of the fourth aspect and any implementation manner of the fourth aspect corresponds to any implementation manner of the first aspect and any implementation manner of the first aspect, respectively. Technical effects corresponding to any implementation manner of the fourth aspect may be referred to the technical effects corresponding to any implementation manner of the first aspect, and are not described herein.
In one possible design, the program in the fifth aspect may be stored in whole or in part on a storage medium packaged with the processor, or in part or in whole on a memory not packaged with the processor.
Drawings
Fig. 1 is a schematic hardware structure of an electronic device according to an embodiment of the present application;
fig. 2 is a schematic software architecture of an electronic device according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a window manager according to an embodiment of the present application;
FIG. 4 is a schematic diagram of an interface for displaying a suspension ball according to an embodiment of the present disclosure;
FIG. 5 is a schematic diagram of an interface for ipsilateral window interaction provided in an embodiment of the present application;
FIG. 6 is a schematic illustration of an interface for ipsilateral window interaction provided in an embodiment of the present application;
FIG. 7 is a schematic diagram of an interface for different side window interactions provided in an embodiment of the present application;
FIG. 8 is a schematic diagram of a conflict area provided in an embodiment of the present application;
FIG. 9 is a schematic diagram of an interface for canceling display of smart multi-windows according to an embodiment of the present disclosure;
FIG. 10 is a schematic diagram of a region where intelligent multi-window cannot be triggered according to an embodiment of the present application;
fig. 11 is a flow chart of a window interaction method provided in an embodiment of the present application;
fig. 12 is a flowchart of another window interaction method according to an embodiment of the present application;
fig. 13 is a schematic structural diagram of a window interaction device according to an embodiment of the present application.
Detailed Description
In order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second", etc. are used to distinguish the same item or similar items having substantially the same function and effect. For example, the first value and the second value are merely for distinguishing between different values, and are not limited in their order. It will be appreciated by those of skill in the art that the words "first," "second," and the like do not limit the amount and order of execution, and that the words "first," "second," and the like do not necessarily differ.
In this application, the terms "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
In the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a alone, a and B together, and B alone, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b, or c may represent: a, b, c, a and b, a and c, b and c, or a, b and c, wherein a, b, c may be single or plural.
When a user opens multiple windows in the same interface, the positions of the multiple windows may overlap in the interface, so that the multiple windows collide in the display process.
The plurality of windows are exemplified as a suspension ball and a smart multi-window, respectively, and the example is not limited to the embodiments of the present application. For example, when the user triggers the display of the suspension ball corresponding to the translation function by copying the text to be translated, the display of the smart multi-window is triggered by sliding the right edge of the screen inwards, and the position of the suspension ball may overlap with the position of the smart multi-window, so that the electronic device may overlap the suspension ball and the smart multi-window, and the suspension ball may be displayed above the smart multi-window in a semitransparent manner.
However, in the above-mentioned suspension ball coverage display interface in the area where the smart multi-window is located, if the user wants to trigger a certain application control in the smart multi-window, and when the application control is covered by the suspension ball, the user cannot implement normal triggering of the application control.
In view of this, the embodiment of the present application provides a window interaction method, so that when a plurality of windows overlap, an electronic device may set a suitable display manner for the windows, so as to avoid a conflict between the plurality of windows, and further realize normal use of the windows by a user.
The electronic device may also be called a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), or the like. The electronic device may be a mobile phone (mobile phone) with a window display function, a smart television, a wearable device, a tablet, a computer with a wireless transceiving function, a Virtual Reality (VR) electronic device, an augmented reality (augmented reality, AR) electronic device, a wireless terminal in an industrial control (industrial control), a wireless terminal in an unmanned driving (self-driving), a wireless terminal in a teleoperation (remote medical surgery), a wireless terminal in a smart grid (smart grid), a wireless terminal in a transportation security (transportation safety), a wireless terminal in a smart city (smart city), a wireless terminal in a smart home (smart home), or the like. The embodiment of the application does not limit the specific technology and the specific equipment form adopted by the electronic equipment.
Exemplary, fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
As shown in fig. 1, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, a user identification module (subscriber identification module, SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an angular chain sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a touch sensor 180K, an ambient light sensor 180L, and the like.
It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or less components than illustrated, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors. For example, the processor 110 is configured to perform the method of detecting ambient light in the embodiments of the present application.
The controller can be a neural center and a command center of the electronic device. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it may be called directly from memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.
The electronic device implements display functions via a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ an organic light-emitting diode (OLED). In some embodiments, the electronic device may include 1 or N display screens 194, N being a positive integer greater than 1.
The software system of the electronic device may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the invention, an Android system with a layered architecture is taken as an example, and the software structure of the electronic equipment is illustrated.
Fig. 2 is a schematic software architecture diagram of an electronic device according to an embodiment of the present application.
As shown in fig. 2, the electronic device may divide the Android system into five layers, namely an application layer (applications), an application framework layer (application framework), an Zhuoyun rows (Android run) and a system library, a hardware abstraction layer (hardware abstract layer, HAL, not shown in the figure), and a kernel layer (kernel).
The application layer may include a series of application packages, among other things. For example, the application layer may include applications (applications may be simply referred to as applications) such as settings, calendars, maps, and alarms, which are not limited in any way by the embodiments of the present application.
In the embodiment of the application program layer, the application program layer can further comprise a context awareness module, a business logic processing module, a business presentation module and the like. The context awareness module, the service logic processing module and the service presentation module may be independent APPs, or may be integrated in different APPs, or may be integrated in the same APP, which is not limited in this application.
Wherein, the context awareness module, which is resident or operates in a low power consumption form, has the ability to perceive external facts or environments. The context aware module may detect related events and acquire the status of events from other applications of the application layer or the application framework layer or the system layer or the kernel layer through an API (application program interface), such as detecting bluetooth connections, network connections, monitoring user messages, customizing timers, etc. In the embodiment of the application, the context awareness module is mainly used for monitoring whether the clipboard has a copy event, and notifying the copy event to the business logic processing module when the clipboard is monitored to have the copy event. The context awareness module may also be used to obtain the source Application (APP), i.e. the application package name, of the cut content in the cut-out panel. That is, the clipboard content identifies, through the context awareness module, that the clipped content is copied from a particular application. In addition, the context awareness module can also detect whether the operation of exiting the current page exists, and when the operation of exiting the current page is detected, the business logic processing module is notified.
The business logic processing module (such as a computing engine) has business logic processing capability and is used for realizing the display and disappearance logic of various floating balls or floating windows. For example, the business logic processing module receives the copy event triggered by the user and the clipboard content sent by the context awareness module, and judges whether the translation condition is met, thereby judging whether the suspension ball is displayed. The business logic processing module can also judge whether to display a floating window or not and display the translation result in the floating window according to the event of clicking the floating ball triggered by the user and the translation result content acquired from the third-party server. In addition, the service logic processing module can also be used for judging whether to display or disappear the suspension ball or the suspension window on the electronic equipment according to the event that the suspension ball or the suspension window is disappeared, which is triggered by the user.
In addition, the business logic processing module may also recognize duplicate text or text extracted by OCR technology. For example, the text may be identified as at least one of a calendar, a link to be shared, a treasured password, a web site, etc. Also, for example, the language of the text may be identified.
The business presentation module may include a YOYO suggestion management module and an intelligent multi-window management module. The yoyoyo suggestion management module is used for displaying or disappearing the suspension ball or the suspension window on the screen of the mobile phone. For example, the service presentation module receives a command sent by the service logic processing module to display a hover ball or hover window, and notifies the window manager to display the hover ball or hover window on the electronic device. Meanwhile, the YOYO suggestion management module can also present the text copied by the user and the corresponding translation result in the floating window. In addition, the YOYO suggestion management module can also inform the window manager to display or disappear the floating ball or the floating window on the electronic device according to the event that the floating ball display or the floating window is triggered by the user. The intelligent multi-window management module is used for notifying the window manager to display or disappear the intelligent multi-window on the electronic equipment according to the display of the intelligent multi-window triggered by the user or the event of the disappearance of the intelligent multi-window.
As shown in fig. 2, the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, etc., an activity manager, a clipboard manager, etc., which the embodiments of the present application do not impose any limitation.
The window manager is used for managing window programs, and can acquire the size of a display screen, judge whether a status bar exists, lock a screen, intercept the screen and the like.
The clipboard manager is used for managing the clipboard. The clipboard is a temporary storage area for temporarily storing exchanged information.
The activity manager is used for managing the life cycle of each application program and the navigation rollback function, and is responsible for the creation of the main thread of the Android, and the maintenance of the life cycle of each application program.
The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.
The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.
The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.
As shown in fig. 2, the system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.
The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
As shown in fig. 2, the kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.
Fig. 3 is a schematic structural diagram of a window manager according to an embodiment of the present application.
As shown in fig. 3, the window manager may include: application windows, sub-windows (not shown) and system windows.
The application window corresponds to an application window of an application, such as an application window of a reading application, for displaying content in the reading application, and an application window of a translation application, for displaying content in the translation application, and an application window of a memo application, for displaying content in the memo application. Each application interface consists of an activity, and the activity consists of a view, wherein the view is a window existence form, and the window is a view carrier. When an activity is started, the application process is notified that any activity is affiliated with the application process. That is, for example, the reading application corresponds to one activity, and the memo application corresponds to another activity because it is a different application from the reading application. All activity default window TYPEs are BASE window (type_base_application), i.e. all other TYPEs of APPLICATION windows will appear at the upper layer of the BASE window.
The child window is attached to the parent window, i.e. cannot exist independently, and needs to rely on an application, such as an application input method window, an application prompt box window and the like. When the parent window is not visible, the child window is also not visible.
The system window is different from the application window and does not need to correspond to the Activity. Unlike child windows, there is no need for a parent window. The system window is not any application, is created by the system, only belongs to the system itself, and often needs to claim rights to create, such as a shutdown dialog window, a status bar window, a search bar window, an input method window, a warning dialog box, a system volume bar, and the like.
It should be noted that the system window is generally higher in level than the application window and the sub-window.
Continuing with the illustration of fig. 3, in the embodiment of the present application, a suspension ball and a suspension window are disposed in the system window. From the above analysis, the floating ball and the floating window are system windows, and cannot be set in the application window.
The essence of the floating window and the floating ball is that one view is intersected with a window manager, the z-axis range of an application window is 1-99, the range of a child window is 1001-1999, and the system window is (2000-2999) because of the system limitation of an android bottom layer, so that the floating window and the floating ball can only be realized in the range of the system window, and if a user-defined system level window needs to be popped up, dynamic application permission is needed. The Z-axis is a concept of a hierarchy of android windows, with larger Z-axis windows residing on top.
Furthermore, since the interface of each application in the application program is composed of activities and any activity is subordinate to the application process, the suspending ball and the suspending window set in the system window have no activity function. In order to obtain the effects similar to the activity in the application window, that is, display content and operation based on sliding of the user in the suspension ball and the suspension window, it is necessary to additionally set sliding operation, sliding conflict and the like in the system window, and judge the focus of the response window and the like according to clicking and the like of the user. And more particularly, will be apparent in light of the following description.
The following describes the technical solutions of the present application and how the technical solutions of the present application solve the above technical problems in detail with specific embodiments. The following embodiments may be implemented independently or combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.
In this embodiment of the present application, with electronic equipment as a mobile phone, a plurality of windows are respectively: the suspension ball and the smart multi-window are taken as examples, and the window interaction method provided by the embodiment of the application is illustrated, and the example is not limited by the embodiment of the application.
It will be appreciated that the user may trigger a hover ball corresponding to a translation function by copying the translation text before the electronic device performs a window interaction. Exemplary, fig. 4 is a schematic diagram of an interface for displaying a suspension ball according to an embodiment of the present application.
For example, an option switch such as "copy trigger translation" may be set in the setting interface of the mobile phone, and when the user selects to start the function of copy trigger translation, the electronic device may trigger the translation function and display a suspension ball corresponding to the translation function when the user copies the text in the non-system default language; further, when the user triggers the hover ball, the translation result may be displayed.
When the mobile phone receives an operation of opening a certain news page in the news application by the user, the mobile phone may display an interface as shown in (a) of fig. 4, where the interface may be displayed as a section of english. In the scenario where translation is required as shown in fig. 4 (a), when the mobile phone receives an operation that the user selects a "patent" word, the mobile phone may pop up the option field 401, where the option field 401 may include operation options such as copy, search, and the like.
In the interface shown in fig. 4 (a), when the mobile phone receives an operation that the user triggers the "copy" option in the option field 401 corresponding to the "patent" word, the mobile phone can recognize the user's intention and display the interface shown in fig. 4 (b). An interface as shown in fig. 4 (b) may include a hover ball identifier 402 therein, where the hover ball identifier 402 may be used to indicate that the mobile phone is recognizing a user's intent, and the mobile phone's recognized user's intent may be a translation. It will be appreciated that during the identification of the handset, the user's intent can be identified without the user having to operate, for example without the user having to click on any content of the page as in fig. 4 (b).
Further, the mobile phone may display an interface as shown in (c) of fig. 4 when recognizing that the user intends to translate the "patent" word, where the interface may include: a hover ball 403 in a first state, the hover ball 403 in the first state being configured to provide a portal to a user for displaying translation results.
In the interface shown in fig. 4 (c), when the mobile phone does not receive the trigger of the user on the hover ball 403 in the first state within a preset time, the mobile phone may determine that the user does not need to perform the translation operation at this time, and display the interface shown in fig. 4 (d). The interface shown in fig. 4 (d) may include a suspension ball 404 in a second state. The preset time may be 5 seconds or other values, which are not limited in the embodiment of the present application.
It can be understood that, as shown in (d) of fig. 4, the suspension ball 404 in the second state in the interface may be displayed on the edge of the right screen of the mobile phone by default, and the suspension window in the second state may be displayed on other positions of the edge of the mobile phone according to the drag operation of the user, which is not limited in this embodiment of the present application.
Based on the interface shown in fig. 4 (a) -the interface shown in fig. 4 (d), the mobile phone can realize the suspension ball calling up the second state shown in fig. 4 (d) according to the copy operation of the user.
It is to be understood that the suspension ball in the second state will be hereinafter simply referred to as a suspension ball.
In the embodiment corresponding to fig. 4, the mobile phone calls out the suspension ball, or it is understood that the mobile phone calls out any window, and the mobile phone can also call out another window by opening the smart multi-window or other operations by the user. The window interaction method described in the embodiments of the present application will be described in the following with a hover sphere and an intelligent multi-window (e.g. the embodiments corresponding to fig. 5, 6, and 7, respectively).
It can be understood that when the suspension ball and the smart window are located on the same side, and the position of the suspension ball overlaps the position of the smart window, the mobile phone can display the collision between the suspension ball and the smart window based on the embodiment corresponding to fig. 5.
Exemplary, fig. 5 is a schematic diagram of an interface for interaction with a window on the same side provided in an embodiment of the present application.
In the case where the hover ball 501 as shown in fig. 5 (a) is displayed on the right edge of the handset, when the handset receives an operation that the user slides inward along the right edge of the handset, the handset may display an interface as shown in fig. 5 (b). The interface shown in (b) of fig. 5 may include: a hover ball 501 and a logo 502, the logo 502 indicating that the phone is about to display smart multi-windows.
In the interface shown in fig. 5 (b), when the mobile phone receives the operation of the user to continuously slide inward, the mobile phone can determine that the position of the suspension ball 501 overlaps with the position of the smart multi-window, and display the interface shown in fig. 5 (c). The interface shown in (c) in fig. 5 may include: a smart multi-window 503, where the smart multi-window 503 may include: a control 504 for an email application, a control for a memo application, a control for a video application, a control for a gallery application, a control for adding or subtracting applications in a smart multi-window, and the like.
It will be appreciated that, because the location of the suspension ball 501 overlaps the location of the smart window, the mobile phone can cancel displaying the suspension ball 501 and display the smart window 503.
Further, in the interface shown in fig. 5 (c), when the mobile phone receives an operation of the control 504 for triggering the email application in the smart multi-window 503 by the user, the mobile phone may display the interface shown in fig. 5 (d). The interface shown in (d) of fig. 5 may include: a mail application corresponding to the hover window 505, one or more of the following may be displayed in the hover window 505: controls for displaying hover window 505 full screen, controls for displaying the hover window 505 in hover spherical form, controls for closing hover window 505, a drag lever for moving hover window 505, a text identification for an inbox, a search field for searching for mail, and email sent by shopping network 2022-1-18, or email sent by Patent 2022-1-10, etc.
It will be appreciated that the handset may cancel displaying the hover ball 501 and smart multi-window 503 when the handset receives a control that the user triggers an application in the smart multi-window 503.
Based on the embodiment corresponding to fig. 5, when the user opens the suspending ball and triggers the smart multi-window, the mobile phone can display the smart multi-window, if the position of the suspending ball overlaps with the position of the smart multi-window, the mobile phone cancels the display of the suspending ball, so as to avoid the collision between the suspending ball and the smart multi-window, and the user can realize normal use of the smart multi-window.
It can be understood that when the suspension ball and the smart window are located on the same side, and the position of the suspension ball and the position of the smart window are not overlapped, the mobile phone can display the situation that the suspension ball and the smart window do not collide based on the embodiment corresponding to fig. 6.
Fig. 6 is a schematic diagram of another interface for ipsilateral window interaction according to an embodiment of the present application.
In the case where the hover ball 601 as shown in (a) of fig. 6 is displayed on the right side edge of the handset and near the upper edge of the handset, when the handset receives an operation that the user slides inward along the right side edge of the handset and near the middle portion of the handset, the handset may display an interface as shown in (b) of fig. 6. The interface shown in (b) in fig. 6 may include: a hover ball 601 and a logo 602, the logo 602 being used to indicate that the phone is about to display smart multi-windows.
In the interface shown in fig. 6 (b), when the mobile phone receives the operation of the user to continuously slide inward, the mobile phone can determine that the position of the suspension ball 601 and the position of the smart multi-window do not overlap, and display the interface shown in fig. 6 (c). The interface shown in (c) in fig. 6 may include: a suspension sphere 601, and an intelligent multi-window 603. The content that can be displayed in the smart window 603 may be described in the smart window 503 in the corresponding embodiment of fig. 5, which is not described herein.
It can be understood that, because the position of the suspension ball 601 is close to the upper side of the mobile phone, and the position of the smart window 603 is not overlapped when the smart window 603 is triggered, the mobile phone can display the smart window 603 and the suspension ball 601 at the same time.
Based on the embodiment corresponding to fig. 6, when the user opens the suspending ball and triggers the smart multi-window, the mobile phone can display the smart multi-window, and if the position of the suspending ball is not overlapped with the position of the smart multi-window, the mobile phone can display the suspending ball, so that the user can realize normal use of the suspending ball and the smart multi-window.
It will be appreciated that when the suspension ball and the smart window are located at different sides, the position of the suspension ball and the position of the smart window do not overlap, and the mobile phone can display the situation that the suspension ball and the smart window do not collide based on the embodiment corresponding to fig. 7.
Fig. 7 is an interface schematic diagram of interaction of different side windows provided in an embodiment of the present application.
In the case where the hover ball 701 as shown in (a) of fig. 7 is displayed on the left side edge of the handset, when the handset receives an operation that the user slides inward along the right side edge of the handset, the handset may display an interface as shown in (b) of fig. 7. The interface shown in (b) in fig. 7 may include: a hover ball 701 and an identification 702, the identification 702 indicating that the phone is about to display smart multi-windows.
In the interface shown in fig. 7 (b), when the mobile phone receives the operation of the user to continuously slide inward, the mobile phone can determine that the position of the suspension ball 701 does not overlap with the position of the smart multi-window, and display the interface shown in fig. 7 (c). The interface shown in (c) in fig. 7 may include: a hover ball 701, and an intelligent multi-window 703. The content that can be displayed in the smart multi-window 703 can be referred to the description of the smart multi-window 503 in the corresponding embodiment of fig. 5, and will not be described herein.
It can be appreciated that, since the position of the suspension ball 701 is located at the left edge of the mobile phone, and the position of the smart multi-window 703 is not overlapped when the smart multi-window 703 is triggered by the user at the right edge of the mobile phone, the mobile phone can display the smart multi-window 703 and the suspension ball 701 simultaneously.
Based on the embodiment corresponding to fig. 7, when the user opens the suspending ball and triggers the smart multi-window, the mobile phone can display the smart multi-window, and if the position of the suspending ball is not overlapped with the position of the smart multi-window, the mobile phone can display the suspending ball, so that the user can realize normal use of the smart multi-window and the suspending ball.
It will be appreciated that based on the description of the embodiments corresponding to fig. 5 to 7, the conflict area between the floating window and the smart multi-window may be referred to the description of the embodiment corresponding to fig. 8.
Fig. 8 is a schematic diagram of a first conflict area according to an embodiment of the present application.
In the case where the suspension ball 801 shown in fig. 8 (a) is displayed on the right side edge of the mobile phone and is close to the upper edge of the mobile phone, when the mobile phone receives an operation that the user slides inward along the right side edge of the mobile phone, the mobile phone can determine that the suspension ball 801 does not overlap with the smart multi-window, and thus the mobile phone can display the smart multi-window 802 and the suspension ball 801 at the same time.
It will be appreciated that in the interface shown in fig. 8 (a), the suspension ball 801 does not overlap with a certain area around the smart multi-window 802 (an area where a dashed frame is shown in fig. 8 (a), or referred to as a first collision area), so that the mobile phone can display the suspension ball 801 and the smart multi-window 802 at the same time. The area where the dotted line box shown in (a) of fig. 8 is located may be an area corresponding to when the mobile phone takes 10 pixels on the upper side and the lower side of the smart multi-window 802.
In a possible implementation, in the interface shown in fig. 8 (a), when the handset receives an operation of adding an application to the smart multi-window 802 by the user, for example, adding or deleting the application to or from the smart multi-window 802 through a control 803 in the smart multi-window, the handset may display the interface shown in fig. 8 (b), and the interface shown in fig. 8 (b) may include a smart multi-window 804.
It will be appreciated that, since a certain area (such as the area where the dashed box shown in (b) of fig. 8 is located, or referred to as the first collision area) around the smart multi-window 804 in the interface shown in (b) of fig. 8 overlaps the position where the suspension ball 801 shown in (a) of fig. 8 is located, the mobile phone may cancel displaying the suspension ball 801 when displaying the smart multi-window 804. The area where the dotted line box shown in (b) of fig. 8 is located may be an area corresponding to when the mobile phone takes 10 pixels on the upper side and the lower side of the smart window 804.
In a possible implementation manner, if the suspension ball 801 is located at the left edge of the mobile phone, when the mobile phone receives an operation that the user slides inward at the right edge of the mobile phone, the suspension ball 801 and the smart multi-window 804 do not collide, so that the mobile phone can display the suspension ball 801 located at the left edge of the mobile phone and display the smart multi-window 804 located at the right edge of the mobile phone at the same time.
In a possible implementation, the size and location of the smart window may be related to the number of applications in the smart window, for example, when the number of smart windows is 4, the location of the smart window may be the area where the smart window 802 shown in fig. 8 (a) is located. In this scenario, the first collision area that collides with the suspension ball 801 may be a certain area around the smart multi-window 802, for example, may be an area where a dashed box shown in (a) of fig. 8 is located.
Alternatively, when the number of smart windows is 5, the smart windows may be located in the area where the smart windows 802 shown in (b) of fig. 8 are located. In this scenario, the first collision area that collides with the suspension ball 801 may be a certain area around the smart multi-window 804, for example, may be an area where a dashed box shown in (b) of fig. 8 is located.
Based on the description of the first conflict area in the embodiment corresponding to fig. 8, the user may move the suspension ball far away from the smart multi-window or to the area opposite to the side where the smart multi-window is located when the suspension ball needs to be displayed, so as to avoid the situation that the mobile phone cancels displaying the suspension ball due to the conflict between the suspension ball and the smart multi-window.
It will be appreciated that, based on the description of the embodiments corresponding to fig. 5 to 7, in the case that the smart window is displayed by the mobile phone and the smart window is cancelled by the mobile phone due to the collision between the suspension ball and the smart window, when the mobile phone receives the trigger from the user to trigger the area other than the smart window, the mobile phone may cancel the smart window, and determine whether to display the suspension ball according to the time from the cancellation of the display of the suspension ball to the cancellation of the display of the smart window.
Exemplary, fig. 9 is a schematic diagram of an interface for canceling display of smart multi-windows according to an embodiment of the present application.
In the case where the smart window is displayed by the mobile phone and the smart window is canceled by the mobile phone due to collision of the suspension ball with the smart window, for example, the mobile phone displays an interface as shown in (a) of fig. 9, when the mobile phone receives a user trigger of an area other than the smart window in the interface, the mobile phone can cancel displaying the smart window and the mobile phone can calculate a period from canceling display of the smart window by the suspension ball.
In one implementation, when the mobile phone determines that the duration from suspension ball cancel display to smart multi-window cancel display exceeds a time threshold, the mobile phone cancels display of the suspension ball while canceling display of the smart multi-window, e.g., the mobile phone may switch from the interface shown in fig. 9 (a) to the interface shown in fig. 9 (b). It will be appreciated that when the duration from suspension ball cancel display to smart multi-window cancel display exceeds a time threshold, it will be appreciated that the user has not needed to use the suspension ball and therefore the handset may cancel the display of the suspension ball.
In another implementation, when the mobile phone determines that the duration from suspension ball cancellation display to smart multi-window cancellation display does not exceed the time threshold, the mobile phone may display the suspension ball and cancel display of the smart multi-window, e.g., the mobile phone may switch from the interface shown in fig. 9 (a) to the interface shown in fig. 9 (c), which includes the suspension ball.
Based on the description of the duration from the suspension ball cancel display to the intelligent multi-window cancel display in the corresponding embodiment of fig. 9, the user can avoid the situation that the suspension ball is cancelled from being displayed when the mobile phone receives the condition that the user cancels the intelligent multi-window display due to the fact that the intelligent multi-window is displayed for a long time when the suspension ball is required to be displayed.
In a possible implementation manner, based on the embodiments corresponding to fig. 5-7, when the mobile phone receives that the user triggers the smart multi-window by sliding inwards along the edge of the screen in a certain area around the suspension ball, the mobile phone cannot display the smart multi-window.
Exemplary, fig. 10 is a schematic diagram of a region where intelligent multi-window cannot be triggered according to an embodiment of the present application.
In the case of displaying the hover ball 1001 as shown in fig. 10 (a), when the cell phone receives an operation in which the user slides inward along the edge of the cell phone screen within a certain area around the hover ball 1001 (a dotted area as shown in fig. 10 (a), or referred to as a second collision area), the cell phone may display an interface as shown in fig. 10 (b), which may include the hover ball 1001 therein.
It will be appreciated that when the mobile phone receives the user's operation of sliding inward along the edge of the mobile phone screen within the dotted line area shown in fig. 10 (a), the mobile phone can default the triggering operation within the dotted line area to the triggering operation of the user on the suspension ball 1001.
Alternatively, when the mobile phone receives an operation that the user slides inward along the edge of the screen of the mobile phone outside a certain area around the suspension ball 1001, the mobile phone may display an interface as shown in (c) of fig. 10, and a smart multi-window 1002 may be included in the interface as shown in (c) of fig. 10.
It will be appreciated that when the mobile phone receives an operation that the user slides inward along the edge of the mobile phone screen outside the dotted line area shown in fig. 10 (a), the mobile phone can execute a corresponding function according to the triggering operation.
Based on the description of the second collision area in the embodiment corresponding to fig. 10, the user may trigger the smart multi-window outside the second collision area corresponding to the suspension ball when the smart multi-window needs to be displayed, so as to avoid the situation that the mobile phone cannot display the smart multi-window due to the overlapping of the second collision area and the position when the smart multi-window is triggered.
Fig. 11 is a schematic flow chart of a window interaction method according to an embodiment of the present application. In the corresponding embodiment of fig. 11, the software architecture of the electronic device may include multiple layers, such as an application layer, an application framework layer, and the like; the application layer may include a service presentation module, and the application framework layer may include a window manager; the service presentation module may include: the system comprises a YOYO suggestion management module for managing the display of the suspension ball and an intelligent multi-window management module for managing the display of the intelligent multi-window.
As shown in fig. 11, the window interaction method may include the steps of:
s1101, the user triggers a copy event.
The copying event may be an event that copies the text to be translated to trigger the display of the hover sphere corresponding to the translation function.
S1102, responding to a user triggering copy event, and sending a message for indicating to display a suspension ball to a window manager by the YOYO suggestion management module.
S1103, the YOYO suggestion management module calls a display to display the suspension ball.
S1104, triggering and displaying the event of intelligent multi-window by the user.
The event for displaying the smart multi-window may be an event in which a user triggers the smart multi-window display by sliding the event inward along the edge of the screen.
S1105, responding to an event of triggering the display of the intelligent multi-window by a user, and sending a message for indicating the display of the intelligent multi-window to the intelligent multi-window management module by the window manager.
S1106, the intelligent multi-window management module calls the display to display the intelligent multi-window.
S1107, the intelligent multi-window management module sends the position information of the intelligent multi-window to the YOYO suggestion management module.
Illustratively, the smart multi-window management module may acquire the location information of the smart multi-window when receiving the message for displaying the smart multi-window sent by the window manager, and send the location information of the smart multi-window to the YOYO advice management module. Wherein, the position information of this wisdom many windows can be: and a coordinate point set corresponding to the position of the intelligent multi-window.
S1108, the YOYO suggestion management module judges whether the intelligent multi-window collides with the suspension ball according to the position information of the intelligent multi-window and the position information of the suspension ball.
In the embodiment of the application, when the yoyoyo suggestion management module determines that the smart window does not conflict with the suspension ball according to the position information of the smart window and the position information of the suspension ball, the electronic device maintains the display of the suspension ball in the step shown in S1103 and maintains the smart window in the step shown in S1106; alternatively, when the YOYO advice management module determines that the smart window collides with the hover ball according to the position information of the smart window and the position information of the hover ball, the module in the electronic device may perform the steps shown in S1109-S1111.
The yoyoyo suggestion management module may obtain position information of the suspension ball, where the position information of the suspension ball may be: and a coordinate point set corresponding to the position of the suspending ball.
In a possible implementation manner, the yoyoyo suggestion management module may obtain the position information of the smart multi-window, and respectively extend 10 pixels along the upper and lower sides of the smart multi-window to obtain the position information of the smart multi-window after extension, where the position information of the smart multi-window after extension may be: and coordinate point sets of the positions of the intelligent multiple windows after extension.
Further, the YOYO suggestion management module determines whether a coordinate point set of the position where the extended intelligent multi-window is located is repeated or not, and when the YOYO suggestion management module determines that a repeated coordinate point exists between the two coordinate point sets, the intelligent multi-window can be determined to collide with the suspension ball; or when the YOYO suggestion management module determines whether repeated coordinate points exist between two coordinate point sets, it can be determined that the intelligent multi-window does not collide with the suspension ball.
It will be appreciated that the location of the extended smart window may be referred to as a dotted line area shown in fig. 8 (a), and the number of the extended pixels may be other values, which are not limited in the embodiment of the present application.
It can be appreciated that the scenario of the collision between the smart multi-window and the suspension ball can be seen in the corresponding embodiment of fig. 5; a scenario where the smart window does not collide with the suspension ball can be seen in the corresponding embodiment of fig. 6 and fig. 7; and will not be described in detail herein.
In a possible implementation manner, when the user adjusts the number of applications in the smart multi-window so that the location information of the smart multi-window changes, in response to the operation of the user adjusting the number of applications in the smart multi-window, the window manager may send a message for updating the smart multi-window to the smart multi-window management module, so that the smart multi-window management module may reacquire the current location information of the smart multi-window and send the updated location information to the yoyoyo suggestion management module, so that the yoyoyo suggestion management module may re-execute the step shown in S1108.
S1109, the YOYO advice management module sends a message for instructing to cancel the display of the hover sphere to the window manager.
S1110, the window manager sends a message for indicating to cancel the display of the suspension ball to the YOYO suggestion management module.
In a possible implementation manner, on the basis of the steps shown in S1101-S1110, in the case that the smart window is displayed by the mobile phone and the smart window is cancelled by the mobile phone due to the collision between the suspension ball and the smart window, when the mobile phone receives the trigger from the user to the other area except the smart window, the mobile phone may cancel displaying the smart window, and determine whether to display the suspension ball according to the time from the cancellation of the display of the suspension ball to the cancellation of the display of the smart window.
Illustratively, the S1111, YOYO suggestion management module starts a timer when the display of the hover sphere is canceled.
S1112, the user triggers an event to cancel the display of the smart multi-window.
The event of canceling the display of the smart window may be a triggering operation of the user for an area other than the smart window, which is not limited in the embodiment of the present application.
S1113, the window manager sends a message for indicating to cancel displaying the intelligent multi-window to the intelligent multi-window management module.
S1114, the intelligent multi-window management module sends a message for indicating to cancel displaying the intelligent multi-window to the YOYO suggestion management module.
S1115, the YOYO suggestion management module determines whether to display the suspension ball according to the duration from suspension ball cancellation display to intelligent multi-window cancellation display.
In the embodiment of the application, when the yoyoyo suggestion management module determines that the duration from canceling display of the suspension ball to canceling display of the intelligent multi-window does not exceed the time threshold, the YOYO suggestion determines to display the suspension ball, and then the module in the electronic device can execute the steps shown in S1116-S1118; alternatively, when the YOYO advice management module determines that the duration from suspension ball cancellation display to smart multi-window cancellation display exceeds the time threshold, the YOYO advice determines to cancel display of the suspension ball, and the YOYO advice management module may perform the step shown in S1119.
S1116, the YOYO suggestion management module sends a message for indicating the display of the hover sphere to the window manager.
S1117, the window manager sends a message for indicating to display the suspension ball to the YOYO suggestion management module.
S1118, the YOYO suggestion management module calls a display to display the suspension ball.
S1119, YOYO advice management module sends a message for instructing to cancel the display of the hover sphere to the window manager.
Based on the method, when the positions of the suspension ball and the intelligent multi-window overlap, the electronic equipment can avoid the collision of the windows, and further normal use of the windows by a user is realized.
In a possible implementation manner, based on the embodiment corresponding to fig. 11, the YOYO suggestion management module may also determine whether to display the suspension ball or the intelligent multiple windows according to the location information of the user trigger event and the location information of the suspension ball. Fig. 12 is a schematic flow chart of another window interaction method according to an embodiment of the present application.
As shown in fig. 12, the window interaction method may include the steps of:
s1201, user trigger event.
The triggering event may be an event that the user triggers and displays an intelligent multi-window, or may be an event that the user triggers the suspension ball to move, etc.
S1202, responding to a user trigger event, and sending position information of the trigger event to the YOYO suggestion management module by the window manager.
The location information of the trigger event may be a coordinate point set corresponding to the trigger event.
And S1203, the YOYO suggestion management module determines whether to display the suspension ball or the intelligent multi-window according to the position information of the suspension ball and the position information of the trigger event.
In the embodiment of the application, when the YOYO suggestion management module determines to continue to display the suspension ball according to the position information of the suspension ball and the position information of the trigger display event, the module in the electronic device may execute the steps shown in S1204-S1207; or when the YOYO advice management module determines that the hover ball is not continuously displayed according to the position information of the hover ball and the position information of the trigger display event, the module in the electronic device may execute the steps shown in S1208-S1210.
The position information of the suspending ball can be: and a coordinate point set corresponding to the position of the suspending ball.
In a possible implementation manner, the YOYO suggestion management module may obtain the position information of the suspension ball, and extend 10 pixels outwards along the edge of the suspension ball to obtain the position information of the suspension ball after extension, where the position information of the suspension ball after extension may be: and a coordinate point set of the position of the extended suspension ball.
Further, the YOYO suggestion management module determines whether a coordinate point set of the position of the extended suspension ball is repeated or not, and when the YOYO suggestion management module determines that a repeated coordinate point exists between the two coordinate point sets, the user can be determined to trigger the suspension ball; or when the YOYO suggestion management module determines whether repeated coordinate points exist between two coordinate point sets, it may determine that the user triggers the intelligent multi-window.
It can be understood that the location of the extended suspension ball may be referred to as a dotted line area shown in fig. 10 (a), and the number of the extended pixels may be other values, which is not limited in the embodiment of the present application.
S1204, the YOYO suggestion management module sends a message for indicating to display the suspension ball to the window manager.
And S1205, updating the suspension ball by the window manager to obtain an updated suspension ball.
When the YOYO suggestion management module determines in S1203 to continue displaying the suspension ball according to the position information of the suspension ball and the position information of the trigger display event, the user trigger event may be understood as a movement event for the suspension ball, so that the window manager may update the position of the suspension ball and obtain the updated suspension ball.
S1206, the window manager sends a message for indicating to display the updated suspension ball to the YOYO suggestion management module.
S1207, the YOYO suggestion management module calls a display to display the updated suspension ball.
S1208, the YOYO suggestion management module sends a message to the window manager indicating that the YOYO suggestion management module is not processing the trigger event.
When the YOYO suggestion management module determines in S1203 that the suspension ball is not continuously displayed according to the position information of the suspension ball and the position information of the trigger display event, the YOYO suggestion management module may send a message that the YOYO suggestion management module does not process the trigger event to the window manager. S1209, the window manager sends a message for indicating to display the smart multi-window to the smart multi-window management module.
For example, when the window manager receives a message sent by the yoyoyo suggestion management module to indicate that the YOYO suggestion management module is not processing the trigger event, the window manager may determine that the trigger event needs to be processed by another module, for example, by the smart multi-window management module, so the window manager may send a message to the smart multi-window management module to indicate that the smart multi-window is displayed.
S1210, the intelligent multi-window management module calls the display to display the intelligent multi-window.
Based on this for the user can trigger in the position department that is far away from the suspension ball when needs show the wisdom multi-window according to self demand, when needs show the suspension ball, triggers in the position department that is near to the suspension ball, improves the user and uses the use experience of suspension ball and wisdom multi-window.
It will be appreciated that the interface provided by the embodiments of the present application is provided as an example only and is not intended to further limit the embodiments of the present application.
Fig. 13 is a schematic structural diagram of a window interaction device according to an embodiment of the present application.
As shown in fig. 13, the window interaction device 130 may be used in a communication apparatus, a circuit, a hardware component, or a chip, and the window interaction device includes: a display unit 1301, a processing unit 1302, and a communication unit 1303. Wherein, the display unit 1301 is configured to support a step of exiting the display performed by the resource allocation method; the processing unit 1302 is configured to support the window interaction device to perform information processing; the communication unit 1303 is configured to support data transmission and data reception performed by the resource allocation method.
In one possible embodiment, the communication unit 1303 may be an input or output interface, a pin, or a circuit, or the like.
In a possible embodiment, the window interaction device may further comprise: a storage unit 1304. The processing unit 1302, the communication unit 1303, and the storage unit 1304 are connected by a line.
The memory unit 1304 may include one or more memories, which may be one or more devices, circuits, or means for storing programs or data.
The storage unit 1304 may exist independently and is connected to the processing unit 1302 provided in the window interaction device through a communication line. The memory unit 1304 may also be integrated with the processing unit 1302.
The storage unit 1304 may store computer-executable instructions of a method in the terminal device to cause the processing unit 1302 to perform the method in the above-described embodiment.
The storage unit 1304 may be a register, a cache, a RAM, or the like, and the storage unit 1304 may be integrated with the processing unit 1302. The memory unit 1304 may be a read-only memory (ROM) or other type of static storage device that may store static information and instructions, and the memory unit 1304 may be independent of the processing unit 1302.
In the above embodiments, the instructions stored by the memory for execution by the processor may be implemented in the form of a computer program product. The computer program product may be written in the memory in advance, or may be downloaded in the form of software and installed in the memory.
The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL), or wireless (e.g., infrared, wireless, microwave, etc.), or semiconductor medium (e.g., solid state disk, SSD)) or the like.
Embodiments of the present application also provide a computer-readable storage medium. The methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. Computer readable media can include computer storage media and communication media and can include any medium that can transfer a computer program from one place to another. The storage media may be any target media that is accessible by a computer.
As one possible design, the computer-readable medium may include compact disk read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disk memory; the computer readable medium may include disk storage or other disk storage devices. Moreover, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, digital versatile disc (digital versatile disc, DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers.
Combinations of the above should also be included within the scope of computer-readable media. The foregoing is merely illustrative embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think about variations or substitutions within the technical scope of the present invention, and the invention should be covered. Therefore, the protection scope of the invention is subject to the protection scope of the claims.
Claims (13)
1. A window interaction method, applied to an electronic device, the method comprising:
the electronic equipment displays a first interface of a first application; the first interface comprises a first suspension ball control;
in response to a first operation in the first interface, the electronic device displays a first floating window;
and when the position of the first floating window is not overlapped with the position of the first floating ball control, the electronic equipment continuously displays the first floating ball control and the first floating window.
2. The method according to claim 1, wherein the method further comprises:
and when the position of the first suspension window is overlapped with the position of the first suspension ball control, the electronic equipment cancels the display of the first suspension ball control.
3. The method according to claim 2, wherein the method further comprises:
in response to an operation to cancel displaying the first floating window, the electronic device cancels displaying the floating window;
the electronic equipment determines the duration from the cancel of the display of the first suspension ball control to the cancel of the display of the first suspension window;
and when the duration does not exceed a first time threshold, the electronic equipment displays the first suspension ball control.
4. The method of claim 2, wherein the first floating window includes a control therein for opening a second application, the method further comprising:
responding to the operation of the control for starting the second application, and displaying a second interface by the electronic equipment; the second interface comprises a second floating window corresponding to the second application.
5. The method of claim 1, wherein the position of the first hover window does not overlap the position of the first hover ball control, comprising: the position of the first suspension window and the position of the first suspension ball control are respectively located at two sides of a screen of the electronic equipment.
6. The method of claim 1, wherein the position of the first hover window does not overlap the position of the first hover ball control, comprising: the position of the first floating window and the position of the first floating ball control are positioned on the same side of the screen of the electronic equipment, and the position of the first floating ball control is not overlapped with the position of a first area corresponding to the first floating window; the first region includes the first floating window.
7. The method of claim 6, wherein the size of the first region is related to a number of application controls included in the first floating window.
8. The method of claim 1, wherein the electronic device displays a first floating window in response to a first operation in the first interface, comprising:
responding to the first operation in the first interface, and displaying the first floating window by the electronic equipment when the electronic equipment determines that the position of the first operation is outside a second area corresponding to the first floating ball control; the second area comprises the first suspension ball control.
9. The method of claim 8, wherein the method further comprises:
and responding to a second operation in the first interface, and when the electronic equipment determines that the position of the second operation is in the second area, continuing to display the first suspension ball control by the electronic equipment.
10. The method of claim 1, wherein the electronic device displays a first interface of a first application, comprising:
the electronic equipment displays a third interface of the first application; the third interface comprises a first text;
Responsive to a third operation on the first text, the electronic device displays a first control; the first control comprises a copying option and a translation option;
in response to a fourth operation of the copy option, the electronic device displays a third hover ball control;
and when the electronic equipment does not receive the operation of the third hover ball control within the first time threshold, the electronic equipment cancels the display of the third hover ball control and displays a first interface of the first application.
11. An electronic device comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform the method of any one of claims 1-10.
12. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when run on a computer, causes the computer to perform the method of any of claims 1-10.
13. A computer program product, characterized in that the computer program product comprises a computer program which, when run on a computer, causes the computer to perform the method of any of claims 1-10.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2023/071086 WO2023131314A1 (en) | 2022-01-10 | 2023-01-06 | Window interaction method and electronic device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2022100238122 | 2022-01-10 | ||
CN202210023812 | 2022-01-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116456018A true CN116456018A (en) | 2023-07-18 |
Family
ID=87130781
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210114776.0A Pending CN116456018A (en) | 2022-01-10 | 2022-01-30 | Window interaction method and electronic device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116456018A (en) |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105808095A (en) * | 2015-07-08 | 2016-07-27 | 维沃移动通信有限公司 | Display method for application interface of terminal and terminal |
CN107153541A (en) * | 2017-04-20 | 2017-09-12 | 北京小米移动软件有限公司 | Browse interaction processing method and device |
CN107861679A (en) * | 2017-09-18 | 2018-03-30 | 深圳市金立通信设备有限公司 | A kind of operation processing method, terminal and computer-readable recording medium |
CN111854789A (en) * | 2019-05-31 | 2020-10-30 | 北京嘀嘀无限科技发展有限公司 | Navigation display method and system |
CN111966252A (en) * | 2020-05-14 | 2020-11-20 | 华为技术有限公司 | Application window display method and electronic equipment |
CN112114722A (en) * | 2020-09-16 | 2020-12-22 | 北京嘀嘀无限科技发展有限公司 | Suspension window control method and system |
CN113645351A (en) * | 2020-04-24 | 2021-11-12 | 华为技术有限公司 | Application interface interaction method, electronic device and computer-readable storage medium |
CN113805743A (en) * | 2021-08-12 | 2021-12-17 | 荣耀终端有限公司 | Method for switching display window and electronic equipment |
-
2022
- 2022-01-30 CN CN202210114776.0A patent/CN116456018A/en active Pending
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105808095A (en) * | 2015-07-08 | 2016-07-27 | 维沃移动通信有限公司 | Display method for application interface of terminal and terminal |
CN107153541A (en) * | 2017-04-20 | 2017-09-12 | 北京小米移动软件有限公司 | Browse interaction processing method and device |
CN107861679A (en) * | 2017-09-18 | 2018-03-30 | 深圳市金立通信设备有限公司 | A kind of operation processing method, terminal and computer-readable recording medium |
CN111854789A (en) * | 2019-05-31 | 2020-10-30 | 北京嘀嘀无限科技发展有限公司 | Navigation display method and system |
CN113645351A (en) * | 2020-04-24 | 2021-11-12 | 华为技术有限公司 | Application interface interaction method, electronic device and computer-readable storage medium |
CN111966252A (en) * | 2020-05-14 | 2020-11-20 | 华为技术有限公司 | Application window display method and electronic equipment |
WO2021227770A1 (en) * | 2020-05-14 | 2021-11-18 | 华为技术有限公司 | Application window display method and electronic device |
CN112114722A (en) * | 2020-09-16 | 2020-12-22 | 北京嘀嘀无限科技发展有限公司 | Suspension window control method and system |
CN113805743A (en) * | 2021-08-12 | 2021-12-17 | 荣耀终端有限公司 | Method for switching display window and electronic equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220075696A1 (en) | Application Exception Recovery | |
US11853820B2 (en) | Cross-process communication method, apparatus, and device | |
CN111597000B (en) | Small window management method and terminal | |
EP2735132B1 (en) | Method and apparatus for triggering a remote data entry interface | |
US20200057541A1 (en) | Dynamically generated task shortcuts for user interactions with operating system user interface elements | |
US11450034B2 (en) | Techniques for enabling multiple mutually untrusted applications to concurrently generate augmented reality presentations | |
EP4170476A1 (en) | Translation method and electronic device | |
CN116088716B (en) | Window management method and terminal equipment | |
CN116451709A (en) | Control method of translation control and electronic equipment | |
CN114489920B (en) | Input method of android application on Linux platform | |
WO2023005751A1 (en) | Rendering method and electronic device | |
CN116456018A (en) | Window interaction method and electronic device | |
US20240012938A1 (en) | Information Display Method and Related Apparatus | |
WO2023131314A9 (en) | Window interaction method and electronic device | |
CN112578988A (en) | Mobile terminal and updating method of display interface thereof | |
EP4351116A1 (en) | Window interaction method and electronic device | |
CN116456020A (en) | Window interaction method and electronic device | |
CN116456019A (en) | Window interaction method and electronic device | |
CN117492609B (en) | Display method, readable storage medium, program product and electronic device | |
WO2023131313A9 (en) | Window interaction method and electronic device | |
CN115421599B (en) | Input method display control method and related device | |
CN116672707B (en) | Method and electronic device for generating game prediction frame | |
CN117519864B (en) | Interface display method, electronic device and storage medium | |
CN116055611B (en) | Execution method of drawing operation, electronic device and readable medium | |
CN116700535B (en) | Suspension bar display method based on note application, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |