CN110908552A

CN110908552A - Multi-window operation control method, device, equipment and storage medium

Info

Publication number: CN110908552A
Application number: CN201910963953.0A
Authority: CN
Inventors: 黄腾霄
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2019-10-11
Filing date: 2019-10-11
Publication date: 2020-03-24
Anticipated expiration: 2039-10-11
Also published as: CN110908552B; WO2021068382A1

Abstract

The embodiment of the application discloses a multi-window operation control method, a device, equipment and a storage medium, which relate to the technical field of electronic whiteboards and comprise the following steps: receiving a first control operation acting on a first window; displaying a first execution result of the first control operation in the first window, and displaying a second execution result of the first control operation in an associated second window, where the first window and the second window are windows responding to a second control operation, the second control operation and the first control operation satisfy a sequential operation time sequence relationship, the second control operation acts on the first window or the second window, and the first execution result and the second execution result are interfaces displayed by the first window and the second window before the second control operation is executed. By adopting the method, the technical problem that the process of synchronously controlling the linkage operation of the two windows in the double-screen mode in the prior art is too complex can be solved.

Description

Multi-window operation control method, device, equipment and storage medium

Technical Field

The embodiment of the application relates to the technical field of electronic whiteboards, in particular to a multi-window operation control method, device, equipment and storage medium.

Background

With the development of computer technology, computer devices are widely used in various scenes of daily life. For example, intelligent devices such as tablet computers and televisions with electronic whiteboard functions are widely used in scenes such as office and teaching. At this time, the user can perform operations such as writing and drawing on the display screen based on the electronic whiteboard function. In some scenarios, it is desirable to utilize the dual-screen mode of electronic whiteboard, i.e., to employ two windows in cooperation to accomplish a specific operation. In the process of implementing the invention, the inventor finds that the prior art has the following problems: when the electronic whiteboard is in the dual-screen mode, although the two windows can cooperate to complete a specific operation, the operation records of the two windows are independent of each other, and when a user wants to perform synchronous control on the specific operation (for example, cancel the specific operation), the user is required to perform control operations in the two windows respectively, which may make the operation process too complicated and increase the operation amount of the user.

Disclosure of Invention

The embodiment of the application provides a multi-window operation control method, a multi-window operation control device, multi-window operation control equipment and a storage medium, and aims to solve the technical problem that in the prior art, the process of synchronously controlling linkage operation of two windows in a double-screen mode is too complex.

In a first aspect, an embodiment of the present application provides a method for controlling multi-window operation, including:

receiving a first control operation acting on a first window;

displaying a first execution result of the first control operation in the first window, and displaying a second execution result of the first control operation in an associated second window, where the first window and the second window are windows responding to a second control operation, the second control operation and the first control operation satisfy a sequential operation time sequence relationship, the second control operation acts on the first window or the second window, and the first execution result and the second execution result are interfaces displayed by the first window and the second window before the second control operation is executed.

Further, the second control operation acts on the first window;

before the receiving the first control operation acting on the first window, the method further comprises:

receiving the second control operation;

displaying a third execution result of the second control operation in the first window;

and displaying a fourth execution result of the second control operation in the second window, and marking the third execution result and the fourth execution result as correlation results.

Further, the displaying a first execution result of the first control operation in the first window and a second execution result of the first control operation in an associated second window includes:

acquiring the third execution result according to the first control operation;

responding to the first control operation in the first window according to the third execution result to generate the first execution result;

and obtaining a fourth execution result which is a correlation result of the third execution result, responding to the first control operation in the second window according to the fourth execution result, and generating a second execution result.

Further, the step of marking the third execution result and the fourth execution result as associated results specifically includes:

generating identification information according to the second control operation;

recording the third execution result, wherein the third execution result corresponds to the identification information;

recording the fourth execution result, wherein the fourth execution result corresponds to the identification information.

Further, the identification information is a globally unique identifier.

Further, the recording the third execution result, where the third execution result corresponds to the identification information and includes:

generating first operation data according to the third execution result, wherein the first operation data is provided with the identification information;

adding the first operation data into a first operation stack corresponding to the first window;

the recording the fourth execution result, where the fourth execution result corresponding to the identification information includes:

generating second operation data according to the fourth execution result, wherein the second operation data is provided with the identification information;

and adding the second operation data into a second operation stack corresponding to the second window.

Further, the obtaining the third execution result according to the first control operation includes:

acquiring third operation data recorded at the top of the stack in the first operation stack according to the first control operation;

if the third operation data contains identification information, the step of obtaining the fourth execution result which is the correlation result of the third execution result is executed.

Correspondingly, the obtaining of the fourth execution result which is the correlation result of the third execution result includes:

acquiring fourth operation data recorded at the top of the stack in the second operation stack;

and if the fourth operation data contains the identification information, executing an operation of responding to the first control operation in the second window according to the fourth execution result and generating a second execution result.

Further, the method also comprises the following steps:

and if the third operation data does not contain the identification information, responding to the first control operation in the first window according to the third operation data to generate a fifth execution result.

Further, the method also comprises the following steps:

and if the fourth operation data does not contain the identification information, indicating the second window to stop responding.

Further, the acquiring fourth operation data recorded at the top of the stack in the second operation stack includes:

generating a control operation notification, the control operation notification including the identification information and the first control operation;

and acquiring fourth operation data recorded at the top of the stack in the second operation stack according to the control operation notification.

Further, the generating the identification information according to the second control operation includes:

confirming whether the second control operation meets a window linkage condition;

and if the window linkage condition is met, generating identification information according to the second control operation.

Further, the receiving the first control operation acting on the first window includes:

acquiring a touch track of current touch operation in a first window;

if the touch track meets a preset track condition, determining that a first control operation is received; or the like, or, alternatively,

a trigger control is displayed in the first window, and the receiving of the first control operation acting on the first window includes:

and when the trigger control is detected to receive the touch operation, determining that a first control operation is received.

Further, the first window is located in the first screen, and the second window is located in the second screen.

Further, the first window and the second window are located in the same screen.

Further, the first control operation is a cancel operation.

In a second aspect, an embodiment of the present application further provides a multi-window operation control apparatus, including:

the first monitoring module is used for receiving a first control operation acting on a first window;

the first execution module is used for displaying a first execution result of the first control operation in the first window;

the second execution module is configured to display a second execution result of the first control operation in an associated second window, where the first window and the second window are windows that respond to a second control operation, the second control operation and the first control operation meet a sequential operation timing relationship, the second control operation acts on the first window or the second window, and the first execution result and the second execution result are interfaces displayed by the first window and the second window before the second control operation is executed.

In a third aspect, an embodiment of the present application further provides a multi-window operation control device, including:

one or more processors;

a memory for storing one or more programs;

when the one or more programs are executed by the one or more processors, cause the one or more processors to implement the multi-window operation control method according to the first aspect.

In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the multi-window operation control method according to the first aspect.

According to the multi-window operation control method, the multi-window operation control device, the multi-window operation control equipment and the multi-window operation control storage medium, the first execution result of the first control operation is displayed in the first window by receiving the first control operation acting on the first window, and the second execution result of the first control operation is displayed in the associated second window. By adopting the technical means, when linkage operation of a plurality of windows is required to be controlled, only the first control operation needs to be triggered on one window, so that the plurality of windows can all respond, the execution results corresponding to the first control operation are respectively displayed in the plurality of windows, synchronous control of the plurality of windows is realized, the realization mode is simple and accurate, a user does not need to control and operate each window one by one, and the use experience of the user is improved. Meanwhile, the linkage operation executed by the two windows at the same time is identified through the identification information, so that whether the two windows execute the control operation (such as cancel operation) synchronously or not is determined through the identification information, the accuracy of synchronous control is ensured, and the error of the synchronous operation is reduced.

Drawings

Fig. 1 is a flowchart of a multi-window operation control method according to an embodiment of the present disclosure;

FIG. 2 is a first schematic view of a window provided in an embodiment of the present application;

FIG. 3 is a second schematic view of a window provided in accordance with an embodiment of the present application;

FIG. 4 is a third schematic view of a window provided in an embodiment of the present application;

FIG. 5 is a fourth illustration of a window provided in accordance with an embodiment of the present application;

FIG. 6 is a fifth schematic view of a window provided in accordance with an embodiment of the present application;

fig. 7 is a flowchart of a multi-window operation control method according to a second embodiment of the present application;

FIG. 8 is a diagram of an operation stack provided by an embodiment of the present application;

fig. 9 is a schematic structural diagram of a multi-window operation control device according to a third embodiment of the present application;

fig. 10 is a schematic structural diagram of a multi-window operation control device according to a fourth embodiment of the present invention.

Detailed Description

The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are for purposes of illustration and not limitation. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action or object from another entity or action or object without necessarily requiring or implying any actual such relationship or order between such entities or actions or objects. For example, "first" and "second" of the first control operation and the second control operation are used to distinguish two different control operations.

The multi-window operation control method provided in the embodiment of the present application may be executed by a multi-window operation control device, where the multi-window operation control device may be implemented in a software and/or hardware manner, and the multi-window operation control device may be formed by two or more physical entities or may be formed by one physical entity. For example, the multi-window operation control device may be a smart device such as a computer, a mobile phone, a tablet or a smart interactive tablet.

For the convenience of understanding, the intelligent interactive tablet is taken as an exemplary description of the multi-window operation control device in the embodiment. The intelligent interactive panel can be an integrated device which controls the content displayed on the display panel and realizes man-machine interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound box, a television, a video conference terminal and the like.

Generally, the smart interactive tablet includes at least one display screen. In the embodiment, the smart interactive tablet is configured with two display screens as an example. At this time, the two display screens may be the same type of display screen, or may be different types of display screens. In the embodiment, two display screens are taken as the same type of display screen as an example, and the two display screens have the same pixel coordinate system. The two display screens can be directly communicated or indirectly communicated through a processor (such as a central processing unit) of the intelligent interactive tablet. Also, the processor may control each display screen individually. Furthermore, two display screens all have the touch-control function, and correspondingly, the display screen can be capacitive screen, resistance screen or electromagnetic screen. Further, the touch operation response modes of the two display screens are the same, taking the case that a user performs touch operation in one display screen as an example, at this time, the user can perform touch operation in a manner of touching the display screen by a finger or a stylus, correspondingly, the intelligent interactive tablet detects the touch position of the touch operation in the display screen, and then determines a response scheme according to the display content corresponding to the touch position and performs response, so as to implement a touch function. For example, the corresponding display content is determined to be a control of a certain function according to the touch position, and at this time, the response scheme is to execute the function. In practical application, a user can perform touch operation on one display screen or can perform touch operation on two display screens simultaneously. Optionally, the specific manner of determining the touch position of the touch operation in the display screen may be set in combination with an actual situation, for example, when a certain position of the display screen receives the touch operation, a parameter collected by an electrical component responsible for detecting the position may change, and at this time, the intelligent interactive tablet may determine the touch position according to a parameter change situation. It can be understood that, in practical applications, the user may also implement control operations by means of a keyboard, a mouse, physical keys, and the like.

Typically, the smart interactive tablet is installed with at least one type of operating system, wherein the operating system includes, but is not limited to, an android system, a Linux system, and a Windows system. Each display screen can be controlled individually by the operating system. Further, the smart interactive tablet may install at least one application based on the operating system, and in an embodiment, the application with the electronic whiteboard function is exemplarily described. For example, an electronic whiteboard application is installed in the smart interactive tablet. The application program may be an application program carried by an operating system, or an application program downloaded from a third-party device or a server. The multi-window operation control device may also be an electronic whiteboard application. Optionally, under the function of the electronic whiteboard, the functions of writing, inserting a table, inserting a picture, inserting multimedia, inserting a file (such as PPT, etc.), playing multimedia, inserting a graph, drawing a table, etc. may be implemented. It will be appreciated that for both displays, it is possible to open the same application at the same time, or to open different applications at the same time. For the same application program, the same interface or different interfaces can be displayed in the two display screens after the application program is started. Optionally, when displaying different interfaces, the application program may have different versions, and each display screen may display the interface under the corresponding version. Alternatively, the two display screens display different functions of the same application. In the embodiment, two display screens are taken as an example to respectively display the interfaces of two application programs. At this time, the intelligent interactive tablet can respectively control the two application programs to run. In the embodiment, the intelligent interactive tablet controls two application programs to cooperatively operate so as to realize the method provided in the embodiment. The two applications may communicate with each other, and the specific embodiment of the communication means is not limited.

Example one

Fig. 1 is a flowchart of a multi-window operation control method according to an embodiment of the present disclosure. Referring to fig. 1, the multi-window operation control method specifically includes:

step 110, a first control operation acting on the first window is received.

It should be noted that, since both display screens display corresponding interfaces in the form of windows, in the embodiment, the display screens are replaced by windows for presentation. Illustratively, a linkage operation can be performed between the two windows, that is, the two windows can simultaneously execute a certain instruction sent by the user on one of the two windows. In the embodiment, the linkage operation is described as an example of the element transfer operation. Wherein, the element refers to an operable object displayed in the current interface. The elements can be elements drawn by a user, such as drawn graphs, text boxes, tables and the like, and can also be elements inserted by the user, such as inserted pictures, documents, PPT and the like. After the elements are displayed, the user may perform control operations on the elements, such as adjusting the positions, sizes, colors, and the like of the elements, and further, for example, page turning, closing, deleting, and the like on the elements.

In this embodiment, some elements may include multiple elements, for example, when an element is a courseware, a picture inserted in the courseware may also be considered as one element. At this time, the user can control the pictures individually, or can control the pictures when controlling the courseware. Further, the element transfer operation refers to transferring an element displayed in one window to another window for display. At this time, two windows that complete the element passing operation are defined as associated windows and are respectively marked as a first window and a second window. One of the first window and the second window serves as an initiating end of element transfer operation (namely, a window for displaying elements before transfer), and the other window serves as a receiving end of element transfer operation (namely, a window for displaying elements after transfer). It can be understood that the first window corresponds to the first screen and the second window corresponds to the second screen, that is, the two display screens are respectively referred to as the first screen and the second screen, and the first window is located in the first screen and the second window is located in the second screen.

Furthermore, the first window is set to display an interface with the first application program, that is, the first application program controls the relevant operation of the first window, and the second window is set to display an interface with the second application program, that is, the second application program controls the relevant operation of the second window. The specific types of the first application and the second application are not limited. It is to be understood that the linkage operation between windows may be understood as a linkage operation between application programs. It should be noted that the operations related to the window in the embodiment all represent operations performed by the corresponding application program. For example, notifying the second window to respond to the first control operation means notifying the second application to respond to the first control operation. For another example, controlling the first window to respond to the first control operation means controlling the first application program to respond to the first control operation. The window description is used for ease of reading only. Specifically, the touch operation for instructing the two windows to perform the linkage operation is denoted as a second control operation, and the linkage operation is taken as an example of an element transmission operation, and a specific trigger form embodiment of the second control operation is not limited. For example, the second control operation is a move operation and acts on the element displayed at the initiating end, at this time, the acted element moves synchronously with the second control operation, and when the element transfer condition is satisfied, the element transfer operation is performed, that is, the element is displayed at the receiving end while the element is deleted at the initiating end.

The specific content of the element transmission condition is not limited to the embodiment. For example, the element transfer condition may be that the moving speed of the second control operation is greater than a preset speed and/or the moving distance is greater than a preset distance, or the element transfer condition may be considered to be satisfied at the end of the second control operation. It can be understood that, in practical applications, element passing conditions may be defined for the initiator and the receiver, respectively, and the element passing operation may be executed only when both the initiator and the receiver satisfy the element passing conditions. Alternatively, in order to distinguish the second control operation from the general element moving operation, it may be set that the element transfer operation can be performed only when the element is in the selected state. The triggering mode of the selected state can be set according to actual conditions, and if the element is detected to receive the long press operation, the selected state is determined to be entered.

In the embodiment, a description is made of a scenario in which two windows perform the element transfer operation (second control operation). Specifically, the first control operation refers to an operation issued by a user and used for controlling the linkage operation, and in the embodiment, the first control operation is defined as a cancel operation. Further, the window in which the first control operation is initially received is recorded as a first window.

Typically, a trigger control is displayed in the first window, the trigger control is configured to receive the first control operation, and the display position and the display style of the touch control are not limited in this embodiment. At this time, receiving the first control operation applied to the first window may specifically include: when the trigger control is detected to receive the touch operation, the first control operation is determined to be received.

Specifically, when the click operation of the user on the first window is detected, the touch position corresponding to the click operation in the first window is obtained, and if the touch position falls into the display range of the trigger control, the reception of the first control operation is confirmed. The first control operation may also be triggered by means of a preset trajectory condition. At this time, receiving the first control operation acting on the first window includes: acquiring a touch track of current touch operation in a first window; and if the touch track meets the preset track condition, determining that a first control operation is received. For example, the preset trajectory condition defines a trajectory shape, at this time, after receiving the current touch operation in the first window, the touch trajectory is determined according to the touch position obtained at each acquisition time, and then, if the trajectory shape of the touch trajectory conforms to the trajectory shape of the first control operation, it is determined that the first control operation is received. For another example, the preset track condition defines an operation form (e.g., an operation form such as double-click or multi-point touch), at this time, after the current touch operation is received in the first window, the touch track is determined according to the touch position obtained at each acquisition time, the current operation form is determined according to the touch track, and if the current operation form meets the operation form defined in the preset track condition, it is determined that the first control operation is received. In addition, a cancel command (such as Ctrl + Z) may also be input through the keyboard to implement triggering of the first control operation, for example, when the first window is in an activated state, the cancel operation is triggered by pressing the Ctrl + Z key of the keyboard, and the reception of the first control operation is confirmed according to the input condition of the keyboard. The first window is in an activated state, namely the first window is highest in hierarchy level, and when control operation is sent through a keyboard, the control operation is defaulted to act on the first window.

It can be understood that, in practical applications, the first window and the second window may be not only windows in two display screens, but also two windows located in one display screen, that is, the first window and the second window are located in the same screen.

Step 120, displaying a first execution result of the first control operation in the first window, and displaying a second execution result of the first control operation in an associated second window, where the first window and the second window are windows responding to a second control operation, the second control operation and the first control operation satisfy a sequential operation timing relationship, the second control operation acts on the first window or the second window, and the first execution result and the second execution result are interfaces displayed by the first window and the second window before the second control operation is executed, respectively.

In particular, as can be seen from the foregoing, currently, the first window and the second window have responded to the second control operation. At this time, the first control operation is directed to the second control operation, i.e., for overriding the second control operation. Therefore, it can also be understood that the second control operation and the first control operation satisfy a sequential operation timing relationship, that is, the first control operation should be triggerable after the second control operation is executed.

Further, since the first window and the second window both respond to the second control operation, after receiving the first control operation, it is necessary to control both the first window and the associated second window to respond to the first control operation. Typically, when there are at least two second windows, in order to accurately find the associated second window, the second control operation may be recorded when the first window and the second window respond to the second control operation. At this time, after the second control operation targeted by the first control operation is determined, in addition to controlling the first window to respond, the record data corresponding to each second window is also accessed to search for the second window responding to the second control operation, and then the searched second window is controlled to respond. Or when the first window and the second window respond to the second control operation, the two windows are controlled to record the second control operation respectively and correspond to the same identification information, wherein the identification information has uniqueness. And then, after determining a second control operation aimed at by the first control operation, searching a second window with the same identification information according to the identification information corresponding to the second control operation, and controlling the second window to respond. The embodiment of the manner of recording the second control operation is not limited. For example, recording is performed in a stack manner, or recording is performed in a data table manner. It is to be understood that when there is only one second window, the second window may be directly determined as the associated second window.

Further, after the first window executes the first control operation, a corresponding execution result is displayed. And after the first control operation is executed in the second window, displaying a corresponding execution result, wherein in the embodiment, the execution result of the second window is recorded as a second execution result. The first execution result is an interface displayed by the first window before the second control operation is executed, and the second execution result is an interface displayed by the second window before the second control operation is executed. For example, in response to the second control operation, the second window displays an element in the first window, and the first window deletes the element. And after receiving the first control operation, the corresponding first execution result is that the element is redisplayed on the first window, and the second execution result is that the display of the element on the second window is cancelled.

It is to be understood that, when the first window and the second window perform the first control operation, the first control operation may be recorded as the linkage operation. Then, if a redo operation for the first control operation is received, the first window and the second window may be controlled to both respond to the redo operation in the above manner. For example, after the first control operation is performed, the first execution result is that the element is displayed again on the first window, and the second execution result is that the display of the element on the second window is canceled. And then, if the redo operation is received, deleting the elements on the first window, namely canceling the display of the elements on the first window, and displaying the elements on the second window again. Since the redo operation and the undo operation respond in the same manner, the first control operation may be a redo operation in addition to an undo operation.

It should be noted that, in practical applications, the control operation whose timing is closest to the first control operation is not necessarily the second control operation, and therefore, when the first control operation is received, the control operation that needs to be cancelled currently is acquired, and the control operation is generally the operation whose timing is latest except for the first control operation. And further, determining whether the control operation is a second control operation, namely whether the control operation is a linkage operation, if the control operation is the linkage operation, controlling the first window and the second window to respond to the first control operation, and otherwise, only controlling the first window to respond to the first control operation.

It can be understood that the second window may also receive the first control operation, and at this time, the processing manner is the same as the manner in which the first window receives the first control operation, and is not described herein again.

The technical solutions provided by the embodiments are exemplarily described below:

the intelligent interactive tablet has two display screens and is applied to teaching scenes. Fig. 2 is a first schematic view of a window provided in the present application. Referring to fig. 2, the corresponding two display screens are respectively referred to as a first screen 11 and a second screen 12. The first window 13 is disposed in the first screen 11, and the second window 14 is disposed in the second screen 12. The first screen 11 serves as a teaching tablet, and correspondingly, the first window 13 serves as a window for displaying courseware and corresponds to an application program for displaying courseware. The second screen 12 acts as a writing tablet and correspondingly the second window 14 acts as a writing tablet window and corresponds to a writing tablet enabled application. A first trigger control 17 and a second trigger control 18 for triggering a first control operation are respectively arranged on the first window 13 and the second window 14.

When the teacher needs to move an element in the courseware to the second window 14 for displaying, so as to operate and explain the element, the teacher can perform a second control operation on the corresponding element in the first window 13, so that the intelligent interactive tablet triggers an element transfer operation according to the second control operation, and further transfers the element to the second window 14. Taking fig. 2 as an example, two elements, element 15 and element 16, are currently displayed in the first window 13, and no element exists in the second window 14. Further, fig. 3 is a second schematic view of a window provided in the present application, which is a schematic view of a window in an element passing operation process. Referring to fig. 3, if the teacher wants to transfer the element 15 to the second window 14, the teacher needs to touch the element 15 with a finger and drag the finger in the direction of the arrow so that the smart interactive tablet receives the second control operation for the element 15, and then the smart interactive tablet control element 15 moves synchronously along the movement track of the second control operation, and when the element transfer condition is satisfied, performs the element transfer operation. Fig. 4 is a third schematic view of a window provided in the present application, which is a screenshot of the window when an element passing operation is completed. Referring to fig. 4, when the second control operation satisfies the element passing condition, the element passing operation of the element 15 between the first window 13 and the second window 14 is triggered, the element 15 is displayed on the second window 14, the element 15 on the first window 13 is deleted, the display of the element 15 on the first window 13 is cancelled, and the element passing operation of the element 15 is completed.

Further, fig. 5 is a fourth schematic view of a window provided in the present embodiment, which is a schematic view of a process for implementing the first control operation, at this time, the transmission event of the element 15 is completed, the element 16 is displayed on the first window 13, and the element 15 is displayed on the second window 14. Referring to fig. 5, in order to cancel the delivery event to the element 15, the user needs to touch the first trigger control 17 on the first window 13 with a finger. Correspondingly, after the intelligent interactive tablet detects that the first trigger control 17 is clicked, it is determined that the first control operation is received. Thereafter, the first window 13 and the second window 14 are instructed to respond to the first control operation. The first execution result of the first window 13 is to restore the display of the element 15 on the first window 13, and the second execution result of the second window 14 is to delete the element 15 on the second window 14. Further, fig. 6 is a fifth schematic view of a window provided in the embodiment of the present application, which is a screenshot of two windows after responding to the first control operation, where an element 15 and an element 16 are displayed on the first window 13, and no element is displayed in the second window 14.

It is understood that the fingers and arrows shown in the above figures are only used for explaining the technical solution, and are not displayed in the window in practical application. Meanwhile, in practical application, elements can be displayed in a window according to actual requirements to transfer a trigger control, delete a control and the like, and the embodiment does not limit the elements. In addition, for convenience of understanding, the frame of the first window is shown in the first screen, and the frame of the second window is shown in the second screen, in an actual application, the frames of the first window and the second window may not be displayed, for example, in a full-screen mode, the frames of the first window and the second window may not be displayed in the corresponding display screens.

In the above, by receiving a first control operation applied to a first window, a first execution result of the first control operation is displayed in the first window, and a second execution result of the first control operation is displayed in an associated second window, where the first window and the associated second window are windows responding to the same control operation. By adopting the technical means, when linkage operation of a plurality of windows needs to be cancelled, the plurality of windows can all respond only by triggering the first control operation on one window, and the execution results corresponding to the first control operation are respectively displayed in the plurality of windows, so that synchronous control of cancelling operation of the plurality of windows is realized, the realization mode is simple and accurate, the user does not need to cancel operation at each window one by one, and the use experience of the user is improved.

Example two

Fig. 7 is a flowchart of a multi-window operation control method according to a second embodiment of the present application. The present embodiment is embodied on the basis of the above-described embodiments. In an embodiment, the first control operation is a undo operation. The first window is located in the first screen and the second window is located in the second screen. Furthermore, the first window displays an interface of the first application program, and the second window displays an interface of the second application program. The specific types of the first application and the second application are not limited. It is understood that the first application and the second application may be the same application or different applications.

Referring to fig. 7, the method for controlling multi-window operation provided in this embodiment specifically includes:

step 210, receiving a second control operation.

It is understood that the second control operation may act on the first window, and may also act on the second window, and the embodiment is described by taking the example that the second control operation acts on the first window. The second control operation is used for indicating the first window and the second window to carry out linkage operation.

In an embodiment, it is defined that the second control operation can be detected only if the element is in the selected state. The selected state may be realized through a set touch operation, for example, when a long-press operation, a double-click operation, or a multi-finger click operation for an element is received, the first application program determines that the element becomes the selected state. It will be appreciated that what corresponds to the selected state is the elemental state of the element. In the basic state, the user can perform normal operations on the element. Conventional operations include, but are not limited to, zooming, dragging, rotating, and the like. Further, when an element is in the selected state, the element may also be switched back to the basic state. The basic state may also be realized by a set touch operation, and the touch operation may be the same as or different from the touch operation in the selected state. For example, when an element is in a basic state, if a long press operation (press duration exceeds 2s) for the element is received, the first application program confirms that the element becomes a selected state. Then, if the click operation is received in the window range outside the element, the first application program confirms that the element is changed from the selected state to the basic state.

Further, when the element is in the selected state, if a touch operation for the element is received and the touch operation is used for performing linkage operation, it is determined that the second control operation is received.

Specifically, when the second control operation is confirmed to be received, the first application program is controlled to perform data communication with the second application program, so that the second window responds to the second control operation. Further, in order to ensure the accuracy of the linkage operation, when the first window receives the second control operation, the first application program determines whether the second control operation meets the window linkage condition, and if the second control operation meets the window linkage condition, the first application program performs data communication with the second application program so as to enable the second window to respond to the second touch operation. The window linkage condition is a limiting condition for executing linkage operation, and can be set according to actual conditions. For example, when the linkage operation is an element transfer operation, the window linkage condition corresponds to an element transfer condition. If the window linkage condition comprises two parts and is respectively specific to the first window and the second window, the first application program carries out data communication with the second application program when confirming that the first window meets the window linkage condition, so that the second application program confirms whether the second window meets the window linkage condition or not, and carries out data communication with the first application program after confirming that the second window meets the window linkage condition so as to inform the first application program of linkage operation, and then, the second application program and the first application program carry out linkage operation. The communication means between the first application program and the second application program can be set according to actual conditions.

And step 220, displaying a third execution result of the second control operation in the first window.

Specifically, the linkage operation corresponding to the second control operation is executed in the first window, and the obtained result is recorded as a third execution result, for example, the linkage operation is an element transfer operation, and at this time, when the first application executes the element transfer operation, the corresponding third execution result is that the storage address of the element used for transfer in the first window is copied and sent to the second application, and then the element is deleted in the first window. At this time, from the user perspective, it can only be seen that the third execution result is the deletion of the element in the first window.

Step 230, displaying a fourth execution result of the second control operation in the second window, and marking the third execution result and the fourth execution result as associated results.

Specifically, the second application program responds to the linkage operation after determining that the linkage operation corresponding to the second control operation can be executed. At this time, the obtained result is recorded as a fourth execution result, for example, the linkage operation is an element transfer operation, and at this time, when the second application executes the element transfer operation, the corresponding fourth execution result is to acquire an element according to the element storage address sent by the first application and display the element in the second window. At this time, from the user perspective, it can only be seen that the fourth execution result is that the element is displayed in the second window.

Specifically, after the first application program and the second application program execute the control operation once, the corresponding execution results are respectively recorded. At this time, since the third execution result and the fourth execution result are the execution results of the linkage operation, the third execution result and the fourth execution result are marked as the association results when the third execution result and the fourth execution result are recorded. In the embodiment, the association result is marked by adopting a mode of identification information. Namely, the third execution result and the fourth execution result are marked by the same or corresponding identification information. For example, the marking with the same identification information is performed, and at this time, the setting of marking the third execution result and the fourth execution result as the association result specifically includes steps 231 to 233:

and 231, generating identification information according to the second control operation.

Typically, in order to accurately record the linkage operation of the two windows, identification information is set in the embodiment. The identification information may be a segment of characters and has uniqueness. The embodiment of the generation rule of the identification information is not limited, for example, a Globally Unique Identifier (GUID) is used as the identification information, that is, the identification information is a GUID. At this time, the first application may call the GUID generation algorithm to randomly generate the GUID as the identification information. Wherein the algorithm used to generate the GUID incorporates non-random parameters (such as time) to ensure the uniqueness of the GUID. Furthermore, each second control operation corresponds to one identification information, and in the embodiment, the identification information generated by the first application program is set and sent to the second application program. Specifically, the first application program confirms whether the second control operation meets a window linkage condition; and if the window linkage condition is met, generating identification information according to the second control operation. If the window linkage condition is simultaneously for the first window and the second window, the first application program may generate the identification information when it is determined that both the two windows satisfy the window linkage condition, or the first application program may generate the identification information when it is determined that the first window satisfies the window linkage condition. Or, when the first application program determines that the second touch operation is received, whether the window linkage condition is met or not is judged, and the identification information is generated. And then, the first application program sends the generated identification information to the second application program. The first application program may send the identification information alone, or send the identification information and other information together to the second application program. For example, when the first window satisfies the window linkage condition, the first application needs to perform data communication with the second application to instruct the second application to determine whether the second window satisfies the window linkage condition, and at this time, the identification information may be synchronously sent to reduce the number of message sending times. It should be noted that, after receiving the identification information, the second application program only stores the identification information when determining that it is possible to perform the linkage operation. If the user cannot perform the linkage operation, the identification information is ignored. After the first application generates the identification information and sends it to the corresponding second application,

step 232, recording the third execution result, where the third execution result corresponds to the identification information.

When the first application program records the execution result, the time sequence relationship between different execution results needs to be reflected. For example, the execution result is recorded in a stack manner, and at this time, since the stack is last-in first-out, it may be determined that the execution result recorded in the stack is a timing relationship executed in order from the bottom of the stack to the top of the stack. For another example, the execution result is recorded in a storage location other than the stack, and at this time, the first application program saves the obtained third execution result in the corresponding storage location. And sequentially recording the execution results of the current control operations of the first application program in the storage position corresponding to the first application program. Typically, since the current third execution result is the execution result of the linkage operation, when the first application program records the third execution result, the identification information and the corresponding relationship between the third execution result and the identification information are synchronously recorded. By this correspondence, it can be determined that the third execution result is the execution result of the linkage operation.

In an embodiment, recording a third execution result in a stack manner, at this time, setting to record the third execution result, where the third execution result corresponds to the identification information, and specifically includes steps 2321 to 2322:

step 2321, generating first operation data according to the third execution result, wherein the first operation data carries the identification information.

Specifically, in order to record the third execution result in the stack, the third execution result needs to be converted into a form recognizable by the stack. In an embodiment, the converted third execution result is recorded as the first operation data. Correspondingly, when the intelligent interactive tablet reads the first operation data recorded in the stack, the specific content of the third execution result can be obtained. The embodiment of the conversion method of the third execution result is not limited.

Further, when the first operation data is generated, the identification information is synchronously added into the first operation data. The embodiment of the adding manner of the identification information is not limited. By writing the identification information into the first operation data, when the intelligent interactive tablet reads the first operation data, the first operation data can be determined to be related to the linkage operation through the identification information.

Step 2322, adding the first operation data into the first operation stack corresponding to the first window.

Illustratively, each window corresponds to a stack, and the stack is used for recording an execution result corresponding to the control operation in the window. In the embodiment, a stack corresponding to the first window is denoted as a first operation stack. Further, after the first application program generates first operation data with identification information, the first operation data is added into the first operation stack. The adding process is specifically that the first operation data is stored in the stack area, and a reference (pointer) of the first operation data in the stack area is added to the stack top of the first operation stack.

In this embodiment, the first operation stack may also be understood as a undo stack, which is specifically used to record operation data that can be undone in the first window. When a user executes control operations except for the undo operation in the first window, the first application program responds to the control operations to obtain corresponding execution results, and if the execution results can perform the undo operation, operation data corresponding to the execution results are generated and added to the undo stack. In an embodiment, since the third execution result is an execution result that can perform a undo operation, the first operation data that can be added to the undo stack may be generated according to the third execution result, and the first operation data includes the identification information.

Step 233, recording the fourth execution result, where the fourth execution result corresponds to the identification information.

Furthermore, each time the second application executes an operation, the corresponding execution result is recorded. The manner of recording the execution result by the second application is the same as the manner of recording the execution result by the first application, and is not described herein again.

In an embodiment, recording a fourth execution result in a stack manner, at this time, setting to record the fourth execution result, where the fourth execution result includes the identification information includes step 2331-step 2332:

step 2331, generating second operation data according to the fourth execution result, wherein the second operation data carries the identification information.

Specifically, in order to record the fourth execution result in the stack, the fourth execution result needs to be converted into a form recognizable by the stack. In an embodiment, the converted fourth execution result is recorded as the second operation data. Accordingly, when the second application program reads the second operation data recorded in the stack, the specific content of the fourth execution result can be obtained. The embodiment of the conversion method of the fourth execution result is not limited.

Further, when the second operation data is generated, the identification information corresponding to the fourth execution result is synchronously added to the second operation data. The embodiment of the adding manner of the identification information is not limited. By writing the identification information in the second operation data, when the second application program reads the second operation data, the second operation data can be determined to be related to the linkage operation through the identification information.

Step 2332, adding the second operation data to a second operation stack corresponding to the second window.

In the embodiment, a stack corresponding to the second window is denoted as a second operation stack. Further, the specific process of adding the second operation data to the second operation stack is the same as the specific process of adding the first operation data to the first operation stack, and details are not repeated here. Optionally, the second operation stack may also be understood as a undo stack, where an implementation manner of the second operation stack is the same as that of the first operation stack, and details are not described here.

Step 240, receiving a first control operation acting on the first window.

Step 250, displaying a first execution result of the first control operation in the first window, and displaying a second execution result of the first control operation in an associated second window.

In the specific implementation, the step specifically includes steps 251 to 253:

and 251, acquiring the third execution result according to the first control operation.

Since the first window executes the second control operation before the first control operation, the first application program in this step can directly acquire the latest third execution result according to the first control operation.

Optionally, when the third execution result is saved to the storage location corresponding to the first application program, after receiving the first control operation, the third execution result may be searched in the storage location. Optionally, when the third execution result is stored in the first operation stack, after the first control operation is received, the operation data located at the top of the first operation stack is obtained, so as to obtain the third execution result. It is understood that, if the first control operation is preceded by another control operation, the first window performs another control operation, and then the result of performing another control operation is obtained according to the first control operation.

Specifically, after the third execution result is obtained, the first application program determines whether the third execution result has the identification information. If the identification information exists, the third execution result is the execution result of the linkage operation, and at the same time, the identification information is sent to the second application program, so that the step 253 is executed at the same time when the step 252 is executed. If the identification information does not exist, the first application program can be instructed to directly respond to the first control operation.

In the embodiment, for example, the first operation stack records the execution result of the first application program, at this time, since the first application program records the corresponding third execution result in the first operation stack after responding to the second control operation, the first application program needs to access its own stack when responding to the first control operation. Accordingly, the step may include: acquiring third operation data recorded at the top of the stack in the first operation stack according to the first control operation; and judging whether the third data contains the identification information. If the third operation data includes identification information, the operations of step 252 and step 253 of obtaining the fourth execution result which is the correlation result of the third execution result are executed. And if the third operation data does not contain the identification information, responding to the first control operation in the first window according to the third operation data to generate a fifth execution result.

Specifically, after confirming that the first control operation is received, the first application program accesses the first operation stack corresponding to the first window according to the first control operation, and obtains operation data recorded in the stack top of the first operation stack. The obtaining of the third operation data recorded in the top of the first operation stack may specifically be: and acquiring a reference (pointer) at the top of the first operation stack, and acquiring the position of the third operation data in the stack area according to the reference (pointer), so as to obtain the third operation data according to the position. It is to be understood that, since the second control operation is set as the preceding operation of the first control operation in the embodiment, the third operation data acquired in this step should have the same content as the first operation data. In practical applications, the preamble operation of the first control operation may be another control operation, that is, another control operation may exist between the second control operation and the first control operation, and at this time, the acquired third operation data is another content.

Specifically, after the first application program acquires the third operation data in the top of the first operation stack, content included in the third operation data is detected to determine an execution result corresponding to the third operation data. Meanwhile, whether the third operation data is attached with the identification information is detected. The manner of detecting the identification information may be set according to actual conditions. For example, the detection may be performed at a specific storage location in the third operation data according to the identification information. For another example, the detection method may be to detect an identification tag attached to the third operation data, where if the third operation data includes the identification tag, it is determined that the third operation data includes the identification information, and otherwise, it is determined that the third operation data does not include the identification information.

Specifically, if the third operation data includes the identification tag, the second application program may be notified, so that the second application program obtains the associated fourth execution result according to the identification tag. Optionally, if the first application program includes a plurality of windows in addition to the first window, the first application program cannot determine which window of the plurality of windows is the second window. At this time, the first application may send the identification information to the application corresponding to each of the other windows. And after receiving the identification information, other application programs confirm whether the identification information is recorded in the application programs, and if the identification information is recorded, the application programs determine that the application programs execute linkage operation and can execute subsequent operation. Optionally, after determining that the application itself performs the linkage operation, the application may notify the first application, so that the first application explicitly associates with the second window. Or after each application program is linked, the associated application program is recorded, and at this time, the first application program may send the identification information to the associated application program according to the record.

And if the third operation data in the first operation stack top does not have identification information attached, namely the third operation data in the first operation stack top is generated in response to control operation except the linkage operation, the first application program automatically responds to the first control operation and displays a corresponding execution result in the first window. In the embodiment, the execution result displayed in the first window is recorded as a fifth execution result.

And 252, responding to the first control operation in the first window according to the third execution result to generate the first execution result.

Specifically, the first application program determines the control operation to be cancelled according to the third operation data, and displays the first execution result after the control operation is cancelled in the first window. Optionally, when the execution result is recorded by the first operation stack, the third operation data recorded in the top of the first operation stack is deleted synchronously. Optionally, when the execution result is recorded in the storage location corresponding to the first application program, after the first application program instructs the first window to respond to the first control operation according to the third execution result, the first execution result is recorded in the storage location corresponding to the first window.

Step 253, obtaining the fourth execution result which is the correlation result of the third execution result, and responding to the first control operation in the second window according to the fourth execution result to generate the second execution result.

Specifically, after receiving the identification information from the first application program, the second application program searches for identification information that is consistent with the identification information sent by the first application program from among the recorded identification information. It is understood that, when there are a plurality of windows in addition to the first window, the application program of each window may receive the identification information sent by the first application program and determine whether there is identification information identical to the identification information itself, and thereafter, only the second application program having the identical identification information may respond.

Further, when the execution result is recorded by the storage location corresponding to the second application, the second application may search, according to the identification information, for a fourth execution result corresponding to the identification information in the storage location where the execution result is recorded. Thereafter, the second window application responds to the first control operation according to the fourth execution result. And simultaneously, recording a second execution result in a preset storage position corresponding to the second window. Or, when the execution result is recorded by the second operation stack, the fourth execution result is searched by the second operation stack.

In the embodiment, for example, the second operation stack records the execution result, at this time, since the second application program records the corresponding fourth execution result in the second operation stack after responding to the second control operation, the second application program needs to access its own stack when responding to the first control operation. Accordingly, setting the fourth execution result to obtain the correlation result as the third execution result includes: acquiring fourth operation data recorded at the top of the stack in the second operation stack; and judging whether the fourth data contains the identification information. And if the fourth operation data contains the identification information, executing an operation of responding to the first control operation in the second window according to the fourth execution result and generating a second execution result. And if the fourth operation data does not contain the identification information, indicating the second window to stop responding.

Specifically, after the second application program receives the identification information, the second application program accesses the second operation stack corresponding to the second window, acquires the operation data recorded in the top of the second operation stack, and records the operation data as fourth operation data. In this embodiment, the acquiring of the fourth operation data recorded in the top of the second operation stack specifically includes: and acquiring a reference (pointer) at the top of the second operation stack, and acquiring the position of the fourth operation data in the stack area according to the reference (pointer), so as to obtain the fourth operation data according to the position. It is to be understood that, in the embodiment, since the second control operation is set as the preceding operation of the first control operation in the embodiment, the fourth operation data acquired in this step should have the same content as the second operation data. In practical applications, the preamble operation of the first control operation may be another control operation, that is, another control operation may exist between the second control operation and the first control operation, and at this time, the obtained fourth operation data is another content.

Specifically, after fourth operation data in the top of the second operation stack is acquired, content included in the fourth operation data is detected to determine an execution result corresponding to the fourth operation data. Meanwhile, whether the fourth operation data is attached with the identification information is detected. The detection method of the identification information is the same as that of the identification information in the third operation data, and is not described herein again. Further, if the fourth operation data is accompanied by identification information, the identification information is compared with the identification information sent by the first application program, and if the two identification information are consistent, it is determined that the fourth operation data contains the identification information (the identification information should be understood as the identification information sent by the first application program).

Specifically, if the identification information in the fourth operation data is not consistent with the identification information sent by the first application program, or the fourth operation data does not include the identification information, it is determined that the fourth operation data does not include the identification information (the identification information should be understood as the identification information sent by the first application program), at this time, the second application program instructs the second window to stop responding, that is, cancel the cancel operation of the linkage between the first window and the second window. Optionally, after stopping the response, the second application may send a stop response notification to the first application, and the first application determines, according to the stop response notification, that the second window cannot execute the first control operation. At this time, the first application program may pop up a prompt box in the first window to prompt the user that the second window cannot execute the first control operation currently, so that the user may determine a subsequent processing manner (e.g., instruct the second window to execute a cancel operation until the operation data including the same identification information is at the top of the second operation stack).

For example, after the user performs the linkage operation, the first window does not receive other control operations, and at this time, for the first operation stack, the operation data corresponding to the linkage operation is located at the top of the stack. And the second window receives the moving operation aiming at the element, and at the moment, for the second operation stack, the operation data corresponding to the moving operation is positioned at the top of the stack, and the operation data corresponding to the linkage operation is arranged below the stack in sequence. At this time, after the first window receives the first control operation, the first application program obtains the operation data positioned at the top of the stack and obtains corresponding identification information, then the first application program sends the identification information to the second application program, after the second application program receives the identification information, the second application program obtains the operation data positioned at the top of the second operation stack, and the operation data does not contain the identification information, at this time, the second window is determined to be incapable of executing the first control operation, and the first window is informed.

Further, the setting and obtaining fourth operation data recorded at the top of the stack in the second operation stack specifically includes: generating a control operation notification, the control operation notification including the identification information and the first control operation; and acquiring fourth operation data recorded at the top of the stack in the second operation stack according to the control operation notification.

Specifically, the control operation notification is used to notify the second application program of the response to the first control operation. The control operation notification includes at least identification information and a first control operation. The control operation notification including the first control operation means that the operation type (undo operation) including the first control operation is included. It will be appreciated that the control action notification is generated by the first application and that the generation rule embodiments are not limiting.

The first application program sends the control operation notification to the second application program, where the sending method embodiment is not limited. Reference may be made specifically to the above-mentioned description relating to the transmission of identification information. Further, after the first application program sends the control operation notification to the second application program, the second application program obtains a fourth control operation recorded at the top of the stack in the second operation stack according to the control operation notification.

Further, when the second application detects that the identification information of the fourth operation data coincides with the identification information included in the control operation notification, it is determined that the fourth operation data is in accordance with the execution result of the linkage operation. At this time, the second window is controlled to respond to the first control operation. The second application program determines the control operation needing to be cancelled according to the fourth operation data, and displays a second execution result after the control operation is cancelled in the second window. Optionally, the fourth operation data recorded in the second operation stack is deleted synchronously. It can be understood that, when the execution result is recorded in the storage location corresponding to the second application program, after the second application program instructs the second window to respond to the first control operation according to the fourth execution result, the second execution result is recorded in the storage location corresponding to the second window.

The advantage of using the control operation notification is that the identification information can be guaranteed to accurately reach the second application program, and the second application program can accurately acquire the first control operation.

the intelligent interactive tablet has two display screens and is applied to teaching scenes. The two display screens are respectively marked as a first screen and a second screen. Correspondingly, the first window is arranged in the first screen, and the second window is arranged in the second screen. The first window is used as a window for displaying courseware, corresponds to an application program capable of displaying courseware and is recorded as a first application program. The second window is used as a window of the writing board, corresponds to the application program of the writing board and is marked as a second application program.

Take the linkage operation as the element transfer operation as an example. When detecting that the first window receives a second control operation for indicating element transfer, controlling the corresponding element in the first window to synchronously move along the moving track of the second control operation, and judging whether the current second control operation meets the element transfer condition in real time. When the element passing condition is satisfied, the first application program calls a GUID generation algorithm to generate a GUID as the identification information.

Further, the first application program informs the second application program of element transfer operation and synchronous sending of the identification information. Thereafter, the first application and the second application respond to the second control operation. At this time, the first window deletes the element, and the second window displays the element. And the first application program generates first operation data aiming at the deleted element and the identification information and puts the first operation data into a first data stack. The second application generates second operation data for the display element and the identification information and places the second operation data in a second data stack. At this time, fig. 8 is a schematic diagram of an operation stack provided in the embodiment of the present application, where the first heap area and the second heap area are used to store corresponding first operation data in the first window and corresponding second operation data in the second window, respectively.

And then, after the first window receives the first control operation representing the undo operation, the first application program acquires third operation data recorded on the top of the stack in the first operation stack. As can be seen from fig. 8, currently, the first operation stack is at the top of the first operation stack, i.e. the third operation data should be the first operation data. And then, the first application program processes the first operation data and confirms that the first operation data contains the identification information. The first application program then sends the identification information to the second application program and responds to the first control operation based on the first operation data. And after receiving the identification information, the second application program acquires fourth operation data recorded at the top of the stack in the second operation stack. As can be seen from fig. 8, currently, the second operation data is at the top of the second operation stack, i.e. the fourth operation data should be the second operation data. And then, the second application program processes the second operation data and confirms that the second operation data contains the identification information, and the identification information is consistent with the identification information sent by the first application program. At this time, the second application responds to the first control operation based on the second operation data. Here, the first window and the second window simultaneously display the execution result of the undo operation.

In the foregoing, the third execution result and the fourth execution result corresponding to the second control operation are marked as the association result, and the first window and the second window are controlled by the association result to respond to the first control operation, so that the synchronous control of the undo operation of the multiple windows is realized. And meanwhile, generating corresponding identification information according to the second control operation, adding the first operation data and the second operation data with the identification information into a corresponding operation stack, displaying a first execution result of the first control operation in a first window, and displaying a second execution result of the first control operation in a related second window according to the corresponding condition of the identification information, wherein the first control operation is a cancel operation. The first execution result and the second execution result of the first control operation can be respectively displayed in the first window and the second window in response to the first control operation of the user, so that the operation amount of the user for carrying out the undo operation on the two windows is reduced, and the implementation mode is simple. Meanwhile, the linkage operation is identified through the identification information, and the corresponding operation data is stored in the operation stack, so that the accuracy of the synchronous undo operation is ensured, and the error occurrence of the synchronous operation is reduced.

EXAMPLE III

Fig. 9 is a schematic structural diagram of a multi-window operation control device according to a third embodiment of the present application. Referring to fig. 9, the multi-window operation control apparatus includes: a first listening module 301, a first executing module 302 and a second executing module 303.

The first monitoring module 301 is configured to receive a first control operation applied to a first window; a first executing module 302, configured to display a first execution result of the first control operation in the first window; a second executing module 303, configured to display a second executing result of the first control operation in an associated second window, where the first window and the second window are windows responding to a second control operation, the second control operation and the first control operation meet a sequential operation timing relationship, the second control operation acts on the first window or the second window, and the first executing result and the second executing result are interfaces displayed by the first window and the second window before the second control operation is executed.

As described above, by receiving a first control operation applied to a first window, a first execution result of the first control operation is displayed in the first window, and a second execution result of the first control operation is displayed in an associated second window. By adopting the technical means, when the control operation on the element transmission operation is needed, the first control operation can be triggered on the first window, so that the first window and the second window respectively display the first execution result and the second execution result of the first control operation, the synchronous control of multiple windows is realized, the operation amount of a user on the two windows is quickly and accurately reduced, the realization mode is simple, and the user does not need to perform the control operation on each window one by one.

On the basis of the above embodiment, the second control operation acts on the first window. The multi-window operation control apparatus further includes: the device comprises a second monitoring module, a third execution module and a fourth execution module. The second monitoring module is used for receiving the second control operation before receiving the first control operation acting on the first window; a third execution module, configured to display a third execution result of the second control operation in the first window; a fourth execution module, configured to display a fourth execution result of the second control operation in the second window; and the identification recording module is used for marking the third execution result and the fourth execution result as correlation results.

On the basis of the above embodiment, the first execution module 302 includes: a result acquisition unit configured to acquire the third execution result according to the first control operation; a result response unit, configured to respond to the first control operation in the first window according to the third execution result to generate the first execution result; the second execution module 303 specifically comprises the following working steps: and obtaining a fourth execution result which is a correlation result of the third execution result, responding to the first control operation in the second window according to the fourth execution result, and generating a second execution result.

On the basis of the above embodiment, the identification recording module includes: an information generating unit configured to generate identification information according to the second control operation; a first recording unit, configured to record the third execution result, where the third execution result corresponds to the identification information; a second recording unit, configured to record the fourth execution result, where the fourth execution result corresponds to the identification information.

On the basis of the above embodiment, the identification information is a globally unique identifier.

On the basis of the above embodiment, the first recording unit includes: a first data generating subunit, configured to generate first operation data according to the third execution result, where the first operation data carries the identification information; a first data stacking subunit, configured to add the first operation data to a first operation stack corresponding to the first window; the second recording unit includes: a second data generating subunit, configured to generate second operation data according to the fourth execution result, where the second operation data carries the identification information; and the second data stacking subunit is configured to add the second operation data to a second operation stack corresponding to the second window.

On the basis of the above embodiment, the result obtaining unit includes: a first data obtaining subunit, configured to obtain, according to the first control operation, third operation data recorded at a top of the stack in the first operation stack; an operation execution subunit, configured to notify a second execution module to execute the step of obtaining the fourth execution result that is the correlation result of the third execution result if the third operation data includes identification information; the second execution module 303 includes: a second object obtaining unit, configured to obtain fourth operation data recorded at the top of the stack in the second operation stack; and the identifier matching unit is configured to respond to the first control operation in the second window according to the fourth execution result if the fourth operation data includes the identifier information, and generate the second execution result.

On the basis of the above embodiment, the method further includes: and the fifth execution module is configured to respond to the first control operation in the first window according to the third operation data to generate a fifth execution result if the third operation data does not include the identification information.

On the basis of the above embodiment, the method further includes: a sixth executing module, configured to instruct the second window to stop responding if the fourth operation data does not include the identification information.

On the basis of the foregoing embodiment, the operation execution subunit is further configured to: if the third operation data contains the identification information, generating a control operation notification, wherein the control operation notification contains the identification information and the first control operation; the second object acquisition unit is specifically configured to: and acquiring fourth operation data recorded at the top of the stack in the second operation stack according to the control operation notification.

On the basis of the above embodiment, the information generating unit includes: a condition confirmation subunit, configured to confirm whether the second control operation satisfies a window linkage condition; and the identifier generating subunit is used for generating identifier information according to the second control operation if the window linkage condition is met.

On the basis of the above embodiment, the first listening module includes: the track acquisition unit is used for acquiring a touch track of the current touch operation in the first window; and the condition confirmation unit is used for determining that the first control operation is received if the touch track meets a preset track condition. Or, a trigger control is displayed in the first window, and the first monitoring module is specifically configured to: and when the trigger control is detected to receive the touch operation, determining that a first control operation is received.

On the basis of the above embodiment, the first window is located in the first screen, and the second window is located in the second screen.

On the basis of the above embodiment, the first window and the second window are located in the same screen.

On the basis of the above embodiment, the first control operation is a cancel operation.

The multi-window operation control device provided by the above can be used to execute the multi-window operation control method provided by the above first to second embodiments, and has corresponding functions and beneficial effects.

It should be noted that, in the embodiment of the multi-window operation control device, the included units and modules are only divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.

Example four

Fig. 10 is a schematic structural diagram of a multi-window operation control device according to a fourth embodiment of the present invention. In this embodiment, an example in which an intelligent interactive tablet is used as a multi-window operation control device is described. As shown in fig. 10, the smart interaction tablet 40 includes at least one processor 41, at least one network interface 42, a user interface 43, a memory 44, and at least one communication bus 45.

Wherein a communication bus 45 is used to enable the connection communication between these components.

The user interface 42 may comprise a display screen and a camera, and the optional user interface 43 may comprise a standard wired interface and a wireless interface. The number of the display screens may be at least one, and two are taken as examples in the embodiment.

The network interface 42 may optionally include a standard wired interface, a wireless interface (e.g., a Wi-Fi interface), among others.

Processor 41 may include one or more processing cores, among others. Processor 41 interfaces with various components throughout smart interaction panel 40 using various interfaces and lines to perform various functions of smart interaction panel 40 and to process data by executing or executing instructions, programs, code sets, or instruction sets stored within processor 41 and invoking data stored within memory 44. Alternatively, the processor 41 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable gate array (FPGA), and Programmable Logic Array (PLA). The processor 41 may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing contents required to be displayed by the display screens, and the two display screens can share the same GPU or each display screen corresponds to one GPU; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 41, but may be implemented by a single chip.

The Memory 44 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 44 includes a non-transitory computer-readable medium. The memory 44 may be used to store instructions, programs, code sets or instruction sets. The memory 44 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like; the storage data area may store data and the like referred to in the above respective method embodiments. The memory 44 may alternatively be at least one memory device located remotely from the aforementioned processor 41. As shown in fig. 10, the memory 44, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an operating application program of the smart interactive tablet.

In the smart interactive tablet 40 shown in fig. 10, the user interface 43 is mainly used for providing an input interface for a user to obtain data input by the user; and the processor 41 may be configured to call the operation application of the smart interactive tablet stored in the memory 44, and specifically perform the relevant operations in the multi-window operation control method in the above-described embodiment.

The intelligent interactive panel can be used for executing any multi-window operation control method, and has corresponding functions and beneficial effects.

In addition, the embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform operations related to the multi-window operation control method provided in any embodiment of the present application, and have corresponding functions and advantages.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product.

Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A multi-window operation control method, comprising:

receiving a first control operation acting on a first window;

2. The multi-window operation control method according to claim 1, wherein the second control operation acts on the first window;

receiving the second control operation;

3. The multi-window operation control method according to claim 2, wherein the displaying a first execution result of the first control operation in the first window and a second execution result of the first control operation in an associated second window comprises:

acquiring the third execution result according to the first control operation;

4. The multi-window operation control method according to claim 3, wherein the marking that the third execution result and the fourth execution result are associated results specifically is:

5. The multi-window operation control method according to claim 4, wherein the identification information is a globally unique identifier.

6. The multi-window operation control method according to claim 4, wherein the recording the third execution result, the third execution result corresponding to the identification information includes:

7. The multi-window operation control method according to claim 6, wherein the obtaining the third execution result according to the first control operation comprises:

if the third operation data contains identification information, executing the step of obtaining the fourth execution result which is the correlation result of the third execution result;

8. The multi-window operation control method according to claim 7, further comprising:

9. The multi-window operation control method according to claim 7, further comprising:

10. The multi-window operation control method according to claim 7, wherein the acquiring fourth operation data of a top-of-stack record in the second operation stack comprises:

11. The multi-window operation control method of claim 4, wherein the generating identification information according to the second control operation comprises:

12. The multi-window operation control method according to claim 1, wherein the receiving of the first control operation acting on the first window comprises:

acquiring a touch track of current touch operation in a first window;

13. The multi-window operation control method according to claim 1, wherein the first window is located in a first screen, and the second window is located in a second screen.

14. The multi-window operation control method according to claim 1, wherein the first window and the second window are located in the same screen.

15. The multi-window operation control method according to claim 1, wherein the first control operation is a cancel operation.

16. A multi-window operation control apparatus, comprising:

17. A multi-window operation control apparatus, characterized by comprising:

one or more processors;

a memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the multi-window operation control method of any of claims 1-15.

18. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a multi-window operation control method according to any one of claims 1 to 15.