CN110851066A - Method and device for supporting touch control of multiple display screens - Google Patents
Method and device for supporting touch control of multiple display screens Download PDFInfo
- Publication number
- CN110851066A CN110851066A CN201911018376.4A CN201911018376A CN110851066A CN 110851066 A CN110851066 A CN 110851066A CN 201911018376 A CN201911018376 A CN 201911018376A CN 110851066 A CN110851066 A CN 110851066A
- Authority
- CN
- China
- Prior art keywords
- display screen
- touch
- input
- operation window
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a method and a device for supporting touch control of multiple display screens, wherein the method comprises the following steps: displaying an operation window on a main display screen; the operation window corresponds to the auxiliary display screen; receiving a touch instruction on an operation window, and executing touch operation on an auxiliary display screen corresponding to the operation window according to the touch instruction; the auxiliary display screen is a display device which is distinguished from the main display screen, the main display screen and the auxiliary display screen are connected to the same processing system, and a touch screen is arranged above the main display screen. Through the technical scheme, when a user wants to perform touch operation on the auxiliary display screen, the user can perform the touch operation through the operation window on the operation main display screen, and the operation window corresponds to the auxiliary display screen, so that a touch instruction can be transmitted to the corresponding auxiliary display screen to be executed, the touch operation of each display screen is realized, and the sensory experience of the user is effectively improved on the basis of saving the cost.
Description
Technical Field
The invention relates to the field of computer input display, in particular to a method and a device for supporting touch control of multiple display screens.
Background
With the development of science and technology and the progress of society, mobile terminals are widely used and have more and more abundant functions. Taking Android equipment as an example, with the popularization of Android system equipment and the continuous improvement of hardware conditions, the requirements of various industries on the Android customization function become more and more complex, and the Android customization function is an important item for multi-screen touch operation.
For satisfying the in-service use needs, generally can be with external a plurality of display screens again on the basis of android device main display screen, however because only the below of main display screen is provided with the touch-sensitive screen, want to realize the touch operation of external vice display screen, just need also set up the touch-sensitive screen in each external vice display screen below equally, it is with high costs.
If the touch screen is not arranged below the auxiliary display screen, the touch operation function of the auxiliary display screen cannot be realized according to the mechanism of the conventional android system. As shown in fig. 10, a display id of a display screen corresponding to a touch screen is bound to an event reported by a driver of an existing android system touch screen, and a touch event (i.e., a touch event) is dispatched to a window in the corresponding display screen by a system touch input service (inputflicker) according to the display id, which results in that the touch event in the android system can only be fixedly sent to a window on one display screen. Because the external auxiliary display screen is outside the size range of the touch screen, and the display screen bound by the touch screen is defaulted to be the main display screen, the touch operation function on the auxiliary display screen cannot be realized, and a user cannot accurately and effectively perform click operation on the auxiliary display screen, so that the user experience is influenced.
Disclosure of Invention
Therefore, a technical scheme supporting multi-display screen touch is needed to be provided, so that the problems that the multiple display screens cannot support touch operation of the auxiliary display screen under the condition that only one touch screen is provided, the interactivity is poor, and poor sensory experience is brought to a user are solved.
To achieve the above object, the inventor provides a method for supporting multi-display touch, the method comprising:
displaying an operation window on a main display screen; the operation window corresponds to the auxiliary display screen;
receiving a touch instruction on an operation window, and executing touch operation on an auxiliary display screen corresponding to the operation window according to the touch instruction;
the auxiliary display screen is a display device which is distinguished from the main display screen, the main display screen and the auxiliary display screen are connected to the same processing system, and a touch screen is arranged above the main display screen.
Furthermore, the number of the operation windows is multiple, and each operation window corresponds to one sub display screen.
Furthermore, the number of the operation windows is N, the number of the auxiliary display screens is M, N and M are positive integers, and M is larger than N; the method comprises the following steps:
and receiving a screen switching instruction on the operation window, and switching the auxiliary display screen corresponding to the current operation window to the auxiliary display screen corresponding to the screen switching instruction.
Further, the value of N is 1.
Further, "receiving a screen switching instruction on the operation window" includes:
the operation window receives a first touch command and enters a state to be operated;
when the operation window in the state of waiting for operation receives a second touch control command, judging whether the second touch control command is matched with the preset touch control command, if so, adjusting the auxiliary display screen corresponding to the current operation window to the auxiliary display screen corresponding to the second touch control command according to the corresponding relation between the preset touch control command and the auxiliary display screen identification;
and the receiving interval time of the first touch command and the second touch command is within a preset interval time range.
Further, the method comprises:
and receiving an operation change instruction of an operation window displayed on a main display screen, and executing corresponding operation on the operation window according to the operation change instruction.
Further, the method comprises:
setting an input channel set; the set of input channels comprises a plurality of input channels;
setting a virtual input method application on at least one secondary display screen;
and each virtual input method application corresponds to one input channel, and the information input function is realized through the input channels.
Further, the method comprises:
and when the virtual input application is hidden or deleted on the secondary display screen, deleting the input channel corresponding to the virtual input application in the input channel set.
And when the virtual input application is displayed on the secondary display screen, saving the input channel corresponding to the virtual input application in the input channel set.
Further, the method comprises:
and modifying the display identification information corresponding to the input frame of the virtual input application displayed on the secondary display screen into the identification information of the main display screen or other secondary display screens, and refreshing the display interface to enable the input frame to be displayed on the modified main display screen or other secondary display screens.
The inventors also provide an apparatus supporting multi-display touch for performing the method as described in any of the preceding.
The method and the device for supporting multi-display screen touch control in the technical scheme comprise the following steps: displaying an operation window on a main display screen; the operation window corresponds to the auxiliary display screen; receiving a touch instruction on an operation window, and executing touch operation on an auxiliary display screen corresponding to the operation window according to the touch instruction; the auxiliary display screen is a display device which is distinguished from the main display screen, the main display screen and the auxiliary display screen are connected to the same processing system, and a touch screen is arranged above the main display screen. Through the technical scheme, when a user wants to perform touch operation on the auxiliary display screen, the user can perform touch operation through operating the operation window on the main display screen, and the touch instruction can be received and triggered because the touch screen is arranged below the main display screen, and the touch instruction can be transmitted to the corresponding auxiliary display screen to be executed because the operation window is corresponding to the auxiliary display screen, so that the touch operation of each display screen is realized, and the sensory experience of the user is effectively improved on the basis of saving the cost.
Drawings
FIG. 1 is a schematic flow chart of a system default input method working process according to the prior art;
FIG. 2 is a schematic flow chart of a multi-input method according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a set of input channels according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a method for supporting multiple input methods for multiple display screens according to an embodiment of the present invention;
FIG. 5 is a schematic flow chart of a method for supporting multiple display screens and multiple input methods according to an embodiment of the present invention;
FIG. 6 is a schematic flow chart illustrating an application of the input method to a sub-display according to an embodiment of the present invention;
FIG. 7 is a flowchart of a method for supporting multiple display screens and multiple input methods according to an embodiment of the present invention;
FIG. 8 is a diagram illustrating an apparatus for supporting multi-display touch control according to an embodiment of the present invention;
FIG. 9 is a flowchart illustrating a method for supporting multi-display touch control according to an embodiment of the present invention;
FIG. 10 is a schematic flow chart illustrating the processing of a multi-display single-touch-screen touch event according to the prior art;
FIG. 11 is a schematic flow chart illustrating the processing of a multi-display single-touch-screen touch event according to an embodiment of the present invention;
FIG. 12 is a schematic flowchart illustrating a multi-display single-touch-screen touch event processing according to another embodiment of the present invention.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Fig. 9 is a flowchart of a method for supporting multi-display touch according to an embodiment of the present invention. The method comprises the following steps:
firstly, entering a step S901 to display an operation window on a main display screen; the operation window corresponds to the auxiliary display screen;
then, step S902 is entered to receive a touch instruction on the operation window, and touch operation is executed on the auxiliary display screen corresponding to the operation window according to the touch instruction;
the auxiliary display screen is a display device which is distinguished from the main display screen, the main display screen and the auxiliary display screen are connected to the same processing system, and a touch screen is arranged above the main display screen.
Through the technical scheme, when a user wants to perform touch operation on the auxiliary display screen, the user can perform touch operation through operating the operation window on the main display screen, and the touch instruction can be received and triggered because the touch screen is arranged below the main display screen, and the touch instruction can be transmitted to the corresponding auxiliary display screen to be executed because the operation window is corresponding to the auxiliary display screen, so that the touch operation of each display screen is realized, and the sensory experience of the user is effectively improved on the basis of saving the cost.
In some embodiments, the number of the operation windows is multiple, and each operation window corresponds to one secondary display screen. Preferably, the size of the operation window is the size of the sub display screen after being scaled in equal proportion. The user can realize touch operation on the plurality of auxiliary display screens by performing touch operation on different operation windows. The plurality of operation windows can be freely arranged on the main display screen, and in order to prevent the display screen pointed by the touch event from being ambiguous, the display areas of the operation windows on the main display screen do not overlap.
In some embodiments, the number of the operation windows is N, the number of the secondary display screens is M, N and M are positive integers, and M is greater than N; the method comprises the following steps: and receiving a screen switching instruction on the operation window, and switching the auxiliary display screen corresponding to the current operation window to the auxiliary display screen corresponding to the screen switching instruction. In this embodiment, at least one operation window corresponding to two or more sub-display screens exists on the main display screen, and for such operation windows, switching of the corresponding sub-display screens needs to be involved, so that before touch operation of the sub-display screens is performed through the operation windows, the sub-display screens corresponding to the operation windows need to be corresponded to the target display screen. The target display screen is a display screen on which a touch command is to be executed, and switching of the target display screen is completed through a screen switching instruction. The screen switching instruction can be triggered by clicking or double clicking the screen, inputting a preset track to the screen, inputting gesture information and the like.
Preferably, the value of N is 1. In short, only one operation window may be displayed on the main display screen, the operation window corresponds to all the external sub-display screens, and the switching operation of each sub-display screen is realized through the screen switching instruction.
In some embodiments, "receiving a screen switch instruction on the operation window" includes: the operation window receives a first touch command and enters a state to be operated; when the operation window in the state of waiting for operation receives a second touch control command, judging whether the second touch control command is matched with the preset touch control command, if so, adjusting the auxiliary display screen corresponding to the current operation window to the auxiliary display screen corresponding to the second touch control command according to the corresponding relation between the preset touch control command and the auxiliary display screen identification; and the receiving interval time of the first touch command and the second touch command is within a preset interval time range.
The first touch command and the second touch command can be set in advance by a user, for example, the first touch command is a circle drawn in an operation window, the number of the auxiliary display screens corresponding to the operation window is 3, and the second touch command includes clicking the operation window once within 3s, clicking the operation window twice within 3s, and clicking the operation window 3 times within 3 s. In the using process, a user firstly circles in the operation window to enable the operation window to enter a state to be operated, and then clicks the operation window once within 3s, so that the auxiliary display screen corresponding to the current operation window is switched to be the auxiliary display screen A; if the user clicks the operation window twice within 3s, the auxiliary display screen corresponding to the current operation window is switched to be the auxiliary display screen B; and clicking the operation window for 3 times within 3s, and switching the auxiliary display screen corresponding to the current operation window into an auxiliary display screen C.
In certain embodiments, the method comprises: and receiving an operation change instruction of an operation window displayed on a main display screen, and executing corresponding operation on the operation window according to the operation change instruction. The operation change instruction includes, but is not limited to, zoom in, zoom out, hide display, delete, add, move, and the like. In this way, the user can arbitrarily adjust the operation window on the main display screen according to personal preference.
Fig. 11 is a schematic flow chart of touch event processing of a multi-display single-touch screen according to an embodiment of the present invention. The main display screen displays an auxiliary window (indicated by black fill in fig. 11, i.e., the aforementioned "operation window") which displays the contents of the sub-display screen N in real time. And covering the touch screen on the main display screen, and clicking the touch event of the black auxiliary window in the main display screen and the coordinate position of the touch point. And the system service records the position, width and height of the auxiliary window and the width, height and display id of the corresponding auxiliary display screen N. And modifying the InputREADER, and when detecting that the coordinate value of the touch event (the touch point of the touch event) is in the auxiliary window model, judging that the touch event is sent to the auxiliary display screen N corresponding to the auxiliary window. And modifying display id of the touch event to be N, so that the operation object of the touch instruction is switched from the main display screen to the auxiliary display screen N. And then, according to the width and the height of the secondary display screen N, the coordinate values of touch events are proportionally modified, namely the coordinate values of touch points received by the operation window are converted into the coordinate values of touch points to be subjected to touch operation on the secondary display screen N. The InputDispatcher distributes touch events to the secondary display screen N according to the display id and the converted coordinate values x and y.
As shown in fig. 12, fig. 12 is a schematic flowchart of a multi-display single-touch-screen touch event processing according to another embodiment of the present invention. In the actual use process, the user may send the touch event to the secondary display screen N by clicking the operation window (black area in fig. 12), or may trigger the touch event corresponding to the primary display screen by clicking an area outside the operation window. Therefore, the main display screen and the auxiliary display screen can synchronously perform touch operation, and the user experience is effectively improved.
In order to further expand the application scene range of the invention, the function that the existing multi-display screen touch device cannot input information simultaneously is met by setting a virtual input method.
Fig. 1 is a schematic flow chart of a working process of a default input method of a system according to the prior art. In the android system, an input box of each input method is an editnfo object, processing that the input box acquires or loses a focus corresponding to each touch key is realized in the object, the object comprises an InputConnection object (namely an input channel), and a default input method inputs characters to the input box through a commitText interface of the InputConnection.
As shown in fig. 1, there are 3 input boxes: input box a, input box B and input box C. The input box A is an operation window corresponding to the input method A, the input box B is an operation window corresponding to the input method B, and the input box C is an operation window corresponding to the input method C. The Input method, i.e., an Input method application program, is also called an Input method editor (english) and is software for realizing information Input on a display screen. The input information includes, but is not limited to, chinese characters, numbers, graphics, and the like.
Assuming that the input boxes A, B, C are all displayed on the main display screen, when the input box a obtains focus and the system default input method is set as input method a, the input method a obtains the system default input channel and the user inputs information through the input box a. When the input box B obtains the focus, the default input method of the system is set as the input method B, the input method B obtains the default input channel of the system, and the user inputs information through the input box B. When the input box C obtains the focus, the processing is similar, and the description is omitted here. The obtaining of the focus may be triggered by: when the selected element is clicked or touched by a mouse or positioned to the input box through a tab key, the input box obtains focus.
Because only one default input channel is provided in the system, the input channel is only allocated to the input box for obtaining the focus, even if the input method application is installed on the auxiliary display screen, the focus cannot be obtained, and therefore information input operation cannot be performed on the input box on the auxiliary display screen, multi-window synchronous input operation cannot be achieved, sensory experience of a user is affected, and the method and the device for inputting the information are designed for solving the problem.
As shown in fig. 7, the present application is further improved on the basis of supporting multi-display touch, so that the main display screen and the sub display screen can be compatible with synchronous input of information, and the method includes:
the process first proceeds to step S701 to set an input channel set. The input channel set includes a plurality of input channels.
Then, the process proceeds to step S702 to set up a virtual input method application on at least one secondary display screen. The auxiliary display screen is a display device which is distinguished from the main display screen, and the main display screen and each auxiliary display screen are connected with the same processing system; and each virtual input method application corresponds to one input channel, and the information input function is realized through the input channels.
As shown in fig. 2, the input applications A, B, C correspond to the input boxes A, B, C, respectively. The input box A, B, C is managed by a unified input channel set (i.e., an InputConnection dynamic set), which dynamically adds or deletes the InputConnection in the set according to the lifecycle of the input box. The virtual input method window obtains all InputConnectins corresponding to the input frames through a system interface, and then calls a commitText method of the connection to input characters. Specifically, as shown in fig. 3, an IMM (named as input method manager, i.e., an input channel set) dynamically stores all the input connections, and the system dynamically adds or deletes the input channel corresponding to the input frame in the set according to which of the sub display screen and the main display screen the input frame of the virtual input method is displayed or disappears.
According to the scheme, the dynamic control of the input method application on each auxiliary display screen is realized by setting the input channel set and virtually setting the input method application on the auxiliary display screen, and because the input method application on each auxiliary display screen is a system virtual input method rather than a system default input method, the input channels in the set can be called to carry out input operation, so that the synchronous input function of a plurality of input methods under multiple display screens is realized, and the user experience is effectively improved.
In certain embodiments, the method comprises: and when the virtual input application is hidden or deleted on the secondary display screen, deleting the input channel corresponding to the virtual input application in the input channel set. In other embodiments, the method comprises: and when the virtual input application is displayed on the secondary display screen, saving the input channel corresponding to the virtual input application in the input channel set.
In short, when an input box of the virtual input method is displayed on the secondary display screen, a channel corresponding to the input box is saved in the input channel set, and since the input box is allocated with input channels, the user can input corresponding information in the input box. When the input frame of the virtual input method is hidden or deleted on the auxiliary display screen, the channel corresponding to the input frame is correspondingly deleted from the input channel set, so that the dynamic adjustment of the input function of the input frame on the auxiliary display screen is realized. By adopting the scheme, the input function of the input box of the virtual input method is realized without depending on the switching of the focuses on the display screen, so that the synchronous input of the information of a plurality of input boxes on a plurality of display screens can be realized, and the user experience is greatly enhanced.
In certain embodiments, the method comprises: and modifying the identification information of the operation window corresponding to the virtual input application into the identification information of the auxiliary display screen where the virtual input application is located, and refreshing the display interface of the auxiliary display screen. The operation window of the virtual input application is the aforementioned "input box", the identification information of the operation window refers to the unique identifier of the input box, and the identification information of the secondary display screen refers to the unique identifier of the secondary display screen. In the actual application process, special processing may be performed on the custom window TYPE (virtualmethod _ TYPE) of the VIRTUAL input METHOD window in the system window service, the display ID value of the window is set to the corresponding screen ID (display ID), and the interface is refreshed.
For example, the main display screen is not provided with the input method, and the auxiliary display screen is provided with the virtual input method, so that the main display screen can also reuse the virtual input method on the auxiliary display screen. Specifically, when touch operation is detected on the main display screen, namely the main display screen obtains a focus, the display screen corresponding to the virtual input frame on the current auxiliary display screen is modified, and the virtual input frame is switched to the main display screen from the auxiliary display screen, so that the information input function of the main display screen is realized. And when the secondary display screen obtains the focus, the display screen corresponding to the virtual input frame is modified from the main display screen to the secondary display screen so as to realize the information input function on the secondary display screen.
In certain embodiments, the method comprises: and setting a virtual input method application or adopting a system default input method application on the main display screen. Preferably, the method comprises: and setting a virtual input method application on the main display screen, and allocating an input channel for the virtual input method application on the main display screen. The method comprises the following steps: adopting a system default input method application on the main display screen, and executing the following steps when detecting that a virtual input method application is arranged on the auxiliary display screen: the system default input method of the main window is not started.
In short, if no input box is set on the current secondary display, that is, the secondary display does not need to input information, the main display may continue to adopt the default input method of the system. If the input box is arranged on the current auxiliary display screen, that is, the information input is required on the auxiliary display screen, the main display screen can adopt either the input method or the virtual input method. When the main display screen adopts the virtual input method, the default main display screen does not adopt the system default input method, namely the input channel is not distributed according to the focus position any more, but the input function of the input box is realized through the correspondence between the input box and the input channel in the input channel set.
In certain embodiments, the method comprises: the virtual input method application receives input information and displays the input information. The input information may be chinese characters, numbers, characters, graphics, etc. The input boxes are in an inputtable state as long as the input channels corresponding to the input boxes are stored in the set, and when the input boxes of the auxiliary display screen are in the inputtable state, a user can synchronously input information through the input boxes on the auxiliary display screen, so that the synchronous input function of the input method under multiple display screens and multiple windows is realized.
In certain embodiments, the method comprises: receiving a window opening instruction, and additionally arranging one or more sub-windows on the auxiliary display screen; and adding the virtual input method application on the added child window, and allocating an input channel for the added virtual input method application. The input channel corresponding to the virtual input method application (hereinafter referred to as "virtual input method") is stored in the input channel set, and then the input channel set can be dynamically adjusted according to the display state of the virtual input method application on the secondary display screen. In short, a processing system may be connected to a plurality of sub-display screens in addition to a main display screen, each sub-display screen may be provided with one sub-window or a plurality of sub-windows, each sub-window may be independently configured to receive different input information, each sub-window corresponds to an input box, each input box corresponds to an input channel in a set, and an information input function on each sub-window may be implemented through the input channels.
As shown in fig. 4, for the android system, the interface of each app displayed on the display screen, the window of the input method, the dialog box, and the essence in the status bar are windows. In a system window display mechanism, each window has a variable displayID, each screen has a unique identification ID (i.e., displayID), and each window is displayed on the corresponding screen according to its corresponding variable displayID. Therefore, when only one input method is provided, the variable displayID corresponding to the input box can be modified according to the position of the focal point on the current display screen, so that the input box can be switched and displayed between the main display screen and the auxiliary display screen.
As shown in fig. 5, a detailed flow chart for implementing the functions shown in fig. 4 is shown. First, the input box pops up the input method window, and at the same time, the system calls addWindow of the window service WMS. And then entering an addWindow processing flow, wherein in a normal condition, the display ID of the input method window is set to be 0 (main display screen ID) by default in the addWindow processing service, and the display width and the height of the main display screen are given to the window as other details such as drawing reference and the like. When the display ID of the window where the input frame corresponding to the input method window is located is judged to be the secondary display screen ID, the display ID of the input method window is modified to be the secondary display screen ID, and the display width and the height of the primary display screen are set to be other details such as drawing reference and the like, namely the size of the primary display screen and the size of the secondary display screen are possibly inconsistent, and in order to ensure that the display positions of the input frames when the input frames are switched in the primary display screen and the secondary display screen are relatively consistent, coordinate conversion is required to be carried out according to the display positions of the input frames on the primary display screen, so that the display positions of the input frames on the secondary display screen are also relatively consistent.
As shown in fig. 6, the display flow of the virtual input box on the secondary display screen is shown. When the input box needs to display the virtual input method window, the system firstly calls addWindow of the window service WMS and starts an addWindow processing flow. When the TYPE of the input METHOD window is judged to be the self-defined VIRTUAL _ METHOD _ TYPE, setting display of the window to be 1 (namely, display id of the auxiliary display screen), and setting display width and height of the auxiliary display screen to the window to serve as drawing reference and other details.
Fig. 8 is a schematic diagram of an apparatus for supporting multi-display touch according to an embodiment of the invention. The apparatus is for performing the method as described hereinbefore. The device comprises a main display screen 101 and one or more auxiliary display screens 102, and a processing system 103, wherein the processing system 103 is connected with the main display screen 101 and each auxiliary display screen 102.
The main display screen and the auxiliary display screen are electronic elements with display functions, and can be AMOLED display screens, LCD liquid crystal display screens, micro light-emitting diode display screens, quantum dot display screens or electronic ink display screens. Of course, the user may also trigger the touch event by other means, such as pressing a button, remote controlling, and the like. The processing system comprises a processor, wherein the processor is an electronic element with a data processing function and can be a Central Processing Unit (CPU), a Microprocessor (MCU) and the like.
The invention provides a method and a device for supporting touch control of multiple display screens, wherein the method comprises the following steps: displaying an operation window on a main display screen; the operation window corresponds to the auxiliary display screen; receiving a touch instruction on an operation window, and executing touch operation on an auxiliary display screen corresponding to the operation window according to the touch instruction; the auxiliary display screen is a display device which is distinguished from the main display screen, the main display screen and the auxiliary display screen are connected to the same processing system, and a touch screen is arranged above the main display screen. Through the technical scheme, when a user wants to perform touch operation on the auxiliary display screen, the user can perform the touch operation through the operation window on the operation main display screen, and the operation window corresponds to the auxiliary display screen, so that a touch instruction can be transmitted to the corresponding auxiliary display screen to be executed, the touch operation of each display screen is realized, and the sensory experience of the user is effectively improved on the basis of saving the cost.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present patent.
Claims (10)
1. A method for supporting multi-display touch control, the method comprising:
displaying an operation window on a main display screen; the operation window corresponds to the auxiliary display screen;
receiving a touch instruction on an operation window, and executing touch operation on an auxiliary display screen corresponding to the operation window according to the touch instruction;
the auxiliary display screen is a display device which is distinguished from the main display screen, the main display screen and the auxiliary display screen are connected to the same processing system, and a touch screen is arranged above the main display screen.
2. The method for supporting multi-display touch as claimed in claim 1, wherein the number of the operation windows is plural, and each operation window corresponds to one sub-display.
3. The method for supporting multi-display touch as claimed in claim 1, wherein the number of the operation windows is N, the number of the sub-displays is M, N and M are positive integers, and M is greater than N; the method comprises the following steps:
and receiving a screen switching instruction on the operation window, and switching the auxiliary display screen corresponding to the current operation window to the auxiliary display screen corresponding to the screen switching instruction.
4. The method of supporting multi-display touch as claimed in claim 3, wherein the value of N is 1.
5. The method for supporting multi-display touch as claimed in claim 3, wherein the receiving a screen switching command on the operation window comprises:
the operation window receives a first touch command and enters a state to be operated;
when the operation window in the state of waiting for operation receives a second touch control command, judging whether the second touch control command is matched with the preset touch control command, if so, adjusting the auxiliary display screen corresponding to the current operation window to the auxiliary display screen corresponding to the second touch control command according to the corresponding relation between the preset touch control command and the auxiliary display screen identification;
and the receiving interval time of the first touch command and the second touch command is within a preset interval time range.
6. The method for supporting multi-display touch as claimed in any one of claims 1 to 5, wherein the method comprises:
and receiving an operation change instruction of an operation window displayed on a main display screen, and executing corresponding operation on the operation window according to the operation change instruction.
7. The method of supporting multi-display touch as recited in claim 1, wherein the method comprises:
setting an input channel set; the set of input channels comprises a plurality of input channels;
setting a virtual input method application on at least one secondary display screen;
and each virtual input method application corresponds to one input channel, and the information input function is realized through the input channels.
8. The method of supporting multi-display touch as recited in claim 7, wherein the method comprises:
when the virtual input application is hidden or deleted on the secondary display screen, deleting the input channel corresponding to the virtual input application in the input channel set;
and when the virtual input application is displayed on the secondary display screen, saving the input channel corresponding to the virtual input application in the input channel set.
9. The method of supporting multi-display touch as recited in claim 7, wherein the method comprises:
and modifying the display identification information corresponding to the input frame of the virtual input application displayed on the secondary display screen into the identification information of the main display screen or other secondary display screens, and refreshing the display interface to enable the input frame to be displayed on the modified main display screen or other secondary display screens.
10. An apparatus for supporting multi-display touch, the apparatus being adapted to perform the method of any of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911018376.4A CN110851066B (en) | 2019-10-24 | 2019-10-24 | Method and device for supporting touch control of multiple display screens |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911018376.4A CN110851066B (en) | 2019-10-24 | 2019-10-24 | Method and device for supporting touch control of multiple display screens |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110851066A true CN110851066A (en) | 2020-02-28 |
| CN110851066B CN110851066B (en) | 2021-12-10 |
Family
ID=69597922
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911018376.4A Active CN110851066B (en) | 2019-10-24 | 2019-10-24 | Method and device for supporting touch control of multiple display screens |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110851066B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012044765A2 (en) * | 2010-10-01 | 2012-04-05 | Imerj LLC | Allowing multiple orientation in dual screen view |
| CN105549876A (en) * | 2015-12-04 | 2016-05-04 | 小米科技有限责任公司 | Method and apparatus for performing input in input box |
| CN107450830A (en) * | 2017-07-19 | 2017-12-08 | 福州瑞芯微电子股份有限公司 | The method and apparatus that a kind of single screen multiwindow supports Random seismic field simultaneously |
| CN109032485A (en) * | 2018-07-10 | 2018-12-18 | 广州视源电子科技股份有限公司 | Display method and device, electronic equipment, intelligent panel and storage medium |
| CN109901760A (en) * | 2019-01-21 | 2019-06-18 | 维沃移动通信有限公司 | A kind of object control method and terminal device |
-
2019
- 2019-10-24 CN CN201911018376.4A patent/CN110851066B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012044765A2 (en) * | 2010-10-01 | 2012-04-05 | Imerj LLC | Allowing multiple orientation in dual screen view |
| CN105549876A (en) * | 2015-12-04 | 2016-05-04 | 小米科技有限责任公司 | Method and apparatus for performing input in input box |
| CN107450830A (en) * | 2017-07-19 | 2017-12-08 | 福州瑞芯微电子股份有限公司 | The method and apparatus that a kind of single screen multiwindow supports Random seismic field simultaneously |
| CN109032485A (en) * | 2018-07-10 | 2018-12-18 | 广州视源电子科技股份有限公司 | Display method and device, electronic equipment, intelligent panel and storage medium |
| CN109901760A (en) * | 2019-01-21 | 2019-06-18 | 维沃移动通信有限公司 | A kind of object control method and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110851066B (en) | 2021-12-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109164964B (en) | Content sharing method and device, terminal and storage medium | |
| US10915284B2 (en) | Multi-monitor full screen mode in a windowing environment | |
| CN103425431A (en) | Mobile terminal and method for achieving multi-window operation | |
| WO2017113624A1 (en) | System and method for operating system of mobile device | |
| JP2005321972A (en) | Information processor, processing method for information processor, and processing program for information processor | |
| KR20130081503A (en) | Display apparatus and control method thereof | |
| CN110865763A (en) | Method and device for supporting multi-screen multi-input method application | |
| CN110865718A (en) | Method and device for supporting application of input method to multi-screen switching | |
| KR102326766B1 (en) | Display device and method of indicating selected at least one of keys | |
| KR20160086645A (en) | Display apparatus and the controlling method thereof | |
| JP5025230B2 (en) | Multi-monitor monitoring control apparatus and process monitoring control system using the same | |
| WO2020253282A1 (en) | Item starting method and apparatus, and display device | |
| US7212210B2 (en) | Method and apparatus for enlarging an output display on a display | |
| CN110851066B (en) | Method and device for supporting touch control of multiple display screens | |
| WO2021039680A1 (en) | Information processing system and information processing method | |
| TW201514832A (en) | System and method for adjusting image display | |
| CN113360228A (en) | Screen display control method and device, electronic equipment and storage medium | |
| CN113064567A (en) | Multi-screen-based control method and device | |
| CN113467866A (en) | Processing method and device | |
| CN110928617A (en) | Method and device for switching component elements among multiple display screens | |
| CN110908748A (en) | Method and device for supporting single-screen multi-input method application | |
| KR20180037155A (en) | Method and apparatus of controlling display using control pad, and server that distributes computer program for executing the method | |
| KR101423234B1 (en) | Method of producing and real time size canging method of menu button of marking progeam for electronic board | |
| CN114281284B (en) | Display apparatus and image display method | |
| US20240163516A1 (en) | Live streaming interface display method, device, apparatus, storage medium and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province Applicant after: Ruixin Microelectronics Co., Ltd Address before: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province Applicant before: FUZHOU ROCKCHIP ELECTRONICS Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |