CN103399640A - Method and device for controlling according to user gesture and client - Google Patents
Method and device for controlling according to user gesture and client Download PDFInfo
- Publication number
- CN103399640A CN103399640A CN201310359109XA CN201310359109A CN103399640A CN 103399640 A CN103399640 A CN 103399640A CN 201310359109X A CN201310359109X A CN 201310359109XA CN 201310359109 A CN201310359109 A CN 201310359109A CN 103399640 A CN103399640 A CN 103399640A
- Authority
- CN
- China
- Prior art keywords
- gesture
- user
- coverage diagram
- current window
- motion track
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a method, a device and a client for controlling according to user gestures, which are invented for not influencing the playing and rendering of a browser to a dynamic object, and the method for controlling according to the user gestures comprises the following steps: detecting whether a user gesture input exists; when detecting that a user gesture is input, creating an overlay layer covering a current window; acquiring a moving track of a user gesture on an overlay layer; and controlling the current window according to the moving track. The embodiment of the invention can be used in the control technology of the browser.
Description
Technical field
The present invention relates to field of computer technology, relate in particular to a kind of method, device and client of controlling according to user's gesture.
Background technology
By the browser browsing pages, become the pith of information age people lives, but, the mode of tradition browsing pages is passive stiff, the user mainly (for example passes through mouse or touch pad, the touch pad of notebook computer) etc. click corresponding page link, or the input network address is browsed the own interested page in address field.
In addition, the user pins left mouse button or touch pad pulls the scroll bar of page side that the page is rolled up or down, and to realize page turning up or down, still, the scroll bar on the page is narrower usually, is inconvenient to control, and the user uses inconvenience.In addition, in the time need between the page of the page of running background and current active, switching, the user need use mouse or touch pad to click the page of running background, with the page by running background, switch to the page of current active, handoff procedure is more inflexible, easily causes maloperation, poor user experience.
For above-mentioned, by mouse, click or the problem of touch pad passive stiff, poor user experience while touching browsing pages, at present, propose a kind of method of using mouse gestures to operate, need not use mouse to click and confirm, as long as utilize mouse to complete specific gesture, can reach operating effect.The problem that exists at present is that the use mouse gestures affects browser to the broadcasting of dynamic object and plays up while operating, and has a strong impact on the result of broadcast of dynamic object in browser (as video, flash animation), in addition, also easily causes maloperation.
Summary of the invention
The present invention is intended to one of solve the problems of the technologies described above at least.
For this reason, first purpose of the present invention is to propose a kind of method of controlling according to user's gesture.The method does not affect application program to the broadcasting of dynamic object and plays up, and promotes the user and experiences.
Second purpose of the present invention is to propose a kind of device of controlling according to user's gesture.
The 3rd purpose of the present invention is to propose a kind of client.
To achieve these goals, the method for controlling according to user's gesture of first aspect present invention embodiment, be applied to the browser field, comprises the following steps: detect whether the input of user's gesture is arranged; When the input of user's gesture having been detected, create the coverage diagram layer that covers current window; Obtain the motion track of described user's gesture in described coverage diagram layer; And according to described motion track, described current window is controlled.
the method of controlling according to user's gesture according to the embodiment of the present invention, generate the coverage diagram layer to cover current window, drawing image on the coverage diagram layer, but executable operations on current window, thus, the video of playing in the page of application program (for example browser), the dynamic objects such as flash animation not there will be the top set (namely can be at video, on flash etc., carry out setting-out) and dodge the phenomenon of shielding, do not affect the normal play of the dynamic object such as in progress video and flash on the application program page, do not affect application program to the broadcasting of dynamic object and play up, promoting the user experiences, in addition, the use coverage diagram layer transparent with respect to current window significantly promotes the performance that has complicated shape and various effect of visualization (as animation, translucent effect), and the user can draw by mouse abundant motion track in the coverage diagram layer, promote the user and experience, enrich control method.
To achieve these goals, the device of controlling according to user's gesture of second aspect present invention embodiment, be applied to the browser field, comprising: monitoring modular, for detection of whether the input of user's gesture is arranged; Coverage diagram layer-management module, for when the input of user's gesture having been detected, create the coverage diagram layer that covers current window; Acquisition module, for obtaining the motion track of described user's gesture at described coverage diagram layer; And the current window control module, for according to described motion track, described current window being controlled.
the device of controlling according to user's gesture according to the embodiment of the present invention, generate the coverage diagram layer to cover current window, drawing image on the coverage diagram layer, but executable operations on current window, thus, the video of playing in the page of application program (for example browser), the dynamic objects such as flash animation not there will be the top set (namely can be at video, on flash etc., carry out setting-out) and dodge the phenomenon of shielding, do not affect the normal play of the dynamic object such as in progress video and flash on the application program page, do not affect application program to the broadcasting of dynamic object and play up, promoting the user experiences, in addition, the use coverage diagram layer transparent with respect to current window significantly promotes the performance that has complicated shape and various effect of visualization (as animation, translucent effect), and the user can draw by mouse abundant motion track in the coverage diagram layer, promote the user and experience, enrich control method.
To achieve these goals, the client of third aspect present invention embodiment comprises: shell, screen, processor, processor and circuit board; Described screen is placed on described shell, and described circuit board is placed in the interior volume that described shell surrounds, and described processor and described storer are arranged on described circuit board; Described storer is for the stores executable programs code; Described processor moves the program corresponding with described executable program code by reading the executable program code of storing in described storer, with for: detect whether the input of user's gesture is arranged; When the input of user's gesture having been detected, create the coverage diagram layer that covers current window; Obtain the motion track of described user's gesture in described coverage diagram layer; And according to described motion track, described current window is controlled.
Client according to the embodiment of the present invention, generate the coverage diagram layer to cover current window, drawing image on the coverage diagram layer, but executable operations on current window, thus, when the dynamic objects such as the video of playing in the page of application program (such as browser), flash animation not there will be top set (namely can not carry out setting-out on video, flash etc.) and dodge the phenomenon of shielding, do not affect the normal play of the dynamic object such as in progress video and flash on the application program page, do not affect application program to the broadcasting of dynamic object and play up, promoting the user and experience; In addition, the use coverage diagram layer transparent with respect to current window significantly promotes the performance that has complicated shape and various effect of visualization (as animation, translucent effect), and the user can draw by mouse abundant motion track in the coverage diagram layer, promote the user and experience, enrich control method.
The aspect that the present invention adds and advantage part in the following description provide, and part will become obviously from the following description, or recognize by practice of the present invention.
The accompanying drawing explanation
Above-mentioned and/or the additional aspect of the present invention and advantage will become from the following description of the accompanying drawings of embodiments and obviously and easily understand, wherein,
Fig. 1 is the process flow diagram of the method controlled according to user's gesture according to an embodiment of the invention;
Fig. 2 is the process flow diagram of the method controlled according to user's gesture in accordance with another embodiment of the present invention;
Fig. 3 is the process flow diagram of the method for controlling according to user's gesture of another embodiment according to the present invention;
Fig. 4 (a) is a kind of illustrative diagram that plane space is divided into to eight zones of the embodiment of the present invention;
Fig. 4 (b) is a kind of illustrative diagram of motion track of the mouse of the embodiment of the present invention;
Fig. 5 is the structured flowchart of the device controlled according to user's gesture according to an embodiment of the invention;
Fig. 6 is the structured flowchart of the device controlled according to user's gesture in accordance with another embodiment of the present invention; And
Fig. 7 is the structured flowchart of the device of controlling according to user's gesture of another embodiment according to the present invention.
Embodiment
Below describe embodiments of the invention in detail, the example of described embodiment is shown in the drawings, and wherein same or similar label represents same or similar element or the element with identical or similar functions from start to finish.Below by the embodiment that is described with reference to the drawings, be exemplary, only be used to explaining the present invention, and can not be interpreted as limitation of the present invention.On the contrary, embodiments of the invention comprise spirit and interior all changes, modification and the equivalent of intension scope that falls into additional claims.
In description of the invention, it will be appreciated that, term " first ", " second " etc. are only be used to describing purpose, and can not be interpreted as indication or hint relative importance.In description of the invention, it should be noted that, unless otherwise clearly defined and limited, term " is connected ", " connection " should do broad understanding, for example, can be to be fixedly connected with, and can be also to removably connect, or connects integratedly; Can be mechanical connection, can be also to be electrically connected to; Can be directly to be connected, also can indirectly be connected by intermediary.For the ordinary skill in the art, can concrete condition understand above-mentioned term concrete meaning in the present invention.In addition, in description of the invention, except as otherwise noted, the implication of " a plurality of " is two or more.
In process flow diagram or in this any process of otherwise describing or method, describe and can be understood to, expression comprises one or more module, fragment or part be used to the code of the executable instruction of the step that realizes specific logical function or process, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can be not according to order shown or that discuss, comprise according to related function by the mode of basic while or by opposite order, carry out function, this should be understood by the embodiments of the invention person of ordinary skill in the field.
Method, device and the client controlled according to user's gesture of the embodiment of the present invention are described below with reference to accompanying drawing.
When application program for example uses in browser mouse gestures to operate, namely use mouse " picture " to go out specific motion track to carry out corresponding command operation, need on the page of application program, describe the motion track of mouse.When describing motion track, directly on current page, to carry out screenshotss, stop screen depict motion track, the method affects application program to the broadcasting of dynamic object (as the flash animation) and plays up, if flash is arranged in application program, during screenshotss, will cause flash to become static state, namely the image around motion track can stop playing.
In fact, while drawing the motion track of mouse, screen is carried out to screenshotss, the figure layer of drawing motion track is exactly the figure layer that current dynamic flash plays, image around the motion track of the mouse during drafting in this flash broadcasting figure layer is fixed, situation perhaps occurs flashing, have a strong impact on result of broadcast.In addition, when watching video, while using right mouse button to draw motion track, easily cause and maloperation can trigger the operation to video, namely allow to again reduce, the video during maloperation also may miss.For this reason, propose a kind of method of controlling according to user's gesture, while drawing the motion track of mouse, reset a layering, mouse gestures operates and draws on independent window.
Fig. 1 is the process flow diagram of the method controlled according to user's gesture according to an embodiment of the invention.As shown in Figure 1, the method for controlling according to user's gesture comprises the following steps.
S101, whether monitoring has the input of user's gesture.
particularly, in one embodiment of the invention, user's gesture is by mouse or touch pad or touch control display screen input, user's gesture refer to the user by mouse or touch pad or touch control display screen input with controlling application program, complete corresponding operating the time a series of actions, for example, at PC(personal computer, personal computer) the upper mouse input user gesture of using, perhaps on individual notebook, by mouse or on touch pad, input user's gesture, perhaps on mobile terminal by touch control display screen on input user gesture, in a word, the user can use any input equipment input user gesture, and for example, user's gesture can be to press the motion track that certain key of mouse draws, it can be also motion track drawing at touch pad of user etc.
S102, when the user having been detected and input gesture, create the coverage diagram layer that covers current window.
In one embodiment of the invention, the coverage diagram layer is transparent with respect to current window for the coverage diagram layer.Wherein, with respect to the transparent all-transparent that can be of current window, but namely the user sees in application program only has current window, coverage diagram layer user to cannot see physical presence, thus, can make the coverage diagram layer not affect the demonstration of current window, promotes the user and experiences; Perhaps, with respect to current window is transparent, can be transparently in proportion, for example translucent, the user can also arrange corresponding transparent proportional, thus, gives the user prompting, and the prompting user carries out the mouse gestures operation in the coverage diagram layer, promote the user and experience.
In one embodiment of the invention, the size of coverage diagram layer is identical with current window.Should be understood that, the size of coverage diagram layer also can be set as required, for example, can arrange less than current window.
S103, obtain the motion track of user's gesture in the coverage diagram layer.
S104, control current window according to motion track.
For example, according to motion track, can realize the related command of the current window of application program, as, advance, retreat, refresh etc.
In one embodiment of the invention, further comprising the steps of: as in the coverage diagram layer, to show motion track.Wherein, the demonstration motion track can be showed the gesture that the user carries out intuitively, visually in the coverage diagram layer, promotes the user and experiences.
the method of controlling according to user's gesture according to the embodiment of the present invention, generate the coverage diagram layer to cover current window, drawing image on the coverage diagram layer, but executable operations on current window, thus, the video of playing in the page of application program (for example browser), the dynamic objects such as flash animation not there will be the top set (namely can be at video, on flash etc., carry out setting-out) and dodge the phenomenon of shielding, do not affect the normal play of the dynamic object such as in progress video and flash on the application program page, do not affect application program to the broadcasting of dynamic object and play up, promoting the user experiences, in addition, the use coverage diagram layer transparent with respect to current window significantly promotes the performance that has complicated shape and various effect of visualization (as animation, translucent effect), and the user can draw by mouse abundant motion track in the coverage diagram layer, promote the user and experience, enrich control method.
When the input of user's gesture having been detected, also need user's gesture is screened.Fig. 2 is the process flow diagram of the method controlled according to user's gesture in accordance with another embodiment of the present invention.Particularly, as shown in Figure 2, the method for controlling according to user's gesture comprises the following steps.
S201, whether monitoring has the input of user's gesture.
S202, when the user having been detected and input gesture, whether user's gesture that judgement detects meets default gesture.
S203, if meet default gesture, create the coverage diagram layer that covers current window.
Wherein, default gesture is corresponding with input equipment.For example, if use mouse input user gesture, whether user's gesture of judgement input is to press default mouse button, such as whether being right button etc., if press right mouse button, create the coverage diagram layer that covers current window, or whether user's gesture of judgement input is to press the default default track of mouse button slip.And for example, if on touch pad or touch display screen curtain, pre-define default gesture, if the default gesture that meets definition of user's input creates the coverage diagram layer that covers current window.Should be appreciated that default gesture mainly plays the effect that creates the coverage diagram layer that covers current window, prevents maloperation.
Should be appreciated that to start by other means to create the coverage diagram layer that covers current window, for example, by some function key of lower keyboard, also create the coverage diagram layer of covering current window, and for example, while being arranged to start application program, send enabled instruction etc.
S204, obtain the motion track of user's gesture in the coverage diagram layer.
S205, control current window according to motion track.
S206, if do not meet default gesture, control current window according to user's gesture.
In one embodiment of the invention, further comprising the steps of: as in the coverage diagram layer, to show motion track.Wherein, the demonstration motion track can be showed the gesture that the user carries out intuitively, visually in the coverage diagram layer, promotes the user and experiences.
According to the method for controlling according to user's gesture of the embodiment of the present invention, by default gesture, user's gesture is screened, while meeting default gesture, just can create the effect of the coverage diagram layer that covers current window, prevent maloperation.
In one embodiment of the invention, the coverage diagram layer generates by the browser host process, and motion track is drawn in the coverage diagram layer by the browser host process.
In one embodiment of the invention, the browser host process is obtained motion track by the window process of current window.
particularly, at first the browser host process receives enabled instruction, the browser host process generates the coverage diagram layer according to user's gesture of user's input afterwards, while in the coverage diagram layer, carrying out mouse or gesture slide, the coverage diagram layer does not receive mouse action or gesture slip message, mouse action or gesture slip message directly see through goes the current window that is covered by the coverage diagram layer to receive, after current window receives mouse action or gesture slip message, this mouse action or gesture slip message are sent to the browser host process, the browser host process is obtained corresponding motion track, and motion track is plotted in the coverage diagram layer.
Thus, by current window, receive mouse action or gesture slip message, the coverage diagram layer is receipt message not, mouse or gesture slip message directly see through and go to be received by the current window under the coverage diagram layer, then the browser host process shows motion track according to mouse or gesture slide again in the coverage diagram layer, continuous top set or the phenomenon of dodging screen in the time of can avoiding on the dynamic objects such as in progress video, flash setting-out, occur, promote the user and experience; In addition, motion track can present smoothly in the coverage diagram layer, not there will be scintillation.
More specifically, in order to create the coverage diagram layer, creating Microsft Windows function of CreateWindowEx(, for creating eclipsed form window, pop-up window or a subwindow with expansion style) time specify expansion forms style WS_EX_LAYERED(Microsft Windows extended attribute, realize the window transparence), or use Microsft Windows function of SetWindowLong(after creating the coverage diagram layer, and be used to changing the attribute of specified window) function setup WS_EX_LAYERED.After CreateWindowEx calls, the coverage diagram layer can not be visible at once, need the coverage diagram layer to call Microsft Windows function of SetLayeredWindowAttributes(, for transparent window is set) or UpdateLayeredWindow function (a Microsft Windows function, be used to realizing transparent window).The coverage diagram layer is transparent, does not receive drawing onpaint message, and mouse or gesture slip message directly see through the current window that goes by the browser that covers and receives.
In the described embodiment of above-mentioned any one, need to judge user's gesture: judgement user gesture is clicking operation or motion track.In one embodiment of the invention, detect and whether have the input of user's gesture specifically to comprise the following steps: the displacement of obtaining user's gesture; Judge that whether displacement is greater than default displacement; And if, greater than default displacement, define the input of user's gesture.Particularly, default displacement can be the Minimum sliding distance of user's setting or system default, the position coordinates of pressing gesture from the user is counted, (for example catch the displacement of user's gesture, can follow the tracks of mouse position etc.), when displacement, during greater than default displacement, think move operation, otherwise think clicking operation.Can prevent maloperation thus.
Fig. 3 is the process flow diagram of the method for controlling according to mouse gestures of another embodiment according to the present invention.According to motion track, can obtain corresponding control command, and according to control command, current window be controlled, particularly, as shown in Figure 3, the method for controlling according to mouse gestures comprises the following steps.
S301, whether monitoring has the input of user's gesture.
S302, when the user having been detected and input gesture, whether user's gesture that judgement detects meets default gesture.
S303, if meet default gesture, create the coverage diagram layer that covers current window.
S304, obtain the motion track of user's gesture in the coverage diagram layer.
S305, control current window according to motion track, and show motion track in coverage diagram layer figure layer.
S306, obtain corresponding control command according to motion track, and according to control command, current window controlled.
S307, if do not meet default gesture, control current window according to user's gesture.
Particularly, at first, according to motion track judgement gesture-type, gesture-type comprises upwards, waits left, left and to the right, concrete determination methods can be: as shown in Figure 4 (a), plane space is divided into to eight zones, using the starting point of motion track as initial point, when motion track was interior in zone 1 and 2, judgement motion track direction was for making progress; When motion track was interior in zone 3 and 4, the direction of judgement motion track was for to the right; In 5 and 6 whens zone of zone, the judgement motion track is downward when motion track; When motion track was interior in zone 7 and 8, the judgement motion track was for left; Two motion tracks as shown in Figure 4 (b), according to above-mentioned determination methods, motion track 1 be first downwards after to the right, motion track 2 is downward.
Then, according to the corresponding operation of gesture-type response, for example, upwards, page turning downwards, forward, the switching activity page, the page advance and retreat etc. backward.
As, with mouse, be input as example, when pinning the downward setting-out of right mouse button, while unclamping mouse, the downward page turning of the current page that is moving; When pinning right mouse button and make progress setting-out, while unclamping mouse, the page turning that makes progress of the current page that is moving; When pinning right mouse button setting-out left, while unclamping mouse, current page retreats into the last layer page; When pinning right mouse button setting-out to the right, while unclamping mouse, current page advances to lower one deck page; When pinning right mouse button and upwards turn round to the right again, the page at running background that will be positioned at current active page left side switches to loose-leaf; When pinning right mouse button and upwards turn round left again, while unclamping mouse, the page at running background that will be positioned at current active page right side switches to loose-leaf, when pinning right mouse button, turns round to the right downwards, while unclamping mouse, closes current page etc.
Should be appreciated that example shown in Figure 4 is only for illustrating, in the control procedure of reality, more abundant control command can also be set and control, mouse action can with the corresponding understanding of gesture slide.
In one embodiment of the invention, above-mentioned page turning or the switching page operate in mouse-up the time respond.
The method of controlling according to user's gesture according to the embodiment of the present invention, the page by judgement motion track application programs is carried out corresponding operation, avoided the maloperation that causes by clicking the mouse, during as the switching between the page at the current active page and running background, when point is to X button and page close because of carelessness, need to reopen page link, cause unnecessary trouble, promote the user and experience.
In one embodiment of the invention, adopt GDI(Graphics Device Interface, Graphics Device Interface)+basic spline that provides shows motion track in the coverage diagram layer.The main task of GDI is the message exchange of being responsible between computer system and plotter program, processes the figure output of all desktop programs; Basic spline is a succession of independent curve, and these curves couple together and form a larger curve, and batten is specified by array and the tension parameters of point, and cardinal spline is passed through each point in array smoothly; On the steepness of curve, there is no wedge angle and unexpected variation.
Thus, the motion track of demonstration is smoother, and motion track is shown in covering forms, and the user can see current operation intuitively, image, directly perceived.
In one embodiment of the invention, application program can be browser.Should be understood that, the described method of controlling according to mouse gestures of any one embodiment of the present invention not only can realize on browser, can also be in a kind of operating system of windows(Microsoft exploitation) any application program can be according to can the described method of controlling according to mouse gestures of the embodiment of the present invention realizing that gesture controls in platform.
In order to realize above-described embodiment, the present invention also proposes a kind of device of controlling according to user's gesture.
Fig. 5 is the structured flowchart of the device controlled according to user's gesture according to an embodiment of the invention.As shown in Figure 5, the device of controlling according to user's gesture comprises: monitoring modular 100, coverage diagram layer-management module 200, acquisition module 300 and current window control module 400.
Particularly, monitoring modular 100 is for detection of whether the input of user's gesture is arranged.in one embodiment of the invention, user's gesture is by mouse or touch pad or touch control display screen input, user's gesture refer to the user by mouse or touch pad or touch control display screen input with controlling application program, complete corresponding operating the time a series of actions, for example, at PC(personal computer, personal computer) the upper mouse input user gesture of using, perhaps on individual notebook, by mouse or on touch pad, input user's gesture, perhaps on mobile terminal by touch control display screen on input user gesture, in a word, the user can use any input equipment input user gesture, and for example, user's gesture can be to press the motion track that certain key of mouse draws, it can be also motion track drawing at touch pad of user etc.
Coverage diagram layer-management module 200, for when the input of user's gesture having been detected, creates the coverage diagram layer that covers current window.
In one embodiment of the invention, the coverage diagram layer is transparent with respect to current window.Wherein, with respect to the transparent all-transparent that can be of current window, but namely the user sees in application program only has current window, coverage diagram layer user to cannot see physical presence, thus, can make the coverage diagram layer not affect the demonstration of current window, promotes the user and experiences; Perhaps, with respect to current window is transparent, can be transparently in proportion, for example translucent, the user can also arrange corresponding transparent proportional, thus, gives the user prompting, and the prompting user carries out the mouse gestures operation in the coverage diagram layer, promote the user and experience.
In one embodiment of the invention, the size of coverage diagram layer is identical with current window.Should be understood that, the size of coverage diagram layer also can be set as required, for example, can arrange less than current window.
Acquisition module 300 is for obtaining the motion track of user's gesture at the coverage diagram layer.
Current window control module 400 is for controlling current window according to motion track.
For example, according to motion track, can realize the related command of the current window of application program, as, advance, retreat, refresh etc.
the device of controlling according to user's gesture according to the embodiment of the present invention, generate the coverage diagram layer to cover current window, drawing image on the coverage diagram layer, but executable operations on current window, thus, the video of playing in the page of application program (for example browser), the dynamic objects such as flash animation not there will be the top set (namely can be at video, on flash etc., carry out setting-out) and dodge the phenomenon of shielding, do not affect the normal play of the dynamic object such as in progress video and flash on the application program page, do not affect application program to the broadcasting of dynamic object and play up, promoting the user experiences, in addition, the use coverage diagram layer transparent with respect to current window significantly promotes the performance that has complicated shape and various effect of visualization (as animation, translucent effect), and the user can draw by mouse abundant motion track in the coverage diagram layer, promote the user and experience, enrich control method.
Fig. 6 is the structured flowchart of the device controlled according to user's gesture in accordance with another embodiment of the present invention.As shown in Figure 6, the device of controlling according to user's gesture comprises: monitoring modular 100, coverage diagram layer-management module 200, acquisition module 300, current window control module 400 and judge module 500.
Particularly, when the input of user's gesture having been detected, also need user's gesture is screened.Whether judge module 500 meets default gesture for user's gesture that judgement detects, and wherein, coverage diagram layer-management module 200 is also for creating the coverage diagram layer that covers current window when judge module 500 judgements meet default gesture.
Wherein, default gesture is corresponding with input equipment.For example, if use mouse input user gesture, whether user's gesture of judgement input is to press default mouse button, such as whether being right button etc., if press right mouse button, create the coverage diagram layer that covers current window, or whether user's gesture of judgement input is to press the default default track of mouse button slip.And for example, if on touch pad or touch display screen curtain, pre-define default gesture, if the default gesture that meets definition of user's input creates the coverage diagram layer that covers current window.Should be appreciated that default gesture mainly plays the effect that creates the coverage diagram layer that covers current window, prevents maloperation.
Should be appreciated that to start by other means to create the coverage diagram layer that covers current window, for example, by some function key of lower keyboard, also create the coverage diagram layer of covering current window, and for example, while being arranged to start application program, send enabled instruction etc.
According to the device of controlling according to user's gesture of the embodiment of the present invention, by default gesture, user's gesture is screened, while meeting default gesture, just can create the effect of the coverage diagram layer that covers current window, prevent maloperation.
Fig. 7 is the structured flowchart of the device of controlling according to user's gesture of another embodiment according to the present invention.As shown in Figure 7, the device of controlling according to user's gesture comprises: monitoring modular 100, coverage diagram layer-management module 200, acquisition module 300, current window control module 400, judge module 500 and display module 600.
Particularly, display module 600 is for showing motion track at the coverage diagram layer.Wherein, the demonstration motion track can be showed the gesture that the user carries out intuitively, visually in the coverage diagram layer, promotes the user and experiences.
In one embodiment of the invention, the coverage diagram layer generates by the browser host process, and motion track is drawn in the coverage diagram layer by the browser host process.
In one embodiment of the invention, the browser host process is obtained motion track by the window process of current window.
particularly, at first the browser host process receives enabled instruction, the browser host process generates the coverage diagram layer according to user's gesture of user's input afterwards, while in the coverage diagram layer, carrying out mouse or gesture slide, the coverage diagram layer does not receive mouse action or gesture slip message, mouse action or gesture slip message directly see through goes the current window that is covered by the coverage diagram layer to receive, after current window receives mouse action or gesture slip message, this mouse action or gesture slip message are sent to the browser host process, the browser host process is obtained corresponding motion track, and motion track is plotted in the coverage diagram layer.
Thus, by current window, receive mouse action or gesture slip message, the coverage diagram layer is receipt message not, mouse or gesture slip message directly see through and go to be received by the current window under the coverage diagram layer, then the browser host process shows motion track according to mouse or gesture slide again in the coverage diagram layer, continuous top set or the phenomenon of dodging screen in the time of can avoiding on the dynamic objects such as in progress video, flash setting-out, occur, promote the user and experience; In addition, motion track can present smoothly in the coverage diagram layer, not there will be scintillation.
In the described embodiment of above-mentioned any one, need to judge user's gesture: in one embodiment of the invention, monitoring modular 100 is also be used to obtaining the displacement of user's gesture, and judge that whether displacement is greater than default displacement, and, when judging greater than default displacement, define the input of user's gesture.Particularly, default displacement can be the Minimum sliding distance of user's setting or system default, the position coordinates of pressing gesture from the user is counted, (for example catch the displacement of user's gesture, can follow the tracks of mouse position etc.), when displacement, during greater than default displacement, think move operation, otherwise think clicking operation.Can prevent maloperation thus.
In one embodiment of the invention, current window control module 400 is also for according to motion track, obtaining corresponding control command, and according to control command, current window controlled.Particularly, at first, current window control module 400 is according to motion track judgement gesture-type, then, current window control module 400 is according to the corresponding operation of gesture-type response, for example, and upwards, page turning downwards, forward, the switching activity page, the page advance and retreat etc. backward.Thus, avoid the maloperation that causes by clicking the mouse, during as the switching between the page at the current active page and running background, when point is to X button and page close because of carelessness, need to reopen page link, cause unnecessary trouble, promote the user and experience.
In one embodiment of the invention, application program can be browser.Should be understood that, the described device of controlling according to mouse gestures of any one embodiment of the present invention not only can realize on browser, can also be in a kind of operating system of windows(Microsoft exploitation) any application program can be according to can the described method of controlling according to mouse gestures of the embodiment of the present invention realizing that gesture controls in platform.
In order to realize above-described embodiment, the present invention also proposes a kind of client.
Client comprises: shell, screen, processor, processor and circuit board; Screen is placed on shell, and circuit board is placed in the interior volume that shell surrounds, and processor and storer are arranged on circuit board; Storer is for the stores executable programs code; Processor moves the program corresponding with executable program code by the executable program code of storing in read memory, with for:
S101 ', whether monitoring has the input of user's gesture.
particularly, in one embodiment of the invention, user's gesture is by mouse or touch pad or touch control display screen input, user's gesture refer to the user by mouse or touch pad or touch control display screen input with controlling application program, complete corresponding operating the time a series of actions, for example, at PC(personal computer, personal computer) the upper mouse input user gesture of using, perhaps on individual notebook, by mouse or on touch pad, input user's gesture, perhaps on mobile terminal by touch control display screen on input user gesture, in a word, the user can use any input equipment input user gesture, and for example, user's gesture can be to press the motion track that certain key of mouse draws, it can be also motion track drawing at touch pad of user etc.
S102 ', when the user having been detected and input gesture, create the coverage diagram layer that covers current window.
In one embodiment of the invention, the coverage diagram layer is transparent with respect to current window for the coverage diagram layer.Wherein, with respect to the transparent all-transparent that can be of current window, but namely the user sees in application program only has current window, coverage diagram layer user to cannot see physical presence, thus, can make the coverage diagram layer not affect the demonstration of current window, promotes the user and experiences; Perhaps, with respect to current window is transparent, can be transparently in proportion, for example translucent, the user can also arrange corresponding transparent proportional, thus, gives the user prompting, and the prompting user carries out the mouse gestures operation in the coverage diagram layer, promote the user and experience.
In one embodiment of the invention, the size of coverage diagram layer is identical with current window.Should be understood that, the size of coverage diagram layer also can be set as required, for example, can arrange less than current window.
S103 ', obtain the motion track of user's gesture in the coverage diagram layer.
S104 ', control current window according to motion track.
For example, according to motion track, can realize the related command of the current window of application program, as, advance, retreat, refresh etc.
In one embodiment of the invention, described processor is also used: in the coverage diagram layer, show motion track.Wherein, the demonstration motion track can be showed the gesture that the user carries out intuitively, visually in the coverage diagram layer, promotes the user and experiences.
Client according to the embodiment of the present invention, generate the coverage diagram layer to cover current window, drawing image on the coverage diagram layer, but executable operations on current window, thus, when the dynamic objects such as the video of playing in the page of application program (such as browser), flash animation not there will be top set (namely can not carry out setting-out on video, flash etc.) and dodge the phenomenon of shielding, do not affect the normal play of the dynamic object such as in progress video and flash on the application program page, do not affect application program to the broadcasting of dynamic object and play up, promoting the user and experience; In addition, the use coverage diagram layer transparent with respect to current window significantly promotes the performance that has complicated shape and various effect of visualization (as animation, translucent effect), and the user can draw by mouse abundant motion track in the coverage diagram layer, promote the user and experience, enrich control method.
When the input of user's gesture having been detected, also need user's gesture is screened.In one embodiment of the invention, processor is also for before creating the coverage diagram layer that covers current window, and whether user's gesture that judgement detects meets default gesture, and creates the coverage diagram layer that covers current window when meeting default gesture.
Wherein, default gesture is corresponding with input equipment.For example, if use mouse input user gesture, whether user's gesture of judgement input is to press default mouse button, such as whether being right button etc., if press right mouse button, create the coverage diagram layer that covers current window, or whether user's gesture of judgement input is to press the default default track of mouse button slip.And for example, if on touch pad or touch display screen curtain, pre-define default gesture, if the default gesture that meets definition of user's input creates the coverage diagram layer that covers current window.Should be appreciated that default gesture mainly plays the effect that creates the coverage diagram layer that covers current window, prevents maloperation.
Should be appreciated that to start by other means to create the coverage diagram layer that covers current window, for example, by some function key of lower keyboard, also create the coverage diagram layer of covering current window, and for example, while being arranged to start application program, send enabled instruction etc.
In one embodiment of the invention, the coverage diagram layer generates by the browser host process, and motion track is drawn in the coverage diagram layer by the browser host process.
In one embodiment of the invention, the browser host process is obtained motion track by the window process of current window.
particularly, at first the browser host process receives enabled instruction, the browser host process generates the coverage diagram layer according to user's gesture of user's input afterwards, while in the coverage diagram layer, carrying out mouse or gesture slide, the coverage diagram layer does not receive mouse action or gesture slip message, mouse action or gesture slip message directly see through goes the current window that is covered by the coverage diagram layer to receive, after current window receives mouse action or gesture slip message, this mouse action or gesture slip message are sent to the browser host process, the browser host process is obtained corresponding motion track, and motion track is plotted in the coverage diagram layer.
Thus, by current window, receive mouse action or gesture slip message, the coverage diagram layer is receipt message not, mouse or gesture slip message directly see through and go to be received by the current window under the coverage diagram layer, then the browser host process shows motion track according to mouse or gesture slide again in the coverage diagram layer, continuous top set or the phenomenon of dodging screen in the time of can avoiding on the dynamic objects such as in progress video, flash setting-out, occur, promote the user and experience; In addition, motion track can present smoothly in the coverage diagram layer, not there will be scintillation.
In the described embodiment of above-mentioned any one, need to judge user's gesture: judgement user gesture is clicking operation or motion track.In one embodiment of the invention, whether described processor is also for detection of having the input of user's gesture specifically to comprise the following steps: the displacement of obtaining user's gesture; Judge that whether displacement is greater than default displacement; And if, greater than default displacement, define the input of user's gesture.Particularly, default displacement can be the Minimum sliding distance of user's setting or system default, the position coordinates of pressing gesture from the user is counted, (for example catch the displacement of user's gesture, can follow the tracks of mouse position etc.), when displacement, during greater than default displacement, think move operation, otherwise think clicking operation.Can prevent maloperation thus.
In one embodiment of the invention, processor specifically for:
S201 ', whether monitoring has the input of user's gesture.
S202 ', when the user having been detected and input gesture, whether user's gesture that judgement detects meets default gesture.
S203 ', if meet default gesture, create the coverage diagram layer that covers current window.
S204 ', obtain the motion track of user's gesture in the coverage diagram layer.
S205 ', control current window according to motion track, and show motion track in coverage diagram layer figure layer.
S206 ', obtain corresponding control command according to motion track, and according to control command, current window controlled.
S207 ', if do not meet default gesture, control current window according to user's gesture.
Client according to the embodiment of the present invention, avoided the maloperation that causes by clicking the mouse, during as the switching between the page at the current active page and running background, when point is to X button and page close because of carelessness, need to reopen page link, cause unnecessary trouble, promote the user and experience.
In one embodiment of the invention, application program can be browser.Should be understood that, not only can running browser in the described client of any one embodiment of the present invention, can also move a kind of operating system of windows(Microsoft exploitation) any application program in platform.
In order to realize above-described embodiment, the present invention also proposes a kind of application program.
A kind of application program, this application program is for carrying out the described method of controlling according to user's gesture of any one embodiment as mentioned above when moving.
Application program according to the embodiment of the present invention, generate the coverage diagram layer to cover the current window of application program, drawing image on the coverage diagram layer, but in the application program executable operations, thus, when the dynamic objects such as the video of playing in the page of application program, flash animation not there will be top set (namely can not carry out setting-out on video, flash etc.) and dodge the phenomenon of shielding, do not affect the normal play of the dynamic object such as in progress video and flash on the application program page, do not affect application program to the broadcasting of dynamic object and play up, promoting the user and experience; In addition, the use coverage diagram layer transparent with respect to current window significantly promotes the performance that has complicated shape and various effect of visualization (as animation, translucent effect), and the user can draw by mouse abundant motion track in the coverage diagram layer, promote the user and experience, enrich control method.
In order to realize above-described embodiment, the present invention also proposes a kind of storage medium.
A kind of storage medium, be used to storing application program, this application program is for carrying out the described method of controlling according to mouse gestures of any one embodiment as mentioned above when moving.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, a plurality of steps or method can realize with being stored in storer and by software or firmware that suitable instruction execution system is carried out.For example, if realize with hardware, the same in another embodiment, can realize with any one in following technology well known in the art or their combination: have for data-signal being realized to the discrete logic of the logic gates of logic function, special IC with suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc.
In the description of this instructions, the description of reference term " embodiment ", " some embodiment ", " example ", " concrete example " or " some examples " etc. means to be contained at least one embodiment of the present invention or example in conjunction with specific features, structure, material or the characteristics of this embodiment or example description.In this manual, the schematic statement of above-mentioned term not necessarily referred to identical embodiment or example.And the specific features of description, structure, material or characteristics can be with suitable mode combinations in any one or more embodiment or example.
Although illustrated and described embodiments of the invention, those having ordinary skill in the art will appreciate that: in the situation that do not break away from principle of the present invention and aim can be carried out multiple variation, modification, replacement and modification to these embodiment, scope of the present invention is limited by claim and equivalent thereof.
Claims (27)
1. a method of controlling according to user's gesture, be applied to the browser field, it is characterized in that, comprises the following steps:
Detect whether the input of user's gesture is arranged;
When the input of user's gesture having been detected, create the coverage diagram layer that covers current window;
Obtain the motion track of described user's gesture in described coverage diagram layer; And
According to described motion track, described current window is controlled.
2. the method for claim 1, is characterized in that, before the coverage diagram layer of described establishment covering current window, also comprises:
Judge whether the described user's gesture that detects meets default gesture; And
If meet default gesture, create the described coverage diagram layer that covers described current window.
3. method as claimed in claim 1 or 2, is characterized in that, also comprises:
In described coverage diagram layer, show described motion track.
4. method as claimed in claim 1 or 2, is characterized in that, described coverage diagram layer figure layer generates by described browser host process, and described motion track is drawn in described coverage diagram layer figure layer by described browser host process.
5. method as claimed in claim 1 or 2, is characterized in that, described user's gesture is by mouse or touch pad or touch control display screen input.
6. method as claimed in claim 1 or 2, is characterized in that, whether described detection has the input of user's gesture, comprising:
Obtain the displacement of described user's gesture;
Judge that whether described displacement is greater than default displacement; And
If greater than default displacement, define described user's gesture input.
7. method as claimed in claim 4, is characterized in that, described browser host process is obtained described motion track by the window process of described current window.
8. as the described method of claim 1-7 any one, it is characterized in that, described coverage diagram layer is transparent with respect to described current window.
9. the method for claim 1, is characterized in that, describedly according to described motion track, described current window controlled and comprised:
According to described motion track, obtain corresponding control command, and according to described control command, described current window is controlled.
10. a device of controlling according to user's gesture, be applied to the browser field, it is characterized in that, comprising:
Monitoring modular, for detection of whether the input of user's gesture is arranged;
Coverage diagram layer-management module, for when the input of user's gesture having been detected, create the coverage diagram layer that covers current window;
Acquisition module, for obtaining the motion track of described user's gesture at described coverage diagram layer; And
The current window control module, for controlling described current window according to described motion track.
11. device as claimed in claim 10, is characterized in that, also comprises:
Whether judge module, meet default gesture be used to judging the described user's gesture that detects, and wherein, described coverage diagram layer-management module is also for creating the described coverage diagram layer that covers described current window when described judge module judgement meets default gesture.
12. device as described as claim 10 or 11, is characterized in that, also comprises:
Display module, for showing described motion track at described coverage diagram layer.
13. device as described as claim 10 or 11, is characterized in that, described coverage diagram layer figure layer generates by described browser host process, and described motion track is drawn in described coverage diagram layer figure layer by described browser host process.
14. device as described as claim 10 or 11, is characterized in that, described user's gesture is by mouse or touch pad or touch control display screen input.
15. device as described as claim 10 or 11, it is characterized in that, described monitoring modular is also for the displacement of obtaining described user's gesture, and judge that whether described displacement is greater than default displacement, and, when judging greater than default displacement, define described user's gesture input.
16. device as claimed in claim 13, is characterized in that, described browser host process is obtained described motion track by the window process of described current window.
17. as the described device of claim 10-16 any one, it is characterized in that, described coverage diagram layer is transparent with respect to described current window.
18. device as claimed in claim 10, is characterized in that, described current window control module obtains corresponding control command according to described motion track, and according to described control command, described current window is controlled.
19. a client, is characterized in that, comprising: shell, screen, processor, processor and circuit board;
Described screen is placed on described shell, and described circuit board is placed in the interior volume that described shell surrounds, and described processor and described storer are arranged on described circuit board;
Described storer is for the stores executable programs code;
Described processor moves the program corresponding with described executable program code by reading the executable program code of storing in described storer, with for:
Detect whether the input of user's gesture is arranged;
When the input of user's gesture having been detected, create the coverage diagram layer that covers current window;
Obtain the motion track of described user's gesture in described coverage diagram layer; And
According to described motion track, described current window is controlled.
20. client as claimed in claim 19, it is characterized in that, described processor is also for before covering the coverage diagram layer of current window in described establishment, judge whether the described user's gesture that detects meets default gesture, and create the described coverage diagram layer that covers described current window when meeting default gesture.
21. client as described as claim 19 or 20, is characterized in that, described processor is also for showing described motion track at described coverage diagram layer.
22. client as described as claim 19 or 20, is characterized in that, described coverage diagram layer figure layer generates by described browser host process, and described motion track is drawn in described coverage diagram layer figure layer by described browser host process.
23. client as described as claim 19 or 20, is characterized in that, described user's gesture is by mouse or touch pad or touch control display screen input.
24. client as described as claim 19 or 20, is characterized in that, described processor detect when whether the input of user's gesture is arranged specifically for:
Obtain the displacement of described user's gesture;
Judge that whether described displacement is greater than default displacement; And
If greater than default displacement, define described user's gesture input.
25. client as claimed in claim 22, is characterized in that, described browser host process is obtained described motion track by the window process of described current window.
26. as the described client of claim 19-25 any one, it is characterized in that, described coverage diagram layer is transparent with respect to described current window.
27. client as claimed in claim 19, is characterized in that, and is described while according to motion track, described current window being controlled, described processor specifically for:
According to described motion track, obtain corresponding control command, and according to described control command, described current window is controlled.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310359109.XA CN103399640B (en) | 2013-08-16 | 2013-08-16 | Method and device for controlling according to user gesture and client |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310359109.XA CN103399640B (en) | 2013-08-16 | 2013-08-16 | Method and device for controlling according to user gesture and client |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103399640A true CN103399640A (en) | 2013-11-20 |
| CN103399640B CN103399640B (en) | 2017-01-25 |
Family
ID=49563280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310359109.XA Expired - Fee Related CN103399640B (en) | 2013-08-16 | 2013-08-16 | Method and device for controlling according to user gesture and client |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103399640B (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104216711A (en) * | 2014-09-01 | 2014-12-17 | 安一恒通（北京）科技有限公司 | Method and device for rendering controls |
| CN105045499A (en) * | 2015-06-12 | 2015-11-11 | 广东小天才科技有限公司 | Method and apparatus for determining touch on object |
| CN105786314A (en) * | 2016-02-25 | 2016-07-20 | 北京京东尚科信息技术有限公司 | Window adjusting method and electronic device using same |
| CN105872691A (en) * | 2015-12-14 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Method and device for controlling browser |
| WO2018120448A1 (en) * | 2016-12-26 | 2018-07-05 | 广州视源电子科技股份有限公司 | Method and apparatus for controlling large-screen display device |
| CN109710362A (en) * | 2018-12-26 | 2019-05-03 | 掌阅科技股份有限公司 | Screenshot processing method calculates equipment and computer storage medium |
| CN111176454A (en) * | 2020-01-07 | 2020-05-19 | 福建天晴数码有限公司 | Terminal screen locking method combined with camera and storage medium |
| CN111241510A (en) * | 2020-01-07 | 2020-06-05 | 福建天晴数码有限公司 | Terminal screen control method based on fingerprint identification and storage medium |
| CN111240566A (en) * | 2020-01-07 | 2020-06-05 | 福建天晴数码有限公司 | Terminal screen control method based on Bluetooth and storage medium |
| WO2020207036A1 (en) * | 2019-04-08 | 2020-10-15 | 广州视源电子科技股份有限公司 | Method for operating intelligent interactive tablet, and storage medium and related device |
| CN112784871A (en) * | 2020-12-22 | 2021-05-11 | 作业帮教育科技（北京）有限公司 | Gesture-based question repetition judging method and device, electronic equipment and recording medium |
| WO2021218017A1 (en) * | 2020-04-28 | 2021-11-04 | 平安科技（深圳）有限公司 | Method and apparatus for implementing mouse cursor trailing special effect, computer device, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090225037A1 (en) * | 2008-03-04 | 2009-09-10 | Apple Inc. | Touch event model for web pages |
| CN101681236A (en) * | 2008-03-04 | 2010-03-24 | 苹果公司 | Touch event processing for web pages |
| WO2010071630A1 (en) * | 2008-12-15 | 2010-06-24 | Hewlett-Packard Development Company, L.P. | Gesture based edit mode |
| CN101763219A (en) * | 2010-02-03 | 2010-06-30 | 北京优视动景网络科技有限公司 | User interface method and device for operating web browser by using touch liquid crystal display (LCD) |
| CN103092496A (en) * | 2011-11-02 | 2013-05-08 | 腾讯科技（深圳）有限公司 | Browser control method, browser control device and mobile equipment |
-
2013
- 2013-08-16 CN CN201310359109.XA patent/CN103399640B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090225037A1 (en) * | 2008-03-04 | 2009-09-10 | Apple Inc. | Touch event model for web pages |
| CN101681236A (en) * | 2008-03-04 | 2010-03-24 | 苹果公司 | Touch event processing for web pages |
| WO2010071630A1 (en) * | 2008-12-15 | 2010-06-24 | Hewlett-Packard Development Company, L.P. | Gesture based edit mode |
| CN101763219A (en) * | 2010-02-03 | 2010-06-30 | 北京优视动景网络科技有限公司 | User interface method and device for operating web browser by using touch liquid crystal display (LCD) |
| CN103092496A (en) * | 2011-11-02 | 2013-05-08 | 腾讯科技（深圳）有限公司 | Browser control method, browser control device and mobile equipment |
Non-Patent Citations (1)
| Title |
|---|
| 胡昌杰等: "《网页设计》", 31 August 2007, 中国水利水电出版社 * |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104216711B (en) * | 2014-09-01 | 2017-10-31 | 安一恒通（北京）科技有限公司 | The rendering intent and device of control |
| CN104216711A (en) * | 2014-09-01 | 2014-12-17 | 安一恒通（北京）科技有限公司 | Method and device for rendering controls |
| CN105045499A (en) * | 2015-06-12 | 2015-11-11 | 广东小天才科技有限公司 | Method and apparatus for determining touch on object |
| CN105872691A (en) * | 2015-12-14 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Method and device for controlling browser |
| CN105786314A (en) * | 2016-02-25 | 2016-07-20 | 北京京东尚科信息技术有限公司 | Window adjusting method and electronic device using same |
| WO2018120448A1 (en) * | 2016-12-26 | 2018-07-05 | 广州视源电子科技股份有限公司 | Method and apparatus for controlling large-screen display device |
| CN109710362A (en) * | 2018-12-26 | 2019-05-03 | 掌阅科技股份有限公司 | Screenshot processing method calculates equipment and computer storage medium |
| WO2020207036A1 (en) * | 2019-04-08 | 2020-10-15 | 广州视源电子科技股份有限公司 | Method for operating intelligent interactive tablet, and storage medium and related device |
| US11954305B2 (en) | 2019-04-08 | 2024-04-09 | Guangzhou Shiyuan Electronics Co., Ltd. | Operation methods of a smart interactive tablet, storage medium and related equipment |
| US11650716B2 (en) | 2019-04-08 | 2023-05-16 | Guangzhou Shiyuan Electronics Co., Ltd. | Operation methods of a smart interactive tablet, storage medium and related equipment |
| CN111241510A (en) * | 2020-01-07 | 2020-06-05 | 福建天晴数码有限公司 | Terminal screen control method based on fingerprint identification and storage medium |
| CN111176454B (en) * | 2020-01-07 | 2021-09-03 | 福建天晴数码有限公司 | Terminal screen locking method combined with camera and storage medium |
| CN111240566B (en) * | 2020-01-07 | 2021-09-03 | 福建天晴数码有限公司 | Terminal screen control method based on Bluetooth and storage medium |
| CN111241510B (en) * | 2020-01-07 | 2021-09-07 | 福建天晴数码有限公司 | Terminal screen control method based on fingerprint identification and storage medium |
| CN111240566A (en) * | 2020-01-07 | 2020-06-05 | 福建天晴数码有限公司 | Terminal screen control method based on Bluetooth and storage medium |
| CN111176454A (en) * | 2020-01-07 | 2020-05-19 | 福建天晴数码有限公司 | Terminal screen locking method combined with camera and storage medium |
| WO2021218017A1 (en) * | 2020-04-28 | 2021-11-04 | 平安科技（深圳）有限公司 | Method and apparatus for implementing mouse cursor trailing special effect, computer device, and storage medium |
| CN112784871A (en) * | 2020-12-22 | 2021-05-11 | 作业帮教育科技（北京）有限公司 | Gesture-based question repetition judging method and device, electronic equipment and recording medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103399640B (en) | 2017-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103399640A (en) | Method and device for controlling according to user gesture and client | |
| CN109164964B (en) | Content sharing method and device, terminal and storage medium | |
| KR102611858B1 (en) | Method for operating intelligent interactive tablet, and storage medium and related device | |
| KR101527827B1 (en) | Split-screen display method and apparatus, and electronic device thereof | |
| CN104135684B (en) | A kind of interface display method and device based on Firefox OS | |
| US9262052B2 (en) | Method and device for controlling the display of a plurality of elements of a list on a display device | |
| CN103390053A (en) | Page switching control method and device of browser and client | |
| KR102132390B1 (en) | User terminal device and method for displaying thereof | |
| CN105224276A (en) | A kind of multi-screen display method and electronic equipment | |
| KR102345098B1 (en) | Screen display method and terminal | |
| US20210200391A1 (en) | Interacting Method for Sidebar Menu, Apparatus and Computer-readable Storage Medium | |
| EP3770743A1 (en) | Page switching method, apparatus, storage medium, and computer device | |
| CN108829314B (en) | Screenshot selecting interface selection method, device, equipment and storage medium | |
| KR102368044B1 (en) | User terminal device and method for controlling the user terminal device thereof | |
| CN111399959A (en) | Multitasking operation method and device, electronic equipment and storage medium | |
| US20160004339A1 (en) | Programmable display device and screen-operation processing program therefor | |
| KR20150134674A (en) | User terminal device, and Method for controlling for User terminal device, and multimedia system thereof | |
| US20140351749A1 (en) | Methods, apparatuses and computer program products for merging areas in views of user interfaces | |
| CN105378628A (en) | Start and application navigation | |
| KR102186548B1 (en) | Method, apparatus and recovering medium for screen display by executing scroll | |
| CN112188001B (en) | Shortcut setting method, shortcut setting device, electronic equipment and readable storage medium | |
| CN108052254B (en) | Information processing method and electronic equipment | |
| CN103488424A (en) | Method and device for displaying information | |
| US20140223328A1 (en) | Apparatus and method for automatically controlling display screen density | |
| KR101419871B1 (en) | Apparatus and method for editing subtitles |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170125 Termination date: 20180816 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |