CN104049779A - Method and device for achieving rapid mouse pointer switching among multiple displayers - Google Patents
Method and device for achieving rapid mouse pointer switching among multiple displayers Download PDFInfo
- Publication number
- CN104049779A CN104049779A CN201410288891.5A CN201410288891A CN104049779A CN 104049779 A CN104049779 A CN 104049779A CN 201410288891 A CN201410288891 A CN 201410288891A CN 104049779 A CN104049779 A CN 104049779A
- Authority
- CN
- China
- Prior art keywords
- mouse
- pointer
- display
- action
- desktop
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a method and device for rapid mouse pointer jumping among multiple displayers driven by a computer only by operating a mouse. According to the method and device, operations are rapid, and the method and device do not interfere with the conventional application of the mouse. According to the implementation method, except for adoption of combination buttons, the more convenient and fast mode is a movement operation mode of inclining, lifting and shaking the mouse. The mouse movement operation mode is detected through an imaging system of the optical mouse or characteristic trajectory analysis or output of a built-in sensor or the like.
Description
Technical field
The invention belongs to electronic information technical field, be specifically related to be many displays of a computer drives time, realize mouse pointer quick method and apparatus of redirect between display.
Background technology
Mouse is the topmost man-machine interface of computing machine except keyboard, and the operating system of computing machine and various application program also depend on mouse more and more.Optical mouse is the current mouse the most often using.The typical case of tradition optical mouse forms, interior section comprises lighting source (LED or LD), optical system, imageing sensor (image sensor), image processor, mouse controller, and peripheral operation partly comprises left mouse button (1eft button), right button (right button) and roller (scroll wheel).
Because the action type that application program is required is more and more, the operating function of mouse is also required to get more and more.The right and left key of mouse and the function of roller are assigned as standard purposes by computer operating system, therefore should not specify separately other function again.For this reason, in some occasion, introduced the mouse instructions input mode of some enhancements.Such as, by the right and left key of mouse and roller combination, on mouse, increase special key, by roller multifunction, make it have button (replacing intermediary button middle button) function and direction (Tilt wheel) key function, meet demands such as vertical or flip horizontal.Also have in addition and utilize mouse gestures (mouse gestures) (specific mouse motion track) as a class assistant software that strengthens input instruction.Definition or User Defined meet the track of certain feature, as simple in left and right translation, upper and lower translation, right-angled bend etc. mobile.For fear of obscuring mutually with normal mouse move operation, need to press right mouse button cooperation simultaneously.This mode has been brought new operating experience to user to a certain extent.
Due to touch function, comprise touch-screen and touch pad, by notebook computer, adopted more and more, operating system coordinates this progress to increase some gesture input modes thereupon, as conventional " convergent-divergent ", " rotation ", " multiple point touching " etc.For these functions are further expanded on a greater variety of computing machines, produced a class and be input as main equipment to touch, as the touch mouse (touch mouse) of external touch pad (touch pad) and various shapes.Touch mouse and simulated the function of touch pad on notebook computer, can think the enhancing of pair roller key, but its major function form still be take conventional mouse as main, right and left key, the page pull up and down, front and back page turning, left and right page turning, double-click and choose etc., this is the basic operational requirements of computing machine, and concrete function depends on the setting of operating system and driver.
A computer drives the situation of many displays (Multiple Displays or Multiple Monitors) can be presented on more and more various occasions, and windows operating system and computer display card are also supported this application at present.Simple implementation is by inserting a plurality of video cards in computing machine, being then connected to many displays by the video-frequency connector on it, or connects many displays by remote data indicator expansion card.Equipment control by operating system arranges, and the working method of many displays can be selected in plurality of display modes.As shown, same content, independence show, spell screen etc.Use the object of many displays, the one, for vision is convenient, as used large display of notebook computer traction; The 2nd, demonstration needs, as connected projector with notebook computer; The 3rd, expand and show perform region (onscreen workspace), many displays are linked to be a large display screen, are the observations that gives particulars such as desk-top publishing (desktop publishing), web exploitation, video editing; The 4th, the independent of computing machine multitask shows and operation, can show different contents, as carried out documents editing, video playback, program debug etc. simultaneously on each display simultaneously; The 5th, the application in scheduling and monitoring field.Which kind of object no matter, operator all will be often in the face of using a mouse to manage between a plurality of displays and the problem of operating application program, inevitably need mouse pointer to switch between a plurality of displays.
The mouse pointer move mode that current computer is supported, the one, conventional continuous moving,, along with the movement of mouse, when mouse pointer moved behind an indicator screen edge, has just entered the screen of another one display.This move mode is the same in a plurality of (if at present without specific installation support, be generally two) indicator screen size, while being arranged side by side, operating process and visual experience comparison match, as operated on a longer display.But when there being a plurality of displays, size of display differs, arrange while there is front and back, upper and lower spatial diversity, operating process is difficult to mate with visual experience, on visual psychology, move left and right smoothly and feel destroyed, when needs are continually during rolling mouse pointer, just become a kind of burden, affect work efficiency.Now, clear and definite mouse pointer easily switches just becomes a kind of new user's request.
In order to address the above problem, can take certain measure that mouse pointer can directly be jumped to other display from current display, simplify move operation.Current implementation has several: the one, special region or soft key are set on screen by software, and when pointer is positioned at this region or clicks after soft " button " that on screen, somewhere shows, automatically switch on other display; The 2nd, shortcut is set on keyboard by software, normally a kind of Macintosh (key combinations), when pressing this generic key, mouse pointer automatically switches to other display; The 3rd, by the special setting to function of touchpad on notebook computer, realize.
These mouse pointer switching modes, can alleviate operator's part burden above, but in the face of the larger a plurality of operation tasks of mouse dependence, are not still mode, also non-mode the most efficiently the most easily.Because the switching of pointer is the operation that requirement can realize at any time under any application window, any running status, should be independent of application program, be independent of other input medias such as keyboard.
In order to solve such problem, the present invention is limited to mouse self by the operation of switching, and having designed can be fast, facility realizes the mode of operation of mouse pointer redirect and relevant implement device.
Summary of the invention
Between a plurality of displays, realize mouse pointer and switch fast, relate to be operator with a hand-held mouse, between many displays of a computer drives, carry out the mode of operation of quick pointer position switching and realize measure.Switching does not refer to and makes mouse pointer stride across indicator screen by artificial continuous moving mouse, but by software program, by mouse pointer, from a display, no matter any position directly jumps on another one display, can show or not show the track of any pointer movement around here.The computing machine of indication of the present invention be independently any or embed realize the equipment that function was calculated, and processed, controlled to data, comprise the computing machine that embeds in desktop computer, notebook computer, industrial computer, various device etc.The display of computer drives is except the display carrying, and external-connection displayer can be that conventional LCD display, projector, television display screen etc. can be by the display device of computer drives.The connected mode of computing machine and display can be any standard or special-purpose video interface, as VGA, DVI, HDMI, DisplayPort, S-Video etc.The wire medium that MouseAcross is excessively traditional or the wireless medium of any agreement are connected to computing machine.The same time of pointer of mouse is merely able on a display, and can be on many displays, and the display at the current place of mouse pointer is the display of mouse operation and control.
By the program relevant with mouse action, as operating system, graphics driver, operator is first to many display serial numbers that relate to or carry out automatic numbering by computing machine, the initial point and level, vertical displaing coordinate of determining each display, make the location of mouse pointer associated with display; Mouse function parameter is arranged, defining operation mode, or the move mode of mouse is carried out to pre-calibration etc.Display actual arrangement mode is numbered in order left and right and is settled, and this is a kind of typical case's application, also can arrange according to any self-defining spatial relation, but the moving direction of mouse pointer is according to the inherent serial number of display.
The mode that realizes the quick redirect of mouse pointer adopts one of following manner.
The first, by the function key of existing mouse or special button is set realizes.1) utilize the roller key on mouse top, this key (Tilt wheel) can with other function sharing of mouse, whenever roller key to the left and right certain direction stir, mouse pointer switches a display to this direction successively.2) in mouse side, roller is set, whenever the roller lattice that roll forward, mouse pointer just switches a display to the left, and whenever the roller lattice that roll backward, mouse pointer just switches a display to the right.3) directionkeys is set on mouse, whenever stirring once to certain direction, mouse pointer switches a display to this direction.4) in the side of mouse, special button is set, or with this button of other function sharing.After pressing this key: press left mouse button once (or left jog dial key, directionkeys), mouse pointer just switches a display left; Press right mouse button once (or to the right jog dial key, directionkeys), mouse pointer just switches a display to the right.Or, often pressing this key once, mouse pointer is directly switched to pointer on next display along predefined direction.
The second, membrane keyboard is set on mouse, does not increase mechanical button, needn't change mouse traditional appearance.1) membrane keyboard can be the pressure transducer that direct sensed pressure changes; 2) or the electric capacity of sensed pressure result of variations, the sensor of electrical resistance property; 3) or the weak photoelectric sensor changing of perception environmental light intensity.When thumb that operator grips mouse occurs after specific " touch mode " on membrane keyboard, at once press left mouse button or right button (or corresponding jog dial key, directionkeys), mouse pointer just left or right cut change once.During due to operating mouse, the thumb contact mouse side that grips mouse is normality, therefore can defining thumb, once to lift fast (and playback fast) be " clicking ", if definition " clicking " is touch mode, after there is " clicking ", press immediately a mouse left side or right button, carry out a pointer left side or right cut and change.Can regard it as sequential combination key, the combination of this sequential avoided with mouse habitually routine operation obscure mutually.
Three, special mode of motion is triggering command to take mouse.1) operator comes and goes and shakes after mouse fast according to set model, and mouse pointer is switched to pointer on next display along selected direction.The movement of mouse can be limited in the plane on desktop.This pattern of shaking is without strict difinition, as rocked mouse, obliquely rock mouse, draw a circle fast counterclockwise, draw a circle fast clockwise in quick double swerve mouse, front and back, etc., be similar to the conditioned reflex action while finding to lose mouse pointer, these actions very easily make a distinction with normal valid function.2) with specifically defined mouse gestures, switch pointer, as press after right mouse button, mouse is with the motion of defect modes of the definition switching command that sets out.3) with the switching of the inclination of mouse, the action triggers of rising and falling mouse pointer.Whenever mouse tilts once to certain direction, mouse pointer is just to a display of this direction switching, or every inclination or lift mouse once, and mouse pointer is switched to next display along predefined direction by pointer.Herein, a complete operation of so-called tilting action is that then put down fast a side or the one end of lifting mouse, and a rise and fall complete operation of action of what is called is that integral body is lifted mouse and then put down fast.If disregard inclination, the action of rising and falling so can be defined as and makes mouse part or all leave the operating process of putting down fast again after desktop.
The pointer of above-mentioned any kind switches, and when when a display jumps to another one display, drop point site can be selected by arranging in advance, such as always in the middle of screen, or by the screen left side etc.When pointer jump on a new display screen occur before moment, recover former pointer shape after can changing into eye-catching form prompting switching result.Eye-catching form comprises the change of pointer shape, near the change of the change of color, size and pointer is moved etc. drop point, can select by setting in advance mode.When pointer switches to same direction continuously, run into after the display on limit, the mode that can select in advance to circulate forwards on the display on other one side.If only have two displays, be exactly alternately to switch so.Or, when pointer runs into after the display on limit, rest on that display, now pointer can be reminded operating result with eye-catching form.
The pointer of above-mentioned any kind switches, the conventional continuous moving that all can set in advance mouse pointer by equipment manager be take current display as border, as only having a display, only, when there is mouse pointer switching command, mouse pointer just jumps on other display.The benefit of doing like this, the one, in many operations of screen edge, needn't worry to cross the border, as bottom brace, close button, and the instrument sidebar in some application programs etc.; The 2nd, and the pop instruction in the time of can continuing to use the mouse pointer defining such as window8 operating system to be positioned at screen " corner " at any one indicator screen edge (while being positioned at the upper right corner as pointer, the selectionbar that occurs search, arranges, starts and so on; When pointer is positioned at the lower left corner, eject begin column), and can make " corner " scope strengthen to be convenient to user to implement this generic operation.Or two kinds of modes all can, can be by the mode of continuous moving, also can be with the mode switching display of redirect.
Can pass through operating system or mouse driver, in equipment manager, set in advance, select to enable or close the rapid switching function of mouse pointer.
All these pointer fast transfer modes, all can be elected to be the instruction that forces pointer to revert to certain ad-hoc location, no matter pointer present position, no matter whether find Loss Of Pointer.
Accompanying drawing explanation
Fig. 1: a notebook computer display of tyre (or projector) is common application scenarios, mouse pointer often need to frequently switch between notebook display and remote data indicator.
Fig. 2: the relative direction and the button that define conventional mouse.Multi-functional roller key can scroll forward and backward, tilt (left and right directions key), vertically press (the middle key function of mouse).Sometimes can be used in conjunction with other key of mouse, depend on operating system and application program.
Fig. 3: the typical case of optical mouse forms schematic diagram.
Fig. 4: narrate the right angle reference frame adopting when of the present invention.
Fig. 5: schematic diagram when mouse keeps flat.
Fig. 6: schematic diagram when mouse tilts.Take a side as rotating shaft, slightly lift the opposite side of mouse.
Fig. 7: during mouse run-off the straight, 3-axis acceleration sensor can detect angle of inclination and vergence direction, and gyroscope can detect the generation of tilting action.
Fig. 8: adopt photoelectric sensor to detect the schematic diagram that mouse tilts or rises and falls and occur.When mouse is placed on desktop, surround lighting is blocked, and photoelectric sensor cannot sense light.
Fig. 9: adopt photoelectric sensor to detect the schematic diagram that mouse tilts or rises and falls and occur.When mouse tilts, surround lighting enters mouse bottom, and therefore the photoelectric sensor that lifts a side can sense surround lighting.Both sides photoelectric sensor receive window direction is outwards design all, and the light that minimizing one side enters is leaked on the photoelectric sensor of opposite side.
Figure 10: when mouse is normally worked on the table, imaging optical system focuses on desktop perform region, and now imaging is the most clear.
Figure 11: when mouse run-off the straight, mouse leaves desktop, object distance increases, and causes the imaging of desktop perform region to occur fuzzy.
Figure 12: pie graph when adopts pressure sensor sensitive mouse tilts and rises and falls.
Figure 13: the pie graph while adopting photoelectric sensor sensitive mouse tilt and rise and fall.
Figure 14: the variation tendency of imaging definition during the action of mouse generation fast lifting, before and after rising and falling, image can present " clear-fuzzy-clear " process.
Figure 15: the partial reference flow process that tilts, rises and falls and move according to the fuzzy condition detection mouse of mouse imaging.Here be the testing process when tilting or rising and falling.
Figure 16: the mouse of collection shakes trajectory diagram.First row, mouse track rocks from side to side; Second row is the most left, and mouse track rocks back and forth; In the middle of second row, mouse is drawn circle counterclockwise; Second row is the rightest, and mouse is drawn circle clockwise.Note, the starting point of mouse track, terminal are known.During practical operation, user can self-defined simple and clear action, too complexity.Because speed, acceleration signature during operation can guarantee to be different from very significantly conventional mouse action action.
Embodiment
It is modal application scenarios that notebook computer drives two displays, as example, completely the present invention can be described.Fig. 1 is the connection layout of described situation.Notebook host (1-1) self is with a display (1-2), by VGA interface (1-5) external a display (1-4), wireless mouse (1-6) is delivered to RF receiver (1-8) on main frame by built-in RF transmitter module (1-7) by mouse signal, thus mouse and computing machine is coupled together.Mouse (1-6) mouse beacon pointer (1-9) is in display (1-2) and (1-4) movement on screen.Conventionally computer operating system supports that mouse pointer seamlessly moves to another display from a display.Wireless mouse communication can adopt the wireless transmission protocol of standard, as Bluetooth, WiFi, ZigBee, or the private radio host-host protocol of designed, designed.Adopt wire mouse or wireless mouse as broad as long to the present invention, the PS/2 mouse interface that related is only by standard transmits mouse signal or by USB oral instructions, pass mouse signal after wireless bridging, and driver and operating system can solve compatibility issue.
Conventional mouse forms as shown in Figure 2.In mouse body, there are two basal keystrokes, left mouse button (2-1) and right mouse button (2-2), a roller key (2-3).Roller key, except roller (scroll forward and backward) function, also has button (middle key that conventionally replaces mouse) function, and left and right directions key (stirring) function.Roller is commonly used to pull up and down webpage or left and right page turning, convergent-divergent etc.The mobile information acquisition mode of mouse is determined by mouse type.Early stage mouse is mechanical mouse, by trace ball, obtains displacement information.Present mouse is optical mouse, by imageing sensor, obtains displacement information.In Fig. 2, the mouse reference direction having adopted while having defined narration this patent.(2-4) being the forward direction of mouse, is (2-5) left-hand of mouse, is (2-6) dextrad of mouse.
As shown in Figure 3, it is comprised of mouse controller (3-3), light illuminator (3-4), illumination optical assembly (3-5), reception optical module (3-6), photoelectric sensor (3-7), image processor (3-8), operation push-button, roller (3-9) and wireless transmitter module (3-10) basic structure of optical mouse.Its basic functional principle is by the optical window of mouse bottom, catches continuously local grain image the express-analysis of working top and processes, and the displacement of mouse is derived in the displacement by texture characteristic points in image.Mouse controller (3-3) is the core of whole mouse, conventionally by MCU (microcontroller), served as, detect the operational motion of button, roller etc., drive light illuminator (3-4) emissive lighting light, the mobile message of reception & disposal mouse, then delivers to wireless communication module (3-10) by interface and passes to main frame.Light illuminator (3-4) is generally LED or laser diode (LD), is responsible for " illumination " of working top (3-2), by optical system, converges and be irradiated to equably perform region.Optical system is comprised of opticses such as some optical lenses, prisms, and optical band is visible ray, infrared ray etc.Receiving optical module (3-6) is the receiving optics (imaging optical system) of photoelectric sensor (3-7), and it is imaged on the workplace of irradiation area (desktop, mouse pad etc.) on sensor.There are two class imaging optical systems: the one, vertical imaging system, optical axis is vertical with object plane, and optical axis is vertical with desktop, also vertical with picture plane; The 2nd, inclination imaging system, optical axis and object plane are angled, require also angled with optical axis as plane.Which kind of optical system no matter, during design, all guarantee imaging on imageing sensor be integral body clearly, or can be by algorithm correction clearly.In figure, the optical system shown in (3-6) has supposed that optical axis is perpendicular to desktop, is conventional imaging optical system.Photoelectric sensor (3-7) is CMOS array image sensor normally, often integrates with graphics processing unit (3-8).Graphics processing unit is processed the image of continuous acquisition, according to the mobile of unique point in every width image, changes, and determines moving direction and the displacement of mouse, then delivers to mouse controller (3-3).Controller is converted to the mouse interface of specific data mode by standard by displacement and is delivered to main frame, or is delivered to main frame by wireless communication module (3-10).
Mouse is as standard I/O equipment of computing machine, by operating system management.Conventionally, the physics instruction that operating system is sent mouse controller, is converted to the function that can call.If application program relates to mouse action, by function call, obtain mouse event so, according to event attribute, will turn to corresponding handling procedure.Conventional mouse event comprises, mouseEvent_Move (mouse moves), mouseEvent_LeftDown (left mouse button is pressed), mouseEvent_RightDown (right mouse button is pressed), mouseEvent_LeftUp (left mouse button is lifted), mouseEvent_RightUp (right mouse button is lifted), mouseEvent_MiddleDown (middle button of mouse is pressed), mouseEvent_MiddleUp (middle button of mouse lifts), mouseEvent_Wheel (dwData) (mouse roller roll value) etc.
Because the handover event of mouse pointer can not relate to application program (certainly, as long as operating system is defined as general mouse event, application program is played as certain, also can be redefined as other purposes), therefore the execution of mouse pointer switching command is directly managed by operating system, or by the specific drivers adding, managed, and can be limited to this aspect.
The present invention is provided with various in order to trigger the mode of operation of mouse pointer switching command, and these operational motions form consistent physics instruction after mouse controller is confirmed.The physics switching mode that consistent physics instruction can make main frame and mouse adopt is irrelevant.Physics instruction is delivered to main frame controller through mouse interface, operating system is caught after this instruction, the form of pointer according to the position of the configuration sequence of display, current mouse pointer and predefined pointer drop point and while falling, directly carry out the switching of mouse pointer, forward mouse pointer to ad-hoc location on next display, as the middle of screen, standardized display surface coordinate is (65536/2,65536/2).
Mouse pointer blocked operation mode in the present invention, can be divided into two types.The first type: redefine mouse event, be defined as mouse pointer left and right switching command comprising the left and right of roller key is stirred, off-gauge existing side press-key is defined as to mouse pointer switching command etc.The second type: define new mouse event, comprising lower various operations.
Mouse side arranges roller, and roller key is connected to mouse controller.The roller lattice (definition) that often roll forward, to a signal of mouse controller output, mouse controller sends mouse pointer left-hand to computing machine and switches once command.
Mouse side arranges directionkeys (JOG key), and directionkeys is connected to mouse controller.Directionkeys has 4 direction of operating conventionally, for operating facility, can only select front and back to effectively stirring key (meeting auto-returned centre position after stirring backward forward) herein.Often stir forward once, mouse controller detects switch motion, to computing machine, sends the instruction that mouse pointer switches a display left.Equally, often stir backward once, mouse controller detects switch motion, to computing machine, sends the instruction that mouse pointer switches a display to the right.
Mouse side arranges special mouse pointer switching key, and this button is connected to mouse controller.It can have two kinds of modes of operation.The one, this key directly determines to switch.Often press this key once, mouse controller detects after switch motion, to computing machine, sends the mouse pointer instruction that a display is switched in (or to the right) left.The direction of switching can preset in mouse device manager.Another kind is the mode of operation that adopts compound keys, when pressing this key, then presses left mouse button and (or rolls before roller, or roller is stirred left, according to mouse, select), mouse controller detects two keys effectively simultaneously, to computing machine, sends the instruction that mouse pointer switches a display left.When pressing this key, then press right mouse button (or roll after roller, or roller stirs, select according to mouse) to the right, mouse controller detects two keys effectively simultaneously, to computing machine, sends the instruction that mouse pointer switches a display to the right.
Mouse side thumb grip position arranges membrane keyboard, and such as capacitance touch key or resistive touch key, this button is connected to mouse controller.Conventionally when using mouse, thumb contact mouse side is normality, even again contact after departing from mouse, the first action of mouse is more mobile but not clicks.According to the use habit of operator's routine, if after thumb is left immediately again touch mouse side be defined as a kind of " click " operator scheme, mouse controller can detect soft-touch control exist one moment non-contact action.If after this there is the action press immediately left mouse button or right button, be defined as mouse pointer left or switching command to the right.This can be defined as is a kind of front and back compound keys, because their operation is not to occur simultaneously, but the generation that continues, touch is a kind of leader label.The length of connecting time can arrange in equipment control project, according to personal habits, determines.The short connecting time of trying one's best, can avoid obscuring with other operation.Because personal habits is different, when operating mouse, thumb, not from thinking that departing from also touch mouse is usually event again, as long as thumb is not to carry out immediately button operation after again contacting, just can be avoided obscuring mutually with left mouse button, the right button operation of standard.This is the conclusion drawing after use habit research, and therefore this composition operation is reliably, is also easy.With respect to button, roller being set in mouse side, the design that not only simplifies the structure, does not cause the additional effect that mouse is gripped yet.
With the tilting action of mouse, trigger the switching of mouse pointer, the detection of tilting action is by the sensor senses of selecting, and mouse controller is delivered in the output of sensor.Alleged tilting action, although can be the action of the conventional plane motion state of any change mouse, but consider facility and the standard of operation, typical action can be defined as that to take arbitrary limit on four bases of mouse be nominal rotating shaft, slightly lifts the one side on opposite.This action is implementation the most easily, there is no need to make to tilt after the whole taken away from desktop of mouse body again.When adopting inclination in this way as means, a suitable structure can bring convenience for the execution of action.The left and right sides feather edge of mouse body or front and back end feather edge adopt straight design, or in main body, are straight designs on the axis direction that tilts to utilize, and square section adopts designed arc-shaped appearance.This is best measure, because tilting action can roll for actual rotating shaft according to it.Take and tilt as example, bottom, the left and right of mouse and desktop intersection are designed to linearly, are parallel state with axis, mouse front and back; And mouse bottom is circular-arc with the transition section design of mouse left and right side.As at the bottom of arrow in Fig. 6 (6-3) indication right mouse with the transition section of right mouse side, linearly, and side is circular-arc to the crossing main paragraph of itself and desktop (6-2).Tilt, tilt forward and back, the choice of four kinds of instructions is actual mouse designs selection.Conventionally the people of right-handed, holding that mouse is tilted to the right is to move comparatively easily.When only having two displays, only use this action just can alternately realize the switching of pointer.If while having a plurality of display, can adopt this action to do cyclic switching, the action that also can tilt all adopts, and makes switched and transferred have directivity.
With the switching of the action triggers mouse pointer that rises and falls of mouse, the detection of the action of rising and falling is by the sensor senses of selecting, and mouse controller is delivered in the output of sensor.The what is called action of rising and falling, has two kinds of definition.The first, if without with tilting action difference, do not consider the instruction of tilting, can be classified as a class by tilting and rising and falling, the action that is defined as that mouse is any and returns fast after can the quick taken away from desktop in sensing position.In this process, do not emphasize that a mouse integral body is picked up and put down.The second, needs and tilting action is distinguished, and likely selects these two kinds of instructions simultaneously.Being defined as a clearer and more definite mouse integral body lifts and puts down action.
Mouse tilts and the detection and Identification of the action command that rises and falls are the final correct keys that triggers pointer switching command, can adopt the implementation that three classes are different in the present invention.The first is based on motion sensor, and the second is based on image processing techniques, and the third is based on other sensor.
Realization based on motion sensor is, in conventional mouse, motion sensor is set.Typical motion sensor is acceleration transducer and gyroscope.At present, MEMS (MEMS (micro electro mechanical system)) technical development is rapid, and many motion sensors based on MEMS technique are very ripe, and is applied in many places, as various portable equipments, wearable device etc.Therefore in mouse, built-in MEMS sensor is very easily.Acceleration sensing can provide the acceleration parameter of motion, conventionally adopts 3 axle construction of quadrature, can measure the acceleration parameter on 3 D stereo coordinate system different directions.In the present invention, be not limited to and adopt which kind of acceleration transducer, be also not limited to the acceleration transducer that adopts several axles, as long as can measure or the action of rising and falling.
In order to describe the spatial movement of mouse, first need to set up the reference coordinate of mouse coordinates and relative motion.Suppose a three-dimensional system of coordinate, as shown in Figure 4.Mouse center is placed on its initial point O; The bottom surface of mouse is parallel to X-Y plane, and the longitudinal axis of mouse is parallel to X-axis, and the place ahead (left and right press key position, direction shown in (2-4) in Fig. 2) points to the negative sense of X-axis; The transverse axis of mouse is in Y-axis, and the forward (direction shown in (2-6) in Fig. 2) of Y-axis is pointed on right side; The Z-axis of mouse is parallel to Z axis, and just facing to the positive dirction of Z axis, bottom surface is towards the negative direction of Z axis.Set the coordinate system that this is mouse, be used for describing mouse self.The coordinate system of mouse relative motion, still with the reference of Fig. 4 position, is placed in this coordinate system by desktop.Setting desktop place face is X-Y plane, and the normal direction of desktop is Z axis positive dirction.
The simplest method that sensitive mouse tilts is to adopt to measure the single-axis acceleration sensors that axle is placed perpendicular to mouse bottom surface, measure axle parallel with mouse Z axis (direction down, Z axis negative sense), placement relation as shown in acceleration transducer in Fig. 7 (7-3), has supposed that its measurement axle overlaps with mouse vertical central axis.At mouse, do when conventional mobile, due to it and mouse mobile plane (being desktop) quadrature conventionally, so the output of ideal situation lower sensor is always gravity acceleration value, i.e. 1g.When mouse run-off the straight, suppose that inclination angle is θ, the so now output of acceleration transducer becomes: cos (θ) g, as shown in arrow (7-5).In Fig. 7, (7-4) vertical desktop is downward, has represented the acceleration of gravity of 1g, (7-5) is the component that decomposes sensor Z-axis direction, is (7-6) to decompose sensor Y-component.This mode can detect inclination, but can not detect, is the inclination in which direction.When adopting the acceleration transducer of 2 axles, if one is measured axle at Z axis, measure axle in Y-axis for one, and sensing is consistent with Y-axis, can detect and tilt.Conventionally when mouse is when desktop moves, the output of the acceleration of Y-axis, can be for just also can be for bearing, and absolute value depends on that operator moves left and right the acceleration of mouse; When mouse does not move left and right, Y-axis is output as zero.When comparatively desirable surface level moves, in the not variation of acceleration measurement of Z-direction, or seldom change.The action that occurred to tilt once mouse does not move,, except the accekeration of sensor Z axis changes, the acceleration output valve of Y-axis also changes, and this value depends on the angle and direction of inclination.Size under static is ± sin (θ) g to be tilted to the right into just, as shown in (7-6); Be tilted to the left as negative.If tilt forward and back if detect, only the sensor measurement direction of principal axis that is placed on mouse Y-axis need be adjusted to X-axis.If want left-right and front-back to tilt, all will detect, to need to adopt 3 axle acceleration sensors simultaneously, 3 of sensor measure 3 parallel placements of axle of axle and mouse.
Another implementation of perceived inclination action is to adopt MEMS gyroscope, the speed that gyroscope can perception rotation.Suppose to adopt the gyroscope of 3 axles, its sensitive axes X, Y, Z axis is placed consistent with mouse reference coordinate axle (Fig. 4).Conventionally, when mouse planar moves, the rotation that may exist is the rotation around Z axis, not output in X and Y-axis.But, when generation mouse tilts, will in X-axis, have output; When tilting forward and back, will in Y-axis, there is output.Output valve obtains the big or small speed that depends on operation.By detecting the positive and negative of output valve and changing, can judge it is the inclination to which direction.As gyroscope X-axis output valve just became from zero before this, then from zero, become and bear vanishing again, be exactly that right bank operation has occurred so.Compare the impact whether gyroscope is not tilted by desktop self with acceleration transducer.
Mouse rise and fall action detection according to one of be acceleration transducer.Because the action of rising and falling is difficult to standard, the level that can't deliberately maintain is lifted and is put down, and the judgement dependence of the accekeration in X, Y-axis is poor conventionally, and the acceleration output of Z axis becomes the optimum basis that identification mouse rises and falls.The action (comprising tilting action) of rising and falling of mouse is first lifted often and is then put down to encounter desktop and finish, so the output of Z axis acceleration transducer is with respect to the normality of lg, will be one and first become then to diminish greatly and become the process returning after large again.The transient acceleration value that mouse is fallen desktop becomes larger, is a small impact process.According to this changing pattern, tilting action also can be as the criterion of rising and falling, conversely or the assistant criteria that occurs as tilting action of this small impact.
Mouse tilts and the detection of the action of rising and falling can also be dependent on can perception run-off the straight other sensor, as being arranged on respectively the photoelectric sensor, pressure transducer etc. of the mouse left and right sides or rear and front end.In the mouse both sides that are prepared for detecting, the left and right sides utilizing as being easy to, by marginal position, settles respectively photoelectric sensor or pressure transducer in left and right, mouse bottom surface, the output of each sensor is connected to mouse controller, and mouse controller is processed, adjudicated the signal of sensor.When Figure 11,12 shows respectively adopts pressure sensor and photoelectric sensor and the annexation of mouse controller.
Photoelectric sensor adopts sensor that can perception visible light wave range, can perception surround lighting.Before normal light electric transducer, there is a simple optical system, converge the light signal in light-receiving visual field, and realize the guiding to light.During concrete installation, the photosensitive surface of photoelectric sensor is a little less than mouse baseplane, and as shown in Figure 8, light receiving unit (8-4), (8-6) are in bottom groove.When mouse does not lift action, mouse bottom and desktop (8-2) close contact, surround lighting is blocked, the photoelectric sensor of the left and right sides (8-4), (8-6) can not receive any light, or only can receive the light a bit leaking because desktop is coarse, its output electrical signals is close to zero.When mouse one side (as left side) is lifted, as shown in Figure 9.Shown in arrow (9-4), ambient lighting is mapped to desktop and reflects mouse bottom surface, the light that the photoelectric sensor (9-1) that makes to lift a side receives by field of view of receiver (9-5) sharply increases, much larger than the light leak that does not lift a sidelight electric transducer (9-2) and receive.Mouse signal processing unit utilizes the variation of this optical output signal and diversity judgement mouse whether tilting action has occurred and to the inclination of which direction.When generation mouse rises and falls action, after being lifted, mouse both sides put down again, and all there is high-lighting and increase variation in the sensitization of mouse both sides, in output, shows as burst signals in short-term, and signal processor can be adjudicated thus.Photoelectric sensor is on mounting structure, and the light entering when a side is lifted is leaked to opposite side, and light-receiving window is defined in the subrange in mouse outside, and the bottom of mouse adopts and is difficult for reflective material coating simultaneously, as black.When lifting a side of mouse, can limit the light-receiving window that light leak enters into opposite side like this, to guarantee the correctness of judgement.In this way judge the inclination of mouse, the impact of rising and falling and not whether tilted by desktop (mouse pad etc.), and the taken away from desktop according to whether only.Can find out, adopt contrary method for designing effective equally, under mouse normality, light can both be experienced in both sides, and when tilting, a side can be experienced light, and the light crested of a side.
Conventional mouse is equipped with the foot pad (Teflon material, PVC plastics etc.) that a plurality of (being generally distributed in four jiaos) promotes the sense of mouse gliding smoothing at present conventionally in bottom.When adopts pressure sensor detection mouse is inclination or no lifting, pressure transducer can be arranged on below these foots pad, and its output is connected to mouse controller.Conventionally, mouse keeps flat desktop not to be had when hand-held, and each pressure transducer is stressed in a basic balance, all has output and difference little.When hand-held use, due to the difference of personal habits and be difficult to carry out standard, the output difference of each pressure transducer may be very large, but one has established a capital output.When mouse one side is lifted, the Output pressure of this side pressure sensor perception will obviously weaken to approaching or equalling zero, and opposite side Output pressure likely increases.Mouse signal processing unit is according to each side pressure sensor output valve and difference each other, the generation of judgement tilting action and to where tilting.When mouse is whole while lifting, all pressure transducer outputs will be zero, and this is an obvious judgement symbol, and when such signal occurs during normal use in short-term, mouse signal processing unit can judge the mouse action of rising and falling has occurred.Therefore,, by judging the output of each side pressure sensor, can judge the inclination of mouse and the situation of rising and falling.
The detection of mouse inclination, the action of rising and falling can be dependent on the output of the built-in imageing sensor of optical mouse.The imageing sensor using in mouse is at present the image of continuous acquisition desktop perform region, high resolving power ground fast, in order to promote desktop texture representing in imageing sensor, commonly uses more suitably light and assists irradiation, to improve image resolution ratio.Mouse images processing unit is according to the change in location of same characteristic area in each two field picture being calculated to moving direction and the displacement of mouse.Be to locate in one plane when conventionally mouse is used, so the imaging optical system of mouse focuses on fixed range in the plane being irradiated by light below optical window when design, this is the designing requirement of imaging definition when the highest.
When mouse taken away from desktop, no matter to which type of imaging optical system, imageing sensor is because image that out of focus becomes will thicken, and fuzzy degree depends on the distance of mouse taken away from desktop, and the consistance that entire image is fuzzy depends on that mouse is with respect to the inclined degree of desktop.
Vertical take off and landing operational motion for mouse, is only greater than to a certain degree (as being greater than the spacing of several millimeters), all can cause entire image to occur fuzzy, makes the graphics processing unit of mouse, cannot continue to obtain textural characteristics information from image.The image taking speed of optical mouse is in thousand frame magnitudes per second, much larger than conventional video frame rate.Therefore, in the integral body of mouse, rise and fall in process, it is relative progressive formation that the out of focus distance of image is observed frame by frame, and the fuzzy of image is gradual change in time, but observation is mutation process outside the time frame (about 1 second) of operational motion.Curve in Figure 14 (14-1) has been illustrated the trend that this image definition changed with the motion action time.In figure, hypothesis is before T1, and mouse is in normal desktop mode of operation, and the sharpness of desktop is more or less the same, and maintains dotted line (14-2) level; When starting to lift after mouse constantly at T1, the sharpness of image sharply reduces, and state very soon reaches capacity; At mouse, put down in process subsequently, the sharpness of image is fast quick-recovery again; At T2, constantly reach after desktop, return to the sharpness of normality.Mistiming between T1 and T2, depend on operator's responsiveness.In actual utilization, can be limited or set, as within 2 second time, if super, go beyond the scope, can think that abort operation or mouse, desktop etc. have occurred extremely.According to this, according to disappearance gradually or the recovery of current every two field picture texture, and the sudden change on second-time interval, graphics processing unit can judge that this kind of situation is exactly the action of rising and falling that globality has occurred mouse.
The imaging window of supposing mouse is positioned at mouse bottom center position, as shown in figure 10, in figure, (10-3) is imaging window, (10-4) be the object lens of imaging system, suppose it is vertical imaging system, optical axis (10-7) is perpendicular to desktop (10-2), and scale (10-5) illustrated dimension d is reasonable object distance.D constant (disregarding desktop roughness) during normal rolling mouse, the desktop area under imaging window will clearly be imaged under the irradiation at LED (3-4) on photoelectric sensor (3-7).
When mouse run-off the straight, the optical axis of imaging system (11-7) is no longer perpendicular to object plane (11-2), but an angle θ of existence.On object plane, each point object distance changes, and is greater than on the whole d, and additional amount increases progressively between scale (11-5) illustrated dimension d1 and scale (11-6) illustrated dimension d2, and this will finally cause the corresponding each point of become image proportional to object distance fuzzy.
To inclination imaging system, if mouse sloping shaft is parallel with optical imaging system sloping shaft, when vergence direction is identical, added in addition inclination angle, when vergence direction is contrary, reduced inclination angle.Any change all causes the relative changes of each point object distance on object plane, and imaging has proportional fuzzy to the variation of each point object distance equally.If mouse sloping shaft and optical imaging system sloping shaft quadrature, increase progressively condiment distance along mouse vergence direction each point on object plane, still cause that corresponding imaging each point is associated with angle of inclination to increase progressively (and non-linear) fuzzy.
Which kind of mode no matter, Changing Pattern is identical, can adopt similar processing mode.While being tilted to the right operation as mouse, whole operational motion is within the time of about one second, slightly lifts mouse left side and puts down rapidly.Macroscopical imaging corresponding to this process changes: normal picture → image blurring → normal picture.The fuzzy process that strengthens gradually that experienced of image wherein, and, the left side that the fuzzy speed on image right side and fog-level are greater than image.As long as image processing system can real-time monitor this variation, just can correctly judge mouse whether inclination has occurred, be to which direction to tilt.
The detection of this imaging difference is had to several different methods in image processing techniques, and Main Basis is the sharpness of image, to the judgement of sharpness, can be dependent on the analysis to image texture edge feature.On the desktop of specific materials, when figure image focu is accurate, texture is the most clear, and intensity contrast is strong, and lines are fine and smooth, and when image out of focus, texture is fuzzy, intensity contrast step-down, and lines are smudgy.
Wherein comparatively simple a kind of processing and testing process as shown in figure 15, have only been described Local treatment mode when mouse tilts or mouse rises and falls here.Suppose the various parameters of current mouse to be arranged, and obtained the statistical information of work at present desktop, such as texture density.Quick accurate owing to not needing as following the tracks of mouse pointer, therefore adopt the mode of sampling to process abstract image, but not original image is processed frame by frame, be rational selection.Such task can be given mouse images processor and be completed.First the image extracting according to the ratio of setting carries out, and such as 1/10th, can reduce a lot of computing workloads.Then picture frame is carried out to edge detection process, obtain texture image.Texture density to texture image quantizes, and simple quantification is counting.Counting according to can be lines length total value, lines total number, or meet the quantity of certain length lines, obtain texture density value a: D_edge.Mouse start application in, can automatically select according to working top characteristics of image.If this value D_edge is also not more than the contrast thresholding T_edge setting according to the upper limit of the fluctuation range of marginal density statistical value under normality, so just think that mouse, in conventional use state, is in one plane to move.Once exist D_edge value to exceed continuously this value T_blur time, just preliminary identification mouse has the trend of leaving desktop.Now, the image starting extracting carries out piecemeal again, calculates the marginal density of each piece.Owing to only considering tilting of mouse herein, therefore the Statistics of Density of piecemeal is limited to left and right part simply, count respectively D_left and D_right (actual texture density is stepped the increasing progressively of certain time point meeting, and meticulousr statistics can be divided into image more strips and analyze).Continuous recording difference of (T_one, the approximately time of single job action) D_left and D_right in limiting time exceeds the number of times of certain thresholding T_lr.Be which exceeds and lift which side that just assert mouse, setting corresponding sign of flag _ left or Flag_right is 1.This sign subsequently will be by the instruction of tilting accordingly of master routine query execution.If within the time limiting, the edge statistics value of left and right piecemeal does not meet judgment condition, and the fuzzy number of times of the appearance of entire image has exceeded certain thresholding T_LiftDown, can assert that the integral body Action Events that rises and falls has appearred in mouse, setting event flag Lift_Down is 1.Of this sort treatment scheme equally can be for the interpretation tilting forward and back.Processing in addition and testing process can be image to be carried out to bidimensional Fourier transform or other can reflect the mathematic(al) manipulation of image low-and high-frequency composition in result, as wavelet transformation, cosine transform etc.The size of the high frequency thresholding of Fourier transform has been reacted the edge component of image.Therefore contrast the high frequency thresholding of entire image or image block, just can judge the texture density of entire image or block image.If wherein there is larger difference, can determine whether thus that mouse has occurred to tilt or the action of rising and falling.
According to processing result image, detect mouse action action, it is irrelevant whether this method and desktop self tilts, and only depends on the relation between mouse bottom surface and desktop.
Operator comes and goes and shakes mouse fast according to setting means, mouse pointer is switched to the mode of operation on next display along selected direction by pointer, can rely on aforementioned acceleration transducer built-in in mouse, also can be without increasing any hardware, but the judgement that only relies on the special movement track of mouse to carry out.Special is movement and the mode of operation that means mouse when this move mode can be different from normality significantly.If user is when finding that mouse pointer is lost, can be by mouse left and right or rock back and forth tempestuously, or mouse-up is put down again.Though these subconscious behaviors vary with each individual, behavior is similar substantially, all differs from the mouse action action of normality.This class behavior, as long as learn a little, define, is got to suitable set of modes, and as pointer switching, pointer playback, or other instruction can not obscured with the mouse move operation of normality completely.
The parameter of set model can comprise the direction that mouse moves, mobile speed, round speed, round number of times etc., and the setting of these patterns meets user's behavioural habits on the one hand, also can think on the other hand to have a kind of agreement character; Its medium velocity, acceleration are to be different from the important symbol that normality moves.During practical application, can by mouse, first be learnt to identify user's operating habit, then by user, be confirmed.Such as first allowing user oneself give mouse the shaking way of the mode of the shake mouse of being accustomed to most or oneself preparation employing, identify, after mouse identification, extract principal character, provide again on this basis a well-to-do scope.Can adopt the method for similar character recognition, also can adopt comparatively simply judgement, as quick double swerve mouse, provide several typical parameters: round minimum number (as more than 2 times), come and go the minimum period (as 0.5 second, this is one of key character, defines speed) etc.This operation coordinates without other button, purely depends on the method for operation of mouse.Course writer is set in mouse, opens up a storage area, store specially mouse track, make mouse have Memorability to its operation result.By the analysis to (in 1.5 seconds, can be default) mouse continuous path in special time period, judge whether to have the orbit segment of pattern up to specification.If mouse has acceleration transducer, so this double swerve can be judged that by the output valve of acceleration transducer Y-axis (track is in Figure 16 above as shown in the 1st, 2 curves, this is the actual mouse track figure gathering, not through training constraint), criterion is identical, i.e. the minimum number of accekeration sign change in special time.Similar operator scheme, mouse (as shown in the 3rd curve in Figure 16) is rocked in front and back, the oblique mouse that rocks, semicircle (can be used as pointer switching command left fast counterclockwise, mouse motion track is as shown in the 4th curve in Figure 16), draw fast clockwise semicircle and (can be used as switching command to the right, mouse motion track is as shown in the 5th curve of Figure 16) etc., all can according to motion characteristic, original signal (not relied on to the pointer showing on screen by image processor or the controller of mouse, as long as the actual motion track of mouse meets, be not subject to the constraint of screen display scope) carry out determining after simple pattern-recognition, or additional specific mouse application program is determined by the movement locus identification of screen cursor on computers.
Mouse right and left key is pressed as mouse pointer switching command simultaneously, is to adopt two operations that the left button of mouse and right button are pressed simultaneously of referring to or singly refer to.Due to the equal nonplanar structure of right and left key of conventional mouse, the dynamics of two fingers can be not identical yet, presses right and left key simultaneously operator is had relatively high expectations with two fingers.In order to guarantee and to be convenient to press two buttons simultaneously, utilize the adjacent feature of right and left key on mouse structure, by a groove of adjacent regions design in the middle of right and left key front end, one hand refers to can power be applied on two buttons when to groove simultaneously, two bond energys are enough pressed in the most synchronous mode, make mouse controller be easy to accurate detection.The position of groove, at mouse roller front end, does not affect conventional right and left key and roller operation.
Above-mentioned various pointer switching mode, when reality adopts, can be selected as required or combine.
Setting position, the direction of action in mouse body such as aforementioned keys, directionkeys, roller, be according to the conventional structure of mouse and conventionally user use habit and the thumb manipulation function that increases is made the essence that corresponding adjustment does not change this patent while utilizing other customs and other finger manipulations.Described any pointer blocked operation mode is not limited to pointer blocked operation, and they all can be defined as other operation purposes by operating system or application program as required, as page turning, game manipulation etc.Mode of operation proposed by the invention and implementation, be not limited to traditional optical mouse, and any human machine input device can adopt similar mode realize relevant with pointer or similarly switch.The present invention is also not limited to man-machine interface, adopts relevant overall technology or local techniques in the present invention also to can be used in similar behaviors such as judgement, detection in other type equipment.
Core of the present invention is create the operational order mode of mouse pointer switching and realize measure, the feature of this class mode is only to rely on one hand can complete easily on mouse, and be independent of any application program of computing machine, only accept the management of computer operating system or mouse driver.
Claims (7)
1. realizing mouse pointer between a plurality of displays, to switch fast what relate to be with a mouse between many displays in computer drives, the mode of operation of being carried out quick pointer position redirect by operator with realize measure; Computing machine is the equipment of realizing data calculating, processing, control function independently any or Embedded, multiple step format; Display is that computing machine carries or external display, projector, televisor etc. can be connected to the display device of computing machine; MouseAcross is crossed wired or wireless medium and is connected to computing machine; User is by equipment manager or the graphics driver of operating system, and to many display serial numbers, the location that relate to, select operating mode, sets in advance, calibrates mouse function parameter, use option; Display actual arrangement mode is numbered in order left and right and is settled, and also can arrange according to any self-defining spatial relation, and the switching direction of mouse pointer is only according to the serial number of display; Computing machine is realized the quick switching of mouse pointer according to the combination of one of following mode of operation or following mode of operation:
A) on mouse top, roller key is set, roller key to the left and right certain direction is stirred once, and mouse pointer switches once to the display of this direction definition;
B) in mouse side, roller is set, the roller lattice that roll forward, mouse pointer to the left display switches once, the roller lattice that roll backward, mouse pointer to the right display switches once;
C) in mouse side, directionkeys is set, to certain direction, stirs once, mouse pointer just switches once to the display of this direction definition;
D) in the side of mouse, special button is set, after pressing this key: often by left mouse button once (or, left jog dial key, forward scroll wheel, stir directionkeys left), mouse pointer to the left display switch once; Often by right mouse button once (or, to the right jog dial key, backward scroll wheel, stir directionkeys to the right), mouse pointer i.e. display to the right switches once; Or, often pressing this key once, mouse pointer is switched to next display along presetting direction;
E) in mouse side, membrane keyboard is set; Membrane keyboard can be the pressure transducer that direct sensed pressure changes, or the electric capacity of sensed pressure result of variations is, the sensor of electrical resistance property, or the photoelectric sensor that changes of perception surround lighting etc.; On membrane keyboard, occur after specific touch mode, at once press left mouse button or right button (or corresponding jog dial key, directionkeys), mouse pointer to the left or right side display switch once; One of specific touch pattern is playback fast again after being positioned at thumb on membrane keyboard and lifting fast;
F) with the switching of the inclination of mouse, the action triggers of rising and falling mouse pointer; When mouse tilts once to certain direction, mouse pointer switches once to the display of this direction definition; Or, every inclination or lift mouse once, mouse pointer is switched to next display along predefined direction by pointer;
G) operator shakes mouse fast according to the pattern that presets, and mouse pointer is switched to next display along predefined direction by pointer;
H) press left mouse button and right button once, mouse pointer is switched to next display along the direction of setting by pointer simultaneously.
2. according to claim 1ly between a plurality of displays, realize mouse pointer and switch fast, wherein
A) described switching refers to and needn't make mouse pointer cross over indicator screen by artificial continuous moving mouse, but by computer program, by mouse pointer, from a display, no matter any position directly jumps on another one display, can show or not show the track of any pointer movement around here;
B) when mouse pointer is when a display is switched to another one display: drop point site can preset, such as always in the middle of screen, or the limit etc. that keeps left; When the pointer icon occurs on target indicator, first to recover former pointer shape after eye-catching form sign switching result, eye-catching form comprises the change of pointer shape, color, size and makes pointer at local motion etc.;
C) when pointer switches to same direction continuously, run into after the display on limit, the mode that can select to circulate forwards on the display on other one side; Or, rest on current display, now pointer is with eye-catching form sign operating result.
D) can select the conventional continuous moving of mouse pointer to take current display as border, only, when there is mouse pointer switching command, mouse pointer just jumps to other display, or selects both effectively simultaneously;
E) can select to enable or close mouse pointer turn function.
3. according to claim 1ly between a plurality of displays, realize mouse pointer and switch fast, wherein
A), with the switching of the inclination of mouse, the action triggers of rising and falling mouse pointer, can distinguish or not distinguish and tilt and rise and fall operation; While not distinguishing, any action that can sensing position taken away from desktop of mouse is all considered as equivalence with the whole taken away from desktop of mouse; During differentiation, the local taken away from desktop of inclination finger mouse, the whole taken away from desktop of the finger mouse that rises and falls;
B) action of the left or right tilt operation of mouse is rotating shaft according to mouse bottom left and right sides one, lifts fast and put down an other side; Being take in one end before and after mouse bottom in the front or rear inclination of mouse is rotating shaft, lifts fast and put down the other end; For the ease of operational motion, the left and right sides feather edge of mouse body or front and back end feather edge, be axially flat line, be laterally circular-arc design;
C) mouse tilt, rise and fall the detection of action be dependent on can perceived inclination motion sensor, one of them is acceleration transducer; The output of acceleration transducer is connected to mouse controller; It is parallel with z axle that while adopting single-axis acceleration sensors, it measures axle, and it is parallel with Z axis that during diaxon, it measures one, axle, and one at X-Y plane, and during three axles, its measurement axle is consistent with three axles of mouse; Mouse controller changes with mouse angle of inclination, the action of rising and falling, touching desktop according to acceleration transducer output valve, detects mouse run-off the straight, the action of rising and falling;
D) detection of mouse tilting action is dependent on motion sensor that can perceived inclination, and one of them is gyroscope; Gyrostatic output is connected to mouse controller; Gyrostatic measurement axle is consistent with the vergence direction of definition; Mouse controller makes the generation of the angular velocity output detections tilting action of gyroscope generation while tilting according to mouse;
E) mouse tilt, rise and fall the detection of action be dependent on can perceived inclination other sensor, one of them is to be arranged on respectively the photoelectric sensor that the mouse left and right sides, bottom (or/and rear and front end) can sense ambient light; The output of photoelectric sensor is connected to mouse controller; Photoelectric sensor is placed in mouse bottom surface near in outer peripheral groove, and when mouse does not leave desktop, the sensitization passage of photoelectric sensor is blocked; It is in outward direction that each photoelectric sensor receives light visual field, and the light-receiving opposite direction of both sides (two ends) optical sensor deviates from relatively; Mouse controller causes the variation of photoelectric sensor received light when tilting, rising and falling according to mouse, detect inclination, the action of rising and falling of mouse;
F) mouse tilt, rise and fall the detection of action be dependent on can perceived inclination other sensor, one of them is mounted in the pressure transducer of mouse bottom; Pressure transducer is placed in below the foot pad of mouse bottom surrounding, and its output is connected to mouse controller; When mouse controller tilts, rises and falls according to mouse, corresponding position pressure changes inclination, the action of rising and falling of judgement mouse;
G) detection of mouse tilting action is dependent on the output of the built-in imageing sensor of optical mouse; The quick continuous imaging of the built-in imageing sensor of mouse; In mouse tilting procedure, because imaging optical system continuously changes the consistance of the focusing distance of desktop perform region and each point focusing, cause the consistance of desktop imaging region size and imaging definition to occur constantly to change, mouse images processor is judged the tilting action of mouse with this; At mouse, rise and fall in process, same because imaging optical system continuously changes the focusing distance of desktop perform region, make the sharpness of desktop perform region imaging in this process, have very big the change of divergence, mouse images processor judges rising and falling of mouse according to this; The judgement of image definition, is dependent on the texture density of image, and texture density more hi-vision is more clear; The density of the judgment basis of texture density edge lines in image; The density of edge lines can be defined as edge lines length summation in image, or surpasses the edge line bar number summation of certain length value.
4. according to claim 1ly between a plurality of displays, realize mouse pointer and switch fast, except the conventional roller key of mouse, the thumb that directionkeys wherein, button, roller, membrane keyboard etc. are arranged on mouse grips side; Other function of mouse can be shared these buttons, can be arranged these key-press event are defined as to other purposes by software.
5. according to claim 1ly between a plurality of displays, realize mouse pointer and switch fast, wherein said left mouse button and the right button simultaneously pressed, in order can singly to refer to operation and to guarantee that right and left key is pressed as far as possible simultaneously, the adjacent zone line of right and left key front end is designed to hold the groove shape singly referring to.
6. according to claim 1ly between a plurality of displays, realize the device that mouse pointer switches fast, the detection method that wherein operator shakes mouse fast according to set model is:
A) mouse controller detects whether there is the movement that meets set model from the mouse motion track of mouse images sensor continuous wave output, or in the data of normally inputting main frame at mouse by the operating system of computing machine, driver etc., judge whether to have the movement that meets set model, or whether mouse controller there is from the output detections of the built-in motion sensor of mouse the movement that meets set model;
B) set model parameter comprise mouse moving direction, translational speed, shuttle speed, come and go number of times etc., the setting of these patterns can retrain or detect operator's pattern; Fast mouse is rocked in double swerve mouse, front and back, oblique to rock mouse, draw a circle fast counterclockwise, draw a circle fast be clockwise more adoptable patterns.
7. according to claim 1ly between a plurality of displays, realize mouse pointer and switch fast, wherein all pointer skip operation modes can be as forcing pointer to revert to the instruction of certain ad-hoc location, no matter pointer present position, no matter whether find Loss Of Pointer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410288891.5A CN104049779A (en) | 2014-06-25 | 2014-06-25 | Method and device for achieving rapid mouse pointer switching among multiple displayers |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410288891.5A CN104049779A (en) | 2014-06-25 | 2014-06-25 | Method and device for achieving rapid mouse pointer switching among multiple displayers |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104049779A true CN104049779A (en) | 2014-09-17 |
Family
ID=51502742
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410288891.5A Pending CN104049779A (en) | 2014-06-25 | 2014-06-25 | Method and device for achieving rapid mouse pointer switching among multiple displayers |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104049779A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461320A (en) * | 2014-12-03 | 2015-03-25 | 合肥联宝信息技术有限公司 | Method and device for displaying double mouse pointers on double computer screens |
| CN106933362A (en) * | 2017-03-14 | 2017-07-07 | 联想(北京)有限公司 | A kind of control method of mouse, mouse controller and electronic equipment |
| CN107704116A (en) * | 2017-10-18 | 2018-02-16 | 冯迎安 | A kind of mouse multi-screen gesture identification method |
| CN108205379A (en) * | 2016-12-16 | 2018-06-26 | 微软技术许可有限责任公司 | Roll wheel assembly and mouse |
| CN110209449A (en) * | 2019-05-21 | 2019-09-06 | 腾讯科技（深圳）有限公司 | Cursor positioning method and device in a kind of game |
| CN110389669A (en) * | 2019-07-31 | 2019-10-29 | 北京金彩科技有限公司 | The transmitting module switching device and control method of a set of mouse control two computers |
| CN111915655A (en) * | 2020-08-12 | 2020-11-10 | 无锡英斯特微电子有限公司 | Method and system for judging distance between photoelectric navigation equipment and target plane |
| CN113426096A (en) * | 2021-07-22 | 2021-09-24 | 网易（杭州）网络有限公司 | Method and device for switching props in game, electronic equipment and storage medium |
| WO2022111690A1 (en) * | 2020-11-30 | 2022-06-02 | 华为技术有限公司 | Method for sharing input device, electronic devices, and system |
| TWI820661B (en) * | 2022-04-01 | 2023-11-01 | 群光電子股份有限公司 | Mouse device and method for switching target device |
| WO2023231893A1 (en) * | 2022-05-31 | 2023-12-07 | 华为技术有限公司 | Cursor display method and electronic device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1794153A (en) * | 2004-12-20 | 2006-06-28 | 国际商业机器公司 | Method and system for quick screen switching in a multi-monitor environment |
| CN102402315A (en) * | 2010-09-17 | 2012-04-04 | 联想(北京)有限公司 | Mouse pointer control method and system and control device |
| CN102541304A (en) * | 2010-11-19 | 2012-07-04 | 微软公司 | Gesture recognition |
| US20120272179A1 (en) * | 2011-04-21 | 2012-10-25 | Sony Computer Entertainment Inc. | Gaze-Assisted Computer Interface |
| US8508470B2 (en) * | 2006-01-31 | 2013-08-13 | Jerry Moscovitch | Cursor management system |
-
2014
- 2014-06-25 CN CN201410288891.5A patent/CN104049779A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1794153A (en) * | 2004-12-20 | 2006-06-28 | 国际商业机器公司 | Method and system for quick screen switching in a multi-monitor environment |
| US8508470B2 (en) * | 2006-01-31 | 2013-08-13 | Jerry Moscovitch | Cursor management system |
| CN102402315A (en) * | 2010-09-17 | 2012-04-04 | 联想(北京)有限公司 | Mouse pointer control method and system and control device |
| CN102541304A (en) * | 2010-11-19 | 2012-07-04 | 微软公司 | Gesture recognition |
| US20120272179A1 (en) * | 2011-04-21 | 2012-10-25 | Sony Computer Entertainment Inc. | Gaze-Assisted Computer Interface |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461320B (en) * | 2014-12-03 | 2017-11-24 | 合肥联宝信息技术有限公司 | A kind of method and device that double mouse pointers are shown on computer computer double screen |
| CN104461320A (en) * | 2014-12-03 | 2015-03-25 | 合肥联宝信息技术有限公司 | Method and device for displaying double mouse pointers on double computer screens |
| CN108205379B (en) * | 2016-12-16 | 2021-04-27 | 微软技术许可有限责任公司 | Roller assembly and mouse |
| CN108205379A (en) * | 2016-12-16 | 2018-06-26 | 微软技术许可有限责任公司 | Roll wheel assembly and mouse |
| CN106933362A (en) * | 2017-03-14 | 2017-07-07 | 联想(北京)有限公司 | A kind of control method of mouse, mouse controller and electronic equipment |
| CN106933362B (en) * | 2017-03-14 | 2021-11-16 | 联想(北京)有限公司 | Mouse control method, mouse controller and electronic equipment |
| CN107704116A (en) * | 2017-10-18 | 2018-02-16 | 冯迎安 | A kind of mouse multi-screen gesture identification method |
| CN110209449A (en) * | 2019-05-21 | 2019-09-06 | 腾讯科技（深圳）有限公司 | Cursor positioning method and device in a kind of game |
| CN110389669A (en) * | 2019-07-31 | 2019-10-29 | 北京金彩科技有限公司 | The transmitting module switching device and control method of a set of mouse control two computers |
| CN111915655A (en) * | 2020-08-12 | 2020-11-10 | 无锡英斯特微电子有限公司 | Method and system for judging distance between photoelectric navigation equipment and target plane |
| CN111915655B (en) * | 2020-08-12 | 2024-04-26 | 无锡英斯特微电子有限公司 | Method and system for judging distance between photoelectric navigation equipment and target plane |
| WO2022111690A1 (en) * | 2020-11-30 | 2022-06-02 | 华为技术有限公司 | Method for sharing input device, electronic devices, and system |
| CN113426096A (en) * | 2021-07-22 | 2021-09-24 | 网易（杭州）网络有限公司 | Method and device for switching props in game, electronic equipment and storage medium |
| TWI820661B (en) * | 2022-04-01 | 2023-11-01 | 群光電子股份有限公司 | Mouse device and method for switching target device |
| WO2023231893A1 (en) * | 2022-05-31 | 2023-12-07 | 华为技术有限公司 | Cursor display method and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104049779A (en) | Method and device for achieving rapid mouse pointer switching among multiple displayers | |
| US20220129060A1 (en) | Three-dimensional object tracking to augment display area | |
| US9746934B2 (en) | Navigation approaches for multi-dimensional input | |
| KR101365394B1 (en) | Light-based finger gesture user interface | |
| US8947353B2 (en) | Photosensor array gesture detection | |
| KR101809636B1 (en) | Remote control of computer devices | |
| US8810509B2 (en) | Interfacing with a computing application using a multi-digit sensor | |
| JP6074170B2 (en) | Short range motion tracking system and method | |
| US20080134078A1 (en) | Scrolling method and apparatus | |
| US20130335324A1 (en) | Computer vision based two hand control of content | |
| DE112012006199T5 (en) | Virtual hand based on combined data | |
| US20110298708A1 (en) | Virtual Touch Interface | |
| CN104423799B (en) | Interface arrangement and interface method | |
| CN104508605B (en) | The modified form device being used in conjunction with computer | |
| CN109426360B (en) | Display control device, pointer display method, and non-transitory recording medium | |
| US9310851B2 (en) | Three-dimensional (3D) human-computer interaction system using computer mouse as a 3D pointing device and an operation method thereof | |
| CA2881581A1 (en) | Augmented peripheral content using mobile device | |
| CN109460160B (en) | Display control device, pointer display method, and non-transitory recording medium | |
| CN103455210B (en) | With the high-res and high sensitive touch controller of optical means driving | |
| KR20140086805A (en) | Electronic apparatus, method for controlling the same and computer-readable recording medium | |
| KR102101565B1 (en) | Media display device | |
| JP2019150137A (en) | Game program, method, and information processing apparatus | |
| Heo et al. | Designing for Hover-and Force-Enriched Touch Interaction | |
| IL222043A (en) | Computer vision based two hand control of content | |
| IL224001A (en) | Computer vision based two hand control of content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140917 |