CN106484125A

CN106484125A - Human-computer interaction device of new generation, electronic installation and method

Info

Publication number: CN106484125A
Application number: CN201610578564.2A
Authority: CN
Inventors: 邱波
Original assignee: Individual
Current assignee: Zhejiang Xuxiang Information Technology Co Ltd
Priority date: 2006-12-19
Filing date: 2007-12-19
Publication date: 2017-03-08
Anticipated expiration: 2027-12-19
Also published as: CN101595445A; CN101324812A; CN101595445B; CN106484125B; CN101324812B

Abstract

A kind of human-computer interaction device, including the first input unit and secondary input device, whole or a certain functions at least part operation region of secondary input device is located in the button operation region of first input unit；First input unit can be press key input device, and secondary input device can be mouse emulation device.Further provide electronic installation and the man-machine interaction method using the human-computer interaction device.

Description

Human-computer interaction device of new generation, electronic installation and method

Technical field

The invention mainly relates to computer man-machine interacting (HCI----Human Computer Interaction) field, More particularly to a kind of human-computer interaction device, electronic installation and man-machine interaction method.

Background technology

Today's society, computer have obtained application widely, and computer-aided equipment is indispensable part, people Machine interactive device is important computer-aided equipment in interactive process again, such as keyboard, mouse and handwriting pad etc..

The keyboard of prior art has following two：

Hard manual, including external connection keyboard, the such as common external connection keyboard of desktop computer；Also include the keyboard with main frame one, such as Notebook computer or the keyboard with main frame one of palm PC；And keyboard special, as applications such as numerical control device, cashier's machines Keyboard special, etc..

Soft keyboard, the keyboard figure being shown on screen, can by way of mouse or touch input information.Soft keyboard It is the soft keyboard that can show as input unit, can be used for the electronic installations such as portable set, console or control panel.

The device of realizing of prior art mouse function has following four：

External access of mouse, such as conventional roller or optical mouse；

External trace ball, similar to a kind of input equipment of mouse, directly stirs trace ball by hand to realize light target Mobile, while can also be provided with button to realize and mouse right and left key identical function；

Touch pad or touch-screen etc. are touch input or the device of output；Trackpad, also referred to as touch pad (English, TouchPad), as the widely used touch pad mouse below host keyboard of current notebook computer.The use of touch pad Very simple, the touch pad below finger touch keyboard, light rotating savings is with movement；The surface for rapping touch pad will be identified that and click Or double-click etc. corresponding mouse action.

TrackPoint, English are TrackPoint, are invented by IBM Corporation, are common in the notebook computer of IBM at present In, it has a little button to be located between tri- key of G, B, H of keyboard, also has two big buttons below the blank key, and which is medium and small to press Button is capable of the size and Orientation of finger sensing thrust, and thus controlling the motion track of mouse, and the big button of lower section is suitable Right and left key in standard mouse.

The handwriting pad of prior art has following two：

External handwriting pad, is external in computer, completes the input function as Chinese character and figure；

Compound handwriting pad, is combined into one with Trackpad, that is, achieves the input Chinese character of handwriting pad on the touch pad And the function of figure.

In the conventional human machine input device of three of the above, the application combination in a computer of keyboard and mouse be broadly divided into Lower several ways, handwriting pad can be external in main frame or be realized with Trackpad.

Mode one, mouse is external in main frame

This mode is related to desktop computer, and (some also can due to due to be accustomed on notebook computer with notebook computer External access of mouse use).

Its advantage is that mouse is flexible and convenient to use, and which has the disadvantage to be independently arranged due to mouse, operation when due to keyboard with Mouse (or handwriting pad) is separated, and needs frequently mobile forearm, inefficiency, while carrying inconvenient.

Mode two, realizes the device of mouse function and keyboard is fixed on main frame

This mode be exactly current notebook computer using by the way of, the first is below the fixing keyboard of notebook computer One Trackpad is set, and which has the disadvantage, in operation due to there is a certain distance between keyboard and Trackpad, to need frequently mobile Forearm, inefficiency.Its two be notebook computer fixation keyboard in TrackPoint is set, arrange two below the blank key Big button, its have the disadvantage that two have greatly a certain distance between button and keyboard, need frequently mobile forearm, inefficiency.

Content of the invention

The technical problem to be solved in the present invention is to provide a kind of man-machine interaction input/output unit, electronic installation and man-machine friendship Mutual method, which reduces the operating area of key-press input and mouse function, can achieve key-press input and mouse without the need for mobile forearm Mark function, high working efficiency.

In order to solve above-mentioned technical problem, the invention provides a kind of human-computer interaction device, including the first input unit and Secondary input device, it is characterised in that whole or a certain functions at least part operation region position of the secondary input device In the button operation region of first input unit；

Or,

A kind of human-computer interaction device, it is characterised in that include：Secondary input device or part thereof, and the first input dress Put or part thereof, comprising described all or part of secondary input device and all or part of first described input dress In the arbitrary region of the arbitrary size of the optional position in the region that puts or space, all or part of second described input is filled Put with described all or part of first input unit using identical region or space, i.e., wholly or in part area coincidence or Region is multiplexed；

Or,

A kind of human-computer interaction device, it is characterised in that include：Secondary input device or part thereof, and the first input dress Put or part thereof, comprising described all or part of secondary input device and all or part of first described input dress In the arbitrary region of the arbitrary size of the optional position in the region that puts or space, all or part of second described input is filled Put with described all or part of first input unit using identical region or space, i.e., wholly or in part area coincidence or Region is multiplexed, and the area coincidence or region multiplexing are area coincidence or the regions in same time or in the different time Multiplexing；

Or,

The secondary input device at least part operation region is located at described except special/only mouse function or limited function In the button operation region of the first input unit outside device, wherein limited function device refers to that the function of the device is limited Or the number of the function of the device is limited, special/the first input unit only outside mouse function or limited function device May include but be not limited to hard device or soft device；

Or,

A kind of human-computer interaction device, it is characterised in that include：For realizing the secondary input device and first of mouse function , wherein, in the region that described secondary input device region is located with the first input unit, at least there is portion in input unit Divide and overlap, the region that first input unit is located is that the regions being located by one or more input buttons are constituted, and does not wrap Include the region between each input button；

Or,

A kind of human-computer interaction device, it is characterised in that include：For realize the Trackpad of mouse function, touch-screen or its His hard input unit, and the first input unit, wherein, described Trackpad, touch-screen or other hard input units are use In the device being input into by touch manner, and the Trackpad, touch-screen or other hard input unit regions and first At least exist in the region that input unit is located and partially overlap, the region at first input unit place be by one or more Region between the region at input button place and each input button is constituted；

Or,

A kind of human-computer interaction device, it is characterised in that include：For realizing the secondary input device and soft of mouse function One input unit, wherein, at least deposits in the region that described secondary input device region is located with soft first input unit Partially overlapping, region that soft first input unit is located is the regions that are located by one or more input buttons and each Region between individual input button is constituted；

Or,

A kind of human-computer interaction device, it is characterised in that include：For realizing the secondary input device and first of mouse function Soft input unit.

Or,

The above all of first input unit can be replaced certain input unit, and wherein input unit includes that button is defeated Enter device.

Further, above-mentioned human-computer interaction device can also have the characteristics that：

The area coincidence or region multiplexing are area coincidence or the regions in same time or in the different time Multiplexing；Or,

First input unit is press key input device, i.e., by realizing the device being input into key operation, described " key " includes one or more in following form：Form, stealthy, sightless or visible on keyboard or control panel Key, button, icon, menu item, order, order setting, display mode, button or can be with the order of clicking operation or diagram, phase It is similar to the figure of input and/or output device；Form, stealthy on keyboard that software is realized or display or control panel , sightless or visible, implicit expression, the explicit or key that shows, button, icon, menu item, order, order arrange, display side Formula, button or can with the order of clicking operation or diagram, similar in appearance to input and/or output device figure；Or,

The secondary input device be for realizing the mouse emulation device of mouse function, the mouse function include but not One or more be limited in following functions：Execute, select, dragging, showing menu, mobile cursor, scrolling display screen, and Multidimensional is while mobile display；

The press key input device and/or mouse emulation device include following kind of input unit or input/output unit Or its combination, or the soft device that realizes on input/output unit：Electronic whiteboard, blank, projected keyboard device, touch-screen, touch-control Plate, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, mechanical device.

The mouse emulation device includes the part or all of region between the part or all of surface of at least one key or key, May be located at the isolated area in the key area of the press key input device or a part is located in key area, remaining Part is located at other regions；

And/or, the mouse emulation device Chong Die with the key area region multiplexing, be at least operable with by Key input and mouse function both of which；

And/or, the mouse emulation device at least part operation region is pressed with described press key input device Key operation area coincidence or region multiplexing, i.e., one region of identical can be used as or realize the work(of different, any number of devices Energy.

The mouse emulation device includes one or many in or beyond the button operation region of the press key input device Individual auxiliary element, these auxiliary elements are used for realizing all or part of mouse function of this human-computer interaction device；Or, these are auxiliary Element is helped for the part mouse function of realization, including ' display menu ' or the function of ' multidimensional is while mobile display '.

One or more controlling switches are also provided with the human-computer interaction device, for opening or closing mouse function, The controlling switch is soft controlling switch or hard controlling switch, and the region at the place of above-mentioned switch is：

In first or secondary input device region or area peripheral edge；Or,

In the region of the first input unit at least partly overlapped with secondary input device region；Or,

In soft/hard desktop computer keyboards formula keyboard at least partly overlapped with secondary input device region, pen Remember in the region of this computer key disc type keyboard or keyboard length more than X centimetre of keyboard；Wherein X be 8,10,12, 14th, 16 or 18；Or,

From soft/hard desktop computer keyboards formula keyboard at least partly overlapped with secondary input device region, Within the region of notebook keyboard-type keyboard or keyboard length more than Y centimetre of the space button of X centimetre of keyboard In region；Y is 1,3,5,7 or 9.

The controlling switch is using the one kind in following form or combination：At least one button being independently arranged, at least one TrackPoint, at least a roller ball, at least a roller, least one set Macintosh, the operation outside an at least mouse emulation device region Button, at least one mode of operation self-defining on the human-computer interaction device.

The mouse emulation device includes one or more main analogue means, and the button in the press key input device In region or one or more auxiliary elements for arranging of periphery, the main analogue means and the touching device are realized described together All or part of mouse function of human-computer interaction device, at least includes to realize the auxiliary element of cursor locomotive function and realizes mouse The auxiliary element of keypress function；

The main analogue means can include but is not limited to following kind of input unit or input/output unit or its group Close：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction Device, pressure apparatus, infrared facility, laser aid, mechanical device.

The auxiliary element includes the one kind in following form or combination：At least one TrackPoint, at least one control The roller ball of target motion, the roller of at least one control targe motion, at least one confirm the button for operating, and at least one touches Touch device, and at least one operation button for being operable with mouse functionality mode.

The press key input device is a keyboard, and the mouse emulation device includes to be arranged on the left of the keyboard or right side A main analogue means, and be arranged on some buttons of keyboard opposite side, some buttons can be selected comprising standard finger ring Middle finger returns one or more buttons thereon after button, for realizing the keypress function of mouse；Or,

The press key input device is a keyboard, and the mouse emulation device includes to arrange a main mould on said keyboard Intend device, and be arranged in keyboard region and some buttons outside the main analogue means, in some buttons, In standard finger ring, the button of left-handed operation is used for realizing the function of left mouse button, and in standard finger ring, the button of right-hand operated is used for real Existing functions of mouse right key；

The press key input device is hard manual or control panel, and the mouse emulation device is hard device, the button In the key area of input unit or periphery also sets up one or more hard controlling switches for opening and closing mouse function, Or, the soft controlling switch being provided with the mouse emulation device for opening and closing mouse function；Or,

The press key input device is soft keyboard or the soft control panel shown on human-computer interaction device, the mouse mould It is to show the soft device in human-computer interaction device to intend device, is also provided with one or more for beating on the human-computer interaction device Open or close the hard controlling switch or soft controlling switch for closing mouse function；The human-computer interaction device can include but is not limited to The input unit of Types Below or input/output unit or its combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, touch-control Plate, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser aid.

The press key input device is the soft device shown on the human-computer interaction device, and sets on the surface of key area There are the fully transparent of key shape or the film between fully transparent and completely opaque, the film is provided with keyboard rill and has There is sense of touch；One kind or combination that the human-computer interaction device includes and is not limited in following device：Electronic whiteboard, blank, projection Key board unit, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared dress Put, laser aid.

The mouse emulation device includes that a main analogue means, the press key input device and the main analogue means are Hard device, part of the main analogue means in the key area of the press key input device is pressed with described by one or more The key shape of key input apparatus and in the same size, and the main analogue means composition of the fritter that divides according to normal key bit boundary, and The main analogue means of the fritter has the elastic mechanism that can be stretched in vertical direction or move；Wherein, the main analogue means can To include but is not limited to following kind of input unit or input/output unit or its combination：Electronic whiteboard, blank, projected keyboard Device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, swash Electro-optical device, mechanical device.

The mouse emulation device includes a main analogue means, and the main mould is with intending device form, stealthyly, invisibly Or visibly, implicit expression, explicit or be explicitly divided into multiple regions, the mouse function that each region is realized can be different, The regional and its function are fixing, change or can configure；The main analogue means can include but not It is limited to following kind of device or combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touch dresses Put and device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, mechanical device.

Present invention also offers a kind of electronic installation, including above-mentioned various human-computer interaction devices.

Further, above-mentioned electronic installation can also have the characteristics that：

The human-computer interaction device for mobile phone, other hand-held devices or notebook computer keyboard-type integrated keyboard and Mouse emulation device, or the keyboard for desktop computer keyboards formula and the mouse emulation device arranged on the keyboard；Or For form, stealthy, sightless or visible, show, on keyboard being explicitly or implicitly arranged at the electronic installation The mouse emulation device of setting；Or for form, stealthy, sightless or visible, be explicitly or implicitly arranged at described Soft device on the input/output unit of electronic installation；The input/output unit can include but is not limited to following kind of defeated Enter output device or combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, electricity input Device, electromagnetic induction device, pressure apparatus, infrared facility, laser aid.

The human-computer interaction device is the soft device being shown on the input/output unit that the electronic installation includes, described Input/output unit determines the device shown in a certain region or content by the control of hardware or software, multiple comprising realizing Display device or the switching of display content；The input/output unit can include but is not limited to following kind of input and output dress Put or combine：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, device of electrical input, electricity Magnetic-inductive device, pressure apparatus, infrared facility, laser aid.

The press key input device is soft device that show on the input/output unit or setting, the mouse mould Intending device includes Trackpad or other input/output units that show on the input/output unit or setting, is opening mouse Shows or the soft Trackpad that arranges or other input/output units in overlapping region during mark function, in overlap during closing mouse function Region shows soft-key button input unit；Or

While showing the press key input device and Trackpad or other input/output units on input/output unit, its In the viewing area of a device be fully transparent or between fully transparent and opaque；

One kind or combination that the input/output unit includes and is not limited in following device：Electronic whiteboard, blank, projection Key board unit, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared dress Put, laser aid.

Present invention also offers a kind of man-machine interaction method using above-mentioned human-computer interaction device, is being filled by key-press input During putting input, such as mouse function need to be used, then all or part of mouse function be opened, can be selected at least portion Divide operating area to be located at the mouse emulation device in key area or in other input units to be operated, in this mode as needed Key-press input pattern or other patterns is switched to, then can select to close the mouse function；Wherein, the press key input device And/or mouse emulation device includes and is not limited to following kind of input or input/output unit or combination, or input and output dress Put the soft device of realization：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, electricity input Device, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, mechanical device.

Further, above-mentioned man-machine interaction method can also have the characteristics that：The mouse function in the following manner in One or more realization：

Mode A, when mouse emulation device has main analogue means, by being implemented separately to the operation of the main analogue means Mouse function；

Mode B, when mouse emulation device has main analogue means, by the main analogue means, and operation button Mouse function is realized in operation, and wherein operation button is used for realizing the part or all of keypress function of mouse；

Mode C, mouse emulation device have main analogue means, and set up on keyboard auxiliary element when, by institute Main analogue means is stated, and mouse function is realized in the operation of auxiliary element；

Mode D, during the auxiliary element that sets up on keyboard with multiple on mouse emulation device, by the auxiliary unit Mouse function is realized in the operation of part；

Mode E, during the auxiliary element that sets up on keyboard with multiple on mouse emulation device, by the auxiliary unit The operation of part and original button realize mouse function；

Mode F, mouse emulation device have main analogue means, and set up on keyboard auxiliary element when, by institute Main analogue means is stated, and mouse function is realized in the operation of auxiliary element and original button；

The mouse function includes and is not limited to one or more in following functions：Execute, select, drag, show dish Single, mobile cursor, scrolling display screen, and multidimensional is while mobile display；

The main analogue means includes and is not limited to following kind of input unit or input/output unit or its combination：Electricity Sub- blank, blank, projected keyboard device, touch-screen, touch pad and other touch input devices, device of electrical input, electricity input Device, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, mechanical device.

Further, above-mentioned man-machine interaction method can also have the characteristics that：

By the mouse emulation device or main analogue means implicit expression therein, explicitly or explicitly multiple regions are divided into, Including realizing the region of cursor locomotive function, and at least one is used for realizing the region of following at least one function：Execute, select Select, drag, showing menu, roll screen, multidimensional while mobile display；And the regional and its function are fixing, become Changing or can configuring.

The mouse function by be arranged on the left of the press key input device key area or right side a main analogue means Realize with some buttons for being arranged on keyboard opposite side, some buttons are that finger is returned thereon after button in standard finger ring One or more buttons, for realizing the keypress function of mouse；Or the mouse function is described by being partly or entirely arranged on A main analogue means in press key input device key area and some buttons being arranged on outside the main analogue means are realized, In some buttons, in standard finger ring, the button of left/right hand operation is used for realizing the function of mouse left/right key, in standard finger ring The button of right/left hand operation is used for realizing right mouse/left button function.

The auxiliary element at least includes：One auxiliary element for realizing cursor locomotive function and one realizes mouse button functions Auxiliary element；

The auxiliary element for realizing mouse locomotive function is using the one kind in following form or combination：At least one refers to Point bar, the input unit of at least one control targe motion, the roller ball of at least one control targe motion and at least one control The roller of target motion processed；

The auxiliary element for realizing mouse button functions is using the one kind in following form or combination：At least one is true Recognize the button of operation, at least one TrackPoint, at least one roller ball, the input unit of at least one control targe motion, extremely A few roller and at least one operation button for being operable with mouse functionality mode.

Further, above-mentioned man-machine interaction method can also have the characteristics that：The opening and closing mouse function passes through Realize comprising one or more in the following manner：

Mouse function is opened or closed by pressing or tapping the button of the confirmation operation being independently arranged on keyboard；

Mouse function is opened or closed by pressing or sequentially tapping the Macintosh on keyboard；

Mouse function is opened or closed by way of touching TrackPoint；

Mouse function is opened or closed by way of rotating a roller ball；

Mouse function is opened or closed by way of rotating a roller；

The input operation of the keyboard outside mouse emulation device operating area is received, closes mouse function；

The operation of the main analogue means in being not received by mouse emulation device or mouse emulation device in setting time, closes Close mouse function；

Beaten by the move mode set in main analogue means of the finger in mouse emulation device or mouse emulation device Open or close and close mouse function；

The main analogue means includes but is not limited to following kind of input unit or input/output unit or its combination：Electricity Sub- blank, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, Pressure apparatus, infrared facility, laser aid, mechanical device.

The mobile side set in the main analogue means by finger in mouse emulation device or mouse emulation device When formula opens or closes Trackpad, the move mode of the setting include following at least one：

The displacement of finger meets or exceeds setting value；

The rate travel of finger meets or exceeds setting value；

The number of times that moves back and forth of finger meets or exceeds setting value；

Finger meets or exceeds setting value to the pressure that at least one button applies；

Finger moves or slides into the surface of another button from the surface of a button；

The motion track of finger meets the shape of setting；

Finger click or double click on area in fixed point, certain region, the summit in certain region.

Further, above-mentioned man-machine interaction method can also have the characteristics that：The main analogue means is real in the following manner Existing mouse function：

After the main analogue means is opened, if fricton-tight before click on for first time also nothing clicking on, it is considered as click mouse Target left button, is slided for the first time as controlling cursor movement；

During click, last time operation before is to click on or slide, if click on the point of last time click or this most The left side of the terminal of a stroke, is considered as the function of clicking on left mouse button and continue to keep clicking on afterwards；If clicking on this last The right side of the terminal of the point of secondary click or the last time stroke, is considered as click right mouse button；

During click, last time operation before is to click on or slide, if the point that clicks in the last time or this last Thereafter slip or stroke are then accordingly to be regarded as dragging by the radius centered on the terminal of secondary stroke for starting to slide or stroke in the circle of M Dynamic, till having click or leaving the main analogue means；

During stroke, last time operation before is stroke, in the region with a distance from the line of the stroke less than N and at this Outside radius centered on the terminal of stroke is for the circle of M, it is considered as operation middle button of mouse；

M, the N are the distance for arranging.

The press key input device be soft device, and can the movement according to the movement of cursor or finger, when cursor or finger When moving from current location to button direction to be operated, finger motion institute in whole press key input device or press key input device The part of direction is with respect to finger motion direction while or asynchronously move.

The mouse emulation device includes main analogue means, and the area maps of the main analogue means completely or partially shield Curtain；Click on the main analogue means certain point when, cursor is moved on the point on the screen with the point with mapping relations； Meanwhile, on the main analogue means during a mobile unit, cursor also moves a unit on the screen, or according to The ratio of the main analogue means and the screen size moves multiple units；The main analogue means is including but not limited to following The input unit of type or input/output unit or its combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, touch pad With other touch input devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, machinery Device.

When operating to the mouse emulation device, with soft or hard nail, artificial nail, finger ring, fingerstall, finger tip Set, refer to Bed linens, articles for use or other articles and its part and/or combination to be realizing positioning the position of cursor or display on hand.

The article for realizing the position of positioning cursor or display, its material is：Soft or hard metal, plastics, wooden Product, biological products or other soft or boardy products.

Described for realize positioning cursor or display position article, its shape can be arbitrary shape, band one little The object of cusp, spherical or oval sphere or 6,8,12,24 face bodies or other curved surfaces and its part and/or combination.

Certain point of the human body parts of the contact that the mouse emulation device is arrived with human body sensory or the movement at position, come real Now position and/or mobile cursor and light target form, stealthy, sightless or visible position, displacement or motion related Or related to cursor relative position relation following at least one：Form, stealthy, invisible or visible order, Order setting, display mode, diagram, figure, image, command menu, button, key or can be with the order of clicking operation or diagram, phase Be similar to be input into and/or output device figure, human body sensory to contact human body parts certain point or position include contact The central point of the part of the finger for arriving or core；Or the dynamics of pressing, area or figure are judging input operation.

When operating to the press key input device and/or mouse emulation device, with vibrations, vibration, picotement, thermal sensation, sudden strain of a muscle Move and/or other feel to realize feel, sense of touch.

From technical scheme as can be seen that being pressed by the operation by the mouse emulation such as Trackpad device located at keyboard Key range.When by input through keyboard, open mouse emulation device and operated.Without the need for frequent mobile forearm, work when using Make efficiency high, and small volume is easy to carry.Meanwhile, human-computer interaction device is applied to electronic installation and computer integration, Make that computer man-machine interacting is more convenient, have more display spaces or more display space can be made full use of, make computer, hand While the functions such as machine, PDA, PIM, household electrical appliances are more convenient, powerful, volume is less, have more display spaces or more can fully profit With display space, easily portable, use.And be particularly well-suited to the input of the suitable both hands such as notebook and desktop computer device defeated Enter.

Description of the drawings

Fig. 1 is a kind of structural representation of the human-computer interaction device described in the embodiment of the present invention one；

Fig. 2 is a kind of structural representation of the human-computer interaction device described in the embodiment of the present invention two；

Fig. 3 is a kind of structural representation of the human-computer interaction device described in the embodiment of the present invention three；

Fig. 4 is a kind of structural representation of the human-computer interaction device described in the embodiment of the present invention four；

Fig. 5 is a kind of structural representation of the human-computer interaction device described in the embodiment of the present invention five；

Fig. 6 is a kind of structural representation of the human-computer interaction device described in the embodiment of the present invention six；

Fig. 7 is a kind of structural representation of the human-computer interaction device described in the embodiment of the present invention seven；

Fig. 8 is a kind of structural representation of the human-computer interaction device described in the embodiment of the present invention eight；

Fig. 9 is the schematic diagram that a kind of human-computer interaction device described in the embodiment of the present invention nine is arranged in touch-screen；

Figure 10 is schematic diagram of the Fig. 9 when human-computer interaction device is not shown；

Figure 11 is the schematic diagram that a kind of human-computer interaction device described in the embodiment of the present invention ten is arranged in touch-screen, in figure Human-computer interaction device in 9 adds soft keyboard film；

Figure 12 is the generalized section of Figure 11 touch-screen；

Figure 13 is the schematic diagram of the mouse pattern that touchpad surface shows in the embodiment of the present invention nine；

Figure 14 is the schematic diagram of the region division that touchpad surface shows in the embodiment of the present invention nine；

Figure 15 is the schematic diagram of the region division of touchpad surface in another embodiment of the present invention nine.

Figure 16 is a kind of schematic diagram of display portion keyboard on mobile phone screen.

The schematic diagram of position of the Figure 17 for the portion keyboard in Figure 16 on whole keyboard.

Figure 18 A and Figure 18 B are schematic diagram of the bidimensional of the present invention with two kinds of indicating modes for moving function.

Specific embodiment

In order to realize input through keyboard and mouse function easily without the need for mobile forearm, the human-computer interaction device of the present invention will The operating area of press key input device and mouse emulation device is least partially overlapped so that all normal persons are (non-disabled, retarded Deng) operation to both can be completed without mobile arm.

Herein, press key input device can be hard manual, soft keyboard, or any by realizing to key operation The device of input, such as control panel.Here " key " includes one or more in following form：On keyboard or control panel Form, stealthy, sightless or visible key, button, icon, menu item, order, order setting, display mode, button or Can be with the order of clicking operation or diagram, the figure similar in appearance to input and/or output device；Key that software is realized or display Form, stealthy, sightless or visible, implicit expression on disk or control panel, explicit or show key, button, icon, Menu item, order, order settings, display mode, button or can be with the order of clicking operation or diagram, similar in appearance to being input into and/or defeated Go out the figure of device.

Mouse emulation device (alternatively referred to as mouse emulation device) be refer to various for realizing mouse work(in addition to mouse The device of energy.As touch-screen, Trackpad, TrackPoint, button, it is used for realizing the key of mouse function, roller or its combination etc..And The various functions that " mouse function " finger mouse mentioned here can be realized, such as execute (order, icon), select (order, figure Mark), drag (order, icon), show menu, scrolling display screen, mobile cursor etc., these functions are typically logical on mouse Cross and move the operation of mouse and the left button to mouse, middle key and right button to realize.Especially, mouse function of the present invention ( Mouse function can be directly referred to as) function of not having to apply but can realize using mouse is additionally may included on existing mouse, As entitled " for multidimensional, speedup, space-efficient system display method while IT field " (Chinese invention patent application number： 200610046372.3), " multidimensional information display output control method and device and input unit " (international application no：PCT/ CN2007/001333 the multidimensional disclosed in) is while the function of mobile display.

Above-mentioned press key input device and mouse emulation device can be hard device, or soft device.And can use Various types of input units or input/output unit can be such as electronic whiteboard, blank, projected keyboard device, touch realizing Touch screen, touch pad and other touch input devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, swash Electro-optical device, mechanical device.In these input units, some fingers leave the also operable input of input unit a certain distance Device.Only illustrated with some types therein in following examples.

Specific embodiment to the present invention is described in detail below in conjunction with the accompanying drawings：

Embodiment one

The press key input device of the human-computer interaction device of the present embodiment is hard manual 1, and mouse emulation device is by hard Trackpad 20 are constituted, and its structure is as shown in figure 1, hard Trackpad 20 includes the part or all of surface of at least one operation button.Hard in Fig. 1 Trackpad 20 includes all surfaces of the part surface for operating button U, I, H, K, N and M and operation button J, occupies hardkey An isolated area in the operation key area of disk 1.The region includes the part or all of table of one or more operation buttons Face, or even the operation key area of hard manual is all set to hard Trackpad.Hard Trackpad 20 can be divided into multiple fritters Hard Trackpad, the such as border according to normal key mapping are dividing.The structure ＆ working mechanism of the hard Trackpad of each fritter all equivalent to The hard Trackpad of a piece of prior art, is combined and realizes a complete hard Trackpad.The hard touch-control plate of fritter also may be used Little displaying block or little touch-screen (each displaying block is a small display or little touch-screen) for the button bulk of display, and should Fritter Trackpad or little touch-screen have the elastic mechanism that can be stretched in vertical direction or move, and can press, and have preferably Feel.

Mouse function can be divided into two classes, and a class is locomotive function, for by cursor movement to target location；One class be by Middle roller (is considered as middle key) by key function, for realizing confirming, choosing, executing (double-click), dragging, popup menu, roll screen Etc. multiple operations.Existing hard Trackpad can realize the work(that locomotive function and part button operation such as left button are clicked, double-clicked, dragging Energy.Some keypress functions are then realized by the button below hard Trackpad.The present embodiment is by the operation to hard Trackpad All mouse functions are achieved that, and does not move arm.

As keyboard and hard Trackpad have lap, need to switch the mode of operation of the part.I.e. defeated by keyboard During entering, the hard Trackpad in the operation key area of keyboard is opened, carries out hard Trackpad operation.Certainly, complete Hard Trackpad should also be closed after becoming one group of hard Trackpad operation.

For the ease of operation, need to arrange controlling switch in keyboard to open or close the i.e. hard Trackpad of mouse function Function.The function of controlling switch for the present embodiment, can be realized by least one set Macintosh, can be set arbitrary Macintosh (as Ctrl+L), opens or closes hard Trackpad by pressing this Macintosh.Can also be by hard Trackpad Self-defining operation mode irregularly realizes the function of controlling switch.The self-defining operation mode can be in the following manner Plant or multiple：A, displacement of the finger in hard Trackpad meet or exceed setting value；B, shifting of the finger in hard Trackpad Dynamic speed meets or exceeds setting value；As 0.5 second draws " √ " or " x " length more than 5cm；C, movement of the finger in hard Trackpad Track meets the shape of setting, for example：“∨”“√”“x”“X”；D, can use and click or double-click fixed point, certain region, certain region The summit of (as key lattice).

The present embodiment is expanded to the operation on hard Trackpad, is accomplished by all of mouse work( Energy：

After hard Trackpad is opened, if fricton-tight before click on for first time also nothing clicking on, it is considered as the left side for clicking on mouse Key, is slided for the first time as controlling cursor movement.During click, if last time operation before (is also referred to as drawn for clicking on or sliding Dynamic), if the left side of the point of last time click or the terminal of the last time stroke is then clicked on, it is considered as click left mouse button And the function of continuing to keep clicking on, or the other functions for being considered as setting；If click on point that the last time clicks on or this most The right side of the terminal of a stroke, is considered as click right mouse button afterwards；If the point that clicks in the last time or the last time are drawn Start to slide or stroke in the circle of radius 8mm centered on dynamic terminal (or other arrange value M), then by slip thereafter or Stroke is accordingly to be regarded as dragging, till having click；During stroke, if last time operation is stroke, from the last time stroke Line region of the distance less than 8mm (or other arrange value N) in and radius 8mm centered on the terminal of the stroke (or Other arrange value M) circle outside, be considered as operation middle button of mouse (as roll screen function).

And for example, the soft keyboard that touch-screen or touch pad are realized, point are touched, tap expression input corresponding certain symbol, word, figure Picture, figure, execute certain order function represented by certain key etc., slide as mouse or multidimensional with moving function；Slide past During 5mm, the mouse emulation device of startup touch-screen, 20 in such as Fig. 1, when the percussions such as input character are a little touched, close touch Screen, carries out keyboard operation.

It is referred to as mode A by way of hard Trackpad is implemented separately mouse function by this below.Touch-screen, throwing can also be used The input units such as shadow keyboard, electronic whiteboard replace hard Trackpad to realize.Following examples all herewith, are no longer illustrated one by one.

Embodiment two

The press key input device of the human-computer interaction device of the present embodiment is hard manual 1, and mouse emulation device includes that first is hard Trackpad 21 and the second hard Trackpad 22, its structure are as shown in Figure 2.First hard Trackpad 21 includes to operate button U, I, O, J, K With the part surface of L, the second hard Trackpad 22 include operate button W, E, S and D all surfaces.Hard touch-control in the present embodiment Plate occupies two isolated areas in hard manual operation key area.And first, second hard Trackpad 21,22 be two kinds of differences Shape, the first and second hard Trackpads 21,22 can also adopt identical shape in actual use certainly.In other enforcements In mode, hard Trackpad can take more isolated areas (more than 2).

The present embodiment can be to control opening and closing using modes such as the self-defining operation on Macintosh or hard Trackpad Mouse function is the function of hard Trackpad.Two hard Trackpads can control simultaneously, it is also possible to individually control, or may be configured as same When control or individually control.The side that the concrete operations mode of mouse function can be described using embodiment one is realized on hard Trackpad Formula A.

Embodiment three

The press key input device of the present embodiment human-computer interaction device is hard manual 1, and mouse emulation device includes hard Trackpad 23 and hard manual in 4 operation button " A ", " S ", " D " and " F ".Its structure is as shown in Figure 3.Hard Trackpad 23 is included at least One operation button part or all of surface and operation button between or outside idle area surface.Hard touch-control in Fig. 3 Plate 23 includes part surface, all surfaces of operation button I for operating button U, O, H, J, K and L, and operation button U, I and O The surface of the idle area between operation above button.Hard Trackpad 23 in the present embodiment occupies an isolated area, by Part hard manual operation key area and part idle area composition, in other embodiments, hard Trackpad can also take The isolated area of greater number, and its area can be more than the operation key area of hard manual.

The present embodiment can be to control opening and closing using modes such as the self-defining operation on Macintosh or hard Trackpad Mouse function, that is, open and close the function of hard Trackpad 23 and above-mentioned 4 buttons.Realize the mode of mouse function and present pen Remember that the hard Trackpad on this computer is similar to the mode of button combination, simply replaced with " A ", " S ", " D " and " F " this 4 buttons Traditional button, realizes the keypress function of mouse, and wherein " F " key is used for realizing right button function, and " A " key is used for realizing left button Function, " S " and " D " key all can achieve middle key function.After opening mouse function, the function of some buttons switch to mouse by The function of key.Another way is only to use " A ", " S ", " D " 3 keys, or " S ", " D ", " F " 3 keys, from left to right successively Realize left, center, right key function.

Why it is because by standard finger ring using several buttons above, this can be returned in the left hand of input interval people several On individual key, so after keyboard shift to mouse functionality mode, button work(can be can achieve using both hands and without mobile finger Can, input efficiency can be improved.It is apparent that when hard Trackpad is arranged on the left side of keyboard, it is possible to use " J ", " K ", " L " and “；" 3 or 4 functions to realize the left, center, right key of mouse in key.

Another embodiment is after hard Trackpad is opened, make whole keyboard work in the functional mode of mousebutton, By to left hand in QWERTY keyboard fingering using the operation of any one key be considered as the operation of the left button to mouse, the right hand is used The operation of any one key be considered as the operation of the right button to mouse.Can certainly be defined with other numerous modes or fixed The more functions of justice.

Another embodiment is, by 3 operations button " N ", " M " and ", " below hard Trackpad in Fig. 3 respectively as Left, center, right key.Here selection is a lot, will not enumerate.

It is referred to as mode B by this by way of hard Trackpad and operation button realize mouse function below.Certainly it is based on The structure of this embodiment, equally can realize mouse function with employing mode A.

On the basis of embodiment one, embodiment two and embodiment three, be additionally provided with the operation key area of hard manual to A few TrackPoint, the roller ball of at least one control targe motion, the roller of at least one control targe motion and/or at least One button for confirming operation.Constitute following new embodiment.

Example IV

As shown in figure 4, the human-computer interaction device of the present embodiment is on the basis of embodiment one, operation button G, H and B it Between be provided with a TrackPoint 4.The keyboard of human-computer interaction device is hard manual 1, and mouse emulation device then includes 20 He of hard Trackpad TrackPoint 4.Certainly, TrackPoint 4 can also be arranged between other operation buttons.Although the present embodiment only gives an indication The example of bar 4, but may also set up multiple TrackPoints.It is also possible to add on the basis of embodiment two and three structure of embodiment TrackPoint, obtains other embodiment.

In the present embodiment, TrackPoint 4 can be used for opening and closing mouse function, such as by touching TrackPoint opening or Close the mouse function of hard Trackpad and TrackPoint.Certainly, open and close mouse function can still pass through key combination, touch firmly The alternate manners such as the self-defining operation mode of control plate are realized, and TrackPoint can be served only for realizing mouse function.

In the implementation of the present embodiment mouse function, hard Trackpad is continued to use the hard Trackpad of tradition and realizes mouse movement and portion Divide the mode of keypress function, the function of right mouse button (or left button, middle key) is realized clicking on by tapping above-mentioned TrackPoint 4.When setting When putting multiple TrackPoints, it is possible to realize the whole keypress function of mouse, such as arrange two left and right arrangements TrackPoint 4 when, can The function of mouse left-right key is realized respectively.Or the function that mouse left, center, right key realized respectively by 3 buttons is set.In addition, referring to Point bar can also be as hard Trackpad, and locomotive function, i.e. operation TrackPoint and hard Trackpad with mouse all may move light Mark.It is referred to as mode C by way of below this auxiliary element that is set up by hard Trackpad and on keyboard being realized mouse function.

Certainly the structure based on this embodiment, equally can realize mouse function with employing mode A and mode B.

Embodiment five

As shown in figure 5, the human-computer interaction device of the present embodiment is on the basis of embodiment one, set on the right side of operation button group There is the roller ball 12 of a control targe motion, the keyboard of human-computer interaction device is hard manual 1, and mouse emulation device includes hard touching Control plate 20.Certainly, roller ball 12 can also be arranged at other positions, it might even be possible to increase the gap between some operation buttons, Roller ball 12 is located at this gap position.Although the present embodiment only gives a roller ball 12, but may also set up multiple rollings Ball.It is also possible to roller ball be added on the basis of embodiment two and three structure of embodiment, obtain other embodiment.

In the present embodiment, roller ball 12 can control opening and closing mouse function, such as be opened by touching roller ball Or close hard Trackpad.Mouse function can pass-through mode A or the realization of mode B.

But above structure is based on, in other embodiments, the function of opening and closing hard Trackpad can still pass through button The alternate manners such as combination, the self-defining operation mode of hard Trackpad are realized.And roller ball 12 can also be used as mouse emulation device A part, for realizing the keypress function of mouse, be such as used for realizing the roll screen function of middle button of mouse or mobile light target function. That is employing mode C is realizing mouse function.

Embodiment six

As shown in fig. 6, the human-computer interaction device of the present embodiment is on the basis of embodiment one, set on the right side of operation button group There is the roller 5 of a control targe motion, the keyboard of human-computer interaction device is hard manual 1, and mouse emulation device includes hard touch-control Plate 20.Certainly, roller 5 can also be arranged at other positions, it might even be possible to increase the gap between some operation buttons, by roller 5 are located at this gap position.Although the present embodiment only gives a roller 5, but may also set up multiple rollers.It is also possible to Roller is added on the basis of embodiment two and three structure of embodiment, obtain other embodiment.

In the present embodiment, roller 5 can control opening and closing mouse function, such as be opened or closed by touching roller Hard Trackpad.Mouse function can pass-through mode A or the realization of mode B.

But above structure is based on, in other embodiments, opening and closing mouse function still can be by key combination, hard The alternate manners such as the self-defining operation mode of Trackpad are realized.And roller 5 can also be used as a part for mouse emulation device To realize the keypress function of mouse, such as it is used for realizing the roll screen function of middle button of mouse.That is employing mode C is realizing mouse function.

Embodiment seven

As shown in fig. 7, the human-computer interaction device of the present embodiment is on the basis of embodiment one, set on the left of operation button group There is a button 6 for confirming operation, the keyboard of human-computer interaction device is hard manual 1, and mouse emulation device includes hard Trackpad 20 With button 6.Certainly, button 6 can also be arranged at other positions, it might even be possible to which this button 6 is set by the arrangement for changing current keyboard In ideal position.Although the present embodiment only gives a button 6, but may also set up multiple buttons.It is also possible in embodiment Two and three structure of embodiment on the basis of add button, obtain other embodiment.

In the present embodiment, mouse function is opened and closed by key combination, self-defining operation mode of hard Trackpad etc. Alternate manner is realized.

The mouse function pass-through mode C of the present embodiment is realizing.Hard Trackpad is continued to use the hard Trackpad of tradition and realizes mouse shifting The mode of dynamic and part keypress function, realizes clicking on the function of right mouse button (or left button, middle key) by tapping button 6.When setting When putting multiple buttons, it is possible to realize the whole keypress function of mouse, such as arrange two left and right arrangements ammonium button when, can distinguish Realize the function of mouse left-right key.Or the function that mouse left, center, right key realized respectively by 3 buttons is set.

But above structure is based on, in other embodiments, button 6 can be used for control and mouse function is opened and closed, such as Hard Trackpad and function is opened or closed by button press 6.And mouse function can be realized with employing mode A or mode B.

Embodiment eight

The press key input device of the human-computer interaction device of the present embodiment is hard manual 1, and mouse emulation device includes TrackPoint 4 With button 6, two are respectively provided with.As shown in figure 8, on normal standard keyboard, operating between button R, T and F and operating button Y, U Respectively add a TrackPoint 4 between H, respectively add a button 6 between button U, I and J operating between button E, R and D and operating.When So, above-mentioned TrackPoint is set and the position of button can change, such as can also be provided at operation between button D, F and C, operation button J, Between N and M, operation between button F, G and V, operation between button H, J and N, operation is between button T, Y and G etc..In addition the indication for arranging The number of bar 4 and button 6 can be one or more (3 and more than).

In the present embodiment, mouse function is opened and closed by key combination, self-defining operation mode of hard Trackpad etc. Alternate manner is realized.And mouse function is accomplished by：And operate between button Y, U and H between button R, T and F in operation Two TrackPoints 4 for arranging are respectively intended to control the function (optional) of the movement of light target and the roll screen for realizing taking turns in mouse, Operation is between button E, R and D and the operation button 6 that (positioned at the left and right of keyboard center line) is arranged between button U, I and J is for realizing mouse Right and left key the function such as click, double-click.Hereinafter hard Trackpad is not used by this, and completely by increasing in keyboard operation region If auxiliary element realize mouse function mode be referred to as mode D.

But be based on said structure, in other embodiments, can be further added by a button or TrackPoint open controlling and Mouse function is closed, or by realizing this function to the self-defining operation of above-mentioned TrackPoint as tapped.

Above human-computer interaction device can be with the electronic installations such as the mobile phone using hard manual, computer, automation dress Put and be integrated.I.e. present invention also offers a kind of electronic installation of employing hard manual, can be using mentioned above any one The human-computer interaction device that plants.The human-computer interaction device can be on the main frame of electronic installation, such as in current notebook computer Fixing operation button part or all of surface, or the idle area surface between operation button arranges hard Trackpad or auxiliary unit Part.Or, the hard Trackpad or auxiliary element are set on the keyboard of desktop computer.Mouse function on these equipment should be very quick Sense, is preferably set as most sensitive pattern, as touch pad.

Above example is situation of the press key input device for hard manual, can also have much other deformation, just no longer List one by one.Keyboard will be specifically described for several embodiments during soft keyboard below.

Embodiment nine

The press key input device of the present embodiment human-computer interaction device is soft keyboard 7, and mouse emulation device is soft Trackpad 2, Its structure is as shown in Figure 9.It (can also be the input of other displayable contents that soft keyboard 7 and soft Trackpad 2 are depicted in touch-screen Device, such as electronic whiteboard, blank, projected keyboard device, touch-screen, touch pad and other touch input devices, electricity input dress Put, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, mechanical device.That is mouse emulation device and key-press input Device all can be realized with the input unit of above-mentioned displayable content.Other embodiments are herewith) in 8 input area, because soft Keyboard 7 and soft Trackpad 2 are all realized using " software " mode, thus in its form of expression be soft Trackpad 2 with soft keyboard 7 extremely The part or all of surface of few operation button overlaps.In the present embodiment, the function of the soft keyboard for showing on the touchscreen with The function of the hard manual of IBM ThinkPad X61s notebook computer is the same, it is possible to achieve the command key of keyboard and Macintosh, Such as Ctrl+S, Ctrl+A, Ctrl+C, Ctrl+V, Ctrl+N, Win+E and Win+M etc., and support to be simultaneously entered.For example pressed Being spaced in 100 milliseconds (this value be able to will set) for two keys, can be regarded as the Macintosh being simultaneously entered.The size of key and keyboard with The hard manual of IBM ThinkPad X61s notebook computer is the same.There are IE, WORD, Outlook, power key etc. quick on keyboard Key, and which makes soft keyboard rectangular with the position of the key of ragged edge and the position slight changes of indicator lamp.Former space bar reduces, The left side of space bar is reserved as switch key.

The surface of the soft Trackpad 2 of the present embodiment includes part operation key area and part idle area surface, its display The shape for going out is similar to the Fig. 3 using hard manual with structure.It is apparent that the arbitrary employing hardkey for above-described embodiment one to nine The structure of the human-computer interaction device of disk, and the various modifications structure that mentions in these embodiments, can be used on the touchscreen Software is realized, and wherein Trackpad, button, TrackPoint, roller etc. can arrange its figure and mark in the relevant position of touch-screen Note, and its function is realized by software, it is properly termed as soft Trackpad, soft key, soft TrackPoint and soft roller.So as to obtain each The corresponding scheme that realizes on the touchscreen.For example, corresponding to embodiment 3, it is also possible to " A ", " S ", " D " on soft keyboard and " F " key is realizing mouse button functions, or slightly does and deform, and such as the position of left mouse button should be in the square of the position comprising key F In shape, in the larger rectangle that can be held as wide and keyboard with key SD, right mouse button is in the rectangle comprising key A for the position of middle button of mouse In.For the correspondence of other embodiments, just no longer enumerated one by one.

In terms of display, soft Trackpad 2 can not be shown in display content with soft keyboard 7, touch-screen 8 whole Surface just shows soft Trackpad 2 and/or soft key in input area all as viewing area only when operator needs input Disk 7, this process can be realized by the change-over switch of setting or order, and mentioned as described above or operator passes through touch-screen 8 activation input areas, show soft Trackpad 2 and/or soft keyboard 7.

The display that soft Trackpad 2 and soft keyboard 7 are overlapped, can be in the way of covering soft keyboard 7 using soft Trackpad 2, generally Coverage mode be soft Trackpad have a housing, inside which be transparent or connect diaphanous, its transparency with do not affect behaviour Make librarian use soft keyboard 7 for standard.Certainly realize soft keyboard 7 with software and cover the mode of soft Trackpad 2 reaching phase As effect.

The display that soft Trackpad 2 and soft keyboard 7 are overlapped, can also only show a device of work at present, cut when needing It is changed to the mode for showing another device.Switching can be realized by a simple change-over switch or button, for example can be A return soft key for returning its corresponding states is respectively provided with soft Trackpad 2 and soft keyboard 7, so that it may realize the function.Preferably Ground, can be combined with the opening and closing of mouse function, show soft Trackpad in overlapping region when opening mouse function, close Show soft keyboard in overlapping region when closing mouse function.This can be used simultaneously as on same region/show different defeated Enter device or be used as/show the method for different input units referred to herein as area coincidence in different time.And in above-mentioned enforcement In example, same input unit using the same area is realizing key-press input function and mouse function (or other functions combinations) While in situation, such as embodiment 1 as button and Trackpad block shape Trackpad, referred to herein as region be multiplexed.

In the above-mentioned various embodiments for referring to and its possible version, can equally involve how to arrange a control Switch controlling opening or closing for Trackpad (soft or hard), can in the way of being mentioned using embodiment one to eight, only for Hard manual is hard controlling switch, is soft controlling switch for soft keyboard.Such as, the soft controlling switch can be soft TrackPoint, soft rolling Wheel, the soft key of the confirmation operation being independently arranged, Macintosh or self-defining operation mode on the touch pad, or more than The combination of mode.

For the present embodiment, can be to realize mouse function on the touch pad using following special mode, which belongs to Mode A, but it is different from existing Trackpad operation, hereinafter referred to mode AE：

After Trackpad is opened, can touchpad surface shows being similar between fully transparent and completely opaque or It is bordering on the shape of mouse, the pattern in such as Figure 13 or Figure 14.

Pattern simulation mouse-shaped shape in Figure 13, including an oval outline, has a little ellipse in center upper portion 103, have a big ellipse 101 under which, the remainder in gabarit by the two ellipse separate left and right two parts 105, 107.Oval 101 regions are used for providing the function of conventional Trackpad whole region, start to slide or stroke from oval 101, real The cursor of existing mouse is moved, drags, selects functional medium；Oval 103 regions are used for providing the function of middle button of mouse, from the ellipse of top Start to slide or stroke in circle 103, realize the control display function such as roll screen.Remaining left part 105 is used for providing a mouse left side The function of key, clicks on, presses the region and can achieve to click on left, pressing left mouse button corresponding function, remaining right part 107 For the function of right mouse button is provided, the corresponding function that the region can achieve to click on right mouse button is clicked on.

Pattern in Figure 14 is rectangle, the touch area including lower section and the soft key such as the left button of top, middle key, right button, In the soft key such as Trackpad or touch-screen click, the left mouse button of pressing display, right button, middle key, execute respectively and click on actual mouse The corresponding operating of the buttons such as target left button, right button, middle key.

The pattern of Figure 13 and Figure 14 explicitly can be arranged on touch pad or touch-screen, it is also possible to arranged stealthyly, not Click on region or slide, execute corresponding operation.Can also on touch pad or touch-screen stealthy ground or explicitly arrange with The similar cursor of touch-screen, realizes the function being similar to as explicit display highlighting on the touchscreen.

Above design, touch pad area can map and full frame (move a unit on a touchpad, cursor can be Several units are moved on screen), it is also possible to when moving a unit on a touchpad, cursor also moves a list on screen Position.

Realize in the other embodiments of mouse locomotive function in such as TrackPoint otherwise, can be by the figure of Trackpad Case is designed as rectangle as shown in figure 15, is divided into left and right two parts.Left is at least followed successively by 3 rectangular areas from upper, uses respectively In realizing shearing, replicating and paste operation, right at least also includes 3 rectangular areas successively from upper, be respectively used to realize insertion, Delete and clear operation.Certainly above division is only an example, and number in region, position and corresponding operating aspect can To there is a lot of selection modes, will not enumerate here.Meanwhile, will can be differently arranged in Trackpad as multiple areas Domain, these regions can show or implicit expression.

Trackpad or touch-screen in above-mentioned mouse emulation device is used for realizing most mouse function, is properly termed as mouse The main analogue means of target, the main analogue means can be using following kind of device or combinations：Electronic whiteboard, blank, projection Key board unit, touch-screen, Trackpad, other touching devices and device of electrical input, electromagnetic induction device, pressure apparatus, infrared dress Put, laser aid,

Embodiment ten

The present embodiment is provided with soft keyboard film 13 on the surface of soft keyboard 7, and other side is all identical with embodiment nine, such as Figure 11 Shown.As shown in figure 12, soft keyboard film 13 is arranged at the region of the display soft keyboard 7 on 8 surface of touch-screen, will typically be slightly larger than soft The area occupied of keyboard 7.Be unlikely to have difference during in order to show, can arrange on 8 surface of whole touch-screen fully transparent or saturating The preferable soft keyboard film 13 of lightness.Here it is to change feel when being input into that transparent soft keyboard film 13 is acted on, and allows using during soft keyboard 7 Operator has the sensation using real hard manual, can have rill between key above which and key, such as 0.5 millimeters deep, 0.5 milli Meter Kuan, can just be sufficient for people and feel it is different keys.

The mouse function of the present embodiment can adopt any one of A～D, AE in manner just described, for mode A～D For, " soft " device that the button, Trackpad and the auxiliary element that simply operate are shown on screen, method do not become Change.

Embodiment 11

The composition of the human-computer interaction device of the present embodiment can be identical with embodiment nine with mode of operation, but is touching Display mode on screen has certain difference.

The press key input device of the present embodiment human-computer interaction device and mouse emulation device in the display location of touch-screen not It is fixedly installed, but can be near the light target as upper and lower, left and right, or, Ke Yiyong overlap wholly or in part with cursor Different shape, color and transparency etc. are being different from the pattern of background.IE, OFFICE, application program etc. can be such as selected to show Show above keyboard in (keyboard can not push down document) or background and show or both stagger display.Start hurdle to may be selected to show Immediately adjacent in keyboard below or above.

The human-computer interaction device is also designed to button according to the movement of cursor or finger and movement.For example, work as finger Start to move to button direction to be operated from a certain position (slide etc.) when, on whole press key input device such as keyboard or keyboard The part of finger motion institute direction can be moved with respect to finger motion direction.So limited by screen size some, only Can show in keyboard under the occasion of part button, it is possible to which the button that will be operated is moved in screen and shown.Figure 16 institute Show it is a folding mobile phone, middle rectangle is a touch-screen, can be in the midline folding cell phone of Figure 16.In the hand Keyboard of the machine using standard, as screen is limited, is once only able to display the keyboard area of a part, is input in this screen When, it is possible to the operation to all buttons is realized using said method.

Even for the soft keyboard that all can be shown, this mobile aspect is it is also possible that user need not be with strength Elongation finger removes the key that operates some distant, and only need to be on the screen first to the very short distance of movement in terms of the button, i.e., The button that must be operated can be made to be automatically moved to finger nearby and can easy operation, improve the precision of operation.Above-mentioned keyboard is moved Dynamic speed can be more than the speed of finger movement, naturally it is also possible to the speed as finger translational speed or less than finger movement Degree.In moving process, one or more object key of finger moving direction institute direction can become big and suitably can deform, other The key neighbouring with object key can diminish or away from.

The mode moved according to cursor is also similar, simply needs recognized to be changed to the shifting of light target by the movement of finger Dynamic, cursor movement can be realized with the mouse emulation device of the present invention or alternate manner.

It should be noted that above-mentioned button is according to finger or cursor movement, and the scheme of relative movement independently can be adopted, I.e. without the need for adopting mouse emulation device and the partly overlapping scheme of press key input device.Even there is no mouse function at some The input without the need for mobile forearm can also be realized on electronic installation using the method, and is overcome the restriction of screen size and carried The precision of high input.

The Trackpad of the present embodiment can also be realized two/multidimensional and can shield while rolling in two/multiple directions with dynamic The function of curtain, refers to Figure 16, Figure 17 and Figure 18 A and 18B.Figure 16 is shown that portion keyboard, its position in whole keyboard Put as shown in figure 17.And then respectively the part in Figure 16 is indicated by mobile cross and size rectangle in Figure 18 A and 18B Position of the keyboard in whole keyboard.The function could be arranged to middle button of mouse function, such as can be in Figure 13 and Figure 14 Trackpad Region in viewing area corresponding to middle key operation is operating and show.Short-term in Figure 18 A on cross indicates currently displaying Transverse and longitudinal coordinate in whole figure, conversely, the short-term on mobile cross is then currently displayed at the transverse and longitudinal in whole figure sit Mark change.And have+shape instruction.Little rectangle in Figure 18 B represents the region for showing, big rectangle represents shown document, The change in location of display, little rectangle represent position and its respective change with respect to big rectangle.Movement is sensitive, follows immediately, As long as originating in the curve (terminating at any position all right) of middle key, all multidimensional is can achieve while mobile display.

In addition, the key of keyboard or symbol can adopt multiple color, such as：Q, W, E, R, T, Y, U, I, O, P adopt the first Color, such as blue；A、S、D、F、G、H、J、K、L、：Using second color, such as red；Z, X, C, V, B, N, M,,.,/, adopts The third color, such as green.In terms of display effect, during button etc., can be with luminous conversion of chromatic colour flicker etc.；Colored sudden strain of a muscle Bright luminous conversion etc. game machine soft keyboard cell phone keyboard computer keyboard etc..

The keyboard that the present embodiment human-computer interaction device shows can have multiple, be carried out using shift+1 or alternate manner many Plant the switching between soft keyboard.Such as at least 3 kinds conventional keyboards are selected with Shift+S D F etc.：(punctuate) keyboard symbol, phonetic key Disk, other conventional incoming symbol keyboard, mobile phone, gamepads etc..In addition, the size of above-mentioned human-computer interaction device viewing area and Shape can also be adjusted.As keyboard can minimize, drags and close, diminish greatly.17 ", 14.1 " widescreen etc. is upper shows keyboard Size also should with actual.

Below the human-computer interaction device that realizes on the touchscreen can be filled with electronics such as the mobile phone with touch-screen, computers Put, robot apparatus are integrated.I.e. present invention also offers a kind of electronic installation with touch-screen, employs above-mentioned Anticipate a kind of human-computer interaction device.The human-computer interaction device can be shown on the touch-screen of electronic installation, or by whether is had The display switch of people or thing touch input area, hardware or software come control whether show on the touch-screen of electronic installation.This The advantage of the mode of kind is to eliminate take up room on electronic installation more hard manual and Trackpad, also just provides for display screen Bigger space.Specifically, it is exactly by the multiplexing of keyboard, mouse, display and touch-screen and integrated, it is possible to computer Integration, makes that computer man-machine interacting is more convenient, have more display spaces or more can make full use of display space, makes calculating While the functions such as machine, mobile phone, PDA, PIM, household electrical appliances are more convenient, powerful, volume is less, has more display spaces or can more fill Divide and display space is utilized, easily portable, use.

Because mouse function is realized being very ripe technology in the inside of computer or other logical calculation devices, with Each embodiment upper mainly describes used mode of operation and operation object for the realization of mouse function.According to above-mentioned Content, those skilled in the art can be easily carried out technical scheme.

Man-machine interaction method of the present invention one of be on or off the mode of mouse function, except above-mentioned enforcement Example also has some alternate manners outside the mode of by the agency of, is concentrated again illustratively here, specifically includes in the following manner At least one or more of combination：

First, mouse function is opened or closed by pressing or tapping the button of the confirmation operation being independently arranged on keyboard.

This mode is more readily understood, such as Fig. 6, arranges a button on keyboard, by opening or closing mouse work(next time Can, then by once closing or open mouse function.It can also be soft keyboard that keyboard can be hard manual, certainly corresponding button It is button or the soft key of hardware.

2nd, the Macintosh for passing through to press or order is tapped on keyboard opens or closes mouse function

This mode is more readily understood, and the Macintosh on computer is often used, and such as Ctrl+Alt+del is exactly computer Conventional thermal starting Macintosh.The present invention can arbitrarily arrange Macintosh (as long as mutually not conflicting) with the Macintosh in system, such as Ctrl+L, Alt+O, Shift+U ..., open or close mouse function by Macintosh next time during use, then by once combining Mouse function is closed or opened to key.It can also be soft keyboard that keyboard can be hard manual, can be pressed using order for soft keyboard The mode of Macintosh is opening or closing mouse function.

3rd, mouse function is opened or closed by way of touching TrackPoint

This mode is to arrange TrackPoint in the operation key area of hard manual, touches a TrackPoint and opens or closes Mouse function, then touch a TrackPoint closing or open mouse function.

4th, opened or closed by way of rotating roller ball

This mode is to arrange roller ball in the operation key area of hard manual, rotates a roller ball and opens or closes Mouse function, and interior as continuous (its delay time can be set, then not think it is continuous more than delay time) turn during this period Dynamic roller ball then realizes the roller ball function of common mouse；It is rotated further by a roller ball and closes or open mouse function.

5th, opened or closed by way of rotation roller

This mode is to arrange roller in the operation key area of hard manual, rotates a roller and opens or closes mouse Function, and interior as continuous (its delay time can be set, then not think it is continuous more than delay time) rotation rolling during this period Wheel then realizes the roller function of common mouse；It is rotated further by a roller and closes or open mouse function.

6th, the input operation of keyboard is received, closes mouse function

During input operation is carried out using mouse emulation device, once system receives the operation of mouse emulation device The input operation of the keyboard outside region, closes mouse function immediately, prevents from pressing or tapping mouse function area in input process Button in domain produces misoperation, and this has treated as control equivalent to by an operation button outside mouse emulation device operating area Switch.Certainly now cannot be used for realizing the occasion of mouse button functions using button.

7th, the operation of mouse emulation device is not received by setting time, closes mouse function

During input operation is carried out using mouse emulation device, if system is not received by setting time The operation of mouse emulation device, closes mouse function, prevents from pressing or tapping the button of mouse emulation device in standby Produce misoperation.

8th, the move mode set in Trackpad by finger opens or closes mouse function

Because finger touch Trackpad be manual operation its form varied, implementation is also more complicated, main with Under several control modes：

1) displacement of the finger in Trackpad meets or exceeds setting value

This mode refers to, during the input operation of keyboard, such as want to open mouse function, then only need finger in touch-control The movement of a larger displacement is carried out in plate region, so that it may open mouse function；The size of this displacement or displacement is big Natural sliding distance of the finger on button during the input operation of general keyboard, to avoid producing misoperation.Certainly, This displacement specifically can be set as desired by system.

2) rate travel of the finger in Trackpad meets or exceeds setting value

This mode refers to, during the input operation of keyboard, such as want to open mouse function, then only need finger in touch-control Carry out one to move in plate region faster, so that it may open mouse function；The size of this rate travel is greater than (or being less than) Natural rate travel of the finger on button during the input operation of general keyboard, is not to produce misoperation.Certainly, this One rate travel can be by what system was set.As this rate travel can be set different from Trackpad operating process In natural rate travel, therefore, after mouse function is opened during input operation, such as want then only to need using input through keyboard Finger carries out one in touch pad area and moves faster, so that it may close mouse function.

3) move back and forth number of times of the finger in Trackpad meets or exceeds setting value

This mode refers to, during the input operation of keyboard, such as want to open mouse function, then only need finger in touch-control Plate is repeatedly moved back and forth in region, so that it may open mouse function；This size for moving back and forth number of times is greater than general During the input operation of keyboard, finger moves back and forth number of times on button naturally, to avoid producing misoperation.Certainly, this Move back and forth number of times and can be by what system was set.Can set different from Trackpad behaviour as this moves back and forth number of times Naturally move back and forth number of times during work, therefore, after mouse function is opened during input operation, such as want to adopt keyboard Input then only needs finger repeatedly to be moved back and forth in touch pad area, so that it may close mouse function.

4) finger meets or exceeds setting value to the pressure that at least one button applies in Trackpad

This mode refers to, during the input operation of keyboard, such as want to open mouse function, then only need finger in touch-control The pressure for setting is applied at least one button in plate region, so that it may open mouse function；The size of the pressure of this setting will More than natural pressure of the finger on button during the input operation of general keyboard, to avoid producing misoperation.Certainly, this One pressure for setting can be by what system was set.Operate different from Trackpad as this pressure for setting can set During natural pressure, therefore, after mouse function is opened during input operation, such as want then only to need using input through keyboard Finger applies, at least one button, the pressure for setting in touch pad area, so that it may close mouse function

5) finger is moved to the surface of another button in Trackpad from the surface of a button

This mode refers to, during the input operation of keyboard, such as want to open mouse function, then only need finger in touch-control The surface of another button is moved or slides in plate region from the surface of a button, so that it may open mouse function；Due to this Mode can coordinate fifth procedure " receiving the input operation of keyboard, close mouse function ", therefore, grasp in the input of keyboard Even if continuous two buttons using in touch pad area, will not also produce misoperation during work.

6) motion track of the finger in Trackpad meets the shape of setting

This mode refers to, during the input operation of keyboard, such as want to open mouse function, then only need finger in touch-control In plate region, movement meets the track for setting shape, so that it may open mouse function；One " √ " " O " " ^ " ... is such as drawn, so that it may To open mouse function.Certainly, the track of this setting shape can be by what system was set.

Certainly, after mouse function is opened during input operation, such as want input through keyboard is adopted, then only need finger touching Movement in control plate region meets the track for setting shape, so that it may close mouse function；" X " "-" ... is such as drawn, so that it may To close make and break mouse function.

7) click or double-click fixed point in Trackpad, certain region, the summit in certain region.

For the human-computer interaction device of the present invention, as long as with the hardware needed for above control mode such as Trackpad and auxiliary Element etc., it is possible to the method for realizing opening and closing mouse function using any one in these control modes.

In each embodiment above, the method that implemented below was accurately positioned, produced sense of touch can also be provided：

For example, need to realize in the operation of input unit such as Trackpad or touch-screen being accurately positioned or mobile, can be with firmly Part such as nail, the nail of artificial finger tip shell type, soft or hard finger ring, fingerstall, fingertip etc. are realizing being accurately positioned cursor, display Position.Its material can be：Soft or hard metal, plastics, woodwork, biological products etc.；Its shape can arbitrarily such as：One, band is little (can be the point of pellet shapes) of cusp or spherical, oval sphere or 6,8,12 or 24 face bodies or other curved surfaces and with On part and combinations thereof.As a duroplasts finger tip ring with steel ball shape point.

Furthermore it is also possible to the central point of the human body parts contacted in input unit such as Trackpad or touch-screen or centre Movement, to realize rapidly being accurately positioned and move.The area for touching detected with input unit such as Trackpad or touch-screen Central point or the movement in centre, speed or acceleration etc. realizing rapidly being accurately positioned and move.When striking in multiple keys When upper, it was judged as that the maximum key of this contact area was enter key.

For the position overlapped in key area and touch pad area, sense of touch during button operation is also realized, can be at this Overlapping region is provided with the fully transparent film for having keyboard rill and sense of touch of keypad shape.And with vibrations or tremble (for example Shake as present most mobile phones, but very slight, very briefer, the pressure of touch-screen can be contacted with touch-screen with finger Area be directly proportional), flash etc. and to realize feel, sense of touch.

The above, the only present invention preferably specific embodiment, Summary further disclose a lot of other Mapping mode, here are no longer illustrated one by one.Protection scope of the present invention is not limited thereto, any skill for being familiar with the art Art personnel the invention discloses technical scope in, the change or replacement that can readily occur in, should all cover the protection in the present invention Within the scope of.Therefore, protection scope of the present invention should be defined by scope of the claims.

In addition, the operation of above Trackpad all can be replaced using other induction installation, now not necessarily touch Touch, can vacantly (certain height, such as<=15mm or 10cm) can also realize corresponding operation.

For example, when operating such as click, stroke/slip on the touch pad, more than certain pressure (such as：Hand is put superincumbent Pressure) just it is input into, recognize that certain dynamics just calculates the input of finger.

Industrial applicibility

The present invention passes through Trackpad located at the operation key area of keyboard.When by input through keyboard, described touching is opened Control plate is operated.Without the need for the frequent mobile forearm when using, high working efficiency, while easy to carry.Meanwhile, by man-machine interaction Device is applied to electronic installation and computer integration, make that computer man-machine interacting is more convenient, have more display spaces or More display space can be made full use of, while making the functions such as computer, mobile phone, PDA, PIM, household electrical appliances more convenient, powerful, volume is more Little, there are more display spaces or more display space can be made full use of, easily portable, use.

Claims

1. a kind of human-computer interaction device, including the first input unit and secondary input device, it is characterised in that second input Whole or a certain functions at least part operation region of device is located in the button operation region of first input unit；Area Domain overlaps or region multiplexing is area coincidence or region multiplexing in the same time；

Or,

A kind of human-computer interaction device, it is characterised in that include：Secondary input device or part thereof, and the first input unit or Its part, comprising described all or part of secondary input device and described all or part of first input unit In the arbitrary region of the arbitrary size of the optional position in region or space, described all or part of secondary input device and Described all or part of first input unit using identical region or space, i.e. area coincidence or region wholly or in part Multiplexing；The area coincidence or region multiplexing are the area coincidence in the same time or region multiplexing；

Or,

A kind of human-computer interaction device, it is characterised in that include：Secondary input device or part thereof, and the first input unit or Its part, comprising described all or part of secondary input device and described all or part of first input unit In the arbitrary region of the arbitrary size of the optional position in region or space, described all or part of secondary input device and Described all or part of first input unit using identical region or space, i.e. area coincidence or region wholly or in part Multiplexing, the area coincidence or region multiplexing are the area coincidence in the same time or region multiplexing；

Or,

The secondary input device at least part operation region is located at described except special/only mouse function or limited function device Outside the first input unit button operation region in, wherein limited function device refer to the function of the device be limited or should The number of the function of device is limited, and special/the first input unit only outside mouse function or limited function device can be wrapped Include but be not limited to hard device or soft device；Area coincidence or region multiplexing are that the area coincidence in the same time or region are multiple With；

Or,

A kind of human-computer interaction device, it is characterised in that include：For realizing secondary input device and first input of mouse function , wherein, in the region that described secondary input device region is located, at least there is part weight with the first input unit in device Close, the region that first input unit is located is that the region being located by one or more input buttons is constituted, and does not include each Region between individual input button；The area coincidence or region multiplexing are that the area coincidence in the same time or region are multiple With；

Or,

A kind of human-computer interaction device, it is characterised in that include：For realizing Trackpad, touch-screen or the others of mouse function Hard input unit, and the first input unit, wherein, described Trackpad, touch-screen or other hard input units be for leading to Cross the device of touch manner input, and the Trackpad, touch-screen or other hard input unit regions and the first input At least exist in the region that device is located and partially overlap, the region at first input unit place be by one or more inputs Region between the region at button place and each input button is constituted；The area coincidence or region multiplexing be when identical Interior area coincidence or region multiplexing；

Or,

A kind of human-computer interaction device, it is characterised in that include：For realizing the secondary input device of mouse function and soft first defeated Enter device, wherein, in the region that described secondary input device region is located with soft first input unit, at least there is portion Point overlap, the region that soft first input unit is located is the regions that are located by one or more input buttons and each is defeated The region entered between button is constituted；The area coincidence or region multiplexing are that the area coincidence in the same time or region are multiple With；

Or,

A kind of human-computer interaction device, it is characterised in that include：Secondary input device and first for realizing mouse function is soft defeated Enter device；Area coincidence or region multiplexing are the area coincidence in the same time or region multiplexing；

Or,

The above all of first input unit can be replaced input unit, and wherein input unit includes press key input device； Area coincidence or region multiplexing are the area coincidence in the same time or region multiplexing.

2. human-computer interaction device as claimed in claim 1, it is characterised in that：

First input unit is press key input device, i.e., by realizing the device being input into key operation, described " key " is wrapped Include one or more in following form：Form, stealthy, sightless or visible key on keyboard or control panel, Button, icon, menu item, order, order setting, display mode, button or can be with the order of clicking operation or diagram, similar in appearance to defeated Enter and/or output device figure；Form, stealthy, no on software the is realized or keyboard of display or control panel Visible or visible, implicit expression, the key of explicit or display, button, icon, menu item, order, order setting, display mode, button Or can be with the order of clicking operation or diagram, the figure similar in appearance to input and/or output device；Or, the second input dress The mouse emulation device being set to for realizing mouse function, the mouse function include but is not limited to following functions in one kind or Multiple：Execute, select, dragging, showing menu, mobile cursor, scrolling display screen, and multidimensional is while mobile display；Described Press key input device and/or mouse emulation device include following kind of input unit or input/output unit or its combination, or The soft device that realizes on input/output unit：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touches Device, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, mechanical device；

Or；

The secondary input device is that the mouse emulation device is included at least for realizing the mouse emulation device of mouse function Part or all of region between the part or all of surface of one key or key, may be located at the key zone of the press key input device An isolated area or a part in domain is located in key area, and remaining part is located at other regions；And/or, described The region multiplexing Chong Die with the key area of mouse emulation device, is at least operable with two kinds of moulds of key-press input and mouse function Formula；And/or, the button operation of the mouse emulation device at least part operation region and described press key input device Area coincidence or region multiplexing, i.e., one region of identical can be used as or realize the function of different, any number of devices；

Or；

The secondary input device is that the mouse emulation device is included in institute for realizing the mouse emulation device of mouse function The one or more auxiliary elements in or beyond the button operation region of press key input device are stated, these auxiliary elements are used for realizing this All or part of mouse function of human-computer interaction device；Or, these auxiliary elements are used for the part mouse function that realizes, wherein Including ' display menu ' or the function of ' multidimensional is while mobile display '；

Or；

One or more controlling switches are also provided with the human-computer interaction device, for opening or closing mouse function, the control System switch is soft controlling switch or hard controlling switch, and the region at the place of above-mentioned switch is：First or secondary input device institute In region or area peripheral edge；Or, in the first input unit at least partly overlapped with secondary input device region In region；Or, in soft/hard desktop computer keyboards formula at least partly overlapped with secondary input device region In the region of keyboard, notebook keyboard-type keyboard or keyboard length more than X centimetre of keyboard；Wherein X be 8, 10th, 12,14,16 or 18；Or, from soft/hard desk-top calculating at least partly overlapped with secondary input device region Switch disc type keyboard, notebook keyboard-type keyboard or keyboard length are more than Y centimetre of the space button of X centimetre of keyboard Region within region in；Y is 1,3,5,7 or 9；

Or；

One or more controlling switches are also provided with the human-computer interaction device, for opening or closing mouse function, described Controlling switch is using the one kind in following form or combination：At least one button being independently arranged, at least a TrackPoint, at least one Roller ball, at least a roller, least one set Macintosh, the operation button outside an at least mouse emulation device region, at least one Self-defining mode of operation on the human-computer interaction device；

Or；

The secondary input device is that the mouse emulation device includes one for realizing the mouse emulation device of mouse function Or multiple main analogue means, and in the key area of the press key input device or periphery arrange one or more auxiliary Element, the main analogue means and the touching device realize all or part of mouse work(of the human-computer interaction device together Can, at least include the auxiliary element for realizing cursor locomotive function and the auxiliary element for realizing mouse button functions；The main mould is intended Device can include but is not limited to following kind of input unit or input/output unit or its combination：Electronic whiteboard, blank, throwing Shadow key board unit, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared dress Put, laser aid, mechanical device；

Or；

The secondary input device is that the mouse emulation device is included in institute for realizing the mouse emulation device of mouse function The one or more auxiliary elements in or beyond the button operation region of press key input device are stated, or, the mouse emulation device Including one or more main analogue means, and in the key area of the press key input device or arrange one of periphery or Multiple auxiliary elements；The auxiliary element includes the one kind in following form or combination：At least one TrackPoint, at least one The roller ball of control targe motion, the roller of at least one control targe motion, the button of at least one confirmation operation, at least one Individual touching device, and at least one operation button for being operable with mouse functionality mode；

Or；

The press key input device is a keyboard, the mouse emulation device include to be arranged on the left of the keyboard or right side one Main analogue means, and some buttons of keyboard opposite side are arranged on, some buttons can be selected comprising hand in standard finger ring Refer to return one or more buttons thereon after button, for realizing the keypress function of mouse；Or, the key-press input dress A keyboard is set to, the mouse emulation device includes a main analogue means on said keyboard is arranged, and is arranged on keyboard Some buttons in key area and outside the main analogue means, in some buttons, left-handed operation in standard finger ring Button is used for realizing the function of left mouse button, and in standard finger ring, the button of right-hand operated is used for realizing functions of mouse right key；Described Main analogue means can include but is not limited to following kind of input unit or input/output unit or its combination：Electronic whiteboard, Blank, projected keyboard device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure dress Put, infrared facility, laser aid, mechanical device；

Or；

The press key input device is hard manual or control panel, and the mouse emulation device is hard device, the key-press input In the key area of device or periphery also sets up one or more hard controlling switches for opening and closing mouse function, or Person, the soft controlling switch being provided with the mouse emulation device for opening and closing mouse function；Or, the button is defeated It is soft keyboard or the soft control panel shown on human-computer interaction device to enter device, and the mouse emulation device is for showing man-machine The soft device of interactive device, is also provided with the human-computer interaction device one or more for opening or closing mouse function Hard controlling switch or soft controlling switch；The human-computer interaction device can include but is not limited to following kind of input unit or Input/output unit or its combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, electricity Input unit, electromagnetic induction device, pressure apparatus, infrared facility, laser aid；

Or；

The press key input device be on the human-computer interaction device show soft device, and the surface of key area be provided with by Key-shaped shape fully transparent or the film between fully transparent and completely opaque, the film are provided with keyboard rill and have and touch Sense；One kind or combination that the human-computer interaction device includes and is not limited in following device：Electronic whiteboard, blank, projected keyboard Device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, swash Electro-optical device.

3. human-computer interaction device as claimed in claim 2, it is characterised in that：

The secondary input device is that the mouse emulation device includes a master for realizing the mouse emulation device of mouse function Analogue means, the press key input device and the main analogue means are hard device, and the main analogue means is in the button Part in the key area of input unit by one or more with the key shape of the press key input device and in the same size, And the fritter main analogue means composition divided according to normal key bit boundary, and the main analogue means of the fritter have can be in vertical direction The elastic mechanism of upper flexible or motion；Wherein, the main analogue means can include but is not limited to following kind of input unit Or input/output unit or its combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, Device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, mechanical device；

Or；

The secondary input device is that the mouse emulation device includes a master for realizing the mouse emulation device of mouse function Analogue means, the main mould intend device form ground, stealthy ground, invisibly or visibly, implicit expression, explicit or be explicitly divided into Multiple regions, the mouse function that each region is realized can be different, and the regional and its function are fixing, changes Or can configure；The main analogue means can include but is not limited to following kind of device or combination：Electronic whiteboard, Blank, projected keyboard device, touch-screen, Trackpad, other touching devices and device of electrical input, electromagnetic induction device, pressure dress Put, infrared facility, laser aid, mechanical device.

4. a kind of electronic installation, it is characterised in that include the man-machine interaction as described in any claim in claims 1 to 3 Device.

5. electronic installation as claimed in claim 4, it is characterised in that：

The human-computer interaction device is integrated keyboard and the mouse of the keyboard-type of mobile phone, other hand-held devices or notebook computer Analogue means, or the keyboard for desktop computer keyboards formula and the mouse emulation device arranged on the keyboard；Or be shape Formula, stealthy, sightless or visible, display, setting on keyboard being explicitly or implicitly arranged at the electronic installation Mouse emulation device；Or for form, stealthy, sightless or visible, be explicitly or implicitly arranged at the electronics Soft device on the input/output unit of device；It is defeated that the input/output unit can include but is not limited to following kind of input Go out device or combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, electricity input dress Put, electromagnetic induction device, pressure apparatus, infrared facility, laser aid；

Or；

The human-computer interaction device is the soft device being shown on the input/output unit that the electronic installation includes, the input Output device determines the device shown in a certain region or content by the control of hardware or software, comprising realizing multiple displays Device or the switching of display content；The input/output unit can include but is not limited to following kind of input/output unit or Combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetism sense Answer device, pressure apparatus, infrared facility, laser aid；

Or；

The press key input device is soft device that show on the input/output unit or setting, the mouse emulation dress Put including Trackpad or other input/output units that show on the input/output unit or setting, opening mouse work( Can when shows or the soft Trackpad that arranges or other input/output units in overlapping region, in overlapping region during closing mouse function Show soft-key button input unit；Or

While showing the press key input device and Trackpad or other input/output units on input/output unit, wherein one The viewing area of individual device is fully transparent or between fully transparent and opaque；

One kind or combination that the input/output unit includes and is not limited in following device：Electronic whiteboard, blank, projected keyboard Device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, swash Electro-optical device.

6. the man-machine interaction method of the human-computer interaction device in a kind of use such as claims 1 to 3 as described in any claim, its It is characterised by：During being input into by press key input device, such as mouse function need to be used, then open all or part of mouse Mark function, can select to be located at least part operation region the dress of the mouse emulation in key area or in other input units Put and operated, need to such as be switched to key-press input pattern or other patterns in this mode, then can select to close the mouse Function；Wherein, the press key input device and/or mouse emulation device include and are not limited to following kind of input or be input into defeated Go out the soft device that realizes in device or combination, or input/output unit：Electronic whiteboard, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, machinery dress Put.

7. man-machine interaction method as claimed in claim 6, it is characterised in that：The mouse function in the following manner in one Plant or multiple realizations：Mode A, when mouse emulation device has main analogue means, by the operation list to the main analogue means Mouse function is solely realized；Mode B, when mouse emulation device has main analogue means, by the main analogue means, and operation Mouse function is realized in the operation of button, and wherein operation button is used for realizing the part or all of keypress function of mouse；Mode C, mouse Mark analogue means there is main analogue means, and set up on keyboard auxiliary element when, by the main analogue means and auxiliary The operation of element is helped to realize mouse function；Mode D, with multiple auxiliary elements that sets up on keyboard on mouse emulation device When, by realizing mouse function to the operation of the auxiliary element；Mode E, on mouse emulation device with multiple on keyboard During the auxiliary element that sets up, by realizing mouse function to the operation of the auxiliary element and original button；Mode F, mouse Analogue means has main analogue means, and set up on keyboard auxiliary element when, by the main analogue means, and auxiliary Mouse function is realized in the operation of element and original button；

The mouse function includes and is not limited to one or more in following functions：Execute, select, drag, show menu, shifting Dynamic cursor, scrolling display screen, and multidimensional is while mobile display；The main analogue means includes and is not limited to following kind of Input unit or input/output unit or its combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, touch pad and other Touch input device, device of electrical input, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser aid, Mechanical device；

Or；

By the mouse emulation device or main analogue means implicit expression therein, explicitly or explicitly multiple regions are divided into, including The region of cursor locomotive function is realized, and at least one is used for realizing the region of following at least one function：Execute, select, Drag, show menu, roll screen, multidimensional while mobile display；And the regional and its function are fixing, changes Or can configure；

Or；

The mouse function is by being arranged on the left of the press key input device key area or the main analogue means on right side and set The some buttons realization in keyboard opposite side is put, some buttons are finger returns thereon after button in standard finger ring one Or multiple buttons, for realizing the keypress function of mouse；Or the mouse function is by being partly or entirely arranged on the button A main analogue means in input unit key area and some buttons being arranged on outside the main analogue means are realized, if at this In dry button, in standard finger ring, the button of left/right hand operation is used for realizing the function of mouse left/right key, right/left in standard finger ring The button of hand operation is used for realizing right mouse/left button function；

Or；

The auxiliary element at least includes：One auxiliary element for realizing cursor locomotive function and one realizes the auxiliary of mouse button functions Help element；The auxiliary element for realizing mouse locomotive function is using the one kind in following form or combination：At least one refers to Point bar, the input unit of at least one control targe motion, the roller ball of at least one control targe motion and at least one control The roller of target motion processed；The auxiliary element for realizing mouse button functions is using the one kind in following form or combination： At least one button for confirming operation, it is defeated that at least one TrackPoint, at least one roller ball, at least one control targe are moved Enter device, at least one roller and at least one operation button for being operable with mouse functionality mode；

Or；

Mouse function is opened or closed by pressing or tapping the button of the confirmation operation being independently arranged on keyboard；By pressing or The Macintosh that order is tapped on keyboard opens or closes mouse function；Mouse work(is opened or closed by way of touching TrackPoint Energy；Mouse function is opened or closed by way of rotating a roller ball；Beaten by way of rotating a roller and open or close Close mouse function；The input operation of the keyboard outside mouse emulation device operating area is received, closes mouse function；Setting time The operation of the main analogue means in being inside not received by mouse emulation device or mouse emulation device, closes mouse function；Pass through The move mode set in main analogue means of the finger in mouse emulation device or mouse emulation device opens or closes mouse Function；The main analogue means includes but is not limited to following kind of input unit or input/output unit or its combination：Electronics Blank, blank, projected keyboard device, touch-screen, Trackpad, other touching devices, device of electrical input, electromagnetic induction device, pressure Power apparatus, infrared facility, laser aid, mechanical device；

Or；

By in main analogue means of the finger in mouse emulation device or mouse emulation device set move mode open or When closing Trackpad, the move mode of the setting include following at least one：The displacement of finger meets or exceeds setting Value；The rate travel of finger meets or exceeds setting value；The number of times that moves back and forth of finger meets or exceeds setting value；Finger is to extremely The pressure that a few button applies meets or exceeds setting value；Finger from the movement of the surface of a button or slide into another by The surface of key；The motion track of finger meets the shape of setting；Finger click or double click on area in fixed point, certain region, certain The summit in individual region.

8. input method as claimed in claim 6, it is characterised in that：

The mouse emulation device has main analogue means, and mouse function realized in the following manner by the main analogue means：Institute After stating the unlatching of main analogue means, if fricton-tight before click on for first time also nothing clicking on, it is considered as the left button for clicking on mouse, the Once slide as controlling cursor movement；During click, last time operation before for click or is slided, if clicking on the last time The left side of the terminal of the point of click or the last time stroke, is considered as the function of clicking on left mouse button and continue to keep clicking on；If The right side of the point of last time click or the terminal of the last time stroke is clicked on, is considered as click right mouse button；During click, Last time operation before for click or is slided, if in the terminal of the point that the last time is clicked on or the last time stroke is The radius of the heart for M circle in start slide or stroke, then by slip thereafter or stroke be accordingly to be regarded as drag, until have click on or from Till driving the main analogue means；During stroke, last time operation before is stroke, is being less than N with a distance from the line of the stroke Region in and the radius centered on the terminal of the stroke for M circle outside, be considered as operation middle button of mouse；

M, the N are the distance for arranging；

Or；

The mouse emulation device has main analogue means, and the press key input device is soft device, and can be according to cursor or hand The movement of finger and movement, when cursor or finger are moved from current location to button direction to be operated, whole key-press input dress Put or press key input device in finger motion institute direction part with respect to finger motion direction while or asynchronously move；

Or；

The mouse emulation device includes main analogue means, the area maps all or part screen of the main analogue means；Point Hit the main analogue means certain point when, cursor is moved on the point on the screen with the point with mapping relations；Meanwhile, On the main analogue means during a mobile unit, cursor also moves a unit on the screen, or according to described The ratio of main analogue means and the screen size moves multiple units；The main analogue means is included but is not limited to Types Below Input unit input/output unit or its combination：Electronic whiteboard, blank, projected keyboard device, touch-screen, touch pad and its Its touch input device, device of electrical input, device of electrical input, electromagnetic induction device, pressure apparatus, infrared facility, laser dress Put, mechanical device.

9. a kind of human-computer interaction device of man-machine interaction method of the application as described in any one of claim 6～8, its feature exist In：

When operating to the mouse emulation device, with soft or hard nail, artificial nail, finger ring, fingerstall, fingertip, refer to Bed linens, on hand articles for use or other articles and its part and/or the position for combining to realize positioning cursor or display.

10. human-computer interaction device as claimed in claim 9, it is characterised in that：

The article for realizing the position of positioning cursor or display, its material is：Soft or hard metal, plastics, woodwork, life Tetramune or other soft or boardy products；

Or；

The article for realizing the position of positioning cursor or display, its shape can be arbitrary shape, one little cusp of band Object, spherical or oval sphere or 6,8,12,24 face bodies or other curved surfaces and its part and/or combination；

Or；

Certain point of the human body parts of the contact that the mouse emulation device is arrived with human body sensory or the movement at position, it is fixed to realize Position and/or mobile cursor and light target form, stealthy, sightless or visible position, displacement or motion related or Person related to cursor relative position relation following at least one：Form, stealthy, invisible or visible order, order Setting, display mode, diagram, figure, image, command menu, button, key or can with the order of clicking operation or diagram, similar in appearance to Input and/or the figure of output device, human body sensory to certain point of human body parts of contact or position include to touch The central point of the part of finger or core；Or the dynamics of pressing, area or figure are judging input operation；

Or；

When operating to the press key input device and/or mouse emulation device, with vibrations, vibration, picotement, thermal sensation, flash and/ Or other feel to realize feel, sense of touch.