EP1924900A1 - Systeme et procede de traitement de donnees brutes d'un dispositif de pave tactile - Google Patents
Systeme et procede de traitement de donnees brutes d'un dispositif de pave tactileInfo
- Publication number
- EP1924900A1 EP1924900A1 EP06789732A EP06789732A EP1924900A1 EP 1924900 A1 EP1924900 A1 EP 1924900A1 EP 06789732 A EP06789732 A EP 06789732A EP 06789732 A EP06789732 A EP 06789732A EP 1924900 A1 EP1924900 A1 EP 1924900A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- touch
- digits
- track pad
- host
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
- G06F3/0446—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
Definitions
- the invention relates generally to computer input devices and more particularly to a track pad input device that generates and transmits measured (raw) sensor data to a host computer system.
- Software executing on the host computer system analyzes the raw sensor data to determine the user's action.
- a track pad is a touch-sensing planar digitizer input device used instead of, or in conjunction with, a mouse or trackball. During use, an operator places a finger on the track pad and moves the finger along the touch-sensing planar surface. The track pad detects the movement of the finger and in response provides location and/or motion signals to a computer.
- track pad sensor devices resistive and capacitive.
- a resistive track pad sensor is a mechanical sensor that uses two layers of material that are typically separated by air. Pressure from a finger pushes the top layer (generally a thin, clear polyester film) so that it touches the bottom layer (generally glass). The voltage at the contact point is measured and the finger's location and/or motion is computed and transmitted to a host computer system. After the finger is removed, the top layer "bounces back" to its original configuration.
- a capacitive track or touch pad sensor in contrast, is a solid-state sensor made using printed circuit board (“PCB”) or flex circuit technology. A finger on, or in close proximity to, a top grid of conductive traces changes the capacitive coupling between adjacent traces or the self-capacitance of each trace.
- prior art computer system 100 includes track pad device 105 coupled to host computer module 110 via communication path 115.
- Track pad device 105 comprises sensor 120, data acquisition circuit 125, processor 130, memory 135 and transmit circuit 140.
- data acquisition circuit 125 measures changes in the capacitive coupling between adjacent sensor elements (or the self-capacitance of a given sensor element).
- Processor 130 processes the acquired capacitance signals to compute a signal indicating the user's finger position on sensor 120 (e.g., a ⁇ x and ⁇ y signal).
- processor 130 may also determine if multiple fingers are activating sensor 120 and whether certain predetermined finger motions (often referred to as “gestures") are being made - e.g., "select,” “drag,” “file open” and “file close” operations.
- gestures often referred to as “gestures”
- the user's finger location and/or motion as determined by processor 130 is transmitted to host computer module 110 via communication path 115.
- receive circuit 145 receives the transmitted track pad signal and passes its information to driver application 150.
- Driver application 150 makes the computed sensor information available to other applications such as, for example, window display subsystem application 155.
- prior art system 100 utilizes a dedicated processor for measuring and analyzing raw track pad sensor data to generate a signal that indicates a user's action.
- processor 130 may be embodied in a general-purpose processor (e.g., a microprocessor), a microcontroller, or a special purpose or custom designed processor or state machine (e.g., an application specific integrated circuit or a custom designed gate array device).
- memory 135 is typically used to provide permanent storage for instructions (i.e., firmware) to drive processor 130 and may, optionally, include random access memory and/or register storage.
- firmware i.e., firmware
- FIG. 1 A benefit of the architecture of FIG. 1 is that host computer module 110 does not need to know about or understand the type of data generated by sensor 120. A corollary of this feature is that host computer module 110 does not process track pad sensor data.
- the invention provides a track pad input device that includes a track pad sensor element that generates output signals representing a track pad sensor characteristic (i.e., capacitance or resistance), a data acquisition circuit that measures a (digital) value encoding the track pad sensor's characteristic and a communication circuit that transmits the measured track pad sensor values to a general purpose processor for analysis, the general purpose processor is also responsible for executing user and other system level tasks or applications.
- the track pad sensor is a capacitive track pad sensor so that measured values comprise raw track pad sensor values and the general-purpose processor corresponds to a host computer system's central processing unit.
- Figure 1 shows, in block diagram form, a track pad-computer system architecture in accordance with the prior art.
- Figure 2 shows, in block diagram form, a track pad-computer system architecture in accordance with one embodiment of the invention.
- Figure 3 shows, in block diagram form, a track pad device and host computer system in accordance with one embodiment of the invention.
- Figure 4 shows, in block diagram form, a track pad sensor data acquisition system in accordance with one embodiment of the invention.
- Figure 5 shows, in flowchart form, a data acquisition method in accordance with one embodiment of the invention.
- Figures 6 through 9 show various gestures that can be made on a touch pad and interpreted as a user-level task using the disclosed system according to the present disclosure.
- Figure 10 illustrates the disclosed touch pad device and a host module for interpreting measured data values from gestures as user-level tasks for a host application.
- system 200 includes track pad device 205 coupled to host module 210 through communication path 215.
- Track pad device 205 comprises track pad sensor 220 that generates signals based on user manipulation thereof, data acquisition circuit 225 for capturing or measuring the sensors and transmit circuit 230 for aggregating and periodically transmitting the measured sensor data values to host module 210 via communication path 215.
- receive circuit 235 receives the measured sensor data and passes them to driver application 240.
- Driver application 240 processes or analyzes the measured data to determine the user's conduct (e.g., a "single click,” “double click,” “scroll” or “drag” operation), passing the calculated location and/or movement information to other applications such as, for example, window display subsystem application 245.
- driver application 240 is executed by host processor 250 which, as shown, is also responsible for executing (at least in part) one or more user applications or processes 255. It is significant to note that track pad device 205 has no capability to process or analyze data signals (values) acquired from sensor 220.
- sensor data is analyzed by a host computer system's general-purpose processor or central processing unit (“CPU").
- the architecture of FIG. 2 recognizes and takes unique advantage of the processing power of modern CPUs incorporated in host computer systems (e.g., notebook or other personal computers, workstations and servers).
- This recognition and the architecture of FIG. 2 permits a computer system 200 that is both lower in cost to manufacture and more flexible than the systems provided by the prior art.
- Lower costs may be realized by eliminating the prior art's dedicated hardware for processing track pad sensor data (i.e., a processor and associated firmware memory - see components 130 and 135 in FIG. 1).
- Increased flexibility may be realized by providing feature set functionality via software that executes on the host computer's CPU - that is, processing/analyzing measured track pad sensor data on one or more of the host computer's CPUs.
- track pad functionality may be modified, updated and enhanced through conventional software upgrade procedures.
- track pad device 300 in accordance with one embodiment of the invention comprises m-row by n-column capacitive sensor array 305, data acquisition circuit 310 (itself comprising multiplexer ("MUX") circuit 315, storage capacitor 320 and scan circuit 325) and Universal Serial Bus (“USB”) transmit circuit 330.
- MUX multiplexer
- USB Universal Serial Bus
- MUX circuit 315 is responsible for coupling and stimulating successive sensor array elements (e.g., rows, columns, or individual pixels - that is, an element at the intersection of a row and column) to storage capacitor 320 in a controlled/sequenced manner and indicating that a measurement cycle has begun to scan circuit 325.
- scan circuit 325 records the time required to charge storage capacitor 320 to the specified threshold. Accordingly, scan circuit 325 provides a digital value that is a direct indication of the selected sensor array element's capacitance.
- USB transmit circuit 330 is responsible for aggregating the measured capacitance values into packets and transmitting them in accordance with the USB protocol to host module 335 via USB bus 340.
- USB transmit circuit 330 may transfer each frame of data to host module 335 in more than one, one or more than one packet.
- host module's USB receive circuit 345 receives the measured sensor data from track pad device 300 via USB bus 340, it unpacks and passes the measured capacitance data to driver application 350.
- Driver application 350 accepts and processes the raw (measured) capacitance data to provide meaningful cursor movement input to operating system application 355.
- driver application 350 implements track pad algorithms traditionally provided by a dedicated track pad processor such as, for example, processor 130 and firmware memory 135 of FIG. 1.
- FIG. 4 a more detailed view of MUX circuit 315 as it can be implemented for a row and column addressable capacitive sensor array is illustrated. As shown, each row in sensor array 400 is electrically coupled to voltage source Vcc 405 through MUX-I 410 and to storage capacitor 415 through MUX-2 420. (although not shown in detail, each column of sensor array 400 is similarly coupled to Vcc 405 and to storage capacitor 415 through other MUX circuits - block 425.)
- MUX-I 410 couples a first sensor array row to Vcc 405 for a specified period of time (block 500) and then isolates or disconnects that row from Vcc 405 (block 505).
- MUX-2 420 couples the same row to storage capacitor 415 for a specified period of time, or until the voltage on storage capacitor 415 reaches a specified threshold (block 510). If, during the time MUX-2 420 couples the selected sensor row to storage capacitor 415 the storage capacitor's voltage reaches a specified threshold (the "Yes" prong of block 515), the digital value corresponding to the time it took to charge storage capacitor 415 to the threshold is recorded by scan circuit 325 (block 520).
- sensor array 400 comprises a
- 16x32 capacitive grid providing 48 output channels; Vcc is 3.3 volts; storage capacitor 415 is approximately 10,000 picofarads, an average row capacitance value is approximately 12 picofarads; an average column capacitance value is approximately 9 picofarads; the average change in capacitance of a row or column electrode due to a user's finger touching sensor array 400 is approximately 0.2 picofarads; the threshold value at which a digital capacitance value is obtained is 1.6 volts; and the rate at which MUX circuits 410, 420 and 425 are switched is 6 megahertz. It has been found, for these values, that its takes approximately 580- 600 sample cycles to charge storage capacitor 415 to the threshold voltage.
- the digital capacitance value is, in fact, a count of the number of sampling cycles required to charge storage capacitor 415 to the threshold value.
- scan circuit 325 (in conjunction with MUX circuits 410, 420 and 425 and storage capacitor 415) measures each of the 48 sensor array outputs 125 times each second, with each measurement comprising a 10-bit value (unsigned integer).
- the illustrative track pad sensor device Referring to the 48 measurements acquired by scan circuit 325 from sensor array 400 in each of the 125 epochs as a frame, the illustrative track pad sensor device generates: bytes/ v frame A channel A second y ⁇ bits y / secon ⁇
- driver application 350 is executed general purpose processing unit 360 that is also responsible for executing user applications and tasks, e.g., 365. That is, in accordance with the invention raw track pad sensor data is analyzed by one, or more, general-purpose processing units associated with the host computer system and not by a dedicated processor or processing circuit(s) associated with track pad device 300.
- processing resources e.g., CPUs
- tasked with analyzing track pad sensor data must be shared with other computer system processing needs such as other system level and user level applications.
- transmit circuits 230 and 330 may be shared by other USB input devices such as, for example, a keyboard.
- the invention is also applicable to track pad sensor devices that are pixilated rather that row-column addressable.
- the operational procedure outlined in FIG. 5 may be modified. For instance, sensor column values may be obtained before sensor row values. Alternatively, sensor row and sensor column data may be interlaced and/or measured at the same time.
- scan circuit 325 measures sensor pad characteristic values (e.g., capacitance or resistance) in a set order and that this order must be known or communicated to driver application 350.
- scan circuit 325 may measure sensor characteristic values in any convenient manner and reorder them into a sequence known or expected by driver application 350 prior to transmission by transmit circuit 330.
- Various gestures can be detected by the track pad device 300 and interpreted as user-level tasks or operations.
- the user gesture made on the sensing elements 305 of the track pad device 300 include a touch of one digit, a touch of two or more digits concurrently, a touch with sliding movement of one or more digits, a touch and sliding movement of one or more digits concurrently with a stationary touch of one or more digits, a touch and contractive movement of two or more digits, a tap of one or more digits, a touch and expansive movement of two or more digits, a touch of one or more digits with a tap of one or more digits, a touch of a portion (e.g., palm) of a hand, and a touch and movement of a portion of a hand.
- a portion e.g., palm
- Some one-finger gestures include a one-finger tap on the track pad device to implement a left click mouse operation and a one-finger down and hold on the track pad device to implement a cursor motion.
- Some two-finger gestures on the track pad device include: (1) two fingers down together and a vertical movement to implement a vertical scroll operation; (2) two fingers down together and a horizontal movement to implement a horizontal scroll operation; (3) a two- finger tap to implement an operation; (4) two fingers both down and then spread apart and back together to implement a zoom operation; (5) two fingers down together and rotated in a circular motion either clockwise/counter-clockwise to implement a rotate operation; (6) one finger down and then a second finger down to implement an operation; (7) one finger down and then a second finger tap to implement an operation; and (8) two fingers down together and a diagonal movement to implement an operation.
- FIGS. 6 through 9 a number of exemplary gestures 600, 700,
- user gestures 600 on the sensing elements of a track pad device can be used to perform various mouse operations or tasks of a host application.
- the mouse operations can include, but are not limited to, a point, a click, a double click, a right click, a drag/select, and a scroll.
- a point operation can be implemented with a first gesture 602 involving touching and moving any two adjacent fingers on the track pad device.
- a click operation can be implemented with a second gesture 604 involving a tap (momentary touch) of any two adjacent fingers on the track pad device.
- a double click operation can be implemented with a third gesture 606 involving a tap (momentary touch) of any three adjacent fingers on the track pad device.
- a right click operation can be implemented with a fourth gesture 608 involving a tap of the thumb, middle finger, and ring finger on the track pad device.
- a drag/select operation can be implemented with a fifth gesture 610 involving a touch and movement of three fingers on the track pad device.
- a scroll operation can be implemented with a sixth gesture 612 involving the touch and slide up/down of four fingers on the track pad device.
- the system can also be used to emulate operation of a three-button mouse.
- a click of a middle button can be implemented by a seventh gesture 614 involving a tap of the thumb, index, and middle fingertips on the track pad device.
- a right click in a three-button emulation can be implemented by a eighth gesture 616 involving the spreading of the hand and then the tap of the thumb, ring, and pinky fingers on the track pad device.
- additional user gestures 700 on the track pad device can be used to implement various editing and cursor operations or tasks of a host application.
- the editing operations can include, but are not limited to, cut, copy, paste, undo previous operation, and redo previous operation.
- the cursor operations can include, but are not limited to, move cursor, select with cursor, tab cursor, move cursor to home, move cursor to end, page up, and page down.
- a cut operation can be implemented with a first gesture 702 involving a touch and pinch of the thumb and middle finger on the track pad device.
- a copy operation can be implemented with a second gesture 704 involving a tap of the thumb and middle finger on the track pad device.
- a paste operation can be implemented with a third gesture 706 involving a touch and expansion of the thumb and middle finger on the track pad device.
- An Undo/Redo operation can be implemented with a fourth gesture 708 involving a touch and slide of the thumb and middle finger up/down on the track pad device.
- Undoing just one operational step can be implemented by sliding quickly, or multiple steps can be implemented by sliding gradually.
- a Tab/BackTab operation can be implemented with a fifth gesture 710 involving a touch and slide of the thumb and middle finger right/left on the track pad device.
- Just one tab can be implemented by sliding quickly, and repetitive tabs can be implemented by sliding gradually.
- An arrows operation can be implemented with a sixth gesture 712 involving a touch with a slide of any finger on the track pad device to move the text cursor.
- a Text Select operation can be implemented with a seventh gesture 714 involving a touch with a slide up/down of three spread fingers on the track pad device.
- a Tab/Back Tab operation can be implemented with a eighth gesture 716 involving a touch of the thumb and middle finger and a slide left/right on the track pad device.
- a Home/End operation can be implemented with a ninth gesture 718 involving a touch of four spread fingers with slide left/right on the track pad device.
- a Page-Up/Page-Down operation can be implemented with a tenth gesture 720 involving a touch of four spread fingers with a slide up/down on the track pad device.
- additional user gestures 800 on the sensing elements of the track pad can be used to implement various file and application operations or tasks of a host application.
- the file operations can include, but are not limited to, open file, close file, save file, new file, print file, next file, and previous file.
- the application operations can include, but are not limited to, show desktop, exit application, and switch application window.
- an open file operation can be implemented with a first gesture 802 involving a touch with counter-clockwise rotation of the thumb and three fingers on the track pad device.
- a close file operation can be implemented with a second gesture 804 involving a touch with clockwise rotation of the thumb and three fingers on the track pad device.
- a save file operation can be implemented with a third gesture 806 involving a touch with contraction of the thumb and three fingers on the track pad device.
- a new file operation can be implemented with a fourth gesture 808 involving a touch with expansion of the thumb and three inner fingers on the track pad device.
- a print file operation can be implemented with a fifth gesture 810 involving pre-spreading of the hand and then a touch with further expansion of the thumb and three outer fingers on the track pad device.
- a next file operation can be implemented with a sixth gesture 812 involving a touch with a slide of the thumb and three fingertips to the left on the track pad device.
- a previous file operation can be implemented with a seventh gesture 814 involving a touch with a slide of the thumb and three fingertips to the right on the track pad device.
- An operation for showing the desktop can be implemented with a eighth gesture 816 involving touching the track pad with spread thumb and three fingers and then sliding to the left on the track pad device.
- An exit application operation can be implemented with a ninth gesture 818 involving a touch with clockwise rotation of spread thumb and three fingers on the track pad device.
- a switch application operation can be implemented with a tenth gesture 820 involving touching the track pad with spread three fingers and thumb and then sliding left or right on the track pad device. Sliding crisply can be used to advance just one window, and sliding gradually can be used to scroll through whole list.
- additional user gestures 900 on the track pad device can be used to perform various web-browsing and keyboard operations or tasks of a host application.
- the browser operations can include, but are not limited to, back, forward, scroll, zoom in, zoom out, and find in page.
- the keyboard operations can include, but are not limited to, shift, control/command, and select key.
- a back operation can be implemented with a first gesture 902 involving a touch with a slide of the thumb and three fingertips to the left on the track pad device.
- a forward operation can be implemented with a second gesture 904 involving a touch with a slide of the thumb and three fingertips to the right on the track pad device.
- a scroll operation can be implemented with a third gesture 906 involving a touch with a slide of four fingers up/down on the track pad device. If desired, the thumb can be rested on the track pad device after starting the slide on the track pad device.
- a zoom-in operation can be implemented with a fourth gesture 908 involving a touch with expansion of the thumb and four fingers on the track pad device.
- a zoom-out operation can be implemented with a fifth gesture 910 involving a touch with a contraction of the thumb and four fingers on the track pad device.
- a find-in-page operation can be implemented with a sixth gesture 912 involving a touch with a pinch of the thumb and two fingertips on the track pad device.
- a fine scroll operation can be implemented with a seventh gesture 914 involving the "roll" of fingers instead of sliding them on the track pad device. If desired, the thumb can be rested on the track pad device once the scroll starts.
- a pointing operation can be implemented with an eighth gesture 916 involving dropping other fingers to point with all five fingers on the track pad device once pointing starts. Additional gestures can include a ninth gesture 918 involving moving all five fingers on the track pad device and a tenth gesture 920 involving a touch and movement of a portion (e.g., palm) of a hand on the track pad device.
- the system 1000 includes track pad device 1010 having sensor array 1012, data acquisition circuit 1014, first communication circuit 1016, host module 1040 having second communication circuit 1042, one or more host processors 1044, software 1046, and host application 1048, each of which is similar to previous embodiments discussed above.
- the second communication circuit 1042 is operatively coupled to the first communication circuit 1016 via communication path 1030, such as a USB bus.
- the one or more host processors 1044 are operatively coupled to the second communication circuit 1042, and at least one of the host processors 1044 is responsible, at least in part, for executing user-level tasks of the host application 1048.
- Sensing elements of the track pad array 1012 measure data values
- the touch pad device 1010 does not process the raw, measured data values representative of the user gesture. Instead, the data acquisition circuit 1014 obtains the measured data values 1020 of the array 1012, and the first communication circuit 1016 transmits the measured data values 1020 to the second communication circuit 1042 of the host module 1040.
- the gesture processing software 1046 on the host module 1040 executes on at least one of the host processors 1044.
- the gesture processing software 1046 interprets the raw data values 1020 communicated from the track pad device 1010 and makes interpreted data 1122 available to the host application 1048 for execution as a user-level task.
- the software 1046 uses algorithms for processing the data and interpreting it into data for user-level tasks or operations to be implemented at the host module 1040.
- the algorithms used can include those algorithms known in the art, such as existing algorithms used with touch-screens, existing algorithms used with touch pads that process gestures at the touch pad, and existing algorithms used for navigation features provided on a prior art Fountain touch pad.
- the software 1046 can use algorithms, such as those disclosed in U.S. Patent Nos. 6,570,577 and 6,677,932 and in U.S. Patent Publication Nos. 2005/0104867 and 2002/0015024, which are incorporated herein by reference.
- an exemplary algorithm for the system 1000 may first involve the track pad device 1010 obtaining raw row and column data from the sensor array 1012 at a first point in time and transmitting that raw data to the host module 1040.
- the software 1046 receives that row and column data as a current frame.
- the software 1046 filters or smoothes the data and separately counts the number of areas that have created increased signal in the rows and columns of the current frame. These areas of increased signal correspond to images of the user's digits on the track pad device 1010. (The areas of increased strength are referred to here as the finger count). If the finger count in either the rows or columns of the current frame is zero, then the finger count for the entire track pad device 1010 of the current frame is assumed to be zero.
- the finger count for the entire track pad device 1010 is set to the maximum of the row finger count or the column finger count.
- the maximum finger count of the current frame is compared to the maximum finger count in one or more previous frames of data obtained from the track pad device 1010. If the maximum finger count has changed between the current and previous frames, the state of this change is examined to determine if the change in finger count represents a gesture or is part of a gesture.
- the amount of time that the previous finger count was held may be considered.
- the maximum finger count in the current frame may be one, while the maximum finger count in the previous frame may have been two. If the two-finger count in the previous frame lasted less than 250-ms, then the user has made a second finger tap on the track pad device 1010 corresponding to a gesture for a mouse button operation, for example. On the other hand, if the two-finger count in the previous frame lasted more than 250-ms, then the user has used a two-finger gesture for performing a scroll operation, for example, and no mouse button operation is issued.
- the locations of the areas of increased signal strength may be considered.
- the maximum finger counts in the current and previous frames may both be two. If the two-finger count in the previous frame had first row and column values that are different than second row and column values in the current frame, then the user has moved two fingers on the track pad device 1010, which may correspond to a gesture for a scroll operation or the like.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
L'invention concerne un dispositif et un système d'entrée permettant d'acquérir (mesurer) des données brutes d'un capteur de pavé tactile et de transmettre ces données à un ordinateur hôte qui les analyse au moyen d'une application s'exécutant sur une ou plusieurs unité(s) de traitement centrale(s) de l'ordinateur hôte. L'architecture de traitement d'entrée résultante fournit un dispositif d'entrée de pavé tactile qui est à la fois moins cher à la fabrication et plus souple que les dispositifs d'entrée de pavé tactile de l'état de la technique. On peut obtenir de meilleurs coûts par élimination du matériel de pavé tactile dédié de l'état antérieur de la technique permettant de traiter des données de capteur (par exemple, un processeur et une mémoire de micrologiciel associée). L'augmentation de la souplesse peut être réalisée par fourniture d'une fonctionnalité d'ensemble de caractéristiques via un logiciel qui s'exécute sur l'ordinateur hôte. Dans cette architecture, la fonctionnalité de pavé tactile peut être modifiée, mise à jour et améliorée par l'intermédiaire de procédures de mise à niveau.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2005/033255 WO2006036607A1 (fr) | 2004-09-24 | 2005-09-15 | Dispositif et systeme de pave tactile permettant d'acquerir des donnees brutes |
US11/232,299 US7728823B2 (en) | 2004-09-24 | 2005-09-21 | System and method for processing raw data of track pad device |
PCT/US2006/031524 WO2007037806A1 (fr) | 2005-09-15 | 2006-08-11 | Systeme et procede de traitement de donnees brutes d'un dispositif de pave tactile |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1924900A1 true EP1924900A1 (fr) | 2008-05-28 |
Family
ID=37106317
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06789732A Withdrawn EP1924900A1 (fr) | 2005-09-15 | 2006-08-11 | Systeme et procede de traitement de donnees brutes d'un dispositif de pave tactile |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP1924900A1 (fr) |
JP (2) | JP2009523267A (fr) |
CN (2) | CN102841713A (fr) |
WO (1) | WO2007037806A1 (fr) |
Families Citing this family (65)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7760187B2 (en) | 2004-07-30 | 2010-07-20 | Apple Inc. | Visual expander |
US7719522B2 (en) | 2004-09-24 | 2010-05-18 | Apple Inc. | Raw data track pad device and system |
US7728823B2 (en) | 2004-09-24 | 2010-06-01 | Apple Inc. | System and method for processing raw data of track pad device |
US7856605B2 (en) | 2006-10-26 | 2010-12-21 | Apple Inc. | Method, system, and graphical user interface for positioning an insertion marker in a touch screen display |
US8570278B2 (en) | 2006-10-26 | 2013-10-29 | Apple Inc. | Portable multifunction device, method, and graphical user interface for adjusting an insertion point marker |
US20080168402A1 (en) | 2007-01-07 | 2008-07-10 | Christopher Blumenberg | Application Programming Interfaces for Gesture Operations |
US20080168478A1 (en) | 2007-01-07 | 2008-07-10 | Andrew Platzer | Application Programming Interfaces for Scrolling |
US7844915B2 (en) | 2007-01-07 | 2010-11-30 | Apple Inc. | Application programming interfaces for scrolling operations |
KR101420419B1 (ko) | 2007-04-20 | 2014-07-30 | 엘지전자 주식회사 | 전자기기와 그 데이터 편집방법 및 이동통신단말기 |
TW200925969A (en) * | 2007-12-11 | 2009-06-16 | Tpk Touch Solutions Inc | Device for scanning and detecting touch point of touch control panel and method thereof |
US8610671B2 (en) | 2007-12-27 | 2013-12-17 | Apple Inc. | Insertion marker placement on touch sensitive display |
US8174502B2 (en) | 2008-03-04 | 2012-05-08 | Apple Inc. | Touch event processing for web pages |
US8717305B2 (en) | 2008-03-04 | 2014-05-06 | Apple Inc. | Touch event model for web pages |
US8416196B2 (en) | 2008-03-04 | 2013-04-09 | Apple Inc. | Touch event model programming interface |
US8201109B2 (en) | 2008-03-04 | 2012-06-12 | Apple Inc. | Methods and graphical user interfaces for editing on a portable multifunction device |
US8645827B2 (en) | 2008-03-04 | 2014-02-04 | Apple Inc. | Touch event model |
US8650507B2 (en) * | 2008-03-04 | 2014-02-11 | Apple Inc. | Selecting of text using gestures |
JP2009301302A (ja) * | 2008-06-12 | 2009-12-24 | Tokai Rika Co Ltd | ジェスチャ判定装置 |
CN101661361A (zh) * | 2008-08-27 | 2010-03-03 | 比亚迪股份有限公司 | 多点触摸检测*** |
CN101661363A (zh) * | 2008-08-28 | 2010-03-03 | 比亚迪股份有限公司 | 一种多点触摸感应***的应用方法 |
KR101503835B1 (ko) * | 2008-10-13 | 2015-03-18 | 삼성전자주식회사 | 멀티터치를 이용한 오브젝트 관리 방법 및 장치 |
KR20110086060A (ko) * | 2008-10-20 | 2011-07-27 | 쓰리엠 이노베이티브 프로퍼티즈 컴파니 | 커스터마이즈된 센서 및 범용 제어기를 이용하는 터치 시스템 및 방법 |
US20100162179A1 (en) * | 2008-12-19 | 2010-06-24 | Nokia Corporation | Method and Apparatus for Adding or Deleting at Least One Item Based at Least in Part on a Movement |
US8957865B2 (en) | 2009-01-05 | 2015-02-17 | Apple Inc. | Device, method, and graphical user interface for manipulating a user interface object |
US9684521B2 (en) | 2010-01-26 | 2017-06-20 | Apple Inc. | Systems having discrete and continuous gesture recognizers |
US9311112B2 (en) | 2009-03-16 | 2016-04-12 | Apple Inc. | Event recognition |
US8566044B2 (en) | 2009-03-16 | 2013-10-22 | Apple Inc. | Event recognition |
US8566045B2 (en) | 2009-03-16 | 2013-10-22 | Apple Inc. | Event recognition |
US8285499B2 (en) | 2009-03-16 | 2012-10-09 | Apple Inc. | Event recognition |
US8661362B2 (en) | 2009-03-16 | 2014-02-25 | Apple Inc. | Methods and graphical user interfaces for editing on a multifunction device with a touch screen display |
WO2010110459A1 (fr) | 2009-03-26 | 2010-09-30 | 京セラ株式会社 | Équipement électronique, procédé de traitement d'informations et procédé d'affichage d'informations |
JP5480517B2 (ja) * | 2009-03-26 | 2014-04-23 | 京セラ株式会社 | 電子機器 |
US9258402B2 (en) | 2009-04-14 | 2016-02-09 | Qualcomm Incorporated | System and method for controlling mobile devices |
US8154529B2 (en) | 2009-05-14 | 2012-04-10 | Atmel Corporation | Two-dimensional touch sensors |
CN102804117A (zh) * | 2009-06-19 | 2012-11-28 | 阿尔卡特朗讯公司 | 触摸敏感输入设备上用于关闭窗口或应用的手势 |
JP5184463B2 (ja) * | 2009-08-12 | 2013-04-17 | レノボ・シンガポール・プライベート・リミテッド | 情報処理装置、そのページめくり方法、およびコンピュータが実行可能なプログラム |
US8786559B2 (en) * | 2010-01-06 | 2014-07-22 | Apple Inc. | Device, method, and graphical user interface for manipulating tables using multi-contact gestures |
US9069416B2 (en) | 2010-03-25 | 2015-06-30 | Google Inc. | Method and system for selecting content using a touchscreen |
US8552999B2 (en) | 2010-06-14 | 2013-10-08 | Apple Inc. | Control selection approximation |
US8773370B2 (en) | 2010-07-13 | 2014-07-08 | Apple Inc. | Table editing systems with gesture-based insertion and deletion of columns and rows |
US20120019453A1 (en) * | 2010-07-26 | 2012-01-26 | Wayne Carl Westerman | Motion continuation of touch input |
US20120026077A1 (en) * | 2010-07-28 | 2012-02-02 | Google Inc. | Mapping trackpad operations to touchscreen events |
US9465457B2 (en) * | 2010-08-30 | 2016-10-11 | Vmware, Inc. | Multi-touch interface gestures for keyboard and/or mouse inputs |
KR101645685B1 (ko) * | 2010-12-20 | 2016-08-04 | 애플 인크. | 이벤트 인식 |
US9298363B2 (en) | 2011-04-11 | 2016-03-29 | Apple Inc. | Region activation for touch sensitive surface |
US8661339B2 (en) | 2011-05-31 | 2014-02-25 | Apple Inc. | Devices, methods, and graphical user interfaces for document manipulation |
US8194036B1 (en) * | 2011-06-29 | 2012-06-05 | Google Inc. | Systems and methods for controlling a cursor on a display using a trackpad input device |
CN102421029A (zh) * | 2011-11-22 | 2012-04-18 | 中兴通讯股份有限公司 | 终端的控制方法、装置及*** |
JP5817613B2 (ja) * | 2012-03-23 | 2015-11-18 | 株式会社デンソー | 入力装置 |
CN103188573A (zh) * | 2012-04-01 | 2013-07-03 | 上海锐开信息科技有限公司 | 具有购物链接功能的显示*** |
JP5619063B2 (ja) * | 2012-04-09 | 2014-11-05 | 京セラドキュメントソリューションズ株式会社 | 表示入力装置及びこれを備えた画像形成装置 |
FR3003050B1 (fr) * | 2013-03-08 | 2016-07-29 | Peugeot Citroen Automobiles Sa | Procede et dispositif facilitant l'utilisation de commandes tactiles |
KR102113272B1 (ko) * | 2013-03-11 | 2020-06-02 | 삼성전자주식회사 | 전자장치에서 복사/붙여넣기 방법 및 장치 |
CN103309612A (zh) * | 2013-05-30 | 2013-09-18 | 北京小米科技有限责任公司 | 移动设备图形界面文本框的信息处理方法、装置和设备 |
JP5748798B2 (ja) * | 2013-06-03 | 2015-07-15 | 京セラ株式会社 | アプリケーションの切替方法 |
JP5748799B2 (ja) * | 2013-06-03 | 2015-07-15 | 京セラ株式会社 | 電子機器 |
US9733716B2 (en) | 2013-06-09 | 2017-08-15 | Apple Inc. | Proxy gesture recognizer |
DE102013012394A1 (de) * | 2013-07-26 | 2015-01-29 | Daimler Ag | Verfahren und Vorrichtung zur Fernsteuerung einer Funktion eines Fahrzeugs |
JP6264871B2 (ja) | 2013-12-16 | 2018-01-24 | セイコーエプソン株式会社 | 情報処理装置および情報処理装置の制御方法 |
JP5793604B2 (ja) * | 2014-07-17 | 2015-10-14 | 京セラドキュメントソリューションズ株式会社 | 表示入力装置及びこれを備えた画像形成装置 |
US9977592B2 (en) * | 2014-10-30 | 2018-05-22 | Mediatek Inc. | Touch rim control method and associated device |
JP6884543B2 (ja) * | 2016-10-03 | 2021-06-09 | シャープ株式会社 | 情報処理装置、情報処理プログラムおよび情報処理方法 |
US11669243B2 (en) | 2018-06-03 | 2023-06-06 | Apple Inc. | Systems and methods for activating and using a trackpad at an electronic device with a touch-sensitive display and no force sensors |
US10776006B2 (en) | 2018-06-03 | 2020-09-15 | Apple Inc. | Systems and methods for activating and using a trackpad at an electronic device with a touch-sensitive display and no force sensors |
US11379113B2 (en) | 2019-06-01 | 2022-07-05 | Apple Inc. | Techniques for selecting text |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5734373A (en) * | 1993-07-16 | 1998-03-31 | Immersion Human Interface Corporation | Method and apparatus for controlling force feedback interface systems utilizing a host computer |
WO1997018547A1 (fr) * | 1995-11-16 | 1997-05-22 | Ure Michael J | Dispositif d'entree multi-effleurement, procede et systeme minimisant les besoins de memorisation |
US5825352A (en) * | 1996-01-04 | 1998-10-20 | Logitech, Inc. | Multiple fingers contact sensing method for emulating mouse buttons and mouse operations on a touch sensor pad |
KR100595926B1 (ko) * | 1998-01-26 | 2006-07-05 | 웨인 웨스터만 | 수동 입력 통합 방법 및 장치 |
US7358956B2 (en) * | 1998-09-14 | 2008-04-15 | Microsoft Corporation | Method for providing feedback responsive to sensing a physical presence proximate to a control of an electronic device |
US20020018051A1 (en) * | 1998-09-15 | 2002-02-14 | Mona Singh | Apparatus and method for moving objects on a touchscreen display |
US7730401B2 (en) * | 2001-05-16 | 2010-06-01 | Synaptics Incorporated | Touch screen with user interface enhancement |
KR100474724B1 (ko) * | 2001-08-04 | 2005-03-08 | 삼성전자주식회사 | 터치스크린을 가지는 장치 및 그 장치에 외부디스플레이기기를 연결하여 사용하는 방법 |
JP3909230B2 (ja) * | 2001-09-04 | 2007-04-25 | アルプス電気株式会社 | 座標入力装置 |
JP2003099185A (ja) * | 2001-09-20 | 2003-04-04 | Alps Electric Co Ltd | 入力装置 |
US6762752B2 (en) * | 2001-11-29 | 2004-07-13 | N-Trig Ltd. | Dual function input device and method |
US6891531B2 (en) * | 2002-07-05 | 2005-05-10 | Sentelic Corporation | Sensing an object with a plurality of conductors |
JP3092750U (ja) * | 2002-09-12 | 2003-03-28 | 文 修 郭 | マルチメディアボタンを有するマウス装置 |
WO2005018129A2 (fr) * | 2003-08-15 | 2005-02-24 | Semtech Corporation | Improved gesture recognition for pointing devices |
US20050052427A1 (en) * | 2003-09-10 | 2005-03-10 | Wu Michael Chi Hung | Hand gesture interaction with touch surface |
US7495659B2 (en) * | 2003-11-25 | 2009-02-24 | Apple Inc. | Touch pad for handheld device |
WO2005067604A2 (fr) * | 2004-01-05 | 2005-07-28 | Oqo Incorporated | Station d'accueil pour dispositif informatique mobile |
US20050162402A1 (en) * | 2004-01-27 | 2005-07-28 | Watanachote Susornpol J. | Methods of interacting with a computer using a finger(s) touch sensing input device with visual feedback |
-
2006
- 2006-08-11 EP EP06789732A patent/EP1924900A1/fr not_active Withdrawn
- 2006-08-11 CN CN201210141634XA patent/CN102841713A/zh active Pending
- 2006-08-11 JP JP2008531105A patent/JP2009523267A/ja active Pending
- 2006-08-11 WO PCT/US2006/031524 patent/WO2007037806A1/fr active Application Filing
- 2006-08-11 CN CN2006800302344A patent/CN101243382B/zh not_active Expired - Fee Related
-
2013
- 2013-01-24 JP JP2013011333A patent/JP2013069350A/ja active Pending
Non-Patent Citations (1)
Title |
---|
See references of WO2007037806A1 * |
Also Published As
Publication number | Publication date |
---|---|
JP2009523267A (ja) | 2009-06-18 |
WO2007037806A1 (fr) | 2007-04-05 |
CN101243382A (zh) | 2008-08-13 |
JP2013069350A (ja) | 2013-04-18 |
CN101243382B (zh) | 2013-01-30 |
CN102841713A (zh) | 2012-12-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7728823B2 (en) | System and method for processing raw data of track pad device | |
WO2007037806A1 (fr) | Systeme et procede de traitement de donnees brutes d'un dispositif de pave tactile | |
US7719522B2 (en) | Raw data track pad device and system | |
EP1805587A1 (fr) | Dispositif et systeme de pave tactile permettant d'acquerir des donnees brutes | |
US20090051671A1 (en) | Recognizing the motion of two or more touches on a touch-sensing surface | |
US8830181B1 (en) | Gesture recognition system for a touch-sensing surface | |
EP0777875B1 (fr) | Detecteur de position d'objets pourvu d'une caracteristique de deplacement des bords | |
US9122947B2 (en) | Gesture recognition | |
US9182884B2 (en) | Pinch-throw and translation gestures | |
TWI496041B (zh) | 二維觸碰感測器 | |
US9069405B2 (en) | Dynamic mode switching for fast touch response | |
US5825352A (en) | Multiple fingers contact sensing method for emulating mouse buttons and mouse operations on a touch sensor pad | |
US5889236A (en) | Pressure sensitive scrollbar feature | |
JP2000181613A (ja) | タッチスクリ―ン用複数同時入力分類方法および装置 | |
US8743061B2 (en) | Touch sensing method and electronic device | |
KR100984630B1 (ko) | 트랙 패드 장치의 원시 데이터를 처리하기 위한 시스템 및방법 | |
US20130113728A1 (en) | Single-point-multi-finger gestures for touch panel | |
Habib et al. | Dgts: Integrated typing and pointing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20080319 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
17Q | First examination report despatched |
Effective date: 20081203 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
18W | Application withdrawn |
Effective date: 20101019 |