TWI452494B - Method for combining at least two touch signals in a computer system - Google Patents
Method for combining at least two touch signals in a computer system Download PDFInfo
- Publication number
- TWI452494B TWI452494B TW100101410A TW100101410A TWI452494B TW I452494 B TWI452494 B TW I452494B TW 100101410 A TW100101410 A TW 100101410A TW 100101410 A TW100101410 A TW 100101410A TW I452494 B TWI452494 B TW I452494B
- Authority
- TW
- Taiwan
- Prior art keywords
- touch
- point
- touch panel
- mouse
- panel
- Prior art date
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Description
本發明是有關於一種將至少兩個觸控訊號結合於電腦系統中的方法，且特別是有關於一種具有至少兩個觸控板(touch pad)的滑鼠。The present invention relates to a method of incorporating at least two touch signals into a computer system, and more particularly to a mouse having at least two touch pads.
最近發展出的多點觸控感測器(multi-touch sensor)提供了更廣泛的輸入能力，其包括應用於電腦繪圖(computer graphics)的多方向性輸入指令。相對於一鍵盤及/或傳統的二維滑鼠等標準輸入裝置來說，直覺又易於掌握的多指互動影像多方向性輸入法(multi-finger gesture-based multi-dimensional input)顯著地改善了二維/三維作業的生產效率。The recently developed multi-touch sensor provides a wider range of input capabilities, including multi-directional input commands for computer graphics. The intuitive and easy-to-follow multi-finger gesture-based multi-dimensional input is significantly improved over standard keyboards such as a keyboard and/or traditional two-dimensional mouse. Production efficiency of 2D/3D operations.
本發明提供了一種新穎設計概念，將多點觸控感測器運用於一滑鼠本體上，以進行多點觸控與多方向性的導航與控制，進而對傳統的二維應用與三維電腦繪圖應用的使用者介面提供一種新的操作方式。The invention provides a novel design concept, which applies a multi-touch sensor to a mouse body for multi-touch and multi-directional navigation and control, and then to traditional two-dimensional applications and three-dimensional computers. The user interface of the drawing application provides a new way of operating.
本發明的一實施例包括了一種新穎的滑鼠硬體設計以及一種介面方法，以對可識別由操作系統所定義的多點觸控訊息的任意應用產生多點觸控輸入指令。本發明的另一實施例則包括了一種介面方法，以利用多點觸控感測器的數據封包來作為無法將一標準輸入當成多點觸控訊息來接受的應用程式的介面指令。然而，上述實施例並非用以限定本發明。One embodiment of the present invention includes a novel mouse hardware design and an interface method for generating multi-touch input commands for any application that recognizes multi-touch messages defined by the operating system. Another embodiment of the present invention includes an interface method to utilize a data packet of a multi-touch sensor as an interface command for an application that cannot accept a standard input as a multi-touch message. However, the above embodiments are not intended to limit the invention.
用來產生多指觸控輸入指令的介面程式包括了一個核心模式裝置驅動器(kernel mode device driver)以及一個使用者應用層級驅動器(user application level driver)，用以輸出特定訊息至目標應用程式。The interface program for generating multi-finger touch input commands includes a kernel mode device driver and a user application level driver for outputting specific messages to the target application.
為讓本發明的上述特徵和優點能更明顯易懂，下文特舉多個實施例，並配合所附圖式，作詳細說明如下。The above described features and advantages of the invention will be apparent from the following description.
一、多點觸控多方向性滑鼠與控制指令的產生1. Multi-touch multi-directional mouse and control command generation
圖1繪示出一種多點觸控及多方向性滑鼠的一第一實施例。滑鼠(或稱為電腦滑鼠)可為經常用來從事電腦工作的任何傳統形式的指標裝置，其作用係藉由偵測其本身相對於其支撐表面的二維運動。實際上，在部分實施例中，滑鼠可包括使用者手握持的一個物件以及一個或多個按鍵。滑鼠更可包括有一個滾輪。FIG. 1 illustrates a first embodiment of a multi-touch and multi-directional mouse. A mouse (or computer mouse) can be any conventional form of indicator device that is often used for computer work by detecting its own two-dimensional motion relative to its support surface. In fact, in some embodiments, the mouse can include an item held by the user's hand and one or more buttons. The mouse can also include a scroll wheel.
在部分實施例中，滑鼠100具有一個深V型凹陷102或是其他缺口，並且V型凹陷102或缺口具有用來容納一個多點觸控感測板106的一個平坦表面104。利用設置於V型凹陷102的表面104上的多點觸控感測板106，使用者可藉由介面驅動程式來發送出其所想要達成的多點觸控手指手勢指令。多點觸控感測板106可獨立地偵測多指觸控動作。其中，上述的感測板能在現有的個人電腦市場上取得。在部份範例中，感測板包括了台灣義發科技()的智慧型觸控式多功能遙控器(smart pad)以及美國新思國際科技()的觸控板。In some embodiments, the mouse 100 has a deep V-shaped recess 102 or other indentation, and the V-shaped recess 102 or notch has a flat surface 104 for receiving a multi-touch sensing plate 106. With the multi-touch sensing board 106 disposed on the surface 104 of the V-shaped recess 102, the user can send out the multi-touch finger gesture command desired by the interface driver. The multi-touch sensing board 106 can independently detect multi-finger touch actions. Among them, the above sensing board can be obtained in the existing personal computer market. In some examples, the sensor board includes Taiwan Yifa Technology ( Smart touch-sensitive multi-function remote control (smart pad) and Synopsys International Technology ( ) of the touchpad.
基於人體工學，一台多點觸控及多方向性滑鼠的工業設計可以非常多樣。在部分實施例中，滑鼠100在其滑鼠本體108的中央區域上具有一個深V型缺口或是凹陷102。凹陷102的表面104為平坦表面，並且在其左右兩端不具有實體的邊界。凹陷102的深度與寬度應足以安裝一個小型的觸控板(面積至少約為30 mm×30 mm)。也就是說，在滑鼠本體上，凹陷的工業設計能讓使用者順利地放置多個手指，並且能順利地向右、向左、向前以及向後拖曳手指。Based on ergonomics, the industrial design of a multi-touch and multi-directional mouse can be very diverse. In some embodiments, the mouse 100 has a deep V-shaped notch or depression 102 in the central region of its mouse body 108. The surface 104 of the recess 102 is a flat surface and does not have a physical boundary at its left and right ends. The depth and width of the recess 102 should be sufficient to mount a small touchpad (area at least about 30 mm x 30 mm). That is to say, on the body of the mouse, the industrial design of the recess allows the user to smoothly place a plurality of fingers and smoothly drag the fingers to the right, left, forward and backward.
凹陷102可提供一種符合人體工學舒適的觸控板使用設計，而且能讓使用者在使用傳統的二維滑鼠操作時不會意外地觸發觸控板。值得注意的是，多點觸控滑鼠的工業設計並不會受限於滑鼠本體的外型與觸控板的校準。The recess 102 provides an ergonomically comfortable touchpad design that allows the user to accidentally trigger the touchpad when using a conventional two-dimensional mouse operation. It is worth noting that the industrial design of the multi-touch mouse is not limited by the appearance of the mouse body and the calibration of the touchpad.
圖2繪示出一種多點觸控及多方向性滑鼠200的一個實施例。滑鼠200具有包含在一個深V型凹陷102內的一個第一多點觸控感測板106以及位於滑鼠本體108側面204上的一第二感測板202。第二感測板202可為一個多點觸控感測板或是單點觸控感測板。FIG. 2 illustrates an embodiment of a multi-touch and multi-directional mouse 200. The mouse 200 has a first multi-touch sensing panel 106 contained within a deep V-shaped recess 102 and a second sensing panel 202 on the side 204 of the mouse body 108. The second sensing board 202 can be a multi-touch sensing board or a single touch sensing board.
圖16及17繪示出多點觸控滑鼠1600及1700的其他實施例。圖16繪示出具有兩個側延伸部1608的一個滑鼠本體1602，並且這兩個側延伸部1608分別包含了一觸控板1604與一觸控板1606。其中，觸控板1604與1606可分別為一單點觸控板或是一多點觸控板。在一實施例中，圖16的多點觸控滑鼠1600包括了兩個單點觸控板。圖17繪示出具有兩個觸控板的一個滑鼠本體1702，一個第一觸控板1706配置於滑鼠本體1702的一頂部上，而一個第二觸控板1704則配置於滑鼠本體1702的一個側延伸部1608上。也就是說，兩個分開的觸控板可設置於一個滑鼠本體上的不同位置。16 and 17 illustrate other embodiments of multi-touch mouse 1600 and 1700. FIG. 16 illustrates a mouse body 1602 having two side extensions 1608, and the two side extensions 1608 include a touchpad 1604 and a touchpad 1606, respectively. The touch panels 1604 and 1606 can be a single touch panel or a multi-touch panel, respectively. In one embodiment, the multi-touch mouse 1600 of Figure 16 includes two single-point trackpads. 17 shows a mouse body 1702 having two touch panels. One first touch panel 1706 is disposed on a top of the mouse body 1702, and one second touch panel 1704 is disposed on the mouse body. One side extension 1608 of 1702. That is to say, two separate touch panels can be placed at different positions on a mouse body.
如繪示於圖1、2、16與17中的多點觸控及多方向性滑鼠具有傳統的二維滑鼠功能，並且可經由一個通用序列匯流排(universal serial bus,USB，以下簡稱為USB)連接器、藍芽(blue tooth)連接器或是其他類似的連接器發送一個多點觸控輸入數據封包至個人電腦主機。使用者以其手指接觸V型凹陷上的主觸控板表面及/或滑鼠本體側面上的第二感測板。這些手指觸控動作即用來產生包括有觸控點座標相關數據的原始數據封包。這些數據封包即用來產生個人電腦作業系統中的一組預先定義觸控訊息(pre-defined touch message)其中之一，在現有技術中，諸如微軟公司7作業系統中的WM_TOUCH或是WM_GESTURE皆為常見的預先定義觸控訊息。也就是說，感測板106(觸控板)會產生包括有各個觸控點在觸控板上的座標的觸控數據(touch data)。這些觸控點用來產生電腦應用程式所能識別的觸控指令訊息(touch command message)。The multi-touch and multi-directional mouse shown in Figures 1, 2, 16 and 17 has a traditional two-dimensional mouse function and can be connected via a universal serial bus (USB). Send a multi-touch input data packet to the PC host for a USB) connector, a blue tooth connector, or other similar connector. The user touches the surface of the main touchpad on the V-shaped recess and/or the second sensing panel on the side of the body of the mouse with his finger. These finger touch actions are used to generate raw data packets including touch point coordinates related data. These data packets are used to generate one of a set of pre-defined touch messages in a personal computer operating system, such as Microsoft Corporation. The WM_TOUCH or WM_GESTURE in the 7 operating system are common pre-defined touch messages. That is to say, the sensing board 106 (the touch panel) generates touch data including coordinates of the respective touch points on the touch panel. These touch points are used to generate touch command messages that can be recognized by a computer application.
在利用介面軟體演算法(interface software algorithm)的部分實施例中，第一感測板上的觸控點與第二感測板上的觸控點會被總合起來處理。舉例來說，使用者可在第一感測板上利用三根手指頭來嘗試產生一個三指觸控手勢。然而，當僅藉由大拇指與小指來支撐滑鼠本體時，在第一感測板上使用到三根手指頭的操作方式可能會較為不舒適。因此，在部分實施例中，介面軟體會結合第一感測板上的兩指觸控動作與第二感測板上的單指觸控動作，以產生三指觸控訊息。另外，在部分實施例中，介面軟體可結合觸控動作，並且經由介面驅動程式，結合後的手指觸控動作對映(mapping)到最終多點觸控手勢訊息能夠是可程式控制的。In some embodiments in which an interface software algorithm is utilized, the touch points on the first sensing board and the touch points on the second sensing board are collectively processed. For example, the user can use three fingers on the first sensing board to try to generate a three-finger touch gesture. However, when the mouse body is supported only by the thumb and the little finger, the operation of using three fingers on the first sensing board may be less comfortable. Therefore, in some embodiments, the interface software combines the two-finger touch action on the first sensing board with the single-finger touch action on the second sensing board to generate a three-finger touch message. In addition, in some embodiments, the interface software can be combined with a touch action, and the combined finger touch action mapping to the final multi-touch gesture message can be programmable through the interface driver.
圖3繪示出圖2的多點觸控及多方向性滑鼠200的俯視圖。圖3顯示出經由利用第一感測板106上的兩指觸控動作與第二感測板202上的單指觸控動作所結合而成的三指觸控動作所產生的一個三指觸控輸入指令。圖4繪示出圖3中所繪示的三指觸控動作的側視圖。3 is a top plan view of the multi-touch and multi-directional mouse 200 of FIG. FIG. 3 shows a three-finger touch generated by a three-finger touch action using a two-finger touch action on the first sensing plate 106 and a single-finger touch action on the second sensing plate 202. Control input instructions. 4 is a side view showing the three-finger touch action illustrated in FIG. 3.
圖5繪示出根據部分實施例的第二感測板502的另一種用法，用以控制觸控手指數。於此圖中，第二感測板502(觸控板)包括了兩個設定區塊，即一個前半部502a以及一個後半部502b。觸控前半部502a可產生一個單指觸控動作，而觸控後半部502b可產生一個兩指觸控動作。這些單指與兩指觸控動作利用一個使用者可程式介面軟體來產生。依據使用者可程式介面軟體的程式設定，使用者可經由在第一感測板106上的一兩指觸控動作與拖曳動作以及在第二感測板502後半部502b的一個單指觸控動作來產生一個四指觸控手勢。FIG. 5 illustrates another use of the second sensing pad 502 to control the touch hand index, in accordance with some embodiments. In this figure, the second sensing board 502 (touching pad) includes two setting blocks, namely, a front half 502a and a rear half 502b. The touch front half 502a can generate a single finger touch action, and the touch back half 502b can generate a two finger touch action. These single-finger and two-finger touch actions are generated using a user-programmable interface software. According to the programming of the user-programmable interface software, the user can perform a two-finger touch action and a drag action on the first sensor board 106 and a single-finger touch on the second half 502b of the second sensor board 502. Action to generate a four-finger touch gesture.
圖6繪示出根據部分實施例的第二觸控板602(感測板)的另一種用法，用以控制觸控手指數。如圖所示，此第二觸控板602包括了四個設定區塊。在這樣的設定之下，在第二觸控板602上所產生的「手指觸控」的數量將會根據前下方、前上方、後下方以及後上方這四個位置而改變。舉例來說，在部分實施例中，觸控第二觸控板602前下方部位代表單指觸控動作。同樣地，觸控前上方部位代表兩指觸控動作；觸控後下方部位代表三指觸控動作；以及觸控後上方部位代表四指觸控動作。也就是說，在這樣的程式設定之下，經由在第一感測板106上的一個兩指觸控動作與拖曳動作，加上在第二觸控板602(感測板)後上方部位的一個觸控動作，使用者最多能產生一個六指觸控手勢。6 illustrates another use of a second touchpad 602 (sensing panel) to control the touch hand index, in accordance with some embodiments. As shown, the second touchpad 602 includes four set blocks. Under such settings, the number of "finger touches" generated on the second touch panel 602 will vary according to the four positions of front lower, front upper, lower rear, and upper rear. For example, in some embodiments, the front and lower portions of the touch second touch panel 602 represent a single finger touch action. Similarly, the upper part of the touch represents the two-finger touch action; the lower part of the touch represents the three-finger touch action; and the upper part after the touch represents the four-finger touch action. That is to say, under such a program setting, a two-finger touch action and a drag action on the first sensing board 106 are added to the upper part of the second touch panel 602 (sensing board). A touch action allows the user to generate up to one six-finger touch gesture.
1.將來自於多點觸控板表面上的當地(local)座標的觸控點數據對映在個人電腦螢幕座標上1. Map the touch point data from the local coordinates on the surface of the multi-touch track to the PC screen coordinates.
在一個滑鼠觸控板表面上的觸控點可利用至少兩種對映方法(或對映模式)對映在個人電腦螢幕座標。第一種方法利用來自於在一個多點觸控板上的手指觸控動作的絕對位置數據將絕對座標對映在整個個人電腦螢幕區域。這種方法稱為整體對映法(entire mapping method)。第二種對映方法利用來自於在一個多點觸控板上的手指觸控動作的絕對位置數據將絕對座標對映在個人電腦螢幕座標上的一小部分對映區域，這種方法稱為部分對映法(portion mapping method)。Touch points on the surface of a mouse trackpad can be mapped to a personal computer screen coordinate using at least two mapping methods (or mapping modes). The first method uses absolute position data from finger touch actions on a multi-touch panel to map absolute coordinates across the entire PC screen area. This method is called the entire mapping method. The second mapping method uses absolute position data from finger touch actions on a multi-touch panel to map absolute coordinates to a small portion of the mapping area on the PC screen coordinates. This method is called Partition mapping method.
圖7詳細地繪示出整體對映法。橫座標702與縱坐標704由感測板106表面上的當地二維座標所組成。一組橫座標702與縱坐標704由個人電腦螢幕714表面上的顯示螢幕座標所構成。感測板106上左上角落710的絕對位置數據會被對映在顯示螢幕座標上左上角落712的絕對位置。同樣地，左下角落、右下角落與右上角落的絕對位置數據會被對映在感測板106上各自的角落。Figure 7 illustrates the overall entropy in detail. The abscissa 702 and the ordinate 704 are comprised of local two-dimensional coordinates on the surface of the sensing plate 106. A set of abscissas 702 and ordinates 704 are formed by display screen coordinates on the surface of the personal computer screen 714. The absolute position data of the upper left corner 710 on the sensing plate 106 is mapped to the absolute position of the upper left corner 712 on the display screen coordinates. Similarly, absolute position data of the lower left corner, the lower right corner, and the upper right corner are mapped to respective corners of the sensing board 106.
在感測板106上的手指觸控動作706提供了當地X位置與當地Y位置的原始數據。觸控數據被對映到顯示螢幕點708或是在螢幕座標中個別的X、Y位置。在整體對映模式下，若觸控板的其他工程能力及/或規格沒有改變的情形下，觸控板數據的解析度會與觸控板的尺寸成正比。觸控板的尺寸越大，在顯示螢幕上的觸控指令輸入解析度也越高。Finger touch action 706 on sensor panel 106 provides raw data for the local X position and the local Y position. The touch data is mapped to display screen point 708 or to individual X, Y positions in the screen coordinates. In the overall mapping mode, if the other engineering capabilities and/or specifications of the touchpad are not changed, the resolution of the touchpad data will be proportional to the size of the touchpad. The larger the size of the touchpad, the higher the resolution of the touch command input on the display screen.
圖8A與8B繪示出第二種對映方法，其中在多點感測板106(觸控板)上的絕對座標被對映在個人電腦螢幕座標上的一部分對映區域。如圖所示，使用者可經由拖曳滑鼠來移動此部分對映區域，之後再利用感測板106在此部分對映區域內產生多指觸控指令。Figures 8A and 8B illustrate a second mapping method in which the absolute coordinates on the multi-point sensing pad 106 (touchpad) are mapped to a portion of the mapping area on the PC screen coordinates. As shown in the figure, the user can move the partial mapping area by dragging the mouse, and then use the sensing board 106 to generate a multi-finger touch command in the partial mapping area.
圖8A詳細地繪示出部分對映法。於此對映法中，經由感測板106表面上的當地X座標與當地Y座標所定義出來的中心點會被對映在顯示螢幕座標上預定區域800的中心點。如圖所示，預定區域800僅會覆蓋住個人電腦螢幕區域的一部分。也就是說，在觸控板上左上角落的絕對位置數據會被對映在對映區域800左上角落的絕對位置。同樣地，感測板106左下角落、右下角落與右上角落的絕對位置會被對映在對映區域800各自的角落。Figure 8A illustrates in detail the partial entropy. In this embodiment, the center point defined by the local X coordinate on the surface of the sensing plate 106 and the local Y coordinate is mapped to the center point of the predetermined area 800 on the display screen coordinates. As shown, the predetermined area 800 will only cover a portion of the PC screen area. That is to say, the absolute position data in the upper left corner of the touch panel will be reflected in the absolute position of the upper left corner of the mapping area 800. Similarly, the absolute positions of the lower left corner, the lower right corner, and the upper right corner of the sensing panel 106 are reflected in respective corners of the engraving area 800.
如圖8B中所繪示，使用者可經由拖曳滑鼠本體108來移動對映區域800的位置。根據上述，在部份實施例中，個人電腦主機介面程式會利用滑鼠游標數據來對對映區域800所要到達的位置執行編碼指令。因此，使用者可將其滑鼠游標移動至個人電腦顯示螢幕上的所要到達的位置，之後再經由觸控滑鼠上的多點感測板106表面來開始進行多點觸控指令。也因此，在部份實施例中，對於在顯示螢幕上進行輸入控制而言，因為來自於觸控板的觸控數據提供了在較小對映區域上的較高解析度輸入，所以預定部分對映模式相較於整體對映模式具有能辨識較高精確度觸控數據的技術優點。As illustrated in FIG. 8B, the user can move the position of the enemies area 800 by dragging the mouse body 108. In accordance with the above, in some embodiments, the personal computer host interface program utilizes mouse cursor data to execute encoding instructions for the location to be reached by the mapping area 800. Therefore, the user can move the mouse cursor to the desired position on the display screen of the personal computer, and then start the multi-touch command via the surface of the multi-point sensing board 106 on the touch mouse. Therefore, in some embodiments, for input control on the display screen, since the touch data from the touch panel provides a higher resolution input on a smaller enemies, the predetermined portion The entropy mode has the technical advantage of being able to recognize higher-accuracy touch data compared to the overall entropy mode.
在部分實施例中，在不論對映法為何種的情況下，即便其感測器面積遠小於傳統的數位板，多點感測板106(觸控板)經由滑鼠中的韌體(firmware)定義為一種通用序列匯流排人性化介面裝置(USB human interface device,USB-HID，以下簡稱為USB-HID)數位板(digitizer)。韌體提供了在主觸控板表面上各個手指觸控的絕對當地座標數據組，其中主觸控板經由USB系統所定義。In some embodiments, the multi-point sensing board 106 (touchpad) passes the firmware in the mouse (the firmware) even if the sensor area is much smaller than the conventional tablet. ) is defined as a universal human address device (USB-HID, hereinafter referred to as USB-HID) digitizer. The firmware provides an absolute local coordinate data set for each finger touch on the surface of the main touchpad, wherein the main touchpad is defined via a USB system.
2.經由具有多點觸控板的多點觸控滑鼠設計來產生多指手勢2. Generate multi-finger gestures via multi-touch mouse design with multi-touch pad
圖9A繪示出一種多點觸控及多方向性滑鼠基本的硬體元件(hardware component)與韌體的功能方塊圖。在部分實施例中，韌體900，可設置於印刷電路板上，有系統地定義兩個獨立的USB裝置，邏輯裝置#1，例如傳統的USB二維滑鼠與邏輯裝置#2，例如USB-HID。邏輯裝置#1擷取滑鼠感測器數據904與滑鼠按鍵及滾輪數據906，並且將傳統的二維滑鼠數據封包經由一個USB連接器輸出至一台個人電腦主機。邏輯裝置#2擷取來自於多點觸控感測器902的數據，並且將上述數據封包當成經由USB系統所定義的一個USB-HID輸入裝置。FIG. 9A is a functional block diagram of a basic hardware component and a firmware of a multi-touch and multi-directional mouse. In some embodiments, the firmware 900 can be disposed on a printed circuit board to systematically define two independent USB devices, such as a conventional USB two-dimensional mouse and logic device #2, such as USB. -HID. The logic device #1 captures the mouse sensor data 904 and the mouse button and wheel data 906, and outputs the conventional two-dimensional mouse data packet to a personal computer host via a USB connector. Logic device #2 retrieves data from multi-touch sensor 902 and treats the data packet as a USB-HID input device defined via a USB system.
一旦滑鼠上的韌體將多點觸控板定義為一個數位板，觸控訊號會被諸如Windows7作業系統等個人電腦作業系統的核心驅動程式(kernel driver)所接收，並且會被轉換為諸如Windows作業系統中的WM_TOUCH等觸控訊息。當滑鼠移動時，滑鼠會依據滑鼠輸入型態將滑鼠輸入數據輸出至韌體、軟體或硬體，以依據滑鼠的移動定義滑鼠座標的變化。部分對映區域會因應滑鼠輸入數據而沿著滑鼠的運動方向移動。圖9A繪示出一種在多點觸控滑鼠中的韌體功能方塊圖。韌體以即時的方式(real time manner)截取多點觸控板上觸控點的當地絕對座標的數據封包。然後，這些座標會經由韌體對映在個人電腦螢幕座標上。來自於韌體的輸出數據封包包含了手指觸控的數量與各個觸控數據在個人電腦螢幕座標中的X-Y位置數據。Once the firmware on the mouse defines the multi-touch pad as a tablet, the touch signal will be used by Windows. 7 The kernel driver of the personal computer operating system such as the operating system is received and converted into a touch message such as WM_TOUCH in the Windows operating system. When the mouse moves, the mouse will output the mouse input data to the firmware, software or hardware according to the mouse input type to define the change of the mouse coordinates according to the movement of the mouse. Part of the mapping area moves along the direction of movement of the mouse in response to mouse input data. FIG. 9A illustrates a block diagram of firmware functionality in a multi-touch mouse. The firmware intercepts the data packets of the local absolute coordinates of the touch points on the multi-touch panel in a real time manner. These coordinates are then mapped to the PC screen coordinates via the firmware. The output data packet from the firmware contains the number of finger touches and the XY position data of each touch data in the PC screen coordinates.
3. 經由具有主多點觸控板與數位開關(以開關訊號為基準的感測器)或是次觸控板(只有觸控/未觸控狀態)的多點觸控滑鼠設計來產生多指手勢3. Generated by a multi-touch mouse design with a main multi-touch panel and a digital switch (a sensor based on a switching signal) or a secondary touch panel (only touch/untouched) Multi-finger gesture
圖9B繪示出一種多點觸控及多方向性滑鼠基本的硬體元件與韌體的功能方塊圖，其包含了一個主多點觸控感測器902以及一個次觸控感測器908(僅為單點觸控偵測或是多點觸控)。在部份實施例中，韌體900有系統地定義兩個獨立的USB裝置，或者是邏輯裝置#1與邏輯裝置#2。9B is a functional block diagram of a basic hardware component and a firmware of a multi-touch and multi-directional mouse, including a main multi-touch sensor 902 and a secondary touch sensor. 908 (only for single touch detection or multi-touch). In some embodiments, firmware 900 systematically defines two separate USB devices, or logic device #1 and logic device #2.
圖10A與10B繪示出經由不同的觸控數據組所對映出的兩指觸控動作。在圖10A中，使用者將兩根手指1000放置於一個主感測器106上，然後此觸控數據會被當作兩個觸控點1002與1004而對映在個人電腦螢幕上。在圖10B中，來自於一個主感測器上的一個第一手指1010的觸控數據會被當作一個第一觸控點1004而對映在個人電腦螢幕714上，並且來自於拇指1008觸控一個次感測器的觸控狀態數據(觸控或未觸控)會用來創造出虛擬觸控點(virtual touch point)1006，以當作個人電腦螢幕上的一個第二觸控點。第一觸控點1004與第二觸控點(即虛擬觸控點1006)之間的距離可藉由韌體進行程式化。韌體利用主感測器上第一觸控點的絕對當地座標數據與預定小X,Y數據的增加或減少數值來計算第二觸控點的絕對當地座標數據。一旦計算出虛擬觸控點1006，此觸控點與其他觸控點的座標即會被包含在一個數據封包中傳送至個人電腦主機。個人電腦主機利用這些觸控點產生可由電腦應用程式識別的一個觸控指令訊息。10A and 10B illustrate two-finger touch actions that are mapped via different touch data sets. In FIG. 10A, the user places two fingers 1000 on a main sensor 106, and the touch data is then displayed as two touch points 1002 and 1004 on the personal computer screen. In FIG. 10B, the touch data from a first finger 1010 on a main sensor is reflected as a first touch point 1004 on the personal computer screen 714, and is touched by the thumb 1008. Controlling the touch state data (touch or no touch) of a secondary sensor will be used to create a virtual touch point 1006 as a second touch point on the PC screen. The distance between the first touch point 1004 and the second touch point (ie, the virtual touch point 1006) can be programmed by the firmware. The firmware calculates the absolute local coordinate data of the second touch point by using the absolute local coordinate data of the first touch point on the main sensor and the increase or decrease value of the predetermined small X, Y data. Once the virtual touch point 1006 is calculated, the coordinates of the touch point and other touch points are included in a data packet and transmitted to the personal computer host. The PC host uses these touch points to generate a touch command message that can be recognized by the computer application.
圖11A與11B繪示出經由不同的觸控數據組所對映出的三指觸控動作。在圖11A中，使用者將三根手指1100放置於一個主感測器106上，然後來自於這三根手指的觸控動作所產生的觸控數據會被當作觸控點1102,1104與1106而對映在個人電腦螢幕上。11A and 11B illustrate three-finger touch actions that are mapped via different touch data sets. In FIG. 11A, the user places three fingers 1100 on one main sensor 106, and then the touch data generated by the touch actions of the three fingers is used as the touch points 1102, 1104 and 1106. The screen is on the screen of the personal computer.
在圖11B中，來自於一個主感測器上的兩根手指1108的兩個觸控數據會被當作兩個觸控點1114與1116而對映在個人電腦螢幕上，並且來自於使用者拇指觸控一個次感測器1110的觸控狀態數據(觸控或是未觸控)會用來創造出虛擬觸控點1112，以當作個人電腦螢幕上的一個第三觸控點。這兩個實際觸控點與第三觸控點(即虛擬觸控點)之間的距離可經由韌體進行程式化。韌體利用主感測板上第一與第二觸控點的絕對當地座標數據與預定小X,Y數據的增加或減少數值來計算第三觸控點的絕對當地座標數據。In FIG. 11B, two touch data from two fingers 1108 on one main sensor are reflected as two touch points 1114 and 1116 on the screen of the personal computer, and are from the user. Thumb touch The touch state data (touch or no touch) of a secondary sensor 1110 is used to create a virtual touch point 1112 to serve as a third touch point on the personal computer screen. The distance between the two actual touch points and the third touch point (ie, the virtual touch point) can be programmed via the firmware. The firmware calculates the absolute local coordinate data of the third touch point by using the absolute local coordinate data of the first and second touch points on the main sensing board and the increase or decrease value of the predetermined small X, Y data.
圖12A與12B繪示出經由一個兩指觸控動作所產生的一個變換手勢。在圖12A中，使用者可在主觸控板(可偵測多點觸控的感測器)上沿著一水平或是垂直方向拖曳兩根手指1200，以產生兩指變換手勢(兩個「實際觸控」動作)，如標號1202與1204所示。在圖12B中，使用者可在主觸控板(可偵測多點觸控的感測器)上沿著一水平或是垂直方向拖曳一根手指1206，同時以拇指1208觸控一個次感測器，以產生由1210與1212所表示的一個兩指變換手勢。值得注意的是，此兩指變換手勢是由來自於主觸控板的一個實際觸控點與來自於次觸控板的一個虛擬的第二觸控點(或稱為虛擬觸控點)所組成。若主觸控點在各個時間點的主手指軌跡是在水平或是垂直方向上，則韌體會將此手勢識別為一個變換手勢，並且會隨著主觸控點將虛擬觸控點計算至座標中，如圖所示。利用數據與這些觸控點之間的關聯性(個人電腦主機隨時都在識別此關聯性)，第一觸控點會具有一個水平或是垂直軌跡，並且會產生可由電腦應用程式識別的一個變換手勢觸控指令訊息。12A and 12B illustrate a transform gesture generated via a two-finger touch action. In FIG. 12A, the user can drag two fingers 1200 along a horizontal or vertical direction on the main touch panel (detectable multi-touch sensor) to generate a two-finger transformation gesture (two "Actual touch" action, as indicated by reference numerals 1202 and 1204. In FIG. 12B, the user can drag a finger 1206 along a horizontal or vertical direction on the main touch panel (detectable multi-touch sensor) while touching the thumb 1208 with a touch. A detector is used to generate a two-finger transformation gesture represented by 1210 and 1212. It is worth noting that the two-finger transformation gesture is performed by an actual touch point from the main touchpad and a virtual second touch point (or virtual touch point) from the secondary touchpad. composition. If the main finger track of the main touch point is at the horizontal or vertical direction at each time point, the firmware recognizes the gesture as a transform gesture, and calculates the virtual touch point into the coordinates along with the main touch point. ,as the picture shows. Using the correlation between the data and these touch points (the PC host recognizes this association at any time), the first touch point will have a horizontal or vertical trajectory and will produce a transformation that can be recognized by the computer application. Gesture touch command message.
圖13A與13B繪示出經由一個兩指觸控動作所產生的一個展開(stretch)/收縮(pinch)手勢。在圖13A中，使用者可在主觸控板(可偵測多點觸控的感測器)上展開或收縮兩根手指1300，以產生一個兩指展開/收縮手勢，如標號1302與1304所示。在圖13B中，使用者可在主觸控板(可偵測多點觸控的感測器)上沿著一傾斜方向(diagonal direction)拖曳一根手指1308，同時以另一根手指或是拇指1310在次觸控板上進行觸控，以產生由1304與1306所表示的一個兩指展開/收縮手勢。若主手指軌跡在一個傾斜/對角線方向上，則韌體會將此虛擬觸控點(即手勢1306)當作一個靜止的樞紐點(pivot point)來計算座標。也就是說，個人電腦主機會產生一個收縮或展開手勢觸控指令訊息。Figures 13A and 13B illustrate a stretch/pinch gesture generated via a two-finger touch action. In FIG. 13A, the user can expand or contract two fingers 1300 on the main touchpad (detectable multi-touch sensor) to generate a two-finger expansion/contraction gesture, such as reference numerals 1302 and 1304. Shown. In FIG. 13B, the user can drag a finger 1308 along a diagonal direction on the main touch panel (detectable multi-touch sensor) while using another finger or The thumb 1310 is touched on the secondary touchpad to produce a two-finger expansion/contraction gesture represented by 1304 and 1306. If the main finger trajectory is in a tilt/diagonal direction, the firmware will calculate the coordinates by treating the virtual touch point (ie, gesture 1306) as a stationary pivot point. In other words, the PC host will generate a shrink or expand gesture touch command message.
圖14A與14B繪示出經由兩指觸控動作所產生的一個旋轉手勢。在圖14A中，使用者可在主觸控板(可偵測多點觸控的感測器)上拖曳兩根手指1400，以產生一個兩指旋轉手勢，如標號1402與1404所示。在圖14B中，使用者可在主觸控板(可偵測多點觸控的感測器)上拖曳一根手指1408以劃出一個圓形軌跡，同時以另一根手指或是拇指1410在次感測器上進行觸控，以產生由1404與1406所表示的一個兩指旋轉手勢。當主手指的軌跡被韌體識別為一個圓形軌跡時，則韌體會將此虛擬觸控點(即手勢1406)當作一個動態的樞紐點來計算座標。也就是說，個人電腦主機會產生一個旋轉手勢觸控指令訊息。14A and 14B illustrate a rotation gesture generated via a two-finger touch action. In FIG. 14A, the user can drag two fingers 1400 on the main touchpad (detectable multi-touch sensor) to generate a two-finger rotation gesture, as indicated by reference numerals 1402 and 1404. In FIG. 14B, the user can drag a finger 1408 on the main touchpad (detectable multi-touch sensor) to draw a circular trajectory while using another finger or thumb 1410. Touching is performed on the secondary sensor to produce a two-finger rotation gesture represented by 1404 and 1406. When the trajectory of the main finger is recognized by the firmware as a circular trajectory, the firmware will use this virtual touch point (ie, gesture 1406) as a dynamic pivot point to calculate the coordinates. In other words, the personal computer host will generate a rotating gesture touch command message.
4. 經由具有單點觸控感測板與數位開關或是次觸控板(只有觸控/未觸控狀態)的多點觸控滑鼠設計來產生多指手勢4. Generate multi-finger gestures via a multi-touch mouse design with a single touch sensor and a digital switch or a secondary touchpad (only touch/untouched)
多點觸控手勢的產生可經由設置一個單點觸控板以及一個數位開關(或是觸控狀態偵測感測板)而創造出來。在部分實施例中，諸如圖16中所揭露者，多點觸控滑鼠由兩個單點觸控偵測感測器所組成。此實施例可被定義為以多點觸控滑鼠來實現收縮手勢(reduced gesture)功能。Multi-touch gestures can be created by setting up a single touchpad and a digital switch (or touch detection sensor). In some embodiments, such as those disclosed in FIG. 16, the multi-touch mouse is comprised of two single touch detection sensors. This embodiment can be defined as a multi-touch mouse to implement a reduced gesture function.
請重新參考圖9B，其繪示出一種包含了兩個單點觸控偵測感測器的多點觸控及多方向性滑鼠基本的硬體元件與韌體的功能方塊圖。在部分實施例中，韌體900有系統地定義兩個獨立的USB裝置，或者是邏輯裝置#1與邏輯裝置#2。於此實施例中，滑鼠安裝了僅能偵測單點觸控的一個觸控板908以及僅能偵測觸控(ON)或釋放(OFF)的一個數位開關。作為此開關的硬體可為一個推入/推出開關(push in/out switch)或是能偵測觸控/非觸控狀態的一個觸控感測器。Referring again to FIG. 9B, a functional block diagram of a multi-touch and multi-directional mouse basic hardware component and firmware including two single-touch detection sensors is illustrated. In some embodiments, firmware 900 systematically defines two separate USB devices, or logical device #1 and logical device #2. In this embodiment, the mouse is equipped with a touch panel 908 that can only detect single touch and a digital switch that can only detect touch (ON) or release (OFF). The hardware of the switch can be a push in/out switch or a touch sensor capable of detecting a touch/non-touch state.
此實施例最多能產生兩個手指手勢指令。圖12B繪示出包含在主主感測器)接墊(只有單點觸控位置的偵測)與次感測器(只有觸控/非觸控狀態)上的手指觸控動作的一組數據可在個人電腦螢幕上對映出來。次觸控數據(觸控開啟/關閉狀態)用來當作一個虛擬觸控點，即描述於上述段落3標題中的「經由具有多點觸控板與數位開關(以開關訊號為基準的感測器)的多點觸控滑鼠設計來產生多指手勢」。This embodiment can generate up to two finger gesture commands. FIG. 12B illustrates a set of finger touch actions included in the main main sensor) pads (detection only at the single touch position) and the secondary sensor (only touch/non-touch states). The data can be viewed on the PC screen. The secondary touch data (touch on/off state) is used as a virtual touch point, which is described in the above paragraph 3 "via a multi-touch panel and a digital switch (based on the switching signal) The multi-touch mouse is designed to produce multi-finger gestures."
這裡的兩指變換手勢相似於圖12B中所繪示的手指手勢產生範例。這裡的兩指收縮/展開手勢的產生相似於圖13A與圖13B中所繪示的手指手勢產生範例。這裡的兩指旋轉手勢的產生相似於圖14B中所繪示的手指手勢產生範例。The two-finger transformation gesture here is similar to the finger gesture generation example illustrated in FIG. 12B. The generation of the two-finger contraction/expansion gesture here is similar to the finger gesture generation example illustrated in FIGS. 13A and 13B. The generation of the two-finger rotation gesture here is similar to the finger gesture generation example illustrated in FIG. 14B.
5.個人電腦主機上的裝置驅動程式5. Device driver on the personal computer host
圖15繪示出個人電腦主機1500內電腦作業系統之多點觸控界面驅動程式的功能方塊圖，以代替應用程式來管理多點觸控及多方向性滑鼠200的數據封包，並管理多方向性控制的指令產生。作業系統中的一個核心模式層(kernel mode layer)中的裝置驅動模組將會一併擷取經由滑鼠韌體所定義的邏輯裝置#1與邏輯裝置#2的原始數據。在部分實施例中，輸入裝置(例如滑鼠)與電腦之間是經由一個USB連接器來連接。在其他實施例中則使用了諸如無線網路(wireless)、藍芽(Bluetooth)等其他連接型態。為了要擷取USB數據封包，諸如Windows作業系統等電腦中的作業系統提供了一個內建的核心模式驅動程式1502。在作業系統中的一個使用者模式層中的裝置驅動模組1504會擷取滑鼠的原始數據封包，並且會執行以下兩個運算步驟：(1)來自於USB驅動程式數據封包的編譯，以及(2)多點觸控及多方向性指令的產生。15 is a functional block diagram of a multi-touch interface driver of a computer operating system in a personal computer host 1500, in place of an application to manage data packets of the multi-touch and multi-directional mouse 200, and manages multiple Directional control commands are generated. The device driver module in a kernel mode layer in the operating system will capture the raw data of the logical device #1 and the logical device #2 defined by the mouse firmware. In some embodiments, an input device (such as a mouse) is connected to the computer via a USB connector. Other connection types such as wireless, Bluetooth, etc. are used in other embodiments. In order to capture USB data packets, such as Windows The operating system in the computer such as the operating system provides a built-in core mode driver 1502. The device driver module 1504 in a user mode layer in the operating system captures the mouse's original data packet and performs the following two operation steps: (1) compiling from the USB driver data packet, and (2) Multi-touch and multi-directional commands are generated.
在第一步驟中，使用者層級裝置驅動程式1506(user level device driver)經由利用一套軟體的方式編譯手指觸控動作，即定義各個手指對於各個感測板在各個時間點上的手指觸控點的數量與當地位置。在第二步驟中，若應用程式準備好要將多點觸控訊息當作一個標準介面輸入串流(standard interactive input stream)的其中之一來接收，則介面驅動程式將產生與電人電腦作業系統訊息相關的多點觸控訊息，亦即根據手指觸控動作與指尖軌跡的總數來輸出預定多點觸控訊息(也就是Windows7作業系統中的WM_TOUCH或是WM_GESTURE)。In the first step, the user level device driver 1506 compiles the finger touch action by using a set of software, that is, defines the finger touch of each finger at each time point for each sensing board. The number of points and the local location. In the second step, if the application is ready to receive the multi-touch message as one of the standard interactive input streams, the interface driver will generate an operation with the computer. System message related multi-touch message, that is, outputting a predetermined multi-touch message according to the total number of finger touch actions and fingertip tracks (that is, Windows) 7WM_TOUCH or WM_GESTURE in the operating system).
若應用程式1512可接收多點觸控輸入，但是卻無法將多點觸控訊息識別為其標準介面輸入指令，則使用者層級裝置驅動程式1506將會啟動一個輔助介面驅動程式1508(supplemental interface driver)。輔助介面驅動程式將會對應用程式1512輸出已轉換成可由應用程式1512識別的特定應用輸入格式(application specific input format)的修正後感測板數據。If the application 1512 can receive multi-touch input but cannot recognize the multi-touch message as its standard interface input command, the user-level device driver 1506 will start an auxiliary interface driver 1508 (supplemental interface driver) ). The auxiliary interface driver will output to the application 1512 the corrected sensor data that has been converted into an application specific input format that can be recognized by the application 1512.
舉例來說，若應用程式1510無法接收多點觸控輸入而只能識別定義在作業系統中的傳統標準輸入數據(conventional standard input data)，諸如在舊版Windows作業系統情況下的一個滑鼠/鍵盤，則輔助介面驅動程式1508會將多點觸控感測板的數據封包轉換成一組傳統標準輸入數據，並會對應用程式1510輸出傳統標準輸入的模擬輸入訊息(emulated input message)，使得應用程式1510能執行其互動指令。For example, if the application 1510 cannot receive multi-touch input and only recognizes the conventional standard input data defined in the operating system, such as a mouse in the case of the old Windows operating system / The keyboard, the auxiliary interface driver 1508 converts the data packet of the multi-touch sensor board into a set of conventional standard input data, and outputs the traditional standard input analog input message to the application 1510, so that the application The program 1510 can execute its interactive instructions.
雖然本發明已以實施例揭露如上，然其並非用以限定本發明，任何所屬技術領域中具有通常知識者，在不脫離本發明的精神和範圍內，當可作些許的更動與潤飾，因此本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and those skilled in the art can make some modifications and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.
100、200、1600、1700．．．滑鼠100, 200, 1600, 1700. . . mouse
102．．．凹陷102. . . Depression
104．．．平坦表面104. . . Flat surface
106、202、502、602、902、1110．．．感測板106, 202, 502, 602, 902, 1110. . . Sensing board
108、1602、1702．．．滑鼠本體108, 1602, 1702. . . Mouse body
204．．．側面204. . . side
502a．．．前半部502a. . . First half
502b．．．後半部502b. . . The second half
702．．．橫座標702. . . Horizontal coordinate
704．．．縱坐標704. . . Y-axis
706、1202、1204．．．觸控動作706, 1202, 1204. . . Touch action
710、712．．．角落710, 712. . . corner
714．．．個人電腦螢幕714. . . Personal computer screen
800．．．預定區域800. . . Scheduled area
900．．．韌體900. . . firmware
904、906．．．數據904, 906. . . data
908、1604、1606、1704、1706．．．觸控板908, 1604, 1606, 1704, 1706. . . touchpad
1000、1008、1010、1100、1108、1200、1206、1208、1300、1308、1310、1400、1408、1410．．．手指1000, 1008, 1010, 1100, 1108, 1200, 1206, 1208, 1300, 1308, 1310, 1400, 1408, 1410. . . finger
1002、1004、1006、1112、1114、1116．．．觸控點1002, 1004, 1006, 1112, 1114, 1116. . . Touch point
1210、1212、1302、1304、1306、1402、1404、1406．．．手勢1210, 1212, 1302, 1304, 1306, 1402, 1404, 1406. . . gesture
1608．．．側延伸部1608. . . Side extension
位置：X、YLocation: X, Y
#1、#2．．．邏輯裝置#1, #2. . . Logic device
1500．．．多點觸控界面驅動程式1500. . . Multi-touch interface driver
1502．．．核心模式驅動程式1502. . . Core mode driver
1504．．．裝置驅動模組1504. . . Device driver module
1506．．．使用者層級介面驅動程式1506. . . User level interface driver
1508．．．輔助介面驅動程式1508. . . Auxiliary interface driver
1510、1512．．．應用程式1510, 1512. . . application
圖1繪示出一種具有一個觸控板的滑鼠的立體圖。Figure 1 depicts a perspective view of a mouse with a touchpad.
圖2繪示出一種具有兩個觸控板的多點觸控及多方向性滑鼠的立體圖。2 is a perspective view of a multi-touch and multi-directional mouse with two touch panels.
圖3繪示出圖2的觸控板的俯視圖，並且使用者的兩個手指位於頂部的多點觸控板上，而使用者的一隻第三手指則位於一個側面觸控板上。3 illustrates a top view of the touchpad of FIG. 2 with the user's two fingers on the top multi-touch panel and the user's third finger on one of the side touchpads.
圖4繪示出圖3的觸控板的側視圖。4 is a side view of the touch panel of FIG. 3.
圖5繪示出一種具有兩個設定區塊的一個滑鼠上的觸控板。Figure 5 illustrates a touchpad on a mouse with two set blocks.
圖6繪示出一種具有四個設定區塊的一個滑鼠上的觸控板。Figure 6 illustrates a touchpad on a mouse with four set blocks.
圖7繪示出一種整體對映法的示意圖。Figure 7 depicts a schematic of an overall enantiomeric method.
圖8A繪示出一種部分對映法的示意圖。Figure 8A depicts a schematic of a partial enantiomeric method.
圖8B繪示出一種部分對映法的示意圖，其中部分對映區域正在移動。Figure 8B depicts a schematic of a partial entropy in which a portion of the enantiomeric region is moving.
圖9A繪示出一種連結韌體與具有一個多點感測板的滑鼠的示意圖。Figure 9A depicts a schematic view of a bonded firmware and a mouse having a multi-point sensing plate.
圖9B繪示出一種連結韌體與具有一個多點感測器觸控板以及一個第二觸控板的滑鼠的示意圖。FIG. 9B is a schematic diagram of a connecting firmware and a mouse having a multi-point sensor trackpad and a second trackpad.
圖10A繪示出將一個單點觸控板上的一個兩指觸控動作對映在個人電腦螢幕座標的示意圖。FIG. 10A is a schematic diagram showing a two-finger touch action on a single touch panel on a personal computer screen coordinate.
圖10B繪示出將兩個分開的觸控板上的一個兩指觸控動作對映在個人電腦螢幕座標的示意圖。FIG. 10B is a schematic diagram showing a two-finger touch action on two separate touch panels on a personal computer screen coordinate.
圖11A繪示出將一個單點觸控板上的一個三指觸控動作對映在個人電腦螢幕座標的示意圖。FIG. 11A is a schematic diagram showing a three-finger touch action on a single touch panel on a personal computer screen coordinate.
圖11B繪示出將兩個分開的觸控板上的一個三指觸控動作對映在個人電腦螢幕座標的示意圖。FIG. 11B is a schematic diagram showing a three-finger touch action on two separate touch panels on a personal computer screen coordinate.
圖12A繪示出將一個單點觸控板上的一個兩指觸控手勢對映在個人電腦螢幕座標的示意圖。FIG. 12A is a schematic diagram showing a two-finger touch gesture on a single touch panel on a personal computer screen coordinate.
圖12B繪示出將兩個分開的觸控板上的一個兩指觸控手勢對映在個人電腦螢幕座標的示意圖。FIG. 12B is a schematic diagram showing a two-finger touch gesture on two separate touch panels on a personal computer screen coordinate.
圖13A繪示出將一個單點觸控板上的另一個兩指觸控手勢對映在個人電腦螢幕座標的示意圖。FIG. 13A is a schematic diagram showing another two-finger touch gesture on a single touch panel on a personal computer screen coordinate.
圖13B繪示出將兩個分開的觸控板上的另一個兩指觸控手勢對映在個人電腦螢幕座標的示意圖。FIG. 13B is a schematic diagram showing another two-finger touch gesture on two separate touch panels on a personal computer screen coordinate.
圖14A繪示出將一個單點觸控板上的又一個兩指觸控手勢對映在個人電腦螢幕座標的示意圖。FIG. 14A is a schematic diagram showing another two-finger touch gesture on a single touch panel on a personal computer screen coordinate.
圖14B繪示出將兩個分開的觸控板上的又一個兩指觸控手勢對映在個人電腦螢幕座標的示意圖。FIG. 14B is a schematic diagram showing another two-finger touch gesture on two separate touch panels on a personal computer screen coordinate.
圖15繪示出一種將硬體與軟體元件連接到多點觸控滑鼠的方塊圖。Figure 15 depicts a block diagram of a hardware and software component connected to a multi-touch mouse.
圖16繪示出一種具有兩個分開的觸控板的電腦滑鼠的另一實施例。Figure 16 illustrates another embodiment of a computer mouse having two separate trackpads.
圖17繪示出一種具有兩個分開的觸控板的電腦滑鼠的又一實施例。Figure 17 depicts yet another embodiment of a computer mouse having two separate trackpads.
200．．．滑鼠200. . . mouse
102．．．凹陷102. . . Depression
104．．．平坦表面104. . . Flat surface
106．．．第一感測板106. . . First sensing board
108．．．滑鼠本體108. . . Mouse body
202．．．第二感測板202. . . Second sensing board
204．．．側面204. . . side
Claims (20)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/914,649 US8614664B2 (en) | 2009-11-09 | 2010-10-28 | Multi-touch multi-dimensional mouse |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201218036A TW201218036A (en) | 2012-05-01 |
| TWI452494B true TWI452494B (en) | 2014-09-11 |
Family
ID=46086184
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW100101410A TWI452494B (en) | 2010-10-28 | 2011-01-14 | Method for combining at least two touch signals in a computer system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102467261A (en) |
| TW (1) | TWI452494B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI763191B (en) * | 2020-12-17 | 2022-05-01 | 宏碁股份有限公司 | Mouse device with touch control function |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103472931A (en) * | 2012-06-08 | 2013-12-25 | 宏景科技股份有限公司 | Method for operating simulation touch screen by mouse |
| TW201433938A (en) | 2013-02-19 | 2014-09-01 | Pixart Imaging Inc | Virtual navigation apparatus, navigation method, and computer program product thereof |
| CN104007849B (en) * | 2013-02-26 | 2017-09-22 | 原相科技股份有限公司 | Virtual navigation device and its air navigation aid |
| US20170371515A1 (en) | 2014-11-19 | 2017-12-28 | Honda Motor Co., Ltd. | System and method for providing absolute and zone coordinate mapping with graphic animations |
| US9727231B2 (en) | 2014-11-19 | 2017-08-08 | Honda Motor Co., Ltd. | System and method for providing absolute coordinate and zone mapping between a touchpad and a display screen |
| CN104656992A (en) * | 2015-02-13 | 2015-05-27 | 业成光电（深圳）有限公司 | Operation method of touch system |
| CN105320298A (en) * | 2015-11-23 | 2016-02-10 | 攀枝花学院 | Wireless handheld mouse |
| US11983363B1 (en) * | 2023-02-09 | 2024-05-14 | Primax Electronics Ltd. | User gesture behavior simulation system and user gesture behavior simulation method applied thereto |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050179650A1 (en) * | 2004-02-13 | 2005-08-18 | Ludwig Lester F. | Extended parameter-set mouse-based user interface device offering offset, warping, and mixed-reference features |
| US20090184936A1 (en) * | 2008-01-22 | 2009-07-23 | Mathematical Inventing - Slicon Valley | 3D touchpad |
| TWM377639U (en) * | 2009-11-24 | 2010-04-01 | Sunrex Technology Corp | Mouse structure of multi-fingers touch on suface |
| TWM383156U (en) * | 2010-02-09 | 2010-06-21 | Sunrex Technology Corp | Improved touch control mouse device |
-
2011
- 2011-01-14 TW TW100101410A patent/TWI452494B/en not_active IP Right Cessation
- 2011-01-19 CN CN2011100303369A patent/CN102467261A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050179650A1 (en) * | 2004-02-13 | 2005-08-18 | Ludwig Lester F. | Extended parameter-set mouse-based user interface device offering offset, warping, and mixed-reference features |
| US20090184936A1 (en) * | 2008-01-22 | 2009-07-23 | Mathematical Inventing - Slicon Valley | 3D touchpad |
| TWM377639U (en) * | 2009-11-24 | 2010-04-01 | Sunrex Technology Corp | Mouse structure of multi-fingers touch on suface |
| TWM383156U (en) * | 2010-02-09 | 2010-06-21 | Sunrex Technology Corp | Improved touch control mouse device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI763191B (en) * | 2020-12-17 | 2022-05-01 | 宏碁股份有限公司 | Mouse device with touch control function |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201218036A (en) | 2012-05-01 |
| CN102467261A (en) | 2012-05-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI452494B (en) | Method for combining at least two touch signals in a computer system | |
| US8614664B2 (en) | Multi-touch multi-dimensional mouse | |
| US11449224B2 (en) | Selective rejection of touch contacts in an edge region of a touch surface | |
| US20200310561A1 (en) | Input device for use in 2d and 3d environments | |
| US8294047B2 (en) | Selective input signal rejection and modification | |
| KR101844366B1 (en) | Apparatus and method for recognizing touch gesture | |
| TWI493387B (en) | Multi-touch mouse | |
| US20110227947A1 (en) | Multi-Touch User Interface Interaction | |
| US20110205169A1 (en) | Multi-touch input apparatus and its interface method using hybrid resolution based touch data | |
| TWI470475B (en) | Electronic system | |
| JP5524937B2 (en) | Input device including touchpad and portable computer | |
| Mistry et al. | Mouseless: a computer mouse as small as invisible | |
| KR20140086805A (en) | Electronic apparatus, method for controlling the same and computer-readable recording medium | |
| AU2013100574A4 (en) | Interpreting touch contacts on a touch surface | |
| KR20130015511A (en) | Mouse pad type input apparatus and method | |
| KR20140083303A (en) | Method for providing user interface using one point touch, and apparatus therefor | |
| AU2015271962B2 (en) | Interpreting touch contacts on a touch surface | |
| CN103383589A (en) | Electronic computing system | |
| TWM467936U (en) | Input device with multiple input modes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |