TW201020867A - Mouse simulating system and using method thereof - Google Patents

Mouse simulating system and using method thereof Download PDF

Info

Publication number
TW201020867A
TW201020867A TW97146236A TW97146236A TW201020867A TW 201020867 A TW201020867 A TW 201020867A TW 97146236 A TW97146236 A TW 97146236A TW 97146236 A TW97146236 A TW 97146236A TW 201020867 A TW201020867 A TW 201020867A
Authority
TW
Taiwan
Prior art keywords
mouse
camera
user
palm
movement
Prior art date
Application number
TW97146236A
Other languages
Chinese (zh)
Other versions
TWI486821B (en
Inventor
Meng-Chieh Chou
Original Assignee
Chi Mei Comm Systems Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chi Mei Comm Systems Inc filed Critical Chi Mei Comm Systems Inc
Priority to TW097146236A priority Critical patent/TWI486821B/en
Publication of TW201020867A publication Critical patent/TW201020867A/en
Application granted granted Critical
Publication of TWI486821B publication Critical patent/TWI486821B/en

Links

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

A system for simulating Mouse is provided. The system includes a computer and a camera connected to the computer. The computer includes a storage system and a controlling chip. The storage system stores reference information for simulating a Mouse. The controlling chip computes an installation height of the camera, sets an interval to determine movements of a user palm or fingers, and sets operations corresponding to each of the movements. The camera captures images of the user palm in a visual angle range of the camera and sends the images to the storage system. The controlling chip analyzes the images captured in each interval, determines a movement of the user palm or a finger according to differences of the images, obtains operations corresponding to the movement, and executes commands corresponding to the operations. A related using method of the system is also provided.

Description

201020867 九、發明說明: 【發明所屬之技術領域】 本發明涉及一種類比系統及其應用方法,尤其是一種 ' 關於滑鼠的類比系統及其應用方法。 【先前技術】 滑鼠是電腦常用的輸入設備。用戶在桌面上移動滑鼠 時,電腦顯示螢幕上的游標與滑鼠同步移動,當游標指到 顯示螢幕上的某個位置,用戶對滑鼠上的功能鍵(左鍵、 〇 右鍵、滚輪)進行相應操作,電腦便執行該操作對應的命 令。例如,當游標指到顯示螢幕上的一個檔案夾,用戶單 擊滑鼠左鍵,則電腦執行選中該檔案夾的指令,若用戶雙 擊滑鼠左鍵,則電腦執行開啟該檔案夾的指令,若用戶單 擊右鍵,則執行彈出相應視窗的指令,等等。 然而,當前的滑鼠存在許多不足之處,有線滑鼠常常 會因為滑鼠線長的限制或材質不良,導致用戶操作滑鼠時 較為費勁。無線滑鼠擺脫了線纜的束缚,但容易因為桌面 ® 材質造成游標漂移,並且需頻繁更換電池。 【發明内容】 鑒於以上内容,有必要提供一種滑鼠類比系統及其應 用方法,可以具備滑鼠提供的功能且克服當前滑鼠的不足 之處。 本發明提供一種滑鼠類比系統,該系統包括電腦及與 電腦連接的相機。所述相機對其視角範圍内的用戶手掌進 行拍攝,並將拍攝的圖片傳送至電腦。所述電腦包括儲存 6 201020867 系統及控制晶片。所述儲存系統用於儲存類比滑鼠運動的 參考資料,包括滑鼠在桌面上的有效移動範圍,相機的視 角及像素,以及用戶對溃鼠上的功能鍵進行相應操作時’ 電腦執行的該操作對應的命令。所述控制晶片用於根據所 述參考資料計算相機的粲設高度以提示用戶架設相機,設 置判斷手掌或手指運動的時間間隔,並設置手掌及手指運 動對應於滑鼠的操作。所述控制晶片,還用於對每一個時 間間隔内,相機拍攝的用戶手掌在視角範園内運動的圖片 ❹ 進行處理、比較,根據圖片的區別判斷用戶手掌或手指的 運動’獲取該運動對應於滑鼠的操作,執行該操作對應的 命令。 本發明還提供一種滑鼠類比系統的應用方法,該方法 包括以下步驟:(A)利用相機對其視角範圍内的用戶手掌 進行拍攝,並將拍攝的圖片傳送至電腦,該電腦包括儲存 系統及控制晶片;(B)利用儲存系統儲存類比滑鼠運動的 參考資料,包括滑鼠在桌面上的有效移動範圍,相機的視 響 & 角及像素,以及用戶對滑鼠上的功能鍵進行相應操作時, 電腦執行的該操作對應的命令;(C)利用控制晶片根據所 述參考資料計算相機的架設高度以提示用戶架設相機,設 置判斷手掌或手指運動的時間間隔’並設置手掌及手指運 動對應於滑鼠的操作;及(D)利用控制晶片對每一個時 間間隔内,相機拍攝的用戶手掌在視角範圍内運動的圖片 進行處理、比較,根據圖片的區別判斷用戶手掌或手指的 運動’獲取該運動對應於滑鼠的操作,執行該操作對應的 7 201020867 命令。 相較於習知技術,本發明提供的滑鼠類比系統及其應 用方法,利用相機拍攝用戶手掌或手指運動的圖片,利用 ' 電腦對圖片進行處理、比較,得到一定時間間隔内用戶手 掌或手指運動的移動方向及移動距離,並將用戶手掌或手 指的運動與滑鼠的操作相關聯,用戶透過手掌或手指運動 及可控制電腦顯示螢幕上的游標移動或執行相應操作。 【實施方式】 φ 如圖1所示,係本發明滑鼠類比系統較佳實施例的功 能模組圖。該滑鼠類比系統包括電腦10及相機20。相機 20透過連接30與電腦10連接。所述連接30可以為線纜, 也可以為無線連接。 相機20用於對其有效視角範圍40内的用戶手掌50 進行拍攝,並將拍攝的晝面透過連接30傳送至電腦10。 在本實施例中,用戶手掌50在一個水平桌面(圖1中未示 出)運動。相機20架設於該水平桌面正上方。相機20的 ® 有效視角範圍40是由相機的可視角度(以下簡稱視角)及 架設高度決定的。相機20的視角指的是其鏡頭中心點到成 像平面對角線兩端所形成的夾角。相機20的視角一定時, 架設高度越高,有效視角範圍40越大。 電腦10包括儲存系統11及控制晶片12。 儲存系統11用於儲存類比滑鼠運動的參考資料,包 括:一般滑鼠在桌面上的有效移動範圍、相機20的相關資 訊,及用戶對滑鼠上的功能鍵(左鍵、右鍵、滚輪)進行 8 201020867 相應操作時’電腦1G執行的該操作對應的命令。 二述右^可以為硬碟、光碟或其他儲存設備。 &域内^動純目&岐這樣—個輯:#滑鼠在該 區域内移動¥,電腦1〇顯 動,而當滑鼠的移動超出外2上的游標與滑鼠同步移 的邊緣。 超出和域時,游標停留在顯示螢幕 I2?相關資訊包括相機2〇的視角及像素。 ❹ ❹ 存機2G拍攝的畫面。 控制明片12用於根據所述參 資訊計算相機20的牟讯高舟以[#科及相機2〇的相關 置纏手堂J 提示用戶架設相機2〇,設 置判斷手掌或手指運動的時間間隔,錢機: 指運動對應於滑鼠的操作。 戶手掌或手 控制晶片12還用於對每—個 攝的用戶手掌在有效視角範園ΓΛ時間㈣内,相機2〇拍 括的圖片進行處理、比較,根據圖片的區別判斷^戶^ 或手指的運動’獲取該運動對應於滑鼠 二: 作對應的命令。 轨订該# 如圖2所示,係圖1中控制晶片12的功能模 控制晶片12主要包括:資訊獲取模 、圖該 122、參數調整模組123、設置模組124、| 數確定模組 運動判斷模組126及執行模組127 模組以 資訊獲取模組m用於從錯存系統叫取類比 動的參考資料,包括-般滑鼠在桌面上财效=運 相機20的視角及像素。 乾圍、 9 201020867 參數確定模組122用於根據滑鼠的有效移動範圍確定 相機20的最小視角範圍,根據最小視角範園及相機20的 視角計算相機20的最低架設高度。例如’假設滑鼠的有效 移動範圍為20cm*20cm (長*寬)的區域,則2〇的最小視 — 角範圍為20cm*20cm區域。相機20架設於最小視角範圍 的正上方,其視角為60度,最小視角範圍的對角線長度 =(2〇2+202)l/2cm,則相機 20 的最低架設高度 h=l/2*(202+202)l/2cm*cot30o=24.49cm。 ❹ 參數調整模組123用於根據相機20的像素確定拍攝得 到圖片的晝面比例,根據晝面比例調整所述最小視角範圍 得到有效視角範圍40,並根據有效視角範圍40調整相機 20的最低架設高度得到相機20的有效架設高度。例如, 假没相機20為顯不讀·圖陣列(Video Graphic Array,VGA) 攝像頭,其VGA解析度為640X480像素,即水平方向分 佈640像素,垂直方向分伟480像素,則相機20拍攝得到 的晝面比例為:640:480=4:3=40:30。則參數調整模組123 ❹調整調整上述最小視角範圍20cm*20cm,得到有效視角範 圍40為40cm*30cm’有效視角範圍4〇的對角線長度等於 50cm。進而,參數調整模組123根據有效視角範圍40及 相機20的視角計算相機20的有效架設高度 H=25cm*cot30o=43.3cm ° 參數調整模組123還用於提示用戶相機2〇的有效架設 咼度及有效視角範圍40,以利於用戶架設相機2〇及知曉 手掌運動的有效範圍。 201020867 設置模M24言曼置判斷手掌或手指運動的時間間隔, 並設置手掌及手指運動對應於滑鼠的操作。例如,設置模 組I24設置每隔1秒判斷一次用戶手掌或手β 這裏的運動指的是能夠觸發電腦10顯示螢^游標移動 的動作。 在本實施例中,設置模組124設置用戶食指向左水平 移動第一距離對應於單擊滑鼠左鍵的操作,設置用戶食指 向左水平移動第一距離後在一定時間内又向右水平移動第 〇 二距離對應於雙擊滑鼠左鍵的操作,設置用戶無名指向右 水平移動第三距離對應於單擊滑鼠右鍵的操作了設^用戶 中指向上移動第四距離對應於向上滑動滑鼠滾輪的操作, 設置用戶中指向下移動第五距離對應於向下滑動滑鼠滚 的操作’設置用戶手掌向上移動對應於向上移動滑鼠 作,設置用戶手掌向下移動對應於向下移動滑鼠的操作,、 設置用戶手掌向左移動對應於向左移動滑鼠的操作,及設 置用戶手掌向右移動對應於向右移動滑鼠的操作。 叹 所述第一至第五個距離可以為具體的數值,也可以為 數值區間。在本實施例中,所述第一至第五個距離均為二 個數值區間。例如第一距離為2cm~5cm的數值區間,當用 戶食指向左水平移動的距離落入該數值區間時, 動為單擊滑鼠左鍵的操作。 ~ 畫面處理模組125用於對一個時間間隔内相機2〇拍攝 得到的用戶手掌或手指運動的連績晝面進行處理,包括將 該連續畫面所包括的一系列彩色圖片轉換為黑白圖片,並 11 201020867 提高各黑白圖片的對比度。在本實施例中,為減少運算量, 晝面處理模組125將彩色圖片轉換為黑白圖片並提高對比 度後’每張圖片中各像素的灰度值只有〇及255兩種,0 代表黑色,255代表白色。 . 運動判斷模組126將該連續晝面所包括的各黑白圖片 進行比較,根據圖片的區別判斷用戶手掌或手指的運動。 在本實施例中’運動判斷模組126根據黑白圖片中灰度值 發生變化的像素確定用戶手掌或手指的移動方向及移動距 © 離。例如’圖6和圖7是兩張黑白圖片,兩張圖片的像素 均為640X480,手掌的有效移動範圍為4〇cm*3〇cm,則水 平方向/垂直方向lcm分佈16個像素。用戶手掌所覆蓋區 域的像素的灰度值為0’其他區域的像素的灰度值為255。 假設在圖6中,用戶手掌離圖片左邊緣的水平方向分佈的 灰度值為255的像素有m個’運動判斷模組126將圖7中 的圖片與圖6中圖片比較後得到,在圖7中,用戶手掌與 圖片上、下邊緣的區域中像素灰度值與圖6中用戶手掌與 ® 圖片上、下邊緣的區域中像素灰度值相同,但用戶手掌離 圖片左邊緣的水平方向灰度值為255的像素分佈減少至n 個,則運動判斷模組126用戶手掌向左移動了,其移動距 離為 d=(ni-n)/16。 執行模組127用於根據用戶手掌或手指移動方向及移 動距離獲取用戶手掌或手指運動對應的滑氣操作,並執行 該滑鼠操作對應的指令。例如,當用戶食指向左水平移動 所述第-距離時,對應於單擊滑鼠左鍵的操作,執行模組 12 201020867 127根據電腦顯示螢幕上游標的指向執行相應指令,例如 選中某個物件(如一個檔)。 圖3係本發明滑鼠類比系統應用方法較佳實施例的流 • 程圖。 步驟S301,資訊獲取模組121從儲存系統n獲取類 比=鼠運動的參考資料,包括一般滑鼠在桌面上的有效移 動範圍、相機20的視角及像素。在本實施例中,滑鼠的有 效移動乾圍為20cm*20cm (長*寬)的區域,相機2〇的視 ❹ 角為60度、像素為640*480。 步驟S302’參數確定模組122根據滑鼠的有效移動範 圍確定相機的最小視角範圍,根據最小視角範圍及相機視 角計算相機的最低架設高度。據上所述,當滑鼠的有效移 動範圍為2〇cm*20cm (長*寬)的區域時,相機的最小視 角範圍為20cm*20cm (長*寬)的區域。當相機2〇架設於 最小視角範圍的正上方,且其視角為60度,最小視角範圍 ❹ 的對角線長度=(202+202)l/2cm,則相機20的最低架設高 度 h=l/2*(2〇2+202)l/2cm*cot300=24.49cm。 步驟S303,參數調整模組123根據相機20的像素確 定拍攝得到圖片的畫面比例,根據畫面比例調整所述最小 視角範圍得到有效視角範圍40,並根據有效視角範圍40 調整相機20的最低架設高度得到相機20的有效架設高 度。例如,晝面比例為:640:480= 4:3=40:30。則參數調整 模組123調整調整上述最小視角範圍20cm*20cm,得到有 效視角範圍40為40cm*30cm,有效視角範圍40的對角線 13 201020867 長度等於50cm °進而’參數調整模組123根據有效視角範 圍40及相機20的視角計算相機2〇的有效架設高度 H=25cm*cot30〇=43.3cm。 步驟S304,參數調整模組123提示用戶相機2〇的有 效架設高度及有效視角範圍40,以利於用戶架設相機2〇 及瞭解手掌運動的有效範圍40。 ❹ e 步驟S305 ’設置模組124設置判斷手掌或手指運動的 時間間隔’並設置手掌及手指運動對應於滑鼠的操作。在 本實施例中’設置模組124設置所述時間間隔為i秒。 步驟S306,相機20對有效視角範圍4〇内的用戶手掌 進行拍攝,得到-個時間間隔内用戶手掌或手指運動的連 續畫面,並將該連續晝面所包括的彩色圖片傳送至電腦 10。例如’若相機20在!秒鐘内連續拍攝15張圖片,則 該15張圖片被傳送至電腦。 步驟S307,畫面處理模組125將該連續晝面所包括的 彩色圖片轉換為黑白圖片,並提高各黑白圖片的對比度。 在本實施例中,為減少運算量’畫面處理模組125提高各 黑白圖片的對比度後,每張黑白圖片中各像素的灰度值只 有0及255兩種,〇代表黑色,况代表白色。 步驟S 3〇 8,運動判斷模組12 6將該連續畫面所包括的 各黑白圖片進行比較,根據圖片的區別判斷用戶手掌或手 指運動的移動方向及移動距離。 步驟S309’執行模組127根據用戶手掌或手指移動方 向及移動距離從儲存Μ η獲取用戶手掌或手指運動對 201020867 應的滑鼠操作’並執行該滑鼠操作對應的指令❶ 如圖4所示,係圖3中步驟S305的細化流程圖。 步驟S401 ’設置模組124設置用戶食指向左水平移動 .第一距離對應於單擊滑鼠左鍵的操作。所述第一距離可以 為具體的數值’也可以為數值區間,例如2cm〜5cm的數值 區間,當用戶食指向左水平移動的距離落入該數值區間 時’則視該移動為單擊滑鼠左鍵的操作。 步驟S402’設置模組124設置用戶食指向左水平移動 ❿第一距離後在一定時間内又向右水平移動第二距離對應於 雙擊滑鼠左鍵的操作。 步驟S403,設置模組124設置用戶無名指向右水平移 動第三距離對應於單擊滑鼠右鍵的操作。 步驟S404,設置模組124設置用戶中指向上移動第四 距離對應於向上滑動滑鼠滾輪的操作。 步驟S405,設置模組124設置用戶中指向下移動第五 距離對應於向下滑動滑鼠滾輪的操作。 © 步驟S406,設置模組124設置用戶手掌向上移動對應 於向上移動滑鼠的操作,設置用戶手掌向下移動對應於向 下移動滑鼠的操作,設置用戶手掌向左移動對應於向左移 動滑鼠的操作,及設置用戶手掌向右移動對應於向右移動 滑鼠的操作。 所述第二、第三、第四及第五距離與所述第一距離類 似,可以為具體的數值,也可以為數值區間。 需要指出的是,圖4僅為舉例說明設置手掌及手指運 15 201020867 動對應於滑鼠的操作,用戶可以根據需要或習慣靈活設置 各個手指移動方向及移動距離對應於滑鼠的操作類塑。 如圖5所示,係圖3中步驟S308的細化流程圖。 步驟S501’運動判斷模組126獲取每張黑白圖片中各 像素的灰度值。综上所述,提高對比度之後,每張黑白圖 片中像素的灰度值只有兩種,〇 (黑色)或255 (白色)。 一步驟S502’運動判斷模组126將所有黑白照片兩兩進 仃比較’得到每兩張黑白圖片中灰度值發生變化的像素數 目0 步驟S5〇3’運動判斷模组m選取灰度值發生變化的 像素數目最大的兩張黑白圖片。 步驟S504,運動判斷模组126根據該兩張黑白圖片中 灰度值發生變化的像切手掌或手指的移動方命或 及移動距離如圖6及圖7所示,為兩張黑白圖片示意圖。 :張黑白圖片的像素均為640X480,手掌的有效移動範園 ”、4〇Cm 3〇Cm’則相當於水平方向/垂直方向lcm分佈16 個像素。用戶手掌所覆蓋區域的像素的灰度值為〇 (黑 色)’其他區域的像素的灰度值為255 (白色)。假設在圖6 中用戶手掌離圖片左邊緣的水平方向分佈的灰度值為 255 (白色)的像素有m個,運動判斷模組126將圖7中 的圖片與圖6中圖片比較後得到,在圖,用戶手掌與 圖片上、下邊緣的區域中像素灰度值與圖6中用戶手掌與 圖片上、下邊緣的區域中像素灰度值相同,但用戶手掌離 圖片左邊緣的水平方向灰度值為255 (白色)的像素分佈 16 201020867 減少至η個,則運動判斷模組126判斷用戶手掌向左移動 了,其移動距離為d=(m-n)/16。 以上所述僅為本發明之較佳實施例而已,且已達廣泛 ' 之使用功效,凡其他未脫離本發明所揭示之精神下所完成 之均等變化或修飾,均應包含在下述之申請專利範圍内。 【圖式簡單說明】 圖1係本發明滑鼠類比系統較佳實施例的功能模組 圖。 〇 圖2係圖1中控制晶片的功能模組圖。 圖3係本發明滑鼠類比系統應用方法較佳實施例的流 程圖。 圖4係圖3中步驟S305的細化流程圖。 圖5係圖3中步驟S308的細化流程圖。 圖6及圖7係圖1中相機拍攝得到的用戶手掌的兩張 黑白圖片。 【主要元件符號說明】 電腦 10 相機 20 連接 30 有效視角範圍 40 用戶手掌 50 儲存系統 11 控制晶片 12 資訊獲取模組 121 17 201020867 參數確定模組 122 參數調整模組 123 設置模組 124 - 晝面處理模組 125 運動判斷模組 126 執行模組 127 ❹ 18201020867 IX. Description of the Invention: [Technical Field] The present invention relates to an analog system and an application method thereof, and more particularly to an analog system for a mouse and an application method thereof. [Prior Art] A mouse is a commonly used input device for computers. When the user moves the mouse on the desktop, the cursor on the screen is synchronized with the mouse. When the cursor points to a position on the display screen, the user presses the function key on the mouse (left button, right button, scroll wheel). When the corresponding operation is performed, the computer executes the command corresponding to the operation. For example, when the cursor refers to a folder on the display screen and the user clicks the left mouse button, the computer executes an instruction to select the folder. If the user double-clicks the left mouse button, the computer executes an instruction to open the folder. If the user clicks the right button, the instruction to pop up the corresponding window is executed, and so on. However, current mice have many shortcomings, and wired mice often have difficulty in operating the mouse because of the limitation of the length of the mouse or the poor material. The wireless mouse gets rid of the cable, but it is easy to drift due to the desktop ® material and the battery needs to be replaced frequently. SUMMARY OF THE INVENTION In view of the above, it is necessary to provide a mouse analog system and a method for applying the same, which can provide the functions provided by the mouse and overcome the shortcomings of the current mouse. The present invention provides a mouse analogy system that includes a computer and a camera coupled to the computer. The camera takes a picture of the user's palm within its viewing angle range and transmits the captured picture to a computer. The computer includes a storage 6 201020867 system and control chip. The storage system is configured to store reference data for analog mouse movement, including the effective range of movement of the mouse on the desktop, the angle of view and pixels of the camera, and the corresponding operation of the function keys on the mouse when the user performs the operation. Operate the corresponding command. The control chip is configured to calculate a height of the camera according to the reference material to prompt the user to set up the camera, set a time interval for judging the movement of the palm or the finger, and set the operation of the palm and the finger movement corresponding to the mouse. The control chip is further configured to process, compare, and compare the picture of the user's palm moving in the viewing angle in each time interval, and determine the motion of the user's palm or the finger according to the difference of the picture. The operation of the mouse, the command corresponding to the operation is performed. The invention also provides a method for applying a mouse analog system, the method comprising the steps of: (A) using a camera to shoot a user's palm in a range of angles of view, and transmitting the captured image to a computer, the computer comprising a storage system and Control the wafer; (B) use the storage system to store reference data for analog mouse movement, including the effective range of movement of the mouse on the desktop, the camera's visual sound & angle and pixels, and the user's corresponding function keys on the mouse In operation, the computer executes the corresponding command of the operation; (C) uses the control chip to calculate the height of the camera according to the reference data to prompt the user to set up the camera, set the time interval for judging the movement of the palm or the finger' and set the palm and finger movement Corresponding to the operation of the mouse; and (D) using the control chip to process and compare the pictures of the user's palm moving within the viewing angle within each time interval, and determine the movement of the user's palm or finger according to the difference of the pictures' Get the action corresponding to the mouse, and perform the operation corresponding to the 7 201020867 make. Compared with the prior art, the mouse analogy system and the application method thereof use the camera to take pictures of the user's palm or finger movement, and use the computer to process and compare the pictures, and obtain the user's palm or finger within a certain time interval. The moving direction and moving distance of the movement, and the movement of the palm or the finger of the user is associated with the operation of the mouse, and the user can control the movement of the cursor on the screen or perform the corresponding operation through the palm or finger movement. [Embodiment] φ is a functional module diagram of a preferred embodiment of the mouse analog system of the present invention as shown in FIG. The mouse analog system includes a computer 10 and a camera 20. The camera 20 is connected to the computer 10 via a connection 30. The connection 30 can be a cable or a wireless connection. Camera 20 is used to capture a user's palm 50 within its effective viewing angle range 40 and to transmit the captured face to computer 10 via connection 30. In the present embodiment, the user's palm 50 is moved on a horizontal table (not shown in Fig. 1). The camera 20 is mounted directly above the horizontal table. The effective angle of view 40 of the camera 20 is determined by the viewing angle of the camera (hereinafter referred to as the angle of view) and the height of the erection. The angle of view of the camera 20 refers to the angle formed by the center point of the lens to the opposite ends of the imaging plane. When the angle of view of the camera 20 is constant, the higher the erection height, the larger the effective angle range 40. The computer 10 includes a storage system 11 and a control wafer 12. The storage system 11 is used for storing reference data of the analog mouse movement, including: the effective moving range of the general mouse on the desktop, the related information of the camera 20, and the function keys (left button, right button, and scroll wheel) of the user on the mouse. When the corresponding operation is performed on 8 201020867, the corresponding command is executed by the computer 1G. The second can be a hard disk, a compact disc or other storage device. &Domains in the domain ^ 纯 目 & — — 个 个 # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # . When the field is exceeded, the cursor stays on the display screen I2? The related information includes the camera's 2 视角 view angle and pixels. ❹ ❹ The screen shot by the 2G. The control module 12 is configured to calculate the camera 20's 根据 高 根据 根据 根据 # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # # , money machine: refers to the movement corresponding to the operation of the mouse. The palm or hand control chip 12 is also used to process and compare the pictures of the camera 2 in the effective viewing angle of the camera (4) for each camera, and judge the image according to the difference of the pictures. The movement 'get the movement corresponding to the mouse two: make the corresponding command. As shown in FIG. 2, the functional mode control chip 12 of the control chip 12 in FIG. 1 mainly includes: an information acquisition module, a map 122, a parameter adjustment module 123, a setting module 124, and a number determination module. The motion judging module 126 and the execution module 127 module are used by the information acquisition module m to retrieve analog reference materials from the faulty system, including the mouse-like effect on the desktop = the camera angle and pixel of the camera 20 . The slanting module 9 is used to determine the minimum viewing angle range of the camera 20 according to the effective moving range of the mouse, and calculate the minimum erection height of the camera 20 according to the minimum viewing angle and the angle of view of the camera 20. For example, 'Assuming that the effective range of movement of the mouse is 20 cm * 20 cm (length * width), the minimum angle - angle range of 2 〇 is 20 cm * 20 cm area. The camera 20 is erected directly above the minimum viewing angle range, the viewing angle is 60 degrees, and the diagonal length of the minimum viewing angle range = (2 〇 2+ 202) l / 2 cm, the minimum erection height of the camera 20 h = l / 2 * (202+202) l/2cm*cot30o=24.49cm. The parameter adjustment module 123 is configured to determine the proportion of the captured picture according to the pixels of the camera 20, adjust the minimum viewing angle range according to the aspect ratio to obtain the effective viewing angle range 40, and adjust the minimum erection of the camera 20 according to the effective viewing angle range 40. The height is obtained by the effective erection height of the camera 20. For example, if the camera 20 is a Video Graphic Array (VGA) camera, the VGA resolution is 640×480 pixels, that is, 640 pixels in the horizontal direction and 480 pixels in the vertical direction, and the camera 20 captures the image. The ratio of the face is: 640:480=4:3=40:30. Then, the parameter adjustment module 123 adjusts and adjusts the above minimum viewing angle range of 20 cm*20 cm to obtain an effective viewing angle range of 40 cm*30 cm'. The diagonal length of the effective viewing angle range of 4 等于 is equal to 50 cm. Further, the parameter adjustment module 123 calculates the effective erection height of the camera 20 according to the effective viewing angle range 40 and the angle of view of the camera 20. H=25cm*cot30o=43.3cm. The parameter adjustment module 123 is also used to prompt the user to effectively set up the camera 2〇. The range of effective angles of view 40 is to facilitate the user to set up the camera 2 and know the effective range of palm movement. 201020867 Set the modulo M24 to determine the time interval for palm or finger movement, and set the palm and finger movements to correspond to the mouse's operation. For example, the setting module I24 sets the user's palm or hand to be judged every 1 second. The motion here refers to an action that can trigger the computer 10 to display the cursor movement. In this embodiment, the setting module 124 sets the user's food pointing to the left horizontally to move the first distance corresponding to the operation of clicking the left mouse button, and sets the user's food pointing to the left horizontally to move the first distance and then to the right level within a certain time. Moving the second distance corresponds to the operation of double-clicking the left mouse button, setting the user nameless to the right horizontal movement, the third distance corresponding to the operation of clicking the right mouse button, the user moving upward, pointing the upper movement, the fourth distance corresponding to the upward sliding mouse The operation of the scroll wheel, setting the user to point downward and move the fifth distance corresponding to the operation of sliding the mouse roll downwards. 'Setting the user's palm to move upward corresponds to moving the mouse up, setting the user's palm to move downwards corresponding to moving the mouse downwards The operation of setting the user's palm to the left corresponds to the operation of moving the mouse to the left, and setting the user's palm to the right corresponds to the operation of moving the mouse to the right. The first to fifth distances may be specific values or numerical intervals. In this embodiment, the first to fifth distances are two numerical intervals. For example, the first distance is a numerical interval of 2 cm to 5 cm. When the distance from the user's food to the left horizontal movement falls within the numerical interval, the operation is performed by clicking the left mouse button. ~ The picture processing module 125 is configured to process the continuous image of the user's palm or finger movement captured by the camera 2 within a time interval, including converting a series of color pictures included in the continuous picture into black and white pictures, and 11 201020867 Improve the contrast of each black and white picture. In this embodiment, in order to reduce the amount of calculation, the facet processing module 125 converts the color picture into a black and white picture and improves the contrast. The gray value of each pixel in each picture is only 255 and 0, and 0 represents black. 255 stands for white. The motion judging module 126 compares each black and white picture included in the continuous face, and judges the movement of the user's palm or finger according to the difference of the pictures. In the present embodiment, the motion determination module 126 determines the moving direction and the moving distance of the user's palm or the finger according to the pixel whose gray value changes in the black and white picture. For example, 'Fig. 6 and Fig. 7 are two black and white pictures, the pixels of both pictures are 640X480, the effective movement range of the palm is 4〇cm*3〇cm, and the horizontal direction/vertical direction lcm is 16 pixels. The gradation value of the pixel of the area covered by the user's palm is 0'. The gradation value of the pixel of the other area is 255. Assume that in FIG. 6, the pixels in the horizontal direction of the user's palm from the left edge of the picture have a gray value of 255, and m 'motion determination module 126 compares the picture in FIG. 7 with the picture in FIG. In 7, the pixel gray value in the area of the palm of the user and the upper and lower edges of the picture is the same as the gray value of the pixel in the area of the upper and lower edges of the user's palm and the picture in FIG. 6, but the horizontal direction of the user's palm from the left edge of the picture. When the pixel distribution with the gray value of 255 is reduced to n, the motion determination module 126 moves the palm of the user to the left, and the moving distance is d=(ni-n)/16. The execution module 127 is configured to obtain a slipping operation corresponding to the movement of the palm or the finger of the user according to the moving direction and the moving distance of the user's palm or the finger, and execute an instruction corresponding to the mouse operation. For example, when the user points to move the first horizontal distance horizontally, corresponding to the operation of clicking the left mouse button, the execution module 12 201020867 127 executes a corresponding instruction according to the pointing of the upstream display of the screen of the computer, for example, selecting an object. (such as a file). Fig. 3 is a flow chart of a preferred embodiment of the method for applying the mouse analog system of the present invention. In step S301, the information acquisition module 121 acquires the reference data of the analog=rat motion from the storage system n, including the effective moving range of the general mouse on the desktop, the angle of view of the camera 20, and the pixels. In the present embodiment, the effective moving circumference of the mouse is 20 cm * 20 cm (length * width), and the camera 2 〇 has an angle of view of 60 degrees and a pixel of 640 * 480. Step S302' The parameter determination module 122 determines the minimum viewing angle range of the camera according to the effective moving range of the mouse, and calculates the minimum erection height of the camera according to the minimum viewing angle range and the camera angle of view. According to the above, when the effective range of the mouse is 2 〇 cm * 20 cm (length * width), the minimum angle of view of the camera is 20 cm * 20 cm (length * width). When the camera 2 is erected directly above the minimum viewing angle range and its viewing angle is 60 degrees, the diagonal length of the minimum viewing angle range ❹ = (202 + 202) l / 2 cm, the minimum erection height of the camera 20 h = l / 2*(2〇2+202)l/2cm*cot300=24.49cm. Step S303, the parameter adjustment module 123 determines the aspect ratio of the captured image according to the pixels of the camera 20, adjusts the minimum viewing angle range according to the screen ratio to obtain the effective viewing angle range 40, and adjusts the minimum erection height of the camera 20 according to the effective viewing angle range 40. The effective erection height of the camera 20. For example, the facet ratio is: 640:480 = 4:3 = 40:30. Then, the parameter adjustment module 123 adjusts and adjusts the minimum viewing angle range of 20 cm*20 cm to obtain an effective viewing angle range of 40 cm*30 cm, and the diagonal of the effective viewing angle range 40 is 201020867. The length is equal to 50 cm ° and then the parameter adjustment module 123 is based on the effective viewing angle. The range 40 and the angle of view of the camera 20 calculate the effective erection height of the camera 2 H H = 25 cm * cot 30 〇 = 43.3 cm. In step S304, the parameter adjustment module 123 prompts the user for the effective erection height of the camera 2 and the effective viewing angle range 40, so as to facilitate the user to set up the camera 2 and understand the effective range 40 of the palm movement. ❹ e Step S305' The setting module 124 sets the time interval for judging the movement of the palm or the finger' and sets the operation of the palm and the finger movement corresponding to the mouse. In the present embodiment, the setting module 124 sets the time interval to i seconds. In step S306, the camera 20 captures the user's palm in the effective viewing angle range 4〇, obtains a continuous picture of the user's palm or finger movement within a time interval, and transmits the color picture included in the continuous face to the computer 10. For example 'If the camera 20 is in! When 15 pictures are taken continuously in seconds, the 15 pictures are transferred to the computer. In step S307, the picture processing module 125 converts the color picture included in the continuous picture into a black and white picture, and improves the contrast of each black and white picture. In the present embodiment, in order to reduce the amount of calculations, the picture processing module 125 increases the contrast of each black and white picture. The gray value of each pixel in each black and white picture has only 0 and 255, and 〇 represents black, and the condition represents white. Step S3〇8, the motion judging module 12 6 compares the black and white pictures included in the continuous picture, and determines the moving direction and the moving distance of the user's palm or finger movement according to the difference of the pictures. Step S309' The execution module 127 acquires the mouse operation of the user's palm or finger movement for the 201020867 according to the moving direction and the moving distance of the user's palm or the finger, and executes the corresponding operation of the mouse operation, as shown in FIG. , is a refinement flowchart of step S305 in FIG. Step S401' sets the module 124 to set the user's index pointing to the left horizontal movement. The first distance corresponds to the operation of clicking the left mouse button. The first distance may be a specific value ' or a numerical interval, for example, a numerical interval of 2 cm to 5 cm. When the distance that the user's food is pointing to the left horizontally falls within the numerical interval, then the movement is regarded as a click mouse. Left button operation. Step S402' sets the module 124 to set the user's food pointing to the left horizontal movement ❿ the first distance and then move horizontally to the right for a certain time and the second distance corresponds to the operation of double-clicking the left mouse button. In step S403, the setting module 124 sets the user nameless pointing to the right horizontal movement, and the third distance corresponds to the operation of clicking the right mouse button. In step S404, the setting module 124 sets an operation in which the user moves the fourth distance upward to correspond to the upward sliding of the mouse wheel. In step S405, the setting module 124 sets an operation of moving the fifth distance downward in the user corresponding to sliding the mouse wheel downward. © step S406, the setting module 124 sets the user's palm upward movement corresponding to the upward movement of the mouse, and sets the user's palm downward movement corresponding to the downward movement of the mouse, and sets the user's palm to the left to move to the left. The operation of the mouse, and setting the user's palm to the right, corresponds to the operation of moving the mouse to the right. The second, third, fourth, and fifth distances are similar to the first distance, and may be specific values or numerical intervals. It should be noted that FIG. 4 is only an example to illustrate the operation of setting the palm and the finger. The user can flexibly set the direction of the finger movement and the distance of the movement corresponding to the operation mode of the mouse according to the needs or habits. As shown in FIG. 5, it is a refinement flowchart of step S308 in FIG. Step S501' motion determination module 126 acquires the gray value of each pixel in each black and white picture. In summary, after increasing the contrast, there are only two types of gray values in each black and white picture, 〇 (black) or 255 (white). In a step S502, the motion determining module 126 compares all the black and white photos into two pairs to obtain the number of pixels in which the gray value changes in each of the two black and white pictures. Step S5〇3' The motion determining module m selects the gray value to occur. Two black and white pictures with the largest number of pixels changing. In step S504, the motion determination module 126 is a schematic diagram of two black and white pictures according to the moving or moving distance of the palm or the finger according to the change of the gray value in the two black and white pictures, as shown in FIG. 6 and FIG. 7 . : The black and white picture pixels are all 640X480, the effective movement of the palm of the hand, and 4〇Cm 3〇Cm' is equivalent to 16 pixels in the horizontal direction/vertical direction lcm. The gray value of the pixel in the area covered by the user's palm For 〇 (black), the gray value of the pixels in other areas is 255 (white). Assume that there are m pixels in the horizontal direction of the user's palm from the left edge of the picture with a gray value of 255 (white). The motion judging module 126 compares the picture in FIG. 7 with the picture in FIG. 6. In the figure, the pixel gray value in the area of the user's palm and the upper and lower edges of the picture and the upper and lower edges of the user's palm and the picture in FIG. The pixel gray value is the same in the area, but the pixel distribution 16 201020867 of the user's palm from the left edge of the picture is 255 (white) is reduced to n, then the motion determination module 126 determines that the user's palm has moved to the left. The moving distance is d = (mn) / 16. The above description is only the preferred embodiment of the present invention, and has been used in a wide range of functions, and other than the spirit of the present invention has been achieved. Equal change or The modifications are to be included in the following claims. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a functional block diagram of a preferred embodiment of the mouse analog system of the present invention. Figure 2 is a functional mode of the control wafer of Figure 1. Figure 3 is a flow chart of a preferred embodiment of the method for applying the mouse analog system of the present invention. Figure 4 is a detailed flow chart of step S305 of Figure 3. Figure 5 is a detailed flow chart of step S308 of Figure 3. Figure 6 and Figure 7 are two black and white pictures of the user's palm taken by the camera in Figure 1. [Key component symbol description] Computer 10 Camera 20 Connection 30 Effective viewing angle range 40 User palm 50 Storage system 11 Control chip 12 Information acquisition module 121 17 201020867 Parameter determination module 122 Parameter adjustment module 123 Setting module 124 - Kneading processing module 125 Motion judging module 126 Execution module 127 ❹ 18

Claims (1)

201020867 十、申請專利範固 L機種:相鼠=統Γ統包括電腦及與電_的相 拍攝的圖片傳送至電腦,該電腦包括: 儲存系統,用於儲存類比滑鼠運動的參考資料,包括滑 魯 ❿ :=::_圍,相機的視二= 操作對應的命令;Ϊ鍵進仃相應㈣時,電腦執行的該 控制晶片,用於根據所述參考資 以提示用戶架設相機 ㈣機的架汉问度 間隔,並設置手 所述控制晶片’還用於對每^掉相作拍 的用戶手掌在視角範圍内運動的圖=内,相機拍攝 根據圖片的區別判斷用戶手 進订處理、比較, 動對應於滑鼠的操作,執行4指的運動,獲取該運 2.如申請專利範圍第μ所^滑^應的命令。、 控制晶片包括: *類比系統,其中所述 資訊獲取模組,用於從儲存系 考資料,包括滑鼠在桌面上^取軸㈣運動的參 角及像素; 效移動範圍、相機的視 參數確定模組,用於根據滑鼠 的最小視角範圍,根據最小視^效移動範圍確定相機 相機的最低妓高度; _及相機的視角計算 參數調整模組,用於根據相機的像素確定拍攝得到圖片 201020867 的晝面的比例,根據晝面比例調整所述最小視角範圍得 到相機的有效視角範圍,並根據有效視角範圍調整最低 架設高度,得到相機的有效架設高度; ‘設置模組,用於設置判斷手掌或手指運動的時間間隔, 並設置手掌及手指運動對應於滑鼠的操作; 晝面處理模組,用於將一個時間間隔内,相機拍攝得到 的彩色圖片轉換為黑白圖片,並提高各黑白圖片的對比 度; ❿ 運動判斷模組,用於將該時間間隔内的各黑白圖片進行 比較,根據圖片的區別判斷用戶手掌或手指運動的移動 方向及移動距離;及 執行模組,根據用戶手掌或手指移動方向及移動距離確 定用戶手掌或手指運動對應的滑鼠操作,並執行該滑鼠 操作對應的指令。 3. 如申請專利範圍第2項所述之滑鼠類比系統,其中,提 高對比度後,所述黑白圖片中像素的灰度值包括0及 ❿ 255兩種。 4. 如申請專利範圍第2項所述之滑鼠類比系統,其中,所 述圖片的區別是指兩張黑白圖片中灰度值發生變化的 像素。 5. 如申請專利範圍第2項所述之滑鼠類比系統,其中,所 述設置手掌及手指運動對應於滑鼠的操作包括: 設置用戶食指向左水平移動第一距離對應於單擊滑鼠 左鍵的操作; 20 201020867 又向右水平移動第二距離^應第距離後在一疋時間内 設置用戶舞名指水平銘t 雙擊滑鼠左鍵的操作; 鍵的操作 千移動第三距離對應於單擊滑鼠右 滾輪=::曰向上移動第四距離對應於向上滑動滑鼠 滾輪的操^曰向下移動第五距離對應於向下滑動滑鼠 應於向上移動滑鼠的操作; 設置用戶手掌白左純姆應於向下移動滑鼠的操作; 設置用應於向左移動滑鼠_及 6如申笮專利範圍坌 對應於向右移動滑鼠的操作。 6·如月專利範圍第5項所述之 述第一距離、第二距離、第三距^類比系統,其中,所 離為一個具體數值或一個數值範圍第四距離及第五距 7·=滑鼠類比系狀應財法包括. 利用相機鬆視角範_的 匕括· 攝的乎掌進行拍攝,並將拍 片;傳送至電腦’該電腦包括餘存系統及控制晶 利用儲存系統儲存類比滑鼠運動 在桌面上的有效移動範圍,相機的視角考及:音包= 戶對滑鼠上的功能鍵進行相應操執 作對應的命令; 1屬腦執盯的該操 利用控制晶片根據所述參考資料計算相機的架設高度 21 201020867 以提示用戶架設相機,設置判斷手掌或手指運動的時間 間隔,並設置手掌及手指運動對應於滑鼠的操作;及 利用控制晶片對每一個時間間隔内,相機拍攝的用戶手 掌在視角範圍内運動的圖片進行處理、比較,根據圖片 的區別判斷用戶手掌或手指的運動,獲取該運動對應於 滑鼠的操作,執行該操作對應的命令。 8.如申請專利範圍第7項所述之滑鼠類比系統之應用方 法,其中,所述利用控制晶片的步驟包括: ❿ 從儲存系統獲取類比滑鼠運動的參考資料,包括滑鼠在 桌面上的有效移動範圍、相機的視角及像素; 根據滑鼠的有效移動範圍確定相機的最小視角範圍,根 據最小視角範圍及相機的視角計算相機的最低架設高 度; 根據相機的像素確定拍攝得到圖片的晝面比例,根據晝 面比例調整所述最小視角範圍得到有效視角範圍,並根 據有效視角範圍調整相機的最低架設高度,得到相機的 ® 有效架設高度; 設置判斷手掌或手指運動的時間間隔,並設置手掌及手 指運動對應於滑鼠的操作; 將一個時間間隔内,相機拍攝得到的彩色圖片轉換為黑 白圖片,並提高各黑白圖片的對比度; 將該時間間隔内的各黑白圖片進行比較,根據圖片的區 別判斷用戶手掌或手指運動的移動方向及移動距離;及 根據用戶手掌或手指移動方向及移動距離確定用戶手 22 201020867 掌或手指運動對應的滑鼠操作,並執行該滑氣操作對應 的指令。 9.如申請專_園第8項所述之輯類比系統之應用方 法,其中,所述設置手掌及手指運動對應於滑鼠的操作 的步驟包括: 設置用戶食指向左水平移動第一距離對應於單擊滑鼠 左鍵的操作; e 設置用戶食指向左水平移動第一距離後在一定時間内 又^右水平移鮮二_對躲雙擊滑鼠 設置用戶無名指水平移動第三距離 的操作二 鍵的操作; 早擎滑氡右 設置用户中指向上移動第四距離對應 滾輪的操作; 上滑動滑鼠 成置用戶中指向下移動第五距離對應於 滾輪的操作; ;卜^動滑鼠 ❹ 3二手掌向上移動對應於向上移動滑鼠的操作. 下移動對應於向下移動滑鼠的操作; 設置用戶手ί向左移動對應於向左移動滑鼠的操作;及 掌向右移動對應於向右移動滑鼠的操作 10·如申請專利範圍第8項所述 、乍。 法’其中’所述將該時間間隔内:黑:圏^ =艮據圖片的區別判斷用戶手掌或手指運動的移= 向及移動距離的步驟包括: 動方 獲取每張黑白圖片中各像素的灰度值; 23 201020867 將所有黑白照片兩兩進行比較,得到每兩張黑白圖片中 灰度值發生變化的像素數目; 選取灰度值發生變化的像素數目最大的兩張黑白圖 • 片;及 根據該兩張黑白圖片中灰度值發生變化的像素確定用 戶手掌或手指的移動方向及移動距離。201020867 X. Applying for a patented model: the mouse: the system including the computer and the picture taken with the power _ to the computer, the computer includes: a storage system for storing reference data for analog mouse movement, including滑鲁❿ :=::_, the camera's view 2 = the corresponding command; when the Ϊ key enters the corresponding (4), the control chip executed by the computer is used to prompt the user to set up the camera (four) according to the reference The interval between the Chinese and the Chinese is set, and the control chip is also used to move the image of the user's palm in the range of viewing angles for each shot. The camera capture determines the user's hand binding processing according to the difference of the pictures. For comparison, the operation corresponding to the mouse is performed, and the movement of the 4-finger is performed to obtain the command of the operation. The control chip comprises: an analogy system, wherein the information acquisition module is configured to collect data from the storage system, including the mouse and the axis (4) movement of the reference angle and the pixel on the desktop; the effective movement range, the visual parameter of the camera Determining a module for determining a minimum camera height of the camera camera according to a minimum viewing angle range of the mouse; _ and a camera angle calculation parameter adjustment module for determining a picture according to a pixel of the camera The proportion of the face of 201020867, the minimum angle of view is adjusted according to the proportion of the face to obtain the effective range of the camera, and the minimum erection height is adjusted according to the effective angle range to obtain the effective erection height of the camera; 'Setting module for setting judgment The time interval between the movement of the palm or the finger, and the movement of the palm and the finger corresponding to the operation of the mouse; the processing module for converting the color picture taken by the camera into a black and white picture in one time interval, and improving each black and white Contrast of the picture; ❿ motion judgment module for each of the time intervals White pictures are compared, and the moving direction and moving distance of the user's palm or finger movement are determined according to the difference of the pictures; and the execution module determines the mouse operation corresponding to the user's palm or finger movement according to the user's palm or finger moving direction and moving distance, and Execute the command corresponding to the mouse operation. 3. The mouse analogy system of claim 2, wherein, after the contrast is increased, the gray values of the pixels in the black and white picture include 0 and ❿255. 4. The mouse analogy system of claim 2, wherein the difference in the picture refers to a pixel in which the gray value changes in two black and white pictures. 5. The mouse analogy system of claim 2, wherein the setting of the palm and the finger movement corresponding to the mouse comprises: setting the user's index of food to the left horizontally to move the first distance corresponding to clicking the mouse Left button operation; 20 201020867 Moves the second distance horizontally to the right again ^ After the first distance, set the user's dance name to the horizontal position in one time. Double-click the left mouse button; the operation of the key moves a third distance corresponding to Click the right mouse wheel =:: 曰 move up the fourth distance corresponds to the operation of sliding the mouse wheel upwards 曰 move down the fifth distance corresponds to the downward sliding mouse should move the mouse upwards; set the user The palm white Zuom should move the mouse down; the setting should be to move the mouse to the left _ and 6 as claimed in the patent range, corresponding to the operation of moving the mouse to the right. 6. The first distance, the second distance, and the third distance analogy system described in item 5 of the patent scope, wherein the distance is a specific value or a range of values, the fourth distance and the fifth distance 7·=slip The mouse analogy method includes the use of the camera. The camera is used to capture the film and the film is sent to the computer. The computer includes the remaining system and the control crystal storage system to store the analog mouse. The effective range of motion on the desktop, the camera's perspective: the package = the user's corresponding command on the function key on the mouse; 1 is the brain to control the operation of the control wafer according to the reference Data calculation camera erection height 21 201020867 to prompt the user to set up the camera, set the time interval for judging the movement of the palm or finger, and set the palm and finger movement corresponding to the operation of the mouse; and use the control chip for each time interval, the camera shoots The picture of the user's palm moving within the angle of view is processed and compared, and the movement of the user's palm or finger is judged according to the difference of the picture, and the operation is obtained. The operation corresponding to the mouse is executed, and the command corresponding to the operation is executed. 8. The method of applying the control system of the mouse according to claim 7, wherein the step of utilizing the control wafer comprises: 获取 obtaining reference data of the analog mouse movement from the storage system, including the mouse on the desktop The effective range of motion, the camera's angle of view and pixels; determine the camera's minimum viewing angle range based on the mouse's effective range of motion, calculate the camera's minimum erection height based on the minimum viewing angle range and the camera's viewing angle; determine the image to be taken based on the camera's pixels Surface ratio, adjust the minimum viewing angle range according to the aspect ratio to obtain the effective viewing angle range, and adjust the minimum erection height of the camera according to the effective viewing angle range to obtain the effective erection height of the camera; set the time interval for judging the movement of the palm or the finger, and set The palm and finger movements correspond to the operation of the mouse; the color pictures captured by the camera are converted into black and white pictures in one time interval, and the contrast of each black and white picture is improved; the black and white pictures in the time interval are compared, according to the picture The difference between the user's palm or It refers to the movement of the moving direction and a moving distance; and the user's palm or the finger moving direction and moving distance determining 22201020867 palm or fingers corresponding to the hand movement of the user's mouse operation, and executes the air slide according to the corresponding operational instructions. 9. The application method of the analogy system according to the application of the eighth aspect of the invention, wherein the step of setting the palm and the finger movement corresponding to the operation of the mouse comprises: setting the user's food index to the left horizontal movement corresponding to the first distance Click on the left mouse button to operate; e set the user's food point to the left horizontally to move the first distance and then within a certain period of time ^ right horizontal shift fresh two _ to hide the double-click mouse to set the user ring finger horizontally move the third distance operation two The operation of the key; the early slick right set the operation of the user corresponding to the moving wheel corresponding to the fourth distance; the upper sliding mouse is placed in the user to move downward and the fifth distance corresponds to the operation of the scroll wheel; The second-hand palm movement corresponds to the operation of moving the mouse upwards. The lower movement corresponds to the operation of moving the mouse downwards; setting the user's hand ί to the left corresponds to the operation of moving the mouse to the left; and the palm moving to the right corresponds to the direction Operation of moving the mouse to the right 10. As described in item 8 of the patent application, 乍. The method of 'where' described in the time interval: black: 圏 ^ = 判断 according to the difference of the picture to determine the movement of the user's palm or finger movement = direction and movement distance includes: the action to obtain each pixel in each black and white picture Gray value; 23 201020867 Compare all black and white photos by two to get the number of pixels whose gray value changes in each black and white picture; select two black and white pictures with the largest number of pixels whose gray value changes; The moving direction and the moving distance of the user's palm or the finger are determined according to the pixels in which the gray value changes in the two black and white pictures. 24twenty four
TW097146236A 2008-11-28 2008-11-28 Mouse simulating system and using method thereof TWI486821B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW097146236A TWI486821B (en) 2008-11-28 2008-11-28 Mouse simulating system and using method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW097146236A TWI486821B (en) 2008-11-28 2008-11-28 Mouse simulating system and using method thereof

Publications (2)

Publication Number Publication Date
TW201020867A true TW201020867A (en) 2010-06-01
TWI486821B TWI486821B (en) 2015-06-01

Family

ID=44832416

Family Applications (1)

Application Number Title Priority Date Filing Date
TW097146236A TWI486821B (en) 2008-11-28 2008-11-28 Mouse simulating system and using method thereof

Country Status (1)

Country Link
TW (1) TWI486821B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016029581A1 (en) * 2014-08-27 2016-03-03 华南理工大学 Touch reading method and device based on visual gestures

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7907117B2 (en) * 2006-08-08 2011-03-15 Microsoft Corporation Virtual controller for visual displays
TWM327733U (en) * 2007-09-07 2008-03-01 Univ Southern Taiwan Light-source-followed image identification game apparatus

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016029581A1 (en) * 2014-08-27 2016-03-03 华南理工大学 Touch reading method and device based on visual gestures
US11087637B2 (en) 2014-08-27 2021-08-10 South China University Of Technology Finger reading method and device based on visual gestures

Also Published As

Publication number Publication date
TWI486821B (en) 2015-06-01

Similar Documents

Publication Publication Date Title
US8818027B2 (en) Computing device interface
US10628010B2 (en) Quick review of captured image data
Schmitz et al. Ad-Hoc Multi-Displays for Mobile Interactive Applications.
US20080050035A1 (en) Information Processing Apparatus, Imaging Apparatus, Information Processing System, Device Control Method and Program
US9377851B2 (en) Information processing apparatus, information processing method, and computer program
WO2012128835A1 (en) Gesture-based configuration of image processing techniques
US11064784B2 (en) Printing method and system of a nail printing apparatus, and a medium thereof
US9547370B2 (en) Systems and methods for enabling fine-grained user interactions for projector-camera or display-camera systems
JP2012138666A (en) Data presentation system
TWI726252B (en) Operation method for multi-monitor and electronic system using the same
CN106200916B (en) Control method, device and the terminal device of augmented reality image
CN116114250A (en) Display device, human body posture detection method and application
US8810641B2 (en) Television, control method and control device for the television
WO2019051785A1 (en) Icon display method and device for intelligent terminal
TWI505135B (en) Control system for display screen, control apparatus and control method
US9195310B2 (en) Camera cursor system
WO2018171363A1 (en) Position information determining method, projection device and computer storage medium
WO2015127731A1 (en) Soft keyboard layout adjustment method and apparatus
TW201227399A (en) Motion recognition module, electronic device appling the motion recognition module and method thereof
TW201020867A (en) Mouse simulating system and using method thereof
CN103543824B (en) Gesture input system and method
CN114168034A (en) Menu operation method applied to head-mounted display equipment and head-mounted display equipment
CN111625210A (en) Large screen control method, device and equipment
Lin et al. The measurement of the angle of a user’s head in a novel head-tracker device
TWI416419B (en) System and method for implementing navigation key function