TW201218093A - System and method for controlling an image capturing device - Google Patents

System and method for controlling an image capturing device Download PDF

Info

Publication number
TW201218093A
TW201218093A TW099136392A TW99136392A TW201218093A TW 201218093 A TW201218093 A TW 201218093A TW 099136392 A TW099136392 A TW 099136392A TW 99136392 A TW99136392 A TW 99136392A TW 201218093 A TW201218093 A TW 201218093A
Authority
TW
Taiwan
Prior art keywords
eyeball
sample
moves
state
camera device
Prior art date
Application number
TW099136392A
Other languages
Chinese (zh)
Inventor
Hou-Hsien Lee
Chang-Jung Lee
Chih-Ping Lo
Original Assignee
Hon Hai Prec Ind Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hon Hai Prec Ind Co Ltd filed Critical Hon Hai Prec Ind Co Ltd
Priority to TW099136392A priority Critical patent/TW201218093A/en
Priority to US13/034,624 priority patent/US8743192B2/en
Publication of TW201218093A publication Critical patent/TW201218093A/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/197Matching; Classification

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention provides an image capturing device control system. The system is installed in a computer. The system obtains an image captured by a camera of the computer, detects an eyes area in the obtained image using an eyes detection method, compares the detected eyes area with each of preset eyes templates according to a height of the detected eyes area and coordinates of a position of the detected eyes to obtain a matched eyes template. The system further obtains a preset control command corresponding to the matched eyes template, and sends the control command to the image capturing device to adjust a position of the image capturing device, or adjust an angle and focal length of the image capturing device. The present invention can control a movement of an image capturing device according to a status change or a movement of the user's eyes.

Description

201218093 六、發明說明: 【發明所屬之技術領域】 [0001] 本發明涉及一種攝影機裝置控制系統及方法。 【先前技材ΐ】 [0002] 傳統的攝影機裝置在利用軌道系統進行安全監控時,需 要監看人員隨時關注監控場景的畫面,當不明物體(包 括人員)出現在畫面中時,監控人員僅能依靠攝影機裝 置的專屬控制器,手動調整攝影機裝置在轨道系統上的 位置,及攝影機裝置鏡頭的角度和焦距,以取得較為清 晰的物體影像。但是,如果監控人員為行動不便或全身 癱瘓的殘障人士,將無法以手動方式調整攝影機裝置的 拍攝位置與鏡頭角度等參數。 【發明内容】 [0003] [0004] [0005] [0006] 鑒於以上内容,有必要提供一種利用攝影機裝置控制系 統及方法,其可根據監控人員眼球狀態和位置的變化, 自動控制攝影機裝置在轨道系統上移動,並調整攝影機 裝置鏡頭的角度和焦距。 在一個實施方式中,該系統或方法包括如下步驟: 控制電腦獲取攝像頭拍攝的圖像; 利用眼球偵測技術,在獲取的圖像中偵測眼球區域,並 根據該偵測到的眼球區域的高度、眼球位置的座標值, 將偵測到的眼球區域與預先設置的眼球樣本比對,獲取 匹配的眼球樣本;及 獲取預先設置的該匹配到的眼球樣本所對應的控制指令 099136392 表單編號Α0101 第4頁/共27頁 0992063624-f) [0007] 201218093 [0008] [0009] [0010] θ [0011] ο [0012] ,並將該控制指令發送至攝影機裝置,以調整攝影機裝 置的拍攝位置、鏡頭角度與焦距。 前述方法可以由控制電腦執行,其中該控制電腦具有一 個或多個處理器、儲存器以及保存在儲存器中用於執行 這些方法的一個或多個模組、程式或指令集。 用於執行前述方法的指令可以包含在被配置成由一個或 多個處理器執行的程式產品中。 相較於習知技術,所述的攝影機裝置控制系統及方法, 可以根據監控人員眼球狀態和位置的變化,自動控制攝 影機裝置在轨道系統上移動,並調整攝影機裝置鏡頭的 角度和焦距,提高了安全監控工作的效率和精確度。 【實施方式】 參閱圖1所示,係本發明攝影機裝置控制系統較佳實施方 式的應用環境示意圖。在本實施方式中,該攝影機裝置 控制系統24運行於控制電腦2中。該控制電腦2還包括透 過資料匯流排相連的顯示設備20、攝像頭21、輸入設備 22、儲存器23和處理器25。 在本實施方式中,該控制電腦2透過網路3與攝影機裝置4 連接。其中,所述網路3可以是企業内部網路(I η-tranet)或乙太網路(Ethernet),也可以是網際網路 (Internet)或其他類型的通訊網絡。 參閱圖2所示,所述攝影機裝置4安裝於軌道系統6中。在 本實施方式中,所述軌道系統6的類型包括,但不限於, 履帶傳動式、電動滑輪式和攝影機自帶馬達式等致動方 099136392 表單編號A0101 第5頁/共27頁 0992063624-0 [0013] 201218093 [0014] [0015] [0016] [0017] [0018J 099136392 二適二:道系統设置於監控場景的天花板上’或 實=攝影機裝置4移動並取得場景影像的位置。在其他 中。 ⑯裝置4也可以安裝於非軌道系統 =攝影機裝置4包括’但不限於,可由軟體或硬體電路 ^驅動的巡轉臺攝影機、快速球攝影機(細義如 J和可平移(Pan)、傾斜( ΡΤ7 ( 1 U )、縮放(Zoom)的 W (Pan/TiU/Z〇〇ra)攝影機等。 ^攝像頭21用於拍攝用戶的圖像以偵测該用戶的眼球 :域’所述顯示設備2〇用於顯示攝影機她所攝取的圖 所迷輸入設備22用於輸人用戶設置的各種資料。 :斤術續裝置控制系統24用於根據監控人員眼球狀態 t置的變化,自動控制攝影《置在軌道系統上移動 =調整攝影機裝置鏡頭的角度和焦距,具體過程以下 抱述〇 '.V:- . ^本實知方式中’所述攝影機裝置控制系統24可以被分 1成—個或多個模組,所述-個或多個模組被配置成由 1,多個處理器(本實施方式為—個處理器25)執行 ' π成本發明。例如,參閱圖3所示所述攝影機裝置 控制系統24被分割成樣本創建模組2()1、功能設置模組 〇2眼球制模組203和控龍組綱。本發明所稱的 模組是完成—特定功能的程式段比程式更適合於描述 軟體在攝影機裝置2令的執行過程。 參閱圖4所示,係本發明進行系統功能設定的流程圖。 表單編號A0101 第6頁/共27頁 09921 201218093 [0019] [0020] Ο [0021] Ο [0022] 099136392 步驟S10,啟動攝影機ι番 戍戒置4的鏡頭針對 同狀態和位置進行拍攝,*眼球各種不 腦^在本實施方式Η:::括圖 態和眯眼狀態,眼球位置3 狀〜'、盱眼狀 氧匕括上方、下大 、左上方、左下方、右上方和 方、右方 眼球不同位置的圖像是在 可U理解,用戶 _的。 球處於正常狀態下拍攝 梦驟sl1’搜集到—定數量(如10張)的用戶眼球不同狀 態和位置的圖像後,樣本創__根據該用戶眼球= 同狀態和位置的圖像’建立該用戶不同眼球狀態和位置 的樣本。在本實施方式中,所述不同眼球狀態的樣本包 括:正常狀態下的眼球樣本、、睁眼㈣下的眼球樣本和 眯眼狀態下的眼球樣本。 所述不同眼球位置的樣本包括:眼球靜止時的樣本、眼 球向上移動時的樣本、眼球向下移動時的樣本、眼球向 左移動時的樣本、眼球向右移動時的樣本、眼球向左上 移動時的樣本、眼球向左下移動時的樣本、眼球向右上 移動時的樣本、眼球向右下移動時的樣本。 在本實施方式中,先設置正常狀態下的眼球樣本。假設 用戶眼球在正常狀態下的圖像一共有10張’樣本創建模 組2 01計算每張圖像中眼球區域的高度,得到正常狀態下 的眼球區域高度範圍。在本實施方式中,所述眼球區域 是指包圍用戶眼睛範圍的最小矩形區域,正常狀態下的 眼球區域高度範圍為[丨,;[.5],單位為厘米。參閱圖6A 所示,是正常狀態下用戶眼球區域的示意圖’ ABCD代表 表單編號A0101 第7頁/共27頁 0992063624-0 201218093 艮球區域,A為座標原點,H代表該眼球區域的高度,el 代表右眼的座標位置,e2代表左眼的座標位置。 [0023] [0024] [0025] [0026] 以正常狀態下的眼球樣本為參照,可以進一步確定睜眼 狀態下的眼球樣本和眯眼狀態下的眼球樣本確定方法 與刖述正常狀態下的確定方法類似,在此不再贅述。例 如,睁眼狀態下的眼球區域高度範圍為(1. 5,2],眯眼 狀態下的眼球區域高度範圍為[0. 1,n。 然後,可以進—步設置正常狀態下不同眼球位置的樣本 。在本實施方式中,先設置正常狀態下跟球靜止時的樣 本。假設在正常狀態下眼球靜止的圖像一共有1〇張,樣 本創建模組201計算每張圖像中一個眼球位置的座標值, 知·到該用戶眼球位置在靜止時的又軸座標值範圍和γ轴座 標值範圍。以右眼球為例,在本實施方式中,右眼球位 置在靜止時的X轴座標值範圍為[1.8,I〗],γ軸座標值 範圍為[2. 8,3. 2]。 ·.... .....-:......二:. 以眼球位置在靜止時的X軸座標值範圍和γ軸座標值範圍 為參照,可以進一步確定主常狀態下不同移動方向的眼 球樣本,確定方法與前述靜止狀態下的確定方法類似, 在此不再贅述。 舉例而言,眼球向右移動時的右眼球位置的X軸座標值範 圍為[1 ’ 1.8) ’ Y轴座標值範圍為[2.8,3.2];眼球向 上移動時的右眼球位置的X軸座標值範圍為[丨· 8,2. 2] ’ Y軸座標值範圍為[2 ’ 2.8);眼球向右上方移動時的右 眼球位置的X軸座標值範圍為[1,1.8),γ軸座標值範圍 099136392 表單編號Α0101 第8頁/共27頁 0992063624-0 201218093 [0027] [0028] Ο [0029] [0030] ❹ [0031] [0032] 099.136392 為U , 2.8)。 步驟S12,用戶利用功能設置模組2〇2設爹各種類裂的眼 球樣本所對應的控制指令’並將設置的對應關係存儲在 餘存器23中,以對該攝影機敦置4進行控制。 在本實施方式中,在眼球處於正常狀態下時:眼球靜土 時的樣本對應的控制指令為控制攝影機04的键頭處於 靜止狀態’眼球向上移動時(參閱圖额*)的樣本對 應的控制指令為控制攝影機裝置4的沿軌道系統6前移’ 目艮球向下移動時(參閱㈣所示)_本對應的控制指 令為控制攝影機裝置4的沿轨道系統6後移。 眼球向左移動時(參閱圖8A所示)♦樣本對應的控制指 7為控制攝影機襄置4的沿執道系統6在移,眼球向右移 夺(參閱圖8B所示)的樣本對應的雜指令為控制攝 影機裝置4的沿軌道系統6右移。 向左上移動時(參閱圖9A所示)的樣本對應的控制 旨令為控制攝影機_的鏡頭向上移動,眼球向左下移 動時(參閱圖9B所 $)的樣本對應的控制指令為控制攝 影機裝置4的鏡頭向左移動。 眼球向右上移動時r ^ (參閱圓10A所示)的樣本對應的控制 ^為控觸影機|置4的鏡頭向右移動,眼球向 動時(參閲圖1卟所_ 吓不)的樣本對應的控制指令為控制攝 影機裝置4的鏡頭向下移動。 睁眼狀態下(參朗 令為㈣攝f彡所示)⑽球縣對應的控制指 表單編號麵 置4的鏡頭拉遠Out),以調 第9頁/共27頁 201218093 整焦距;眯眼狀態下(參閲圖6C所示)的眼球樣本對應 的控制指令為控制攝影機裝置4的鏡頭拉近(z〇〇m In) ’以調整焦距。 [0033] 在本實施方式中,樣本創建模組201是以一個眼球位置的 X軸座標值範圍和γ柏座梯值範圍來創建不同眼球位置的 樣本。在其他實施方式中,樣本創建模組201也可以根據 兩個眼球位置的X轴座標值範圍和γ軸座標值範圍來創建 不同眼球位置的樣本,方法與一個眼球位置的創建方法 類似,在此不再贅述。 [0034] 參閱圖5所示,係本發明•影機裝置控制方法的較佳實施 方式的流程圖。 [0035] 步驟S20 [0036] [0037] 眼球偵測模組203獲取控制電腦2的攝像頭21 拍攝的圖像。 步職卜眼球制模組2〇3利用眼球價測技術,在獲取 的圖像中_眼球區域’並根據_測到的眼球區域的 尚度、眼球位置的X軸座標值和γ轴座標值,將债測到的 眼球區域與所有眼球樣本比對,獲取匹配的眼球樣本。 在本實施方式巾,眼球_模、 的X軸座標值和γ軸座標值。 =二該:球區域的高度在睁眼狀態下的眼球 η 的w度㈣内’則眼球組2G3獲取睜眼 狀悲下的眼球樣本。如 下的目p技媒士 *β玄眼球£域的高度在目米眼狀態 下的眼球樣本所設置的 〇又範圍内,則眼球偵測模組203 獲取眯眼狀態下的眼球樣本。 099136392 表單編號A0101 第10頁/共27頁 0992063624-0 201218093 士果°亥眼球區域的高度在正常狀態下的眼球樣本所設置 ^度範圍内’則眼球偵測模組2G3進-步獲取該眼球區 域的一個眼球位置(如右眼球)的\軸座標值和γ軸座標 值’根據該眼球位置的1輛座標值和γ轴座標值在不同 眼球位置的樣本中尋找匹配的眼球樣本。在本實施方式 中,所述不同眼球位置的樣本包括:眼球靜止時的樣本 、眼球向上移動時的樣本、眼球向下移動時的樣本、眼 衣向左移動時的樣本、眼球向右移動時的樣本、眼球向 左上移動時的樣本、眼球向左下靜時的樣本眼球向 *上移料的樣本、眼频右.動時的樣本。 ]在本實施方式中,眼球制技術可採取特徵樣本比對( emplate Matching)的識別技術來實現。具體而言, 先取域集大量各式不同的眼球圖像與非眼球圖像以 員神..、里網路訓練方式進行訓練,持續修正錯誤,建立完 。的眼球樣本(Template),单以此樣本作為後續判別 眼球(Testing)的依據β - ί ° 闺步驟奶,控制模組2G4從跡器23中獲取該匹配到的眼 求樣本所對應的控制指令,並透過網路3將該控制指令發 送至攝影機裝置4,以控制攝影機裝置4在軌道系統上移 動、及調整攝影機裝置4鏡頭的角度與焦距等。 _㈣似,攝影機裝置4的信號接收單元接收該控制指令 後,致動單元(如馬達)根據該控制指令調整攝影機裝 置4的拍攝位置、鏡頭角度與焦距。 [_树明是以安全監控領域為例進行說明的,同樣,該方 099J36392 表單編號A0101 0992063624-0 201218093 法也可以應用於其他相關領域,如居家照護、保全監視 等。 [0043] 最後應說明的是,以上實施方式僅用以說明本發明的技 術方案而非限制,儘管參照較佳實施方式對本發明進行 了詳細說明,本領域的普通技術人員應當理解,可以對 本發明的技術方案進行修改或等同替換,而不脫離本發 明技術方案的精神和範圍。 【圖式簡單說明】 [0044] 圖1係本發明攝影機裝置控制系統較佳實施方式的應用環 境示意圖。 [0045] 圖2係攝影機裝置安裝於軌道系統的示意圖。 [0046] 圖3係攝影機裝置控制系統的功能模組圖。 [0047] 圖4係本發明進行系統功能設定的流程圖。 [0048] 圖5係本發明攝影機裝置控制方法的較佳實施方式的流程 圖。 [0049] 圖6(A)至圖6(C)係不同類型的眼球狀態示意圖。 [0050] 圖7(A)和圖7(B)係眼球位置向上、向下移動的示意圖。 [0051] 圖8(A)和圖8(B)係眼球位置向左、向右移動的示意圖。 [0052] 圖9(A)和圖9(B)係眼球位置向左上、向左下移動的示意 圖。 [0053] 圖10(A)和圖10(B)係眼球位置向右上、向右下移動的示 意圖。 099136392 表單編號A0101 第12頁/共27頁 0992063624-0 201218093 【主要元件符號說明】 [0054] 控制電腦:2 [0055] 網路:3201218093 VI. Description of the Invention: [Technical Field of the Invention] [0001] The present invention relates to a camera device control system and method. [Previous technical materials] [0002] When using the track system for security monitoring, the traditional camera device needs to monitor the scene of the monitoring scene at any time. When an unknown object (including personnel) appears in the screen, the monitoring personnel can only By relying on the dedicated controller of the camera device, manually adjust the position of the camera device on the track system, and the angle and focal length of the lens of the camera device to obtain a clear image of the object. However, if the monitor is a person with a disability or a full-body disability, the parameters such as the shooting position and lens angle of the camera unit cannot be manually adjusted. SUMMARY OF THE INVENTION [0003] [0006] In view of the above, it is necessary to provide a camera device control system and method that can automatically control the camera device in orbit according to changes in the state of the eye and the position of the monitor. Move on the system and adjust the angle and focus of the camera unit lens. In one embodiment, the system or method includes the steps of: controlling a computer to acquire an image captured by a camera; and using an eyeball detection technique to detect an eyeball region in the acquired image, and according to the detected eyeball region The coordinate value of the height and the eyeball position, the detected eyeball area is compared with the preset eyeball sample to obtain a matching eyeball sample; and the control instruction corresponding to the matched eyeball sample obtained in advance is obtained. 099136392 Form No. Α0101 Page 4 of 27 pages 0992063624-f) [0007] 201218093 [0008] [0010] ο [0012] ο and the control command is sent to the camera device to adjust the shooting position of the camera device , lens angle and focal length. The foregoing method can be performed by a control computer having one or more processors, memory, and one or more modules, programs, or sets of instructions stored in the memory for performing the methods. Instructions for performing the foregoing methods can be included in a program product configured to be executed by one or more processors. Compared with the prior art, the camera device control system and method can automatically control the camera device to move on the track system according to the change of the eye state and position of the monitor, and adjust the angle and focal length of the camera device lens, thereby improving Safety monitoring work efficiency and accuracy. [Embodiment] Referring to Figure 1, there is shown a schematic diagram of an application environment of a preferred embodiment of a camera device control system of the present invention. In the present embodiment, the camera device control system 24 operates in the control computer 2. The control computer 2 also includes a display device 20, a camera 21, an input device 22, a storage 23, and a processor 25 connected through a data bus. In the present embodiment, the control computer 2 is connected to the camera device 4 via the network 3. The network 3 may be an intranet (Internet) or an Ethernet, or an Internet or other type of communication network. Referring to Figure 2, the camera unit 4 is mounted in a track system 6. In the present embodiment, the type of the rail system 6 includes, but is not limited to, an actuator such as a crawler belt type, an electric pulley type, and a camera self-contained motor type 099136392 Form No. A0101 Page 5 / Total 27 Page 0992063624-0 [0013] [0014] [0016] [0017] [0018J 099136392 two suitable: the track system is set on the ceiling of the surveillance scene' or real = camera device 4 moves and obtains the location of the scene image. Among others. 16 device 4 can also be installed in a non-track system = camera device 4 includes, but is not limited to, a patrol camera that can be driven by a software or hardware circuit, a fast-ball camera (such as J and pan, tilt) ( ΡΤ 7 ( 1 U ), Zoom W (Pan/TiU/Z〇〇ra) camera, etc. ^ Camera 21 is used to capture the user's image to detect the user's eye: domain 'the display device 2〇 used to display the camera, the input device 22 used by the input device is used to input various information set by the user. The charging device control system 24 is used to automatically control the photography according to the change of the eye state of the monitor. Moving on the track system = adjusting the angle and focal length of the lens of the camera device, the specific process is as follows: '.V:-. ^ In the present mode, the camera device control system 24 can be divided into one or one a plurality of modules, the one or more modules being configured to perform a 'π cost invention by 1, more than one processor (the present embodiment is a processor 25). For example, refer to FIG. Camera device control system 24 is segmented into samples Modeling group 2 () 1, function setting module 〇 2 eyeball module 203 and control dragon group. The module referred to in the present invention is completed - the specific function of the program segment is more suitable for describing the software in the camera device than the program The execution process of the second command is shown in Fig. 4. The flow chart of the system function setting is performed by the present invention. Form No. A0101 Page 6 of 27 09921 201218093 [0019] [0020] 002 [0022] 002 [0022] 099136392 In step S10, the lens of the camera ι 戍 戍 4 4 启动 针对 针对 针对 * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * The image of the blinking oxygen, including the upper, lower, upper left, lower left, upper right, and right and right eyeballs, is understood by the user. The ball is in a normal state and the dream is sl1' After collecting images of different states and positions of the user's eyeballs in a fixed number (for example, 10 sheets), the sample creates a sample of the different eye state and position of the user according to the image of the user's eyeball = same state and position. In this embodiment, the The sample of the eyeball state includes: an eyeball sample in a normal state, an eyeball sample in a blinking eye (4), and an eyeball sample in a blinking state. The samples of the different eyeball positions include: a sample when the eyeball is at rest, when the eyeball moves upward The sample, the sample when the eyeball moves downward, the sample when the eyeball moves to the left, the sample when the eyeball moves to the right, the sample when the eyeball moves to the upper left, the sample when the eyeball moves to the lower left, the sample when the eyeball moves to the upper right, The sample when the eyeball moves to the lower right. In the present embodiment, the eyeball sample in the normal state is set first. It is assumed that the image of the user's eyeball in the normal state has a total of 10 samples. The sample creation module 2 01 calculates each image. The height of the middle eyeball region gives the height range of the eyeball region under normal conditions. In the present embodiment, the eyeball region refers to a minimum rectangular region surrounding the user's eye range, and the eyeball region height in the normal state is [丨,; [.5], and the unit is centimeters. Referring to FIG. 6A, it is a schematic diagram of the user's eyeball area under normal conditions. ABCD stands for Form No. A0101 Page 7 of 27 Page 0992063624-0 201218093 The ball area, A is the coordinate origin, and H is the height of the eye area. El represents the coordinate position of the right eye, and e2 represents the coordinate position of the left eye. [0025] [0025] [0025] With the eyeball sample in the normal state as a reference, the method for determining the eyeball sample in the blinking state and the eyeball sample in the blinking state can be further determined and the determination in the normal state is described. The method is similar and will not be described here. For example, the height of the eyeball area in the blinking state is (1. 5, 2), and the height of the eyeball area in the blinking state is [0. 1, n. Then, it is possible to set the different eye positions in the normal state. In the present embodiment, the sample in the normal state and the ball is still set first. Assuming that there are a total of one image in the normal state, the sample creation module 201 calculates one eyeball in each image. The coordinate value of the position, the range of the coordinate value of the axis and the range of the coordinate value of the γ axis when the user's eyeball position is at rest. Taking the right eyeball as an example, in the present embodiment, the X-axis coordinate of the right eyeball position at rest is at rest. The value range is [1.8, I]], and the γ-axis coordinate value range is [2. 8, 3. 2]. ·.... .....-:...Two:. The range of the X-axis coordinate value and the range of the γ-axis coordinate value at rest are referenced, and the eyeball samples of different moving directions in the main normal state can be further determined, and the determination method is similar to the determination method in the static state described above, and will not be described herein. For example, the X-axis of the right eye position when the eyeball moves to the right The range of the standard value is [1 '1.8) 'The range of the Y-axis coordinate value is [2.8, 3.2]; the range of the X-axis coordinate value of the right eyeball position when the eyeball moves up is [丨· 8, 2. 2] ' Y-axis coordinate The value range is [2 ' 2.8); the X-axis coordinate value of the right eyeball position when the eyeball moves to the upper right is [1, 1.8), and the γ-axis coordinate value range is 099136392. Form number Α 0101 Page 8 / Total 27 pages 0992063624 - 0 201218093 [0028] [0030] [0030] [0032] 099.136392 is U, 2.8). In step S12, the user sets the control command corresponding to the various cracked eye samples by the function setting module 2〇2 and stores the set correspondence in the memory 23 to control the camera. In the present embodiment, when the eyeball is in a normal state: the control command corresponding to the sample when the eyeball is in the static state is the control corresponding to the sample that controls the key of the camera 04 to be in a stationary state when the eyeball moves upward (see the figure *) The command is to control the camera device 4 to move forward along the track system 6 when the target ball moves downward (see (4)). The corresponding control command is to control the camera device 4 to move backward along the track system 6. When the eyeball moves to the left (refer to FIG. 8A) ♦ The sample-corresponding control finger 7 is a sample corresponding to the sample that controls the camera device 4 to move along the lane system 6 and shift the eyeball to the right (see FIG. 8B). The miscellaneous command is to control the camera device 4 to move right along the track system 6. The control command corresponding to the sample moving to the upper left (refer to FIG. 9A) is to control the camera lens to move upward, and the control command corresponding to the sample when the eyeball moves to the lower left (refer to FIG. 9B) is to control the camera device 4. The lens moves to the left. When the eyeball moves to the upper right, the control corresponding to the sample of r ^ (refer to circle 10A) is controlled by the touch camera | The lens of the 4 is moved to the right, and when the eyeball moves (see Figure 1 _ 吓 吓 )) The control command corresponding to the sample is to control the downward movement of the lens of the camera device 4. In the blinking state (as shown in (4), f彡) (10) The corresponding control of the ball county refers to the lens with the face number of 4, which is far out), to adjust the 9th page/total 27 pages 201218093, the focal length; The control command corresponding to the eyeball sample in the state (refer to FIG. 6C) is to control the lens of the camera device 4 to zoom in (z〇〇m In)' to adjust the focal length. [0033] In the present embodiment, the sample creation module 201 creates samples of different eyeball positions by using an X-axis coordinate value range of the eyeball position and a gamma cyber range value range. In other embodiments, the sample creation module 201 may also create samples of different eyeball positions according to the X-axis coordinate value range and the γ-axis coordinate value range of the two eyeball positions, in a similar manner to the creation method of an eyeball position. No longer. [0034] Referring to Figure 5, there is shown a flow chart of a preferred embodiment of the method of controlling a video camera device of the present invention. [0035] Step S20 [0037] The eyeball detection module 203 acquires an image captured by the camera 21 of the control computer 2. The step-by-step eyeball module 2〇3 uses the eyeball price measurement technique, in the acquired image _eyeball area' and according to the measured sensation of the eyeball area, the X-axis coordinate value of the eyeball position and the γ-axis coordinate value The eyeball area measured by the debt is compared with all the eyeball samples to obtain a matching eyeball sample. In the present embodiment, the X-axis coordinate value of the eyeball_mode, and the γ-axis coordinate value. = two: the height of the ball area is within the w degree (four) of the eyeball η in the blinking state. Then the eyeball group 2G3 obtains the eyeball sample of the blinking eye. The eyeball detection module 203 acquires an eyeball sample in a blinking state. The eyeball detection module 203 acquires an eyeball sample in a blinking state in the range of the eyeball set by the eyeball sample in the eye-eye state. 099136392 Form No. A0101 Page 10/Total 27 Page 0992063624-0 201218093 The height of the eyeball area is set within the range of the eyeball sample under normal conditions. Then the eyeball detection module 2G3 takes the eyeball in step-by-step. The \axis coordinate value and the γ-axis coordinate value of one eyeball position of the region (such as the right eyeball) are searched for matching eyeball samples in samples of different eyeball positions according to the one coordinate value of the eyeball position and the γ-axis coordinate value. In the present embodiment, the samples of the different eyeball positions include: a sample when the eyeball is stationary, a sample when the eyeball moves upward, a sample when the eyeball moves downward, a sample when the eyewear moves to the left, and when the eyeball moves to the right. The sample, the sample when the eyeball moves to the upper left, the sample to which the eyeball moves to the left when the eyeball is left, and the sample with the right eye and the right eye. In the present embodiment, the eyeball technology can be implemented by an identification technique of emplate matching. Specifically, firstly, a large number of different eyeball images and non-eyeball images of the domain set are trained in the network training mode, and the error is continuously corrected and established. The eyeball sample (Template), using this sample as the basis for the subsequent discrimination of the eyeball (Testing), the control module 2G4 obtains the control instruction corresponding to the matched eye sample from the tracker 23 The control command is transmitted to the camera device 4 via the network 3 to control the movement of the camera device 4 on the track system, and to adjust the angle and focal length of the lens of the camera device 4. _(d), after the signal receiving unit of the camera device 4 receives the control command, the actuating unit (e.g., motor) adjusts the shooting position, lens angle, and focal length of the camera device 4 in accordance with the control command. [_ Shuming is explained by taking the security monitoring field as an example. Similarly, the party 099J36392 form number A0101 0992063624-0 201218093 can also be applied to other related fields, such as home care, security monitoring, and so on. [0043] It should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention and are not intended to be limiting, and the present invention will be described in detail with reference to the preferred embodiments. The technical solutions are modified or equivalently substituted without departing from the spirit and scope of the technical solutions of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS [0044] FIG. 1 is a schematic diagram of an application environment of a preferred embodiment of a camera device control system of the present invention. 2 is a schematic view of a camera device mounted on a track system. [0046] FIG. 3 is a functional block diagram of a camera device control system. 4 is a flow chart of system function setting performed by the present invention. 5 is a flow chart of a preferred embodiment of a method of controlling a camera device of the present invention. 6(A) to 6(C) are schematic diagrams of different types of eyeball states. 7(A) and 7(B) are schematic views of the eyeball position moving up and down. 8(A) and 8(B) are schematic diagrams showing the movement of the eyeball position to the left and right. 9(A) and 9(B) are schematic views showing the movement of the eyeball position to the upper left and lower left. 10(A) and 10(B) are diagrams showing the movement of the eyeball position to the upper right and to the lower right. 099136392 Form No. A0101 Page 12 of 27 0992063624-0 201218093 [Main component symbol description] [0054] Control computer: 2 [0055] Network: 3

[0056] 攝影機裝置:4 [0057] 軌道系統:6 [0058] 顯示設備:20 [0059] 攝像頭:21 [0060] 輸入設備:2 2 [0061] 儲存器:23 [0062] 攝影機裝置控制系統:24 [0063] 處理器:25 [0064] 樣本創建模組: 201 [0065] 功能設置模組: 202 [0066] 眼球偵測模組: 203 [0067] 控制模組:204 099136392 表單編號A0101 第13頁/共27頁 0992063624-0[0056] Camera device: 4 [0057] Track system: 6 [0058] Display device: 20 [0059] Camera: 21 [0060] Input device: 2 2 [0061] Memory: 23 [0062] Camera device control system: 24 [0063] Processor: 25 [0064] Sample Creation Module: 201 [0065] Function Setting Module: 202 [0066] Eye Detection Module: 203 [0067] Control Module: 204 099136392 Form No. A0101 No. 13 Page / Total 27 pages 0992063624-0

Claims (1)

201218093 七、申請專利範圍: 1 · 一種攝影機裝置控制方法,其中,該方法包括如下步驟: 控制電腦獲取攝像頭拍攝的圖像; 利用目艮球偵測技術’在獲取的圖像中偵測眼球區域,並根 據該偵測到的眼球區域的高度、眼球位置的座標值,將偵 測到的眼球區域與預先設置的眼球樣本比對,獲取匹配的 眼球樣本;及 獲取預先設置的該匹配到的眼球樣本所對應的控制指令, 並將該控制指令發送至攝影機裝置,以調整攝影機裝置的 拍攝位置、鏡頭角度與焦距。 2 .如申請專利範圍第上項所述之攝影機裝置控制方法,其中 ,所述預先設置的眼球樣本包括不同眼球狀態的樣本和不 同眼球位置的樣本。 3 .如申請專利範圍第2項所述之攝影機裝置控制方法,其中 ’所述不同眼球狀態的樣本包括:正常狀態下的眼球樣本 、睁眼狀態下的眼球樣本和辟娘狀態下的眼球樣本; 所述不同眼球位置的樣本包括:眼球靜止時的樣本眼球 向上移動時的樣本、眼球向下移動時的樣本、眼球向左移 動時的樣本、眼球向右移動時的樣本、眼球向左上移動時 的樣本、眼球向左下移動時的樣本、眼球向右上移動時的 樣本、眼球向右下移動時的樣本。 4 .如申請專利範圍第3項所述之攝影機裝置控制方法其中 ,所述獲取匹配的眼球樣本的步驟包括: 如果該眼球區域的高度在睁眼狀態下的眼球樣本所設置的 高度範圍内,則獲取睜眼狀態下的眼球樣本; 099136392 表單編號A0101 第】4頁/共27頁 0992063624-0 201218093 ^果該眼球區域的高度在眯眼狀態下的眼球樣本所設置的 局度範圍内,則獲取眯眼狀態下的眼球樣本; =果該眼球區域的高度在正常狀態下的眼球樣本所設置的 高度範圍内’則根據該眼球區域的眼球位置的X軸座標值 和Y轴座標值’在不同眼球位置的樣本中尋找匹配的眼球 樣本。 5 . —種控制攝影機裝置的電腦 測,其中,該電腦包括: 儲存器; 用於對監控物件進行動態偵 Ο 一個或多個處理器;以及 :個或多個模組,所述一個或多個模組被存儲在所述儲存 器中並被配置成由所述—個或多個處理器執行,所述一個 或多個模組包括: t . 眼球该測模組,用於獲取與電腦相連的攝像翻攝的圖像201218093 VII. Patent application scope: 1 · A camera device control method, wherein the method comprises the following steps: controlling a computer to obtain an image taken by a camera; using a target ball detection technology to detect an eyeball region in the acquired image And matching the detected eyeball area with the preset eyeball sample according to the detected height of the eyeball area and the coordinate value of the eyeball position to obtain a matching eyeball sample; and obtaining the matched set of the preset The control command corresponding to the eyeball sample is sent to the camera device to adjust the shooting position, lens angle and focal length of the camera device. 2. The camera device control method according to the above aspect of the invention, wherein the pre-set eyeball sample comprises a sample of different eyeball states and a sample of different eyeball positions. 3. The camera device control method according to claim 2, wherein the sample of the different eyeball states comprises: an eyeball sample in a normal state, an eyeball sample in a blinking state, and an eyeball sample in a parental state. The samples of the different eyeball positions include: a sample when the eyeball is moving when the eyeball is stationary, a sample when the eyeball moves downward, a sample when the eyeball moves to the left, a sample when the eyeball moves to the right, and an eyeball moving to the left. The sample at the time, the sample when the eyeball moves to the lower left, the sample when the eyeball moves to the upper right, and the sample when the eyeball moves to the lower right. 4. The camera device control method according to claim 3, wherein the step of acquiring a matching eyeball sample comprises: if the height of the eyeball region is within a height range set by the eyeball sample in a blink state, Obtain an eyeball sample in a blinking state; 099136392 Form No. A0101 No. 4 Page/Total 27 Page 0992063624-0 201218093 ^The height of the eyeball area is within the range of the eyeball sample set in the blink state, then Obtaining an eyeball sample in a blinking state; = the height of the eyeball region is within the height range set by the eyeball sample under normal conditions, 'based on the X-axis coordinate value and the Y-axis coordinate value of the eyeball position of the eyeball region' Find matching eyeball samples in samples of different eye positions. 5 . A computer test for controlling a camera device, wherein the computer comprises: a storage device; configured to dynamically detect the monitored object; one or more processors; and: one or more modules, the one or more Modules are stored in the storage and configured to be executed by the one or more processors, the one or more modules comprising: t. an eyeball module for acquiring and a computer Connected camera flipped image 所述眼球债測模組,還用於利用眼球制技術,在獲取的 圖象中4貞測眼球區域,並根據該债測到的眼球區域的高度 眼球位置的座縣,將債_的眼球區域與預先設置的 眼球樣本比對’獲取匹配的眼球樣本;及 模用於從儲存器中獲取預先設置的該匹配到的眼 本所對應的控制指令,並將該控制指令發送至攝影機 乂調正攝影機裝置的拍攝位置、鏡頭角度與焦距。 •如申凊專利範11第5項所述之電腦,其中,所述__個或多 個模組還包括: 099136392 #本創建模組1於獲取攝影機裝置的鏡頭針對用戶眼球 各種不同狀態和仅置拍攝的圖像 ,根據該用戶眼球不同狀 表單編號AQ101 油 ^ 第15頁/共27頁 0992063624-0 201218093 態和位置的圖像,建立該用戶 不同眼球狀態和位置的樣本The eyeball debt measurement module is also used to utilize the eyeball technology to measure the eyeball area in the acquired image, and according to the height of the eyeball area of the eyeball area, the county is in charge of the eyeball. The area is compared with a preset eyeball sample to obtain a matching eyeball sample; and the mode is used to obtain a preset control command corresponding to the matched eyebook from the storage, and send the control command to the camera to adjust The shooting position, lens angle and focal length of the positive camera unit. The computer of claim 5, wherein the __ or modules further include: 099136392 #本制作模块1 is for acquiring a lens of a camera device for various states of the user's eyeball and Only the image taken, according to the user's eyeball different form number AQ101 oil ^ page 15 / a total of 27 pages 0992063624-0 201218093 state and position of the image, establish a sample of the user's different eye state and position 如申請專利範圍第5項所述之電腦’其中,所述一個或多 個模組還包括: 功能設置模組,用於設置各種類型的眼球樣本所對應的控 制指令,並將設置的對應關係存儲在儲存器中。 8.如申請專利範圍第5項所述之電腦,其中,所述預先設置 麟球樣本包括不同眼球狀態的樣本和不同眼球位置的樣 本。 9 ·如申請專利範圍第8項所述之電腦,其中,所述不同眼球 狀態的樣本包括:正常狀態下的眼球樣本、睁眼狀態下的 眼球樣本和眯眼狀態下的眼球樣本; 所述不同眼球位置的樣本包括:眼球靜止時的樣本、眼球 向上移動時的樣本、眼球向下移動時的樣本、眼球向左移 動時的樣本、眼球向右移動時的樣本、眼球向左上移動時 的樣本、眼球向左下移動時的樣本、眼球向右上移動時的 樣本、眼球向右下移動時的樣本。 10 .如申請專利範圍第9項所述之電腦,其中,所述眼球偵測 模組獲取匹配的眼球樣本包括: 如果該眼球區域的高度在睜眼狀態下的眼球樣本所設置的 高度範圍内’則獲取睁眼狀態下的眼球樣本; 如果該眼球區域的高度在眯眼狀態下的眼球樣本所設置的 高度範圍内’則獲取眯眼狀態下的眼球樣本; 如果該眼球區域的高度在正常狀態下的眼球樣本所設置的 高度範圍内,則根據該眼球區域的眼球位置的χ袖座標值 和Y軸座標值’在不同眼球位置的樣本中尋找匹配的眼球 099136392 表單編號A0101 第16頁/共27頁 0992063624-0 201218093樣本。 Ο 099-136392 表單編號Α0101 第17頁/共27頁 0992063624-0The computer of claim 5, wherein the one or more modules further comprise: a function setting module, configured to set control instructions corresponding to various types of eyeball samples, and set the corresponding relationship Stored in the storage. 8. The computer of claim 5, wherein the pre-set lining sample comprises samples of different eye states and samples of different eye positions. 9. The computer of claim 8, wherein the sample of the different eyeball states comprises: an eyeball sample in a normal state, an eyeball sample in a blink state, and an eyeball sample in a blink state; Samples of different eyeball positions include: a sample when the eyeball is still, a sample when the eyeball moves upward, a sample when the eyeball moves downward, a sample when the eyeball moves to the left, a sample when the eyeball moves to the right, and a case where the eyeball moves to the upper left The sample, the sample when the eyeball moves to the lower left, the sample when the eyeball moves to the upper right, and the sample when the eyeball moves to the lower right. 10. The computer of claim 9, wherein the eyeball detection module acquires a matching eyeball sample comprising: if the height of the eyeball region is within a height range set by the eyeball sample in a blink state 'According to the eyeball sample in the blinking state; if the height of the eyeball region is within the height range set by the eyeball sample in the blinking state', the eyeball sample in the blinking state is obtained; if the height of the eyeball region is normal In the height range set by the eyeball sample in the state, the matching eyeball is found in the sample of the different eyeball position according to the occipital coordinate value and the Y-axis coordinate value of the eyeball position of the eyeball region. 099136392 Form No. A0101 Page 16/ A total of 27 pages 0992063624-0 201218093 samples. Ο 099-136392 Form No. Α0101 Page 17 of 27 0992063624-0
TW099136392A 2010-10-25 2010-10-25 System and method for controlling an image capturing device TW201218093A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW099136392A TW201218093A (en) 2010-10-25 2010-10-25 System and method for controlling an image capturing device
US13/034,624 US8743192B2 (en) 2010-10-25 2011-02-24 Electronic device and image capture control method using the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW099136392A TW201218093A (en) 2010-10-25 2010-10-25 System and method for controlling an image capturing device

Publications (1)

Publication Number Publication Date
TW201218093A true TW201218093A (en) 2012-05-01

Family

ID=45972707

Family Applications (1)

Application Number Title Priority Date Filing Date
TW099136392A TW201218093A (en) 2010-10-25 2010-10-25 System and method for controlling an image capturing device

Country Status (2)

Country Link
US (1) US8743192B2 (en)
TW (1) TW201218093A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI756522B (en) * 2018-03-20 2022-03-01 日商日本電氣股份有限公司 Input/output device, screen control device, screen control method and recording medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6794895B2 (en) * 2017-03-28 2020-12-02 カシオ計算機株式会社 Electronic devices, location identification systems, location identification methods and programs
CN112022642B (en) * 2020-09-16 2023-01-10 杭州集视智能科技有限公司 Edge visual field training equipment and training method based on visual field center damage

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6154559A (en) * 1998-10-01 2000-11-28 Mitsubishi Electric Information Technology Center America, Inc. (Ita) System for classifying an individual's gaze direction
US6757422B1 (en) * 1998-11-12 2004-06-29 Canon Kabushiki Kaisha Viewpoint position detection apparatus and method, and stereoscopic image display system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI756522B (en) * 2018-03-20 2022-03-01 日商日本電氣股份有限公司 Input/output device, screen control device, screen control method and recording medium
US11475715B2 (en) 2018-03-20 2022-10-18 Nec Corporation Input/output device, screen control device, and screen control method

Also Published As

Publication number Publication date
US8743192B2 (en) 2014-06-03
US20120098966A1 (en) 2012-04-26

Similar Documents

Publication Publication Date Title
EP3293620B1 (en) Multi-screen control method and system for display screen based on eyeball tracing technology
EP3308325B1 (en) Liveness detection method and device, and identity authentication method and device
US9154739B1 (en) Physical training assistant system
US10496159B2 (en) User input processing with eye tracking
CN109690553A (en) The system and method for executing eye gaze tracking
KR101533686B1 (en) Apparatus and method for tracking gaze, recording medium for performing the method
CN109446947A (en) The face recognition of enhancing in video
KR20170103931A (en) Image identification system and identification method
WO2020000912A1 (en) Behavior detection method and apparatus, and electronic device and storage medium
TW201218093A (en) System and method for controlling an image capturing device
CN104063041B (en) A kind of information processing method and electronic equipment
WO2018121730A1 (en) Video monitoring and facial recognition method, device and system
US20190369807A1 (en) Information processing device, information processing method, and program
CN206331472U (en) A kind of interactive robot based on Face datection
WO2022247067A1 (en) Intelligent eye examination method, device and system
US9392223B2 (en) Method for controlling visual light source, terminal, and video conference system
JP4568024B2 (en) Eye movement measuring device and eye movement measuring program
Heng et al. Analysis of performance between Kinect v1 and Kinect v2 for various facial part movements
JP2019153986A (en) Monitoring system, management apparatus, monitoring method, computer program, and storage medium
McMurrough et al. Low-cost head position tracking for gaze point estimation
CN102457670B (en) camera device control system and method
US20230132986A1 (en) Information processing apparatus, information processing method, and program
Almira et al. Mimicking 2-DOF Human Eye Movement using an IR Camera-Based Wearable Eye-Gaze Tracking Controller
CN108319372A (en) A kind of virtual unit and method
Panev et al. Improved multi-camera 3D eye tracking for human-computer interface