TWI395144B - Method of eye sight judgment - Google Patents
Method of eye sight judgment Download PDFInfo
- Publication number
- TWI395144B TWI395144B TW97123813A TW97123813A TWI395144B TW I395144 B TWI395144 B TW I395144B TW 97123813 A TW97123813 A TW 97123813A TW 97123813 A TW97123813 A TW 97123813A TW I395144 B TWI395144 B TW I395144B
- Authority
- TW
- Taiwan
- Prior art keywords
- pupil
- eye
- eyelid
- image
- signal
- Prior art date
Links
Landscapes
- Studio Devices (AREA)
- Image Analysis (AREA)
Description
本發明係關於一種眼睛視線判斷的方法，特別是一種眼睛視線是否注視前方的判斷方法。 The present invention relates to a method for judging eye gaze, and more particularly to a method for judging whether an eye line of sight is looking ahead.
目前數位相機愈來愈普及，幾乎人手一台。而各大數位相機廠商分別推出不同造型及功能訴求的相機，讓消費者能夠依據個人的需求去選購。 At present, digital cameras are becoming more and more popular, almost one person. And the major digital camera manufacturers have launched different cameras with different styling and function requirements, so that consumers can purchase according to individual needs.
現在的數位相機，具有之基本功能極為類似，從光圈大小、光學變焦、數位變焦、開機速率、記憶卡容量支援度，以及防手振等功能。每一家廠商無不積極的開發新功能來滿足消費者的慾望，而一般消費者最常用的攝影模式，不外乎是人像拍攝。因此，有廠商推出了具有人臉辨識功能的相機，係自動將螢幕中所有的人臉辨識出來，並取得最佳的拍攝焦距，再搭配最合適之光圈及快門，使拍攝者能夠輕輕鬆鬆拍到清晰的照片。 Today's digital cameras have very similar basic functions, from aperture size, optical zoom, digital zoom, boot rate, memory card capacity support, and anti-shake. Every manufacturer has actively developed new features to satisfy consumers' desires, and the most common photography mode used by consumers is nothing more than portrait shooting. Therefore, some manufacturers have introduced a camera with face recognition function, which automatically recognizes all the faces in the screen and achieves the best shooting focal length, together with the most suitable aperture and shutter, making it easy for the photographer. Take a clear picture.
然而，在拍攝人物相片時，被拍攝者的眼神對照片拍攝的好壞佔有很大的比重。因此，拍攝者需要額外注意每位被拍攝者之眼睛是否注視著前方之鏡頭，如此拍攝出來的照片才會較有美感。當被拍攝者之數量較少時，拍攝者可藉由相機之液晶螢幕或直接以目視之方式注意被拍攝者之視線。若被拍攝者之視線不是注視著前方之鏡頭時，拍攝者再以口頭喊話告知被拍攝者。但若是拍團體照時，拍攝者就無法兼顧每位被拍攝者之視線，若有少數人之視線沒有注視前方之鏡頭，即會破壞美感。另一方面，如 果相機之液晶螢幕較小，拍攝者也不容易從相機之液晶螢幕發現是否有少部分人的視線是在注視著別的地方。 However, when taking a photo of a person, the subject's eyes have a large proportion to the quality of the photo. Therefore, the photographer needs to pay extra attention to whether the eyes of each of the photographers are looking at the lens in front, so that the photos taken will be more beautiful. When the number of photographers is small, the photographer can pay attention to the subject's line of sight by means of the camera's LCD screen or directly in a visual manner. If the subject's line of sight is not looking at the lens in front, the photographer then utters a verbal message to inform the subject. However, if a group photo is taken, the photographer cannot take into account the line of sight of each photographer. If a few people do not look at the lens in front, they will destroy the beauty. On the other hand, like If the LCD screen of the camera is small, it is not easy for the photographer to find out from the LCD screen of the camera whether a small number of people are watching other places.
鑒於上述習知技術的問題，本發明提供一種眼睛視線判斷的方法。藉以改良習知技術中，若是拍攝者無法直接以目視之方法或從相機之液晶螢幕找出被拍攝者之視線未注意前方之鏡頭，並予以告知的話，將造成拍攝出來的照片較不美觀的問題。 In view of the above problems of the prior art, the present invention provides a method of eye line of sight determination. In order to improve the conventional technology, if the photographer cannot directly visually find out the camera's line of sight and pay attention to the lens in front of the camera's LCD screen, and will inform, the resulting photo will be less beautiful. problem.
根據本發明所揭露之眼睛視線判斷的方法，係應用於攝像裝置拍攝人像時，自動進行偵測人像之眼睛視線是否注視前方之攝像裝置。攝像裝置包括攝像單元。 The method for determining the eyesight of the eye according to the present invention is applied to an image capturing apparatus that detects whether the eye line of the portrait is looking at the front when the portrait is taken by the image capturing apparatus. The imaging device includes an imaging unit.
首先，由攝像單元取得欲拍攝之人像影像。接著，由人像影像中，利用輪廓比對之方式分析出被拍攝者之眼睛區塊。再透過眼睛區塊之資訊，得到包括瞳孔及眼眶的眼部特徵。經過眼部特徵之比對，可以得到有關於眼部特徵的特徵比例。根據特徵比例即可以判斷眼睛視線注視之方向。 First, the portrait image to be captured is acquired by the imaging unit. Next, from the portrait image, the subject's eye block is analyzed by the contour comparison method. Through the information of the eye block, the eye features including the pupil and the eyelid are obtained. Through the comparison of the eye features, a feature ratio with respect to the eye features can be obtained. According to the feature ratio, the direction of eye gaze can be judged.
其中，用以判斷眼睛視線注視之方向係利用眼部特徵中的特徵比例。特徵比例的計算方法包括下列步驟：從畫面中的每一個臉部區塊中，擷取出包括瞳孔和眼眶的眼睛特徵。再分析同一個臉部區塊中，瞳孔和眼眶之間的相對距離，再根據瞳孔半徑特定百分比所得到之差異值，計算出特徵比例。 Among them, the direction for judging eye gaze gaze utilizes the feature ratio in the eye features. The method of calculating the feature ratio includes the steps of extracting eye features including the pupil and the eyelid from each of the face blocks in the picture. Then analyze the relative distance between the pupil and the eyelid in the same face block, and then calculate the feature ratio according to the difference value obtained from the specific percentage of the pupil radius.
而瞳孔和眼眶之間的相對距離之分析包括下列步驟：分別分析出瞳孔中心點和眼眶中心點的位置，再計算瞳孔中心點之位置和眼眶中心點之位置之間的距離。計算出之距離即代表瞳孔和眼 眶之間的相對距離。 The analysis of the relative distance between the pupil and the eyelid includes the following steps: respectively analyzing the position of the pupil center point and the eyelid center point, and then calculating the distance between the pupil center point position and the position of the eyelid center point. The calculated distance represents the pupil and the eye The relative distance between 眶.
根據特徵比例來判斷瞳孔位於眼眶的位置之判定包括下列步驟：相對距離與差異值相減之值小於零，特徵比例即為負數。相對距離與差異值相減之值大於零，特徵比例即為正數。如果特徵比例為負數，則判定瞳孔是位於眼眶的中心位置，即代表眼睛視線注視著前方。如果相對距離大於差異值，則判定瞳孔不是位於眼眶的中心位置，即代表眼睛不是注視著前方。 The determination of determining the position of the pupil at the eyelid according to the feature ratio includes the following steps: the value of the relative distance subtracted from the difference value is less than zero, and the feature ratio is a negative number. The value of the relative distance and the difference value is greater than zero, and the feature ratio is a positive number. If the feature ratio is negative, it is determined that the pupil is located at the center of the eyelid, that is, the eye of the eye is looking ahead. If the relative distance is greater than the difference value, it is determined that the pupil is not at the center of the eyelid, that is, the eye is not looking at the front.
經過特徵比例判定後，瞳孔位於眼眶的中心位置時，攝像裝置會產生提示訊號。使拍攝者發覺提示訊號後，了解被拍攝者的眼睛視線皆注視著攝像裝置後，即可進行拍照。反之，經過判定後，瞳孔不是位於眼眶的中心位置時，攝像裝置也會產生警示訊號。使拍攝者發覺警示訊號後，了解被拍攝者的眼睛視線並非全部注視著攝像裝置。拍攝者即可以告知被拍攝者請注視著攝像裝置，待攝像裝置產生提示訊號後，即可以進行拍照。 After the feature ratio is determined, when the pupil is located at the center of the eyelid, the camera device generates a prompt signal. After the photographer detects the prompt signal, the camera can be photographed after knowing that the subject's eyes are looking at the camera. On the contrary, after the judgment, when the pupil is not at the center of the eyelid, the camera device will also generate a warning signal. After the photographer is alerted to the warning signal, it is understood that the subject's eyesight is not all looking at the camera. The photographer can inform the photographer to look at the camera, and the camera can take a picture after the camera generates a signal.
本發明所揭露之眼睛視線判斷的方法，係透過畫面擷取被拍攝者的臉部區塊後，分析出臉部區塊中的眼部特徵，再利用眼部特徵換算出特徵比例，即可以判斷眼睛視線所注視之方向。而攝像裝置根據判斷結果，發出提示訊號或警示訊號。因此，拍攝者不用一一目視被拍攝者之視線，或從相機之液晶螢幕找出注視著別方的被拍攝者，能夠直接輕輕鬆鬆地拍攝出一張被拍攝者皆注視著攝像裝置的照片。 The method for determining the line of sight of the eye disclosed by the present invention is to extract the face feature of the face of the subject through the screen, and then analyze the feature of the eye in the face block, and then use the feature of the eye to convert the feature ratio, that is, Determine the direction in which the eye's line of sight is looking. The camera device sends a prompt signal or a warning signal according to the judgment result. Therefore, the photographer does not have to look at the subject's line of sight one by one, or find out from the camera's LCD screen that the other person is watching the other party, and can directly and easily photograph a photographer who is watching the camera. photo.
以上之關於本發明內容之說明及以下之實施方式之說明係用以示範與解釋本發明之精神與原理，並且提供本發明之專利申請 範圍更進一步之解釋。 The above description of the present invention and the following description of the embodiments are intended to illustrate and explain the spirit and principles of the present invention, and to provide the patent application of the present invention. Further explanation of the scope.
以下在實施方式中詳細敘述本發明之詳細特徵以及優點，其內容足以使任何熟習相關技藝者了解本發明之技術內容並據以實施，且根據本說明書所揭露之內容、申請專利範圍及圖式，任何熟習相關技藝者可輕易地理解本發明相關之目的及優點。以下之實施例係進一步詳細說明本發明之觀點，但非以任何觀點限制本發明之範疇。 The detailed features and advantages of the present invention are set forth in the Detailed Description of the Detailed Description of the <RTIgt; </ RTI> <RTIgt; </ RTI> </ RTI> </ RTI> <RTIgt; The objects and advantages associated with the present invention can be readily understood by those skilled in the art. The following examples are intended to describe the present invention in further detail, but are not intended to limit the scope of the invention.
根據本發明所揭露之眼睛視線判斷的方法，係可應用於攝像裝置。此攝像裝置可為數位相機(Digital Camera)、行動電話(Mobile Phone)、個人數位助理(Personal Digital Assistant，PDA)、智慧型行動電話(PDA phone、Smart phone)、口袋型電腦(Pocket PC)或掌上型電腦(Hand-held PC)等電子資料處理裝置上的攝像元件。此攝像裝置用以進行影像之擷取及儲存。 The method for determining the eyesight of the eye according to the present invention is applicable to an image pickup apparatus. The camera device can be a digital camera, a mobile phone, a personal digital assistant (PDA), a smart phone (PDA phone, a smart phone), a pocket computer (Pocket PC) or An imaging element on an electronic data processing device such as a Hand-held PC. The camera device is used for capturing and storing images.
請參閱「第1圖」，其係為根據本發明一實施例之眼睛視線判斷方法的流程圖。如「第1圖」所示，根據本發明之眼睛視線判斷方法係透過攝像裝置之攝像單元所擷取的畫面，進行影像分析判斷，以取得視線注視之方向判定。 Please refer to FIG. 1 , which is a flowchart of an eye line of sight determination method according to an embodiment of the present invention. As shown in FIG. 1, the eyesight determination method according to the present invention performs image analysis determination through the screen captured by the imaging unit of the imaging device to obtain the direction of the line of sight gaze.
首先，透過攝像單元取得影像(步驟S10)。攝像單元係為鏡頭，通常由一塊或是多塊光學玻璃組成，用來接收欲拍攝物的光線。攝像單元所接收到的光線再由攝像裝置將其轉換為影像顯示於攝像裝置之液晶螢幕上。接下來，利用輪廓比對之方式從影像中分析出眼睛區塊(步驟S11)。在所得到影像中，通常是包含各 式各樣的畫面。因此，需要利用輪廓比對之方式，從畫面影像中找出人臉區塊，再由人臉區塊中比對出眼睛區塊，以利於之後的視線判斷。分析出眼睛區塊中的眼部特徵(步驟S12)。比對出眼睛區塊後，再透過眼睛區塊的畫面再分析出眼部特徵。眼部特徵包括瞳孔和眼眶。 First, an image is acquired by the imaging unit (step S10). The camera unit is a lens, usually composed of one or more pieces of optical glass, for receiving light from a subject. The light received by the camera unit is converted into an image by the camera to be displayed on the liquid crystal screen of the camera. Next, the eye block is analyzed from the image by the contour comparison method (step S11). In the resulting image, usually contains each A variety of pictures. Therefore, it is necessary to use the contour comparison method to find the face block from the screen image, and then compare the eye block in the face block to facilitate the subsequent line of sight judgment. The eye features in the eye block are analyzed (step S12). After comparing the eye blocks, the eye features are analyzed through the image of the eye block. Eye features include pupils and eyelids.
接著，從眼部特徵計算瞳孔和眼眶的相對距離並依據瞳孔半徑算出差異值(步驟S13)。舉例來說，可分別分析瞳孔的中心點及眼眶中心點的位置。眼眶之中心點係利用眼眶兩角之距離來決定其中心點位置。瞳孔的中心點則可藉由偵測瞳孔輪廓後，透過分析瞳孔輪廓而得到。得到瞳孔中心點及眼眶中心點的位置之後，即可計算出瞳孔中心點及眼眶中心點之間的相對距離。再利用瞳孔輪廓計算出瞳孔的半徑後，根據瞳孔半徑的特定百分比可以算出差異值。 Next, the relative distance between the pupil and the eyelid is calculated from the eye feature and the difference value is calculated from the pupil radius (step S13). For example, the center point of the pupil and the position of the center point of the eyelid can be separately analyzed. The center point of the eyelid uses the distance between the two corners of the eyelid to determine the center point position. The center point of the pupil can be obtained by analyzing the pupil contour after detecting the pupil contour. After obtaining the position of the pupil center point and the eyelid center point, the relative distance between the pupil center point and the eyelid center point can be calculated. After calculating the radius of the pupil using the pupil contour, the difference value can be calculated according to a certain percentage of the pupil radius.
之後，根據相對距離與差異值之值，計算出特徵比例(步驟S14)。若是相對距離與差異值相減之值小於零，特徵比例即為負數。若是相對距離與差異值相減之值大於零，特徵比例即為正數。根據特徵比例判斷瞳孔位於眼眶的位置(步驟S15)。如果特徵比例為負數，判定瞳孔位於眼眶之中央位置。如果特徵比例為正數，判定瞳孔不位於眼眶之中央位置，即在中央位置外。 Thereafter, the feature ratio is calculated based on the values of the relative distance and the difference value (step S14). If the relative distance and the difference value are less than zero, the feature ratio is negative. If the value of the relative distance and the difference value is greater than zero, the feature ratio is a positive number. It is judged based on the feature ratio that the pupil is located at the eyelid (step S15). If the feature ratio is negative, it is determined that the pupil is at the center of the eyelid. If the feature ratio is positive, it is determined that the pupil is not located at the center of the eyelid, that is, outside the center position.
最後，依據瞳孔所在眼眶之位置，以判定視線是否注視前方，若判定注視前方，產生提示訊號，若判定不是注視前方，產生警示訊號(步驟S16)。若是經過特徵比例之判定，瞳孔所在位置位於眼眶的中央位置，即判定視線注視著前方之攝像裝置。隨即產 生提示訊號，提示訊號係為文字訊號或聲音訊號。若是經過特徵比例之判定，瞳孔所在位置不是位於眼眶的中央位置，即判定視線不注視著前方，而是朝其他方向注視。隨即產生警示訊號於影像上，警示訊號係為聲音訊號或畫面訊號。 Finally, depending on the position of the eyelid where the pupil is located, it is determined whether the line of sight is looking at the front, and if it is determined that the front is gazing forward, a warning signal is generated, and if it is determined that the front is not looking at the front, a warning signal is generated (step S16). If the feature ratio is judged, the position of the pupil is located at the center of the eyelid, that is, the line of sight is determined to be in front of the camera. Immediate production A prompt signal is generated, and the prompt signal is a text signal or an audio signal. If it is judged by the characteristic ratio, the position of the pupil is not located at the center of the eyelid, that is, it is determined that the line of sight does not look at the front, but looks at the other direction. A warning signal is generated on the image, and the warning signal is an audio signal or a picture signal.
以下為本發明之實施例，請參閱「第2圖」。利用攝像裝置拍攝團體照時，透過攝像單元得到影像20，影像20中包含數位被拍攝者200。接著從被拍攝者200中，採用輪廓比對之方式分析出被拍攝者200的人臉後，再由人臉比對出眼睛區塊30(如「第3A圖」所示)。接著，從眼睛區塊30中，同樣利用輪廓比對之方式比對出眼眶31及瞳孔32。 The following is an embodiment of the present invention, please refer to "Figure 2". When a group photo is taken by the imaging device, the image 20 is obtained by the imaging unit, and the image 20 includes the digital subject 200. Next, from the subject 200, the face of the subject 200 is analyzed by contour matching, and then the face block 30 is displayed by the face (as shown in "Fig. 3A"). Next, from the eye block 30, the eyelids 31 and the pupils 32 are aligned by the contour comparison.
請參閱「第3B圖」，從眼睛區塊30中，比對出眼眶31及瞳孔32後，計算出眼眶中心點311及瞳孔中心點321的位置。從眼眶中心點311及瞳孔中心點321的位置可以得到兩者之相對距離D，接著計算出瞳孔32的半徑R。 Referring to "3B", the position of the eyelid center point 311 and the pupil center point 321 is calculated from the eye block 30 after the eyelid 31 and the pupil 32 are aligned. From the position of the eyelid center point 311 and the pupil center point 321, the relative distance D between the two can be obtained, and then the radius R of the pupil 32 is calculated.
根據半徑R，可以依照半徑R之特定百分比來計算差異值X。在本實施例之特定百分比採用30%，亦可為其他特定百分比。30%係根據資料庫處理後所得到之較佳比例而設定，拍攝者亦可依照自己能接受之程度更改其特定百分比。將相對距離D與差異值X做比較，可得到特徵比例。若是相對距離D與差異值X相減之值小於零，即代表特徵比例為負數。若是相對距離D與差異值X相減之值大於零，即代表特徵比例為正數。 According to the radius R, the difference value X can be calculated according to a certain percentage of the radius R. The specific percentage in this embodiment is 30%, and may be other specific percentages. 30% is set according to the preferred ratio obtained after the database is processed, and the photographer can change its specific percentage according to the degree of acceptance. Comparing the relative distance D with the difference value X, the feature ratio can be obtained. If the relative distance D and the difference value X are subtracted from the value less than zero, the representative feature ratio is negative. If the relative distance D and the difference value X are subtracted from each other by more than zero, the representative feature ratio is a positive number.
而依照特徵比例之值為正數或負數，可以判定瞳孔32位於眼眶31的位置。當特徵比例之值為負數，則瞳孔32位於眼眶31的 中央位置，即可判定眼睛視線注視著前方。同時，產生提示訊號使拍攝者知道此狀況。當特徵比例之值為正數，則瞳孔32不是位於眼眶31的中央位置，即可判定眼睛視線不是注視著前方。同時，產生警示訊號，使拍攝者發現異常並即時告知被拍攝者視線之方向。 On the other hand, according to the fact that the value of the characteristic ratio is a positive number or a negative number, it can be determined that the pupil 32 is located at the position of the eyelid 31. When the value of the feature ratio is negative, the pupil 32 is located at the eyelid 31 At the central position, you can determine that the eye is looking at the front. At the same time, a prompt signal is generated to let the photographer know the situation. When the value of the feature ratio is a positive number, the pupil 32 is not located at the center of the eyelid 31, and it can be determined that the eye line of sight is not looking at the front. At the same time, a warning signal is generated to cause the photographer to find an abnormality and immediately inform the subject of the direction of the line of sight.
請參閱「第4A、4B、4C圖」，係為判定視線方向後，產生之提示訊號或警示訊號之示意圖。提示訊號可為聲音訊號或文字訊號，警示訊號可為聲音訊號、文字訊號，以及畫面訊號。當產生之訊號為聲音訊號時，係由攝像裝置產生聲音(例如，提示訊號之聲音為連續三短聲，而警示訊號之聲音為一長聲)(未圖示)。當產生之訊號為畫面訊號時，畫面訊號可為顏色標記框41(如「第4A圖」)或黑白影像42(如「第4B圖」)。顏色標記框41出現於影像20中，眼睛視線未注視攝像裝置之被拍攝者200之眼睛區塊30(未圖示)周圍，以提醒拍攝者影像20中哪一位被拍攝者200未注視攝像裝置。黑白影像42係將眼睛視線未注視攝像裝置之被拍攝者200之眼睛區塊30(未圖示)之顏色，由原本之彩色轉為黑白畫面，以方便拍攝者清楚地發現被拍攝者200之視線異常。當產生之訊號為文字訊號43(如「第4C圖」)時，在影像20右下角即會產生文字串告知拍攝者狀況(例如，提示訊號出現之文字訊號43為「可以拍攝」，警示訊號出現之文字訊號43為「有人未注視鏡頭」)。 Please refer to "4A, 4B, 4C", which is a schematic diagram of the prompt signal or warning signal generated after determining the direction of the line of sight. The prompt signal can be an audio signal or a text signal, and the warning signal can be an audio signal, a text signal, and a picture signal. When the generated signal is an audio signal, the sound is generated by the camera device (for example, the sound of the prompt signal is three consecutive short sounds, and the sound of the warning signal is a long sound) (not shown). When the generated signal is a picture signal, the picture signal can be a color mark box 41 (such as "4A") or a black and white image 42 (such as "4B"). The color mark frame 41 appears in the image 20, and the eye line of sight is not looking around the eye block 30 (not shown) of the subject 200 of the camera to remind the photographer of which of the images 20 is not photographed by the photographer 200. Device. The black-and-white image 42 is such that the color of the eye block 30 (not shown) of the subject 200 of the camera is not looked at, and the original color is changed to a black-and-white picture, so that the photographer can clearly find the subject 200. The line of sight is abnormal. When the generated signal is the text signal 43 (such as "4C"), a text string will be generated in the lower right corner of the image 20 to inform the photographer of the situation (for example, the text signal 43 indicating the presence of the signal is "can be taken", the warning signal The text message 43 appears as "someone is not looking at the camera").
以上所述之提示訊號及警示訊號之產生方式，亦可提供選項由拍攝者自行設定。設定選項包括顏色標記框41之顏色及所框眼 睛區塊30的範圍、黑白影像42所包含的範圍、攝像裝置產生之聲音訊號長短，以及文字訊號43所標示之文字及於影像20中的位置。 The manner in which the alert signal and the warning signal are generated as described above may also be provided by the photographer. Setting options include the color of the color marker box 41 and the framed eye The range of the eye block 30, the range of the black and white image 42, the length of the sound signal generated by the camera, and the text indicated by the text signal 43 and the position in the image 20.
藉由本發明所揭露之眼睛視線判斷的方法，拍攝者不用一一目視被拍攝者之視線，或從攝像裝置之液晶螢幕找出注視著別方的被拍攝者。而能夠直接從攝像裝置產生的聲音或從影像中的提示訊號或警示訊號得知被拍攝者之視線，輕鬆地拍攝出一張被拍攝者皆注視著攝像裝置的照片。 With the method of determining the eyesight of the present invention, the photographer does not have to visually look at the subject's line of sight, or find out from the liquid crystal screen of the camera that the other person is looking at the other party. The sound of the camera can be directly detected from the sound generated by the camera or from the alert signal or warning signal in the image, and a photo that the photographer is looking at the camera can be easily taken.
雖然本發明以前述之實施例揭露如上，然其並非用以限定本發明。在不脫離本發明之精神和範圍內，所為之更動與潤飾，均屬本發明之專利保護範圍。關於本發明所界定之保護範圍請參考所附之申請專利範圍。 Although the present invention has been disclosed above in the foregoing embodiments, it is not intended to limit the invention. It is within the scope of the invention to be modified and modified without departing from the spirit and scope of the invention. Please refer to the attached patent application for the scope of protection defined by the present invention.
20‧‧‧影像 20‧‧‧ images
200‧‧‧被拍攝者 200‧‧‧Photographed
30‧‧‧眼睛區塊 30‧‧‧ Eye block
31‧‧‧眼眶 31‧‧‧ Glasses
311‧‧‧眼眶中心點 311‧‧‧ eyelid center point
32‧‧‧瞳孔 32‧‧‧瞳孔
321‧‧‧瞳孔中心點 321‧‧‧ pupil center point
41‧‧‧顏色標記框 41‧‧‧Color mark box
42‧‧‧黑白影像 42‧‧‧Black and white images
43‧‧‧文字訊號 43‧‧‧Text signal
D‧‧‧相對距離 D‧‧‧relative distance
R‧‧‧半徑 R‧‧‧ Radius
X‧‧‧差異值 X‧‧‧ difference value
S10‧‧‧透過攝像單元取得影像 S10‧‧‧Get images through the camera unit
S11‧‧‧利用輪廓比對之方式從影像中分析出眼睛區塊 S11‧‧‧Using contour comparison to analyze eye blocks from images
S12‧‧‧分析出眼睛區塊中的眼部特徵 S12‧‧·Analysis of eye features in the eye block
S13‧‧‧從眼部特徵計算瞳孔和眼眶的相對距離並依據瞳孔半徑算出差異值 S13‧‧‧ Calculate the relative distance between the pupil and the eyelid from the eye features and calculate the difference based on the pupil radius
S14‧‧‧根據相對距離與差異值之值，計算出特徵比例 S14‧‧‧ Calculate the characteristic ratio based on the relative distance and the value of the difference value
S15‧‧‧根據特徵比例判斷瞳孔位於眼眶的位置 S15‧‧‧ Judging the position of the pupil at the eyelid according to the characteristic ratio
S16‧‧‧依據瞳孔所在眼眶之位置，以判定視線是否注視前方，若判定注視前方，產生提示訊號，若判定不是注視前方，產生警示訊號 S16‧‧‧ According to the position of the eyelid where the pupil is located, to determine whether the line of sight is looking ahead, if it is determined to look ahead, a signal will be generated. If it is determined that it is not looking ahead, a warning signal will be generated.
第1圖係為本發明之流程圖；第2圖係為本發明之透過攝像裝置所得到之影像示意圖；第3A圖係為本發明之眼睛區塊示意圖；第3B圖係為本發明之特徵比例示意圖；第4A圖係為本發明之顏色標記框示意圖；第4B圖係為本發明之黑白影像示意圖；以及第4C圖係為本發明之文字訊號示意圖。 1 is a flow chart of the present invention; FIG. 2 is a schematic view of an image obtained by a camera device of the present invention; FIG. 3A is a schematic diagram of an eye block of the present invention; FIG. 3B is a feature of the present invention. FIG. 4A is a schematic diagram of a color mark frame of the present invention; FIG. 4B is a schematic view of a black and white image of the present invention; and FIG. 4C is a schematic diagram of a text signal of the present invention.
S10‧‧‧透過攝像單元取得影像 S10‧‧‧Get images through the camera unit
S11‧‧‧利用輪廓比對之方式從影像中分析出眼睛區塊 S11‧‧‧Using contour comparison to analyze eye blocks from images
S12‧‧‧分析出眼睛區塊中的眼部特徵 S12‧‧·Analysis of eye features in the eye block
S13‧‧‧從眼部特徵計算瞳孔和眼眶的相對距離並依據瞳孔半徑算出差異值 S13‧‧‧ Calculate the relative distance between the pupil and the eyelid from the eye features and calculate the difference based on the pupil radius
S14‧‧‧根據相對距離與差異值之值，計算出特徵比例 S14‧‧‧ Calculate the characteristic ratio based on the relative distance and the value of the difference value
S15‧‧‧根據特徵比例判斷瞳孔位於眼眶的位置 S15‧‧‧ Judging the position of the pupil at the eyelid according to the characteristic ratio
S16‧‧‧依據瞳孔所在眼眶之位置，以判定視線是否注視前方，若判定注視前方，產生提示訊號，若判定不是注視前方，產生警示訊號 S16‧‧‧ According to the position of the eyelid where the pupil is located, to determine whether the line of sight is looking ahead, if it is determined to look ahead, a signal will be generated. If it is determined that it is not looking ahead, a warning signal will be generated.
Claims (15)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW97123813A TWI395144B (en) | 2008-06-25 | 2008-06-25 | Method of eye sight judgment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW97123813A TWI395144B (en) | 2008-06-25 | 2008-06-25 | Method of eye sight judgment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201001302A TW201001302A (en) | 2010-01-01 |
| TWI395144B true TWI395144B (en) | 2013-05-01 |
Family
ID=44824818
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW97123813A TWI395144B (en) | 2008-06-25 | 2008-06-25 | Method of eye sight judgment |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI395144B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI469061B (en) * | 2012-12-19 | 2015-01-11 | Nat Univ Chung Hsing | Applies to eye recognition methods and identification systems |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW473645B (en) * | 2000-11-22 | 2002-01-21 | Elecvision Inc | Method of displacement detection for digital camera |
| TWI275977B (en) * | 2005-07-07 | 2007-03-11 | Chung Shan Inst Of Science | Eye-controlled system of virtual keyboard |
| US7246904B2 (en) * | 2004-03-12 | 2007-07-24 | Honda Motor Co., Ltd. | Line-of-sight detection method and apparatus therefor |
| US20070189582A1 (en) * | 2005-01-26 | 2007-08-16 | Honeywell International Inc. | Approaches and apparatus for eye detection in a digital image |
-
2008
- 2008-06-25 TW TW97123813A patent/TWI395144B/en not_active IP Right Cessation
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW473645B (en) * | 2000-11-22 | 2002-01-21 | Elecvision Inc | Method of displacement detection for digital camera |
| US7246904B2 (en) * | 2004-03-12 | 2007-07-24 | Honda Motor Co., Ltd. | Line-of-sight detection method and apparatus therefor |
| US20070189582A1 (en) * | 2005-01-26 | 2007-08-16 | Honeywell International Inc. | Approaches and apparatus for eye detection in a digital image |
| TWI275977B (en) * | 2005-07-07 | 2007-03-11 | Chung Shan Inst Of Science | Eye-controlled system of virtual keyboard |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201001302A (en) | 2010-01-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9866748B2 (en) | System and method for controlling a camera based on processing an image captured by other camera | |
| US7715598B2 (en) | Method for detecting facial expressions of a portrait photo by an image capturing electronic device | |
| US7391886B1 (en) | Digital camera with image tracking system | |
| US8928770B2 (en) | Multi-subject imaging device and imaging method | |
| CN101620359A (en) | Judging method of eye sight line | |
| JP5467992B2 (en) | Imaging device | |
| KR101755598B1 (en) | Digital photographing apparatus and control method thereof | |
| CN112565589A (en) | Photographing preview method and device, storage medium and electronic equipment | |
| WO2019015477A1 (en) | Image correction method, computer readable storage medium and computer device | |
| JP5604285B2 (en) | Imaging device | |
| WO2022134957A1 (en) | Camera occlusion detection method and system, electronic device, and storage medium | |
| US20100123804A1 (en) | Emotion-based image processing apparatus and image processing method | |
| CN108093170B (en) | User photographing method, device and equipment | |
| KR101701814B1 (en) | Method and apparatus for displaying framing information | |
| TW201222429A (en) | Web camera device and operating method thereof | |
| CN114910052B (en) | Distance measurement method, control method and device based on camera and electronic equipment | |
| JP2003092701A (en) | Imaging apparatus | |
| CN108052883A (en) | User's photographic method, device and equipment | |
| TWI395144B (en) | Method of eye sight judgment | |
| TW201339986A (en) | Method and device for capturing image | |
| JP2013118574A (en) | Imaging apparatus | |
| JP2011113196A (en) | Face direction specification device and imaging device | |
| KR100783482B1 (en) | Digital camera having function of taking passport photo, method, and method thereof | |
| JP5477025B2 (en) | Image display device and program | |
| KR101571332B1 (en) | Digital photographing apparatus and method for controlling the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |