201239676 六、發明說明： 【發明所屬之技術領域】 本發明係關於根據亮度將以攝像機構拍攝之設置有複數 個標記之方向盤之圖像進行黑、白二值化，並將白色區域 判定為手之手之判定方法及手之判定裝置，與使用該手之 判定裝置之自動車之車載機器之操作裝置。 【先前技術】 先前，已知有一種手勢遠程控制式操作裝置，該操作裝 置具備：攝像機構，係讀取方向盤上之乘員之手之位置、 動作之CCD相機等；與操作指令機構，係基於該攝像機構 讀取之手之位置、動作，可對車载機器輸出操作指令。 例如下述專利文獻Is己載有基於操作者之手勢，即手 之位置或手之動作，對車載機器輸出操作指令者。 又，下述專利文獻2記載有對應於駕駛者之手堵塞設置 於方向盤之貫通孔’開始手勢遠程控制之動作，從而手勢 遠程控制之動作錯誤而無法開始者。 [先前技術文獻] [專利文獻] [專利文獻1]曰本專利第3941786號公報 [專利文獻2]日本特開2006-312347號公報 【發明内容】 [發明所欲解決之問題] 然而，在先前之此種手勢遠程控制式操作裝置中，基於 由攝像機構拍攝之圖像，基於預先設定之固定之臨限值， 157325.doc 201239676 將亮度相對較低（暗）之方向盤與亮度相對較高（亮）之操作 者之手二值化成黑（方向盤）與白（手），根據由此獲得之 黑、白二值化圖像，將特定面積以上之白色區域判定為 〇 然而，在手進入光影之部份、或操作者穿著暗色之手套 等之情形’會導致在使用先前之固定之臨限值之二值化圖 像中’操作者之手與方向盤一起二值化成黑色，從而有無 法確實判定手之情形。又，相反，在直射日光照到方向盤 發出白光等之情形，會導致在使用先前之固定之臨限值之 二值化圖像中，操作者之手與方向盤一起二值化成白色， 有無法確實判定手之情形。 本發明係鑑於前述之情況而完成者，其目的在於將操作 者之手及方向盤準確進行黑、白二值化，提高手之判定精 度。 [解決問題之技術手段] 為達成上述目的，根據技術方案丨記載之發明，提案一 種手之判定方法，其係根據亮度將以攝像機構拍攝之設有 標記之方向盤之圖像二值化為黑、白，並將白色區域判定201239676 VI. Description of the Invention: [Technical Field] The present invention relates to black and white binarization of an image of a steering wheel provided with a plurality of marks photographed by an image pickup mechanism according to brightness, and determines a white area as a hand The method for determining the hand and the device for determining the hand, and the operating device for the on-vehicle device of the automatic vehicle using the determination device for the hand. [Prior Art] Conventionally, there is known a gesture remote control type operation device including: an image pickup mechanism that reads a position of an occupant's hand on a steering wheel, a motion CCD camera, and the like; and an operation command mechanism based on The position and movement of the hand read by the camera mechanism can output an operation command to the vehicle-mounted device. For example, the following patent document Is has carried out an operator's gesture, that is, the position of the hand or the movement of the hand, and outputs an operation command to the in-vehicle device. Further, Patent Document 2 listed below describes an operation in which the driver's hand is clogged with the through hole of the steering wheel to start the gesture remote control, and the gesture remote control operation is incorrect and cannot be started. [PRIOR ART DOCUMENT] [Patent Document 1] Japanese Patent Laid-Open No. Hei. No. 3,941,786 [Patent Document 2] JP-A-2006-312347 [Summary of the Invention] [Problems to be Solved by the Invention] However, In such a gesture remote control type operation device, based on the image captured by the camera mechanism, based on a preset fixed threshold, 157325.doc 201239676 has a relatively low (dark) steering wheel with relatively high brightness ( The operator's hand is binarized into black (steering wheel) and white (hand). According to the black and white binarized image thus obtained, the white area above the specific area is determined as 〇, and the light is entered in the hand. The part, or the operator wearing a dark glove, etc., will cause the operator's hand to be binned to black with the steering wheel in the binarized image using the previously fixed threshold. Determine the situation of the hand. On the contrary, in the case of direct sunlight to the steering wheel to emit white light, etc., in the binarized image using the previously fixed threshold, the operator's hand and the steering wheel are binarized into white, which is not certain. Determine the situation of the hand. The present invention has been made in view of the above circumstances, and an object thereof is to accurately perform black and white binarization of an operator's hand and a steering wheel, and to improve hand determination accuracy. [Means for Solving the Problems] In order to achieve the above object, according to the invention described in the claims, a method for determining a hand is used, which is to binarize an image of a steering wheel provided with a mark photographed by an image pickup mechanism to black according to brightness. , white, and determine the white area
為手^ ’其特徵為包含以下步驟：步驟，其製作以手H 掩蓋前述標記時之前述方向盤之特定區域之亮度分佈圖； 第2步驟，其於前述亮度分佈圖之2個峰部之間設定判定 黑、白之亮度之臨限值；及第3步驟，其將亮度高於前述 臨限值之區域判定為白色區域。 又’根據技術方案2記載之發明，提案-種手之判定方 157325.doc 201239676 、勺入、技術方案！之構成，其中前述方向盤之特定區域 二以手掩蓋前述標記時通常被手掩蓋之區域與未被掩蓋 入 很媒技術方案3記載之發明，提案一種手之判定裝 置’其係根據亮度將以攝像機構拍攝之設有標記之方向盤 =像二值化為黑 '白，並將白色區域判定為手者，其特 徵為具備：亮度分佈圖製作機構，其製作以手掩蓋前述標 :時之前述方向盤之特定區域之亮度分佈圖；峰部判定機 ，其判Μ述亮度分㈣之2料部；臨限值設定機 構.，其於前述2個蜂部之間設定判定黑、白之亮度之臨限 值值化圖像轉換機構，其基於前述臨限值，將前述圖 像轉換成黑、白之二值化及手判定機構，其將前述 一值化圖像之白色區域判定為手。 又’根據技術方案4記载之發明，提案一種手之判定裝 置，其如技術方案3之構成’其中前述方向盤之特定區域 包含以手掩蓋前述標記時通常被手掩蓋之區域與未被掩蓋 之區域。 又’根據技術方案5記載之發明，提案—種自動車上之 車載機器之操作裝置，其特徵為，其係、使用如技術方案3 或技術方案4記載之手之判定裝置者，其具備：判定機 構，其可基於從前述攝像機構輸出之攝像資料，對每個標 記個別判定含有前述標纪之複數個.標記中之何者是否由^ 掩蓋；及操作指令機構，其基於前述判定機構之判定結 果’對車載機器輸出操作指令。 1 157325.doc 6 - 201239676 再者’實施形態之音頻AU、視訊DVD及汽車導航系統 CN對應於本發明之車載機器，而實施形態之相機對應 於本發明之攝像機構。 [發明之效果] 根據技術方案1之構成，在第1步驟中，製作以手掩蓋標 δ己時之方向盤之特定區域之亮度分佈圖，在第2步驟中， 於亮度分佈圖之2個峰部之間設定判定黑、白之亮度之臨 限值，在第3步驟中，將亮度高於臨限值之區域判定為白 色區域。因此，若手之亮度比方向盤之亮度相對較高，則 可設定能夠確實將方向盤二值化成黑色，且將手二值化成 白色之適當之臨限值，且可將白色區域判定為手，從而大 幅提高判定精度。 又，根據技術方案2之構成，由於方向盤之特定區域包 含以手掩蓋標記時通常被手掩蓋之區域與未被掩蓋之區 域，故可於亮度分佈圖確實形成2個峰部，根據該亮度分 佈圖設定準確之臨限值，從而可進一步提高手之判定精 度。 又，根據技術方案3之構成，亮度分佈圖製作機構係製 作以手掩蓋標記時之方向盤之特定區域之亮度分佈圖，峰 部判定機構係判定亮度分佈圖之2個峰部，臨限值設定機 構係於2個峰部之間設定判定黑、白之亮度之臨限值，二 值化圖像轉換機構係基於臨限值將圖像轉換成黑、白二值 化圖像，手判定機構係將二值化圖像之白色區域判定為 手。因此’若手之亮度比方向盤之亮度相對較高，則可設 157325.do, 201239676 定能夠確實將方向盤二值化成黑色，且將手二值化成白色 之適當之臨限值，且可將白色區域判定為手，從而大幅提 尚判定精度。 又，根據技術方案4之構成，由於方向盤之特定區域包 含以手掩蓋標記時通常被手掩蓋之區域與未被掩蓋之區 域，故可於亮度分佈圖確實形成2個峰部，根據該亮度分 佈圖’設定準確之臨限值，從而可進—步提高手之判定精 度。 又，根據技術方案5之構成，判定機構係基於由攝像機 構輸出之攝像資料’對每個標記個別判定含有前述標記之 複數個該標記中之何者是^由手掩蓋，操作指令機構由於 基於該判定結果，對車載機器輸出操作指令，故不僅可基 於各標記是否因操作者之手從攝像機構掩蓋，董子車載機器 正確地輸出操作指令’亦可使操作者之操作程序容易判 定，從^亦可有⑽防止操作者之認識差異導致之誤操 作。且操作指令機構之判斷邏輯比較簡單，不僅能夠對節 省成本有幫助，亦可快速地進行運算處理。 【實施方式】 以下，基於圖1〜圖13說明本發明之實施形態。 首先，在圖1〜圖3中，於車室之儀錶板道，除速度計等 各種量表以外，設置用於音頻八1;、視訊DVD、汽車導航 系統CN等車載機器之顯示部L’或用於手動操作該等車載 機器AU、DVD、CN之操作則等，再者，於該各種量表之 正面側，配設由駕駛者操向操作之方向盤s。 157325.doc 201239676 方向盤S具備連結於操向軸（未圖示）之中央輪殼部Sa; 將該中央輪殼部Sa圓環狀包圍之輪緣部Sm ;及連結該輪 緣部Sm及中央輪殼部Sa間之3個輻條部Sbl〜Sb3。於中央 輪殼部Sa之外面可裝卸地覆蓋喇a護罩2，而於該喇π八護 罩2之中央外面，安裝經圖樣處理之Η字狀之第1標記Ml。 又，於前述輻條部Sbl〜Sb3可裝卸地安裝樣式符合地覆 蓋該等之外面之輻條罩3。該輻條罩3於圖示例中係將具有 可撓性之薄板狀金屬板形成為對應於輻條部Sbl ~Sb3之展 開形狀而構成’且於其背面設置貼附用之接著劑或接著片 材。將該輻條罩3安裝於輻條部Sb 1〜Sb3時，使該罩3仿照 輻條部Sb 1〜Sb3之外面的方式纏繞貼附，且以使該罩3之自 由端緣3e如圖3所示向内方彎折的方式，固定於輻條部 Sbl〜Sb3 〇 於前述輻條罩3之對應於左側之輻條部sb 1之部份，第2〜 第4標記M2〜M4(在圖示例中M2相當於音量標記，]y[3相當 於來源標記，M4相當於選擇標記）分別藉由接著或印刷附 設成一行’又’於輻條罩3之對應於右側之輻條部sb3之部 份’第5〜第7標記M5〜M7(在圖示例中M5相當於語音標 記，M6相當於調高標記，M7相當於調低標記）分別藉由接 著或印刷’以將第5標記M5設為靠内之鋸齒形之排列附 設。 於車室内之適當位置，在圖示例中為駕驶者之略微斜後 方之車頂部，設置作為可拍攝各標記M丨〜M7之攝像機構之 單色相機CA。該相機CA在駕駛者掩蓋某個標記m1〜M7 157325.doc 201239676 將可明確辨識該經掩蓋之攝像資料輸出 置ECU(參照圖4)。 至電子控制裝 方向盤S之顏色較佳為接近黑色之暗色系，且第卜第7標For the hand ^', the method comprises the steps of: preparing a brightness distribution map of a specific area of the steering wheel when the hand H is covered by the hand H; and the second step, between the two peaks of the brightness distribution map A threshold for determining the brightness of black and white is set; and a third step of determining a region having a luminance higher than the threshold is determined as a white region. Further, according to the invention described in the second aspect of the invention, the proposal - the judge of the seed type 157325.doc 201239676, spoonful, technical solution! The invention is characterized in that the specific area of the steering wheel is covered by the hand and the area which is usually covered by the hand when the cover is covered by the hand, and the invention described in the third embodiment is proposed. The steering wheel with the mark photographed by the mechanism = like binarized to black 'white, and the white area is judged as the hand, and is characterized by: a brightness distribution map producing mechanism, which is configured to cover the aforementioned steering wheel with the hand: a brightness distribution map of a specific area; a peak determining machine that determines a brightness portion (four) of two material portions; a threshold setting mechanism that sets a brightness between black and white between the two bee portions The limit valued image conversion means converts the image into a black and white binarization and hand determination means based on the threshold value, and determines a white area of the binarized image as a hand. Further, according to the invention described in claim 4, there is proposed a hand determining device which is constructed as in the third aspect, wherein the specific region of the steering wheel includes an area which is normally covered by the hand when the hand is covered by the hand and is not covered. region. According to the invention of the fifth aspect of the invention, there is provided an apparatus for controlling an in-vehicle device in an automatic vehicle, characterized in that the device for determining a hand according to the third aspect or the fourth aspect of the invention includes: a mechanism, based on the image data outputted from the camera mechanism, determining, individually for each of the plurality of marks, whether or not the plurality of marks are masked by each of the marks; and operating the command means based on the determination result of the determining means 'Output instructions for the onboard machine. 1 157325.doc 6 - 201239676 Furthermore, the audio AU, the video DVD, and the car navigation system CN of the embodiment correspond to the in-vehicle device of the present invention, and the camera of the embodiment corresponds to the imaging mechanism of the present invention. [Effects of the Invention] According to the configuration of the first aspect, in the first step, a luminance distribution map of a specific region of the steering wheel when the target δ is covered by the hand is created, and in the second step, the two peaks of the luminance distribution map are obtained. The threshold for determining the brightness of black and white is set between the units, and in the third step, the area where the brightness is higher than the threshold is determined as a white area. Therefore, if the brightness of the hand is relatively higher than the brightness of the steering wheel, it is possible to set an appropriate threshold value for which the steering wheel can be binarized to black and the hand is binarized to white, and the white area can be determined as a hand, thereby greatly Improve the accuracy of the decision. Further, according to the configuration of the second aspect of the invention, since the specific region of the steering wheel includes the region which is normally covered by the hand and the region which is not covered by the hand when the mark is covered by the hand, two peaks can be formed in the luminance distribution map according to the luminance distribution. The figure sets the exact threshold so that the accuracy of the hand can be further improved. Further, according to the configuration of claim 3, the luminance profile generation means creates a luminance distribution map of a specific region of the steering wheel when the marker is covered by the hand, and the peak determination means determines two peak portions of the luminance distribution map, and sets the threshold value. The mechanism sets the threshold for determining the brightness of black and white between the two peaks, and the binarized image conversion mechanism converts the image into a black and white binarized image based on the threshold value, and the hand determination mechanism The white area of the binarized image is determined as a hand. Therefore, if the brightness of the hand is relatively higher than the brightness of the steering wheel, you can set 157325.do, 201239676 to be able to binarize the steering wheel to black, and to binarize the hand to the appropriate threshold of white, and the white area can be It is judged to be a hand, so that the judgment accuracy is greatly increased. Further, according to the configuration of the fourth aspect of the invention, since the specific region of the steering wheel includes the region which is normally covered by the hand and the region which is not covered by the hand when the marker is covered by the hand, two peak portions can be formed in the luminance distribution map according to the luminance distribution. The figure 'sets the exact threshold, so that the accuracy of the hand can be improved step by step. Further, according to the configuration of claim 5, the determination means determines, based on the image data output by the image pickup means, which of the plurality of the marks including the mark is individually marked for each mark, by the hand, the operation command means is based on As a result of the determination, the operation command is output to the in-vehicle device. Therefore, not only can each of the markers be masked from the imaging device by the operator's hand, but the Dongzi vehicle-mounted device can correctly output the operation command, and the operator's operation program can be easily determined. There may also be (10) preventing the operator from misunderstanding caused by the difference in understanding. Moreover, the judgment logic of the operation command mechanism is relatively simple, and it can not only save the cost, but also perform the calculation processing quickly. [Embodiment] Hereinafter, an embodiment of the present invention will be described based on Figs. 1 to 13 . First, in FIG. 1 to FIG. 3, in the instrument panel of the vehicle compartment, in addition to various scales such as a speedometer, a display portion L' for an in-vehicle device such as an audio VIII; a video DVD, a car navigation system CN, or the like is provided. Alternatively, the operation of the in-vehicle devices AU, DVD, and CN may be manually performed, and the steering wheel s operated by the driver may be disposed on the front side of the various gauges. 157325.doc 201239676 The steering wheel S includes a center wheel housing portion Sa connected to a steering shaft (not shown); a rim portion Sm that surrounds the center wheel housing portion Sa in an annular shape; and the rim portion Sm and the center thereof Three spoke portions Sb1 to Sb3 between the wheel housing portions Sa. The la-shi shield 2 is detachably covered on the outer surface of the center wheel housing portion Sa, and the first mark M1 in the shape of a U-shaped pattern is attached to the outside of the center of the shi-eight-shield cover 2. Further, the spoke cover 3 which covers the outer surfaces in conformity with each other is detachably attached to the spoke portions Sb1 to Sb3. In the illustrated example, the spoke cover 3 is formed by forming a flexible thin plate-shaped metal plate so as to correspond to the developed shape of the spoke portions Sb1 to Sb3 and providing an adhesive for attaching or a sheet on the back side thereof. . When the spoke cover 3 is attached to the spoke portions Sb 1 to Sb3, the cover 3 is wound and attached to the outer surface of the spoke portions Sb 1 to Sb3 so that the free end edge 3e of the cover 3 is as shown in FIG. The inwardly bent manner is fixed to the spoke portions Sb1 to Sb3 to the portion of the spoke cover 3 corresponding to the left spoke portion sb1, and the second to fourth marks M2 to M4 (in the illustrated example, M2) Corresponding to the volume mark, ]y[3 is equivalent to the source mark, and M4 is equivalent to the selection mark), which is attached to the line of the spoke portion sb3 of the spoke cover 3 corresponding to the right side by the following or printing. ~7th mark M5~M7 (in the example of the figure, M5 is equivalent to a voice mark, M6 is equivalent to a mark up mark, and M7 is equivalent to a mark up mark), respectively, by pressing or printing 'to set the fifth mark M5 to be inside The zigzag arrangement is attached. In the appropriate position in the vehicle compartment, in the example of the figure, the top of the driver's car is slightly inclined, and a monochrome camera CA is provided as an imaging mechanism capable of capturing the respective marks M丨 to M7. The camera CA can clearly identify the masked camera data output ECU (see Fig. 4) when the driver masks a mark m1~M7 157325.doc 201239676. To the electronic control unit, the color of the steering wheel S is preferably a dark color close to black, and the seventh standard
之手Η。 如圖4所不，電子控制裝置ECU為設置於車室内之適當 且具備：判定機構C1，其 料，並基於該分析資料， 位置、例如儀錶板〗之内部者，且 可分析從相機CA輸出之攝像資料 對每個標記Ml〜M7個別判定標記M1〜M7是否被掩蓋；操 作指令機構C2，其基於該判定機構C1之判定結果對車 載機器（即音頻AU、視訊DVD、汽車導航系統CN)輸出作 為操作指令之操作指令信號；信號輸出部C3，其將該操作 指令機構C2之輸出信號轉換成對前述車載機器之驅動信 號，並輸出至車載機器AU' DVD、CN ;及辨識機構C4， 其能夠基於從相機CA輸出之攝像資料，辨識乘員之手H。 前述相機CA連接於判定機構。及辨識機構€4之各輸入 侧。又，於操作指令機構C2之輸入側，分別連接判定機構 C1及辨識機構C4之各輸出側，以及外部之前述操作部1、 轉向角度感測器SE1及車速感測器SE2。再者，於信號輸 出部C3之輸入側連接有操作指令機構C2之輸出侧，且於 該信號輸出部C3之輸出側連接有前述車載機器AU、 DVD、CN。 操作指令機構C2可選擇性採取可由前述外部之操作部j 157325.doc -10· 201239676 操作輸入車載機器AU、DVD、CN之待機模式，與禁止該 操作輸入之第1、第2動作模式中之一者，且在前述待機模 式中，即使第1標記Ml及第5標記M5以外之標記（即，第2 第4標記M2〜M4、第6標記M6及第7標記M7)被掩蓋，操作 指令機構C2亦不會應答，即不會發送操作指令。 又，操作指令機構C2在該操作指令機構C2處於第i或第 2動作模式時，根據在車輛中預先設定之狀態（在圖示例 中，為具有特定角度以上之轉向角度操作之狀態、或於特 定時間内發生急劇之車速變化之狀態、或切換成第卜第之 之任一者之動作模式後經過一定時間以上無掩蓋第2〜第7 標記M2〜M7之任一者之操作之閒置狀態、或雖處於第1或 第2動作模式但仍做出再次掩蓋第丨標記Μι之操作之狀 態）’自動切換成前述待機模式。 如圖8所示，辨識機構C4具備亮度分佈圖製作機構η、 峰部判定機構P2、臨限值設定機構!>3、二值化圖像轉換機 構P4 '及手判定機構P5。於亮度分佈圖製作機構耵及二值 化圖像轉換機構P4連接相機CA，而亮度分佈圖製作機構 P1連接於峰部判定機構P2，峰部判定機構p2連接於臨限值 設定機構P3，臨限值設定機構p3連接於二值化圖像轉換機 構P4，二值化圖像轉換機構p4連接於手判定機構p5。 如圖2所示，於方向盤s上設定中央之第丨區域RC，與位 於其左右兩側之第2、第3區域RL、RR。第1區域RC及第 2、第3區域RL、RR均為假設之區域，第i區域RC設定於 覆蓋第1標記Ml之位置，而第2、第3區域RL、RR設定於 157325.doc 11 201239676 從第1區域RC離開特定距離之位置。換而言之，第1區域 RC設定於駕駛者欲以手掩蓋第1標記Ml時被覆蓋之位置， 而第2、第3區域RL、RR設定於駕驶者欲以手掩蓋第j標記 Ml時不易被覆蓋之位置。 返回至圖8，辨識機構C4之亮度分佈圖製作機構？1從相 機CA之圖像提取對應於前述第1區域RC及第2、第3區域 RL、RR之像素’並將其按亮度排列，從而製作圖9所示之 亮度分佈圖。駕駛者欲以手掩蓋第1標記Ml時，由於第1 區域RC之大部份被亮色之手覆蓋，故其像素之亮度趨向 於高’而第2、第3區域RL、RR之大部份未被亮色之手覆 蓋’使得暗色之方向盤S之喇八護罩2露出，故其亮度趨向 於低。其結果，於亮度分佈圖中，在對應於第1區域RC之 像素之亮度較高之區域產生1個峰部，且在對應於第2、第 3區域RL、RR之像素之亮度較低之區域產生另一個峰部。 峰卩判疋機構p2係判定前述2個蜂·部，臨限值設定機構 Ρ3係於前述2個峰部之間設定用於二值化之亮度之臨限 值。該臨限值為根據車室之環境等變化之值，例如，在車 室較暗之情形，由於第丨〜第3區域RC、RL、RR之像素之 亮度整體變低，故使臨限值向低（暗）之方向移動，而在車 至較亮之情形，由於第1〜第3區域RC、RL、RR之像素之 亮度整體變高’故使臨限值向高（亮）之方向移動。Handcuffs. As shown in FIG. 4, the electronic control unit ECU is provided in the vehicle compartment and has a determination mechanism C1, based on the analysis data, the position, for example, the inside of the dashboard, and can be analyzed and output from the camera CA. Whether the camera data is individually masked for each of the markers M1 to M7; the operation command mechanism C2 is based on the determination result of the determination mechanism C1 for the in-vehicle device (ie, audio AU, video DVD, car navigation system CN) Outputting an operation command signal as an operation command; the signal output unit C3 converts the output signal of the operation command mechanism C2 into a drive signal to the in-vehicle device, and outputs the signal to the in-vehicle device AU'DVD, CN; and the identification mechanism C4, It is capable of recognizing the hand H of the occupant based on the image data output from the camera CA. The aforementioned camera CA is connected to the determination mechanism. And the input side of the identification mechanism €4. Further, on the input side of the operation command mechanism C2, the respective output sides of the determination means C1 and the identification means C4, and the external operation unit 1, the steering angle sensor SE1, and the vehicle speed sensor SE2 are connected. Further, an output side of the operation command unit C2 is connected to the input side of the signal output unit C3, and the in-vehicle devices AU, DVD, and CN are connected to the output side of the signal output unit C3. The operation command mechanism C2 can selectively adopt a standby mode in which the external operation unit j 157325.doc -10·201239676 is operated to input the in-vehicle devices AU, DVD, and CN, and the first and second operation modes in which the operation input is prohibited. In the standby mode, even the marks other than the first mark M1 and the fifth mark M5 (that is, the second and fourth marks M2 to M4, the sixth mark M6, and the seventh mark M7) are masked, and the operation command is issued. Organization C2 will not respond, ie no operational instructions will be sent. Further, when the operation command mechanism C2 is in the i-th or second operation mode, the operation command means C2 is in a state set in advance in the vehicle (in the example of the figure, the state is operated at a steering angle having a specific angle or more, or The operation of any of the second to seventh marks M2 to M7 is not masked for a certain period of time or more after a sudden change in the speed of the vehicle in a certain period of time or after switching to the operation mode of any one of the first The state, or the state in which the first or second operation mode is performed, but the operation of re-masking the third mark Μι is again performed) is automatically switched to the aforementioned standby mode. As shown in Fig. 8, the identification mechanism C4 includes a luminance profile generation unit η, a peak determination unit P2, a threshold setting unit!>3, a binarized image conversion unit P4', and a hand determination unit P5. The luminance profile generation unit 耵 and the binarized image conversion unit P4 are connected to the camera CA, and the luminance profile generation unit P1 is connected to the peak determination unit P2, and the peak determination unit p2 is connected to the threshold setting unit P3. The limit setting means p3 is connected to the binarized image converting means P4, and the binarized image converting means p4 is connected to the hand determining means p5. As shown in Fig. 2, the center second region RC is set on the steering wheel s, and the second and third regions RL and RR located on the left and right sides thereof. The first region RC and the second and third regions RL and RR are assumed regions, the i-th region RC is set at a position covering the first mark M1, and the second and third regions RL and RR are set at 157325.doc 11 201239676 The position away from the first area RC by a certain distance. In other words, the first area RC is set at a position where the driver wants to cover the first mark M1 by hand, and the second and third areas RL, RR are set when the driver wants to cover the j-th mark M1 by hand. A location that is not easily covered. Returning to Figure 8, the brightness profile generation mechanism of the identification mechanism C4? (1) Pixels corresponding to the first region RC and the second and third regions RL and RR are extracted from the image of the camera CA and arranged in brightness, thereby producing a luminance profile as shown in Fig. 9. When the driver wants to cover the first mark M1 with his hand, since most of the first area RC is covered by the bright hand, the brightness of the pixel tends to be high' and the majority of the second and third areas RL and RR The cover that is not covered by the bright color makes the black shield 2 of the steering wheel S of the dark color appear, so the brightness tends to be low. As a result, in the luminance profile, one peak is generated in a region where the luminance of the pixel corresponding to the first region RC is high, and the luminance of the pixel corresponding to the second and third regions RL and RR is low. The area produces another peak. The peak value determining means p2 determines the two bee parts, and the threshold setting means Ρ3 sets a threshold value for the binarization luminance between the two peaks. The threshold value is a value that varies depending on the environment of the vehicle compartment, for example, in the case where the vehicle compartment is dark, since the brightness of the pixels of the second to third regions RC, RL, and RR is low overall, the threshold value is set. Moving in the direction of low (dark), when the car is brighter, the brightness of the pixels of the first to third regions RC, RL, and RR is higher overall, so the threshold is higher (bright). mobile.
一值化圖像轉換機構p4係根據前述臨限值分配由相機 CA拍攝之圖像之全部像素，比臨限值亮之像素二值化成 白色’比臨限值暗之像素二值化成黑色，從而將相機CA 157325.doc •12· 201239676 之圖像轉換成由白及黑2色構成之二值化圖像。且手判定 機構Ρ5係在二值化圖像之白色區域中，將具有特定值以上 之面積組成之部份判定為駕駛者之手Η。 如此’由於係以亮度分佈圖製作機構卩丨製作以手Η掩蓋 第1標記Ml時之方向盤S之第1區域RC及第2、第3區域 RL、RR之亮度分佈圖，以峰部判定機構p2，判定亮度分 佈圖之2個峰部’以臨限值設定機構p3，於2個峰部之間設 定判定黑、白之亮度之臨限值，以二值化圖像轉換機構 P4 ’基於臨限值將圖像轉換成黑、白之二值化圖像，以手 判定機構P5，將二值化圖像之特定面積以上之白色區域判 定為手Η，故若手Η之亮度比方向盤3之亮度相對較高，則 可没定能夠確實將方向盤S二值化成黑色，且將手η二值化 成白色之適當之臨限值，從而可大幅提高判定精度。 且，由於判定機構C1在操作指令機構C2位於待機模式 之狀態下，係基於相機C Α之攝像資料，如圖5(Α)所示，辨 識方向盤本體Sm之輪廓（圓）設為監視對象範圍，其次，如 圖5(B)所示，辨識中央之第i區域M1，故在該辨識中，如 圖5(C)所示，在駕駛者之手H掩蓋第！標記河丨時，能夠快 速確實地辨識該情形，將該辨識結果輸出至操作指令機構 C2 ’從而該機構C2會切換成第1動作模式。 又，由於判定機構C1在操作指令機構C2位於第1或第2 動作模式之狀態下，係如圖6(A)所示，辨識輻條部Sbl、 Sb2之第2〜第7標記M2〜M7 ’故在該辨識中，例如如圖6(B) 所示，在駕驶者之手Η掩蓋複數個第2標記（即，第2〜第5標 157325.doc •13· 201239676 記M2~M5)時，可快速確實地辨識該情形’基於該辨識辞 果，操作指令機構C2會切換成第2動作模式。再者，在該 第2動作模式之狀態下，如圖6(C)所示，可快速確實地辨 識駕駛者之手Η掩蓋複數個第3標記（即，第6、第7標記 Μ6、Μ7)之情形，將該辨識結果輸出至操作指令機構c2。 再者，辨識機構C4在操作指令機構C2位於任意之模式 之情形，仍可基於相機CA之攝像資料，如圖7(A)所示，辨 識方向盤本體Sm之輪廓設為監視對象範圍。且操作指令 機構C2之構成為，在其基於車速感測器SE2之檢測信號， 判斷為自動車在行駛中時，辨識機構C4未辨識輪緣部Sm 上具有2隻手Η時，會使來自前述操作部1之至少一部份之 操作信號無效，而辨識機構C4如圖7(B)所示，辨識輪緣部 Sm上具有2隻手Η時，不會使前述操作信號無效。 因此’行駛中與先前相同’從安全駕驶之觀點來看，可 使對車載機器AU、DVD、CN之操作部丨之手動操作中至少 部伤無效。然而，在行驶中辨識機構C4仍能辨識輪緣部 Sm上有2隻手Η之情形，由於即使從前述操作部丨輸出操作 k號’其亦被認為是由駕駛者以外之乘員操作者，故操作 指令機構C2不會使前述操作信號無效，而將利用駕駛者以 外之乘員之操作設為有效。藉此，即使自動車在行駛中， 只要駕驶者以兩手Η握住方向盤S ’則可利用駕駛者以外之 同乘者對車載機器AU、DVD、行操作，從而提高可 用性、便利性。 操作指令機構C2在其位於待機掇+ & 付愧褀式時，基於判定機構 157325.doc 14 201239676 C1判又第1標記M1被掩蓋，而切換成第1動作模式，在該 第1動作模式中，可藉由掩蓋第2〜第5標記M2〜M5中之一 個，而任意選擇車載機器之操作對象（圖示例中為「音 ，」、選擇視訊、音頻之「來源」、選擇專輯名、曲名之 選擇」、及選擇汽車導航系統之聲音檢測模式之「語 音」）。 ^又，操作指令機構C2在其位於第i動作模式時，基於判 疋機構ci判定第2〜第5標記M2〜M”之何者被掩蓋，而切 換成第2動作模式’在該第2動作模式中，可藉由掩蓋第 、第払》己M6、M7中之一個，而選擇關於前述操作對象 之複數個操作參數中之-個。該操作參數是指關於前述操 作對象，操作者應該更具體選擇操作之操作内容，圖示例 中，藉由掩蓋第2標記M2而選擇「音量」之情形，掩蓋第 6標記M6與掩蓋第7標記M7分別對應於「音量調高 量調低」。 又，藉由掩蓋第3標記M3選擇「來源」之情形，掩蓋第 6標記M6與掩蓋第7標記M7分別對應於〇FF、視訊、音頻 之「快轉」、及「倒帶」。 再者，藉由掩蓋第4標記M4選擇「選擇」之情形，長時 間（例如2秒）掩蓋第6標記M6、短暫掩蓋第6標記M6、長時 間（例如2秒）掩蓋第7標記M7、及短暫掩蓋第7標記M7分別 對應於專輯名之「一方向漸進」、曲名之「一方向漸進」、 專輯名之「另-方向漸進」、及曲名之「另-方向漸進」。 其次，參照圖1〇~圖13，更具體地說明前述操作裝置之 157325.doc •15- 201239676 操作程序。 [1 ]音量調整操作 操作指令機構C2位於前述待機模式時，如圖1〇之步驟 S10所示，顯示部L為通常之汽車導航系統畫面，若操作者 從該狀態掩蓋第1標記Ml(步驟S11)，則與「請操作之廣 播同時於晝面下半部份強調顯現接下來應該選擇操作之標 記M2〜M5之顯示（步驟S12)。此處，若掩蓋第2標記M2(步 驟S13)’則與「音量」之廣播同時於畫面下半部份強調顯 現接下來應該操作選擇之標記M6、M7之顯示（步驟SI4)， 其次，若經過特定時間（例如3秒），則顯現現時點之音量顯 示（步驟S15)。此處，若掩蓋第6標記M6或第7標記M7中之 任一個（步驟S16)，則對應於掩蓋之標記執行音量調整， 顯現該調整後之音量顯示（步驟S17)。 [2]來源選擇操作 如圖11所示，步驟S20〜S22為止與前述步驟si〇〜S12相 同/若從該步驟S22之狀態掩蓋第3標記M3(步驟S23)，則 與「來源選擇」之廣播同時於畫面下半部份強調顯現接下 來應該選擇操作之標記M6、M7之顯示（步驟S24)，其次， 右經過「特定時_如3秒）’職現在現時點之來源顯示 (中〇FF」之選擇顯示）（步驟S25) »此處，若掩蓋第6 標記M6或第7標記M7中之任一個（步驟s26)，則對應於掩 蓋之標記’執行OFF、視訊、音頻之一方向或另一方向之 漸進’且與「來源選擇。〇〇〇」之廣播同時顯現該選擇後 之來源顯示（步驟S27) » 157325.doc 201239676 [3] 專輯名、曲名之選擇操作 如圖12所示，步驟S30〜S32為止係與前述步驟§10〜S12 相同，若從該步驟S32之狀態掩蓋第4標記M4(步驟S33) ’ 則與「專輯名、曲名選擇」同時於畫面下半部份強調顯現 接下來應該選擇操作之標記M6、M7之顯示（步驟S34)，其 次，若經過特定時間（例如3秒），則顯現在現時點之專輯 名、曲名來源顯示（步驟S35)。因此，若長時間（例如2秒） 掩蓋第6標記M6或第7標記M7中之任一個，則執行專輯名 之一方向漸進或另一方向漸進（步驟S36)，又若短暫掩蓋 第6標s己M6或第7標記M7中之任一個，則執行曲名之一方 向漸進或另一方向漸進（步驟S36)，與該等之執行同時會 顯現重新選擇之專輯名、曲名之顯示（步驟S37)。顯現該 顯示後，若閒置特定時間（例如5秒），則會確定重新選擇之 專輯名、曲名。 [4] 對聲音檢索模式之轉移操作 如圖13所示，步驟S40〜步驟S42為止與前述步驟si〇〜步 驟S12相同，若操作者從該步驟S42之狀態掩蓋第5標記 M5(步驟S43)，則可與「聲音檢索」之廣播同時將汽車導 航系統CN轉移成先前眾所周知之聲音檢索模式。 根據以上說明之本實施形態，由於具備判定機構〇，係 可基於從相機CA輸出之攝像資料，對每個標記個別判定 複數個標記Ml〜M7是否被掩蓋，與操作指令機構C2，係 基於利用該判定機構C1之判定結果，對車載機器au、 DVD、CN輸出操作指令（操作指令信號），故不僅可基於各 157325.doc 17 201239676 払=Μ1 M7疋否因操作者之手Ή從相機ca掩蓋，而對車載 機器AU、DVD、CN正確地輸出操作指令，亦可使操作者 之操作程序容易判定，從而亦可有效地防止操作者之辨識 差異導致之誤操作。 且該操作指令機構C2之判斷邏輯比較簡單，從而可謀求 成本之節ίί ’且亦可快速地進行運算處理。又，由於前述 複數個標記Ml〜Μ7設置於車室内之被安裝構件（圖示例中 為可裝卸於方向盤S之喇B八護罩2、輻條罩3)，且無需於該 等罩2、3或於方向盤s特別穿設讀取用之貫通孔故不僅 附加之選項對應比較容易，且各標記M1〜M7及相機之 設置位置之自由度亦變較高，進而可容易且快速地進行握 著方向盤S之駕駛者以手掩蓋標記操作。 且，操作者可僅以掩蓋第丄標記M，將操作指令機構。 從待機模式快速且確實地切換成第丨動作模式，再者，在 該第1動作模式中，可僅以掩蓋複數個標記M2〜M5中之一 個，快速且確實地選擇車載機器AU、DVD、CN之操作對 象再者插作者在插作指令機構C2位於前述第2動作模 式時’可僅以掩蓋第6、第7標記M6、M7中之一個，快速 且確實地選擇關於操作對象應該指定之複數個操作參數， 即操作内容之其中一個。 然而’操作指令機構C2在該機構處於任意之動作模式 時’根據車輛所預先設定之狀態（在圖示例中，為具有特 疋角度以上之轉向角度操作之狀態、或於特定時間内發生 急劇之車速變化之狀態、或切換成第1、第2之任一者之動 157325.doc • 18 - 201239676 作模式後經過一定時間以上無掩蓋第2〜第7標記M2〜m72 閒置狀態、或雖處於第1或第2動作模式但仍做出再次掩蓋 第1標記Ml之操作之狀態），自動切換成待機模式。藉此， 由於在轉彎行駛時或急加速時等之應該專心駕駛之特別之 行歇狀態等的情形，或閒置一定時間以上之情形且在駕 駛者希望要立即返回至待機模式之情形，可將操作指令機 構C2自動返回至待機模式，故在該等之情形，可使因操作 者之誤操作而導致之操作指令機構C2輸出指令確實防於未 以上，雖已說明本發明之實施形態，但本發明並不限定 於上述實施形態，可不脫離申請專利範圍記載之本發明， 進行各種之設計變更。 例如，在實施形態中，第i區域Rc及第2、第3區域rl、 RR3個區域係設定為相互離開，但亦可設定為該等為連續 之1個區域。區域之設定方法為任意，但其—部份必須包 含第1標記Ml。 又，在實施形態中，*财可由本發明㈣裝置操作音 頻AU、視訊DVD、汽車導航系統CN等者，但本發明亦可 將操作對象設為車載之其他機器，例如空調等之空調裝 置、電視等。 又’在實施形態中，示例有操作指令機似基於判定機 構cm掩蓋標t£M1〜M7之判定結果，對車載機器au、 DVD、CN輸出操作指令（操作指令信號）者，但本發明亦可 基於將判定機構ci就掩蓋標記M1〜M7之判定結果，與辨 157325.doc 201239676 識機構C4辨識手Η之結果組合之判斷邏輯，對車載機器 AU、DVD、CN輸出操作指令（操作指令信號）。由於即使 在該情形下，辨識機構C4亦僅將手Η辨識成手Η以外之身 體部位（頭、手腕等），故不會如先前技術般使判斷邏輯複 雜化。 又’在實施形態中’將特定面積以上之白色區域判定為 手，但亦可將從白色區域之中心位置放射狀延伸之凸起為 1個以上者作為手之判定條件。 【圖式簡單說明】 圖1係顯示自動車之車室内之概略圖。 圖2係從駕駛者侧觀察儀錶板附近之前視圖。 圖3係圖2之3-3線放大剖面圖。 圖4係控制系統之方塊圖。 圖5(A)-(C)係簡略顯示從操作指令機構之待機模式，向 第1動作模式切換之操作過程之說明圖。 圖6(A)-(C)係簡略顯示從操作指令機構之第丨動作模式， 向第2動作模式切換之操作過程之說明圖。 圖7(A)、（B)係簡略顯示用於解除對車載機器之行馼中 操作之限制’使其即便在行驶中’駕驶者以外之同乘者亦 可對車載機器進行手動操作之說明圖》 圖8係顯示判定手之邏輯之方塊圖。 圖9係顯示亮度分佈圖之一例之圖。 圖10係顯示用於進行音量調整操作之操作程序之步驟概 A ret 蛋圖。 157325.doc • 20· 201239676 圖11係顯示用於進行來源選擇操作之操作程序之步驟概 要圖。 圖12係顯示用於進行專輯名.曲名之選擇操作之操作程 序之步驟概要圖。 圖13係用於進行對聲音檢索模式之轉移操作之操作程序 之步驟概要圖。 【主要元件符號說明】 1 操作部 2 味J 〇八護罩 3 輕條罩 AU 音頻（車載機器） C1 判定機構 C2 操作指令機構 C3 信號輸出部 C4 辨識機構 CA 相機（攝像機構） CN 汽車導航系統（車載機器） DVD 視訊（車載機器） Η 手 I 儀錄板 L 顯示部 M1-M7 複數個標記 PI 亮度分佈圖製作機才冓 P2 峰部判定機構 157325.doc -21- 201239676 Ρ3 臨限值設定機構 Ρ4 二值化圖像轉換機構 Ρ5 手判定機構 RC 第1區域 RL 第2區域 RR 第3區域 S 方向盤 Sa 中央輪殼部 Sbl〜Sb3 輻條部 SE1 轉向角度感測器 SE2 車速感測器 Sm 輪緣部 157325.doc ·22·The binarized image conversion mechanism p4 assigns all the pixels of the image captured by the camera CA according to the aforementioned threshold value, and binarizes the pixel which is brighter than the threshold value into a white color. The pixel darker than the threshold value is binarized to black. Thereby, the image of the camera CA 157325.doc •12· 201239676 is converted into a binarized image composed of two colors of white and black. Further, the hand determination mechanism Ρ5 determines a portion having an area of a specific value or more in the white area of the binarized image as the driver's hand. In this way, the brightness distribution map of the first region RC and the second and third regions RL and RR of the steering wheel S when the first mark M1 is covered by the handcuff is produced by the brightness profile creation means, and the peak portion determining mechanism is used. P2, determining the two peaks of the luminance profile as the threshold setting means p3, setting the threshold for determining the brightness of black and white between the two peaks, based on the binarized image conversion mechanism P4' The threshold value converts the image into a black and white binarized image, and the hand determination mechanism P5 determines the white area above the specific area of the binarized image as the handcuff, so that the brightness of the handcuff is greater than the steering wheel 3 If the brightness is relatively high, the steering wheel S can be surely binarized to black, and the hand η is binarized to an appropriate threshold of white, so that the determination accuracy can be greatly improved. Further, since the determination means C1 is in the standby mode while the operation command mechanism C2 is in the standby mode, based on the imaging data of the camera C, as shown in FIG. 5 (Α), the contour (circle) of the steering wheel body Sm is set as the monitoring target range. Next, as shown in FIG. 5(B), the i-th region M1 in the center is recognized. Therefore, in the identification, as shown in FIG. 5(C), the driver's hand H masks the first! When the river raft is marked, the situation can be quickly and surely recognized, and the identification result is output to the operation command mechanism C2', and the mechanism C2 is switched to the first operation mode. Further, since the determination means C1 is in the state of the first or second operation mode, the determination means C1 recognizes the second to seventh marks M2 to M7' of the spoke portions Sb1, Sb2 as shown in Fig. 6(A). Therefore, in this identification, for example, as shown in FIG. 6(B), when the driver's hand is covering a plurality of second marks (that is, the second to fifth marks 157325.doc •13·201239676, M2 to M5) The situation can be quickly and surely identified. Based on the recognition result, the operation command mechanism C2 switches to the second operation mode. Further, in the state of the second operation mode, as shown in FIG. 6(C), the driver's hand can be quickly and surely recognized to cover a plurality of third marks (ie, the sixth, seventh marks Μ6, Μ7). In the case of this, the identification result is output to the operation command mechanism c2. Further, in the case where the operation command mechanism C2 is in any mode, the recognition mechanism C4 can still recognize the contour of the steering wheel body Sm as the monitoring target range based on the image data of the camera CA as shown in Fig. 7(A). Further, when the operation command mechanism C2 is configured to determine that the automatic vehicle is running while the automatic vehicle is traveling while the identification mechanism C4 has not recognized the rim portion Sm having two handcuffs, the operation command mechanism C2 may be configured from the foregoing. At least a part of the operation signal of the operation unit 1 is invalid, and the identification mechanism C4 does not invalidate the operation signal when it is recognized that there are two hand rims on the rim portion Sm as shown in FIG. 7(B). Therefore, 'the same as before,' from the viewpoint of safe driving, it is possible to invalidate at least some of the manual operations of the operation units of the in-vehicle devices AU, DVD, and CN. However, in the running, the identification mechanism C4 can still recognize that there are two handcuffs on the rim portion Sm, since even if the operation k number is outputted from the aforementioned operation portion, it is considered to be an occupant operator other than the driver. Therefore, the operation command mechanism C2 does not invalidate the operation signal, but uses the operation of the occupant other than the driver to be effective. Thereby, even if the driver is driving, the driver can use the passengers other than the driver to operate the AU, DVD, and the line on the vehicle, as long as the driver holds the steering wheel S' with both hands, thereby improving the usability and convenience. When the operation command mechanism C2 is in the standby 掇+ & 愧褀 type, the first flag M1 is masked based on the determination mechanism 157325.doc 14 201239676 C1, and is switched to the first operation mode, and the first operation mode is switched. By masking one of the second to fifth marks M2 to M5, the operation target of the in-vehicle device can be arbitrarily selected (in the example, "sound,", video, audio "source", and album name are selected. "The choice of the title", and the "speech" of the sound detection mode of the car navigation system. Further, when the operation command means C2 determines that the second to fifth marks M2 to M" are masked based on the judgment mechanism ci, the operation command means C2 switches to the second operation mode 'in the second action In the mode, one of a plurality of operational parameters relating to the aforementioned operational object may be selected by masking one of the first and third hexagrams M6 and M7. The operational parameter refers to the operation object, and the operator should be more Specifically, in the example of the operation, the "volume" is selected by masking the second mark M2, and the sixth mark M6 and the cover seventh mark M7 are respectively associated with "the volume up amount is lowered". Further, by masking the third mark M3 to select the "source", the cover sixth mark M6 and the cover seventh mark M7 correspond to the "fast turn" and the "rewind" of the video, audio, and audio, respectively. Furthermore, by masking the fourth mark M4 and selecting "selection", the sixth mark M6 is masked for a long time (for example, 2 seconds), the sixth mark M6 is temporarily masked, and the seventh mark M7 is masked for a long time (for example, 2 seconds). And the short-covering of the 7th mark M7 corresponds to the "one-way progressive" of the album name, the "one-way progressive" of the title, the "other-direction progressive" of the album name, and the "other-direction progressive" of the title. Next, referring to Fig. 1 to Fig. 13, the operation procedure of the aforementioned operating device 157325.doc •15-201239676 will be more specifically described. [1] When the volume adjustment operation operation command mechanism C2 is in the standby mode, as shown in step S10 of FIG. 1A, the display unit L is a normal car navigation system screen, and the operator masks the first mark M1 from the state (step In the case of S11), the display of the mark M2 to M5 which should be selected and operated next is emphasized in the lower half of the face of the operation (step S12). Here, if the second mark M2 is masked (step S13) 'The broadcast with the "volume" simultaneously emphasizes the display of the marks M6 and M7 that should be operated next in the lower part of the screen (step SI4). Second, if a certain time (for example, 3 seconds) elapses, the current point is displayed. The volume is displayed (step S15). Here, if any one of the sixth mark M6 or the seventh mark M7 is masked (step S16), the volume adjustment is performed corresponding to the masked mark, and the adjusted volume display is displayed (step S17). [2] The source selection operation is as shown in FIG. 11, and the steps S20 to S22 are the same as the above steps si〇 to S12. If the third flag M3 is masked from the state of the step S22 (step S23), the "source selection" is used. At the same time, the broadcast emphasizes the display of the marks M6 and M7 which should be selected next in the lower part of the screen (step S24), and secondly, the right after the "specific time_3 seconds" is displayed. Selection of FF" is displayed) (Step S25) » Here, if either of the sixth mark M6 or the seventh mark M7 is masked (step s26), the direction corresponding to the mask "performs OFF, video, and audio" Or the gradual progress of the other direction and the source display of the selection is displayed simultaneously with the broadcast of the source selection (〇〇〇) (step S27) » 157325.doc 201239676 [3] The selection operation of the album name and the name of the song is shown in Fig. 12. It is to be noted that steps S30 to S32 are the same as steps § 10 to S12 described above, and if the fourth mark M4 is masked from the state of step S32 (step S33)', the "album name and song name selection" are simultaneously in the lower half of the screen. Emphasize that the next step should be to choose the operation Note M6, M7 of the display (step S34), and secondly, if a certain time passes (e.g., three seconds), the point appears in the current album name, song title display source (step S35). Therefore, if any one of the sixth mark M6 or the seventh mark M7 is masked for a long time (for example, 2 seconds), one of the album names is progressively progressive or the other direction is progressive (step S36), and if the sixth standard is temporarily masked If either one of the M6 or the seventh mark M7 is executed, one of the execution of the track name is progressive or the other direction is progressive (step S36), and the display of the re-selected album name and the title is displayed simultaneously with the execution (step S37). ). After the display is displayed, if it is idle for a specific time (for example, 5 seconds), the re-selected album name and song name will be determined. [4] The transfer operation to the sound search mode is as shown in FIG. 13, and steps S40 to S42 are the same as steps si to S12, and the operator masks the fifth mark M5 from the state of step S42 (step S43). At the same time, the car navigation system CN can be transferred to the previously known sound retrieval mode simultaneously with the "sound retrieval" broadcast. According to the present embodiment described above, it is possible to determine whether or not the plurality of marks M1 to M7 are individually masked for each mark based on the image data output from the camera CA, and the operation command mechanism C2 is based on the use of the determination means 〇. As a result of the determination by the determination means C1, an operation command (operation command signal) is output to the in-vehicle devices au, DVD, and CN, so that it is not only based on each 157325.doc 17 201239676 払=Μ1 M7 疋 No because of the operator's handcuffs from the camera ca By masking and correctly outputting the operation command to the in-vehicle devices AU, DVD, and CN, the operator's operation program can be easily determined, and the operator's identification difference can be effectively prevented from being erroneously operated. Further, the judgment logic of the operation command mechanism C2 is relatively simple, so that the cost can be obtained and the calculation processing can be performed quickly. Further, since the plurality of marks M1 to Μ7 are provided in the mounted member in the vehicle interior (in the illustrated example, the handle B is detachable from the steering wheel S, the spoke cover 3), and the cover 2 is not required. 3 or the steering wheel s is specially provided with a through hole for reading, so that not only the additional options are relatively easy, but also the degrees of freedom of the positions M1 to M7 and the position of the camera are increased, so that the grip can be easily and quickly performed. The driver of the steering wheel S covers the marking operation by hand. Moreover, the operator can only operate the command mechanism by masking the third mark M. Quickly and surely switch from the standby mode to the third operation mode. Further, in the first operation mode, only one of the plurality of markers M2 to M5 can be masked, and the in-vehicle device AU, DVD, and the vehicle can be quickly and surely selected. When the insertion operation command mechanism C2 is located in the second operation mode, the operation target of the CN can only cover one of the sixth and seventh marks M6 and M7, and quickly and surely select the operation target to be specified. A plurality of operational parameters, that is, one of the operational contents. However, the 'operation command mechanism C2' is in a state set in advance by the vehicle when the mechanism is in an arbitrary operation mode (in the illustrated example, the state is operated at a steering angle having a characteristic angle or more, or occurs sharply within a specific time. The state of the vehicle speed change, or the switch to either the first or the second move 157325.doc • 18 - 201239676 After the mode has elapsed for a certain period of time or more, the second to seventh marks M2 to m72 are idle, or In the first or second operation mode but in a state in which the operation of the first mark M1 is again masked, the mode is automatically switched to the standby mode. Therefore, due to a situation such as a special walking state in which driving should be concentrated during cornering or rapid acceleration, or a situation in which the driver is idle for a certain period of time or longer and the driver desires to immediately return to the standby mode, Since the operation command mechanism C2 automatically returns to the standby mode, in this case, the operation command mechanism C2 output command due to the operator's erroneous operation can be surely prevented from being over. Although the embodiment of the present invention has been described, The invention is not limited to the embodiments described above, and various design changes can be made without departing from the invention described in the claims. For example, in the embodiment, the i-th region Rc and the second and third regions rl and RR are set to be separated from each other, but may be set to be one continuous region. The setting method of the area is arbitrary, but the part thereof must include the first mark M1. Further, in the embodiment, the audio AU, the video DVD, the car navigation system CN, and the like may be operated by the device of the fourth aspect of the present invention. However, the present invention may also be used as an air-conditioning device such as an air conditioner or the like. TV, etc. Further, in the embodiment, the operation command machine is exemplified by the determination result of the determination mechanism cm to mask the values t£M1 to M7, and outputs an operation command (operation command signal) to the in-vehicle devices au, DVD, and CN, but the present invention also The operation command (operation command signal) can be output to the in-vehicle devices AU, DVD, and CN based on the determination logic that the determination mechanism ci masks the determination results of the marks M1 to M7 and the result of identifying the result of the recognition mechanism C4. ). Since the identification mechanism C4 recognizes only the handcuff as a body part (head, wrist, etc.) other than the handcuff even in this case, the judgment logic is not complicated as in the prior art. Further, in the embodiment, the white area having a specific area or more is determined as a hand, but one or more protrusions radially extending from the center position of the white area may be used as the hand determination condition. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a schematic view showing a car interior of an automatic car. Figure 2 is a front view of the vicinity of the dashboard as viewed from the driver's side. Figure 3 is an enlarged cross-sectional view taken along line 3-3 of Figure 2. Figure 4 is a block diagram of the control system. Fig. 5 (A) - (C) are explanatory diagrams schematically showing an operation procedure from the standby mode of the operation command mechanism to the first operation mode. 6(A) to 6(C) are explanatory diagrams schematically showing an operation procedure from the third operation mode of the operation command mechanism to the second operation mode. 7(A) and (B) show a brief description of the restriction on the operation of the in-vehicle device to make it possible to manually operate the in-vehicle device by a passenger other than the driver while driving. Figure 8 is a block diagram showing the logic of the decision hand. Fig. 9 is a view showing an example of a luminance distribution map. Figure 10 is a diagram showing the steps of the operation procedure for performing the volume adjustment operation. 157325.doc • 20· 201239676 Figure 11 shows a step-by-step diagram showing the operating procedures used to perform the source selection operation. Fig. 12 is a schematic diagram showing the steps of an operation procedure for performing a selection operation of a album name and a music name. Fig. 13 is a schematic diagram showing the steps of an operation procedure for performing a transfer operation to the sound retrieval mode. [Description of main component symbols] 1 Operation unit 2 Flavor J 〇8 Shield 3 Light bar cover AU Audio (vehicle device) C1 Judgment mechanism C2 Operation command mechanism C3 Signal output unit C4 Identification mechanism CA Camera (camera mechanism) CN Car navigation system (Vehicle equipment) DVD video (on-board equipment) Η Hand I instrument recorder L Display section M1-M7 Multiple markers PI brightness profile generator 冓 P2 Peak judgment mechanism 157325.doc -21- 201239676 Ρ3 Threshold setting Mechanism Ρ 4 Binary image conversion mechanism Ρ 5 Hand determination mechanism RC First region RL Second region RR Third region S Steering wheel Sa Central wheel housing portion Sb1 to Sb3 Spoke portion SE1 Steering angle sensor SE2 Vehicle speed sensor Sm wheel Edge 157325.doc ·22·