JP2011022945A5 - Interactive operation device - Google Patents
Interactive operation device Download PDFInfo
- Publication number
- JP2011022945A5 JP2011022945A5 JP2009169589A JP2009169589A JP2011022945A5 JP 2011022945 A5 JP2011022945 A5 JP 2011022945A5 JP 2009169589 A JP2009169589 A JP 2009169589A JP 2009169589 A JP2009169589 A JP 2009169589A JP 2011022945 A5 JP2011022945 A5 JP 2011022945A5
- Authority
- JP
- Japan
- Prior art keywords
- fingertip
- determined
- hand
- content
- projection screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002452 interceptive Effects 0.000 title claims description 6
- 238000001514 detection method Methods 0.000 claims description 11
- 230000003993 interaction Effects 0.000 claims description 2
Description
本発明は以上のような点を解決するためになされたものであって、本発明の課題は、閲覧者が道具を用いずに、また、投影台に仕掛けを施さずに、投影表示されたコンテンツに対して、対話操作装置を提供することである。 The present invention has been made in order to solve the above-described points, and the object of the present invention is that the viewer can project and display without using a tool and without setting a device on the projection table. for the content, it is to provide a dialogue operation equipment.
本発明は、以下の各態様に記載の手段により、前記課題を解決する。
すなわち、本願発明の第１の発明は、
コンテンツ投影画面データに基づく像を投影台に投影する投影機と、前記投影台を撮影して撮影画像を生成する赤外カメラと、が接続される対話操作装置において、
コンテンツ構成データを格納するコンテンツ格納領域と、
前記コンテンツ投影画面データを保持する表示画面保持領域と、
を備える記憶手段と、
前記コンテンツ構成データを解釈して、前記コンテンツ投影画面データを作成する表示閲覧手段と、
前記赤外カメラから前記撮影画像を取得する撮影画像取得手段と、
前記撮影画像の各フレームから閲覧者の指先を検知する指先検出手段と、
前記指先の座標を算出する指先位置算出手段と、
連続する前記各フレームの指先の座標を用いて当該指先の移動距離を算出して、所定の時間中の前記移動距離がゼロと判定された場合には、前記指先の座標を含む指先静止検知情報を作成する指先静止検知手段と、
前記指先静止検知情報に基づいて、入力イベント情報を生成して、前記表示閲覧手段に引き渡す入力エミュレーション手段と、
を備え、
前記表示閲覧手段は、前記入力エミュレーション手段から引き渡された入力イベント情報を受け付けて、適宜コンテンツ投影画面データを更新して、
前記指先検出手段は、前記コンテンツ投影画面の輪郭を構成する複数の辺のうち、手の前記撮影画像が接する一つの前記辺が、底辺、または、左辺、または、右辺、または、上辺のいずれの辺であるか否かを判定し、前記判定した辺が底辺である場合には手の最上部を指先と判定し、前記判定した辺が左辺である場合には手の最右部を指先と判定し、前記判定した辺が右辺である場合には手の最左部を指先と判定し、前記判定した辺が上辺である場合には手の最下部を指先と判定する、
ことを特徴とする対話操作装置である。
This invention solves the said subject by the means as described in each following aspect.
That is, the first invention of the present invention is :
A projector for projecting an image based on the content projection screen data to the projection stage, and an infrared camera to generate a captured image by capturing the projection stage, the interaction device is connected,
And a content storage area for storing the content configuration data,
A display screen holding area for holding the content projection screen data,
Storage means comprising :
Interprets the content member data, a display viewing means for creating the content projection screen data,
Captured image acquisition means for acquiring the captured image from the infrared camera;
And the fingertip detection means for detecting the fingertip of the viewer from each frame of the captured image,
And the fingertip position calculating means for calculating the coordinates of the fingertip,
And calculates the movement distance of the finger using the coordinates of the fingertip of each frame consecutive, when the moving distance during a predetermined time is determined to zero, the fingertip stationary detection information including coordinates of the fingertip Fingertip stationary detection means for creating
Based on the fingertip stationary detection information, and generates the input event information, an input emulation means to pass to the display viewing means,
With
The display browsing means receives the input event information delivered from the input emulation means, updates the content projection screen data as appropriate ,
The fingertip detecting means is one of a plurality of sides constituting the outline of the content projection screen, and one of the sides in contact with the captured image of the hand is a bottom side, a left side, a right side, or an upper side. It is determined whether or not it is a side, and when the determined side is the bottom side, the top of the hand is determined as the fingertip, and when the determined side is the left side, the rightmost part of the hand is the fingertip. determined, the determined sides is determined that the fingertip of the leftmost portion of the hand when it is right, it is determined that the fingertip of the bottom of the hand when the determined sides are the upper side,
This is an interactive operation device characterized by the above.
本願の第２の発明は、第１の発明に記載の前記指先検出手段は、
前記指先検出手段は、
手形画像が接するコンテンツ投影画面の辺が見つからなかった場合には、距離画像の最高輝度点を基準にして、移動して延びてきた手の側の辺と平行で最高輝度点を通る直線にて２分割される手形画像の輪郭のうち、手が移動してきた側の輪郭は探索しないで、最遠部を指先とする、
ことを特徴とする対話操作装置である。
According to a second aspect of the present invention, the fingertip detection means according to the first aspect is
The fingertip detection means includes
If the side of the content projection screen that touches the handprint image is not found, the straight line that passes through the maximum brightness point is parallel to the side of the hand that has been moved and extended based on the maximum brightness point of the distance image. Of the contours of the handprint image divided into two, without searching for the contour on the side where the hand has moved, the farthest part is the fingertip.
This is an interactive operation device characterized by the above.
Claims (2)
コンテンツ構成データを格納するコンテンツ格納領域と、
前記コンテンツ投影画面データを保持する表示画面保持領域と、
を備える記憶手段と、
前記コンテンツ構成データを解釈して、前記コンテンツ投影画面データを作成する表示閲覧手段と、
前記赤外カメラから前記撮影画像を取得する撮影画像取得手段と、
前記撮影画像の各フレームから閲覧者の指先を検知する指先検出手段と、
前記指先の座標を算出する指先位置算出手段と、
連続する前記各フレームの指先の座標を用いて当該指先の移動距離を算出して、所定の時間中の前記移動距離がゼロと判定された場合には、前記指先の座標を含む指先静止検知情報を作成する指先静止検知手段と、
前記指先静止検知情報に基づいて、入力イベント情報を生成して、前記表示閲覧手段に引き渡す入力エミュレーション手段と、
を備え、
前記表示閲覧手段は、前記入力エミュレーション手段から引き渡された入力イベント情報を受け付けて、適宜コンテンツ投影画面データを更新して、
前記指先検出手段は、前記コンテンツ投影画面の輪郭を構成する複数の辺のうち、手の前記撮影画像が接する一つの前記辺が、底辺、または、左辺、または、右辺、または、上辺のいずれの辺であるか否かを判定し、前記判定した辺が底辺である場合には手の最上部を指先と判定し、前記判定した辺が左辺である場合には手の最右部を指先と判定し、前記判定した辺が右辺である場合には手の最左部を指先と判定し、前記判定した辺が上辺である場合には手の最下部を指先と判定する、
ことを特徴とする対話操作装置。 A projector for projecting an image based on the content projection screen data to the projection stage, and an infrared camera to generate a captured image by capturing the projection stage, the interaction device is connected,
And a content storage area for storing the content configuration data,
A display screen holding area for holding the content projection screen data,
Storage means comprising :
Interprets the content member data, a display viewing means for creating the content projection screen data,
Captured image acquisition means for acquiring the captured image from the infrared camera;
And the fingertip detection means for detecting the fingertip of the viewer from each frame of the captured image,
And the fingertip position calculating means for calculating the coordinates of the fingertip,
And calculates the movement distance of the finger using the coordinates of the fingertip of each frame consecutive, when the moving distance during a predetermined time is determined to zero, the fingertip stationary detection information including coordinates of the fingertip Fingertip stationary detection means for creating
Based on the fingertip stationary detection information, and generates the input event information, an input emulation means to pass to the display viewing means,
With
The display browsing means receives the input event information delivered from the input emulation means, updates the content projection screen data as appropriate ,
The fingertip detecting means is one of a plurality of sides constituting the outline of the content projection screen, and one of the sides in contact with the captured image of the hand is a bottom side, a left side, a right side, or an upper side. It is determined whether or not it is a side, and when the determined side is the bottom side, the top of the hand is determined as the fingertip, and when the determined side is the left side, the rightmost part of the hand is the fingertip. determined, the determined sides is determined that the fingertip of the leftmost portion of the hand when it is right, it is determined that the fingertip of the bottom of the hand when the determined sides are the upper side,
An interactive operation device characterized by that.
前記指先検出手段は、The fingertip detection means includes
手形画像が接するコンテンツ投影画面の辺が見つからなかった場合には、距離画像の最高輝度点を基準にして、移動して延びてきた手の側の辺と平行で最高輝度点を通る直線にて２分割される手形画像の輪郭のうち、手が移動してきた側の輪郭は探索しないで、最遠部を指先とする、If the side of the content projection screen that touches the handprint image is not found, the straight line that passes through the maximum brightness point is parallel to the side of the hand that has been moved and extended based on the maximum brightness point of the distance image. Of the contours of the handprint image divided into two, do not search for the contour on the side where the hand has moved, and use the farthest part as the fingertip.
ことを特徴とする対話操作装置。An interactive operation device characterized by that.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009169589A JP5201096B2 (en) | 2009-07-17 | 2009-07-17 | Interactive operation device |
| PCT/JP2010/061747 WO2011007746A1 (en) | 2009-07-17 | 2010-07-12 | Fingertip-manipulation-type information providing system, interactive manipulation device, computer program, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009169589A JP5201096B2 (en) | 2009-07-17 | 2009-07-17 | Interactive operation device |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2011022945A JP2011022945A (en) | 2011-02-03 |
| JP2011022945A5 true JP2011022945A5 (en) | 2012-08-23 |
| JP5201096B2 JP5201096B2 (en) | 2013-06-05 |
Family
ID=43449353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2009169589A Expired - Fee Related JP5201096B2 (en) | 2009-07-17 | 2009-07-17 | Interactive operation device |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP5201096B2 (en) |
| WO (1) | WO2011007746A1 (en) |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012208926A (en) * | 2011-03-15 | 2012-10-25 | Nikon Corp | Detection device, input device, projector and electronic apparatus |
| CN102221887B (en) * | 2011-06-23 | 2016-05-04 | 康佳集团股份有限公司 | Interactive projection system and method |
| JP2013037420A (en) * | 2011-08-04 | 2013-02-21 | Dainippon Printing Co Ltd | Content display system, content display control method, content display control device, and program |
| JP2013206350A (en) * | 2012-03-29 | 2013-10-07 | Ntt Docomo Inc | Information processor, and method for correcting input place in the information processor |
| JP2013222317A (en) * | 2012-04-17 | 2013-10-28 | Toshiba Mach Co Ltd | Numerical control device |
| JP5174978B1 (en) * | 2012-04-26 | 2013-04-03 | 株式会社三菱東京Ｕｆｊ銀行 | Information processing apparatus, electronic device, and program |
| JP6049334B2 (en) * | 2012-07-12 | 2016-12-21 | キヤノン株式会社 | Detection apparatus, detection method, and program |
| JP6127564B2 (en) * | 2013-02-15 | 2017-05-17 | コニカミノルタ株式会社 | Touch determination device, touch determination method, and touch determination program |
| JP5991538B2 (en) | 2013-02-20 | 2016-09-14 | 富士ゼロックス株式会社 | Data processing apparatus, data processing system, and program |
| JP2014186715A (en) | 2013-02-21 | 2014-10-02 | Canon Inc | Information processing apparatus and information processing method |
| TW201510771A (en) | 2013-09-05 | 2015-03-16 | Utechzone Co Ltd | Pointing direction detecting device and its method, program and computer readable-medium |
| JP6303514B2 (en) * | 2014-01-14 | 2018-04-04 | 新日鐵住金株式会社 | Work information input system, information processing apparatus, control method thereof, and program |
| JP6340860B2 (en) * | 2014-01-21 | 2018-06-13 | セイコーエプソン株式会社 | POSITION DETECTION DEVICE, PROJECTOR, POSITION DETECTION SYSTEM, AND POSITION DETECTION DEVICE CONTROL METHOD |
| JP6335695B2 (en) * | 2014-07-09 | 2018-05-30 | キヤノン株式会社 | Information processing apparatus, control method therefor, program, and storage medium |
| JP2016091457A (en) | 2014-11-10 | 2016-05-23 | 富士通株式会社 | Input device, fingertip-position detection method, and computer program for fingertip-position detection |
| JP2016126160A (en) * | 2014-12-26 | 2016-07-11 | カシオ計算機株式会社 | Imaging device, imaging control method, and program |
| JP6786792B2 (en) * | 2015-12-03 | 2020-11-18 | セイコーエプソン株式会社 | Information processing device, display device, information processing method, and program |
| JP6808330B2 (en) * | 2016-02-26 | 2021-01-06 | キヤノン株式会社 | Information processing equipment, information processing methods, and programs |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3777650B2 (en) * | 1995-04-28 | 2006-05-24 | 松下電器産業株式会社 | Interface equipment |
| JP3834766B2 (en) * | 2000-04-03 | 2006-10-18 | 独立行政法人科学技術振興機構 | Man machine interface system |
| JP2005063092A (en) * | 2003-08-11 | 2005-03-10 | Keio Gijuku | Hand pattern switch device |
| JP4193895B2 (en) * | 2006-10-12 | 2008-12-10 | 横河電機株式会社 | Defect inspection equipment |
| JP2008152622A (en) * | 2006-12-19 | 2008-07-03 | Mitsubishi Electric Corp | Pointing device |
| JP4220555B2 (en) * | 2007-02-09 | 2009-02-04 | 株式会社日立製作所 | Table type information terminal |
| JP4513830B2 (en) * | 2007-06-25 | 2010-07-28 | ソニー株式会社 | Drawing apparatus and drawing method |
| JP4933389B2 (en) * | 2007-09-14 | 2012-05-16 | 株式会社リコー | Image projection display device, image projection display method, image projection display program, and recording medium |
-
2009
- 2009-07-17 JP JP2009169589A patent/JP5201096B2/en not_active Expired - Fee Related
-
2010
- 2010-07-12 WO PCT/JP2010/061747 patent/WO2011007746A1/en active Application Filing
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2011022945A5 (en) | Interactive operation device | |
| US9766711B2 (en) | Information processing apparatus, information processing method and program to recognize an object from a captured image | |
| US9329691B2 (en) | Operation input apparatus and method using distinct determination and control areas | |
| US9507411B2 (en) | Hand tracker for device with display | |
| US9734392B2 (en) | Image processing device and image processing method | |
| JP5201096B2 (en) | Interactive operation device | |
| CN104117201B (en) | Projection type billiard system gesture/club control system and its implementation | |
| US20130222427A1 (en) | System and method for implementing interactive augmented reality | |
| JP2015043154A5 (en) | ||
| TW201120681A (en) | Method and system for operating electric apparatus | |
| TWI506529B (en) | Display control system of sliding operation and method thereof | |
| JP2012185630A (en) | Projection device | |
| JP5817149B2 (en) | Projection device | |
| CN103609093A (en) | Interactive mobile phone | |
| CN105242776A (en) | Control method for intelligent glasses and intelligent glasses | |
| TWI486815B (en) | Display device, system and method for controlling the display device | |
| KR101426378B1 (en) | System and Method for Processing Presentation Event Using Depth Information | |
| JP2015108870A (en) | Operation input device, operation input program, and operation input method | |
| CN102253718B (en) | Three-dimensional hand-written inputting method | |
| CN202798838U (en) | Interacting cell phone | |
| US9489077B2 (en) | Optical touch panel system, optical sensing module, and operation method thereof | |
| US9251408B2 (en) | Gesture recognition module and gesture recognition method | |
| KR101374316B1 (en) | Apparatus for recognizing gesture by using see-through display and Method thereof | |
| CN103064564A (en) | Multi-touch based geographic information system | |
| CN203117946U (en) | Mobile terminal |