WO2024014131A1 - Non-contact input device - Google Patents

Non-contact input device Download PDF

Info

Publication number
WO2024014131A1
WO2024014131A1 PCT/JP2023/018848 JP2023018848W WO2024014131A1 WO 2024014131 A1 WO2024014131 A1 WO 2024014131A1 JP 2023018848 W JP2023018848 W JP 2023018848W WO 2024014131 A1 WO2024014131 A1 WO 2024014131A1
Authority
WO
WIPO (PCT)
Prior art keywords
hand
contact
interface screen
input device
user
Prior art date
Application number
PCT/JP2023/018848
Other languages
French (fr)
Japanese (ja)
Inventor
重樹 上田平
好正 斉藤
Original Assignee
インターマン株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターマン株式会社 filed Critical インターマン株式会社
Publication of WO2024014131A1 publication Critical patent/WO2024014131A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Definitions

  • the present invention relates to a non-contact input device that allows input operations to be performed without any trouble while looking at a screen.
  • pandemic caused by the new coronavirus has reminded people of how vulnerable societies are to infectious diseases in the 21st century, an age of increased population density and high-speed mass transportation. In such a situation, everything around us seems to be a source of infection, and living conditions become extremely difficult. In fact, amidst the spread of infection, we need to question everything.
  • Patent Document 1 since it is hygienic for a surgeon to touch a pointing device such as a computer mouse during surgery, a mouse on a non-contact remote pointer control device displayed using aerial imaging technology is disclosed. operate.
  • a special optical element for example, there is an optical imaging device described in Patent Document 2.
  • One of the typical applications of aerial imaging technology is a non-contact input device as described in Patent Document 1, but it is less convenient to use than actual mouse operation. . That is, when operating an aerial display using a real hand, the real hand inevitably covers the aerial display, blocking the display and making it difficult to see. On the other hand, in the case of normal mouse operations such as when working on a computer, only a small pointer is displayed on the display, so that the display can be viewed almost as it is. Therefore, operating an aerial display can be confusing compared to operating a normal mouse.
  • an object of the present invention is to provide a non-contact input device that does not block the display when inputting with the hand.
  • a non-contact input device includes: a display device that displays a non-contact interface screen; an operation space provided in a position that does not cover the non-contact interface screen; a detection device that detects a movement of a user's hand in the operation space in a non-contact manner, and when the detection device detects a movement of the user's hand in the operation space, the movement of the hand is detected by the non-contact interface.
  • the non-contact interface screen is displayed on the screen, and the non-contact interface screen is operated by the movement of the hand.
  • the user's hand movement displayed on the non-contact interface screen is a semi-transparent display, and the user can view the non-contact interface screen through the semi-transparent display. It is characterized by the ability to visually recognize the constituent elements.
  • the user's hand movement displayed on the non-contact interface screen is displayed as a pointer indicating the position of the fingertip of the index finger.
  • the operation space is located below the contactless interface screen.
  • the non-contact interface screen is an aerial display.
  • the non-contact input device when operating the non-contact interface screen, the user's hand does not block the screen, the user can input while checking the information on the screen, and the input operation can be done smoothly.
  • FIG. 1 is a perspective view showing a non-contact input device 1 in use according to an embodiment of the present invention.
  • FIG. 2 is a side view showing the non-contact input device 1 in use according to an embodiment of the present invention.
  • FIG. 3 is a diagram showing an example of a non-contact interface screen displayed on the non-contact input device 1 according to the embodiment of the present invention.
  • FIG. 4 is a diagram showing another example of the non-contact interface screen displayed on the non-contact input device 1 according to the embodiment of the present invention.
  • FIG. 5 is a diagram illustrating the operation of the non-contact interface screen shown in FIG. 4.
  • FIG. 6 is a diagram showing still another example of the non-contact interface screen displayed on the non-contact input device 1 according to the embodiment of the present invention.
  • FIG. 1 is a perspective view showing a non-contact input device 1 in use according to an embodiment of the present invention.
  • FIG. 2 is a side view showing the non-contact input device 1 in use according to an embodiment of the present invention.
  • FIG. 7 is a diagram illustrating the operation of the non-contact interface screen shown in FIG. 6.
  • FIG. 8 is a perspective view of a non-contact input device 5 in use according to another implementation of an embodiment of the present invention.
  • FIG. 9 is a side view showing the non-contact input device 1 in a folded state according to an embodiment of the present invention.
  • FIG. 10 is a front view showing the non-contact input device 1 according to the embodiment of the present invention in a folded state.
  • FIG. 11 is a rear view showing the non-contact input device 1 according to the embodiment of the present invention in a folded state.
  • FIG. 12 is a diagram showing a blackout curtain used in the non-contact input device 1 according to the embodiment of the present invention.
  • FIG. 13 is a perspective view showing the blackout curtain of FIG. 12 attached to the non-contact input device 1 according to the embodiment of the present invention.
  • FIG. 1 is a perspective view showing a non-contact input device 1 in use according to an embodiment of the present invention.
  • FIG. 2 is a side view showing the non-contact input device 1 in use according to an embodiment of the present invention.
  • the non-contact input device 1 includes a support substrate 10 on which an information processing device that performs overall signal processing is mounted, and a liquid crystal display 20 connected to the support substrate 10 via a hinge section 12. , consists of this liquid crystal display 20 and an optical plate 30 connected via a hinge portion 22.
  • the information processing device mounted on the support substrate 10 is essentially a small computer, and includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and a storage device that stores various programs and data. , input/output interfaces, etc.
  • a USB port 14 or a wireless LAN such as WIFI is implemented as the input/output interface.
  • the surface of the liquid crystal display 20 that faces the optical plate 30 is a display surface 24. That is, in the operable state of the non-contact input device 1 shown in FIGS. 1 and 2, the display surface 24 faces diagonally upward. Then, a non-contact interface is displayed on the display surface 24 based on the display data transmitted from the support substrate 10.
  • the non-contact interface here has components such as buttons, icons, menus, etc., and by operating these components, the user can input information to the system.
  • the optical plate 30 has an entrance surface 31 facing downward and facing the display surface 24 of the liquid crystal display 20, and an exit surface 33 facing directly above.
  • the image on the display surface 24 of the liquid crystal display 20 is then focused again on the opposite side at the same distance as the aerial display 4 to form the same image as the original image.
  • an optical imaging element described in JP-A No. 2011-175297 can be used.
  • This optical imaging element is realized by arranging a large number of mutually orthogonal planar light reflecting portions at a constant pitch.
  • a structure such as a two-sided corner reflector in which a reflective surface is formed on the side surface of a rectangular hole as described in Japanese Patent No. 4900618 may be used.
  • an infrared LED 32 and a pair of infrared cameras 34 are provided on the optical plate 30 near the hinge portion 22.
  • the infrared LED 32 and the infrared camera 34 constitute an operation detection unit that detects an operation on the aerial display 4 performed by the user.
  • the detection range of the operation detection section is defined by the emission angle of the infrared LED 32 and the angle of view of the infrared camera 34.
  • the support substrate 10, the liquid crystal display 20, and the optical plate 30 are connected by a hinge part 12 and a hinge part 22, respectively, and the non-contact input device 1 shown in FIGS. 1 and 2 is connected by a pair of left and right locking rods 40. is fixed in an operational state.
  • the locking rod 40 is rotatably supported by a shaft 42 provided at the center of the side surface of the liquid crystal display 20, and is rotatably supported by the engagement recess 16 of the support substrate 10 and the engagement recess 36 of the optical plate 30. It is possible to engage with.
  • the optical plate 30 In the operating state in which both ends of the locking rod 40 are engaged with the engagement recesses 16 of the support substrate 10 and the engagement recesses 36 of the optical plate 30, the optical plate 30 is supported horizontally, and the liquid crystal display 20 is mounted on the optical plate. 30 at an angle of approximately 45 degrees downward. Further, in this state of use, the liquid crystal display 20 and the support substrate 10 are fixed at an angle of about 45 degrees.
  • the angle between the liquid crystal display 20 and the optical plate 30 is about 45 degrees. At this angle, the light from the liquid crystal display 20 is imaged onto the aerial display 4 under optimal conditions. Furthermore, the angle between the liquid crystal display 20 and the supporting substrate 10 is about 45 degrees, and the optical plate 30 becomes horizontal at this angle. Specifically, about 45 degrees is preferably in the range of approximately 40 degrees to 50 degrees.
  • the operation interface When the operation interface is displayed on the liquid crystal display 20 in this state, it is imaged as the non-contact interface screen 4 on the opposite side of the optical plate 30.
  • a gesture such as touching with a finger is performed on this non-contact interface screen 4
  • the operation is detected by an operation detection unit consisting of an infrared LED 32 and an infrared camera 34, and a corresponding operation signal is sent to the information processing device of the support substrate 10.
  • the information is then sent to , and predetermined processing is performed.
  • Components of the operation interface include, for example, controls such as buttons, checkboxes, and drop-down menus.
  • an image sensor 48 is provided at the upper center of the back surface of the liquid crystal display 20, and an image sensor 49 is provided at the center inside the hinge portion 12.
  • the image sensor 48 images the space between the support substrate 10 and the liquid crystal display 20 (hereinafter referred to as the operation space S) from above, and the image sensor 49 images the space between the support substrate 10 and the liquid crystal display 20 (hereinafter referred to as the operation space S). imaged from the front.
  • These image sensors 48 and 49 detect the movement of the hand H inserted into the operation space S between the support substrate 10 and the liquid crystal display 20.
  • the hand H detected by these image sensors 48 and 49 is displayed on the display surface 24 of the liquid crystal display 20 and the aerial display 4 as a condensed image through the optical plate 30 thereof.
  • the outline H' of the hand H is displayed or is displayed semitransparently. The movement of the hand H allows the non-contact interface of the aerial display 4 to be operated using this hand H'.
  • the positions of five fingertips may be specified and an outline H' or a semi-transparent image of the hand H may be created on the aerial display 4 from there.
  • the simplest method is to specify only the fingertip position of the index finger and display one pointer on the aerial display 4.
  • the fingertip positions of the index finger and thumb may be specified and two pointers may be displayed on the aerial display 4, or five fingers may be displayed as five pointers on the aerial display 4. By moving these pointers, the non-contact interface of the aerial display 4 is operated.
  • the non-contact input device 1 of this embodiment there are two input methods to the non-contact input device 1 of this embodiment.
  • One is the conventional method of directly operating the non-contact interface displayed on the aerial display 4
  • the other is the conventional method of directly operating the non-contact interface displayed on the aerial display 4 by hand, but using the support substrate 10 and the liquid crystal display.
  • This is a method of operating the non-contact interface via the hand H' displayed on the aerial display 4 by moving the hand H in the operating space between the user and the user 20.
  • the infrared camera 34 detects a hand directly operating the non-contact interface displayed on the aerial display 4, input is accepted according to the operation.
  • the image sensors 48 and 49 detect a hand H, the corresponding movement of the hand H' is displayed on the aerial display 4 according to the movement, and input via this hand H' is accepted.
  • a pointer is displayed instead of the hand H', and input via this pointer is accepted.
  • the interface screen is a non-contact interface screen with simple button selection as shown in FIG. 3, it is easy to directly operate the aerial display 4 by hand.
  • the interface screen is a non-contact interface screen with simple button selection as shown in FIG. 3, it is easy to directly operate the aerial display 4 by hand.
  • the non-contact interface where multiple selections are made while reading characters as shown in FIG. Insert your hand into S.
  • the image sensors 48 and 49 detect the hand H, and display a pointer P on the aerial display 4 corresponding to the position of the index finger.
  • the user moves the index finger while looking at the pointer P on the aerial display 4 to align the pointer P with one of the check boxes.
  • the check box is selected.
  • the checkbox is deselected (see FIG. 5).
  • icon I indicates an image file.
  • the system prints the corresponding image on a printer (not shown).
  • the icon I is dropped on the display icon DP instead of the print icon PT, the corresponding image is displayed.
  • the infrared LED 32 and the infrared camera 34 may be omitted, and only the method of inserting a hand into the operation space S and indirectly operating the non-contact interface screen may be effective. In this case, since there is only one operation method, the user will not be confused. Furthermore, in this case, there is no need to implement an aerial display in terms of realizing a contactless interface. Therefore, the non-contact input device according to the present invention can be realized even if the system is constructed using only the liquid crystal display without using the aerial display device including the optical plate 30.
  • FIG. 8 shows a specific example of realizing a non-contact input device without using an aerial display device.
  • elements corresponding to each element of the non-contact input device of FIG. 1 are given the same reference numerals in this non-contact input device 5, and the description thereof will not be repeated.
  • the optical plate 30 in FIG. 1 is replaced by a liquid crystal display 60, and a support substrate 65 is provided at the position of the liquid crystal display 20 in FIG.
  • the liquid crystal display 60 is raised up to the position of the aerial display 4 in FIG. 1 and is supported at a position where the user can easily view it.
  • an image sensor 48 is provided at the upper center of the back surface of the support substrate 65, and an image sensor 49 is provided at the center inside the hinge portion 12.
  • the image sensor 48 images the operation space S from above, and the image sensor 49 images the operation space S between the support substrate 10 and the support substrate 65 from the front.
  • the hand H detected by these image sensors 48 and 49 is displayed on the liquid crystal display 60.
  • the outline H' of the hand H may be displayed, or may be displayed semitransparently, or the position of the fingertips may be displayed. or display a pointer corresponding to the .
  • the movement of the hand H enables the non-contact interface of the aerial display 4 to be operated using this hand H' as shown in FIGS. 4 to 7.
  • this non-contact input device 1 has excellent portability. That is, when carrying it, both ends of the locking rod 40 are removed from the engagement recess 16 of the support substrate 10 and the engagement recess 36 of the optical plate 30, and the support substrate 10, liquid crystal display 20, and optical plate 30 are attached to the hinge section 12. Then, they are rotated by the hinge part 22, and are horizontally arranged and overlapped small as shown in the side view of FIG. 9, the front view of FIG. 10, and the rear view of FIG. 11.
  • the non-contact input device is a portable type that can be folded into a small size and carried freely. You can do things like make online payments.
  • a speaker 18 can also be provided on the support substrate 10.
  • the user can be made aware of this with a click sound or the like.
  • guidance audio may be played back for users who are not used to the system.
  • a voice guidance is played that says, ⁇ Touch the button directly on the aerial display,'' and on the interface screen shown in Figure 4, the voice guidance is ⁇ Please touch the button on the lower support board.'' Move your index finger to align the cursor on the screen with the box to the left of the item you want to select.'' Voice guidance is played.
  • This blackout curtain 44 is for covering the space between the liquid crystal display 20 and the optical plate 30, and is composed of a left shielding portion 44L, a center shielding portion 44C, and a right shielding portion 44R.
  • the left shielding portion 44L covers the left opening between the liquid crystal display 20 and the optical plate 30, and the center shielding portion 44C covers the central opening between the liquid crystal display 20 and the optical plate 30, that is, the back surface.
  • the right shielding portion 44R covers the right opening between the liquid crystal display 20 and the optical plate 30.
  • a hook-and-loop fastener 46 is provided at the edge of the blackout curtain 44.
  • a hook-and-loop fastener is also provided on the corresponding surface of the non-contact input device 1.
  • the blackout curtain 44 and the hook-and-loop fastener of the non-contact input device 1 have one female fastener and the other male fastener, and as shown in FIG. 13, completely cover the space between the liquid crystal display 20 and the optical plate 30. It can be glued like this. Thereby, external light is not added to the light from the liquid crystal display 20, and a clearer aerial display 4 can be realized.
  • the blackout curtain 44 is attached here during use, it may be permanently fixed to the liquid crystal display 20 and the optical plate 30 without being attached or detached. In this case, when folding the non-contact input device 1, it is folded between the liquid crystal display 20 and the optical plate 30.
  • the folding method is, for example, a bellows fold, which is folded in a zigzag pattern like a fan.
  • the user's hand when operating a non-contact interface screen, the user's hand does not block the screen, the user can input while checking the information on the screen, and input operations can be performed smoothly.
  • a non-contact input device can be realized.
  • a liquid crystal display is used, but the present invention is not limited to this, and an organic EL display, electronic paper, etc. may be used.
  • a locking rod is used as a support structure for fixing the display and the optical panel, the present invention is not limited thereto.
  • a locking mechanism may be mounted on the hinge itself, or a shielding plate may be used instead of the blackout curtain, and this shielding plate may be used as a support structure for fixing the display and the optical panel.
  • Non-contact input device Aerial display 10 Support substrate 12 Hinge portion 14 Port 16 Engagement recess 18 Speaker 20 Liquid crystal display 22 Hinge portion 24 Display surface 30 Optical plate 31 Incident surface 32 Infrared LED 33 Output surface 34 Infrared camera 36 Engagement recess 40 Locking rod 42 Shaft 44 Blackout curtain 44C Center shielding part 44L Left shielding part 44R Right shielding part 46 Hook-and-loop fastener 48, 49 Image sensor

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

The present invention provides a non-contact input device that allows input operations to be performed smoothly.　This non-contact input device comprises: a display device that displays a non-contact interface screen; an operation space provided at a position that does not overlap the non-contact interface screen; and a detection device that detects a movement of a user's hand in the operation space in a non-contact manner. When the detection device detects a movement of a hand of a user in the operation space, the movement of the hand is displayed on the non-contact interface screen in the form of a translucent image or a pointer. This prevents a hand of a user from blocking the user's view of the non-contact interface screen when the user operates the screen, allowing the user to perform input while checking information on the screen.

Description

非接触入力装置Non-contact input device
　本発明は、画面を見ながら入力作業が支障なく行える非接触入力装置に関する。 The present invention relates to a non-contact input device that allows input operations to be performed without any trouble while looking at a screen.
　今般の新型コロナウイルスによって引き起こされたパンデミックは、人口密度があがり、高速大量輸送時代となった２１世紀が、いかに感染症に弱い社会であるかを人々に思い知らせることとなった。このような状況においては、身の回りのあらゆる物が感染源に思え、生活状況が非常に窮屈なものとなる。事実、感染拡大の中では、全てを疑ってかかる必要がある。 The pandemic caused by the new coronavirus has reminded people of how vulnerable societies are to infectious diseases in the 21st century, an age of increased population density and high-speed mass transportation. In such a situation, everything around us seems to be a source of infection, and living conditions become extremely difficult. In fact, amidst the spread of infection, we need to question everything.
　マスクを着用し、他人との距離を十分に取り、密集を避ける、といった対策を講じることが重要であるが、必要な社会生活を送る上で、どうしても最小限度の感染経路への接触は避けられない。このリスクをできるだけ小さくすることが感染を予防する上で肝要である。 It is important to take measures such as wearing a mask, keeping a sufficient distance from others, and avoiding crowds, but in order to have a necessary social life, it is absolutely necessary to avoid contact with infection routes to the minimum. do not have. It is important to minimize this risk in order to prevent infection.
　例えば、銀行のATM、スーパーのセルフレジ、企業の受け付け、ホテルのチェックインなどでは、不特定多数のユーザーが同じタッチパネルを操作することになる。このようなタッチパネルは、潜在的な感染経路となり得る。このリスクを回避するためには、ユーザーが変わる度にタッチパネルを消毒する必要が生じるが、そのような処置はかなり手間がかかり、十分に行うことが困難である。 For example, an unspecified number of users operate the same touch panel at bank ATMs, supermarket self-checkouts, corporate reception desks, hotel check-ins, etc. Such touch panels can be a potential route of infection. In order to avoid this risk, it is necessary to disinfect the touch panel every time the user changes, but such a procedure is quite time-consuming and difficult to perform satisfactorily.
　近年、このような状況において、特殊な光学素子を使用して空中に結像される空中像を非接触で指示できる技術が注目を集めている。この技術を用いることで、従来のタッチパネルを同様の使い勝手で、完全な非接触のインターフェースを実現できる。 In recent years, under such circumstances, a technology that uses special optical elements to point out an aerial image formed in the air without contact has been attracting attention. By using this technology, it is possible to create a completely contactless interface that is as easy to use as a conventional touch panel.
　例えば、特許文献１では、手術中に執刀医がコンピュータのマウス等のポインティングデバイスに触れるのは衛生上の問題があるため、空中結像技術を用いて表示した非接触遠隔ポインター制御装置上のマウスを操作する。このような特殊な光学素子としては、例えば、特許文献２に記載されている光学結像装置がある。 For example, in Patent Document 1, since it is hygienic for a surgeon to touch a pointing device such as a computer mouse during surgery, a mouse on a non-contact remote pointer control device displayed using aerial imaging technology is disclosed. operate. As such a special optical element, for example, there is an optical imaging device described in Patent Document 2.
特開２０１８－１４７０５４号公報Japanese Patent Application Publication No. 2018-147054 国際公開２００９／１３１１２８号公報International Publication No. 2009/131128
　このように空中結像技術の典型的な応用の一つは、特許文献１に記載されているような非接触入力装置であるが、実際のマウスの操作に比較して使い勝手が劣る面がある。すなわち、空中ディスプレイに現実の手を用いて操作を行う場合、どうしてもこの現実の手が空中ディスプレイに被ってしまい、表示を遮り見難くしてしまうという点である。これに対して、パソコン作業などでの通常のマウスの操作の場合では、小さなポインタのみがディスプレイに表示されるので、ディスプレイの表示は殆どそのまま視認される。従って、通常のマウスの操作に比較して、空中ディスプレイの操作は戸惑うことがある。 One of the typical applications of aerial imaging technology is a non-contact input device as described in Patent Document 1, but it is less convenient to use than actual mouse operation. . That is, when operating an aerial display using a real hand, the real hand inevitably covers the aerial display, blocking the display and making it difficult to see. On the other hand, in the case of normal mouse operations such as when working on a computer, only a small pointer is displayed on the display, so that the display can be viewed almost as it is. Therefore, operating an aerial display can be confusing compared to operating a normal mouse.
　そこで、本発明の目的は、手を用いて入力を行う際に、ディスプレイの表示を遮ることのない非接触入力装置を提供することである。 Therefore, an object of the present invention is to provide a non-contact input device that does not block the display when inputting with the hand.
　上記課題を解決するために、本発明の１つの様相による非接触入力装置は、非接触インターフェース画面を表示する表示装置と、前記非接触インターフェース画面に被らない位置に設けられた操作空間と、前記操作空間におけるユーザーの手の動きを非接触で検出する検出装置とを備え、前記検出装置が、前記操作空間におけるユーザーの手の動きを検出した場合に、この手の動きが前記非接触インターフェース画面に表示され、この手の動きによって前記非接触インターフェース画面の操作が行われることを特徴とする。 In order to solve the above problems, a non-contact input device according to one aspect of the present invention includes: a display device that displays a non-contact interface screen; an operation space provided in a position that does not cover the non-contact interface screen; a detection device that detects a movement of a user's hand in the operation space in a non-contact manner, and when the detection device detects a movement of the user's hand in the operation space, the movement of the hand is detected by the non-contact interface. The non-contact interface screen is displayed on the screen, and the non-contact interface screen is operated by the movement of the hand.
　また、一つの実施例では、前記非接触インターフェース画面に表示されるユーザーの手の動きは、半透明の表示となっており、ユーザーは、この半透明の表示ごしに前記非接触インターフェース画面を構成する要素を視認できることを特徴とする。 Further, in one embodiment, the user's hand movement displayed on the non-contact interface screen is a semi-transparent display, and the user can view the non-contact interface screen through the semi-transparent display. It is characterized by the ability to visually recognize the constituent elements.
　更に、一つの実施例では、前記非接触インターフェース画面に表示されるユーザーの手の動きは、人差し指の指先の位置を示すポインタで表示されることを特徴とする。 Further, in one embodiment, the user's hand movement displayed on the non-contact interface screen is displayed as a pointer indicating the position of the fingertip of the index finger.
　更に、一つの実施例では、前記操作空間は、前記非接触インターフェース画面の下方に位置していることを特徴とする。 Furthermore, in one embodiment, the operation space is located below the contactless interface screen.
　更に、一つの実施例では、前記非接触インターフェース画面は、空中ディスプレイであることを特徴とする。 Furthermore, in one embodiment, the non-contact interface screen is an aerial display.
　本発明に係わる非接触入力装置によれば、非接触インターフェース画面を操作する際に、ユーザーの手が画面を遮ることがなく、画面上の情報を確認しながら入力を行うことができ、入力操作をスムーズに行うことができる。 According to the non-contact input device according to the present invention, when operating the non-contact interface screen, the user's hand does not block the screen, the user can input while checking the information on the screen, and the input operation can be done smoothly.
図１は、本発明の実施例による使用状態の非接触入力装置１を示す斜視図である。FIG. 1 is a perspective view showing a non-contact input device 1 in use according to an embodiment of the present invention. 図２は、本発明の実施例による使用状態の非接触入力装置１を示す側面図である。FIG. 2 is a side view showing the non-contact input device 1 in use according to an embodiment of the present invention. 図３は、本発明の実施例による非接触入力装置１で表示される非接触インタフェース画面の一例を示す図である。FIG. 3 is a diagram showing an example of a non-contact interface screen displayed on the non-contact input device 1 according to the embodiment of the present invention. 図４は、本発明の実施例による非接触入力装置１で表示される非接触インタフェース画面の別の例を示す図である。FIG. 4 is a diagram showing another example of the non-contact interface screen displayed on the non-contact input device 1 according to the embodiment of the present invention. 図５は、図４に示した非接触インタフェース画面の操作を説明する図である。FIG. 5 is a diagram illustrating the operation of the non-contact interface screen shown in FIG. 4. 図６は、本発明の実施例による非接触入力装置１で表示される非接触インタフェース画面の更に別の例を示す図である。FIG. 6 is a diagram showing still another example of the non-contact interface screen displayed on the non-contact input device 1 according to the embodiment of the present invention. 図７は、図６に示した非接触インタフェース画面の操作を説明する図である。FIG. 7 is a diagram illustrating the operation of the non-contact interface screen shown in FIG. 6. 図８は、本発明の実施例の別の実装による使用状態の非接触入力装置５を示す斜視図である。FIG. 8 is a perspective view of a non-contact input device 5 in use according to another implementation of an embodiment of the present invention. 図９は、本発明の実施例による非接触入力装置１の折り畳んだ状態を示す側面図である。FIG. 9 is a side view showing the non-contact input device 1 in a folded state according to an embodiment of the present invention. 図１０は、本発明の実施例による非接触入力装置１の折り畳んだ状態を示す正面図である。FIG. 10 is a front view showing the non-contact input device 1 according to the embodiment of the present invention in a folded state. 図１１は、本発明の実施例による非接触入力装置１の折り畳んだ状態を示す背面図である。FIG. 11 is a rear view showing the non-contact input device 1 according to the embodiment of the present invention in a folded state. 図１２は、本発明の実施例による非接触入力装置１で用いる暗幕を示す図である。FIG. 12 is a diagram showing a blackout curtain used in the non-contact input device 1 according to the embodiment of the present invention. 図１３は、本発明の実施例による非接触入力装置１に図１２の暗幕を取り付けた様子を示す斜視図である。FIG. 13 is a perspective view showing the blackout curtain of FIG. 12 attached to the non-contact input device 1 according to the embodiment of the present invention.
　以下、添付図面を参照しながら、本発明による非接触入力装置の実施例を説明する。図１は、本発明の実施例による使用状態の非接触入力装置１を示す斜視図である。図２は、本発明の実施例による使用状態の非接触入力装置１を示す側面図である。 Hereinafter, embodiments of the non-contact input device according to the present invention will be described with reference to the accompanying drawings. FIG. 1 is a perspective view showing a non-contact input device 1 in use according to an embodiment of the present invention. FIG. 2 is a side view showing the non-contact input device 1 in use according to an embodiment of the present invention.
　これらの図に示したように、非接触入力装置１は、全体の信号処理を行う情報処理装置を実装した支持基板１０と、この支持基板１０とヒンジ部１２を介して接続した液晶ディスプレイ２０と、この液晶ディスプレイ２０とヒンジ部２２を介して接続した光学プレート３０とからなっている。 As shown in these figures, the non-contact input device 1 includes a support substrate 10 on which an information processing device that performs overall signal processing is mounted, and a liquid crystal display 20 connected to the support substrate 10 via a hinge section 12. , consists of this liquid crystal display 20 and an optical plate 30 connected via a hinge portion 22.
　支持基板１０に実装された情報処理装置は、実質的に小型コンピュータでありＣＰＵ（Central Processing Unit）、ＲＯＭ（Read Only Memory）、ＲＡＭ（Random Access Memory）、各種プログラム及びデータ等を記憶する記憶装置、入出力インタフェース等により構成されている。入出力インタフェースとしては、例えば、ＵＳＢポート１４やＷＩＦＩなどの無線ＬＡＮなどが実装される。 The information processing device mounted on the support substrate 10 is essentially a small computer, and includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and a storage device that stores various programs and data. , input/output interfaces, etc. As the input/output interface, for example, a USB port 14 or a wireless LAN such as WIFI is implemented.
　液晶ディスプレイ２０は、光学プレート３０と向き合う面が表示面２４となっている。すなわち、図１および図２に示した非接触入力装置１の動作可能状態において、表示面２４は斜め上向きとなっている。そして、支持基板１０から送信された表示データに基づいて、表示面２４に非接触インタフェースを表示する。ここでの非接触インタフェースとは、ボタン、アイコン、メニューなどを構成要素とするものであり、これらの構成要素を操作することでユーザーはシステムへの入力を行うことができる。 The surface of the liquid crystal display 20 that faces the optical plate 30 is a display surface 24. That is, in the operable state of the non-contact input device 1 shown in FIGS. 1 and 2, the display surface 24 faces diagonally upward. Then, a non-contact interface is displayed on the display surface 24 based on the display data transmitted from the support substrate 10. The non-contact interface here has components such as buttons, icons, menus, etc., and by operating these components, the user can input information to the system.
　光学プレート３０は、入射面３１が下向きとなって液晶ディスプレイ２０の表示面２４に向き合い、出射面３３が真上を向いている。そして、液晶ディスプレイ２０の表示面２４の映像は、その反対側の同じ距離の位置に空中ディスプレイ４として再び集光し元と同じ像を形成する。 The optical plate 30 has an entrance surface 31 facing downward and facing the display surface 24 of the liquid crystal display 20, and an exit surface 33 facing directly above. The image on the display surface 24 of the liquid crystal display 20 is then focused again on the opposite side at the same distance as the aerial display 4 to form the same image as the original image.
　このような光学プレート３０としては、例えば特開２０１１－１７５２９７号に記載されている光学結像素子を用いることができる。この光学結像素子は、互いに直交する平面光反射部を一定のピッチで多数並べることで実現される。この他にも、特許第４９００６１８号に記載されているような四角形状の穴の側面に反射面が形成された２面コーナリフレクタ等の構造を用いてもよい。 As such an optical plate 30, for example, an optical imaging element described in JP-A No. 2011-175297 can be used. This optical imaging element is realized by arranging a large number of mutually orthogonal planar light reflecting portions at a constant pitch. In addition, a structure such as a two-sided corner reflector in which a reflective surface is formed on the side surface of a rectangular hole as described in Japanese Patent No. 4900618 may be used.
　また、ヒンジ部２２近傍の光学プレート３０には、赤外線ＬＥＤ３２と、一対の赤外線カメラ３４が設けられている。この赤外線ＬＥＤ３２と赤外線カメラ３４により、ユーザーが行う空中ディスプレイ４に対する操作を検出する操作検出部が構成される。操作検出部の検出範囲は、赤外線ＬＥＤ３２の出射角と赤外線カメラ３４の画角によって規定される。 Furthermore, an infrared LED 32 and a pair of infrared cameras 34 are provided on the optical plate 30 near the hinge portion 22. The infrared LED 32 and the infrared camera 34 constitute an operation detection unit that detects an operation on the aerial display 4 performed by the user. The detection range of the operation detection section is defined by the emission angle of the infrared LED 32 and the angle of view of the infrared camera 34.
　支持基板１０、液晶ディスプレイ２０および光学プレート３０は、夫々にヒンジ部１２およびヒンジ部２２で接続しているが、左右一対の係止ロッド４０によって図１および図２に示した非接触入力装置１の動作可能状態に固定されている。 The support substrate 10, the liquid crystal display 20, and the optical plate 30 are connected by a hinge part 12 and a hinge part 22, respectively, and the non-contact input device 1 shown in FIGS. 1 and 2 is connected by a pair of left and right locking rods 40. is fixed in an operational state.
　すなわち、係止ロッド４０は、液晶ディスプレイ２０の側面の中央に設けられた軸４２によって、回動可能に枢支されており、支持基板１０の係合凹部１６および光学プレート３０の係合凹部３６と係合可能となっている。係止ロッド４０の両端が、支持基板１０の係合凹部１６および光学プレート３０の係合凹部３６と係合した使用状態では、光学プレート３０は水平に支持されており、液晶ディスプレイ２０は光学プレート３０に対して下方約４５度の角度に固定されている。また、この使用状態において、液晶ディスプレイ２０と支持基板１０は、約４５度の角度に固定される。 That is, the locking rod 40 is rotatably supported by a shaft 42 provided at the center of the side surface of the liquid crystal display 20, and is rotatably supported by the engagement recess 16 of the support substrate 10 and the engagement recess 36 of the optical plate 30. It is possible to engage with. In the operating state in which both ends of the locking rod 40 are engaged with the engagement recesses 16 of the support substrate 10 and the engagement recesses 36 of the optical plate 30, the optical plate 30 is supported horizontally, and the liquid crystal display 20 is mounted on the optical plate. 30 at an angle of approximately 45 degrees downward. Further, in this state of use, the liquid crystal display 20 and the support substrate 10 are fixed at an angle of about 45 degrees.
　この液晶ディスプレイ２０と光学プレート３０の角度が約４５度であるということは重要である。この角度で、液晶ディスプレイ２０からの光が最適な条件で空中ディスプレイ４に結像されるのである。また、液晶ディスプレイ２０と支持基板１０とが約４５度であり、この角度で光学プレート３０が水平となる。詳しく言えば、約４５度というのは、概ね４０度から５０度の範囲であることが望ましい。 It is important that the angle between the liquid crystal display 20 and the optical plate 30 is about 45 degrees. At this angle, the light from the liquid crystal display 20 is imaged onto the aerial display 4 under optimal conditions. Furthermore, the angle between the liquid crystal display 20 and the supporting substrate 10 is about 45 degrees, and the optical plate 30 becomes horizontal at this angle. Specifically, about 45 degrees is preferably in the range of approximately 40 degrees to 50 degrees.
　このような状態で、液晶ディスプレイ２０に操作インターフェースを表示すると、それが光学プレート３０の反対側に、非接触インターフェース画面４として結像される。この非接触インターフェース画面４に対して、指で触れるなどジェスチャーを行うと、その操作が、赤外線ＬＥＤ３２と赤外線カメラ３４からなる操作検出部が検出し、対応する操作信号が支持基板１０の情報処理装置へ送られ、所定の処理がなされる。操作インターフェースの構成要素としては、例えば、ボタンやチェックボックス、ドロップダウンメニューなどのコントロールが含まれる。 When the operation interface is displayed on the liquid crystal display 20 in this state, it is imaged as the non-contact interface screen 4 on the opposite side of the optical plate 30. When a gesture such as touching with a finger is performed on this non-contact interface screen 4, the operation is detected by an operation detection unit consisting of an infrared LED 32 and an infrared camera 34, and a corresponding operation signal is sent to the information processing device of the support substrate 10. The information is then sent to , and predetermined processing is performed. Components of the operation interface include, for example, controls such as buttons, checkboxes, and drop-down menus.
　更に本発明による非接触入力装置１においては、液晶ディスプレイ２０の裏面の上方中央に撮像素子４８と、ヒンジ部１２の内側中央に撮像素子４９が設けられている。撮像素子４８は、支持基板１０と液晶ディスプレイ２０との間の空間（以下、操作空間Ｓという）を上方から撮像し、撮像素子４９は、支持基板１０と液晶ディスプレイ２０との間の操作空間Ｓを前方から撮像する。これら撮像素子４８、４９によって、支持基板１０と液晶ディスプレイ２０との間の操作空間Ｓに挿入された手Ｈの動きを検出する。 Further, in the non-contact input device 1 according to the present invention, an image sensor 48 is provided at the upper center of the back surface of the liquid crystal display 20, and an image sensor 49 is provided at the center inside the hinge portion 12. The image sensor 48 images the space between the support substrate 10 and the liquid crystal display 20 (hereinafter referred to as the operation space S) from above, and the image sensor 49 images the space between the support substrate 10 and the liquid crystal display 20 (hereinafter referred to as the operation space S). imaged from the front. These image sensors 48 and 49 detect the movement of the hand H inserted into the operation space S between the support substrate 10 and the liquid crystal display 20.
　これら撮像素子４８、４９によって検出された手Ｈは、液晶ディスプレイ２０の表示面２４と、その光学プレート３０ごしの集光像としての空中ディスプレイ４に表示される。ただし、空中ディスプレイ４に表示される非接触インタフェースを遮らないように、手Ｈの輪郭Ｈ’のみを表示したり又は半透明に表示される。手Ｈの動作によって、この手Ｈ’を用いた空中ディスプレイ４の非接触インタフェースの操作が可能となる。 The hand H detected by these image sensors 48 and 49 is displayed on the display surface 24 of the liquid crystal display 20 and the aerial display 4 as a condensed image through the optical plate 30 thereof. However, in order not to block the non-contact interface displayed on the aerial display 4, only the outline H' of the hand H is displayed or is displayed semitransparently. The movement of the hand H allows the non-contact interface of the aerial display 4 to be operated using this hand H'.
　操作空間Ｓでの手Ｈの検出方法として、例えば、五つの指先の位置を特定して、そこから空中ディスプレイ４上に手Ｈの輪郭Ｈ’や半透明映像を作成しても良い。または、輪郭や半透明映像ではなく、指先を示すポインタのみを空中ディスプレイ４上に表示することも応用によって有効である。この場合、最もシンプルな方法では、人差し指の指先位置のみを特定して、一つのポインタを空中ディスプレイ４上に表示する。あるいは、人差し指と親指の指先位置を特定して、二つのポインタを空中ディスプレイ４上に表示するとか、五本の指を五つのポインタとして空中ディスプレイ４上に表示するようにしてもよい。これらのポインタを動かすことで、空中ディスプレイ４の非接触インタフェースの操作を行う。 As a method of detecting the hand H in the operation space S, for example, the positions of five fingertips may be specified and an outline H' or a semi-transparent image of the hand H may be created on the aerial display 4 from there. Alternatively, it may be effective depending on the application to display only the pointer indicating the fingertip on the aerial display 4 instead of the outline or semi-transparent image. In this case, the simplest method is to specify only the fingertip position of the index finger and display one pointer on the aerial display 4. Alternatively, the fingertip positions of the index finger and thumb may be specified and two pointers may be displayed on the aerial display 4, or five fingers may be displayed as five pointers on the aerial display 4. By moving these pointers, the non-contact interface of the aerial display 4 is operated.
　従って、本件実施例の非接触入力装置１への入力方法としては、２系統存在することになる。一つは空中ディスプレイ４に表示された非接触インタフェースに直接操作する従来の方法であり、もう一つは空中ディスプレイ４に手で直接非接触インタフェースを操作するのではなく、支持基板１０と液晶ディスプレイ２０との間の操作空間で手Ｈを動かすことで、空中ディスプレイ４に表示された手Ｈ’を介して非接触インタフェースを操作方法である。 Therefore, there are two input methods to the non-contact input device 1 of this embodiment. One is the conventional method of directly operating the non-contact interface displayed on the aerial display 4, and the other is the conventional method of directly operating the non-contact interface displayed on the aerial display 4 by hand, but using the support substrate 10 and the liquid crystal display. This is a method of operating the non-contact interface via the hand H' displayed on the aerial display 4 by moving the hand H in the operating space between the user and the user 20.
　すなわち、赤外線カメラ３４が、空中ディスプレイ４に表示された非接触インタフェースを直接操作する手を検出した場合には、その操作に従って入力を受け付ける。一方で、撮像素子４８、４９が手Ｈを検出した場合には、その動作に従って空中ディスプレイ４中に対応する手Ｈ’の動きを表示し、この手Ｈ’を介した入力を受け付ける。または、手Ｈ’の代わりにポインタを表示し、このポインタを介した入力を受け付ける。 That is, when the infrared camera 34 detects a hand directly operating the non-contact interface displayed on the aerial display 4, input is accepted according to the operation. On the other hand, when the image sensors 48 and 49 detect a hand H, the corresponding movement of the hand H' is displayed on the aerial display 4 according to the movement, and input via this hand H' is accepted. Alternatively, a pointer is displayed instead of the hand H', and input via this pointer is accepted.
　例えば、図３に示したような単純なボタンの選択のような非接触インタフェース画面であれば、手で空中ディスプレイ４を直接操作するのが簡単である。一方で、図４に示したような文字を読みながら複数の選択を行うような非接触インタフェースの場合（ここではチェックボックス）には、ユーザーは支持基板１０と液晶ディスプレイ２０との間の操作空間Ｓに手を挿入する。 For example, if the interface screen is a non-contact interface screen with simple button selection as shown in FIG. 3, it is easy to directly operate the aerial display 4 by hand. On the other hand, in the case of a non-contact interface where multiple selections are made while reading characters as shown in FIG. Insert your hand into S.
　すると、撮像素子４８、４９が手Ｈを検出して、その人差し指の位置に対応して空中ディスプレイ４中にポインタＰを表示する。ユーザーは、空中ディスプレイ４中のポインタＰを見ながら、人差し指を移動させてポインタＰをチェックボックスの一つに合わせる。そして、ポインタＰをチェックボックスの一つに合わせた状態で、一定時間（例えば３秒以上）そのまま留めるとチェックボックスが選択される。また、ポインタＰを選択されたチェックボックス合わせた状態で、一定時間（例えば３秒以上）そのまま留めるとチェックボックスの選択が解除される（図５参照）。このような方法では、チェックボックスのテキストはユーザーの手によって隠れないので、内容を確認しながら選択が可能となっている。 Then, the image sensors 48 and 49 detect the hand H, and display a pointer P on the aerial display 4 corresponding to the position of the index finger. The user moves the index finger while looking at the pointer P on the aerial display 4 to align the pointer P with one of the check boxes. Then, when the pointer P is placed on one of the check boxes and held there for a certain period of time (for example, 3 seconds or more), the check box is selected. Furthermore, if the pointer P is held on a selected checkbox for a certain period of time (for example, 3 seconds or more), the checkbox is deselected (see FIG. 5). With this method, the text of the checkbox is not hidden by the user's hand, allowing the user to check the contents while making a selection.
　図６に示した別の例では、撮像素子４８、４９が手Ｈを検出した場合には、人差し指と親指の位置を特定して、空中ディスプレイ４の非接触インタフェース画面に、二つのポインタＰ１、Ｐ２を表示する。これら二つのポインタＰ１、Ｐ２は、人差し指と親指の位置の動きに従って移動する。 In another example shown in FIG. 6, when the image sensors 48 and 49 detect a hand H, the positions of the index finger and thumb are specified and two pointers P1, P1, and P1 are displayed on the non-contact interface screen of the aerial display 4. Display P2. These two pointers P1 and P2 move according to the movement of the index finger and thumb positions.
　ユーザーは、空中ディスプレイ４の画面に表示されたポインタＰ１、Ｐ２を見ながら、人差し指と親指を動かして、画面上のアイコンＩをポインタＰ１、Ｐ２でつまむようにし、アイコンＩを印刷アイコンＰＴにドロップする（図７参照）。ここでは、アイコンＩは画像ファイルを示している。この動きを検出したら、システムはプリンタ（図不示）で対応する画像の印刷を行う。アイコンＩを印刷アイコンＰＴの代わりに表示アイコンＤＰにドロップした場合には、対応する画像の表示を行う。 While looking at the pointers P1 and P2 displayed on the screen of the aerial display 4, the user moves his index finger and thumb to pinch the icon I on the screen with the pointers P1 and P2, and drops the icon I onto the print icon PT. (See Figure 7). Here, icon I indicates an image file. Upon detecting this movement, the system prints the corresponding image on a printer (not shown). When the icon I is dropped on the display icon DP instead of the print icon PT, the corresponding image is displayed.
　上記の通り、本発明による非接触入力装置の実施例では、手で空中ディスプレイ４を直接操作する方法と、下方に設けられた操作空間Ｓに手を挿入して間接的に非接触インタフェース画面を操作する方法の両方が利用できる。 As described above, in the embodiment of the non-contact input device according to the present invention, there are two methods: directly operating the aerial display 4 with your hand, and indirectly operating the non-contact interface screen by inserting your hand into the operation space S provided below. Both methods of operation are available.
　しかし、赤外線ＬＥＤ３２と赤外線カメラ３４を省略して、操作空間Ｓに手を挿入して間接的に非接触インタフェース画面を操作する方法のみを有効としても良い。この場合、操作方法が一つなので、ユーザーは混乱することがない。また、この場合、非接触インタフェースの実現という意味では、空中ディスプレイを実装する必然性はなくなる。従って、光学プレート３０を含む空中ディスプレイ表示装置を用いずに、液晶ディスプレイのみでシステムを構築しても本発明による非接触入力装置を実現できる。 However, the infrared LED 32 and the infrared camera 34 may be omitted, and only the method of inserting a hand into the operation space S and indirectly operating the non-contact interface screen may be effective. In this case, since there is only one operation method, the user will not be confused. Furthermore, in this case, there is no need to implement an aerial display in terms of realizing a contactless interface. Therefore, the non-contact input device according to the present invention can be realized even if the system is constructed using only the liquid crystal display without using the aerial display device including the optical plate 30.
　図８に空中ディスプレイ表示装置を用いずに非接触入力装置を実現した具体例を示す。ここで、図１の非接触入力装置の各要素に対応する要素には、この非接触入力装置５でも同様の参照符号を付してその説明を繰り返さない。ここで、図１の光学プレート３０は液晶ディスプレイ６０で置き換わっており、図１の液晶ディスプレイ２０の位置には、支持基板６５が設けられている。ただし、液晶ディスプレイ６０は、図１の空中ディスプレイ４の位置まで立ち上がった状態で、ユーザーが見やすい位置に支持されている。 FIG. 8 shows a specific example of realizing a non-contact input device without using an aerial display device. Here, elements corresponding to each element of the non-contact input device of FIG. 1 are given the same reference numerals in this non-contact input device 5, and the description thereof will not be repeated. Here, the optical plate 30 in FIG. 1 is replaced by a liquid crystal display 60, and a support substrate 65 is provided at the position of the liquid crystal display 20 in FIG. However, the liquid crystal display 60 is raised up to the position of the aerial display 4 in FIG. 1 and is supported at a position where the user can easily view it.
　やはり、非接触入力装置５においても、支持基板６５の裏面の上方中央に撮像素子４８と、ヒンジ部１２の内側中央に撮像素子４９が設けられている。撮像素子４８は、操作空間Ｓを上方から撮像し、撮像素子４９は、支持基板１０と支持基板６５との間の操作空間Ｓを前方から撮像する。これら撮像素子４８、４９によって、操作空間Ｓに挿入された手Ｈの動きを検出する。 Similarly, in the non-contact input device 5, an image sensor 48 is provided at the upper center of the back surface of the support substrate 65, and an image sensor 49 is provided at the center inside the hinge portion 12. The image sensor 48 images the operation space S from above, and the image sensor 49 images the operation space S between the support substrate 10 and the support substrate 65 from the front. These image sensors 48 and 49 detect the movement of the hand H inserted into the operation space S.
　これら撮像素子４８、４９によって検出された手Ｈは、液晶ディスプレイ６０に表示される。ただし、図１に示した例と同様に、液晶ディスプレイ６０に表示される非接触インタフェースを遮らないように、手Ｈの輪郭Ｈ’のみを表示したり又は半透明に表示したり、指先の位置に対応するポインタを表示したりする。手Ｈの動作によって、図４乃至図７に示したような、この手Ｈ’を用いた空中ディスプレイ４の非接触インタフェースの操作が可能となる。 The hand H detected by these image sensors 48 and 49 is displayed on the liquid crystal display 60. However, similar to the example shown in FIG. 1, in order not to obstruct the non-contact interface displayed on the liquid crystal display 60, only the outline H' of the hand H may be displayed, or may be displayed semitransparently, or the position of the fingertips may be displayed. or display a pointer corresponding to the . The movement of the hand H enables the non-contact interface of the aerial display 4 to be operated using this hand H' as shown in FIGS. 4 to 7.
　なお、この非接触入力装置１は可搬性に優れる。すなわち、持ち運ぶ際には、係止ロッド４０の両端を、支持基板１０の係合凹部１６および光学プレート３０の係合凹部３６から外し、支持基板１０、液晶ディスプレイ２０および光学プレート３０をヒンジ部１２およびヒンジ部２２で回転させ、図９の側面図、図１０の正面図および図１１の背面図に示すように水平にして小さく重ねる。 Note that this non-contact input device 1 has excellent portability. That is, when carrying it, both ends of the locking rod 40 are removed from the engagement recess 16 of the support substrate 10 and the engagement recess 36 of the optical plate 30, and the support substrate 10, liquid crystal display 20, and optical plate 30 are attached to the hinge section 12. Then, they are rotated by the hinge part 22, and are horizontally arranged and overlapped small as shown in the side view of FIG. 9, the front view of FIG. 10, and the rear view of FIG. 11.
　従って、本発明の実施例による非接触入力装置は、小さく折り畳んで自由に持ち運びの可能な可搬型となっており、例えば、この非接触入力装置を鞄に入れて持ち歩き、訪問先で非接触でオンライン決済を実行するといったことができる。 Therefore, the non-contact input device according to the embodiment of the present invention is a portable type that can be folded into a small size and carried freely. You can do things like make online payments.
　なお、図１に示すように、支持基板１０にスピーカー１８を設けておくこともできる。例えば、非接触インターフェース画面４に対して何らかの操作が行われ、それが検出された場合に、クリック音などでユーザーに認識させることができる。また、慣れないユーザーに対して、ガイダンスの音声を再生しても良い。具体的には、図３のようなインタフェース画面では、「直接、空中ディスプレイのボタンにタッチして下さい」という音声ガイダンスを流し、図４のようなインタフェース画面では、「下の支持基板の上で人差し指を動かして、画面上のカーソルを選択する項目の左側のボックスに合わせて下さい」といった音声ガイダンスを流す。 Incidentally, as shown in FIG. 1, a speaker 18 can also be provided on the support substrate 10. For example, when some kind of operation is performed on the non-contact interface screen 4 and it is detected, the user can be made aware of this with a click sound or the like. Further, guidance audio may be played back for users who are not used to the system. Specifically, on the interface screen shown in Figure 3, a voice guidance is played that says, ``Touch the button directly on the aerial display,'' and on the interface screen shown in Figure 4, the voice guidance is ``Please touch the button on the lower support board.'' Move your index finger to align the cursor on the screen with the box to the left of the item you want to select.'' Voice guidance is played.
　また、より鮮明な空中ディスプレイ４を実現するには、液晶ディスプレイ２０からの光に外部光が加わらないことが望ましい。そのためには、図１２に示したような暗幕４４を用いると良い。この暗幕４４は、液晶ディスプレイ２０と光学プレート３０の間の空間を覆うためのものであり、左側遮蔽部分４４Ｌ、中央遮蔽部分４４Ｃと右側遮蔽部分４４Ｒとからなっている。 Furthermore, in order to realize a clearer aerial display 4, it is desirable that no external light be added to the light from the liquid crystal display 20. For this purpose, it is preferable to use a blackout curtain 44 as shown in FIG. 12. This blackout curtain 44 is for covering the space between the liquid crystal display 20 and the optical plate 30, and is composed of a left shielding portion 44L, a center shielding portion 44C, and a right shielding portion 44R.
　左側遮蔽部分４４Ｌは、液晶ディスプレイ２０と光学プレート３０の間の左側の開放部を覆うもので、中央遮蔽部分４４Ｃは、液晶ディスプレイ２０と光学プレート３０の間の中央部の開放部すなわち背面部を覆うもので、右側遮蔽部分４４Ｒは、液晶ディスプレイ２０と光学プレート３０の間の右側の開放部を覆うものである。 The left shielding portion 44L covers the left opening between the liquid crystal display 20 and the optical plate 30, and the center shielding portion 44C covers the central opening between the liquid crystal display 20 and the optical plate 30, that is, the back surface. The right shielding portion 44R covers the right opening between the liquid crystal display 20 and the optical plate 30.
　暗幕４４の縁部には面ファスナー４６が設けられている。図には直接示されていないが、非接触入力装置１の対応する面にも面ファスナーが設けられている。暗幕４４と非接触入力装置１の面ファスナーは、一方が雌ファスナーであれば他方は雄ファスナーであり、図１３に示したように、液晶ディスプレイ２０と光学プレート３０の間の空間を完全に覆うように接着することができる。これにより、液晶ディスプレイ２０からの光に外部光が加わらず、より鮮明な空中ディスプレイ４が実現できる。 A hook-and-loop fastener 46 is provided at the edge of the blackout curtain 44. Although not directly shown in the figure, a hook-and-loop fastener is also provided on the corresponding surface of the non-contact input device 1. The blackout curtain 44 and the hook-and-loop fastener of the non-contact input device 1 have one female fastener and the other male fastener, and as shown in FIG. 13, completely cover the space between the liquid crystal display 20 and the optical plate 30. It can be glued like this. Thereby, external light is not added to the light from the liquid crystal display 20, and a clearer aerial display 4 can be realized.
　なお、ここでは暗幕４４を使用時に取り付けるものとしているが、取り付け取り外しをせずに、恒久的に液晶ディスプレイ２０と光学プレート３０に固定しておいても良い。この場合、非接触入力装置１を折り畳む際には、液晶ディスプレイ２０と光学プレート３０の間に折り込むようにする。折り込む方法としては、例えば、扇子のようにジグザグに折る蛇腹折りとする。 Although the blackout curtain 44 is attached here during use, it may be permanently fixed to the liquid crystal display 20 and the optical plate 30 without being attached or detached. In this case, when folding the non-contact input device 1, it is folded between the liquid crystal display 20 and the optical plate 30. The folding method is, for example, a bellows fold, which is folded in a zigzag pattern like a fan.
　本発明によれば、非接触インターフェース画面を操作する際に、ユーザーの手が画面を遮ることがなく、画面上の情報を確認しながら入力を行うことができ、入力操作をスムーズに行うことができる非接触入力装置が実現できる。 According to the present invention, when operating a non-contact interface screen, the user's hand does not block the screen, the user can input while checking the information on the screen, and input operations can be performed smoothly. A non-contact input device can be realized.
　以上、本発明を実施例により詳細に説明したが、当業者にとっては、本発明が本願中に説明した実施例に限定されるものではないということは明らかである。本発明の装置は、特許請求の範囲の記載により定まる本発明の趣旨及び範囲を逸脱することなく修正及び変更態様として実施することができる。従って、本願の記載は、例示説明を目的とするものであり、本発明に対して何ら制限的な意味を有するものではない。 Although the present invention has been described in detail with reference to Examples above, it is clear to those skilled in the art that the present invention is not limited to the Examples described in this application. The device of the present invention can be implemented as modifications and changes without departing from the spirit and scope of the present invention as defined by the claims. Therefore, the description of this application is for the purpose of illustrative explanation and does not have any limiting meaning on the present invention.
　例えば、上記実施例では、液晶ディスプレイを採用しているが、本発明はこれに限定されず、有機ＥＬディスプレイや電子ペーパー等を採用しても良い。また、ディスプレイと光学パネルを固定するための支持構造として係止ロッドを用いているが、本発明はこれに限定されない。例えば、ヒンジ部そのものに係止機構を実装しても良いし、暗幕の代わりに遮蔽板を用い、この遮蔽板をディスプレイと光学パネルを固定するための支持構造として利用しても良い。 For example, in the above embodiment, a liquid crystal display is used, but the present invention is not limited to this, and an organic EL display, electronic paper, etc. may be used. Further, although a locking rod is used as a support structure for fixing the display and the optical panel, the present invention is not limited thereto. For example, a locking mechanism may be mounted on the hinge itself, or a shielding plate may be used instead of the blackout curtain, and this shielding plate may be used as a support structure for fixing the display and the optical panel.
　　１、５、６　　非接触入力装置
　　４　　空中ディスプレイ
　１０　　支持基板
　１２　　ヒンジ部
　１４　　ポート
　１６　　係合凹部
　１８　　スピーカー
　２０　　液晶ディスプレイ
　２２　　ヒンジ部
　２４　　表示面
　３０　　光学プレート
　３１　　入射面
　３２　　赤外線ＬＥＤ
　３３　　出射面
　３４　　赤外線カメラ
　３６　　係合凹部
　４０　　係止ロッド
　４２　　軸
　４４　　暗幕
　４４Ｃ　　中央遮蔽部分
　４４Ｌ　　左側遮蔽部分
　４４Ｒ　　右側遮蔽部分
　４６　　面ファスナー
　４８、４９　　撮像素子 1, 5, 6 Non-contact input device 4 Aerial display 10 Support substrate 12 Hinge portion 14 Port 16 Engagement recess 18 Speaker 20 Liquid crystal display 22 Hinge portion 24 Display surface 30 Optical plate 31 Incident surface 32 Infrared LED
33 Output surface 34 Infrared camera 36 Engagement recess 40 Locking rod 42 Shaft 44 Blackout curtain 44C Center shielding part 44L Left shielding part 44R Right shielding part 46 Hook-and- loop fastener 48, 49 Image sensor

Claims (5)

  1. 　非接触インターフェース画面を表示する表示装置と、
    　前記非接触インターフェース画面に被らない位置に設けられた操作空間と、
    　前記操作空間におけるユーザーの手の動きを非接触で検出する検出装置とを備え、
    　前記検出装置が、前記操作空間におけるユーザーの手の動きを検出した場合に、この手の動きが前記非接触インターフェース画面に表示され、この手の動きによって前記非接触インターフェース画面の操作が行われることを特徴とする非接触入力装置。     a display device that displays a contactless interface screen;
    an operation space provided in a position that does not cover the non-contact interface screen;
    a detection device that detects the movement of the user's hand in the operation space in a non-contact manner,
    When the detection device detects a movement of the user's hand in the operation space, the movement of the hand is displayed on the non-contact interface screen, and the movement of the hand is used to operate the non-contact interface screen. A non-contact input device featuring:
  2. 　前記非接触インターフェース画面に表示されるユーザーの手の動きは、半透明の表示となっており、ユーザーは、この半透明の表示ごしに前記非接触インターフェース画面を構成する要素を視認できることを特徴とする請求項１に記載の非接触入力装置。 The user's hand movements displayed on the non-contact interface screen are displayed in a semi-transparent manner, and the user can visually recognize the elements constituting the non-contact interface screen through this semi-transparent display. The non-contact input device according to claim 1.
  3. 　前記非接触インターフェース画面に表示されるユーザーの手の動きは、指先の位置を示すポインタで表示されることを特徴とする請求項１に記載の非接触入力装置。 The non-contact input device according to claim 1, wherein the user's hand movement displayed on the non-contact interface screen is displayed as a pointer indicating the position of a fingertip.
  4. 　前記操作空間は、前記非接触インターフェース画面の下方に位置していることを特徴とする請求項１に記載の非接触入力装置。 The non-contact input device according to claim 1, wherein the operation space is located below the non-contact interface screen.
  5. 　前記非接触インターフェース画面は、空中ディスプレイであることを特徴とする請求項２に記載の非接触入力装置。 The non-contact input device according to claim 2, wherein the non-contact interface screen is an aerial display.
PCT/JP2023/018848 2022-07-14 2023-05-21 Non-contact input device WO2024014131A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022113288 2022-07-14
JP2022-113288 2022-07-14

Publications (1)

Publication Number Publication Date
WO2024014131A1 true WO2024014131A1 (en) 2024-01-18

Family

ID=89536513

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/018848 WO2024014131A1 (en) 2022-07-14 2023-05-21 Non-contact input device

Country Status (1)

Country Link
WO (1) WO2024014131A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110084893A1 (en) * 2009-10-09 2011-04-14 Lg Electronics Inc. Mobile terminal and controlling method thereof
JP2013045255A (en) * 2011-08-23 2013-03-04 Kyocera Corp Display device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110084893A1 (en) * 2009-10-09 2011-04-14 Lg Electronics Inc. Mobile terminal and controlling method thereof
JP2013045255A (en) * 2011-08-23 2013-03-04 Kyocera Corp Display device

Similar Documents

Publication Publication Date Title
CA2662313C (en) Information output device
KR101209087B1 (en) System for input to information processing device
US7433179B2 (en) Electronic apparatus having universal human interface
US7676767B2 (en) Peel back user interface to show hidden functions
JP4129841B1 (en) Information input auxiliary sheet, information processing system using information input auxiliary sheet, and printing related information output system using information input auxiliary sheet
CN104536691B (en) Two fingers with mobile element touch the handheld device of triggering selection and transformation
US7479950B2 (en) Manipulating association of data with a physical object
US20100103136A1 (en) Image display device, image display method, and program product
US20030184958A1 (en) Protective case for a tablet personal computer
KR20110038120A (en) Multi-touch touchscreen incorporating pen tracking
JP2005520239A (en) Touchpad, stylus using touchpad, and method of operating touchpad
KR20110038121A (en) Multi-touch touchscreen incorporating pen tracking
JP2006164275A (en) System and directional input device for displaying images in a plurality of directions
US9606506B2 (en) Holographic interaction device
JP2008176802A (en) Coordinate input/detection device and electronic blackboard system
JP2012022375A (en) Display control device, display control method, and program
JP2005266968A (en) Electronic equipment
WO2024014131A1 (en) Non-contact input device
JP2011227397A (en) Display control unit and display control method
US20050275635A1 (en) Manipulating association of data with a physical object
JP2023184557A (en) Display device, display method, and program
Zhou et al. Innovative wearable interfaces: an exploratory analysis of paper-based interfaces with camera-glasses device unit
WO2023238561A1 (en) Folding aerial image display device
WO2024105974A1 (en) Aerial image display device provided with biometric authentication system
TW201243655A (en) Electronic book device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23839308

Country of ref document: EP

Kind code of ref document: A1