WO2013180446A1 - 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치 및 방법 - Google Patents
프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치 및 방법 Download PDFInfo
- Publication number
- WO2013180446A1 WO2013180446A1 PCT/KR2013/004672 KR2013004672W WO2013180446A1 WO 2013180446 A1 WO2013180446 A1 WO 2013180446A1 KR 2013004672 W KR2013004672 W KR 2013004672W WO 2013180446 A1 WO2013180446 A1 WO 2013180446A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- projector
- user
- coordinate data
- information
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04101—2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Definitions
- the present invention relates to a device and a method for remotely controlling an electronic device by a user, and in particular, by using a virtual touch through a movement (gesture) of a user's fingertip remotely using information displayed through a projector.
- the present invention relates to a remote control apparatus and a method for performing a virtual touch capable of controlling a driving operation.
- the touch panel technology cannot be used remotely because the user needs to touch the display surface directly. Therefore, even electronic devices employing touch panel technology have no choice but to rely on devices such as a conventional remote control for remote operation.
- a remote electronic control device a device capable of generating a pointer at an accurate point, such as touch panel technology, that is, a straight line of the user's eyes and fingers is displayed from the captured image after photographing the front of the display using two cameras.
- a technique for generating a pointer at the point of meeting is disclosed in the published patent application [Document 1]
- a 'pointer' must be generated as a preliminary measure for controlling an electronic device (with a pointer control unit). It is very inconvenient in performing an operation by comparing a user's gesture with a previously stored pattern for specific operation control.
- a large screen (operation icons may be identified by the user even at a distance). Size) of the display device is limited to the configured electronic device.
- the remote operation is possible only in the front of the electronic device for this purpose, there was an inconvenience that the user must move to the front of the electronic device to operate the electronic device.
- the electronic device since the electronic device is configured to manipulate the operation of the home appliance through communication between the home appliance and the camera control unit, the electronic device can be remotely operated only at a fixed position at any time. This can only be limited to electronic devices.
- the present invention has been made to solve the above problems, the operation of the electronic device using the virtual touch through the user's movement (gesture) at a remote location, the auxiliary information through the projector regardless of the display device It is an object of the present invention to provide a remote control device and a method that can be applied and controlled by all electronic devices displayed and driven.
- Another object of the present invention is to remotely perform a virtual touch remotely using the information displayed through the projector electronic devices located in all spaces in the home irrespective of the movement of the electronic device and the position and direction between the user and the electronic device To provide a device and a room.
- Another object of the present invention is to provide a remote control device and method that can be applied to a variety of electronic devices that are free to move by performing a virtual touch using the information displayed through the projector even when the electronic device to be remotely controlled have.
- the remote control device for performing a virtual touch using the information displayed through the projector for achieving the above object is a three-dimensional coordinate calculation unit for extracting three-dimensional coordinate data of the user's body and electronic devices And, by using the three-dimensional coordinate data of the electronic device calculated by the three-dimensional coordinate calculation unit recognizes the spatial position information and the device product information of the electronic device to display the projector in a position that can be confirmed by the user, a straight line between the user and the projector An electronic device detecting unit generating a virtual contact area for a virtual touch between the user and the projector based on the direction information corresponding to the image, and using the 3D coordinate data of the user's body calculated by the 3D coordinate calculating unit Calculating the virtual touch position of the projector and its change in position for driving operation of the device, A user detection unit for generating a command code for performing an operation of a preset electronic device based on the change of the touch position, and if a command code generated by the user detection unit is input, as a
- Electronic device drive control unit that converts and transmits an operation command signal to a corresponding electronic device, device product information such as manufacturer and model name of an electronic device provided in the home, protocol information applied to drive operation for each device product, and electronic device It is composed of the electronic device information DB that stores the operation information for each.
- the 3D coordinate data of the electronic device is set in advance.
- the electronic device detector includes a projector modeling unit configured to perform projector modeling according to an electronic device selected based on the 3D spatial coordinates of the electronic device calculated by the 3D coordinate calculating unit, and the electron modeled by the projector modeling unit.
- the projector setting unit outputs a projector including basic information for executing the function of the device to be displayed at a position which can be checked by the user, and the direction information corresponding to a straight line between the user and the projector is matched with each other, and the matching direction information is obtained.
- a touch position matching unit configured to generate a virtual two-dimensional contact area for a virtual touch based on the user and the projector.
- the projector setting unit is provided in a configuration independent of the projector modeling unit and the touch position matching unit.
- the user detector calculates a first spatial coordinate and a second spatial coordinate based on the three-dimensional spatial coordinates of the user's body calculated by the three-dimensional coordinate calculator, and calculates the calculated first spatial coordinates (finger) and second.
- a touch position calculator configured to calculate contact coordinate data where a straight line connecting the first spatial coordinates and the second spatial coordinates meets a virtual contact area generated by the touch position matching unit by using a spatial coordinate (eye);
- a virtual touch processor configured to determine whether the contact coordinate data calculated by the touch position calculator is changed and to generate a command code for performing an operation of a preset electronic device when it is determined that there is a change.
- the first spatial coordinate is a three-dimensional coordinate of any one of the end of one finger of the user's finger, the end of the pointer held by the user with the finger, and the second spatial coordinate is the center point of one eye of the user. It is characterized in that the three-dimensional coordinates of.
- the virtual touch processing unit determines whether there is a change in the contact coordinate data for a set time or more from a time at which initial contact coordinate data is calculated, and if there is a change in the contact coordinate data for a set time or more, there is a change in contact coordinate data. It is characterized by judging.
- the virtual touch processing unit determines whether there is a change in distance greater than or equal to a set distance between the first spatial coordinates and the second spatial coordinates when there is no change of the contact coordinate data for a set time or more from the time at which the initial contact coordinate data is calculated.
- a distance change over the distance occurs, it is determined that there is a change, characterized in that for generating a command code for performing the operation of the preset electronic device.
- a remote control method for performing a virtual touch using information displayed through a projector includes (A) extracting three-dimensional coordinate data of a user's body and an electronic device; (B) Detecting a corresponding electronic device based on previously stored information using three-dimensional coordinate data according to the electronic device among the calculated three-dimensional coordinate data, and auxiliary information for executing a function of the detected electronic device Modeling the included projector and displaying the same at a location that can be checked by the user; and (C) detecting the corresponding electronic device by comparing the electronic device information previously stored based on the projector modeled electronic device, and detecting the detected electronic device.
- Generating and outputting a command code for executing the operation of the set electronic device and (G) converting the generated command code into a control command signal for driving operation of the corresponding electronic device, and then operating the command signal with the corresponding electronic device. It comprises the step of transmitting a.
- the step (F) determines whether there is a change in the contact coordinate data for a set time or more from a time at which initial contact coordinate data is calculated, and there is a change in contact coordinate data when there is a change in the contact coordinate data for a set time or more. It is characterized by judging.
- step (F) if there is no change of the contact coordinate data from the time at which the initial contact coordinate data is calculated for more than a predetermined time, it is determined whether there is a change in distance or more than the set distance between the first spatial coordinate and the second spatial coordinate. When a distance change of more than a set distance occurs, it is determined that there is a change, and generates a command code for performing an operation of a preset electronic device.
- the touch area for the virtual touch operation is set in the two-dimensional contact area of the generated projector according to the operation information previously stored in the electronic device information DB, and the first spatial coordinates and the second Calculating contact coordinate data where a straight line connecting the spatial coordinates meets the generated two-dimensional contact area of the projector, and the user touches up, down, left, right to a preset touch area of the two-dimensional contact area of the projector; If a change request of the contact coordinate data calculated according to the change of the first spatial coordinate is performed by performing an operation request of the electronic device by performing at least one virtual touch operation among the front and the back, to correspond to the change of the contact coordinate data. And generating a command code for performing an operation of a preset electronic device.
- the remote control apparatus and method for performing the virtual touch using the information displayed through the projector according to the present invention have the following effects.
- the electronic device may be manipulated electronically by virtually touching the body of the 3D modeled electronic device, instead of performing a virtual touch on the displayed operation icon using a pointer through the display device. Do. Therefore, there is an effect that can be applied to all electronic devices that do not include a display device.
- the present invention can provide a new touch recognition method that can be utilized in a virtual touch device that does not use a display device and can accurately operate an electronic device.
- the configuration of the remote control device is separated from the electronic device to be remotely controlled, it is free to calculate the changed three-dimensional spatial coordinates of the electronic device even when the electronic device is moved, thereby making it possible to apply various electronic devices with free mobility. There is a possible effect.
- the virtual touch is provided through three-dimensional modeling to perform operations corresponding to the virtual touches. It is possible.
- FIG. 1 is a diagram showing an entire system of a remote operation for performing a virtual touch using information displayed through a projector according to an embodiment of the present invention.
- FIG. 2 is a block diagram illustrating a remote control device for performing a virtual touch using information displayed through a projector according to an embodiment of the present invention.
- FIG. 3 is a flowchart illustrating a remote operation method of performing a virtual touch using information displayed through a projector according to an embodiment of the present invention.
- FIG. 1 is a diagram illustrating an entire system of a remote operation for performing a virtual touch using information displayed through a projector according to an embodiment of the present invention.
- the user requests a driving operation of the electronic device 200 by using a virtual touch through a movement (gesture) of a hand or the like remotely (1), through the user's movement.
- the 3D coordinate data of the user's body is extracted to check the 3D region (2), and at the same time, the user recognizes the electronic device 200 that requests the driving operation.
- the projector 400 including information, a menu, a button, etc. for executing the function of the recognized electronic device 200 is displayed at a position which can be checked by the user (3). Subsequently, when any one of information, a menu, a button, etc.
- the drive operation command signal of the corresponding electronic device is generated and transmitted to the electronic device 200, thereby driving the drive of the electronic device 200 (5).
- the auxiliary information for executing the function of the electronic device is separately displayed through the projector, and as the remote operation is performed through the projector displayed as described above, the existing remote controller is used regardless of the presence or absence of a display device in the electronic device 200. Applicable to all electronic devices that are driven and operated.
- FIG. 2 is a block diagram illustrating a remote control apparatus for performing a virtual touch using information displayed through a projector according to an exemplary embodiment of the present invention.
- the remote control apparatus 100 includes a three-dimensional coordinate calculation unit 110, an electronic device driving control unit 120, an electronic device detection unit 130, a user detection unit 140, and an electronic device information DB ( 150).
- the three-dimensional coordinate calculation unit 110 may calculate the three-dimensional coordinates of the user's body and the electronic device by a variety of known three-dimensional coordinate extraction method. At this time, the calculation of the three-dimensional coordinates according to the electronic device may be calculated by using an image captured by the camera, but since the home electronic devices are usually fixed at a specific position, according to the fixed position Three-dimensional coordinate data may be preset and used as three-dimensional coordinates of an electronic device.
- Representative methods of such three-dimensional coordinate extraction can be divided into optical triangulation method, time delay measurement method and measurement method using structured light.
- the optical triangulation method is a method of calculating three-dimensional coordinate data by using a triangulation method for images obtained by two cameras taken from different angles, and various related techniques for extracting three-dimensional coordinates by applying trigonometric method Camera self calibration, Harris corner extraction, SIFT, RANSAC, and Tsai techniques are commonly employed.
- the time delay measurement method is a technique of obtaining three-dimensional coordinate data by converting the time difference between the ultrasonic wave generated from the transmitter and the receiver to reach the receiver divided by the traveling speed of the ultrasonic wave.
- the measuring method using structured light is a method of estimating a three-dimensional position by continuously projecting a coded pattern image and obtaining an image of a scene in which structured light is projected through a camera.
- the electronic device detector 130 includes a projector modeling unit 132, a projector setting unit 134, and a touch position matching unit 136, and calculates the electronic device calculated by the three-dimensional coordinate calculation unit 110. Recognizing the spatial position information and the device product information of the electronic device 200 using the three-dimensional coordinate data to display the projector in a position that can be identified by the user, and based on the direction information corresponding to a straight line between the user and the projector Create a virtual contact area for virtual touch with the projector.
- the projector modeling unit 132 performs the projector modeling according to the electronic device selected based on the 3D spatial coordinates of the electronic device calculated by the 3D coordinate calculating unit 110.
- the projector modeling is an auxiliary device including information, a menu, a button, etc. for detecting a corresponding electronic device and executing a function of the detected electronic device by comparing the electronic device information previously stored in the electronic device information DB 150.
- the projector setting unit 134 outputs a projector including information, a menu, a button, etc. for executing a function of the electronic device modeled by the projector modeling unit 132 so as to be displayed at a position that can be checked by a user.
- the projector setting unit 134 may be located in the electronic device detecting unit 130, but may be used by applying a projector device that is currently sold for general purposes.
- the applicable projector apparatus includes a CRT (Cathode Ray Tube) projector, a Liquid Crystal Display (LCD) projector, a Digital Light Processing (DLP) projector, a Silicon X-tal Reflective Display (SXRD) projector, and a Laser projector.
- the touch position matching unit 136 matches direction information corresponding to a straight line between the user and the projector to generate a virtual two-dimensional contact area for the virtual touch between the user and the projector based on the matching direction information. do. That is, since the auxiliary information and the corresponding position information are already known through the projector modeling unit 132, the two-dimensional contact area generated by the touch position matching unit 136 may specify any one of the auxiliary information displayed by the projector. It becomes possible.
- the user detector 140 includes a touch position calculator 142 and a virtual touch processor 144, using the 3D coordinate data of the user's body calculated by the 3D coordinate calculator 110.
- a virtual touch position of the projector for driving operation of the 200 and a change in its position are calculated, and a command code for performing an operation of a preset electronic device is generated based on the calculated virtual touch position change.
- the touch position calculator 142 calculates the first spatial coordinates and the second spatial coordinates based on the three-dimensional spatial coordinates of the user's body calculated by the three-dimensional coordinate calculator 120, and calculates the first first coordinates.
- Contact coordinates where a straight line connecting the first spatial coordinates and the second spatial coordinates using a spatial coordinate (finger) and a second spatial coordinate (eye) meets the virtual contact region generated by the touch position matching unit 136. It is responsible for producing data.
- a finger In general, a finger is the only part of a person's body that allows for sophisticated and delicate manipulations. In particular, when using either one of the thumb or forefinger or two fingers together, the precise pointing can be performed. Therefore, it is very effective to use the tip of the thumb and / or index finger as the first spatial coordinates in the present invention. Also, in the same context, instead of the tip of the finger serving as the first spatial coordinate, a pointed pointer (eg, a pen tip) held by the finger may be used instead of the tip of the finger serving as the first spatial coordinate, a pointed pointer (eg, a pen tip) held by the finger may be used.
- a pointed pointer eg, a pen tip
- the second spatial coordinate only the center point of one eye of the user is used as the second spatial coordinate.
- the index finger will appear as two. This occurs because the shape of the index finger viewed by both eyes of the user is different (due to the angle difference between the eyes).
- you look at your index finger with only one eye your index finger will be clearly visible.
- the present invention adopts the principle that the shape of the fingertip can be clearly recognized when looking at the fingertip (first spatial coordinate) with only one eye (second spatial coordinate). In this way, the user must be able to accurately view the first spatial coordinates to point to the virtual contact area generated by the touch position matching unit 136 that matches the first spatial coordinates.
- the first spatial coordinate is a three-dimensional coordinate of any one of the end of the finger of the user finger, the end of the pointer held by the user with the finger
- the second spatial coordinate will be the three-dimensional coordinates of the center point of either eye of the user.
- the first spatial coordinates are three-dimensional coordinates of the tips of two or more fingers of the user fingers
- the second spatial coordinates are any one eye of the user. It may be formed of three-dimensional coordinates of the center point of.
- the first spatial coordinates are three-dimensional coordinates of the tips of one or more fingers respectively presented by two or more users
- the second spatial coordinates are the one eye of the two or more users. It may be formed of three-dimensional coordinates of the center point of.
- the virtual touch processor 144 determines whether there is a change in the contact coordinate data for a set time or more from a time at which initial contact coordinate data is calculated, and is set to correspond to the contact coordinate data if there is a change in the contact coordinate data for a set time or more. Generate and output command code to perform the operation. In addition, the virtual touch processor 144 may process two fingers of one user or two or more users in the same manner.
- the virtual touch processor 144 determines whether there is a change in the contact coordinate data for a set time or more from a time at which initial contact coordinate data is calculated, and if there is no change in the contact coordinate data for a set time or more, the first spatial coordinate and the second It is determined whether there is a change in distance greater than or equal to a set distance between spatial coordinates, and when a change in distance greater than or equal to a set distance occurs, a command code is generated to perform an operation corresponding to the contact coordinate data.
- the virtual touch processor 40 may process two fingers of a single user or two or more users in a similar manner.
- the variation of the contact coordinate data is within the range of a setting area, it may be formed to be considered that there is no variation of the contact coordinate data. That is, when the user points the electronic device to the tip of the finger or the tip of the pointer, it is very difficult for the user to maintain the contact coordinates because the body or finger naturally has some movement or tremor. Therefore, when the contact coordinate data value is within a predefined setting range, it is considered that there is no change in the contact coordinate data.
- Electronic devices subject to remote control include home networking such as lighting, speakers, air conditioners, fans, blinds, windows, curtains, doors, heating, gas, microwave ovens, video, cameras, CCTV, and various electronics.
- Devices or artworks such as paintings, sculptures and the like may also be subject to remote control by the present invention.
- menu boards according to the function of remote control and menu selection, operation of electronic devices, etc. will be displayed as a project
- text information according to the description and the artist according to the art objects is displayed as a project.
- auxiliary information in which the menu board and text information are mixed may be displayed as a project.
- the remote control device 100 according to the present invention is installed separately from the electronic device to be remotely controlled, and the outputted projector is also displayed separately from the electronic device to be remotely controlled. It is free to calculate the changed three-dimensional spatial coordinates of the device, it is possible to apply various electronic devices with free mobility.
- the electronic device driving control unit 120 converts the control command signal for driving operation of the corresponding electronic device and transmits the operation command signal to the corresponding electronic device.
- the operation command signal is preferably transmitted as an infrared (IR) signal of the existing remote control, but is not limited to this, it is also applicable to short-range wireless communication methods such as Wi-Fi (WiFi), Bluetooth (Bluetooth) currently used. Of course.
- the electronic device information database (DB) 150 stores device product information such as a manufacturer and a model name of an electronic device provided in a home, protocol information applied to a driving operation for each device product, and operation information for each electronic device. .
- the operation information refers to information that can operate the electronic device power, illuminance, volume, temperature control, and the like.
- the information stored in the electronic device information DB 150 may be updated by the user at any time after the purchase of the electronic device, and as a method of updating, the information of the electronic device is downloaded by accessing the website of the home appliance. It may be received or updated by downloading the information of the electronic device through a transceiver configured in advance in the electronic device.
- the present invention is not limited to various electronic devices, and may store text and image information according to a description, an artist, and the like, such as an artwork. This is possible in various embodiments within the scope of the technical idea of the present invention.
- FIGS. 1 to 2 refer to the same members performing the same functions.
- FIG. 3 is a flowchart illustrating a remote operation method of performing a virtual touch using information displayed through a projector according to an embodiment of the present invention.
- three-dimensional coordinate data of a user's body and an electronic device photographed through at least one camera by optical triangulation, time delay measurement, or structured light is calculated (S100).
- the 3D coordinate data of the electronic device may be calculated by using an image photographed by a camera, but since the home electronic device is usually fixed at a specific position, the 3D coordinate according to the fixed position Coordinate data may be preset and used as three-dimensional coordinates of an electronic device.
- the electronic device 200 detects a corresponding electronic device based on information stored in the electronic device information DB 150 using the three-dimensional coordinate data of the electronic device among the calculated three-dimensional coordinate data, and detects the function of the detected electronic device 200.
- the projector 400 that includes information for execution, a menu, a button, and the like is modeled and displayed at a position where the user can check (S300).
- the electronic device setting unit 134 detects a corresponding electronic device by comparing the electronic device information previously stored in the electronic device information DB 150 based on the projector modeled electronic device, and detects the corresponding electronic device.
- the control signal according to the driving operation is set (S400).
- the touch position matching unit 136 matches direction information corresponding to a straight line between the user and the projector based on the extracted 3D coordinate data of the user's body, and between the user and the projector based on the matching direction information.
- a virtual two-dimensional contact area for a virtual touch is generated.
- the virtual two-dimensional contact area generated refers to the screen of the projector which is separated from the electronic device to be remotely controlled and displayed at a position which can be checked by the user.
- a finger In general, a finger is the only part of a person's body that allows for sophisticated and delicate manipulations. In particular, when using either one of the thumb or forefinger or two fingers together, the precise pointing can be performed. Therefore, it is very effective to use the tip of the thumb and / or index finger as the first spatial coordinates in the present invention. Also, in the same context, instead of the tip of the finger serving as the first spatial coordinate, a pointed pointer (eg, a pen tip) held by the finger may be used instead of the tip of the finger serving as the first spatial coordinate, a pointed pointer (eg, a pen tip) held by the finger may be used.
- a pointed pointer eg, a pen tip
- the second spatial coordinate only the center point of one eye of the user is used as the second spatial coordinate.
- the index finger will appear as two. This occurs because the shape of the index finger viewed by both eyes of the user is different (due to the angle difference between the eyes).
- you look at your index finger with only one eye your index finger will be clearly visible.
- the present invention adopts the principle that the shape of the fingertip can be clearly recognized when looking at the fingertip (first spatial coordinate) with only one eye (second spatial coordinate). In this way, the user must be able to accurately view the first spatial coordinates to point to the virtual contact area generated by the touch position matching unit 136 that matches the first spatial coordinates.
- the first spatial coordinates are three-dimensional coordinates of the tips of two or more fingers of the user fingers
- the second spatial coordinates are any one eye of the user. It may be formed of three-dimensional coordinates of the center point of.
- the first spatial coordinates are three-dimensional coordinates of the tips of one or more fingers respectively presented by two or more users
- the second spatial coordinates are the one eye of the two or more users. It may be formed of three-dimensional coordinates of the center point of.
- the virtual touch processor 144 determines whether there is a change in the contact coordinate data with the generated virtual two-dimensional contact area and, if there is a change, executes a function of a preset electronic device to correspond to the change in the contact coordinate data.
- a command code for performing auxiliary information including information, a menu, a button, and the like is generated and output (S700).
- the virtual touch processing unit 144 is set to the touch area for the virtual touch operation according to the operation information previously stored in the electronic device information DB in the two-dimensional contact region of the generated projector, the first space coordinates and the second space
- the contact coordinate data where a straight line connecting the coordinates meets the two-dimensional contact area of the generated projector is calculated.
- a user's manipulation request of an electronic device is performed by performing a virtual touch manipulation of at least one of up, down, left, right, front, and back to a preset touch area of the two-dimensional contact area of the projector by a user to perform a first spatial coordinate.
- the virtual touch processor 144 determines whether the contact coordinate data is changed or not, whether the contact coordinate data is changed for a predetermined time or more from the time at which the initial contact coordinate data is calculated. In addition, it is determined whether there is a change in the contact coordinate data for a predetermined time or more from a time at which the initial contact coordinate data is calculated, and if there is no change in the contact coordinate data for a predetermined time or more, the distance between the first and second spatial coordinates is set.
- the generated command code is converted into a control command signal for driving operation of the corresponding electronic device, and the operation command signal is transmitted to the corresponding electronic device (S800).
- the operation command signal is preferably transmitted as an infrared (IR) signal of the existing remote control, but is not limited to this, it is possible to transmit by using a short-range wireless communication method such as Wi-Fi (Bluetooth), which is currently used. .
- the present invention as described above is a remote control device and method for performing a virtual touch using the information displayed through the projector, it is possible to quickly operate the electronic device, it is applicable to all electronic devices that do not include a display device It is possible.
- the present invention can provide a new touch recognition method that can be utilized in a virtual touch device that does not use a display device, and can accurately operate an electronic device. Accordingly, the present invention has industrial applicability.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
Claims (12)
- 사용자 신체 및 전자기기의 3차원 좌표 데이터를 추출하는 3차원 좌표 산출부와,상기 3차원 좌표 산출부에서 산출된 전자기기의 3차원 좌표 데이터를 이용하여 전자기기의 공간위치 정보 및 기기제품 정보를 인식하여 프로젝터를 사용자가 확인 가능한 위치에 표시하고, 사용자와 프로젝터 간의 일직선상에 대응되는 방향 정보를 기반으로 사용자와 프로젝터와의 가상 터치를 위한 가상의 접점 영역을 생성하는 전자기기 검출부와,상기 3차원 좌표 산출부에서 산출된 사용자 신체의 3차원 좌표 데이터를 이용하여 전자기기의 구동 조작을 위한 프로젝터의 가상 터치 위치 및 그 위치 변화를 산출하고, 산출된 가상 터치 위치 변화를 기반으로 미리 설정된 전자기기의 조작을 수행하는 명령코드를 생성하는 사용자 검출부와,상기 사용자 검출부에서 생성된 명령코드가 입력되면, 해당되는 전자기기의 구동 조작을 위한 제어명령 신호로 변환하여 해당되는 전자기기로 조작 명령 신호를 송신하는 전자기기 구동 제어부와,가정내 구비된 전자기기의 제조사, 모델명 등의 기기제품 정보와, 기기제품별 구동 조작에 적용되는 프로토콜 정보와, 전자기기별 조작정보를 저장하는 전자기기 정보 DB를 포함하여 구성되는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치.
- 제 1 항에 있어서,상기 전자기기의 3차원 좌표 데이터는 사전에 미리 설정되는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치.
- 제 1 항에 있어서, 상기 전자기기 검출부는상기 3차원 좌표 산출부에서 산출된 전자기기의 3차원 공간좌표를 기반으로 선택되는 전자기기에 따른 프로젝터 모델링을 실시하는 프로젝터 모델링부와,상기 프로젝터 모델링부에서 모델링된 전자기기의 기능을 실행하기 위한 기본 정보를 포함하는 프로젝터를 사용자가 확인 가능한 위치에 표시되도록 출력하는 프로젝터 설정부와,사용자와 프로젝터 간의 일직선상에 대응되는 방향 정보를 서로 매칭시켜, 매칭되는 방향 정보를 기반으로 사용자와 프로젝터 사이에 가상 터치를 위한 가상의 2차원 접점 영역을 생성하는 터치 위치 매칭부를 포함하여 구성되는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치.
- 제 3 항에 있어서,상기 프로젝터 설정부는 상기 프로젝터 모델링부 및 터치 위치 매칭부와 독립적인 구성으로 제공되는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치.
- 제 1 항에 있어서, 상기 사용자 검출부는상기 3차원 좌표 산출부에서 산출된 사용자 신체의 3차원 공간좌표를 기반으로 제 1 공간좌표와 제 2 공간좌표를 산출하고, 산출한 제 1 공간좌표(손가락)와 제 2 공간좌표(눈)를 이용하여 상기 제 1 공간좌표와 제 2 공간좌표를 연결하는 직선이 상기 터치 위치 매칭부에서 생성된 가상의 접점 영역과 만나는 접점 좌표 데이터를 산출하는 터치 위치 산출부와,상기 터치 위치 산출부에서 산출된 접점 좌표 데이터의 변화 여부를 판단하고, 변화가 있는 것으로 판단되면 미리 설정된 전자기기의 조작을 수행하는 명령코드를 생성하는 가상터치 처리부를 포함하여 구성되는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치.
- 제 5 항에 있어서,상기 제 1 공간좌표는 사용자 손가락 중 어느 하나 손가락의 끝, 사용자가 손가락으로 파지하고 있는 포인터의 끝 중 어느 하나의 3차원 좌표이고, 상기 제 2 공간좌표는 상기 사용자의 어느 한쪽 눈의 중심점의 3차원 좌표인 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치.
- 제 5 항에 있어서, 상기 가상터치 처리부는초기 접점 좌표 데이터가 산출된 시간으로부터 설정 시간 이상 상기 접점 좌표 데이터의 변화가 있는지를 판단하여 설정 시간 이상 상기 접점 좌표 데이터의 변화가 있는 경우 접점 좌표 데이터의 변화가 있는 것으로 판단하는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치.
- 제 7 항에 있어서, 상기 가상터치 처리부는초기 접점 좌표 데이터가 산출된 시간으로부터 설정 시간 이상 상기 접점 좌표 데이터의 변화가 없으면, 제 1 공간좌표와 제 2 공간좌표 사이에 설정 거리 이상의 거리 변화 발생 유무를 판단하여 설정 거리 이상의 거리 변화가 발생한 경우에는, 변화가 있는 것으로 판단하여 미리 설정된 전자기기의 조작을 수행하는 명령코드를 생성하는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치.
- (A) 사용자 신체 및 전자기기의 3차원 좌표 데이터를 추출하는 단계와,(B) 상기 산출된 3차원 좌표 데이터 중 전자기기에 따른 3차원 좌표 데이터를 이용하여 미리 저장된 정보를 기반으로 해당되는 전자기기를 검출하고, 검출된 전자기기의 기능을 실행하기 위한 보조 정보가 포함되는 프로젝터를 모델링하여 사용자가 확인 가능한 위치에 표시하는 단계와,(C) 상기 프로젝터 모델링된 전자기기에 기반하여 미리 저장되어 있는 전자기기 정보와 비교하여 해당되는 전자기기를 검출하고, 검출된 전자기기의 구동 조작에 따른 제어신호를 설정하는 단계와,(D) 상기 추출된 사용자 신체의 3차원 좌표 데이터를 기반으로 사용자와 프로젝터 간의 일직선상에 대응되는 방향 정보를 서로 매칭시켜, 매칭되는 방향 정보를 기반으로 사용자와 프로젝터 사이에 가상 터치를 위한 가상의 2차원 접점 영역을 생성하는 단계와,(E) 상기 산출된 3차원 좌표 데이터 중 사용자 신체에 따른 3차원 좌표 데이터를 이용하여 사용자 손가락 중 어느 하나 손가락의 끝의 3차원 좌표를 갖는 제 1 공간좌표와 사용자의 어느 한쪽 눈의 중심점의 3차원 좌표를 갖는 제 2 공간좌표를 산출하고, 상기 제 1 공간좌표와 제 2 공간좌표를 연결하는 직선이 상기 생성된 프로젝터의 2차원 접점 영역과 만나는 접점 좌표 데이터를 산출하는 단계와,(F) 상기 생성된 가상의 2차원 접점 영역과의 접점 좌표 데이터의 변화가 있는지 판단하여 변화가 있는 경우, 상기 접점 좌표 데이터의 변동에 대응되도록 미리 설정된 전자기기의 조작을 실행하는 명령코드를 생성하여 출력하는 단계와,(G) 상기 생성된 명령코드를 해당되는 전자기기의 구동 조작을 위한 제어명령 신호로 변환하여 해당되는 전자기기로 조작 명령 신호를 송신하는 단계를 포함하여 이루어지는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 방법.
- 제 9 항에 있어서,상기 (F) 단계는 초기 접점 좌표 데이터가 산출된 시간으로부터 설정 시간 이상 상기 접점 좌표 데이터의 변화가 있는지를 판단하여 설정 시간 이상 상기 접점 좌표 데이터의 변화가 있는 경우 접점 좌표 데이터의 변화가 있는 것으로 판단하는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 방법.
- 제 9 항에 있어서,상기 (F) 단계는 초기 접점 좌표 데이터가 산출된 시간으로부터 설정 시간 이상 상기 접점 좌표 데이터의 변화가 없으면, 제 1 공간좌표와 제 2 공간좌표 사이에 설정 거리 이상의 거리 변화 발생 유무를 판단하여 설정 거리 이상의 거리 변화가 발생한 경우에는, 변화가 있는 것으로 판단하여 미리 설정된 전자기기의 조작을 수행하는 명령코드를 생성하는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 방법.
- 제 9 항에 있어서, 상기 (F) 단계는상기 생성된 프로젝터의 2차원 접점 영역에 전자기기 정보 DB에 미리 저장된 조작정보에 따라 가상 터치 조작을 위한 터치 영역이 설정되는 단계와,상기 제 1 공간좌표와 제 2 공간좌표를 연결하는 직선이 상기 생성된 프로젝터의 2차원 접점 영역과 만나는 접점 좌표 데이터를 산출하는 단계와,사용자에 의해 상기 프로젝터의 2차원 접점 영역의 미리 설정된 터치 영역에 상, 하, 좌, 우, 앞, 뒤 중 적어도 하나 이상의 가상 터치 조작을 수행하여 전자기기의 조작 요청이 수행되어 제 1 공간좌표의 변화에 따라 산출된 접점 좌표 데이터의 변화가 판단되면, 상기 접점 좌표 데이터의 변화에 대응되도록 미리 설정된 전자기기의 조작을 수행하는 명령코드를 생성하는 단계를 포함하는 것을 특징으로 하는 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 방법.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/404,635 US9569103B2 (en) | 2012-05-29 | 2013-05-28 | Remote control apparatus and method for performing virtual touch by using information displayed by a projector |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2012-0056993 | 2012-05-29 | ||
KR1020120056993A KR101334585B1 (ko) | 2012-05-29 | 2012-05-29 | 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치 및 방법 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013180446A1 true WO2013180446A1 (ko) | 2013-12-05 |
Family
ID=49673582
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2013/004672 WO2013180446A1 (ko) | 2012-05-29 | 2013-05-28 | 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치 및 방법 |
Country Status (3)
Country | Link |
---|---|
US (1) | US9569103B2 (ko) |
KR (1) | KR101334585B1 (ko) |
WO (1) | WO2013180446A1 (ko) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016134935A1 (de) * | 2015-02-25 | 2016-09-01 | BSH Hausgeräte GmbH | Verfahren und system zur projektion von information in einem raum |
CN110733433A (zh) * | 2018-07-19 | 2020-01-31 | 宝沃汽车(中国)有限公司 | 车载投影显示***及车辆 |
CN111028494A (zh) * | 2019-11-04 | 2020-04-17 | 珠海格力电器股份有限公司 | 一种电器设备的虚拟遥控方法、计算机可读存储介质及智能家电 |
EP3227760B1 (en) * | 2014-12-03 | 2020-12-23 | Microsoft Technology Licensing, LLC | Pointer projection for natural user input |
CN114012739A (zh) * | 2021-12-10 | 2022-02-08 | 北京云迹科技有限公司 | 基于全息投影技术控制机器人的方法及装置 |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102335925B1 (ko) * | 2014-10-13 | 2021-12-06 | 삼성전자주식회사 | 네트워크 서비스를 위한 전자장치와 게이트웨이, 및 이를 위한 동작 방법 |
KR20160063812A (ko) | 2014-11-27 | 2016-06-07 | 삼성전자주식회사 | 화면 구성 방법, 전자 장치 및 저장 매체 |
KR102401641B1 (ko) * | 2016-01-08 | 2022-05-25 | 엘지전자 주식회사 | 모바일 디바이스 및 모바일 디바이스의 제어방법 |
JP6996507B2 (ja) * | 2016-07-05 | 2022-01-17 | ソニーグループ株式会社 | 情報処理装置、情報処理方法およびプログラム |
US10976828B2 (en) * | 2016-07-05 | 2021-04-13 | Sony Corporation | Information processing apparatus and information processing method to reduce user burden |
US10921963B2 (en) * | 2016-07-05 | 2021-02-16 | Sony Corporation | Information processing apparatus, information processing method, and program for controlling a location at which an operation object for a device to be operated is displayed |
KR101937823B1 (ko) * | 2016-10-24 | 2019-01-14 | 주식회사 브이터치 | 객체 제어를 지원하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능한 기록 매체 |
KR102463712B1 (ko) | 2017-11-24 | 2022-11-08 | 현대자동차주식회사 | 가상 터치 인식 장치 및 그의 인식 오류 보정 방법 |
KR102155378B1 (ko) * | 2018-09-19 | 2020-09-14 | 주식회사 브이터치 | 객체 제어를 지원하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체 |
WO2021118115A1 (ko) * | 2019-12-10 | 2021-06-17 | 주식회사 브이터치 | 객체 제어를 지원하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체 |
KR102398404B1 (ko) * | 2019-12-10 | 2022-05-16 | 주식회사 브이터치 | 객체 제어를 지원하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20100129629A (ko) * | 2009-06-01 | 2010-12-09 | 엘지전자 주식회사 | 움직임 검출에 의한 전자장치 동작 제어방법 및 이를 채용하는 전자장치 |
KR20120031805A (ko) * | 2010-09-27 | 2012-04-04 | 엘지전자 주식회사 | 휴대 단말기 및 그 동작 제어방법 |
KR20130007813A (ko) * | 2011-07-11 | 2013-01-21 | 김석중 | 3차원 모델링된 전자기기의 가상터치를 이용한 원격 조작 장치 및 방법 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2795961B1 (fr) * | 1999-07-09 | 2004-05-28 | Ethypharm Lab Prod Ethiques | Composition pharmaceutique contenant du fenofibrate micronise, un tensioactif et un derive cellulosique liant et procede de preparation |
JP2004040445A (ja) | 2002-07-03 | 2004-02-05 | Sharp Corp | 3d表示機能を備える携帯機器、及び3d変換プログラム |
JP4286556B2 (ja) * | 2003-02-24 | 2009-07-01 | 株式会社東芝 | 画像表示装置 |
US20100231506A1 (en) * | 2004-09-07 | 2010-09-16 | Timothy Pryor | Control of appliances, kitchen and home |
DE102005061211B4 (de) * | 2004-12-22 | 2023-04-06 | Abb Schweiz Ag | Verfahren zum Erzeugen einer Mensch-Maschine-Benutzer-Oberfläche |
KR20070066382A (ko) | 2005-12-22 | 2007-06-27 | 주식회사 팬택 | 두 대의 카메라를 이용한 3차원 이미지 생성 방법 및 이를구현하는 카메라 단말기 |
KR100818171B1 (ko) | 2006-06-09 | 2008-04-03 | 한국과학기술원 | 손 지시의 3차원 위치 인식 시스템 및 방법 |
JP2010117917A (ja) | 2008-11-13 | 2010-05-27 | Toyota Infotechnology Center Co Ltd | 動作検出装置および操作システム |
WO2011156195A2 (en) * | 2010-06-09 | 2011-12-15 | Dynavox Systems Llc | Speech generation device with a head mounted display unit |
US8947351B1 (en) * | 2011-09-27 | 2015-02-03 | Amazon Technologies, Inc. | Point of view determinations for finger tracking |
-
2012
- 2012-05-29 KR KR1020120056993A patent/KR101334585B1/ko active IP Right Grant
-
2013
- 2013-05-28 US US14/404,635 patent/US9569103B2/en active Active
- 2013-05-28 WO PCT/KR2013/004672 patent/WO2013180446A1/ko active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20100129629A (ko) * | 2009-06-01 | 2010-12-09 | 엘지전자 주식회사 | 움직임 검출에 의한 전자장치 동작 제어방법 및 이를 채용하는 전자장치 |
KR20120031805A (ko) * | 2010-09-27 | 2012-04-04 | 엘지전자 주식회사 | 휴대 단말기 및 그 동작 제어방법 |
KR20130007813A (ko) * | 2011-07-11 | 2013-01-21 | 김석중 | 3차원 모델링된 전자기기의 가상터치를 이용한 원격 조작 장치 및 방법 |
Non-Patent Citations (1)
Title |
---|
AHN, YANG KEUN ET AL.: "Implementation of interactive home control system.", PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE, MAN-MACHINE SYSTEMS AND CYBERNETICS., 5 July 2007 (2007-07-05), pages 203 - 208 * |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3227760B1 (en) * | 2014-12-03 | 2020-12-23 | Microsoft Technology Licensing, LLC | Pointer projection for natural user input |
WO2016134935A1 (de) * | 2015-02-25 | 2016-09-01 | BSH Hausgeräte GmbH | Verfahren und system zur projektion von information in einem raum |
CN110733433A (zh) * | 2018-07-19 | 2020-01-31 | 宝沃汽车(中国)有限公司 | 车载投影显示***及车辆 |
CN111028494A (zh) * | 2019-11-04 | 2020-04-17 | 珠海格力电器股份有限公司 | 一种电器设备的虚拟遥控方法、计算机可读存储介质及智能家电 |
CN114012739A (zh) * | 2021-12-10 | 2022-02-08 | 北京云迹科技有限公司 | 基于全息投影技术控制机器人的方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
US20150145830A1 (en) | 2015-05-28 |
US9569103B2 (en) | 2017-02-14 |
KR101334585B1 (ko) | 2013-12-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2013180446A1 (ko) | 프로젝터를 통해 표시되는 정보를 이용하여 가상터치를 수행하는 원격 조작 장치 및 방법 | |
WO2013009040A2 (ko) | 3차원 모델링된 전자기기의 가상터치를 이용한 원격 조작 장치 및 방법 | |
WO2012111976A2 (ko) | 표시면에 포인터를 사용하지 않는 가상 터치 장치 | |
CN106233229B (zh) | 利用以摄像机为中心的虚拟触控的远程操作装置及方法 | |
US11099655B2 (en) | System and method for gesture based data and command input via a wearable device | |
WO2012111998A2 (ko) | 포인터를 사용하지 않는 가상 터치 장치 | |
WO2012154001A2 (ko) | 포인터를 사용하지 않는 가상 터치 장치에서의 터치 인식 방법 | |
WO2013162236A1 (ko) | 포인터를 표시하지 않는 투명 디스플레이 가상 터치 장치 | |
CN102331884A (zh) | 具有可触控投影画面的投影*** | |
JP2008542900A (ja) | 装置の制御のための方法 | |
KR102407026B1 (ko) | 실시간 실내 영상을 이용한 홈 오토메이션 시스템 | |
WO2021004412A1 (zh) | 手持输入设备及其指示图标的显示位置控制方法和装置 | |
CN104081307A (zh) | 图像处理装置、图像处理方法和程序 | |
CN103543825B (zh) | 摄像机光标*** | |
WO2021004413A1 (zh) | 一种手持输入设备及其指示图标的消隐控制方法和装置 | |
TW201439813A (zh) | 顯示設備及其控制系統和方法 | |
CN111240483B (zh) | 操作控制方法、头戴式设备及介质 | |
WO2020184890A1 (ko) | 2차원 카메라를 이용하여 객체 제어를 지원하는 방법, 시스템 및 비일시성의 컴퓨터 판독 가능 기록 매체 | |
CN111352505B (zh) | 操作控制方法、头戴式设备及介质 | |
CN111443802B (zh) | 测量方法及电子设备 | |
CN108255317B (zh) | 光标控制方法和装置 | |
KR20140060615A (ko) | 포인터를 사용하지 않는 가상 터치 장치에 있어서의 전자기기의 가상 평면을 이용한 원격 조작 장치 | |
TW201913298A (zh) | 可顯示實體輸入裝置即時影像之虛擬實境系統及其控制方法 | |
WO2015053471A1 (ko) | 가상 리모트 컨트롤 장치 및 그 방법 | |
WO2014171909A1 (ru) | Устройство управления при помощи жестов |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13797033 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14404635 Country of ref document: US |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 26/03/2015) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 13797033 Country of ref document: EP Kind code of ref document: A1 |