KR20120135126A - Method for controlling augmented reality using pointing device and apparatus therefof - Google Patents
Method for controlling augmented reality using pointing device and apparatus therefof Download PDFInfo
- Publication number
- KR20120135126A KR20120135126A KR1020120059566A KR20120059566A KR20120135126A KR 20120135126 A KR20120135126 A KR 20120135126A KR 1020120059566 A KR1020120059566 A KR 1020120059566A KR 20120059566 A KR20120059566 A KR 20120059566A KR 20120135126 A KR20120135126 A KR 20120135126A
- Authority
- KR
- South Korea
- Prior art keywords
- user
- pointing device
- augmented reality
- finger
- location
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
The present invention relates to an augmented reality control method and apparatus using a pointing device. More specifically, the present invention relates to a method and apparatus for controlling augmented reality displayed on a screen of a mobile terminal using a pointing device.
In general, various electronic devices are being made through the development of electronic communication technology, and these devices are increasingly emphasizing the user's ease of operation and the beautifulness of the design. Highlighted by this trend is the change from an input device represented by a keyboard or keypad to an input device such as a display.
In particular, in the case of a mobile terminal such as a smart phone, a tablet PC, a portable multimedia player (PMP), a mobile phone, and the like, additional keyboards and keypads are provided for intuitive user input, user convenience, and user aesthetics. Minimizing the number of buttons, etc., user input devices such as touch screens are being adopted as a main input device.
The touch screen is an input device in which a sensor is embedded in a screen and a user input is made by a method in which a sensor detects when a user touches a specific object on the touch screen using a hand or a stylus pen.
Meanwhile, various functions of portable electronic devices are integrated into one portable terminal, and intelligent high-performance portable terminals that support computer functions such as the Internet and communication information retrieval such as smart phones are rapidly becoming common. Accordingly, there is a demand for an input method capable of using, checking, accessing, and controlling detailed data related to various specific contents or programs more easily and quickly.
However, in the case of a mobile terminal employing a user input device such as a touch screen as a main input device, a user input interface corresponding to various operation modes may be provided to the user in various ways, and the user may intuitively perform the corresponding input. Although there is an advantage in that it is possible, detailed methods related to various contents or files, etc. are not presenting an effective way for a user to more easily and quickly use, view, access, and control.
For this reason, in recent years, such a touch screen and a pointing device have tended to be mounted in one terminal.
Here, the pointing device is an input device that moves the cursor (or pointer) on the screen according to the direction of finger movement when the user moves the finger on the contact surface of the pointing device. The pointing device is an infrared, laser, An electric field sensor, a capacitor, a thermistor, etc. can be used.
1 illustrates an example of an augmented reality screen provided by a recently released portable terminal.
Referring to FIG. 1, in general, augmented reality provided by a portable terminal displays an image captured by a camera of the portable terminal on a screen, and displays a virtual object on the screen to a user. That is, the virtual object having additional information is added to the image captured in real time and displayed as one image. For example, when a user executes an augmented reality application of a mobile terminal, trade names registered by buildings or businesses around the user's current location on the screen of the mobile terminal are displayed on the screen. The information is displayed on the screen and the desired information is displayed or searched to obtain the desired information.
In the case of augmented reality provided by a conventional portable terminal, a name or a trade name (ie, a virtual object) of a building located around the user's current location identified through GPS or the like is displayed. Therefore, only when the user moves with the mobile terminal, virtual objects that are not displayed on the screen are displayed on the screen. In other words, in order to obtain information about an object located farther away, the user had to move his portable terminal to the location where the object is located.
The present invention is to solve the above problems,
By using the pointing device mounted on the mobile terminal, the user can freely change the user's current position in augmented reality, so that the user does not have to move directly to obtain information about an object located farther away. An object of the present invention is to easily acquire information on a desired object in augmented reality by only pointing device manipulation.
An augmented reality control apparatus using a pointing device according to an embodiment of the present invention, the pointing device for generating an input signal according to the user's finger movement; A display unit configured to display a plurality of virtual objects representing nearby buildings or shops based on the current location of the user as an augmented reality by superimposing images captured in real time; And when an input signal according to a swipe operation is transmitted from the pointing device, detecting a swipe displacement of a user's finger based on the transmitted input signal, and detecting a swipe displacement of the user's finger based on the detected swipe displacement. It is provided with a control unit for changing the position.
In particular, the controller may display a virtual object of a neighboring building or a shop that is closest to the user's location in the changed augmented reality, and may highlight the current location of the user to a building or a shop corresponding to the highlighted virtual object. It characterized in that the moving distance of the display together.
In particular, the controller determines whether a push detection signal is input from the pointing device, and when the push detection signal is input, information related to the highlighted virtual object is displayed on the screen.
By using a pointing device mounted on a mobile terminal, the user can freely change the user's current position in augmented reality, so that the user does not have to move directly to obtain information about an object located farther away. It is effective to easily obtain information on a desired object in augmented reality only by operating a device.
1 illustrates an example of an augmented reality screen provided by a currently released portable terminal.
2 is a perspective view showing a portable terminal according to the present invention.
3 is a view for explaining in detail the components of FIG.
4 to 7 are exemplary views for explaining a method and apparatus for augmented reality control using a pointing device according to the present invention.
DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.
Throughout the specification, when a part is said to 'include' a certain component, it means that it can further include other components, except to exclude other components unless otherwise stated.
2 is a perspective view showing a portable terminal according to the present invention, FIG. 3 is a view for explaining the components of FIG. 2 in detail, and FIGS. 4 to 7 are augmented reality control method using a pointing device according to the present invention; An illustration for explaining the apparatus. In FIG. 2,
2 to 7, the
The
The augmented reality in the mobile terminal according to the present invention is to combine the virtual object having the additional information with the image taken in real time through the photographing
For example, when the user executes the augmented reality application of the portable terminal, trade names registered for each building or business type are displayed on the screen of the portable terminal at the current location of the user, and the direction of the
The
The
The
In addition, the
The
The
In particular, the
More specifically, the
In other words, the same effect that the user moves is displayed through the
For example, in a screen as shown in FIG. 1, when a user touches a finger to the
Based on the changed user location (ie, 'virtual user location') by the manipulation of the
Through this configuration, the user can accurately grasp the distance and the movement route from the point where he is currently located to the building or shop to go to. Here, 'highlight' refers to a case in which it is highlighted and distinguished from other icons.
Referring to FIG. 4, the highlighted
In the state as shown in FIG. 4, when the user makes a finger contact with the
On the contrary, in the state of FIG. 4, when the user touches the finger to the
The
When the push detection signal is input from the
The photographing
The
The
Here, the subject may be generally understood as a body part of a user such as a finger, but may be any other replaceable object that can make the
As described above, an optimal embodiment has been disclosed in the drawings and specification. Although specific terms have been employed herein, they are used for purposes of illustration only and are not intended to limit the scope of the invention as defined in the claims or the claims. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.
10: portable terminal 100: pointing device
110: display unit 130: memory
140: communication unit 150: audio processing unit
160: control unit 170: recording unit
Claims (3)
A display unit configured to display a plurality of virtual objects representing nearby buildings or shops based on the current location of the user as an augmented reality by superimposing images captured in real time; And
When an input signal according to a swipe operation is transmitted from the pointing device, a swipe displacement of a user's finger is detected based on the transferred input signal, and a position of the user in the augmented reality according to the detected swipe displacement. With a control unit for changing the,
Augmented reality control device using a pointing device.
The control unit,
The virtual objects of the neighboring buildings or shops closest to the user's location in the changed augmented reality are highlighted, and the moving distance from the user's current location to the buildings or shops corresponding to the highlighted virtual objects is displayed together. An augmented reality control apparatus using a pointing device, characterized in that the.
The control unit,
And determining whether a push detection signal is input from the pointing device, and when the push detection signal is input, information related to the highlighted virtual object is displayed on a screen.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR20110053323 | 2011-06-02 | ||
KR1020110053323 | 2011-06-02 |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20120135126A true KR20120135126A (en) | 2012-12-12 |
Family
ID=47903129
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020120059566A KR20120135126A (en) | 2011-06-02 | 2012-06-04 | Method for controlling augmented reality using pointing device and apparatus therefof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20120135126A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9501871B2 (en) | 2014-04-30 | 2016-11-22 | At&T Mobility Ii Llc | Explorable augmented reality displays |
US11941162B2 (en) | 2021-03-24 | 2024-03-26 | Hyundai Motor Company | Mobile apparatus and vehicle displaying augmented reality image |
-
2012
- 2012-06-04 KR KR1020120059566A patent/KR20120135126A/en not_active Application Discontinuation
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9501871B2 (en) | 2014-04-30 | 2016-11-22 | At&T Mobility Ii Llc | Explorable augmented reality displays |
US9940755B2 (en) | 2014-04-30 | 2018-04-10 | At&T Mobility Ii Llc | Explorable augmented reality displays |
US10460522B2 (en) | 2014-04-30 | 2019-10-29 | At&T Mobility Ii Llc | Explorable augmented reality displays |
US11941162B2 (en) | 2021-03-24 | 2024-03-26 | Hyundai Motor Company | Mobile apparatus and vehicle displaying augmented reality image |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230359340A1 (en) | Omnidirectional gesture detection | |
US9329714B2 (en) | Input device, input assistance method, and program | |
US20080024454A1 (en) | Three-dimensional touch pad input device | |
US9459704B2 (en) | Method and apparatus for providing one-handed user interface in mobile device having touch screen | |
US20100328351A1 (en) | User interface | |
KR20130142824A (en) | Remote controller and control method thereof | |
KR20140035870A (en) | Smart air mouse | |
US20150160731A1 (en) | Method of recognizing gesture through electronic device, electronic device, and computer readable recording medium | |
CN101098533A (en) | Keypad touch user interface method and mobile terminal using the same | |
KR20140105691A (en) | Apparatus and Method for handling object in a user device having a touch screen | |
KR20140136855A (en) | Function performing method and electronic device thereof | |
KR101339985B1 (en) | Display apparatus, remote controlling apparatus and control method thereof | |
US20120262369A1 (en) | Hand-mountable device for providing user input | |
GB2517284A (en) | Operation input device and input operation processing method | |
KR20120135126A (en) | Method for controlling augmented reality using pointing device and apparatus therefof | |
KR101165388B1 (en) | Method for controlling screen using different kind of input devices and terminal unit thereof | |
EP2511792A1 (en) | Hand-mountable device for providing user input | |
KR20120115620A (en) | Method for controlling user interface of portable termianl using movement sensing device and apparatus therefof | |
KR101888902B1 (en) | Method for displayng photo album of mobile termianl using movement sensing device and apparatus therefof | |
KR20120134469A (en) | Method for displayng photo album image of mobile termianl using movement sensing device and apparatus therefof | |
KR20120134399A (en) | Method for providing schedule information using movement sensing device and apparatus therefof | |
KR20120134485A (en) | Method for searching index list using movement sensing device and apparatus therefof | |
KR20120134374A (en) | Method for controlling 3d mode of navigation map using movement sensing device and apparatus therefof | |
KR101888904B1 (en) | Method for displayng e-book of mobile termianl using movement sensing device and apparatus therefof | |
KR20120078816A (en) | Providing method of virtual touch pointer and portable device supporting the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E601 | Decision to refuse application |