KR20150039460A - Glass type mobile terminal and mode converting method thereof - Google Patents
Glass type mobile terminal and mode converting method thereof Download PDFInfo
- Publication number
- KR20150039460A KR20150039460A KR20130118078A KR20130118078A KR20150039460A KR 20150039460 A KR20150039460 A KR 20150039460A KR 20130118078 A KR20130118078 A KR 20130118078A KR 20130118078 A KR20130118078 A KR 20130118078A KR 20150039460 A KR20150039460 A KR 20150039460A
- Authority
- KR
- South Korea
- Prior art keywords
- user
- routine
- spot
- mode
- image
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- Telephone Function (AREA)
Abstract
Description
The present invention relates to a spectacle type mobile terminal, and more particularly, to a spectacle type mobile terminal capable of displaying information related to a routine behavior of a user on a glass, and a mode changing method thereof.
The mobile terminal may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functions to execute games, and some other mobile terminals are also implemented as multimedia devices. Moreover, recent mobile terminals can receive a broadcast or multicast signal to view a video or television program.
Efforts to support and increase the functions of the mobile terminal continue. Such efforts include not only changes and improvements in structural components that form the mobile terminal, but also improvements in software or hardware.
In recent years, wearable devices such as smart watch and Google glass have been developed to provide various services either alone or in cooperation with mobile terminals.
Currently, various UI (User Interface) or UX (User Experience) have not been developed for providing a limited service only through a wearable device.
Therefore, an object of the present invention is to provide a spectacular mobile terminal capable of displaying information related to a routine behavior of a user on a glass, and a mode changing method thereof.
It is another object of the present invention to provide a spectacular mobile terminal capable of automatically changing an operation mode according to a surrounding situation, and a mode changing method thereof.
According to another aspect of the present invention, there is provided a method of changing a mode of a mobile terminal, including the steps of: registering a place where a user repeatedly goes to a routine spot; Registering the predetermined mode and the routine spot related information in the registered routine spot; Registering an identification image for identifying a routine spot; And automatically switching to the registered mode when the user approaches the routine spot to display the routine spot related information on the glass.
The predetermined mode is a mode stored in the terminal or a mode arbitrarily set by the user.
The routine spot related information includes an application, a task to be viewed by the user, and public information provided in the network, and is displayed in conjunction with time.
The identification image is an image photographed at a routine spot or an image duplicated in a path approaching a routine spot.
The routine spot related information may be displayed according to the distance the user approaches the routine spot.
Wherein the step of displaying the routine spot related information on the glass includes comparing the previously registered identification image with the image of the user's gaze when the user moves to the routine spot to determine whether the current user is moving to the routine spot; And if it is determined that the current user is moving to the routine spot, displaying the routine spot related information at the time point on the glass.
According to an aspect of the present invention, there is provided a spectacle-type mobile terminal including: a glass for displaying routine-related information; A memory for registering a routine spot repeatedly executed by the user, a user mode set in the routine spot, information related to the routine spot, and an identification image; And a control unit for automatically switching to the user mode when the user approaches the previously registered routine spot and automatically displaying the routine spot related information on the glass.
The user mode is a mode stored in the terminal or a mode arbitrarily set by the user.
The routine spot related information includes an application, a task to be viewed by the user, and public information provided in the network, and is displayed in conjunction with time.
The identification image is an image photographed at a routine spot or an image duplicated in a path approaching a routine spot.
The control unit displays different routine spot related information according to the distance that the user approaches the routine spot.
When the user moves to the routine spot, the control unit compares the previously registered identification image with the image of the user's gaze to determine whether the current user is moving to the routine spot. If the current user is recognized as moving to the routine spot, Display the routine spot related information on the glass at the point of time.
In the present invention, when a user always places an image of a place (routine spot) going to a routine and then approaches an appropriate place, the user automatically switches to the registered mode and displays related information on the glass, There is an effect that can be provided.
1 is a block diagram of a mobile terminal according to an embodiment of the present invention;
2A is a block diagram of a wireless communication system in which a mobile terminal can operate in accordance with an embodiment of the present invention;
FIG. 2B is a configuration diagram of a WiFi location tracking system in which a mobile terminal can operate according to an embodiment of the present invention; FIG.
3 is a diagram illustrating a concept that a user sets an arbitrary mode using an image of a routine spot according to an embodiment of the present invention.
Fig. 4 shows a first embodiment in which mode is automatically changed according to peripheral recognition. Fig.
5 is a second embodiment for automatically changing the mode according to the peripheral recognition.
6 is a flow diagram of a mode change method of a spectacled mobile terminal according to an embodiment of the present invention that automatically displays information associated with a routine action of a user.
7 shows registration of an identification image and an extended image for a routine spot;
FIGS. 8 and 9 illustrate automatically the information associated with a routine action of the user. FIG.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. In addition, it should be noted that the attached drawings are only for easy understanding of the embodiments disclosed in the present specification, and should not be construed as limiting the technical idea disclosed in the present specification by the attached drawings.
The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC , A tablet PC (tablet PC), and an ultrabook (ultrabook). However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.
1 is a block diagram illustrating a mobile terminal according to one embodiment disclosed herein.
The
Hereinafter, the components will be described in order.
The
The
The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.
The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the
The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).
For example, the
The broadcast signal and / or broadcast related information received through the
The
The
The
The short-
The
Referring to FIG. 1, an A / V (Audio / Video)
The image frame processed by the
The
The
The
The
The
The
Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the
There may be two or
Also, the
Here, a stereoscopic image represents a 3-dimensional stereoscopic image, and a 3-dimensional stereoscopic image represents a progressive depth and reality in which objects are located on a monitor or a screen, It is an image that makes you feel the same as the space. 3D stereoscopic images are implemented using binocular disparity. The binocular parallax means a parallax caused by the position of two eyes away from each other. When two eyes see two different images and the images are transmitted to the brain through the retina and fused, the depth and real feeling of the stereoscopic image can be felt .
The stereoscopic display unit 152 may be applied to a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system). The stereoscopic method, which is widely used in home television receivers, includes a Wheatstone stereoscopic method.
Examples of the autostereoscopic method include a parallax barrier method, a lenticular method, an integral imaging method, and a switchable lens method. The projection method includes a reflection type holographic method and a transmission type holographic method.
Generally, 3D stereoscopic images consist of left image (left eye image) and right image (right eye image). A top-down method of arranging a left image and a right image in one frame according to a method in which a left image and a right image are combined into a three-dimensional stereoscopic image, A checker board system in which pieces of a left image and a right image are arranged in a tile form, a left-to-right (right-side) Or an interlaced method in which rows are alternately arranged, and a time sequential (frame-by-frame) method in which right and left images are alternately displayed in time.
In addition, the 3D thumbnail image can generate a left image thumbnail and a right image thumbnail from the left image and right image of the original image frame, respectively, and combine them to generate one 3D thumbnail image. In general, a thumbnail means a reduced image or a reduced still image. The left image thumbnail and the right image thumbnail generated in this way are displayed on the screen with a difference of the left and right distance by the depth corresponding to the parallax between the left image and the right image, thereby exhibiting a stereoscopic spatial feeling.
The left and right images necessary for realizing the three-dimensional stereoscopic image can be displayed on the stereoscopic display unit 152 by a stereoscopic processing unit (not shown). The stereoscopic processing unit receives a 3D image and extracts a left image and a right image from the 3D image, or receives a 2D image and converts it into a left image and a right image.
On the other hand, when a
The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the
If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the
Referring to FIG. 1, a
Examples of the
Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.
The
In the case where the three-dimensional display unit 152 and the touch sensor have a mutual layer structure (hereinafter referred to as a 'three-dimensional touch screen') or a three-dimensional sensor that detects the touch operation and the stereoscopic display unit 152 are combined with each other The stereoscopic display unit 152 may also be used as a three-dimensional input device.
The
The
The stereoscopic
The
The
The
For example, the
As another example, a photosensor may be stacked on a display element. The photosensor is configured to scan the movement of the object proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of light change, thereby acquiring position information of the object to be sensed.
The
The
The
In addition to the vibration, the
The
The
The
The
The identification module is a chip for storing various information for authenticating the use right of the
The
The
In addition, the
In addition, if the state of the mobile terminal meets a set condition, the
The
The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.
According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays , Microprocessors, microprocessors, microprocessors, and other electronic units for carrying out other functions. In some cases, the embodiments described herein may be implemented by the
According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein.
The software code may be implemented in a software application written in a suitable programming language. The software code is stored in the
Next, a communication system that can be implemented through the
First, referring to FIG. 2A, the communication system may use different wireless interfaces and / or physical layers. For example, wireless interfaces that can be used by a communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA) , Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM), and the like.
Hereinafter, for the sake of convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to all communication systems including CDMA wireless communication systems.
2A, a CDMA wireless communication system includes at least one
Each of the plurality of
The intersection of sector and frequency assignment may be referred to as a CDMA channel. The
As shown in FIG. 2A, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to
In addition, FIG. 2A illustrates a
Of the typical operation of a wireless communication system, the
Next, a method of acquiring location information of a mobile terminal using a WiFi (Wireless Fidelity) Positioning System (WPS) will be described with reference to FIG. 2B.
A WiFi Positioning System (WPS) 300 uses a WiFi module included in the
The WiFi
The
SSID, RSSI, channel information, Privacy, Network Type, Signal Strength, and Noise Strength based on the location information request message of the
The
In FIG. 2B, the wireless APs connected to the
Next, the
The information of any wireless APs stored in the
Since the
The extracted location information of the
The present invention is applied to a glasses type (glass type) mobile terminal, which is a kind of wearable device. The glasses include monocular or binocular. In the eyeglass type mobile terminal, the glass (lens) is used as the
The present invention relates to a method for automatically switching to a preset mode or notifying a to-do list through a pair of glasses when a stored image is recognized after storing an image of a place (routine spot) that the user always goes to a routine . The image and the representative location (PGS log) are applied to the mode setting in a separate or combined form.
The routine spot may include a company, an elevator, a porch, a porch, a subway station, a bus stop, a conference room, and the like, and includes both individual objects and object combinations.
The default setting mode is set corresponding to the photographed image as a mode set and registered by the user in the setting menu of the mobile terminal. The default setting mode includes a mode (e.g., desk mode, elevator mode) that the user has set and registered arbitrarily as well as a mode (e.g., vibration mode, Wi-Fi on mode and others) The setting mode may include at least one or more options.
FIG. 3 illustrates a concept in which a user sets an arbitrary mode using an image of a routine spot according to an embodiment of the present invention.
As shown in FIG. 3, the user moves from the initial position (Gasan-dong) to the restaurant, and then touches the spectacle frame to capture the inside of the restaurant. The captured image is stored in
When the user visits the restaurant more than a predetermined time, the
The mode setting menu includes various modes other than the basic modes of the mobile terminal. After selecting the other mode, the user sets the mode arbitrarily by inputting "compounding mode". The addition driving mode may include at least one option set by the user. The option includes at least one of a To do list that the user wants to see (e.g., menu) and / or execute (e.g., application) in the place.
Therefore, when the user comes back to the restaurant after setting the adding operation mode, the
The mode described in FIG. 3 is one embodiment, but the present invention is not limited thereto. The user can set a desired mode immediately after photographing the inside of the restaurant.
Fig. 4 is a first embodiment for automatically changing the mode according to peripheral recognition.
As shown in FIG. 4, the user sets a room mode by photographing and registering a door (a door or a front door) 50 of the house through glasses. At this time, the user can select the time zone and register the word as an option of the room mode according to the time. For example, from 7:00 am to 8:00 am, employee ID, yoghurt, and mobile phone can be registered, and night 10:00 to 11:00 can register the door.
When the user wearing the glasses-type terminal is in front of the
If the comparison result indicates that the images match or the degree of similarity is high, the
5 is a second embodiment for automatically changing the mode according to the peripheral recognition.
The user can set the mode based on the image and location. This mode setting is applied when the same object exists in a plurality of places.
The user can set the elevator mode by photographing the
Accordingly, when the user stands in front of the
In addition, the present invention can set the desk mode so that when the user sits at his or her office, the terminal automatically switches to the vibration mode or the Wi-Fi on mode (changed to the profile designated by the user).
6 is a flowchart of a mode change method of the eyeglass-type mobile terminal according to an embodiment of the present invention that automatically displays information related to a routine action of a user.
When the user accumulates a predetermined number of times of commuting at a predetermined place, for example, a specific stop or subway station based on the location information, the
After the user's location is detected and the user approaches the pre-registered routine spot, the
When accessing the routine spot, the
The present invention can optimize the display time of the association information of the routine spot through LOG recording and analysis.
That is, when a stop or a subway station is registered as a routine spot, the user takes an extended shot of the route to the routine spot and registers a duplicate image.
Accordingly, the
Figure 7 shows the identification of the routine spot and the registration of the extended image.
7, when the user rides the bus at 8:00 for three consecutive days, the
Figures 8 and 9 show an embodiment that automatically shows information associated with a routine action of the user.
As shown in Fig. 8, when a user approaches the subway while the specific subway station "Guro Digital Complex" is registered as a routine spot, the subway timetable is automatically displayed on the glass. For example, information such as Arriving at Daelim, 3 minutes, 6 minutes, 1 minute, 4 minutes after arrival is displayed. The above information is public information and is displayed via Wifi or a data network. That is, based on the subway arrival time of the "subway route map app" stored in the goggle type terminal, when the vicinity of the subway is recognized through the GPS and the situation recognition system, the subway arrival time at the corresponding station is displayed on the glass.
Then, as shown in Fig. 9, when the user approaches the stop at the state where the specific stop "E-Mart" is registered as the routine spot, the bus timetable is automatically displayed on the glass. For example, information such as 5536 2 minutes 30 seconds arrival and 5616 6 minutes arrival is displayed.
In addition, the present invention registers an image of a frequent viewer as an identification image as well as a place, and when the registered person is seen, information related to the user, for example, a friend who uses the same SNS, . In other words, the app and the information specified by the user are displayed together.
As described above, according to the present invention, when an image of a place (routine spot) to be routinely registered by the user is registered and the user approaches the place, the user automatically switches to a predetermined mode or performs a To do list on the glass It is possible to provide convenience to the user by displaying it.
According to an embodiment of the present invention, the above-described method can be implemented as a computer-readable code on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Further, the computer may include a control unit of the terminal.
The above-described eyeglass-type mobile terminal and its mode changing method are not limited to the configuration and method of the above-described embodiments, but the embodiments may be modified so that all or part of each embodiment Or may be selectively combined.
50: Door 60: Elevator
151: display unit 160: memory
180:
Claims (12)
Registering the predetermined mode and the routine spot related information in the registered routine spot;
Registering an identification image for identifying a routine spot; And
And if the user approaches the routine spot, automatically switching to the registered mode and displaying the routine spot related information on the glass.
Wherein the mode is a mode stored in the terminal or a mode set by the user arbitrarily inputting the mode.
Wherein the display mode includes an application, a task to be viewed by the user, and public information provided in the network, and is displayed in conjunction with time.
Wherein the image is an image photographed at a routine spot or an image photographed repeatedly in a path approaching a routine spot.
Wherein different information can be displayed according to the distance that the user is close to the routine spot.
Comparing the pre-registered identification image with the image of the user's gaze when the user moves to the routine spot, and determining whether the current user is moving to the routine spot; And
And if it is determined that the current user is moving to the routine spot, displaying the routine spot related information on the glass at that point of time.
A memory for registering a routine spot repeatedly executed by the user, a user mode set in the routine spot, information related to the routine spot, and an identification image; And
And a control unit for automatically switching to the user mode when the user approaches the pre-registered routine spot, and automatically displaying the routine-spot-related information on the glass.
Wherein the mode is a mode stored in the terminal or a mode set by a user arbitrarily inputting the mode.
Wherein the information is displayed in association with time, including an application, a task to be viewed by the user, and public information provided in a network.
Wherein the image is an image photographed at a routine spot or an image photographed redundantly in a path approaching a routine spot.
Wherein the user displays different routine spot related information according to the distance that the user approaches the routine spot.
When the user moves to the routine spot, it is determined whether the current user is moving to the routine spot by comparing the previously registered identification image with the image of the user's gaze. If it is recognized that the current user is moving to the routine spot, And the spot-related information is displayed on the glass.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR20130118078A KR20150039460A (en) | 2013-10-02 | 2013-10-02 | Glass type mobile terminal and mode converting method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR20130118078A KR20150039460A (en) | 2013-10-02 | 2013-10-02 | Glass type mobile terminal and mode converting method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20150039460A true KR20150039460A (en) | 2015-04-10 |
Family
ID=53029756
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR20130118078A KR20150039460A (en) | 2013-10-02 | 2013-10-02 | Glass type mobile terminal and mode converting method thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20150039460A (en) |
-
2013
- 2013-10-02 KR KR20130118078A patent/KR20150039460A/en not_active Application Discontinuation
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR20150056353A (en) | The mobile terminal and the control method thereof | |
KR20140124634A (en) | Mobile terminal and control method thereof | |
KR20150026027A (en) | Wearable glass-type device, systme habving the samde and method of controlling the device | |
KR102080743B1 (en) | Mobile terminal and control method thereof | |
KR101988262B1 (en) | Mobile terminal and control method thereof | |
KR20150018264A (en) | Wearable glass-type device and control method thereof | |
KR20150026026A (en) | Wearable watch-type device and systme habving the same | |
KR20150020918A (en) | Display device and control method thereof | |
KR20140113154A (en) | Mobile terminal and control method thereof | |
KR20150008733A (en) | Glass type portable device and information projecting side searching method thereof | |
KR20140109719A (en) | Mobile terminal and control method thereof | |
KR101763227B1 (en) | Mobile terminal and method for controlling the same | |
KR102195773B1 (en) | Wearable glass-type device and method of controlling the device | |
KR20150009008A (en) | Mobile terminal and control method thereof | |
KR102018550B1 (en) | Control apparatus of mobile terminal and method thereof | |
KR20150033431A (en) | Wearable glass-type device and control method thereof | |
KR20150004192A (en) | Display device and control method thereof | |
KR20140102936A (en) | Mobile terminal and control method thereof | |
KR20140136309A (en) | Control apparatus of mobile terminal and method thereof | |
KR20150050077A (en) | Control apparatus of mobile terminal and method thereof | |
KR20150014284A (en) | Wearable glass-type device and control method thereof | |
KR20150056360A (en) | Wearable glass-type device and method of controlling the device | |
KR20150012886A (en) | Mobile terminal and information exchangeing method using nfc tag thereof | |
KR20140102937A (en) | Mobile terminal and method for controlling the same | |
EP3005575B1 (en) | Terminal and method for controlling the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WITN | Withdrawal due to no request for examination |