US10560677B2 - Three-dimensional image processing apparatus and electric power control method of the same - Google Patents
Three-dimensional image processing apparatus and electric power control method of the same Download PDFInfo
- Publication number
- US10560677B2 US10560677B2 US13/673,216 US201213673216A US10560677B2 US 10560677 B2 US10560677 B2 US 10560677B2 US 201213673216 A US201213673216 A US 201213673216A US 10560677 B2 US10560677 B2 US 10560677B2
- Authority
- US
- United States
- Prior art keywords
- dimensional image
- user
- controller
- mode
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/373—Image reproducers using viewer tracking for tracking forward-backward translational head movements, i.e. longitudinal movements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/376—Image reproducers using viewer tracking for tracking left-right translational head movements, i.e. lateral movements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/18—Diffraction gratings
- G02B5/1814—Diffraction gratings structurally combined with one or more further optical elements, e.g. lenses, mirrors, prisms or other diffraction gratings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G06K9/00281—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/144—Movement detection
- H04N5/145—Movement estimation
Definitions
- the present disclosure relates to a three-dimensional image processing apparatus and an electric power control method of the same.
- a method of displaying a three-dimensional image may use a principle of binocular disparity by which a viewer experiences a three-dimensional effect due to binocular disparity.
- Such a method may be classified as a shutter glass method, a glassless method, or a full three-dimensional method.
- a region in which a user can view a three-dimensional image without image flipping and cross-talk is limited. Consequently, it is necessary to control display of a three-dimensional image based on a position of the user.
- a three-dimensional image processing apparatus and an electric power control method of the same may move a sweet spot region to correspond to a position of a user, thereby minimizing power consumption.
- FIG. 1 is a block diagram of a three-dimensional image processing apparatus according to an embodiment of the present disclosure
- FIG. 2 is a front perspective view of a three-dimensional image processing apparatus according to an embodiment of the present disclosure
- FIG. 3 is a diagram showing the disposition of a three-dimensional image filter according to an embodiment of the present disclosure
- FIG. 4 is a perspective view showing the disposition of a three-dimensional image filter according to an embodiment of the present disclosure
- FIG. 5 is a diagram illustrating a principle of a liquid crystal lenticular filter
- FIGS. 6A to 6D are block diagrams that illustrate operational modes of a controller according to an embodiment of the present disclosure
- FIG. 7 is a diagram illustrating calculation of a three-dimensional image variation depending upon change in position of a user
- FIG. 8 is a diagram illustrating a movement of a sweet spot according to a change in position of a three-dimensional image filter
- FIG. 9 is a diagram illustrating time intervals of image frames captured by a camera
- FIGS. 10A to 10D are block diagrams that illustrate operational modes of a controller according to another embodiment of the present disclosure.
- FIG. 11 is a diagram illustrating a movement of a sweet spot according to a change in display position of a view image
- FIGS. 12A to 12D are block diagrams that illustrate operational modes of a controller according to another embodiment of the present disclosure.
- FIGS. 13 to 16 are views showing image frames of a user captured by a camera
- FIGS. 17A to 17D are block diagrams that illustrate operational modes of a controller according to a further embodiment of the present disclosure.
- FIG. 18 is a flow chart of a method of controlling a three-dimensional image processing apparatus according to an embodiment of the present disclosure
- FIGS. 19A and 19B are views of a graphical user interface (GUI) to allow a user to input a request for switching between tracking function modes;
- GUI graphical user interface
- FIG. 20 is a flow chart of a method of controlling a three-dimensional image processing apparatus according to another embodiment of the present disclosure.
- FIG. 21 is a flow chart of a method of controlling a three-dimensional image processing apparatus according to a further embodiment of the present disclosure.
- a three-dimensional image processing apparatus described in this specification may include mobile terminals, such as a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigator, or the like.
- mobile terminals such as a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigator, or the like.
- PDA personal digital assistant
- PMP portable multimedia player
- navigator or the like.
- FIG. 1 is a block diagram of a three-dimensional image processing apparatus according to an embodiment of the present disclosure.
- the three-dimensional image processing apparatus 100 may include a wireless communication device 110 , an audio/video (A/V) input device 120 , a user input device 130 , a sensing device 140 , an output device 150 , a memory 160 , an interface device 170 , a controller 180 , a three-dimensional image filter drive device 183 , a three-dimensional image filter 185 and a power supply device 190 .
- the components shown in FIG. 1 are not indispensible. Consequently, the three-dimensional image processing apparatus may include more than or less than the components as listed above.
- the wireless communication device 110 may include one or more modules to enable wireless communication between the three-dimensional image processing apparatus 100 and a wireless communication system or between the three-dimensional image processing apparatus 100 and a network in which the three-dimensional image processing apparatus 100 is located.
- the wireless communication device 110 may include a broadcast reception module 111 , a mobile communication module 112 , a wireless Internet module 113 , a short range communication module 114 and a position information module 115 .
- the broadcast reception module 111 receives broadcast signals and/or broadcast-related signals from an external broadcast management server through broadcast channels.
- the broadcast channels may include satellite channels and terrestrial channels.
- the broadcast management server may be a server to generate broadcast signals and/or broadcast-related information and to transmit the generated broadcast signals and/or broadcast-related information or a server to receive pre-generated generate broadcast signals and/or broadcast-related information and to transmit the received broadcast signals and/or broadcast-related information to terminals.
- the broadcast signals may include TV broadcast signals, radio broadcast signals and data broadcast signals.
- the broadcast signals may include broadcast signals formed by combining data broadcast signals with TV broadcast signals or radio broadcast signals.
- the TV broadcast signals may include two-dimensional image broadcast signals and three-dimensional image broadcast signals.
- the broadcast-related information may be information regarding broadcast channels, broadcast programs, broadcast service providers, or another appropriate type of information.
- the broadcast-related information may be provided through a mobile network. In this case, the broadcast-related information may be received by the mobile communication module 112 .
- the broadcast-related information may be provided in various forms.
- the broadcast-related information may be provided in the form of an electronic program guide (EPG) of digital multimedia broadcasting (DMB) or an electronic service guide (ESG) of digital video broadcast-handheld (DVB-H).
- EPG electronic program guide
- ESG electronic service guide
- DMB digital multimedia broadcasting
- DVB-H digital video broadcast-handheld
- the broadcast reception module 111 may receive digital broadcast signals using digital broadcasting systems, such as digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), media forward link only (MediaFLO), digital video broadcast-handheld (DVB-H), and integrated services digital broadcast-terrestrial (ISDB-T).
- digital broadcasting systems such as digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), media forward link only (MediaFLO), digital video broadcast-handheld (DVB-H), and integrated services digital broadcast-terrestrial (ISDB-T).
- DMB-T digital multimedia broadcasting-terrestrial
- DMB-S digital multimedia broadcasting-satellite
- MediaFLO media forward link only
- DVD-H digital video broadcast-handheld
- ISDB-T integrated services digital broadcast-terrestrial
- the broadcast reception module 111 may be configured to be suitable for the above-mentioned digital broadcasting systems and other different broadcasting systems.
- Broadcast signals and/or broadcast-related information received by the broadcast reception module 111 may be stored in the memory 160 .
- the mobile communication module 112 may transmit and receive wireless signals to and from at least one selected from among a base station, an external terminal and a server via a mobile communication network.
- the wireless signals may include speech call signals, video communication call signals or various forms of data based on transmission and receipt of text/multimedia messages.
- the wireless Internet module 113 is a module for wireless Internet connection.
- the wireless Internet module 113 may be mounted inside or outside the three-dimensional image processing apparatus 100 .
- Wireless LAN WLAN
- Wi-Fi wireless fidelity
- WiBro wireless broadband
- WiMax world interoperability for microwave access
- HSDPA high speed downlink packet access
- the short range communication module 114 is a module for short range communication.
- Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee or the like may be used as short range communication technology.
- RFID radio frequency identification
- IrDA infrared data association
- UWB ultra wideband
- ZigBee ZigBee
- the position information module 115 is a module to acquire positions of the three-dimensional image processing apparatus.
- a representative model of the position information module 115 is a global position system (GPS) module.
- GPS global position system
- the AN input device 120 is provided to input audio signals or video signals.
- the A/V input device 120 may include a camera 121 and a microphone 122 .
- the camera 121 may process image frames, such as still images or moving images, acquired by an image sensor in a video communication mode or in a shooting mode. The processed image frames may be displayed on the display device 151 .
- the image frames captured by the camera 121 may be processed by the controller 180 , stored in the memory 160 , or transmitted to an external device via the wireless communication device 110 . According to circumstances, two or more cameras 121 may be provided.
- the microphone 122 receives external acoustic signals and processes the received acoustic signals into electrical speech data in a communication mode or a recording mode and a speech recognition mode.
- the processed speech data may be converted and output in a form transmittable to a mobile communication base station through the mobile communication module 112 .
- Various noise removal algorithms to remove noise generated during input of external acoustic signals into the microphone 122 may be incorporated in the microphone 122 .
- the user input device 130 allows a user to input commands to control the operation of a terminal.
- the user input device 130 may include a key pad, a dome switch, a touch pad (static pressure/electrostatic), a jog wheel, a jog switch or another appropriate interface.
- the sensing device 140 senses a current state of the three-dimensional image processing apparatus 100 , such as an open and closed state of the three-dimensional image processing apparatus 100 , a position of the three-dimensional image processing apparatus 100 , whether user contact has been occurred, a direction of the three-dimensional image processing apparatus 100 , acceleration/deceleration of the three-dimensional image processing apparatus 100 or the like to generate a sensing signal to control the operation of the three-dimensional image processing apparatus 100 .
- the sensing device 140 may sense whether the slide phone has been opened or closed.
- the sensing device 140 may sense whether power has been supplied from the power supply device 190 and whether the interface device 170 has been coupled to an external device. Meanwhile, the sensing device 140 may include a proximity sensor 141 and an ambient light sensor 143 .
- the output device 150 may generate output related to visual sensation, auditory sensation or tactile sensation.
- the output device 150 may include a display device 151 , an acoustic output module 152 , an alarm device 153 , a haptic module 154 , a projector module 155 , or another appropriate type of output interface.
- the display device 151 may display (output) information processed by the three-dimensional image processing apparatus 100 .
- the display device 151 may display a user interface (UI) or a graphical user interface (GUI) related to communication.
- UI user interface
- GUI graphical user interface
- the display device 151 may display captured and/or received images, a UI or a GUI.
- the display device 151 may display broadcast signals or stored image data.
- the display device 151 may include at least one display selected from among a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display and a three-dimensional display (3D display), or another appropriate type of display.
- LCD liquid crystal display
- TFT-LCD thin film transistor-liquid crystal display
- OLED organic light emitting diode
- flexible display and a three-dimensional display (3D display), or another appropriate type of display.
- 3D display three-dimensional display
- Some of these displays may be configured into a transparent type or light transmission type displays, through which the outside can be seen. These displays may be referred to as transparent displays.
- a representative of the transparent displays is a transparent OLED (TOLED).
- the rear structure of the display device 151 may also be configured into a light transmission type structure. In this structure, it is possible for a user to view objects located at the rear of the terminal body through a region occupied by the display device 151 of the terminal body.
- two or more display devices 151 may be provided.
- the three-dimensional image processing apparatus 100 may be configured so that a plurality of display devices is disposed on a single plane in a state in which the display devices are spaced apart from each other or are in one deviceed body or so that the display devices are disposed on different planes.
- the display device 151 and a sensor to sense a touch operation constitute a layered structure (hereinafter, referred to as a ‘touch screen’)
- the display device 151 may be used as an input device as well as an output device.
- the touch sensor may be configured in the form of a touch film, touch sheet, touch pad or the like.
- the touch sensor may be configured to convert the change of pressure applied to a specific region of the display device 151 or the change of capacitance generated in a specific region of the display device 151 into an electric input signal.
- the touch sensor may be configured to sense touch pressure as well as a touched position and area.
- a corresponding signal(s) is transmitted to a touch controller.
- the touch controller processes the signal(s) and transmits data corresponding to the processed signal(s) to the controller 180 . Consequently, the controller 180 can determine which region of the display device 151 has been touched.
- the proximity sensor 141 may be disposed at an inner region of the three-dimensional image processing apparatus 100 and surrounded by the touch screen or in the vicinity of the touch screen.
- the proximity sensor may sense whether an object has approached a predetermined sensing surface or is present in the vicinity of the predetermined sensing surface using electromagnetic force or infrared rays without mechanical contact.
- the proximity sensor may have a longer lifespan and higher applicability than a contact type sensor.
- Examples of the proximity sensor 141 may include a transmission type photoelectric sensor, direct reflection type photoelectric sensor, mirror reflection type photoelectric sensor, high frequency oscillation type proximity sensor, capacitive type proximity sensor, magnetic type proximity sensor, infrared proximity sensor, or the like.
- the touch screen is of an electrostatic type
- the touch screen is configured to sense an approach of a pointer based on change in an electric field caused by the approach of the pointer.
- the touch screen may be classified as a proximity sensor.
- proximity touch an action in which a pointer approaches the touch screen without contact and it is recognized that the pointer is located on the touch screen
- contact touch an action in which a pointer directly contacts the touch screen
- a position at which proximity touch of the pointer is performed on the touch screen is a position at which the pointer corresponds substantially perpendicular to the touch screen when the proximity touch of the pointer is performed.
- the proximity sensor 141 senses a proximity touch operation and proximity touch patterns (for example, a proximity touch distance, a proximity touch direction, proximity touch velocity, proximity touch time, a proximity touch position, proximity touch movement, etc.). Information corresponding to the sensed proximity touch operation and proximity touch patterns may be output on the touch screen.
- a proximity touch operation and proximity touch patterns for example, a proximity touch distance, a proximity touch direction, proximity touch velocity, proximity touch time, a proximity touch position, proximity touch movement, etc.
- the acoustic output module 152 may output audio data received from the wireless communication device 110 or stored in the memory 160 in a call signal reception mode, a communication mode, a recording mode, a speech recognition mode, a broadcast reception mode, or the like.
- the acoustic output module 152 may output acoustic signals related to functions (for example, call signal reception sound, message reception sound, etc.) executed by the three-dimensional image processing apparatus 100 .
- the acoustic output module 152 may include a receiver, speaker, buzzer, or another appropriate acoustic device.
- the alarm device 153 may output signals to notify that events have been generated in the three-dimensional image processing apparatus 100 .
- Examples of events generated in the three-dimensional image processing apparatus 100 may include call signal reception, message reception, key signal input, touch input, or the like.
- the alarm device 153 may output other different signals, for example vibration signals to notify of event generation in addition to video signals and audio signals.
- the video signals and audio signals may also be output through the display device 151 or the speech output module 152 . Consequently, the display device 151 or the speech output module 152 may be classified as a part of the alarm device 153 .
- the haptic module 154 may generate various tactile effects that a user can feel.
- a representative example of the tactile effects generated by the haptic module 154 is vibration. It is possible to control intensity and patterns of vibration generated by the haptic module 154 . For example, different kinds of vibration may be output in a synthesized state or may be sequentially output.
- the haptic module 154 may generate various tactile effects, such as stimulative effects caused by the arrangement of pins movable perpendicularly to the skin with which the pins are in contact, injection force or suction force of air through an injection port or a suction port, rubbing against the skin, contact with an electrode, electrostatic force, etc. and effects through reproduction of cold and warm sensation using endothermic or exothermic elements.
- the haptic module 154 may be configured to transmit tactile effects through direct contact and, in addition, for a user to feel tactile effects through sensation of muscles, such as fingers or arms. Depending upon how the three-dimensional image processing apparatus 100 is configured, two or more haptic modules 154 may be provided.
- the projector module 155 is a component to perform an image projection function using the three-dimensional image processing apparatus 100 .
- the projector module 155 may display an image identical to or partially different from the image displayed on the display device 151 on an external screen or wall according to a control signal of the controller 180 .
- the projector module 155 may include a light source to generate light (for example, laser light) necessary to output an image to the outside, an image generation device to generate an image to be output to the outside using the light generated by the light source, and a lens to output the image from a predetermined focal distance to the outside in an enlarged state. Also, the projector module 155 may include a device to mechanically move the lens of the entirety of the module to control an image projection direction.
- a light source to generate light (for example, laser light) necessary to output an image to the outside
- an image generation device to generate an image to be output to the outside using the light generated by the light source
- a lens to output the image from a predetermined focal distance to the outside in an enlarged state.
- the projector module 155 may include a device to mechanically move the lens of the entirety of the module to control an image projection direction.
- the projector module 155 may be classified as a cathode ray tube (CRT) module, a liquid crystal display (LCD) module, a digital light processing (DLP) module, or the like.
- the DLP module is configured so that light generated from the light source is reflected by digital micromirror device (DMD) chips to project the generated image in an enlarged state. Consequently, the DLP module may be advantageous in reducing the size of the projector module 151 .
- DMD digital micromirror device
- the projector module 155 may be provided at the side, front or rear of the three-dimensional image processing apparatus 100 in the longitudinal direction thereof. Of course, the projector module 155 may be provided at any position of the three-dimensional image processing apparatus 100 as needed.
- the memory 160 may store programs necessary for the controller 180 to perform processing and control and, in addition, temporarily store input/output data (for example, telephone directories, messages, audio, still images, moving images, etc.)
- the memory 160 may also store frequency of use of the data (for example, frequency of use of each telephone number, each message and each piece of multimedia).
- the memory 160 may store data related to various patterns of vibration and sound output upon performing touch input on the touch screen.
- the memory 160 may include at least one selected from among a flash memory type memory, a hard disk type memory, a multimedia card micro type memory, a card type memory (for example, SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, or another appropriate type of storage device.
- the three-dimensional image processing apparatus 100 may be operated in connection with a web storage, which performs a storage function of the memory 160 over the Internet.
- the interface device 170 serves as a path to external devices connected to the three-dimensional image processing apparatus 100 .
- data from the external devices may be received by the three-dimensional image processing apparatus 100 , power supplied to the components of the three-dimensional image processing apparatus 100 , or data transmitted from the three-dimensional image processing apparatus 100 to the external devices.
- a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port to connect a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, etc. may be included in the interface device 170 .
- the identification module is a chip which stores various kinds of information necessary to authenticate a user of the three-dimensional image processing apparatus 100 .
- the identification module may include a user identity module (UIM), a subscriber identity module (SIM) and a universal scriber identity module (USIM).
- a device having such an identification module (hereinafter, referred to as an ‘identification device’) may be manufactured in the form of a smart card. Consequently, the identification device can be connected to the three-dimensional image processing apparatus 100 through the port.
- the interface device 170 may be a path through which power from an external cradle is supplied to the three-dimensional image processing apparatus 100 when the three-dimensional image processing apparatus 100 is connected to the cradle or a path through which various command signals input by a user through the cradle are transmitted to the mobile terminal.
- Various command signals or power input from the cradle may be operated as a signal to recognize that the mobile terminal has been correctly mounted in the cradle.
- the controller 180 may control overall operations of the three-dimensional image processing apparatus 100 .
- the controller 180 may perform control and processing related to speech communication, data communication, video communication, etc.
- the controller 180 may include a multimedia module 181 to reproduce multimedia.
- the multimedia module 181 may be incorporated in the controller 180 or may be configured separately from the controller 180 .
- the controller 180 may perform pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as text and images. Also, the controller 180 may detect user action and control a command or operation corresponding to the detected user action to be performed.
- the user action may include selection of a physical button of the three-dimensional image processing apparatus 100 or a remote control, execution of a predetermined gesture on the touch screen or selection of a soft button on the touch screen, execution of a predetermined gesture recognized from images captured by the camera 121 , execution of a predetermined speech recognized by speech recognition, or the like.
- the controller 180 may receive image frames in which a user image has been captured from the camera 121 and detect a position of the user using the received image frames. In some embodiments, the controller 180 may calculate a position of a three-dimensional image filter based on the detected position of the user.
- the position of the three-dimensional image filter may be a position of a barrier or a position of the lens.
- the controller 180 may calculate variation of three-dimensional images based on the detected position of the user. Also, the controller 180 may set a position where a view image contained in the three-dimensional images will be displayed based on the calculated variation of three-dimensional images. For example, as shown in FIG. 11 , the controller 180 may control display positions of a left view image and a right view image depending upon the detected position of the user.
- the controller 180 may calculate a difference value between the calculated position of the three-dimensional image filter and the current position of the three-dimensional image filter to calculate an amount of movement of the three-dimensional image filter.
- the amount of movement of the three-dimensional image filter may be an amount of movement of the barrier or an amount of movement of the lens.
- the controller 180 may calculate velocity of movement of the user using at least one selected from among the current detected position of the user and the previously detected position of the user. Also, the controller 180 may estimate a position of the user when a predetermined time elapses using the detected position of the user and the calculated velocity of movement of the user and calculate a position of the three-dimensional image filter and an amount of movement of the three-dimensional image filter based on the estimated position of the user.
- the controller 180 may generate a control signal requesting movement of the three-dimensional image filter based on the calculated position of the three-dimensional image filter or the calculated amount of movement of the three-dimensional image filter and may output the generated control signal to the three-dimensional image filter drive device 183 .
- the three-dimensional image filter drive device 183 may control movement of the barrier or the lens of the three-dimensional image filter 185 based on the position of the three-dimensional image filter calculated by the controller 180 .
- the three-dimensional image filter drive device 183 may calculate a difference value between the position of the three-dimensional image filter calculated by the controller 180 and the current position of the three-dimensional image filter to calculate an amount of movement of the three-dimensional image filter, and may control movement of the barrier or the lens based on the calculated amount of movement of the three-dimensional image filter.
- the three-dimensional image filter drive device 183 may control movement of a transmission region and a non-transmission region of the three-dimensional image filter 185 based on a position of the non-transmission region calculated by the controller 180 . In some embodiments, the three-dimensional image filter drive device 183 may control movement of the lens of the three-dimensional image filter 185 based on the position of the lens calculated by the controller 180 .
- the transmission region is a region of the three-dimensional image filter through which light is transmitted
- the non-transmission region is a region of the three-dimensional image filter through which light is not transmitted.
- the non-transmission region may be a region occupied by the barrier.
- the three-dimensional image filter 185 is a filter to enable a user to view two or more view images displayed on the display device 151 as three-dimensional images. That is, the three-dimensional image filter 185 controls optical paths of view images displayed by the display device 151 . Controlling optical paths of view images may mean interrupting optical paths of some of the view images or refracting the view images.
- the three-dimensional image filter 185 may be a liquid crystal parallax barrier or a liquid crystal lenticular filter.
- the three-dimensional image filter 185 may include transmission regions and non-transmission regions arranged at predetermined intervals. Light emitted from the display device 151 passes through the transmission regions and reaches the right eye or the left eye of a user.
- the non-transmission regions may be constituted by barriers. A pair of transmission and non-transmission regions may be referred to as a pitch.
- the transmission regions and the non-transmission regions of the three-dimensional image filter 185 may be moved under control of the three-dimensional image filter drive device 183 . At this time, the three-dimensional image filter 185 may be fixed to the three-dimensional image processing apparatus 100 .
- the transmission regions and the non-transmission regions may be divided from each other by lenses.
- One lens may be referred to as a pitch.
- the lenses of the three-dimensional image filter 185 may be moved under control of the three-dimensional image filter drive device 183 . At this time, the three-dimensional image filter 185 may be fixed to the three-dimensional image processing apparatus 100 .
- the power supply device 190 supplies external power or internal power to the respective components of the three-dimensional image processing apparatus under control of the controller 180 .
- the ambient light sensor 143 may sense the illuminance of ambient light outside the three-dimensional image processing apparatus 100 and output the sensed illuminance of the ambient light to the controller 180 .
- the three-dimensional image processing apparatus 100 may further include an analog/digital (A/D) converter to convert the illuminance of the ambient light sensed by the ambient light sensor 143 into a digital value and to output the converted digital value to the controller 180 .
- A/D analog/digital
- the controller 180 may adjust a mode of a tracking function based on the illuminance of the ambient light sensed by the ambient light sensor 143 .
- the tracking function is a function to set user position information related to the position of a user using images captured by the camera 121 and to generate a control signal to control a perceived display of three-dimensional images based on the set user position information.
- the control signal may include at least one selected from among a control signal to control movement of the lens of the lenticular lens board, a control signal to control movement of the non-transmission region of the parallax barrier, and a control signal to control positions of view images to be displayed on the display device 151 .
- a mode of the tracking function may include at least one selected from among an off mode in which the tracking function is not executed and an on mode in which the tracking function is executed.
- the on mode may include at least one selected from among a stop mode in which the execution of the tracking function is stopped, a limit mode in which the tracking function is limitedly executed, and a normal mode in which the tracking function is normally executed.
- Various embodiments described herein may be realized in recording media, which can be read from a computer or a device similar thereto, for example, using software, hardware or a combination thereof.
- embodiments described herein may be realized using at least one selected from among application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, or another appropriate type of device.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGAs field programmable gate arrays
- processors controllers, microcontrollers, microprocessors, or another appropriate type of device.
- controller 180 Embodiments described herein may be realized using the controller 180 .
- embodiments such as procedures and functions described herein may be realized using additional software modules.
- the software modules may perform one or more functions and operations described herein.
- Software code may be realized using a software application written using an appropriate programming language.
- the software code may be stored in the memory 160 and may be executed by the controller 180 .
- FIG. 2 is a front perspective view of a three-dimensional image processing apparatus according to an embodiment of the present disclosure.
- the three-dimensional image processing apparatus 100 is shown to have a bar type terminal body.
- embodiments of the present disclosure are not limited thereto.
- Embodiments of the present disclosure may be applied to various structures, such as a slide type structure, a folder type structure, a swing type structure, a swivel type structure, or the like, in which two or more bodies are coupled to each other so that the bodies can move relative to each other.
- the body includes a case (casing, housing, cover, etc.) forming the external appearance thereof.
- the case may be divided into a front case 101 and a rear case 102 .
- Various electronic parts are mounted in a space defined between the front case 101 and the rear case 102 .
- At least one intermediate case may be further provided between the front case 101 and the rear case 102 .
- the cases may be formed through injection molding of a synthetic resin or may be formed of a metal material, such as stainless steel (STS) or titanium (Ti).
- the display device 151 , the acoustic output device 152 , the camera 121 , the user input device 130 ( 131 and 132 ), the microphone 122 , and the interface device 170 may be disposed at the terminal body, particularly at the front case 101 .
- the display device 151 may occupy a major portion of the main surface of the front case 101 .
- the acoustic output device 152 and the camera 121 may be disposed at a region of the front case 101 adjacent to one end of the display device 151 .
- the three-dimensional image filter 185 may be disposed at one end of the display device 151 .
- the three-dimensional image filter 185 may be bonded to one end of the display device 151 .
- the user input device 131 and the microphone 122 may be disposed at a region of the front case 101 adjacent to the other end of the display device 151 .
- the user input device 131 and the interface device 170 may be disposed at sides of the front case 101 and the rear case 102 .
- the user input device 130 may allow a user to input a command to control the operation of the three-dimensional image processing apparatus 100 .
- the user input device 130 may include a plurality of manipulation devices 131 and 132 .
- the manipulation devices 131 and 132 may be generally referred to as a manipulation portion. Any type of manipulation devices 131 and 132 may be adopted as long as a user can manipulate the manipulation devices 131 and 132 while having a tactile sensation.
- Content input via the first or second manipulation device 131 or 132 may be variously set.
- the first manipulation device 131 may allow a user to input commands such as start, end and scroll
- the second manipulation device 132 may allow a user to input commands to adjust the volume of sound output from the acoustic output device 152 or switch to a touch recognition mode of the display device 151 .
- FIG. 3 is a diagram showing the disposition of a three-dimensional image filter according to an embodiment of the present disclosure.
- a three-dimensional image panel 300 may include a display panel 310 to display a three-dimensional image constituted by a mixture of left view images L and right view images R and a three-dimensional image filter 320 having non-transmission regions 321 and transmission regions 322 which are arranged at predetermined intervals.
- the three-dimensional image filter 320 may be a liquid crystal parallax barrier.
- the display device 151 of FIG. 1 may be the display panel 310
- the three-dimensional image filter 185 of FIG. 1 may be the three-dimensional image filter 320 .
- the three-dimensional image filter 320 may be disposed in front of the display panel 310 so that the three-dimensional image filter 320 is spaced from the display panel 310 by a predetermined distance.
- the non-transmission regions 321 and the transmission regions 322 may be alternately arranged in the direction parallel to the display panel 310 .
- the display panel 310 displays view images corresponding to the left eye L and the right eye R, and the displayed left view images L and right view images R may be viewed through the three-dimensional image filter 320 .
- the left eye and the right eye of the user may independently view the corresponding left view images L and the right view images R provided on the display panel 310 . As a result, the user may experience a three-dimensional effect.
- a spot where the user can view the three-dimensional image well is called a sweet spot. That is, the sweet spot may be a spot where left view images L and right view images R do not overlap, e.g., cross-talk does not occur, and left view images L and right view images R are not flipped, e.g., image flipping does not occur.
- the sweet spot where the left view images L are seen well may be points 332 and 334
- the sweet spot where the right view images R are seen well may be points 331 and 333 .
- image flipping may occur (e.g., the perceived 3D effect such as the perceived depth may be inverted).
- FIG. 4 is a perspective view showing the disposition of a three-dimensional image filter according to another embodiment of the present disclosure.
- a three-dimensional image panel 400 may include a display panel 410 to display a three-dimensional image constituted by a mixture of left view images L and right view images R and a three-dimensional image filter 420 having a plurality of lenses.
- the display device 151 of FIG. 1 may be the display panel 410
- the three-dimensional image filter 185 of FIG. 1 may be the three-dimensional image filter 420 .
- the three-dimensional image filter 420 may be disposed in front of the display panel 410 .
- the three-dimensional image filter 420 may be spaced from the display panel 410 by a predetermined distance I so that images are placed on focal planes of the lenses.
- the three-dimensional image filter 420 may be a lenticular filter.
- the lens 421 , the lens 422 , the lens 423 , the lens 424 and the lens 425 of the three-dimensional image filter 420 may be liquid crystal lenses.
- FIG. 5 is a diagram illustrating a principle of a liquid crystal lenticular filter.
- a liquid crystal lenticular filter 520 may include transparent electrodes (ITO) 521 and 522 and a liquid crystal LC disposed between the transparent electrodes.
- the liquid crystal lenticular filter 520 may adjust refraction of light emitted from the display panel 510 through the liquid crystal LC so that view images are placed at appropriate sweet spots. That is, the liquid crystal LC constitutes lenses to refract light.
- the liquid crystal lenticular filter 520 may adjust voltage applied to the transparent electrodes (ITO) to adjust the position, direction and disposition of the liquid crystal LC. Depending upon the position, direction and disposition of the liquid crystal LC, the positions of the lenses may be changed, and therefore, the sweet spots may be changed.
- FIGS. 6A to 6D are block diagrams that illustrate operational modes (states) of a controller according to an embodiment of the present disclosure.
- the controller 180 may include a position detection device 610 , a movement amount calculation device 620 , and a communication controller 630 .
- the position detection device 610 may receive image frames in which a user image has been captured from the camera 121 and detects a position of the user using the received image frames.
- the position detection device 610 may recognize a face region to detect the position of the user.
- the position detection device 610 may recognize the face region using an algorithm based on symmetry of a face, an algorithm based on hair color and face color, and an algorithm based on the contour of a face.
- the position detection device 610 may calculate skin color information from the image frames to recognize the facial region.
- the movement amount calculation device 620 may calculate a position of the three-dimensional image filter and a movement amount of the three-dimensional image filter based on the detected position of the user and outputs the calculated position of the three-dimensional image filter or the calculated movement amount of the three-dimensional image filter. Also, the movement amount calculation device 620 may generate a control signal to control movement of the non-transmission regions of the three-dimensional image filter according to the current position of the three-dimensional image filter and the calculated movement amount of the three-dimensional image filter, and may output the generated control signal to the communication controller 630 .
- the generated control signal may be a signal to enable the non-transmission regions of the three-dimensional image filter to be located at a point away from the current point by the calculated movement amount of the three-dimensional image filter.
- the movement amount calculation device 620 may find the positions of the transmission regions and the non-transmission regions of the three-dimensional image filter having sweet spots corresponding to the detected position of the user and may calculate differences between the found positions and the current positions of the transmission regions and the non-transmission regions of the three-dimensional image filter to obtain a movement amount of the three-dimensional image filter.
- the movement amount calculation device 620 may calculate the position of the lens and the movement amount of the lens based on the detected position of the user and may output the calculated position of the lens and the calculated movement amount of the lens.
- the calculated position of the lens and the calculated movement amount of the lens may be output to the three-dimensional image filter drive device 183 .
- the movement amount calculation device 620 may generate a control signal to control movement of the lens according to the current position of the lens and the calculated movement amount of the lens and may output the generated control signal to the communication controller 630 .
- the generated control signal may be a signal to enable the lens to be located at a point away from the current point by the calculated movement amount of the lens.
- the communication controller 630 may transmit the control signal generated by the movement amount calculation device 620 to the three-dimensional image filter drive device 183 .
- the communication controller 630 may output the control signal to the three-dimensional image filter drive device 183 in an I2C communication fashion.
- the mode of the tracking function is a normal mode
- power is supplied to the camera 121 , the ambient light sensor 143 , the position detection device 610 , the movement amount calculation device 620 , and the communication controller 630 .
- the mode of the tracking function is a limit mode
- power is supplied to the camera 121 , the ambient light sensor 143 , the position detection device 610 , and the communication controller 630 .
- power is not supplied to the movement amount calculation device 620 .
- the mode of the tracking function is a stop mode
- power is supplied to the ambient light sensor 143 and the communication controller 630 .
- power is not supplied to the camera 121 , the position detection device 610 , and the movement amount calculation device 620 .
- the mode of the tracking function is an off mode
- power is supplied to the communication controller 630 .
- power is not supplied to the camera 121 , the ambient light sensor 143 , the position detection device 610 , and the movement amount calculation device 620 .
- power may not be supplied to the communication controller 630 .
- That power is not supplied to the position detection device 610 , the movement amount calculation device 620 , and the communication controller 630 may mean that the position detection device 610 , the movement amount calculation device 620 , and the communication controller 630 are not operated and associated load of the controlling 180 is reduced.
- FIG. 7 is a diagram illustrating a process for calculating a three-dimensional image variation depending upon change in position of a user.
- an example of the variation of the three-dimensional image e.g., a pixel movement amount P
- P Mod( h,Q ) (2) where Q indicates a three-dimensional image pixel cycle.
- the movement amount calculation device 620 may calculate variation of the three-dimensional image using mathematical expression 1 and mathematical expression 2 and may calculate a movement amount of the three-dimensional image filter based on the calculated variation of the three-dimensional image.
- FIG. 8 is a diagram illustrating a movement of a sweet spot according to a change in position of a three-dimensional image filter.
- a three-dimensional image filter 810 including non-transmission regions 811 and transmission regions 812 has a sweet spot 815 in which sweet spots 817 to enable a user to view left view images L displayed on a display panel 801 and sweet spots 816 to enable the user to view right view images R displayed on the display panel 801 are alternately arranged.
- a three-dimensional image filter 820 including non-transmission regions 821 and transmission regions 822 may have a sweet spot 825 that correspond to the position of the user.
- the sweet spot 825 may include a sweet spot 827 corresponding to left view images L displayed on the display panel 801 and sweet spot 826 corresponding to right view images R displayed on the display panel 801 the left eye sweet spots 827 and right eye sweet spots 826 may be alternately arranged.
- a three-dimensional image filter 830 including non-transmission regions 831 and transmission regions 832 may have a corresponding sweet spot 835 , in which sweet spots 837 that enable a user to view left view images L displayed on the display panel 801 and sweet spots 836 that enable the user to view right view images R displayed on the display panel 801 are alternately arranged.
- a three-dimensional image filter 840 including non-transmission regions 841 and transmission regions 842 may correspond to a sweet spot 845 , in which sweet spots 847 that enable a user to view left view images L displayed on the display panel 801 and sweet spots 846 that enable the user to view right view images R displayed on the display panel 801 are alternately arranged.
- a three-dimensional image filter 850 including non-transmission regions 851 and transmission regions 852 may correspond to a sweet spot 855 , in which sweet spots 857 that enable a user to view left view images L displayed on the display panel 801 and sweet spots 856 that enable the user to view right view images R displayed on the display panel 801 are alternately arranged.
- a three-dimensional image filter 860 including non-transmission regions 861 and transmission regions 862 may have a sweet spot 865 , in which sweet spots 867 that enable a user to view left view images L displayed on the display panel 801 and sweet spots 866 that enable the user to view right view images R displayed on the display panel 801 are alternately arranged.
- a three-dimensional image filter 870 including non-transmission regions 871 and transmission regions 872 may have a sweet spot 875 , in which sweet spots 877 that enable a user to view left view images L displayed on the display panel 801 and sweet spots 876 that enable the user to view right view images R displayed on the display panel 801 are alternately arranged.
- the movement amount calculation device 620 may decide that the barrier or the lens of the three-dimensional image filter 185 should be arranged according to one of the arrangement patterns of the three-dimensional image filters 810 to 860 so as to move the sweet spot based on the point where the user is located. For example, in a case in which the left eye of the user is located at the point 817 and the right eye of the user is located at the point 818 , the movement amount calculation device 620 decides that the barrier be arranged according to the arrangement pattern of the three-dimensional image filter 810 so that the sweet spot 815 is provided.
- the controller 180 may calculate a control signal to change the arrangement of the barrier from the arrangement pattern of the three-dimensional image filter 810 to the arrangement pattern of the three-dimensional image filter 830 so that the sweet spot 835 is provided and may output the calculated control signal to the communication controller 630 .
- FIG. 9 is a diagram illustrating time intervals of image frames captured by the camera.
- the camera 121 may be driven at a fixed frame rate irrespective of the illuminance of ambient light or may be driven at more than a predetermined frame rate.
- the controller 180 may control the camera 121 to be driven at the fixed frame rate irrespective of the illuminance of ambient light or may control the camera 121 to be driven at more than the predetermined frame rate.
- the camera 121 may capture N image frames 910 to 990 per second.
- a time interval 925 may be provided between the respective image frames.
- delay time T C due to the camera 121 may be defined as represented by mathematical expression 3 below: T C ⁇ 1 /FR (3) where FR indicates a frame rate of the camera 121 .
- the delay T C may be designated as camera capture delay.
- T m of delay taken until the three-dimensional image filter is controlled according to the change in position of the user after the position of the user is changed may be defined as represented by mathematical expression 4 below: T m ⁇ 1/ FR+T t (4) where T t is a delay taken until the controller 180 receives the image frames in which the change in position of the user has been captured, generates a control signal using the received image frames, and the generated control signal is input to the three-dimensional image filter drive device 183 .
- the camera 121 may be driven below an amount of delay in which the three-dimensional image filter may be moved before the user exits the sweet spot and at least at a minimum frame rate at which the maximum value T m of delay is maintained. Also, the controller 180 may control the camera 121 to be driven at frame rate greater than or equal to the minimum frame rate.
- a conventional camera is driven in a fashion to adjust exposure according to external brightness so as to provide a bright and vivid image when a user views a screen.
- the camera and the three-dimensional image processing apparatus according to the present disclosure may be configured to maintain the frame rate of the camera irrespective of external brightness. Even during movement of a user, therefore, it is possible for the user to always view a vivid three-dimensional image without experiencing cross-talk and image flipping.
- the time interval 925 between the image frames of the camera 121 may be set to be greater than time delay T t taken until a control signal is generated using image frames captured by the camera 121 , and the generated control signal is input to the three-dimensional image filter 185 . That is, the time interval 925 may be set according to mathematical expression 5 below: 1/ FR>T t (5)
- the camera 121 may be driven at a frame rate satisfying mathematical expression 5, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying mathematical expression 5. Also, the camera 121 may be driven at a fixed frame rate satisfying mathematical expression 5 irrespective of change in illuminance of ambient light, and the controller 180 may control the camera 121 to be driven at a fixed frame rate satisfying mathematical expression 5.
- the sum of the delay ⁇ and the delay ⁇ may be referred to as a detection processing delay.
- Mathematical expression 7 may be derived from mathematical expression 5 and mathematical expression 6. 1/ FR> ⁇ + ⁇ + ⁇ + ⁇ (7)
- the camera 121 may be driven at a frame rate satisfying mathematical expression 7, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying mathematical expression 7. Also, the camera 121 may be driven at a fixed frame rate satisfying mathematical expression 7 irrespective of change in illuminance of ambient light, and the controller 180 may control the camera 121 to be driven at a fixed frame rate satisfying mathematical expression 7.
- T t may be defined as the sum of at least one selected among from ⁇ , ⁇ , ⁇ and ⁇ .
- FIGS. 10A to 10D are block diagrams that illustrate operational modes of a controller according to another embodiment of the present disclosure.
- the controller 180 may include a position detection device 1010 , a movement amount calculation device 1020 , and a graphics processing device 1030 .
- the position detection device 1010 may receive image frames in which a user image has been captured from the camera 121 and detects a position of the user using the received image frames.
- the position detection device 1010 may recognize a face region to detect the position of the user.
- the position detection device 1010 may recognize the face region using an algorithm based on symmetry of a face, an algorithm based on hair color and face color, and an algorithm based on the contour of a face.
- the position detection device 1010 may calculate skin color information from the image frames to recognize a particular facial region.
- the movement amount calculation device 1020 may calculate a movement amount of the three-dimensional image based on the detected position of the user and outputs the calculated movement amount of the three-dimensional image. Also, the movement amount calculation device 1020 may calculate a movement amount of the three-dimensional image using mathematical expression 1 and mathematical expression 2. The movement amount calculation device 1020 may output the calculated movement amount of the three-dimensional image to the graphics processing device 1030 .
- the calculated movement amount of the three-dimensional image refers to a movement amount of a position where a pixel value or a sub-pixel value of the three-dimensional image will displayed so that the three-dimensional image can be appropriately displayed corresponding to the position of the user detected by the position detection device 1010 .
- the movement amount of the three-dimensional image may be a movement amount of a pixel or a movement amount of a sub-pixel.
- the graphics processing device 1030 may set a position at which each pixel value of the three-dimensional image is displayed. In some embodiments, the graphics processing device 1030 may set a position at which each pixel value of a plurality of view images included in the three-dimensional image is displayed on the display device 151 , e.g., a display position, according to predefined rules.
- the graphics processing device 1030 may change the set display position based on the movement amount of the three-dimensional image output from the position detection device 1010 to set a final display position.
- the graphics processing device 1030 may set a position at which each pixel value of a plurality of view images included in the three-dimensional image is displayed on the display device 151 , e.g., a display position, using predefined rules and the movement amount of the three-dimensional image output from the position detection device 1010 .
- the graphics processing device 1030 may generate image data including pixel values or sub-pixel values arranged according to the set display position or the set final display position and may output the generated image data to the display device 151 .
- the sum of the delay ⁇ and the delay ⁇ may be designated as an image drive frame rate delay.
- Mathematical expression 9 may be derived from mathematical expression 5 and mathematical expression 8, as follows: 1/ FR> ⁇ + ⁇ + ⁇ + ⁇ (9)
- the camera 121 may be driven at a frame rate satisfying mathematical expression 9, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying mathematical expression 9. Also, the camera 121 may be driven at a fixed frame rate satisfying mathematical expression 9 irrespective of change in illuminance of ambient light, and the controller 180 may control the camera 121 to be driven at a fixed frame rate satisfying mathematical expression 9.
- T t may be defined as the sum of at least one selected among from ⁇ , ⁇ , ⁇ and ⁇ .
- the mode of the tracking function is a normal mode
- power is supplied to the camera 121 , the ambient light sensor 143 , the position detection device 1010 , the movement amount calculation device 1020 , and the graphics processing device 1030 .
- the mode of the tracking function is a limit mode
- power is supplied to the camera 121 , the ambient light sensor 143 , the position detection device 1010 , and the graphics processing device 1030 .
- power is not supplied to the movement amount calculation device 1020 .
- the mode of the tracking function is a stop mode
- power is supplied to the ambient light sensor 143 and the graphics processing device 1030 .
- power is not supplied to the camera 121 , the position detection device 1010 , and the movement amount calculation device 1020 .
- the mode of the tracking function is an off mode
- power is supplied to the graphics processing device 1030 .
- power is not supplied to the camera 121 , the ambient light sensor 143 , the position detection device 1010 , and the movement amount calculation device 1020 .
- That power is not supplied to the position detection device 1010 and the movement amount calculation device 1020 may mean that the position detection device 1010 and the movement amount calculation device 1020 are not operated and a corresponding load on the controller 180 may be reduced.
- FIG. 11 is a diagram illustrating a movement of a sweet spot according to change in display position of a view image.
- a display device 1110 displays a left view image at a point 1111 and a right view image at a point 1112 in a state in which a three-dimensional image filter 1101 is fixed
- a sweet spot 1115 configured so that sweet spots 1117 that enable a user to view the left view image L displayed on the display device 1110 and sweet spots 1116 that enable the user to view the right view image R displayed on the display device 1110 are alternately arranged.
- a sweet spot 1125 configured so that sweet spots 1127 that enable a user to view the left view image L displayed on the display device 1120 and sweet spots 1126 that enable the user to view the right view image R displayed on the display device 1120 are alternately arranged.
- a sweet spot 1135 configured so that sweet spots 1137 that enable a user to view the left view image L displayed on the display device 1130 and sweet spots 1136 that enable the user to view the right view image R displayed on the display device 1130 are alternately arranged.
- a sweet spot 1145 configured so that sweet spots 1147 that enable a user to view the left view image L displayed on the display device 1140 and sweet spots 1146 that enable the user to view the right view image R displayed on the display device 1140 are alternately arranged.
- a display device 1150 displays a three-dimensional image using a left view image 1151 and a right view image 1152 in a state in which the three-dimensional image filter 1101 is fixed
- a sweet spot 1155 configured so that sweet spots 1157 that enable a user to view the left view image L displayed on the display device 1150 and sweet spots 1156 that enable the user to view the right view image R displayed on the display device 1150 are alternately arranged.
- a display device 1160 displays a three-dimensional image using a left view image 1161 and a right view image 1162 in a state in which the three-dimensional image filter 1101 is fixed
- a sweet spot 1165 configured so that sweet spots 1167 that enable a user to view the left view image L displayed on the display device 1160 and sweet spots 1166 that enable the user to view the right view image R displayed on the display device 1160 are alternately arranged.
- a display device 1170 displays a three-dimensional image using a left view image 1171 and a right view image 1172 in a state in which the three-dimensional image filter 1101 is fixed
- a sweet spot 1175 configured so that sweet spots 1177 that enable a user to view the left view image L displayed on the display device 1170 and sweet spots 1176 that enable the user to view the right view image R displayed on the display device 1170 are alternately arranged.
- the movement amount calculation device 1020 may decide that the display positions of the left view image and the right view image should be arranged according to one of the arrangement patterns of the view images 1110 to 1160 so as to move the sweet spot based on the point where the user is located. That is, the movement amount calculation device 1020 may calculate the movement amount of the three-dimensional image so that the current view images are arranged according to the set arrangement pattern of the view images. For example, in a case in which the left eye of the user is located at the point 1117 and the right eye of the user is located at the point 1118 , the movement amount calculation device 1020 decides that the view images should be arranged according to the arrangement pattern of the view images 1110 so that the sweet spot 1115 is provided.
- the movement amount calculation device 1020 may decide that the view images arranged according to the arrangement pattern of the view images 1110 should be changed into the view images arranged according to the arrangement pattern of the view images 1130 so that the sweet spot 1135 is provided. That is, the movement amount calculation device 1020 may calculate the movement amount of the three-dimensional image based on the movement amount of the view images from the arrangement pattern of the view images 1110 to the arrangement pattern of the view images 1130 .
- FIGS. 12A to 12D are block diagrams that illustrate operational modes of a controller according to another embodiment of the present disclosure.
- the controller 180 may include a position detection device 1210 , a velocity calculation device 1220 , a position estimation device 1230 , a movement amount calculation device 1240 , and a communication controller 1250 .
- the position detection device 1210 may receive image frames in which a user image has been captured from the camera 121 and detects a position of the user using the received image frames.
- the position detection device 1210 may recognize a face region to detect the position of the user.
- the position detection device 1210 may recognize the face region using an algorithm based on symmetry of a face, an algorithm based on hair color and face color, and an algorithm based on the contour of a face.
- the position detection device 1210 may calculate skin color information from the image frames to recognize a particular facial region.
- the velocity calculation device 1220 may calculate velocity of movement of the user using at least one selected from among the currently detected position of the user and the previously detected position of the user.
- the position estimation device 1230 may estimate a position of the user when a predetermined time elapses using the detected position of the user and the calculated velocity of movement of the user.
- the movement amount calculation device 1240 may calculate a position of the three-dimensional image filter and a movement amount of the three-dimensional image filter based on the detected position of the user or the estimated position of the user, and outputs the calculated movement amount of the three-dimensional image filter.
- the movement amount of the three-dimensional image filter may be calculated and output for each of the detected positions of the user or each of the estimated positions of the user.
- the movement amount calculation device 1240 may generate a control signal to control movement of the non-transmission regions of the three-dimensional image filter according to the current position of the three-dimensional image filter and the calculated movement amount of the three-dimensional image filter, and may output the generated control signal to the communication controller 1250 .
- the control signal may be calculated and output for each of the detected positions of the user or each of the estimated positions of the user.
- the generated control signal may be a signal to enable the non-transmission regions of the three-dimensional image filter to be located at a point away from the current point by the calculated movement amount of the three-dimensional image filter.
- the generated control signal may be a signal to enable the non-transmission regions of the three-dimensional image filter to be located at a point away from a point for the non-transmission regions corresponding to a previous control signal based on the calculated movement amount of the three-dimensional image filter.
- the movement amount calculation device 1240 may find the positions of the transmission regions and the non-transmission regions of the three-dimensional image filter having sweet spots corresponding to the detected position of the user or the estimated position of the user, and may calculate differences between the found positions of the transmission regions and the non-transmission regions of the three-dimensional image filter and the current positions of the transmission regions and the non-transmission regions of the three-dimensional image filter or the positions of the transmission regions and the non-transmission regions of the three-dimensional image filter indicated by the previous control signal to obtain a movement amount of the three-dimensional image filter.
- the movement amount calculation device 1240 may calculate the position of the lens and the movement amount of the lens based on the detected position of the user or the estimated position of the user, and may output the calculated position of the lens and the calculated movement amount of the lens.
- the calculated position of the lens and the calculated movement amount of the lens may be output to the three-dimensional image filter drive device 183 .
- the movement amount calculation device 1240 may generate a control signal to control movement of the lens according to the current position of the lens or the position of the lens indicated by the previous control signal and the calculated movement amount of the lens, and may output the generated control signal to the communication controller 1250 .
- the generated control signal may be a signal to enable the lens to be located at a point away from the current point by the calculated movement amount of the lens or may be a signal to enable the lens to be located at a point away from the point of the lens which the previous control signal indicates by the calculated movement amount of the lens.
- the communication controller 1250 may transmit the control signal generated by the movement amount calculation device 1240 to the three-dimensional image filter drive device 183 .
- the transmitted control signal may include a control signal generated based on the detected position of the user and a control signal generated based on the estimated position of the user.
- the control signals may be transmitted in order of generation.
- the communication controller 1250 may output the control signal to the three-dimensional image filter drive device 183 in an I2C communication fashion.
- FIGS. 13 to 16 are views showing image frames of a user captured by the camera.
- the position detection device 1210 may detect a position 1311 of the user using an image frame 1300 .
- the position detection device 1210 may recognize a face region in an image frame 1400 to detect a position 1321 of the user.
- the velocity calculation device 1220 may calculate velocity V of the movement of the user from mathematical expression 10 below using the currently detected position 1321 of the user and the previously detected position 1311 of the user.
- V H/T (10) where H is a distance between the currently detected position 1321 of the user and the previously detected position 1311 of the user, and T is a time interval between the image frame 1300 and the image frame 1400 .
- the position estimation device 1230 may estimate N positions of the user at time intervals of t during capture of the image frames, in a case in which a camera captures images at a frame rate of M Hz. Therefore, it is possible to achieve the same effect as in using a camera which performs capture at a frame rate of M*N Hz.
- the position detection device 1210 may detect a position 1331 of the user, and the velocity calculation device 1220 may calculate velocity V of the movement of the user using at least one of the previously detected positions 1311 and 1321 of the user.
- the position detection device 1210 may detect a position 1341 of the user, and the velocity calculation device 1220 may calculate velocity V of the movement of the user using at least one of the previously detected positions 1311 , 1321 and 1331 of the user.
- a frame rate FR of the camera 121 may be set as represented by mathematical expression 14 below: 1/ FR> ⁇ + ⁇ + ⁇ + ⁇ N ⁇ +N ⁇ (14) where ⁇ is a time delay taken until image frames captured by the camera 121 are input to the controller 180 , ⁇ is a time delay taken until a control signal is calculated using image frames input from the position detection device 1210 and the movement amount calculation device 1240 , ⁇ is a time delay taken until the communication controller 1250 starts to transmit the generated control signal to the three-dimensional image filter drive device 183 , ⁇ is a time delay taken until the generated control signal passes from the communication controller 1250 to the three-dimensional image filter drive device 183 , N is the number of times the user's position is estimated.
- the camera 121 may be driven at a frame rate satisfying mathematical expression 14, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying mathematical expression 14. Also, the camera 121 may be driven at a fixed frame rate satisfying mathematical expression 14 irrespective of a change in illuminance of ambient light, and the controller 180 may control the camera 121 to be driven at a fixed frame rate satisfying mathematical expression 14.
- power may be supplied to the camera 121 , the ambient light sensor 143 , the position detection device 1210 , the velocity calculation device 1220 , the position estimation device 1230 , the movement amount calculation device 1240 , and the communication controller 1250 .
- power may be supplied to the camera 121 , the ambient light sensor 143 , the position detection device 1210 , and the communication controller 1250 ; however, power is not supplied to the velocity calculation device 1220 , the position estimation device 1230 , and the movement amount calculation device 1240 .
- power may be supplied to the ambient light sensor 143 and the communication controller 1250 ; however, power is not supplied to the camera 121 , the velocity calculation device 1220 , the position estimation device 1230 , and the movement amount calculation device 1240 .
- power may be supplied to the communication controller 1250 in a case in which the mode of the tracking function is an off mode.
- power is not supplied to the camera 121 , the ambient light sensor 143 , the velocity calculation device 1220 , the position estimation device 1230 , and the movement amount calculation device 1240 .
- the load as well as power consumed by the controller 180 associated with the these terminated processes are reduced or eliminated.
- power may not be supplied to the communication controller 1250 in a case in which the mode of the tracking function is not a normal mode. That power is not supplied to the position detection device 1210 , the velocity calculation device 1220 , the position estimation device 1230 , the movement amount calculation device 1240 , and the communication controller 1250 may mean that the position detection device 1210 , the velocity calculation device 1220 , the position estimation device 1230 , the movement amount calculation device 1240 , and the communication controller 1250 are not operated, thereby reducing the load of the controller 180 and the associates power consumed.
- FIGS. 17A to 17D are block diagrams that illustrate operational modes of a controller according to a further embodiment of the present disclosure.
- the controller 180 may include a position detection device 1710 , a velocity calculation device 1720 , a position estimation device 1730 , a movement amount calculation device 1740 , and a graphics processing device 1750 .
- the position detection device 1710 , the velocity calculation device 1720 , and the position estimation device 1730 correspond to the position detection device 1210 , the velocity calculation device 1220 , and the position estimation device 1230 of FIG. 12 , and therefore, a detailed description thereof will be omitted.
- the graphics processing device 1750 corresponds to the graphics processing device 1030 of FIG. 10 .
- the movement amount calculation device 1740 may calculate a pixel movement amount at specific timing using mathematical expression 1 and mathematical expression 2 based on the position of a user estimated at the specific timing. Referring to FIG. 11 , when the left eye of the user is located at the point 1116 and the right eye of the user is located at the point 1117 , the view images are arranged according to the arrangement pattern of the view images 1110 . The position estimation device 1730 estimates the position 1136 of the left eye of the user and the position 1137 of the right eye of the user and calculates a pixel movement amount A based on the estimated movement positions 1136 and 1137 .
- the graphics processing device 1750 When the user moves from the positions 1116 and 1117 to the positions 1136 and 1137 , the graphics processing device 1750 performs processing so that the three-dimensional image is moved based on the pixel movement amount A calculated according to movement timing. Consequently, the view images are displayed according to the arrangement pattern of the view images 1130 .
- a frame rate FR of the camera 121 may be set as represented by mathematical expression 16 below: 1/ FR> ⁇ + ⁇ + ⁇ + ⁇ N ⁇ +N ⁇ (16) where, ⁇ is a time delay until image frames captured by the camera 121 are input to the controller 180 , ⁇ is a delay taken until a control signal is calculated using image frames input from the position detection device 1710 and the movement amount calculation device 1740 , ⁇ is a delay taken until the graphics processing device 1750 generates image data based on the calculated movement amount of the three-dimensional image, ⁇ is a delay taken until the generated image data are input to the display device 151 , and N is the number of times of estimation of the user's position.
- ⁇ may be calculated as represented by mathematical expression 15 above.
- the camera 121 may be driven at a frame rate satisfying mathematical expression 16, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying mathematical expression 16. Also, the camera 121 may be driven at a fixed frame rate satisfying mathematical expression 16 irrespective of changes in the illuminance of ambient light, and the controller 180 may control the camera 121 to be driven at a fixed frame rate satisfying mathematical expression 16.
- the mode of the tracking function is a normal mode
- power is supplied to the camera 121 , the ambient light sensor 143 , the position detection device 1710 , the velocity calculation device 1720 , the position estimation device 1730 , the movement amount calculation device 1740 , and the graphics processing device 1750 .
- the mode of the tracking function is a limit mode
- power is supplied to the camera 121 , the ambient light sensor 143 , the position detection device 1710 , and the graphics processing device 1750 .
- power is not supplied to the velocity calculation device 1720 , the position estimation device 1730 , and the movement amount calculation device 1740 .
- the mode of the tracking function is a stop mode
- power is supplied to the ambient light sensor 143 and the graphics processing device 1750 .
- power is not supplied to the camera 121 , the velocity calculation device 1720 , the position estimation device 1730 , and the movement amount calculation device 1740 .
- the mode of the tracking function is an off mode
- power is supplied to the graphics processing device 1750 .
- power is not supplied to the camera 121 , the ambient light sensor 143 , the velocity calculation device 1720 , the position estimation device 1730 , and the movement amount calculation device 1740 .
- That power is not supplied to the position detection device 1710 , the velocity calculation device 1720 , the position estimation device 1730 , and the movement amount calculation device 1740 may mean that the position detection device 1710 , the velocity calculation device 1720 , the position estimation device 1730 , and the movement amount calculation device 1740 are not operated and the load to the controller 180 associated with these processes may be reduced.
- FIG. 18 is a flow chart of an electric power control method of a three-dimensional image processing apparatus according to an embodiment of the present disclosure.
- the controller 180 may check a mode of the tracking function, in step S 100 .
- the ambient light sensor 143 senses the illuminance of ambient light, in step S 102 .
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the normal modes shown in FIGS. 6A, 10A, 12A and 17A .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the normal modes shown in FIGS. 6A, 10A, 12A and 17A .
- the controller 180 may check the illuminance of the ambient light sensed by the ambient light sensor 143 , in step S 104 .
- the controller 180 may determine whether the illuminance of the ambient light is equal to or less than a predetermined value.
- the predetermined value may be set by the controller 180 based on at least one selected from among a method of extracting a picture image of a user based on an image captured by the camera 121 and performance of a capturing element of the camera 121 .
- the camera 121 may capture a user image, in step S 106 .
- the controller 180 may set user position information related to a position of the user using the image captured by the camera 12 , in step S 108 .
- step S 108 may be carried out by the position detection device 610 shown in FIG. 6 , the position detection device 1010 shown in FIG. 10 , the position detection device 1210 shown in FIG. 12 , or the position detection device 1710 shown in FIG. 17 .
- the controller 180 may generate a control signal to control display of view images based on the set user position information, in step S 110 .
- step S 110 may be carried out by the movement amount calculation device 620 shown in FIG. 6 , the movement amount calculation device 1020 shown in FIG. 10 , the movement amount calculation device 1240 shown in FIG. 12 , or the movement amount calculation device 1740 shown in FIG. 17 .
- the control signal may include at least one selected from among a control signal to control movement of the lens of the lenticular lens board, a control signal to control movement of the non-transmission region of the parallax barrier, and a control signal to control positions at which view images are to be displayed on the display device 151 .
- the mode of the tracking function may include at least one selected from among an off mode in which the tracking function is not executed and an on mode in which the tracking function is executed.
- the on mode may include at least one selected from among a stop mode in which performance of the tracking function is stopped, a limit mode in which the execution of the tracking function is limited, and a normal mode in which the tracking function is normally executed.
- the display device 151 may display the view images, in step S 112 .
- the controller 180 may determine whether user action to request switching between tracking function modes has been detected, in step S 114 .
- the user action to request switching between tracking function modes may be performed through a graphical user interface GUI shown in FIG. 19 .
- FIGS. 19A to 19B are views of a graphical user interface (GUI) to allow a user to input a request for switching between tracking function modes.
- GUI graphical user interface
- a GUI 1910 of FIG. 19A may include a menu item 1911 to set a tracking function.
- the menu item 1911 may indicate “tracking function off.” “Tracking function off” means that the mode of the tracking function is set to an off mode.
- the user may place a pointer 1901 or an indicator 1905 on the menu item 1911 and click a button (for example, an OK button) on the remote control to perform user action to request switching between tracking function modes. Also, the user may touch the menu item 1911 using a finger 1903 to perform user action to request switching between tracking function modes.
- a button for example, an OK button
- the controller 180 may control a GUI 1920 of FIG. 19B to be displayed in response to the detected user action.
- the GUI 1920 may include a menu item 1921 to set a tracking function.
- the menu item 1921 may indicate “tracking function on.” “Tracking function on” means that the mode of the tracking function is set to an on mode.
- the message 1911 and the message 1921 may be toggled between each other depending upon user action to request switching between tracking function modes.
- the GUI 1910 or the GUI 1920 may be selectively displayed.
- the GUI 1910 may be displayed in response to the user action.
- the GUI 1920 may be displayed in response to the user action.
- the message 1911 and the message 1921 may be the same.
- the message 1911 and the message 1921 may be displayed using different colors, thicknesses, sizes and highlights.
- the message 1921 may be displayed thicker or larger than the message 1911 .
- the GUI 1920 may further include a condition region 1930 .
- the condition region 1930 may include at least one selected from among a menu item 1931 and a menu item 1933 to set the details of the tracking function.
- the condition region 1930 may be displayed when the message 1911 is toggled to the message 1921 .
- the menu item 1931 may be provided to set an ambient light sensing function.
- the ambient light sensing function is a function to adjust the mode of the tracking function based on the illuminance of the ambient light sensed by the ambient light sensor 143 .
- a check mark 1932 is displayed on the menu item 1931 , and the ambient light sensing function is set.
- the controller 180 performs the ambient light sensing function.
- the menu item 1933 may be provided to set a viewing sensing function.
- the viewing sensing function is a function to adjust a mode of the tracking function depending upon whether the user is in a viewing zone.
- a check mark is displayed on the menu item 1931 , and the viewing sensing function is set.
- the controller 180 may perform the viewing sensing function. The user may individually set and release the ambient light sensing function and the viewing sensing function.
- the controller 180 may adjust a mode of the tracking function based on the detected user action, in step S 116 .
- the controller 180 may adjust the mode of the tracking function to the off mode.
- the controller 180 may adjust the mode of the tracking function to the on mode.
- the on mode may be a normal mode.
- the controller 180 may adjust the mode of the tracking function to an off mode. In some embodiments, when a three-dimensional image is displayed after a two-dimensional image is displayed, the controller 180 may automatically adjust the mode of the tracking function to a normal mode.
- the controller 180 may adjust the mode of the tracking function to a predetermined mode.
- the predetermined mode may be a mode of the tracking function adjusted based on the detected user action.
- the controller 180 may change the mode of the tracking function to a stop mode, in step S 118 .
- the controller 180 may check the illuminance of the ambient light detected by the ambient light sensor 143 , in step S 122 .
- the controller 180 may determine whether the illuminance of the ambient light is greater than a predetermined value.
- the controller 180 may change the mode of the tracking function to a normal mode, in step S 124 .
- step S 114 may be carried out.
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the off modes shown in FIGS. 6D, 10D, 12D and 17D .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the off modes shown in FIGS. 6D, 10D, 12D and 17D .
- FIG. 20 is a flow chart of a method of controlling a three-dimensional image processing apparatus according to another embodiment of the present disclosure.
- the controller 180 may check a mode of the tracking function, in step S 200 .
- the camera 121 may capture images within a viewing zone to enable a user to view a three-dimensional image displayed by the three-dimensional image processing apparatus 100 , in step S 202 .
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the normal modes shown in FIGS. 6A, 10A, 12A and 17A .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the normal modes shown in FIGS. 6A, 10A, 12A and 17A .
- the controller 180 may determine whether the user is in the viewing zone through the camera 121 , in step S 204 .
- step S 204 may be carried out by the position detection device 610 shown in FIG. 6 , the position detection device 1010 shown in FIG. 10 , the position detection device 1210 shown in FIG. 12 , and the position detection device 1710 shown in FIG. 17 .
- the controller 180 may set user position information related to a position of the user using the image captured by the camera 121 , in step S 206 .
- step S 206 may be carried out by the position detection device 610 shown in FIG. 6 , the position detection device 1010 shown in FIG. 10 , the position detection device 1210 shown in FIG. 12 , and the position detection device 1710 shown in FIG. 17 .
- the controller 180 may generate a control signal to control a display of view images based on the set user position information, in step S 208 .
- step S 208 may be carried out by the movement amount calculation device 620 shown in FIG. 6 , the movement amount calculation device 1020 shown in FIG. 10 , the movement amount calculation device 1240 shown in FIG. 12 , and the movement amount calculation device 1740 shown in FIG. 17 .
- control signal may include at least one selected from among a control signal to control movement of the lens of the lenticular lens board, a control signal to control movement of the non-transmission region of the parallax barrier, and a control signal to control positions at which view images are to be displayed on the display device 151 .
- the mode of the tracking function may include at least one selected from among an off mode in which the tracking function is not executed and an on mode in which the tracking function is executed.
- the on mode may include at least one selected from among a stop mode in which the execution of the tracking function is stopped, a limit mode in which the tracking function is limitedly executed, and a normal mode in which the tracking function is normally executed.
- the display device 151 displays the view images, in step S 210 .
- the controller 180 may determine whether a request (e.g., user action) to switch between tracking function modes has been detected, in step S 212 .
- the request to switch between tracking function modes may be a user action performed through the graphical user interface GUI shown in FIG. 19 .
- the controller 180 may adjust a mode of the tracking function based on the detected user action, in step S 214 .
- the controller 180 adjusts the mode of the tracking function to the off mode.
- the controller 180 adjusts the mode of the tracking function to the on mode.
- the on mode may be a normal mode.
- the controller 180 may adjust the mode of the tracking function to an off mode. In some embodiments, when a three-dimensional image is displayed after a two-dimensional image is displayed, the controller 180 may automatically adjust the mode of the tracking function to a normal mode. In some embodiments, when a three-dimensional image is displayed after a two-dimensional image is displayed, the controller 180 may adjust the mode of the tracking function to a predetermined mode.
- the predetermined mode may be a mode of the tracking function adjusted based on the detected user action.
- step S 240 the controller 180 may change the mode of the tracking function to a limit mode, in step S 216 .
- the camera 121 may capture images in a viewing zone to enable the user to view a three-dimensional image displayed by the three-dimensional image processing apparatus 100 , in step S 218 .
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the limit modes shown in FIGS. 6B, 10B, 12B and 17B .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the limit modes shown in FIGS. 6B, 10B, 12B and 17B .
- the controller 180 may determine whether the user is in the viewing zone using the image captured by the camera 121 , in step S 220 .
- step S 220 may be carried out by the position detection device 610 shown in FIG. 6 , the position detection device 1010 shown in FIG. 10 , the position detection device 1210 shown in FIG. 12 , and the position detection device 1710 shown in FIG. 17 .
- step S 220 the controller 180 may change the mode of the tracking function to a normal mode, in step S 222 .
- Step 206 may be carried out after step S 222 is carried out.
- step 212 may be carried out after step S 222 is carried out.
- step S 212 may be carried out to determine when an input (e.g., user action) has been detected.
- step S 212 may be carried out.
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the off modes shown in FIGS. 6D, 10D, 12D and 17D .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the off modes shown in FIGS. 6D, 10D, 12D and 17D .
- FIG. 21 is a flow chart of a method of controlling a three-dimensional image processing apparatus according to a further embodiment of the present disclosure.
- the controller 180 may check a mode of the tracking function, in step S 300 .
- the ambient light sensor 143 may sense the illuminance of ambient light, in step S 302 .
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the normal modes shown in FIGS. 6A, 10A, 12A and 17A .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the normal modes shown in FIGS. 6A, 10A, 12A and 17A .
- the controller 180 may check the illuminance of the ambient light sensed by the ambient light sensor 143 , in step S 304 .
- the controller 180 may determine whether the illuminance of the ambient light is equal to or less than a predetermined value.
- the predetermined value may be set by the controller 180 based on at least one selected from among a method of extracting a picture image of a user based on an image captured by the camera 121 or through operation of a capturing element (e.g., sensor) of the camera 121 .
- the camera 121 may capture a user image, in step S 306 .
- the controller 180 may determine whether the user is in a viewing zone to enable a user to view a three-dimensional image displayed by the three-dimensional image processing apparatus 100 using the image captured by the camera 121 , in step S 308 .
- step S 308 may be carried out by the position detection device 610 shown in FIG. 6 , the position detection device 1010 shown in FIG. 10 , the position detection device 1210 shown in FIG. 12 , and the position detection device 1710 shown in FIG. 17 .
- the controller 180 may set user position information related to a position of the user using the image captured by the camera 121 , in step S 310 .
- step S 310 may be carried out by the position detection device 610 shown in FIG. 6 , the position detection device 1010 shown in FIG. 10 , the position detection device 1210 shown in FIG. 12 , and the position detection device 1710 shown in FIG. 17 .
- the controller 180 may generate a control signal to control display of view images based on the set user position information, in step S 312 .
- step S 312 may be carried out by the movement amount calculation device 620 shown in FIG. 6 , the movement amount calculation device 1020 shown in FIG. 10 , the movement amount calculation device 1240 shown in FIG. 12 , and the movement amount calculation device 1740 shown in FIG. 17 .
- the control signal may include at least one selected from among a control signal to control movement of the lens of the lenticular lens board, a control signal to control movement of the non-transmission region of the parallax barrier, and a control signal to control positions at which view images are to be displayed on the display device 151 .
- the mode of the tracking function may include at least one selected from among an off mode in which the tracking function is not executed and an on mode in which the tracking function is executed.
- the on mode may include at least one selected from among a stop mode in which the execution of the tracking function is stopped, a limit mode in which the tracking function is limitedly executed, and a normal mode in which the tracking function is normally executed.
- the display device 151 displays the view images, in step S 314 .
- the controller 180 may determine whether a request e.g., user input) to switch between tracking function modes has been detected, in step S 316 .
- the request to switch between tracking function modes may be performed through the graphical user interface GUI shown in FIG. 19 .
- the controller 180 may adjust a mode of the tracking function based on the detected user action, in step S 318 .
- the controller 180 may adjust the mode of the tracking function to the off mode.
- the controller 180 adjusts the mode of the tracking function to the on mode.
- the on mode may be a normal mode.
- the controller 180 may adjust the mode of the tracking function to an off mode. In some embodiments, when a three-dimensional image is displayed after a two-dimensional image is displayed, the controller 180 may automatically adjust the mode of the tracking function to a normal mode. In some embodiments, when a three-dimensional image is displayed after a two-dimensional image is displayed, the controller 180 may adjust the mode of the tracking function to a predetermined mode.
- the predetermined mode may be a mode of the tracking function adjusted based on the detected user action.
- step S 308 the controller 180 may change the mode of the tracking function to a limit mode, in step S 320 .
- the controller 180 may change the mode of the tracking function to a stop mode, in step S 322 . In other words, if it is determined that there is insufficient amount of light, the controller 180 changes the operational mode to a stop made to suspend various operations, thereby reducing controller 180 load.
- the ambient light sensor 143 may sense the illuminance of ambient light, in step S 330 .
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the limit modes shown in FIGS. 6B, 10B, 12B and 17B .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the limit modes shown in FIGS. 6B, 10B, 12B and 17B .
- the controller 180 may check the illuminance of the ambient light sensed by the ambient light sensor 143 , in step S 332 .
- the controller 180 may determine whether the illuminance of the ambient light is equal to or less than a predetermined value.
- the camera 121 may be controlled to capture a user image, in step S 334 .
- the controller 180 may determine whether the user is in the viewing zone for viewing a three-dimensional image displayed by the three-dimensional image processing apparatus 100 using the image captured by the camera 121 , in step S 336 .
- step S 336 may be carried out by the position detection device 610 shown in FIG. 6 , the position detection device 1010 shown in FIG. 10 , the position detection device 1210 shown in FIG. 12 , and the position detection device 1710 shown in FIG. 17 .
- step S 310 may be carried out after step S 338 is carried out.
- step S 316 may be carried out after step S 338 is carried out.
- step S 316 may be carried out to detect a user action.
- the ambient light sensor 143 may detect the illuminance of ambient light, in step S 350 .
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the stop modes shown in FIGS. 6C, 100, 12C and 17C .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the stop modes shown in FIGS. 6C, 10C, 12C and 17C .
- step S 315 may be carried out.
- the three-dimensional image processing apparatus 100 may be in one of the power applied states in the off modes shown in FIGS. 6D, 10D, 12D and 17D .
- the controller 180 may control the supply of power from the power supply device 190 so that the three-dimensional image processing apparatus 100 is in one of the power applied states in the off modes shown in FIGS. 6D, 10D, 12D and 17D .
- the present disclosure may be realized in recording media readable by computers as code readable by the computers.
- the recording media readable by the computers include all kinds of recording devices to store data readable by the computers. Examples of the recording media readable by the computers include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
- the present disclosure may be realized in the form of a carrier wave (for example, transmission through the Internet).
- the recording media readable by the computers may be stored in computers connected via a network in a distributed fashion as code readable by the computers so that the computers can execute the code.
- the three-dimensional image processing apparatus and the electric power control method of the same may rapidly detect the position of the user through the tracking function and move the sweet spot region to correspond to the sensed position of the user. Hence, the user can experience a three-dimensional effect without feeling fatigue or unnaturalness. Also, in a case in which it is not necessary to detect the position of the user, the three-dimensional image processing apparatus and the electric power control method of the same according to the present disclosure stops the tracking function to prevent power consumption caused by execution of the tracking function, and therefore, it is possible to minimize power consumption of the three-dimensional image processing apparatus.
- a three-dimensional image processing apparatus may include a display configured to display two or more view images, a three-dimensional image filter disposed a prescribed distance from the display to adjust optical paths of the displayed view images, a camera configured to capture an image of a user, and a controller configured to control at least one of the display of the view images, the three-dimensional image filter, or the camera.
- the controller may determine a position of the user based on the captured image and executes at least one process that adjusts a position of the view images on the display or the optical paths of the displayed view images through the three-dimensional image filter.
- the controller may control an operational state of the camera and the at least one process based on the determined position of the user.
- the controller may track a movement of the user based on the determined position of the user and adjusts a perceived three-dimensional view of the view images in response to the tracked movement.
- An ambient light sensor configured to sense an amount of ambient light may be provided.
- the controller may control the operational state of the camera and the at least one process for controlling the display of the view images or the three-dimensional image filter based on the sensed amount of ambient light.
- the controller may stop the operation of the camera, stop the process for determining a position of the user, and stop the at least one of the process that adjusts a position of the view images on the display or a process that controls the three-dimensional image filter to change the optical paths of the displayed view images.
- the controller may operate the camera to capture the image of the user, execute the process for determining a position of the user, and execute the at least one of the process that adjusts a position of the view images on the display or the process that controls the three-dimensional image filter to change the optical paths of the displayed view images.
- the controller may control the operational state to be an off state in which the camera, a process for determining a position of the user, and the at least one of a process that adjusts a position of the view images on the display or a process that controls the three-dimensional image filter to change the optical paths of the displayed images are operational.
- the controller may control the operational state to be a stop state in which the camera, the process for determining a position of the user, and the at least one of a process that adjusts a position of the view images on the display or a process that controls the three-dimensional image filter to change the optical paths of the displayed images are not operational.
- the controller may control the operational state to be a limit state in which the camera and the process for determining the position of the user are operational, and the at least one of a process that adjusts a position of the view images on the display or a process that controls the three-dimensional image filter to change the optical paths of the displayed images are not operational.
- the controller may control the operational state to be a normal state in which the camera, the process for determining the position of the user, and the at least one of a process that adjusts a position of the view images on the display or a process that controls the three-dimensional image filter to change the optical paths of the displayed images are operational.
- the three-dimensional image filter may include a lenticular lens board having a plurality of lenses, and the controller controls a movement of the lenses to adjust the optical paths through the three-dimensional image filter.
- the three-dimensional image filter may include a parallax barrier having transmission regions and non-transmission regions which are alternately formed, and the controller may be configured to control a movement of the non-transmission regions to adjust the optical paths through the three-dimensional image filter.
- the controller may be configured to change locations of the view images displayed on the display.
- the controller may be configured to change the operational state of the camera and the at least one process based on a detected user action.
- the controller may be configured to determine whether the user is positioned within a viewing zone using the captured image and to adjust the operational state of the camera and the at least one process based on the determined result.
- a three-dimensional image processing apparatus may include a display configured to display two or more view images, a three-dimensional image filter disposed a prescribed distance from the display to adjust optical paths of the displayed view images, a camera configured to capture an image of a user for determining a position of the user, an ambient light sensor to sense an illuminance of ambient light, and a controller configured to control a perceived three-dimensional view of the view images by adjusting the display of the view images or the three-dimensional image filter based on the determined position of the user.
- the controller may control an operational state of the camera and at least one process for controlling the display of the view images or a process for controlling the three-dimensional image filter based on the sensed illuminance of ambient light.
- the controller may stop the operation of the camera, the process for determining a position of the user, and the at least one of the process for controlling the display of the view images on the display or the process for controlling the three-dimensional image filter to change the optical paths of the displayed view images.
- the controller may operate the camera, the process for determining a position of the user, and the at least one of a process controlling the display of the view images on the display or a process for controlling the three-dimensional image filter to change the optical paths of the displayed view images.
- the controller may determine whether the user is positioned within a prescribed area relative to the display, and control an operational state of the camera and the at least one processes based on the determined position of the user. When the user is determined to be positioned outside the prescribed area, the controller may power off the camera and prevents execution of the at least one process for adjusting the perceived three-dimensional view based on the position of the user.
- the prescribed area may be a viewing zone for viewing the perceived three-dimensional view of the view images on the display.
- a three-dimensional image processing apparatus may include a display device configured to display two or more view images, a three-dimensional image filter disposed at the front of the display device to adjust optical paths of the displayed view images, a camera configured to capture an image of a user, an ambient light sensor configured to sense an illuminance of ambient light, and a controller configured to execute a tracking function and to adjust a mode of the tracking function based on the sensed illuminance of the ambient light, the tracking function to set user position information related to a position of the user using the captured image and to generate a control signal to control display of the view images based on the set user position information.
- the mode of the tracking function may include at least one selected from among an off mode in which the tracking function is not executed, a stop mode in which the execution of the tracking function is stopped, a limit mode in which the tracking function is limitedly executed, and a normal mode in which the tracking function is normally executed. Power may not be supplied to the camera in a case in which the mode of the tracking function is a stop mode in which the execution of the tracking function is stopped.
- the controller may adjust the mode of the tracking function to a stop mode in which the execution of the tracking function is stopped in a case in which the illuminance of the ambient light is equal to or less than a predetermined value.
- the predetermined value may be set based on at least one selected from among a method of extracting a picture image of the user based on the captured image and performance of a capturing element of the camera.
- the controller may adjust the mode of the tracking function to the normal mode in which the tracking function is normally executed when the illuminance of the ambient light is greater than the predetermined value.
- the three-dimensional image filter may include a lenticular lens board having a plurality of lenses or a parallax barrier having transmission regions and non-transmission regions which are alternately formed, and the control signal may include a control signal to control movement of the lenses or a control signal to control movement of the non-transmission regions.
- the control signal may include a control signal to control positions of the view images to be displayed on the display device.
- the controller may adjust the mode of the tracking function based on a detected user action. Moreover, the controller may determine whether the user is in a viewing zone to enable the user to view the displayed view images using the captured image and adjust the mode of the tracking function based on the determined result.
- a three-dimensional image processing apparatus may include a display device configured to display a three-dimensional image comprising two or more view images, a three-dimensional image filter disposed at the front of the display device to adjust optical paths of the displayed view images, a camera configured to capture a viewing zone of the three-dimensional image processing apparatus, and a controller configured to execute a tracking function, to determine whether the user is in the viewing zone using the captured image and to adjust a mode of the tracking function based on the determined result, the tracking function to set user position information related to a position of a user using the captured image and to generate a control signal to control display of the view images based on the set user position information.
- an electric power control method of a three-dimensional image processing apparatus may include checking a mode of a tracking function, capturing an image of a user when the mode of the tracking function is a normal mode, setting user position information related to a position of the user using the captured image and generating a control signal to control display of two or more view images based on the set user position information, sensing the illuminance of ambient light, and adjusting the mode of the tracking function based on the illuminance of the ambient light.
- an electric power control method of a three-dimensional image processing apparatus may include checking a mode of a tracking function, capturing a viewing zone of the three-dimensional image processing apparatus when the mode of the tracking function is a normal mode, setting user position information related to a position of a user using the captured image and generating a control signal to control display of two or more view images based on the set user position information, determining whether the user is in the viewing zone using the captured image, and adjusting the mode of the tracking function based on the determined result.
- any reference in this specification to “one embodiment,” “an embodiment,” “example embodiment,” etc. means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure.
- the appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Abstract
Description
h=H*d/D (1)
where H indicates a head movement amount of a user, D indicates a distance from a three-
P=Mod(h,Q) (2)
where Q indicates a three-dimensional image pixel cycle.
T C<1/FR (3)
where FR indicates a frame rate of the
T m<1/FR+T t (4)
where Tt is a delay taken until the
1/FR>T t (5)
T t=α+β+γ+δ (6)
where, α indicates a delay taken until image frames captured by the
1/FR>α+β+γ+δ (7)
T t=α+β+ε+ζ (8)
where α is a delay taken until image frames captured by the
1/FR>α+β+ε+ζ (9)
V=H/T (10)
where H is a distance between the currently detected
for (k=1,k<N+1,k++) A(1)
{a position of a user at delay time+kt}
where delay time+kt may be a predetermined time period, and the delay time may be time delayed by at least one selected from among camera capture delay, detection processing delay, or image driver frame rate delay.
t=(1/M)/N (11)
where M is the maximum frame rate of the camera, and N may be set as represented by mathematical expression 12 below:
N>(v*t)/T (12)
where T is a threshold of head position change at which image change occurs.
P=P 0 +VT (13)
where, P0 is a detection position of the user, and T is delay time+kt.
1/FR>α+β+γ+δ−Nη+Nδ (14)
where α is a time delay taken until image frames captured by the
η=[1/(N+1)]×[1/FR] (15)
1/FR>α+β+ε+ζ−Nη+Nζ (16)
where, α is a time delay until image frames captured by the
Claims (15)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2011-0117642 | 2011-11-11 | ||
KR1020110117642A KR101887058B1 (en) | 2011-11-11 | 2011-11-11 | A process for processing a three-dimensional image and a method for controlling electric power of the same |
Publications (2)
Publication Number | Publication Date |
---|---|
US20130120535A1 US20130120535A1 (en) | 2013-05-16 |
US10560677B2 true US10560677B2 (en) | 2020-02-11 |
Family
ID=47428458
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/673,216 Active 2034-07-16 US10560677B2 (en) | 2011-11-11 | 2012-11-09 | Three-dimensional image processing apparatus and electric power control method of the same |
Country Status (4)
Country | Link |
---|---|
US (1) | US10560677B2 (en) |
EP (1) | EP2592840B1 (en) |
KR (1) | KR101887058B1 (en) |
CN (1) | CN103108203B (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9591295B2 (en) * | 2013-09-24 | 2017-03-07 | Amazon Technologies, Inc. | Approaches for simulating three-dimensional views |
US9591426B2 (en) * | 2013-11-22 | 2017-03-07 | Voyetra Turtle Beach, Inc. | Method and apparatus for an ultrasonic emitter system floor audio unit |
CN103913847B (en) * | 2014-03-19 | 2015-12-02 | 京东方科技集团股份有限公司 | A kind of three-dimensional display system |
KR102328703B1 (en) * | 2015-07-24 | 2021-11-19 | 삼성전자주식회사 | Display apparatus and method for controlling a screen of display apparatus |
CN105093544B (en) * | 2015-08-12 | 2017-06-30 | 京东方科技集团股份有限公司 | Display device |
AU2017275482A1 (en) * | 2016-06-03 | 2018-11-15 | Covidien Lp | Systems, methods, and computer-readable storage media for controlling aspects of a robotic surgical device and viewer adaptive stereoscopic display |
US10728537B2 (en) * | 2016-08-29 | 2020-07-28 | Hitachi, Ltd. | Photographing device and photographing method |
KR101919907B1 (en) | 2017-02-28 | 2018-11-20 | 연세대학교 원주산학협력단 | Apparatus and method for monitoring interpersonal interaction based on multiple neurophysiological signals |
JP6895837B2 (en) * | 2017-07-25 | 2021-06-30 | 三菱電機株式会社 | Display device |
WO2019178666A1 (en) * | 2018-03-19 | 2019-09-26 | Vanderlande Apc Inc. | System, apparatus and method for performing security screening at a checkpoint using x-ray and ct scanning devices and gui configured for use in connection with same |
CN112367516B (en) * | 2020-11-09 | 2021-10-01 | 四川长虹电器股份有限公司 | Three-dimensional display system based on space positioning |
WO2024095358A1 (en) | 2022-11-01 | 2024-05-10 | 株式会社バーチャルウインドウ | Image display system and display device |
Citations (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5424553A (en) * | 1994-05-16 | 1995-06-13 | Eastman Kodak Company | Method for aligning a lenticular material for printing |
JPH10232626A (en) | 1997-02-20 | 1998-09-02 | Canon Inc | Stereoscopic image display device |
US5959664A (en) * | 1994-12-29 | 1999-09-28 | Sharp Kabushiki Kaisha | Observer tracking autostereoscopic display and method of tracking an observer |
US6075557A (en) * | 1997-04-17 | 2000-06-13 | Sharp Kabushiki Kaisha | Image tracking system and method and observer tracking autostereoscopic display |
US20020011987A1 (en) * | 2000-03-31 | 2002-01-31 | Seiko Epson Corporation | Detection of pointed position using image processing |
US6377295B1 (en) * | 1996-09-12 | 2002-04-23 | Sharp Kabushiki Kaisha | Observer tracking directional display |
EP1383343A2 (en) | 2002-07-17 | 2004-01-21 | Sharp Kabushiki Kaisha | Autostereoscopic display |
US20040075812A1 (en) * | 2002-01-18 | 2004-04-22 | Kardon Randy H. | Device and method for optical imaging of retinal function |
US20060136762A1 (en) * | 2004-12-20 | 2006-06-22 | Nec-Mitsubishi Electric Visual Systems Corporation | Display device |
US20060139447A1 (en) * | 2004-12-23 | 2006-06-29 | Unkrich Mark A | Eye detection system and method for control of a three-dimensional display |
US20070159673A1 (en) * | 2005-11-21 | 2007-07-12 | Freeman Mark O | Substrate-guided display with improved image quality |
CN101210846A (en) | 2006-12-27 | 2008-07-02 | 汉阳大学校产学协力团 | Ambient light sensor circuit and flat panel display device having the same |
KR20090016251A (en) | 2007-08-10 | 2009-02-13 | 한양대학교 산학협력단 | Ambient light sensor circuit for flat panel display device |
US20090181719A1 (en) * | 2008-01-14 | 2009-07-16 | Sung Yeob Cho | Mobile telecommunication terminal having camera and controlling method for the same |
US20100079508A1 (en) * | 2008-09-30 | 2010-04-01 | Andrew Hodge | Electronic devices with gaze detection capabilities |
US20100295958A1 (en) * | 2009-05-20 | 2010-11-25 | Sony Ericsson Mobile Communications Ab | Portable electronic apparatus including a display and method for controlling such an apparatus |
WO2011001372A1 (en) | 2009-06-30 | 2011-01-06 | Koninklijke Philips Electronics N.V. | Directional display system |
CN101984670A (en) | 2010-11-16 | 2011-03-09 | 深圳超多维光电子有限公司 | Stereoscopic displaying method, tracking stereoscopic display and image processing device |
US20110134251A1 (en) * | 2009-12-03 | 2011-06-09 | Sungun Kim | Power control method of gesture recognition device by detecting presence of user |
US20110157696A1 (en) * | 2009-12-31 | 2011-06-30 | Broadcom Corporation | Display with adaptable parallax barrier |
US20120088581A1 (en) * | 2010-10-07 | 2012-04-12 | Sony Computer Entertainment Inc. | 3-d glasses with camera based head tracking |
-
2011
- 2011-11-11 KR KR1020110117642A patent/KR101887058B1/en active IP Right Grant
-
2012
- 2012-11-05 EP EP12007508.0A patent/EP2592840B1/en not_active Not-in-force
- 2012-11-08 CN CN201210444042.5A patent/CN103108203B/en not_active Expired - Fee Related
- 2012-11-09 US US13/673,216 patent/US10560677B2/en active Active
Patent Citations (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5424553A (en) * | 1994-05-16 | 1995-06-13 | Eastman Kodak Company | Method for aligning a lenticular material for printing |
US5959664A (en) * | 1994-12-29 | 1999-09-28 | Sharp Kabushiki Kaisha | Observer tracking autostereoscopic display and method of tracking an observer |
US6377295B1 (en) * | 1996-09-12 | 2002-04-23 | Sharp Kabushiki Kaisha | Observer tracking directional display |
JPH10232626A (en) | 1997-02-20 | 1998-09-02 | Canon Inc | Stereoscopic image display device |
US6075557A (en) * | 1997-04-17 | 2000-06-13 | Sharp Kabushiki Kaisha | Image tracking system and method and observer tracking autostereoscopic display |
US20020011987A1 (en) * | 2000-03-31 | 2002-01-31 | Seiko Epson Corporation | Detection of pointed position using image processing |
US20040075812A1 (en) * | 2002-01-18 | 2004-04-22 | Kardon Randy H. | Device and method for optical imaging of retinal function |
EP1383343A2 (en) | 2002-07-17 | 2004-01-21 | Sharp Kabushiki Kaisha | Autostereoscopic display |
US20060136762A1 (en) * | 2004-12-20 | 2006-06-22 | Nec-Mitsubishi Electric Visual Systems Corporation | Display device |
US20060139447A1 (en) * | 2004-12-23 | 2006-06-29 | Unkrich Mark A | Eye detection system and method for control of a three-dimensional display |
US20070159673A1 (en) * | 2005-11-21 | 2007-07-12 | Freeman Mark O | Substrate-guided display with improved image quality |
CN101210846A (en) | 2006-12-27 | 2008-07-02 | 汉阳大学校产学协力团 | Ambient light sensor circuit and flat panel display device having the same |
KR20090016251A (en) | 2007-08-10 | 2009-02-13 | 한양대학교 산학협력단 | Ambient light sensor circuit for flat panel display device |
US20090181719A1 (en) * | 2008-01-14 | 2009-07-16 | Sung Yeob Cho | Mobile telecommunication terminal having camera and controlling method for the same |
US20100079508A1 (en) * | 2008-09-30 | 2010-04-01 | Andrew Hodge | Electronic devices with gaze detection capabilities |
US20100295958A1 (en) * | 2009-05-20 | 2010-11-25 | Sony Ericsson Mobile Communications Ab | Portable electronic apparatus including a display and method for controlling such an apparatus |
WO2011001372A1 (en) | 2009-06-30 | 2011-01-06 | Koninklijke Philips Electronics N.V. | Directional display system |
US20110134251A1 (en) * | 2009-12-03 | 2011-06-09 | Sungun Kim | Power control method of gesture recognition device by detecting presence of user |
KR20110062484A (en) | 2009-12-03 | 2011-06-10 | 엘지전자 주식회사 | Controlling power of devices which is controllable with user's gesture by detecting presence of user |
US20110157696A1 (en) * | 2009-12-31 | 2011-06-30 | Broadcom Corporation | Display with adaptable parallax barrier |
US20120088581A1 (en) * | 2010-10-07 | 2012-04-12 | Sony Computer Entertainment Inc. | 3-d glasses with camera based head tracking |
CN101984670A (en) | 2010-11-16 | 2011-03-09 | 深圳超多维光电子有限公司 | Stereoscopic displaying method, tracking stereoscopic display and image processing device |
US20120120203A1 (en) | 2010-11-16 | 2012-05-17 | Shenzhen Super Perfect Optics Ltd. | Three-dimensional display method, tracking three-dimensional display unit and image processing device |
Non-Patent Citations (4)
Title |
---|
Chinese Office Action issued in Application No. 201210444042.5 dated Jun. 23, 2014. |
European Office Action issued in related Application No. 12007508.0 dated May 7, 2014. |
European Search Report issued in related Application No. 12007508.0, dated Sep. 6, 2013. |
Korean Office Action dated Dec. 6, 2017 issued in Application No. 10-2011-0117642 (with English Translation). |
Also Published As
Publication number | Publication date |
---|---|
CN103108203B (en) | 2015-06-24 |
KR101887058B1 (en) | 2018-08-09 |
KR20130052280A (en) | 2013-05-22 |
EP2592840A2 (en) | 2013-05-15 |
CN103108203A (en) | 2013-05-15 |
EP2592840B1 (en) | 2016-07-27 |
EP2592840A3 (en) | 2013-10-09 |
US20130120535A1 (en) | 2013-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10560677B2 (en) | Three-dimensional image processing apparatus and electric power control method of the same | |
US9240068B2 (en) | Three-dimensional image processing apparatus and calibration method of the same | |
KR102014775B1 (en) | Mobile terminal and method for controlling the same | |
KR101852811B1 (en) | Display device and method for controlling thereof | |
US20160291327A1 (en) | Glass-type image display device and method for controlling same | |
US20120038747A1 (en) | Mobile terminal and method for controlling operation of the mobile terminal | |
KR20120010764A (en) | MOBILE TERMINAL AND METHOD FOR CONTROLLING A THREE DIMENSION IMAGE in thereof | |
KR20150024199A (en) | Head mount display device and control method thereof | |
KR101737840B1 (en) | Mobile terminal and method for controlling the same | |
KR101883375B1 (en) | Mobile terminal | |
KR101633336B1 (en) | Mobile terminal and method for controlling thereof | |
KR20120122314A (en) | Mobile terminal and control method for the same | |
KR101870721B1 (en) | Display Apparatus For Stereo-Scopic Image Including Parallax Barrier And Mobile terminal Including The Same | |
KR20130065074A (en) | Electronic device and controlling method for electronic device | |
KR101802755B1 (en) | Mobile terminal and method for controlling the same | |
KR101629313B1 (en) | Mobile terminal and method for controlling the same | |
KR101622220B1 (en) | Mobile terminal | |
KR101853663B1 (en) | Mobile terminal | |
KR20130053476A (en) | Mobile terminal and method for controlling the same | |
KR20120130394A (en) | Mobile terminal and method for controlling the same | |
KR20130017178A (en) | Mobile terminal and method for controlling the same | |
KR101871708B1 (en) | Mobile terminal and method for controlling the same | |
KR101844225B1 (en) | Mobile terminal and method for controlling the same | |
KR20130064155A (en) | Display apparatus for stereo-scopic image including parallax barrier and mobile terminal including the same | |
KR20130058203A (en) | Mobile terminal and method for controlling thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: LG ELECTRONICS INC., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHA, HONGRAE;CHOI, KWANGYEOL;PARK, TAESOO;AND OTHERS;SIGNING DATES FROM 20121030 TO 20121108;REEL/FRAME:029271/0891 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |