WO2012141350A1 - Dispositif électronique et procédé d'affichage d'image stéréoscopique - Google Patents

Dispositif électronique et procédé d'affichage d'image stéréoscopique Download PDF

Info

Publication number
WO2012141350A1
WO2012141350A1 PCT/KR2011/002567 KR2011002567W WO2012141350A1 WO 2012141350 A1 WO2012141350 A1 WO 2012141350A1 KR 2011002567 W KR2011002567 W KR 2011002567W WO 2012141350 A1 WO2012141350 A1 WO 2012141350A1
Authority
WO
WIPO (PCT)
Prior art keywords
stereoscopic image
user
virtual
electronic device
axis
Prior art date
Application number
PCT/KR2011/002567
Other languages
English (en)
Inventor
Soungmin Im
Taehyeong Kim
Original Assignee
Lg Electronics Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lg Electronics Inc. filed Critical Lg Electronics Inc.
Priority to PCT/KR2011/002567 priority Critical patent/WO2012141350A1/fr
Publication of WO2012141350A1 publication Critical patent/WO2012141350A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/398—Synchronisation thereof; Control thereof

Definitions

  • This document relates to an electronic device and a method thereof for displaying stereoscopic images. More specifically, this document relates to an electronic device and a method thereof for displaying stereoscopic images capable of scaling stereoscopic images in response to a gesture of the user.
  • terminals such as personal computers, notebooks, and mobile phones are getting equipped with diversified functions, they are evolving into multimedia players with multi-functions of capturing images or videos, playing audio or video files, providing games, receiving broadcast programs, and so on.
  • a terminal can be classified into a mobile or a stationary terminal depending on mobility of the terminal.
  • a display device can be classified into a handheld or a vehicle mounted terminal depending on whether the user can carry the display device or not. To support and extend the functions of a terminal, improving structural and/or software part of the terminal can be taken into account.
  • An aspect of this document is to provide an electronic device and a method thereof for displaying stereoscopic images capable of displaying stereoscopic images and scaling up or down the images based on the user’s gesture.
  • an electronic device can comprise a camera, a display, and a controller.
  • the camera can obtain a user’s image.
  • the display can display stereoscopic images.
  • the controller can scale up or down the stereoscopic images while moving the stereoscopic images along a virtual axis according to the gesture recognized from the user’s image. At this time, the controller can change the scale factor for the stereoscopic images to be scaled up or down in proportion to the depth along the virtual axis.
  • an electronic device can comprise a camera, a display, and a controller.
  • the camera can obtain a user’s image.
  • the display can display stereoscopic images.
  • the controller can recognize the user’s gesture from the user’s image and based on the recognized gesture, set up a virtual axis and scale the stereoscopic images. At this time, the controller, based on the recognized gesture, can change the scale factor for the stereoscopic images to be scaled up or down in proportion to the depth along the virtual axis.
  • a method of an electronic device for displaying stereoscopic images comprises displaying stereoscopic images; obtaining a user’s image; recognizing the user’s gesture from the user’s image; and scaling stereoscopic images while moving the stereoscopic images along a virtual axis.
  • the scaling stereoscopic images can comprise changing a scale factor of the stereoscopic images to be scaled in proportion to the depth along the virtual axis.
  • a method of an electronic device for displaying stereoscopic images comprises displaying stereoscopic images; obtaining a user’s image; recognizing the user’s gesture from the user’s image; and setting up a virtual axis based on the recognized gesture and scaling the stereoscopic images.
  • the scaling stereoscopic images can comprise changing a scale factor of the stereoscopic images to be scaled in proportion to the depth along the virtual axis based on the recognized gesture.
  • the user can scale up or down stereoscopic images displayed through gesture.
  • the user can scale up or down stereoscopic images while moving the stereoscopic images displayed along an established virtual axis through gesture.
  • the user can change a scale factor of stereoscopic images in proportion to the depth along a virtual axis.
  • FIG. 1 is a block diagram of an electronic device according to an embodiment of the present invention.
  • FIGS. 2 and 3 illustrate a method of displaying three dimensional stereoscopic images employing binocular parallax related to the present invention
  • FIGS. 4 to 6 illustrate a method for displaying stereoscopic images of an electronic device according to an embodiment of the present invention
  • FIG. 7 is a flow diagram illustrating a method for displaying stereoscopic images of an electronic device according to an embodiment of the present invention.
  • FIGS. 8 and 9 illustrate a procedure of scaling up the stereoscopic images displayed on a display according to a method for displaying stereoscopic images of an electronic device shown in FIG. 7;
  • FIGS. 10 and 11 illustrate a procedure of scaling down the stereoscopic images displayed on a display according to a method for displaying stereoscopic images of an electronic device shown in FIG. 7;
  • FIG. 12 is a flow diagram illustrating a method for displaying stereoscopic images of an electronic device according to another embodiment of the present invention.
  • FIGS. 13 and 14 illustrate a procedure of the electronic device’s recognizing the user’s gesture and setting up a virtual axis along the direction corresponding to the recognized gesture according to the S210 to S220 steps of FIG. 12;
  • FIGS. 15 to 20 illustrate examples of an electronic device according to an embodiment of the present invention scaling up stereoscopic images in response to the user’s gesture shown in FIGS. 13 and 14;
  • FIGS. 21 and 22 illustrate another procedure of the electronic device’s recognizing the user’s gesture and setting up a virtual axis along the direction corresponding to the recognized gesture according to the S210 to S220 steps of FIG. 12;
  • FIGS. 23 to 28 illustrate examples of an electronic device according to an embodiment of the present invention scaling down stereoscopic images in response to the user’s gesture
  • FIG. 29 is a flow diagram illustrating a method for displaying stereoscopic images of an electronic device according to another embodiment of the present invention.
  • FIG. 30 is one example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device shown in FIG. 29;
  • FIGS. 31 and 32 are examples of an electronic device’s controller displaying stereoscopic images based on the user’s gesture shown in FIG. 30;
  • FIG. 33 is another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device shown in FIG. 29;
  • FIGS. 34 and 35 are examples of an electronic device’s controller displaying stereoscopic images based on the user’s gesture shown in FIG. 33;
  • FIG. 36 is yet another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device shown in FIG. 29;
  • FIGS. 37 and 38 are examples of an electronic device’s controller displaying stereoscopic images based on the user’s gesture shown in FIG. 33;
  • FIG. 39 is still another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device shown in FIG. 29;
  • FIGS. 40 and 41 are examples of an electronic device’s controller displaying stereoscopic images based on the user’s gesture shown in FIG. 39;
  • FIG. 42 is a flow diagram illustrating one example of setting up a virtual axis of an electronic device according to the present invention.
  • FIG. 43 is a flow diagram illustrating another example of setting up a virtual axis of an electronic device according to the present invention.
  • FIG. 44 illustrates a method for setting up a virtual axis shown in FIG. 43;
  • FIG. 45 is a flow diagram illustrating a method for displaying stereoscopic images of an electronic device according to yet another embodiment of the present invention.
  • FIG. 46 is one example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device shown in FIG. 45;
  • FIG. 47 is an example of an electronic device’s controller displaying stereoscopic images based on the user’s gesture shown in FIG. 46;
  • FIG. 48 is another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device shown in FIG. 45;
  • FIG. 49 is an example of an electronic device’s controller displaying stereoscopic images based on the user’s gesture shown in FIG. 48;
  • FIG. 50 is yet another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device shown in FIG. 45;
  • FIG. 51 is an example of an electronic device’s controller displaying stereoscopic images based on the user’s gesture shown in FIG. 50.
  • the electronic device described in the specification may be mobile terminal such as a cellular phone, a smart phone, a laptop computer, a digital broadcasting terminal, personal digital assistants (PDA), a portable multimedia player (PMP), a navigation system and so on. Also, the electronic device may be stationary device such as a television, a personal computer, and so on.
  • mobile terminal such as a cellular phone, a smart phone, a laptop computer, a digital broadcasting terminal, personal digital assistants (PDA), a portable multimedia player (PMP), a navigation system and so on.
  • PDA personal digital assistants
  • PMP portable multimedia player
  • the electronic device may be stationary device such as a television, a personal computer, and so on.
  • FIG. 1 is a block diagram of a display device relating to an embodiment of this document.
  • the display device 100 may include a communication unit 110, a user input unit 120, an output unit 150, a memory 160, an interface 170, a controller 180, and a power supply 190. Not all of the components shown in FIG. 1 may be essential parts and the number of components included in the display device 100 may be varied.
  • the communication unit 110 may include at least one module that enables communication between the display device 100 and a communication system or between the display device 100 and another device.
  • the communication unit 110 may include a broadcasting receiving module 111, an Internet module 113, and a near field communication module 114.
  • the broadcasting receiving module 111 may receive broadcasting signals and/or broadcasting related information from an external broadcasting management server through a broadcasting channel.
  • the broadcasting channel may include a satellite channel and a terrestrial channel
  • the broadcasting management server may be a server that generates and transmits broadcasting signals and/or broadcasting related information or a server that receives previously created broadcasting signals and/or broadcasting related information and transmits the broadcasting signals and/or broadcasting related information to a terminal.
  • the broadcasting signals may include not only TV broadcasting signals, radio broadcasting signals, and data broadcasting signals but also signals in the form of a combination of a TV broadcasting signal and a radio broadcasting signal of a data broadcasting signal.
  • the broadcasting related information may be information on a broadcasting channel, a broadcasting program or a broadcasting service provider, and may be provided even through a communication network.
  • the broadcasting related information may exist in various forms.
  • the broadcasting related information may exist in the form of an electronic program guide (EPG) of a digital multimedia broadcasting (DMB) system or in the form of an electronic service guide (ESG) of a digital video broadcast-handheld (DVB-H) system.
  • EPG electronic program guide
  • ESG electronic service guide
  • DMB digital multimedia broadcasting
  • DVB-H digital video broadcast-handheld
  • the broadcasting receiving module 111 may receive broadcasting signals using various broadcasting systems.
  • the broadcasting signals and/or broadcasting related information received through the broadcasting receiving module 111 may be stored in the memory 160.
  • the Internet module 113 may correspond to a module for Internet access and may be included in the display device 100 or may be externally attached to the display device 100.
  • the near field communication module 114 may correspond to a module for near field communication. Further, Bluetooth®, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB) and/or ZigBee® may be used as a near field communication technique.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra wideband
  • ZigBee® ZigBee®
  • the user input 120 is used to input an audio signal or a video signal and may include a camera 121 and a microphone 122.
  • the camera 121 may process image frames of still images or moving images obtained by an image sensor in a video telephony mode or a photographing mode. The processed image frames may be displayed on a display 151.
  • the camera 121 may be a 2D or 3D camera.
  • the camera 121 may be configured in the form of a single 2D or 3D camera or in the form of a combination of the 2D and 3D cameras.
  • the image frames processed by the camera 121 may be stored in the memory 160 or may be transmitted to an external device through the communication unit 110.
  • the display device 100 may include at least two cameras 121.
  • the microphone 122 may receive an external audio signal in a call mode, a recording mode or a speech recognition mode and process the received audio signal into electric audio data.
  • the microphone 122 may employ various noise removal algorithms for removing or reducing noise generated when the external audio signal is received.
  • the output unit 150 may include the display 151 and an audio output module 152.
  • the display 151 may display information processed by the display device 100.
  • the display 151 may display a user interface (UI) or a graphic user interface (GUI) relating to the display device 100.
  • the display 151 may include at least one of a liquid crystal display, a thin film transistor liquid crystal display, an organic light-emitting diode display, a flexible display and a three-dimensional display. Some of these displays may be of a transparent type or a light transmissive type. That is, the display 151 may include a transparent display.
  • the transparent display may include a transparent liquid crystal display.
  • the rear structure of the display 151 may also be of a light transmissive type. Accordingly, a user may see an object located behind the body of terminal through the transparent area of the terminal body, occupied by the display 151.
  • the display device 100 may include at least two displays 151.
  • the display device 100 may include a plurality of displays 151 that are arranged on a single face at a predetermined distance or integrated displays.
  • the plurality of displays 151 may also be arranged on different sides.
  • the display 151 and a sensor sensing touch form a layered structure that is referred to as a touch screen
  • the display 151 may be used as an input device in addition to an output device.
  • the touch sensor may be in the form of a touch film, a touch sheet, and a touch pad, for example.
  • the touch sensor may convert a variation in pressure applied to a specific portion of the display 151 or a variation in capacitance generated at a specific portion of the display 151 into an electric input signal.
  • the touch sensor may sense pressure of touch as well as position and area of the touch.
  • a signal corresponding to the touch input may be transmitted to a touch controller.
  • the touch controller may then process the signal and transmit data corresponding to the processed signal to the controller 180. Accordingly, the controller 180 can detect a touched portion of the display 151.
  • the audio output module 152 may output audio data received from the radio communication unit 110 or stored in the memory 160.
  • the audio output module 152 may output audio signals related to functions, such as a call signal incoming tone and a message incoming tone, performed in the display device 100.
  • the memory 160 may store a program for operation of the controller 180 and temporarily store input/output data such as a phone book, messages, still images, and/or moving images.
  • the memory 160 may also store data about vibrations and sounds in various patterns that are output from when a touch input is applied to the touch screen.
  • the memory 160 may include at least a flash memory, a hard disk type memory, a multimedia card micro type memory, a card type memory, such as SD or XD memory, a random access memory (RAM), a static RAM (SRAM), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), a programmable ROM (PROM) magnetic memory, a magnetic disk or an optical disk.
  • the display device 100 may also operate in relation to a web storage performing the storing function of the memory 160 on the Internet.
  • the interface 170 may serve as a path to all external devices connected to the mobile terminal 100.
  • the interface 170 may receive data from the external devices or power and transmit the data or power to internal components of the display device terminal 100 or transmit data of the mobile terminal 100 to the external devices.
  • the interface 170 may include a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device having a user identification module, an audio I/O port, a video I/O port, and/or an earphone port.
  • the controller 180 may control overall operations of the mobile terminal 100.
  • the controller 180 may perform control and processing for voice communication.
  • the controller 180 may also include an image processor 182 for pressing image, which will be explained later.
  • the power supply 190 receives external power and internal power and provides power required for each of the components of the display device 100 to operate under the control of the controller 180.
  • embodiments described in this document can be implemented in software, hardware or a computer readable recording medium. According to hardware implementation, embodiments of this document may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and/or electrical units for executing functions. The embodiments may be implemented by the controller 180 in some cases.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • processors controllers, micro-controllers, microprocessors, and/or electrical units for executing functions.
  • controller 180 may be implemented by the controller 180 in some cases.
  • embodiments such as procedures or functions may be implemented with a separate software module executing at least one function or operation.
  • Software codes may be implemented according to a software application written in an appropriate software language. The software codes may be stored in the memory 160 and executed by the controller 180.
  • FIGS. 2 and 3 are views illustrating a method for displaying a stereoscopic image using binocular parallax according to an exemplary embodiment of the present invention. Specifically, FIG. 2 shows a scheme using a lenticular lens array, and FIG. 3 shows a scheme using a parallax barrier.
  • Binocular parallax refers to the difference in vision of viewing an object between a human being’s (user’s or observer’s) left and right eyes.
  • the user’s brain When the user’s brain combines an image viewed by the left eye and that viewed by the right eye, the combined image makes the user feel stereoscopic.
  • the phenomenon in which the user feels stereoscopic according to binocular parallax will be referred to as a ‘stereoscopic vision’, and an image causing a stereoscopic vision will be referred to as a ‘stereoscopic image’.
  • a particular object included in an image causes the stereoscopic vision
  • the corresponding object when a particular object included in an image causes the stereoscopic vision, the corresponding object will be referred to as a ‘stereoscopic object’.
  • a method for displaying a stereoscopic image according to binocular parallax is classified into a glass type method and a glassless type method.
  • the glass type method may include a scheme using tinted glasses having a wavelength selectivity, a polarization glass scheme using a light blocking effect according to a deviation difference, and a time-division glass scheme alternately providing left and right images within a residual image time of eyes.
  • the glass type method may further include a scheme in which filters each having a different transmittance are mounted on left and right eyes and a cubic effect with respect to a horizontal movement is obtained according to a time difference of a visual system made from the difference in transmittance.
  • the glassless type method in which a cubic effect is generated from an image display surface, rather than from an observer, includes a parallax barrier scheme, a lenticular lens scheme, a microlens array scheme, and the like.
  • a display module 151 includes a lenticular lens array 81a.
  • the lenticular lens array 81a is positioned between a display surface 81 on which pixels (L) to be input to a left eye 82a and pixels (R) to be input to a right eye 82b are alternately arranged along a horizontal direction, and the left and right eyes 82a and 82b, and provides an optical discrimination directionality with respect to the pixels (L) to be input to the left eye 82a and the pixels (R) to be input to the right eye 82b.
  • an image which passes through the lenticular lens array 81a is separated by the left eye 82a and the right eye 82b and thusly observed, and the user’s brain combines (or synthesizes) the image viewed by the left eye 82a and the image viewed by the right eye 82b, thus allowing the user to observe a stereoscopic image.
  • the display module 151 includes a parallax barrier 81b in the shape of a vertical lattice.
  • the parallax barrier 81b is positioned between a display surface 81 on which pixels (L) to be input to a left eye 82a and pixels (R) to be input to a right eye 82b are alternately arranged along a horizontal direction, and the left and right eyes 82a and 82b, and allows images are separately observed at the left eye 82a and the right eye 82b.
  • the user’s brain combines (or synthesizes) the image viewed by the left eye 82a and the image viewed by the right eye 82b, thus allowing the user to observe a stereoscopic image.
  • the parallax barrier 81b is turned on to separate incident vision only in the case of displaying a stereoscopic image, and when a planar image is intended to be displayed, the parallax barrier 81b may be turned off to allow the incident vision to pass through without being separated.
  • a stereoscopic image using binocular parallax may be displayed by using various other methods.
  • FIGS. 4 to 6 illustrate a method for displaying stereoscopic images of an electronic device according to an embodiment of the present invention.
  • FIG. 4 illustrates an example where displayed is a stereoscopic image containing multiple image objects 10, 11.
  • the stereoscopic image illustrated in FIG. 4 can be the image obtained through the camera 121.
  • the stereoscopic image includes a first image object 10 and a second image object 11.
  • two image objects 10, 11 are included in the stereoscopic image; however, in practice, much more image objects can be included in the stereoscopic image.
  • the controller 180 can display images obtained in real-time through the camera 121 on the display 151 in the form of a camera preview.
  • the controller 180 can obtain at least one stereo disparity corresponding to the at least one image object.
  • the controller 180 can obtain the respective stereo disparities of the first 10 and the second image object 11 through the left and the right image obtained through the camera 121.
  • FIG. 5 illustrates stereo disparity of an image object included in a stereoscopic image.
  • the first image object 10 forms a left image 10a viewed by a left eye 20a of the user and a right image 10b viewed by a right eye 20b of the user.
  • the controller 180 can obtain stereo disparity d1 corresponding to the first image object 10 through the left 10a and the right image 10b.
  • the controller 180 when the camera 121 is a 2D camera, the controller 180, by using a predetermined algorithm transforming a 2D image into a 3D image, transforms 2D images obtained through the camera 121 into the corresponding stereoscopic images, thereby displaying the stereoscopic images on the display 151.
  • controller 180 by using left and right images generated by employing the image transformation algorithm, can obtain the respective stereo disparities of the first image object 10 and the second image object 11.
  • FIG. 6 is a drawing for comparing stereo disparities of image objects 10, 11 shown in FIG. 4 with each other.
  • the stereo disparity d1 of the first image object 10 and the stereo disparity d2 of the second image object 11 are different from each other. As shown in FIG. 6, since d2 is larger than d1, the second image object 11 is viewed more distant from the user than the first image object 10.
  • FIG. 7 is a flow diagram illustrating a method for displaying stereoscopic images of an electronic device 100 according to an embodiment of the present invention.
  • the procedure of displaying stereoscopic images will be described with reference to related drawings.
  • the controller 180 of the electronic device 100 displays a stereoscopic image on the display 100.
  • the stereoscopic image denotes a three-dimensional stereoscopic image utilizing stereo disparity.
  • the controller 180 scales up or down the stereoscopic image S120 while moving the center of the stereoscopic image along a virtual axis S110. In other words, the controller 180 can magnify or reduce the size of the stereoscopic image while changing the depth at which the stereoscopic image is displayed.
  • FIGS. 8 and 9 illustrate a procedure of scaling up the stereoscopic images displayed on a display according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 7.
  • the controller 180 of the electronic device 100 can magnify a sphere, which is a stereoscopic image, while moving the center of the sphere along Z’ axis.
  • X, Y, and Z axis in this document correspond to reference axes of the three-dimensional Cartesian coordinate system of the actual living space.
  • X’, Y’, and Z’ axis correspond to reference axes of a virtual three-dimensional Cartesian coordinate system in the virtual space where stereoscopic images are displayed on the display 151 of the electronic device; the respective axes correspond to X, Y, and Z axis of the actual three-dimensional Cartesian coordinate system.
  • the size of the sphere is increased, while the depth of the sphere is deepened. The user then feels that though the sphere is gradually more distant, the size thereof is being increased.
  • the procedure of magnifying a stereoscopic image shown in FIG. 9 the user can know that the depth of the sphere becomes small as the size of the sphere is being increased. The user then recognizes that the size of the sphere is growing as the sphere approaches forward.
  • FIGS. 10 and 11 illustrate a procedure of scaling down the stereoscopic images displayed on a display 151 according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 7.
  • the controller of the electronic device can reduce the stereoscopic image of a sphere while moving the center of the stereoscopic image along Z’ axis.
  • the size of the sphere is reduced while the depth of the sphere deepens. The user then recognizes that the size of the sphere is reduced as the sphere become more distant.
  • a procedure of magnifying a stereoscopic image shown in FIG. 12 it can be known that the size of the sphere is gradually reduced while the depth of the sphere deepens. The user then recognizes that the size of the sphere is reduced while the sphere approaches toward the user.
  • FIG. 12 is a flow diagram illustrating a method for displaying stereoscopic images of an electronic device 100 according to another embodiment of the present invention.
  • a method for displaying stereoscopic images of the electronic device will be described with reference to related drawings.
  • the controller 180 of the electronic device 100 displays stereoscopic images S200. If a stereoscopic image is displayed, the controller 180 obtains an image of the user of the electronic device through a camera 121 and recognizes the user’s gesture by analyzing the image of the user S210. Once the user’s gesture is recognized, the controller 180 sets up a virtual axis based on the direction corresponding to the recognized gesture S220.
  • FIGS. 13 and 14 illustrate a procedure of the electronic device’s 100 recognizing the user’s 200 gesture and setting up a virtual axis along the direction corresponding to the recognized gesture according to the S210 to S220 steps of FIG. 12.
  • the electronic device 100 is a TV capable of recognizing the user’s gesture and scaling stereoscopic images displayed on a display 151 according to the recognized gesture.
  • FIG. 13 assumes that both hands 210, 220 of the user are endowed with control and the user interface for gesture of both hands 210, 220 has been activated. It is further assumed that a specific point between both hands 210, 220 of the user acts as a reference for determining the direction corresponding to the gesture.
  • the distance between both hands 210, 220 of the user is D1; the user moves his or her hands in the positive direction of Z axis and separates both hands from each other in the direction of X axis.
  • the configuration of FIG. 13(b) is obtained and the distance between the two hands 210, 220 of the user becomes D2.
  • the distance between the two hands 210, 220 of the user is D2; the user moves his or her hands in the positive direction of Z axis and separates the two hands 210, 220 from each other in the direction of X axis.
  • the configuration of FIG. 13(c) is obtained and the distance between the two hands 210, 220 of the user becomes D3.
  • the user’s gesture can be interpreted in such a way that the positive direction of Z axis is recognized as the direction corresponding to the user’s gesture and types of the user’s gesture can be identified by the distance made by separating the user’s hands 210, 220 from each other.
  • the controller 180 can set up Z axis as a virtual axis corresponding to the gesture.
  • a center point S1, S2, S3 between both hands 210, 220 of the user acts as a criterion to determine the direction of the gesture; however, the scope of the present invention is not limited to the above.
  • a criterion to determine the direction corresponding to the gesture can be an arbitrary point between the two hands of the user.
  • the controller 180 since the user moves his or her hands in the positive direction of Z axis, the controller 180 sets up Z’ axis corresponding to Z axis as a virtual axis that corresponds to the user’s gesture. However, if the user moves his or her hands along an arbitrary direction in the three-dimensional space, the controller 180 can set up a virtual axis corresponding to the arbitrary direction and scale up or down the stereoscopic image while moving the stereoscopic image along a virtual axis corresponding to the arbitrary direction.
  • the controller moves the stereoscopic image along the virtual axis based on the direction corresponding to the gesture S230 and scales up or down the stereoscopic image based on the type of the gesture S240.
  • the center of the stereoscopic image and the center of the scaled up or down stereoscopic image can be positioned on the virtual axis.
  • the controller 180 scales up the stereoscopic image; if reducing the stereoscopic image, the controller 180 scales down the stereoscopic image.
  • FIGS. 15 to 20 are examples of an electronic device 100 according to an embodiment of the present invention magnifying stereoscopic images in response to the user’s gesture shown in FIGS. 13 and 14. It should be noted that the coordinate system of FIGS. 15 to 20 in which stereoscopic images are displayed is a virtual coordinate system attached to the display 151 where the stereoscopic image is displayed; and the center of the stereoscopic image corresponds to the center point between both hands of the user.
  • the controller 180 of the electronic device 100 magnifies the sphere by moving the center of the sphere along the positive direction of Z’ axis which corresponds to the gesture.
  • the center S1 of the two hands corresponds to the center S1’ of the sphere SP1 shown in FIG. 15, while the center S2 of the two hands in the configuration of FIG. 14(b) corresponds to the center S2’ of the magnified sphere SP2 shown in FIG. 15 and the center S3 of the two hands in the configuration of FIG. 14(c) the center S3’ of the magnified sphere SP3 shown in FIG. 15.
  • FIG. 16 shows spheres of FIG. 15 viewed from the top of virtual space.
  • the sphere SP1 is inscribed in each of the magnified spheres SP2, SP3 through a single point P1.
  • the controller 180 magnifies the sphere in the positive direction of Z’ axis only, the minimum depth along Z’ axis that the user feels in association to the magnified sphere is kept to be constant, namely the P1 point.
  • the controller 180 of the electronic device 100 magnifies the circular cylinder while moving the center of the circular cylinder in the positive direction of Z’ axis which corresponds to the gesture.
  • the center S1 of the two hands in the configuration of FIG. 14(a) corresponds to the center S1’ of the circular cylinder CC1 shown in FIG. 17, which is the origin of the coordinate system;
  • the center S2 of both hands in the configuration of FIG. 14(b) corresponds to the center S2’ of the magnified circular cylinder CC2 shown in FIG. 17;
  • the center S3 of both hands in the configuration of FIG. 14(c) corresponds to the center S3’ of the magnified circular cylinder CC3 shown in FIG. 17.
  • FIG. 18 shows circular cylinders of FIG. 17 viewed from the top of virtual space.
  • the circular cylinder CC1 is inscribed in each of the magnified circular cylinders CC2, CC3 through a single line L1.
  • the magnified circular cylinders CC2, CC3 is inscribed in each other through another line L2 as well as the line L2.
  • the controller magnifies the circular cylinder in the positive direction of Z axis. Therefore, the minimum depth along Z’ axis that the user feels in association to the magnified circular cylinder is kept to be constant, namely the depth corresponding to the line L1.
  • the controller 180 of the electronic device 100 magnifies the regular hexahedron CB1 while moving the center of the regular hexahedron CB1 in the positive direction of Z’ axis which corresponds to the gesture.
  • the center S1 of both hands corresponds to the center S1’ of the regular hexahedron CB1 shown in FIG. 19, which is the origin of the coordinate system.
  • the center S2 of the two hands corresponds to the center S2’ of the magnified regular hexahedron CB2 shown in FIG. 19.
  • the center S3 of the two hands corresponds to the center S3’ of the magnified regular hexahedron CB3 shown in FIG. 19.
  • FIG. 20 shows regular hexahedrons of FIG. 19 views from the top of virtual space.
  • the regular hexahedron CB1 is inscribed in each of magnified regular hexahedrons CB2, CB3 through a single plane PL1.
  • the regular hexahedron CB2, which is the smaller of the magnified regular hexahedrons CB2, CB3, is inscribed in the larger regular hexahedron CB3 through a larger plane PL2 including the plane PL1.
  • the controller 180 magnifies the regular hexahedron CB1 only in the positive direction of Z’ axis. Therefore, the minimum depth along Z’ axis that the user feels in association to the magnified circular cylinder is kept to be constant, namely the depth corresponding to the plane PL1.
  • the magnification ratio of a stereoscopic image displayed on the display 151 can be changed in proportion to the movement distance of both hands 210, 220 forming the user’s gesture.
  • the controller 180 determines the magnification ratio for the stereoscopic image to be high in proportion to the movement distance of the center point between both hands 210, 220.
  • the magnification ratio for the stereoscopic image can be set high in inverse proportion to the movement distance of the center point between both hands.
  • the controller 180 can magnify the stereoscopic image while moving the center of the stereoscopic image in the negative direction of Z’ axis.
  • the controller 180 can magnify the stereoscopic image while keeping the largest depth of the stereoscopic image to be constant.
  • the controller can magnify the stereoscopic image to be inscribed in the magnified stereoscopic image through at least one point, line, or plane; the above should be easily understood by those skilled in the art based on the description with reference to FIGS. 13 to 20 and further description thereof will be omitted.
  • FIGS. 21 and 22 illustrate another procedure of the electronic device’s recognizing the user’s gesture and setting up a virtual axis along the direction corresponding to the recognized gesture according to the S210 to S220 steps of FIG. 12.
  • the electronic device 100 is a handheld terminal capable of recognizing finger gesture of the user and based on the recognized gesture, scaling a stereoscopic image displayed on the display 151.
  • FIG. 21 illustrates a procedure of the user’s making a gesture for scaling down a stereoscopic image by using a thumb 221 and an index finger 222 while moving his or her right hand 220 in the positive direction of Z axis.
  • FIGS. 21 and 22 assume that the thumb 221 and the index finger 222 of the user’s right hand are endowed with control and the user interface for finger gesture has been activated. It is further assumed that a center point between the thumb 221 and the index finger 222 of the right hand acts as a reference for determining the direction corresponding to the gesture.
  • the distance between the fingers 221, 222 is D3; the user moves his or her hands in the direction of Z axis and approaches the fingers to each other in the direction of X axis. Then the configuration becomes that of FIG. 21(b) and the distance between the fingers 221, 222 becomes D2. In the configuration of FIG. 21(b), the distance between the fingers 221, 222 is D2 and the user moves the fingers 221, 222 in the positive direction of Z axis and approaches the fingers in the direction of X axis.
  • the controller 180 recognizes the positive direction of Z axis as the direction corresponding to the user’s gesture and determines the type of the user’s gesture by approaching the user’s fingers 221, 222 toward each other. Once the direction corresponding to the user’s gesture and the type of the gesture are recognized, the controller 180 can set up the Z axis as a virtual axis corresponding to the gesture.
  • FIG. 22 assumed that middle points S1, S2, S3 between the user’s fingers 221, 222 acts as a criterion to determine the direction of the gesture, the scope of the present invention is not limited to the above assumption.
  • an arbitrary point between the fingers 221, 222 can act as the criterion for determining the direction corresponding to the gesture.
  • FIGS. 23 to 28 illustrate examples of an electronic device 100 according to an embodiment of the present invention scaling down stereoscopic images in response to the user’s gesture.
  • the gesture illustrated in FIGS. 21 and 22, namely, the gesture approaching the fingers 221, 222 toward each other while moving the fingers 221, 222 along Z axis indicates reducing the stereoscopic image
  • examples of scaling down the stereoscopic image will be described.
  • the coordinate system of FIGS. 23 to 28 in which stereoscopic images are displayed is a virtual coordinate system where stereoscopic images are displayed on the display 151; and the center of the stereoscopic images corresponds to the center point between the user’s fingers 221, 222.
  • the controller 180 of the electronic device 100 reduces the sphere while moving the center of the sphere in the positive direction of Z’ axis which is the direction corresponding to the gesture.
  • the center S1 of the fingers 221, 222 in the configuration of FIG. 21(a) corresponds to the center S1’ of the sphere SP1 illustrated in FIG. 23, which is the origin of the coordinate system;
  • the center S2 of the fingers 221, 222 in the configuration of FIG. 21(b) corresponds to the center S2’ of the scaled-down sphere SP2 illustrated in FIG. 23;
  • the center S3 of the fingers 221, 222 in the configuration of FIG. 21(c) corresponds to the center S3’ of the scaled-down sphere SP3 illustrated in FIG. 23.
  • FIG. 24 illustrates spheres of FIG. 23 viewed from the top of virtual space.
  • reduced spheres SP2, SP3 are inscribed in the sphere SP1 through a single point P1.
  • the smaller SP3 of the reduced spheres SP2, SP3 is also inscribed in the sphere SP1 and the larger SP2 of the two reduced spheres.
  • the controller 180 reduces the sphere by moving the sphere in the positive direction of Z’ axis while keeping the maximum depth to be the depth of the point P1.
  • the controller 180 of the electronic device 100 reduces the circular cylinder while moving the center of the circular cylinder in the positive direction of Z axis which is the direction corresponding to the gesture.
  • the center S1 of the fingers 221, 222 in the configuration of FIG. 21(a) corresponds to the center S1’ of the circular cylinder CC1 illustrated in FIG. 25, which is the origin of the coordinate system;
  • the center S2 of the fingers 221, 222 in the configuration of FIG. 21(b) corresponds to the center S2’ of the magnified circular cylinder CC2 illustrated in FIG. 25;
  • the center S3 of the fingers 221, 222 in the configuration of FIG. 21(c) corresponds to the center S3’ of the magnified circular cylinder CC3 illustrated in FIG. 25.
  • FIG. 26 illustrates circular cylinders of FIG. 25 viewed from the top of virtual space.
  • the circular cylinder CC1 is inscribed in the magnified spheres CC2, CC3 through a line L1’ or L2’. It can be known that the smaller CC3 of the magnified circular cylinders CC2, CC3 is inscribed in the larger circular cylinder CC2 through another line L1’.
  • the controller 180 can reduce the circular cylinders by taking account of the direction corresponding to the user’s gesture and reduce the circular cylinder based on a particular depth associated with the direction. Therefore, the user’s impression on the maximum depth of a reduced circular cylinder along Z’ axis is kept to be constant as the depth including a particular line L1 or L2.
  • the controller 180 of the electronic device 100 reduces the regular hexahedron CB1 while moving the center of the regular hexahedron CB1 in the positive direction of Z’ axis which is the direction corresponding to the gesture.
  • the center S1 of the fingers 221, 222 in the configuration of FIG. 21(a) corresponds to the center S1’ of the regular hexahedron CB1 illustrated in FIG. 27, which is the origin of the coordinate system;
  • the center S2 of the fingers 221, 222 in the configuration of FIG. 21(b) corresponds to the center S2’ of the reduced regular hexahedron CB2 illustrated in FIG. 27;
  • the center S3 of the fingers 221, 222 in the configuration of FIG. 21(c) corresponds to the center S3’ of the reduced regular hexahedron CB3 illustrated in FIG. 27.
  • FIG. 28 illustrates regular hexahedrons of FIG. 27 viewed from the top of virtual space.
  • the regular hexahedron CB1 is inscribed in the magnified regular hexahedrons CB2, CB3 through a plane PL1’.
  • the controller 180 reduces a regular hexahedron CB1 along the positive direction of Z’ axis. Therefore, it can be known that the user’s impression on the maximum depth of a reduced regular hexahedron along Z’ axis is kept to be constant as the depth including the plane PL1.
  • the reduction ratio of a stereoscopic image displayed on the display 151 can be changed in proportion to the movement distance of both hands 210, 220 generating the user’s gesture.
  • the controller 180 sets the reduction ratio for the stereoscopic image to be large in proportion to the movement distance of the center point between both hands 210, 220.
  • the controller 180 can also set the reduction ratio for the stereoscopic image to be large in inverse proportion to the movement distance of the center point between both hands.
  • the controller 180 can reduce the stereoscopic image while moving the center of the stereoscopic image in the negative direction of Z’ axis.
  • the controller 180 can reduce the stereoscopic image while keeping the minimal depth to be the minimal depth of the stereoscopic image.
  • the controller 180 can reduce the stereoscopic image in such a way that the reduced stereoscopic image is inscribed in the stereoscopic image through a single point, line, or plane. This property can be easily derived by those skilled in the art based on the description provided with respect to FIGS. 21 to 28; therefore, a detailed description thereof will be omitted.
  • FIG. 29 is a flow diagram illustrating a method for displaying stereoscopic images of an electronic device 100 according to another embodiment of the present invention.
  • a method for displaying stereoscopic images of the electronic device 100 will be described with reference to associated drawings.
  • the controller 180 of the electronic device 100 displays stereoscopic images and obtains the image of the user through the camera 121 and recognizes the user’s gesture by analyzing the image of the user S310. Once the user’s gesture is recognized, the controller 180 sets up a virtual axis based on the direction corresponding to the gesture recognized S310.
  • the controller 180 When the virtual axis is set up based on the gesture recognized, the controller 180 performs scaling of the stereoscopic images S330 while moving the stereoscopic images along the virtual axis S320. In other words, the controller 180 can scale up or down the stereoscopic images based on the type of the gesture recognized while moving the center of the stereoscopic image along the virtual axis along the direction corresponding to the gesture recognized.
  • the controller 180 determines S340 whether it is necessary to change a scale factor of the stereoscopic image scaled based on the type of the recognized gesture in proportion to the depth along the direction of the virtual axis. If changing the scale factor of the scaled stereoscopic image is found to be required, the controller 180 can change the scale factor of the scaled stereoscopic image in proportion to the depth along the virtual axis. If not, however, the controller 180 leaves the scaled stereoscopic image intact, displaying the scaled stereoscopic image on the display 151, S360.
  • the controller 180 first performs scaling of the stereoscopic image and changes the scale factor of the scaled stereoscopic image in proportion to the depth along the virtual axis.
  • the controller 180 without carrying out the scaling of the stereoscopic image, can apply a scale factor to the stereoscopic image, the scale factor being determined in proportion to the depth along the virtual axis.
  • FIG. 30 is one example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 29.
  • the user’s right hand 220 is endowed with control; the direction corresponding to the user’s gesture is recognized based on the direction of the right hand 220; and the type of the user’s gesture is determined by the shape of the right hand.
  • FIGS. 33, 36, and 39 which will be described later.
  • the user moves his or her right hand 220 with fingers of the right hand 220 spread in the positive direction of Z axis.
  • the controller 180 can then set up a virtual Z’ axis as the virtual axis based on the user’s gesture.
  • the controller 180 since the user moves his or her right hand 220 in the positive direction of Z axis, the controller 180 sets up the Z’ axis corresponding to Z axis as a virtual axis which corresponds to the user’s gesture. However, if the user moves his or her right hand 220 in an arbitrary direction of the three-dimensional space, the controller 180 can establish a virtual axis which corresponds to the arbitrary direction. This property can be applied the same to FIGS. 33, 36, and 39, which will be described later.
  • FIGS. 31 and 32 are examples of an electronic device’s 100 controller 180 displaying stereoscopic images based on the user’s gesture shown in FIG. 30.
  • the coordinate system based on which stereoscopic images of FIGS. 31 and 32 are displayed is a virtual coordinate system where the stereoscopic images are displayed on the display 151; and the center of the stereoscopic image corresponds to the position of the user’s right hand 220. This setting will be applied the same to FIGS. 34 to 35, FIGS. 37 to 38, and FIGS. 40 to 41, which will be described later.
  • the controller 180 of the electronic device 100 moves the center of the circular cylinder in the positive direction of Z axis which is the direction corresponding to the user’s gesture and increase the scale factor in proportion to the depth along the direction of Z axis.
  • the controller 180 sets the scale factor to be 1 for the depth along Z’ axis which corresponds to one plane PL1 of the circular cylinder CC1, while the scale factor of the plane corresponding to the point where the depth in the positive direction of Z’ axis is D1 is set to be smaller than that of the plane corresponding to the point where the depth in the direction of Z’ axis is D2.
  • the controller 180 in response to the user’s gesture, scales the circular cylinder CC1 to be a three-dimensional object close to a cone CC2’.
  • the circular cylinder CC1 is inscribed in the three-dimensional object CC2’ scaled through a particular plane PL1.
  • the position S1 of the right hand 220 in the configuration of (a) in FIG. 30 corresponds to the center S1’ of the circular cylinder CC1 illustrated in FIG. 32, which is the origin of the coordinate system, while the position S2 of the right hand 220 in the configuration of (b) in FIG. 30 corresponds to the center S2’ of the scaled figure CB2’ illustrated in FIG. 32.
  • This feature can also be applied to FIGS. 35, 38, and 41, which will be described later.
  • controller 180 sets up the scale factor of the regular hexahedron CB1 in proportion to the depth in the positive direction of Z’ axis in response to the user’s gesture shown in FIG. 30, the controller 180 can magnify or reduce the circular cylinder CC1 while keeping the shape thereof. This feature can also be applied to FIGS. 35, 38, and 41, which will be described later.
  • FIG. 33 is another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 29.
  • the user moves his or her right hand 220 in the positive direction of Z axis while closing the user’s right hand 220.
  • the controller 180 then can set up a virtual Z’ axis as the virtual axis based on the user’s gesture.
  • FIGS. 34 and 35 are examples of an electronic device’s 100 controller 180 displaying stereoscopic images based on the user’s gesture shown in FIG. 33.
  • the controller 180 of the electronic device 100 moves the center of the circular cylinder in the positive direction of Z’ axis which corresponds to the gesture and reduces the scale factor as the depth along Z’ axis increases.
  • the controller 180 sets the scale factor to be 1 for the depth along Z’ axis which corresponds to one plane PL1 of the circular cylinder CC1, while the scale factor is gradually reduced to have a value smaller than 1 in proportion to the depth in the positive direction of Z’ axis. Also, it can be known that the circular cylinder CC1 is inscribed in the scaled three-dimensional object CC2’ through the particular plane PL1.
  • the controller 180 of the electronic device 100 moves the center of the regular hexahedron CB1 in the positive direction of Z’ axis which corresponds to the gesture and reduces the scale factor in proportion to the depth along Z’ axis.
  • the controller 180 sets the scale factor to be 1 for the plane located at the distance corresponding to one plane PL1 of the regular hexahedron CB1 and reduces the scale factor in proportion to the depth in the positive direction of Z’ axis. Also, it can be known that the regular hexahedron CB1 is inscribed in the scaled three-dimensional object CB2’ through the particular plane PL1.
  • FIG. 36 is yet another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 29.
  • the user moves his or her right hand 220 backward in the negative direction of Z axis while spreading the user’s right hand 220.
  • the controller 180 then can set up the virtual Z’ axis as a virtual axis based on the user’s gesture.
  • FIGS. 37 and 38 are examples of an electronic device’s 100 controller 180 displaying stereoscopic images based on the user’s gesture shown in FIG. 33.
  • the controller 180 of the electronic device 100 moves the center of the circular cylinder CC1 in the negative direction of Z’ axis which is the direction corresponding to the gesture and reduces the scale factor in proportion to the depth in the positive direction of Z’ axis.
  • the controller 180 gradually reduces the scale factor in proportion to the depth in the positive direction of Z’ axis and sets the scale factor to be 1 for the depth where the depth along Z’ axis corresponds to one plane PL1 of the circular cylinder CC1. Also, it can be known that the circular cylinder CC1 is inscribed in a scaled three-dimensional object CC2’ through the particular plane PL1.
  • the controller 180 of the electronic device 100 moves the center of the regular hexahedron CB1 in the negative direction of Z’ axis which corresponds to the gesture and reduces the scale factor in proportion to the depth in the positive direction of Z’ axis.
  • the controller 180 reduces the scale factor in proportion to the depth in the positive direction of Z’ axis and sets the scale factor to be 1 for the location where the depth along the Z’ axis corresponds to one plane PL1 of the regular hexahedron CB1. Also, it can be known that the regular hexahedron CB1 is inscribed in a scaled three-dimensional object CB2’ through the particular plane PL1.
  • FIG. 39 is still another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 29.
  • the user moves his or her right hand 220 in the negative direction of Z axis while closing the user’s right hand 220.
  • the controller 180 then can set up a virtual Z’ axis as the virtual axis based on the user’s gesture.
  • FIGS. 40 and 41 are examples of an electronic device’s controller displaying stereoscopic images based on the user’s gesture shown in FIG. 39.
  • the controller 180 of the electronic device 100 moves the center of the circular cylinder in the negative direction of Z’ axis which corresponds to the gesture and increases the scale factor in proportion to the depth in the positive direction of Z’ axis.
  • the controller 180 gradually increases the scale factor in proportion to the depth in the positive direction of Z’ axis and sets the scale factor to be 1 for the location where the depth on the Z’ axis corresponds to one plane PL1 of the circular cylinder CC1. Also, it can be known that the circular cylinder CC1 is inscribed in a scaled three-dimensional object CC2’ through the particular plane PL1.
  • the controller 180 of the electronic device 100 moves the center of the regular hexahedron CB1 in the negative direction of Z’ axis which corresponds to the gesture and increases the scale factor in proportion to the depth in the positive direction of Z’ axis.
  • the controller 180 gradually increase the scale factor in proportion to the depth in the positive direction of Z’ axis and sets the scale factor to be 1 for the location where the depth on the Z’ axis corresponds to the depth corresponding to one plane PL1 of the regular hexahedron CB1. Also, it can be known that the regular hexahedron CB1 is inscribed in a scaled three-dimensional object CB2’ through the particular plane PL1.
  • the controller 180 of the electronic device 100 analyzes the obtained image and identifies positions of the middle point between both hands of the user at a first time and a second time, respectively.
  • the first time is the starting time point for the controller 180 to recognize a gesture of the user
  • the second time is the ending time point to recognize a gesture of the user.
  • the controller 180 matches the middle point between both hands at the first time to the middle point in the stereoscopic image displayed on the display 151, S420 and sets a virtual line connecting the middle point of the stereoscopic image and a virtual point corresponding to the middle point between both hands at the second time S430.
  • the controller 180 can magnify the stereoscopic image as the distance between both hands is increased, while reducing the stereoscopic image as the distance between the two hands is decreased.
  • the scope of the present invention is not limited to the above description. The above feature can also be applied to FIG. 43 which will be described below.
  • a method for the controller 180 setting a virtual line as a virtual axis, the virtual line connecting a virtual point corresponding to the middle point between both hands of the user at the first time and a virtual point corresponding to the middle point between both hands of the user at the second time.
  • the controller 180 can set a virtual line as a virtual axis, the virtual line connecting a first virtual point corresponding to a specific point between a first and a second body part of the user at a first time and a second virtual point corresponding to a specific point between the first and the second body part of the user at a second time.
  • This feature can also be applied to a method for setting a virtual axis shown in FIG. 43 which will be described below.
  • the controller 180 can set a virtual line as the virtual axis, the virtual line connecting a first virtual point corresponding to the position of a particular body part of the user at a first time and a second virtual point corresponding to the position of the particular body part at a second time.
  • FIG. 43 is a flow diagram illustrating another example of setting up a virtual axis of an electronic device 100 according to the present invention.
  • a method for setting the virtual axis will be described with reference to related drawings.
  • the controller 180 of the electronic device 100 analyzes the obtained image and identifies positions of the middle point between both hands of the user at a first and a second time S510.
  • the controller 180 sets up a Cartesian coordinate system which employs the middle point between the two hands at the first time as the origin S520 and among reference axes of the Cartesian coordinate system, obtains a reference axis closest to the middle point between the two hands at a second time S530.
  • the controller 180 set a virtual reference axis which corresponds to the obtained reference axis as a virtual axis S540.
  • the controller 180 can set up the virtual axis based on a first virtual point corresponding to a specific point between a first and a second body part of the user at a first time and a second virtual point corresponding to a specific point between the first and the second body part of the user at a second time.
  • the controller 180 can set up a virtual reference axis as the virtual axis, the virtual reference axis corresponding to a reference axis closest to the position of a particular body part at a second time from among reference axes of the Cartesian coordinate system which employs the particular body part of the user at a first time as the origin.
  • FIG. 44 illustrates a method for setting up a virtual axis shown in FIG. 43. It should be noted that in FIG. 44, S1 represents the position of the middle point between both hands of the user at a first time, while S2 at a second time.
  • the controller 180 of the electronic device 100 sets up a Cartesian coordinate system which employs the middle point between both hands at the first time as the origin and calculates distance (DX, DY, and DZ) from the position of the middle point between both hands to the reference axes of the Cartesian coordinate system.
  • the controller 180 can obtain, among reference axes (X, Y, and Z) of the Cartesian coordinate system, a reference axis closest to the middle point between both hands at the second time and set up a virtual reference axis corresponding to the obtained reference axis as a virtual axis for scaling stereoscopic images.
  • FIG. 45 is a flow diagram illustrating a method for displaying stereoscopic images of an electronic device 100 according to yet another embodiment of the present invention.
  • a method for displaying the stereoscopic images will be described.
  • the controller 180 of the electronic device 100 displays a stereoscopic image S600.
  • the controller 180 obtains an image of the user of the electronic device through the camera 121, S610.
  • the controller 180 recognizes the user’s gesture by analyzing the image of the user and sets up a virtual axis based on the direction corresponding to the recognized gesture S620. Once the virtual axis is set up, the controller 180 changes the scale factor of the stereoscopic image according to the depth in the direction of the virtual axis S630.
  • FIG. 46 is one example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 45.
  • the user’s right hand 220 is endowed with control and the direction corresponding to the user’s gesture is recognized based on the direction of the right hand 200 and the type of the user’s gesture is determined by the shape of the right hand.
  • FIG. 48 which will be described later.
  • the controller 180 can then set up a virtual Z’ axis as a virtual axis based on the user’s gesture. As shown in FIG. 46, if the user moves his or her right hand 220 in an arbitrary direction in the three-dimensional space, the controller 180 can sets up a virtual axis corresponding to the arbitrary direction.
  • FIG. 47 is an example of an electronic device’s 100 controller 180 displaying stereoscopic images based on the user’s gesture shown in FIG. 46.
  • the stereoscopic image shown in FIG. 47 can be a stereoscopic image obtained through a wide angle lens camera.
  • the controller 180 of the electronic device 100 increases the scale factor of a stereoscopic image in proportion to the depth in the direction of Z’ axis.
  • the controller 180 set up the scale factor where the stereoscopic image shows the smallest depth in the direction of Z’ axis to be 1. Therefore, it can be known that the width of a road at the part where the depth along Z’ axis reveals the smallest value in FIG. 47(a) and (b) is unchanged at D1.
  • the controller 180 gradually increases the scale factor in proportion to the depth along Z’ axis in the stereoscopic image. Therefore, it can be known that the width of the road at the part where the depth along Z’ axis reveals the largest value in FIG. 47(a) and (b) has been increased from D2 to D2’. Also, it can be known that among the buildings 10, 11 displayed in the stereoscopic image, the size 11 of the building which has a larger depth along Z’ axis has been enlarged to the degree noticeable to the eye.
  • FIG. 48 is another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 45.
  • the controller 180 can set up a virtual Z’ axis as a virtual axis based on the user’s gesture. Different from as shown in FIG. 48, if the user moves his or her right hand 220 in an arbitrary direction in the three-dimensional space, the controller 180 can set up a virtual axis corresponding to the arbitrary axis.
  • FIG. 49 is an example of an electronic device’s 100 controller 180 displaying stereoscopic images based on the user’s gesture shown in FIG. 48.
  • the controller 180 of the electronic device 100 decreases the scale factor of a stereoscopic image in proportion to the depth along Z’ axis.
  • the controller 180 sets the scale factor at the part where the depth along Z’ axis of the stereoscopic image shows the smallest value to be 1 and gradually increases the scale factor of the stereoscopic image in proportion to the depth along Z’ axis. Therefore, it can be known that the width of a road at the part where the depth reveals the largest depth in FIG. 49(a) and (b) has been narrowed from D2 to D2’. Also, it can be known that from among the buildings 10, 11 displayed on the stereoscopic image, the size of the building 11 which reveals a larger depth along Z’ axis has been reduced further.
  • FIG. 50 is yet another example of the user’s gesture for changing a scale factor of stereoscopic images in proportion to the depth along a virtual axis according to a method for displaying stereoscopic images of an electronic device 100 shown in FIG. 45.
  • the controller 180 can set up a virtual Z’ axis as a virtual axis based on the user’s gesture. Different from as shown in FIG. 50, if the user moves his or her right hand 220 in an arbitrary direction in the three-dimensional space, the controller 180 can set up a virtual axis corresponding to the arbitrary axis.
  • FIG. 51 is an example of an electronic device’s 100 controller 180 displaying stereoscopic images based on the user’s gesture shown in FIG. 50.
  • the controller 180 of the electronic device 100 reduces the scale factor of a stereoscopic image in proportion to the depth along Z’ axis.
  • the controller 180 increases the scale factor at the plane where the depth along Z’ axis in the stereoscopic image shows the smallest depth to be larger than 1. Therefore, it can be known that the width of a road corresponding to plane with the smallest depth along Z’ axis has been wider from D1 to D1’ and the size of a building adjacent to the plane has also been increased.
  • the controller 180 gradually increases the scale factor of the stereoscopic image in proportion to the depth in the positive direction of Z’ axis. Accordingly, the width of the road at the part which shows the deepest depth along Z’ axis in FIG. 51(a) and (b) has been narrowed further from D2 to D2’. Also, among the buildings 10, 11 displayed on the stereoscopic image, the size of the building 11 which reveals a larger depth has been reduced further.
  • Each of the methods for an electronic device’s displaying stereoscopic images according to the present invention described above can be recorded in a computer readable recording medium in the form of a program which can be executed through various computing means.
  • the computer readable medium can comprise program commands, a data file, and data structure individually or in a combination thereof. Programs recorded in the medium can correspond to those designed or composed especially for the present invention or those already available to those skilled in the art of computer software.
  • Examples of a computer readable recording medium comprise a hard disk; a floppy disk; a magnetic medium such as a magnetic tape; optical media such as CD-ROM and DVD; a magneto-optical medium such as a floptical disk; and hardware apparatus such as ROM, RAM, and flash memory specially designed to store and carry out program commands.
  • Examples of a program comprise high-level language codes that can be executed through an interpreter as well as assembly codes generated by a compiler.
  • the hardware apparatus can be designed to operate as one or more software modules to carry out the operations of the present invention and vice versa.
  • the electronic device and the method of displaying a stereoscopic image may magnify or reduce the size of the stereoscopic image in proportion to depth.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'invention porte sur un dispositif électronique. Le dispositif électronique peut comprendre un dispositif d'affichage et un dispositif de commande. Le dispositif d'affichage peut afficher des images stéréoscopiques. Le dispositif de commande peut mettre à l'échelle l'image stéréoscopique tout en déplaçant l'image stéréoscopique le long d'un axe virtuel. A ce moment, le dispositif de commande peut modifier le facteur d'échelle de l'image stéréoscopique mise à l'échelle proportionnellement à la profondeur dans la direction de l'axe virtuel.
PCT/KR2011/002567 2011-04-12 2011-04-12 Dispositif électronique et procédé d'affichage d'image stéréoscopique WO2012141350A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2011/002567 WO2012141350A1 (fr) 2011-04-12 2011-04-12 Dispositif électronique et procédé d'affichage d'image stéréoscopique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2011/002567 WO2012141350A1 (fr) 2011-04-12 2011-04-12 Dispositif électronique et procédé d'affichage d'image stéréoscopique

Publications (1)

Publication Number Publication Date
WO2012141350A1 true WO2012141350A1 (fr) 2012-10-18

Family

ID=47009500

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2011/002567 WO2012141350A1 (fr) 2011-04-12 2011-04-12 Dispositif électronique et procédé d'affichage d'image stéréoscopique

Country Status (1)

Country Link
WO (1) WO2012141350A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130009891A1 (en) * 2011-07-04 2013-01-10 Canon Kabushiki Kaisha Image processing apparatus and control method thereof
EP2916209A1 (fr) * 2014-03-03 2015-09-09 Nokia Technologies OY Axe d'entrée entre appareil et appareil séparé

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090228841A1 (en) * 2008-03-04 2009-09-10 Gesture Tek, Inc. Enhanced Gesture-Based Image Manipulation
US20100060576A1 (en) * 2006-02-08 2010-03-11 Oblong Industries, Inc. Control System for Navigating a Principal Dimension of a Data Space
US20100171697A1 (en) * 2009-01-07 2010-07-08 Hyeonho Son Method of controlling view of stereoscopic image and stereoscopic image display using the same
US20110012896A1 (en) * 2009-06-22 2011-01-20 Ji Maengsob Image display apparatus, 3d glasses, and method for operating the image display apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100060576A1 (en) * 2006-02-08 2010-03-11 Oblong Industries, Inc. Control System for Navigating a Principal Dimension of a Data Space
US20090228841A1 (en) * 2008-03-04 2009-09-10 Gesture Tek, Inc. Enhanced Gesture-Based Image Manipulation
US20100171697A1 (en) * 2009-01-07 2010-07-08 Hyeonho Son Method of controlling view of stereoscopic image and stereoscopic image display using the same
US20110012896A1 (en) * 2009-06-22 2011-01-20 Ji Maengsob Image display apparatus, 3d glasses, and method for operating the image display apparatus

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130009891A1 (en) * 2011-07-04 2013-01-10 Canon Kabushiki Kaisha Image processing apparatus and control method thereof
EP2916209A1 (fr) * 2014-03-03 2015-09-09 Nokia Technologies OY Axe d'entrée entre appareil et appareil séparé
WO2015132461A1 (fr) * 2014-03-03 2015-09-11 Nokia Technologies Oy Axe d'entrée entre un appareil et un appareil séparé
US10732720B2 (en) 2014-03-03 2020-08-04 Nokia Technologies Oy Input axis between an apparatus and a separate apparatus

Similar Documents

Publication Publication Date Title
WO2015053449A1 (fr) Dispositif d'affichage d'image de type lunettes et son procédé de commande
WO2016024746A1 (fr) Terminal mobile
WO2015190666A1 (fr) Terminal mobile et son procédé de commande
WO2012144666A1 (fr) Dispositif d'affichage et procédé de commande associé
EP3466041A1 (fr) Dispositif mobile et procédé de commande correspondant
EP3311557A1 (fr) Terminal mobile et son procédé de commande
EP3717992A1 (fr) Dispositif de fourniture de service de réalité augmentée et son procédé de fonctionnement
WO2018117349A1 (fr) Terminal mobile et procédé de commande associé
WO2015130053A2 (fr) Terminal mobile et son procédé de commande
WO2015133701A1 (fr) Terminal mobile et son procédé de commande
WO2015026030A1 (fr) Dispositif d'affichage et son procédé de commande
WO2015178520A1 (fr) Terminal mobile et son procédé de commande
WO2012128399A1 (fr) Dispositif d'affichage et procédé de commande associé
WO2017007090A1 (fr) Dispositif d'affichage et son procédé de commande
WO2018048092A1 (fr) Visiocasque et son procédé de commande
EP2982042A1 (fr) Terminal et son procédé de commande
WO2017171412A2 (fr) Appareil de traitement d'image, et terminal mobile
WO2015174611A1 (fr) Terminal mobile et son procédé de commande
WO2014065595A1 (fr) Dispositif d'affichage d'image et procédé de commande associé
WO2016200005A1 (fr) Terminal mobile et procédé d'utilisation de son affichage
WO2017094984A1 (fr) Terminal mobile, et procédé de commande correspondant
WO2017126709A1 (fr) Terminal mobile et procédé de commande associé
WO2018128227A1 (fr) Terminal mobile
WO2016035920A1 (fr) Terminal mobile et son procédé de commande
WO2013015466A1 (fr) Dispositif électronique pour affichage d'image tridimensionnelle et son procédé d'utilisation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11863681

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11863681

Country of ref document: EP

Kind code of ref document: A1