WO2012161076A1 - 表示装置および方法、並びにプログラム - Google Patents
表示装置および方法、並びにプログラム Download PDFInfo
- Publication number
- WO2012161076A1 WO2012161076A1 PCT/JP2012/062637 JP2012062637W WO2012161076A1 WO 2012161076 A1 WO2012161076 A1 WO 2012161076A1 JP 2012062637 W JP2012062637 W JP 2012062637W WO 2012161076 A1 WO2012161076 A1 WO 2012161076A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pixel
- parallax
- image
- channel
- user
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
- H04N13/312—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being placed behind the display panel, e.g. between backlight and spatial light modulator [SLM]
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
- H04N13/315—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being time-variant
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/324—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/373—Image reproducers using viewer tracking for tracking forward-backward translational head movements, i.e. longitudinal movements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/08—Volume rendering
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0209—Crosstalk reduction, i.e. to reduce direct or indirect influences of signals directed to a certain pixel of the displayed image on other pixels of said image, inclusive of influences affecting pixels in different frames or fields or sub-images which constitute a same image, e.g. left and right images of a stereoscopic display
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/14—Display of multiple viewports
Definitions
- the present technology relates to a display device, a method, and a program, and more particularly, to a display device, a method, and a program for performing stereoscopic display of an image by a naked eye method using a parallax separation unit such as a parallax barrier.
- a glasses method using stereoscopic glasses and a naked-eye method that enables stereoscopic viewing with no naked eyes without using special glasses for stereoscopic viewing.
- a shutter spectacle method using shutter spectacles having a left eye shutter and a right eye shutter there is a shutter spectacle method using shutter spectacles having a left eye shutter and a right eye shutter.
- the left-eye and right-eye parallax images are alternately displayed on the two-dimensional display panel at a high frame sequential speed.
- the left-eye shutter and the right-eye shutter are alternately switched in accordance with the display timing of each parallax image, so that the left-eye parallax image for the observer's left eye and the right-eye parallax for the right eye Only the image is incident, and stereoscopic viewing of the image becomes possible.
- typical examples of the naked eye method include a parallax barrier method and a lenticular method.
- a parallax image for stereoscopic viewing (a parallax image for the right eye and a parallax image for the left eye in the case of two viewpoints) is displayed in a space-divided manner on the two-dimensional display panel.
- the image is separated in the horizontal direction by the parallax separation unit to realize stereoscopic viewing.
- a parallax barrier provided with a slit-shaped opening is used as a parallax separation unit
- a lenticular lens in which a plurality of cylindrical divided lenses are arranged in parallel is used as a parallax separation unit. It is done.
- the present technology has been made in view of such a situation, and makes it possible to present a high-quality stereoscopic image more easily.
- a display device includes a display unit in which a plurality of block regions each including pixels of a plurality of channels of three or more are provided, and a separation unit that separates an image displayed on each channel pixel in the block region And a parallax image is displayed in a first area consisting of a plurality of pixels adjacent to each other in the block area, and pixels of two or more different channels, according to the viewpoint position of the user observing the display unit, A plurality of parallax images for each channel pixel in the block area so that the parallax image and other parallax images having parallax are displayed in a second area different from the first area in the block area.
- An allocation control unit that allocates any one of the above, and a generation unit that synthesizes a plurality of parallax images according to the allocation by the allocation control unit and generates a composite image.
- the plurality of parallax images may be the right-eye parallax image and the left-eye parallax image.
- the allocation control unit includes a viewing position calculation unit that obtains a viewing position on a viewing pixel in the block region observed by the user for each block region based on the viewpoint position, and the viewing position includes the viewing position.
- the position of the block area that is substantially the center of the visual pixel is calculated as a boundary position, and the block area between the boundary position and another boundary position closest to the boundary position is calculated for the block area.
- a boundary position calculation unit that assigns the same parallax image to pixels of the same channel in the block region can be provided.
- the channel of the visual pixel of the block area at the boundary position, and the other boundary position can be assigned to the pixel of the same channel as the channel of the visible pixel in the block area.
- an intermediate position between the boundary position calculated with reference to the user's right eye and the boundary position calculated with reference to the user's left eye is determined as the final boundary. Position.
- the allocation control unit includes the boundary position calculated with reference to the user's right eye and the boundary position calculated with reference to the user's left eye as the target area.
- a blend ratio calculation unit that calculates a blend ratio based on a pixel position in the target region is further provided, and the generation unit includes both the left and right in the target region.
- the pixel of the composite image displayed on the pixel observed by the eye of the right eye can be generated by blending the parallax image for the right eye and the parallax image for the left eye at the blend ratio. .
- the allocation control unit can cause the display unit to display either the parallax image for the right eye or the left eye when the viewpoint position is outside a predetermined region. .
- a display method or program includes a plurality of pixels adjacent to each other in a block region according to a viewpoint position of a user observing the display unit, and a first method including pixels of two or more different channels.
- Each parallax image in the block area is displayed such that a parallax image is displayed in the area and another parallax image having parallax with the parallax image is displayed in a second area different from the first area in the block area.
- a parallax image is formed in a first area including pixels of two or more different channels in a block area, which are adjacent to each other in a block area, according to a viewpoint position of a user observing the display unit. Is displayed on the pixel of each channel in the block area so that the parallax image and another parallax image having parallax are displayed in a second area different from the first area in the block area. Any of a plurality of parallax images is assigned, and a plurality of parallax images are synthesized according to the assignment, and a synthesized image is generated.
- a high-quality stereoscopic image can be presented more easily.
- FIG. 1 is a diagram illustrating a configuration example of an embodiment of a display device to which the present technology is applied.
- the display device 11 is a display device that stereoscopically displays a subject using parallax images from a plurality of viewpoints.
- the display device 11 includes an imaging unit 21, a detection unit 22, an assignment control unit 23, a recording unit 24, a generation unit 25, a display control unit 26, and a display unit 27.
- the imaging unit 21 captures and detects an image of a user around the display device 11, for example, an image of a user observing an image displayed on the display unit 27 (hereinafter referred to as a peripheral image) from almost the front of the display unit 27. Supplied to the unit 22.
- the detection unit 22 detects the user's eyes from the peripheral image supplied from the imaging unit 21 and supplies the detection result to the assignment control unit 23.
- the detection unit 22 includes a viewpoint position calculation unit 31, and the viewpoint position calculation unit 31 calculates a user's viewpoint position with respect to the display unit 27 based on the peripheral image and supplies the calculated position to the assignment control unit 23.
- the allocation control unit 23 allocates a plurality of parallax images to each region on the display surface of the display unit 27 based on the detection result from the detection unit 22 and the viewpoint position of the user.
- the allocation control unit 23 includes a determination unit 32, a visual position calculation unit 33, and a boundary position calculation unit 34.
- the determination unit 32 determines whether or not stereoscopic display (3D display) of a subject using a plurality of parallax images is possible, and the allocation control unit 23 determines whether or not the subject is stereoscopically displayed. Image generation in the generation unit 25 is controlled.
- the visual recognition position calculation unit 33 calculates the position in the pixel on the display surface of the display unit 27 visually recognized by the user as the visual recognition position based on the viewpoint position from the detection unit 22.
- the boundary position calculation unit 34 assigns a plurality of parallax images to each region on the display surface of the display unit 27 based on the visual recognition position.
- the recording unit 24 records a plurality of parallax images constituting a stereoscopic image, and supplies the parallax images to the generation unit 25 as necessary.
- the generation unit 25 Based on the parallax image from the recording unit 24, the generation unit 25 generates a synthesized image obtained by spatially dividing these parallax images and supplies the synthesized image to the display control unit 26 under the control of the allocation control unit 23.
- the generation unit 25 supplies any of the parallax images from the recording unit 24 to the display control unit 26 as it is under the control of the allocation control unit 23.
- the display control unit 26 supplies the composite image from the generation unit 25 to the display unit 27 to display the stereoscopic image of the subject on the parallax image, or supplies the parallax image from the generation unit 25 to the display unit 27.
- the display unit 27 includes a liquid crystal display panel that can display a stereoscopic image by the naked eye method, and displays a composite image or a parallax image supplied from the display control unit 26.
- [Configuration example of display unit] 1 is configured as shown in FIG. 2, for example.
- the display unit 27 includes a backlight 61, a light modulation panel 62, and a barrier element 63.
- the backlight 61 includes, for example, an LED (Light Emitting Diode) light source, a light guide plate, and the like, emits light for displaying an image, and enters the light modulation panel 62.
- LED Light Emitting Diode
- the light modulation panel 62 is made of, for example, a liquid crystal layer or color filters of R, G, and B colors, and transmits light incident from the backlight 61 to display an image. At this time, the light modulation panel 62 performs gradation display of each pixel of the image by changing the light transmittance for each pixel provided in the light modulation panel 62.
- the light modulation panel 62 includes a transparent substrate 71, a transparent substrate 72, and a liquid crystal layer 73.
- the liquid crystal layer 73 is a flat transparent substrate 71 and a transparent substrate that are disposed so as to face each other. 72 is formed.
- the liquid crystal layer 73 is provided with a transmissive portion as a pixel for displaying an image.
- the barrier element 63 includes a polarizing plate, a switch liquid crystal layer, and the like.
- the barrier element 63 optically separates the parallax images by blocking a part of the light incident from the light modulation panel 62 and transmitting the remaining part.
- the barrier element 63 includes a transparent substrate 74, a transparent substrate 75, and a switch liquid crystal layer 76, and the switch liquid crystal layer 76 is disposed between the flat transparent substrate 74 and the transparent substrate 75 arranged so as to face each other. Is formed.
- Electrodes are formed on the transparent substrate 74 and the transparent substrate 75, and when a voltage is applied to some or all of these electrodes, the orientation direction of the liquid crystal molecules in the switch liquid crystal layer 76 changes, thereby A parallax barrier is formed in the switch liquid crystal layer 76.
- the openings 81-1 to 81-3 that transmit the light incident from the light modulation panel 62 and the shielding portions 82-1 to 82-3 that shield the light incident from the light modulation panel 62 are used.
- -3 is formed in the switch liquid crystal layer 76.
- openings 81-1 to 81-3 are also simply referred to as the openings 81, and it is not necessary to particularly distinguish the shielding parts 82-1 to 82-3. Also simply referred to as a shielding portion 82.
- a parallax barrier is formed on the barrier element 63, but a parallax image that is a 2D image is displayed on the light modulation panel 62. In that case, no parallax barrier is formed in the barrier element 63.
- the user observes an image displayed on the light modulation panel 62 from the barrier element 63 side.
- the barrier element 63 when a composite image is displayed, light emitted from the backlight 61 and transmitted through the light modulation panel 62 and the barrier element 63 is incident on the user's right eye ER or left eye EL.
- different lights separated by the barrier element 63 are incident on the user's right eye ER and left eye EL, different parallax images having parallax are observed between the right eye ER and the left eye EL.
- the barrier element 63 has been described as an example of a separation unit that optically separates parallax images.
- the separation unit is not limited to a parallax barrier, and may be a lenticular lens or the like.
- the parallax barrier as the separation unit is not limited to a variable barrier, and may be a fixed barrier in which an opening is provided in a shielding plate or the like.
- the barrier element 63 may be disposed between the light modulation panel 62 and the backlight 61.
- the display unit 27 included in the display device 11 displays parallax images at four different viewpoints, and allows the user to observe parallax images at two viewpoints among the four viewpoints, thereby converting the parallax images into a three-dimensional form.
- the display device can display four viewpoints.
- the horizontal direction and the vertical direction are the x direction and the y direction, respectively, and the direction perpendicular to the x direction and the y direction is the z direction.
- the x direction is the direction in which the user's right eye ER and left eye EL are arranged, that is, the parallax direction of the parallax image displayed on the light modulation panel 62
- the y direction is the direction perpendicular to the display surface of the light modulation panel 62.
- pixels of channel CH0, channel CH1, channel CH2, and channel CH3 are arranged in order from the right side to the left side in FIG. 2, and pixels of the same channel are arranged in the z direction. ing.
- the barrier element 63 is provided with one opening 81 constituting a parallax barrier for one block region.
- an area composed of pixels of the same channel in one block area is also referred to as a channel area.
- the display unit when a parallax image of four viewpoints is displayed on the display unit, the display unit is provided with a block area composed of pixels of channels CH0 to CH3, and the parallax images of each viewpoint are displayed on the pixels of each channel. .
- the position and size of the opening of the display unit for example, when a predetermined position in front of the display unit is set as a reference position, and the user observes the display unit from the reference position, It is predetermined that pixels of the same channel are observed.
- the distance in the y direction from the display surface of the display unit to the reference position is also referred to as an appropriate viewing distance.
- the user's right eye ER can be compared with the user's right eye ER through an opening 112 provided in the shielding unit 111 of the display unit.
- the left eye EL adjacent pixels are observed.
- the horizontal direction and the vertical direction indicate the x direction and the y direction, respectively.
- the pixel G11 is observed in the user's left eye EL, and the pixel G12 adjacent to the pixel G11 is observed in the user's right eye ER.
- the parallax images of different viewpoints are displayed on the pixel G11 and the pixel G12, parallax images of different viewpoints having parallax are observed with the left and right eyes of the user.
- the pixel G13 is observed in the user's left eye EL, and the user's right eye ER is a position away from the pixel G13 by two pixels. A pixel G15 located at is observed. In this state, even if the user's viewpoint position moves slightly in the right direction in FIG. 3, the parallax image displayed on the pixel G13 is not observed in the user's right eye ER. Does not occur.
- the pixels in the block area visually recognized by the user's right eye and left eye are separated by a distance of two pixels. Pixel.
- the right-eye and left-eye parallax images are appropriately displayed on the pixels of each channel, and the user can reduce the appropriate viewing distance. If a parallax image is observed from half the distance, the occurrence of crosstalk can be suppressed.
- a right-eye parallax image is displayed on the adjacent channel CH0 and channel CH1 pixels
- a left-eye parallax image is displayed on the adjacent channel CH2 and channel CH3 pixels. Suppose that it is displayed.
- the user can feel the switching of the display of the left and right parallax images in each region. Thus, a more natural image can be presented.
- a stereoscopic image display method As described above, according to the viewpoint position of the user, appropriately display the parallax image for the right eye or the left eye on the pixel of each channel, and if the user observes from a distance about half of the normal suitable viewing distance, It is possible to suppress the occurrence of crosstalk and present a higher quality image.
- a semi-viewing distance display method such a stereoscopic image display method is referred to as a semi-viewing distance display method.
- parallax barrier design When left and right parallax images are displayed using such a semi-viewing distance display method, the same is applied to the user who observes the display unit 27 from a position that is approximately half the normal viewing distance via each opening 81. In order to make the pixel of the channel visible, it is necessary to appropriately determine the distance between the openings 81, the distance from the openings 81 to the light modulation panel 62, and the like.
- the distance between the user's right eye ER and left eye EL (hereinafter referred to as the interocular distance E) is 65 mm and the appropriate viewing distance Z0 is 900 mm. Note that a typical adult interocular distance is about 65 mm.
- a distance D1 from the opening 81 to the light modulation panel 62 and a distance D2 between the openings 81 are determined.
- the horizontal direction and the vertical direction indicate the x direction and the y direction.
- each square on the lower side represents a pixel on the light modulation panel 62.
- one pixel G21 is visually recognized through the opening 81 from the position PE11 of the user's eye as shown on the left side in the figure. Assuming that the distance between the pixels is D3, the center of the pixel G21 is located away from the straight line A11 by D3.
- the position of the light modulation panel 62 seen through the screen should be separated by 4 pixels.
- the horizontal direction and the vertical direction indicate the x direction and the y direction, respectively.
- the viewpoint position of the user is a distance Z0 / 2 away from the center of the light modulation panel 62 in the y direction. That is, it is assumed that the user observes the light modulation panel 62 from the front at a distance Z0 / 2 from the light modulation panel 62.
- the pixels G31 to G34 in the block region provided for the opening 81 are the pixels of the channels CH3 to CH0, respectively.
- the center of the pixel of the channel CH3 in each block region of the entire light modulation panel 62 is observed in the user's left eye EL, and the light modulation panel is displayed in the user's right eye ER.
- the center of the pixel of channel CH1 in each block area of the entire 62 is observed.
- the refraction angle of light emitted from the light modulation panel 62 and entering the user's eyes through the opening 81 changes. Therefore, in the block region located at a position away from the center of the light modulation panel 62, the position on the pixel observed by the user is slightly shifted from the center.
- the left eye EL of the user has pixels G31 and G32. The position between is observed. Further, the position between the pixel G33 and the pixel G34 is observed in the right eye ER of the user.
- the user's eyes since the refraction angle of light incident on the user's eyes from the pixels of the light modulation panel 62 changes depending on the position on the light modulation panel 62, the user's eyes have either of the two pixels. A slightly larger area of the pixel can be seen.
- the display control of the parallax image on the display device 11 is basically the same regardless of whether the configuration shown on the right side in the figure or the configuration shown on the left side in the figure.
- the display device 11 when the viewpoint position of the user is detected, which position of the pixel of which channel in the block area is visually recognized by the user for each block area (opening 81) based on the viewpoint position. Calculated. Based on the calculation result, a right-eye or left-eye parallax image is assigned to each channel pixel in the block region.
- the display device 11 identifies the positions of the block areas where the luminance of light from the pixels viewed by the user is highest among the block areas on the display surface of the light modulation panel 62, and The position is the boundary position. That is, the position of the block area where the center of the pixel is visually recognized by the user's eyes is set as the boundary position.
- the display device 11 assigns left and right parallax images to the pixels of each channel for each region divided by the boundary position on the light modulation panel 62. At this time, in one area divided by the boundary position, the same parallax image is always assigned to the pixel of the same channel in all the block areas.
- a composite image is generated in accordance with the assignment of the parallax image to the pixel of each channel in such a block area, and the generated composite image is displayed on the light modulation panel 62.
- the viewpoint position of the user moves from this state, the position of the pixel visually recognized by the user in each block area changes, so that the position of the boundary position also moves following the change of the viewpoint position. Therefore, according to the movement of the boundary position, the assignment of the parallax image to the pixel of each channel in the block region is changed.
- an area composed of several block areas arranged in succession, and an area composed of block areas in which the same parallax image is assigned to pixels of the same channel is also referred to as a continuous block area. And That is, the area divided by the boundary position is a continuous block area.
- the boundary position of the continuous block area is the position of the block area where the luminance of light from the pixel visually recognized by the user is highest.
- the block region having the highest luminance is a block region where the approximate center of the pixel is visually recognized by the user.
- a predetermined light beam H11 passes through the air, enters a glass material having a thickness D21, and reaches the surface of the light modulation panel 62.
- a straight line passing through the incident position of the light beam H11 on the glass material and perpendicular to the surface of the glass material is defined as a straight line A21.
- the horizontal direction in the drawing that is, the direction parallel to the display surface of the light modulation panel 62 is the x direction
- the vertical direction in the drawing that is, the display surface of the light modulation panel 62.
- a predetermined position on the xy coordinate system is a position CP of the user's eyes, where the direction perpendicular to the y direction is the y direction.
- the opening 81 in the center of the barrier element 63 is defined as the 0th opening 81
- the nth opening 81 in the left direction from the opening 81 in the figure is defined as the nth opening 81, and the 0th.
- the n-th opening 81 in the right direction from the first opening 81 is defined as the ⁇ n-th opening 81.
- the incident angle T11 of the light beam from the position CP to the nth opening 81 is obtained. That is, the incident angle T11 is an angle formed by the straight line L21 parallel to the y direction and the light beam from the position CP.
- the position in the pixel visually recognized by the user is a value between ⁇ 0.5 and 0.5, with the center position of the pixel being 0.
- the left end position in the pixel diagram is +0.5
- the right end position in the pixel diagram is ⁇ 0.5.
- the channel m of the pixel (hereinafter also referred to as a visible pixel) visually recognized by the user for each block region (opening 81), and the visual position on the visible pixel
- the result shown in FIG. 8 is obtained.
- the horizontal axis indicates the number n of the opening 81
- the vertical axis indicates the channel number or the viewing position of the viewing pixel.
- the direction from the 0th opening 81 toward the nth (where 1 ⁇ n) opening 81 is the + x direction, and the direction opposite to the + x direction is the ⁇ x direction.
- the straight line C11 indicates the channel number of the visual recognition pixel in each block area visible from the user's right eye
- the curved line C12 indicates the visual recognition position of the visual recognition pixel in each block area visible from the user's right eye.
- the pixel of the channel CH1 is visually recognized by the right eye of the user through all the openings 81, that is, in all the block regions on the light modulation panel 62. Further, it can be seen that the center (center) of the pixel of the channel CH1 is visually recognized by the right eye of the user observing the 0th opening 81.
- the position of the opening 81 located on the + x direction side from the 0th opening 81 is shifted in the + x direction from the center as viewed from the pixel by the user's right eye.
- the position on the pixel visually recognized by the user's right eye is shifted from the center in the ⁇ x direction toward the ⁇ x direction side of the 0th opening 81.
- the straight line C13 indicates the channel number of the visible pixel in each block area visible from the user's left eye
- the curve C14 indicates the block area of each block area visible from the user's left eye.
- the visual recognition position in the visual recognition pixel is shown.
- the pixel of the channel CH3 is visually recognized by the user's left eye through all the openings 81, and the pixel of the channel CH3 is observed by the user's left eye observing the 0th opening 81. It can be seen that the center is visible.
- the viewing position is shifted in the + x direction from the pixel center, and the opening 81 on the ⁇ x direction side from the 0th opening 81. It can be seen that the viewing position is shifted in the ⁇ x direction from the pixel center.
- the display device 11 sets the position of the block area (opening 81) where the visual recognition position is 0 as the boundary position LB11 of the continuous block area from the curves C12 and C14. More specifically, the curve indicating the viewing position in each opening 81 such as the curve C12 and the curve C14 has a position that crosses 0 on the vertical axis in a section in which the pixel of the same channel is the viewing pixel, that is, the viewing position is A position where the value changes from a negative value to a positive value is set as a boundary position.
- the display device 11 assigns a parallax image to the pixel of each channel for each continuous block region obtained by being divided by the boundary position LB11.
- a parallax image for the right eye is assigned to the pixels of the channel CH0 and the channel CH1, and the channel CH2 and the channel CH1.
- a parallax image for the left eye is assigned to the pixel of CH3.
- the pixel of the channel CH1 is visually recognized by the user's right eye as a visual pixel, and the visual recognition position is from the center of the visual pixel to the left side, that is, the pixel side of the channel CH0. It's off. Therefore, in the region on the left side from the boundary position LB11, a right-eye parallax image is assigned to the pixels of the channel CH0 and the channel CH1.
- right-eye parallax images are assigned to the pixels of the channel CH1 and the channel CH2, and the channel CH0 and the channel CH3 are assigned.
- a left-eye parallax image is assigned to the pixel.
- pixels of the same channel in each block area are observed as visual pixels by the user's eyes, but when the user's viewpoint position moves, for example, as shown in FIG.
- This pixel may be a visible pixel.
- the horizontal axis indicates the number n of the opening 81
- the vertical axis indicates the channel number or the viewing position of the viewing pixel.
- the broken line C ⁇ b> 21 indicates the channel number of the visible pixel in each block area visible from the user's right eye
- the broken line C ⁇ b> 22 indicates the visual recognition position in the visible pixel of each block area visible from the user's right eye. Yes.
- the position of the pixel of the channel CH0 on the + x direction side is observed through the opening 81 to the right eye of the user.
- the position of the pixel of the channel CH1 on the ⁇ x direction side is observed through the opening 81 to the right eye of the user. I understand that.
- the broken line C ⁇ b> 23 indicates the channel number of the visible pixel in each block area visible from the user's left eye
- the broken line C ⁇ b> 24 indicates the visual recognition position in the visible pixel of each block area visible from the user's left eye. Is shown.
- the left eye of the user passes through the opening 81 on the + x direction side of the pixel of the channel CH2. It can be seen that the position is observed. Further, in the opening 81 on the ⁇ x direction side from the 0th opening 81, the position of the pixel of the channel CH3 on the ⁇ x direction side is observed through the opening 81 to the left eye of the user. I understand that.
- the broken line C22 and the broken line C24 indicating the viewing position do not cross the viewing position “0” (does not cross 0) in the section where the pixel of the same channel is the viewing pixel. There is no boundary position.
- the right-eye parallax image is assigned to the pixels of the channel CH0 and the channel CH1 that are the visible pixels in each block area.
- a left-eye parallax image is assigned to the pixels of the channel CH2 and the channel CH3 that are the visible pixels.
- the entire light modulation panel 62 is set as one continuous block region.
- the boundary position of the continuous block region is determined.
- a channel to which the left and right parallax images are assigned is determined for each block area belonging to each continuous block area.
- the boundary position of the continuous block area is ideally the same as the boundary position when viewed from the right eye and the boundary position when viewed from the left eye. Since the positions of the eyes and the left eyes are different from each other, there may be a shift in the boundary position between them as shown in FIG.
- the horizontal axis indicates the number n of the opening 81
- the vertical axis indicates the channel number or the viewing position of the viewing pixel.
- the broken line C31 indicates the channel number of the visible pixel in each block area visible from the user's right eye
- the broken line C32 indicates the visual recognition position in the visible pixel of each block area visible from the user's right eye.
- a straight line LB31 and a straight line LB32 indicate the boundary position of the continuous block region determined from the broken line C32.
- the broken line C33 indicates the channel number of the visible pixel in each block area visible from the user's left eye
- the broken line C34 indicates the visual recognition position in the visible pixel of each block area visible from the user's left eye.
- the straight line LB41 and the straight line LB42 indicate the boundary position of the continuous block region determined from the broken line C34.
- the straight line LB31 and the straight line LB32 are also referred to as the boundary position LB31 and the boundary position LB32
- the straight line LB41 and the straight line LB42 are also referred to as the boundary position LB41 and the boundary position LB42.
- the boundary position LB41 and the boundary position LB42 with the left eye as a reference correspond to the boundary position LB31 and the boundary position LB32 with the right eye as a reference, but the boundary positions are shifted.
- a contradiction arises in the assignment of the parallax image to the pixel of each channel in the block region.
- the right-eye parallax image is assigned to the pixels of the channel CH0 and the channel CH3 in the block region between the end of the light modulation panel 62 on the ⁇ x direction side and the boundary position LB31 with the right eye as a reference.
- a parallax image for the left eye is assigned to the pixels of the channel CH2 and the channel CH3 in the block region between the boundary position LB41 and the boundary position LB42 with the left eye as a reference.
- both the right-eye parallax image and the left-eye parallax image are assigned to the pixel of the channel CH3.
- an intermediate position (average position) between the boundary position LB31 and the boundary position LB41, and an intermediate position between the boundary position LB32 and the boundary position LB42 are set as boundary positions LB51 and LB52 which are final boundary positions. To do.
- the area divided by the boundary position LB51 and the boundary position LB52 is set as a continuous block area, and a parallax image is allocated in each block area.
- the channel numbers of the pixels to which the parallax images for the right eye and the left eye are assigned in each region are shown on the lower side.
- right-eye parallax images are assigned to the pixels of the channel CH0 and the channel CH3 in the block region, and the channel CH1 and the channel CH2 A left-eye parallax image is assigned to the pixel.
- right-eye parallax images are assigned to the channels CH0 and CH1 in the block region, and left-eye parallax images are assigned to the channels CH2 and CH3. Is assigned.
- right-eye parallax images are assigned to the pixels of the channels CH1 and CH2 in the block region, and the pixels of the channels CH0 and CH3 are assigned. Is assigned a parallax image for the left eye.
- the boundary position between the boundary position based on the right eye and the boundary position based on the left eye is the boundary position of the final continuous block region, the right eye or the left eye is used as the reference in the vicinity of the boundary position.
- pixels in the same channel are observed as visual pixels in the user's right eye and left eye in some block areas.
- the horizontal axis indicates the number n of the opening 81
- the vertical axis indicates the channel number or the viewing position of the viewing pixel.
- the broken line C41 indicates the channel number of the visible pixel in each block area visible from the user's right eye
- the broken line C42 indicates the visual recognition position in the visible pixel of each block area visible from the user's right eye.
- a broken line C43 indicates a channel number of a visible pixel in each block area visible from the user's left eye
- a broken line C44 indicates a visual recognition position in the visible pixel of each block area visible from the user's left eye.
- the polygonal line C41 and the polygonal line C43 partially overlap, and in these parts, pixels in the same channel are visible pixels in the user's right eye and left eye in the block region. And parallax images for both the left eye and the left eye must be assigned. That is, the user cannot observe the subject stereoscopically, and stereoscopic display using the parallax image for the right eye and the parallax image for the left eye becomes impossible.
- the parallax image is obtained when the user observes the display unit 27 from the current viewpoint position based on the result. It is possible to specify whether or not stereoscopic viewing is possible.
- a hatched area WR11 of the surrounding area of the display unit 27 indicates an area in which a parallax image can be stereoscopically displayed. Therefore, when the stereoscopic display of the parallax image is performed by the semi-view distance display method, the display device 11 sets the region WR12 in the region WR11 as a region where the stereoscopic display of the parallax image is possible. The display device 11 stereoscopically displays the subject based on the left and right parallax images when the user's viewpoint position is within the region WR12, and when the user's viewpoint position is outside the region WR12, A parallax image is displayed.
- the display device 11 performs display processing when a stereoscopic image including a parallax image for the right eye and a parallax image for the left eye is designated, and display of these parallax images by the semi-viewing distance display method is instructed, A parallax image is stereoscopically displayed.
- display processing by the display device 11 will be described with reference to the flowchart of FIG.
- step S ⁇ b> 11 the imaging unit 21 captures an image of a region around the display unit 27 as a peripheral image and supplies the image to the detection unit 22.
- step S ⁇ b> 12 the detection unit 22 detects the user's eyes based on the peripheral image supplied from the imaging unit 21. For example, the detection unit 22 detects the user's face from the peripheral image, and further detects the user's eyes from the detected face area.
- step S13 the detection unit 22 determines whether or not the user's eyes are detected from the surrounding images.
- step S14 the viewpoint position calculation unit 31 calculates the user's viewpoint position from the detected user's eye position, and sends it to the assignment control unit 23. Supply. For example, the viewpoint position calculation unit 31 obtains an intermediate position between the left and right eyes of the user on the xy plane as the viewpoint position.
- step S15 the determination unit 32 of the allocation control unit 23 determines whether or not stereoscopic display of a parallax image is possible based on the viewpoint position of the user supplied from the viewpoint position calculation unit 31.
- the determination unit 32 records area information for specifying the stereoscopically displayable area WR12 illustrated in FIG. 12 in advance, and based on the recorded area information, the user's viewpoint position is within the area WR12. By specifying whether or not it is a position, it is determined whether or not stereoscopic display is possible. Therefore, for example, when the viewpoint position of the user is a position in the region WR12, it is determined that stereoscopic display is possible.
- step S16 the viewing position calculation unit 33 visually recognizes each opening 81 based on the viewpoint position of the user supplied from the viewpoint position calculation unit 31. Pixels and viewing positions are calculated.
- the visual recognition position calculation unit 33 performs the calculation described with reference to FIG. 7 for the right eye position and the left eye position of the user determined from the viewpoint position, and opens the opening for each opening 81 (block region).
- the visual recognition pixel observed through the part 81 and the visual recognition position in the visual recognition pixel are calculated.
- the calculation result shown in FIG. 10 is obtained. That is, for each block region, a channel number of a pixel (viewing pixel) observed from the user's right eye or left eye and a position (viewing position) observed by the user on the pixel are obtained.
- step S17 the boundary position calculation unit 34 calculates the boundary position of the continuous block area based on the calculation result of the visual recognition pixel and the visual recognition position for each block area.
- the boundary position calculation unit 34 specifies a block area whose viewing position is “0” based on the viewing position of each block area obtained for the right eye position. Then, the boundary position calculation unit 34 has different viewing positions of the block areas arranged on the left and right sides (x direction) of the block area, and the viewing positions of the three block areas are the same when the channels of the viewing pixels are the same.
- the position of the block area that is “0” is set as a boundary position with the right eye as a reference.
- the boundary position calculation unit 34 calculates the boundary position with reference to the left eye based on the visual recognition pixel of each block area obtained for the left eye position and the calculation result of the visual recognition position. Then, the boundary position calculation unit 34 determines the intermediate position between the boundary position with reference to the right eye and the boundary position with reference to the left eye corresponding to these boundary positions as the boundary of the final continuous block region. Position.
- the boundary position based on the left eye which corresponds to the boundary position based on the right eye, is the boundary position based on the left eye that is closest to the boundary position based on the right eye. is there.
- the boundary position LB51 and the boundary position LB52 shown in FIG. 10 are obtained by such calculation. Note that, as in the example illustrated in FIG. 9, there may be no boundary position depending on the viewpoint position of the user.
- step S18 the boundary position calculation unit 34 assigns right-eye or left-eye parallax images to the pixels in each block area based on the calculation result of the boundary position of the continuous block area.
- a right-eye parallax image is assigned to the pixels (channel regions) of channel CH0 and channel CH1 in all block regions on the display surface of the light modulation panel 62.
- parallax images for the left eye are assigned to the pixels of channel CH2 and channel CH3.
- the right eye is applied to the pixels of the channel CH0 and the channel CH1.
- a parallax image for use is assigned.
- a left-eye parallax image is assigned to the pixels of the channel CH2 and the channel CH3.
- an area composed of four pixels on the light modulation panel 62 is a block area BR1 and a block area BR2.
- the horizontal direction indicates the x direction.
- rectangles indicated by arrows Q41 to Q43 represent the parallax image for the right eye, the parallax image for the left eye, and the light modulation panel 62.
- one rectangle in the rectangle represents one pixel, and the characters “R”, “G”, and “B” in each pixel represent the color of the pixel.
- a region including the pixels G51 to G54 on the light modulation panel 62 is a block region BR1
- a region including the pixels G55 to G58 is a block region BR2.
- the pixel G51 is a pixel that is provided with an R (red) color filter and transmits only R light
- the pixel G52 is a G light that is provided with a G (green) color filter. It is a pixel that transmits only.
- each pixel on the light modulation panel 62 the channel numbers of these pixels are written on the lower side.
- the pixel G51 is a pixel of the channel CH0
- the pixel G52 is a pixel of the channel CH1.
- pixels on an image have values of R, G, and B colors
- adjacent R, G, and B areas are defined as one pixel
- R, G, and B color areas are defined as one pixel. It is often treated as a subpixel (subpixel).
- a region composed of three consecutive pixels of R, G, and B at the left end is generally one pixel (hereinafter also referred to as RGB pixel as appropriate).
- the pixels G61 and G62 of each color are treated as sub-pixels. However, here, these pixels G61 and G62 are referred to as one pixel.
- the three color regions composed of the pixels G51 to G53 may be treated as one pixel, but here each of the pixels G51 to G53 is treated as one pixel. .
- the boundary position calculation unit 34 assigns a right-eye parallax image to the pixels of the channel CH0 and the channel CH1, and a parallax image for the left eye to the pixels of the channel CH2 and the channel CH3. Is assigned.
- the boundary position calculation unit 34 assigns the pixel G61 and the pixel G62 of the parallax image for the right eye to the pixel G51 and the pixel G52 on the light modulation panel 62 at the same position as those pixels. Further, the boundary position calculation unit 34 assigns the pixel G71 and the pixel G72 of the parallax image for the left eye to the pixel G53 and the pixel G54 on the light modulation panel 62 at the same position as those pixels.
- the boundary position calculation unit 34 assigns the pixel G63 and the pixel G64 of the parallax image for the right eye to the pixel G55 and the pixel G56, the pixel G73 and the pixel G74 of the parallax image for the left eye, and the pixel G57 and the pixel G57. Assign to G58.
- a right-eye or left-eye parallax image is assigned to a pixel of a predetermined channel in the block region, more specifically, the right-eye at the same position as the pixel is assigned to the pixel of the channel.
- a pixel of a parallax image for use or for the left eye is assigned.
- the boundary position calculation unit 34 supplies the assignment result to the generation unit 25, and the composite image Instruct the generation of.
- step S ⁇ b> 19 the generation unit 25 generates a composite image based on the allocation result supplied from the boundary position calculation unit 34 and the right-eye and left-eye parallax images read from the recording unit 24, and displays them. It supplies to the control part 26. For example, when the assignment illustrated in FIG. 14 is performed, the generation unit 25 displays the pixel G61 and the pixel G62 of the parallax image for the right eye on the pixel G51 and the pixel G52, and the pixel of the parallax image for the left eye A composite image is generated so that G71 and pixel G72 are displayed on pixel G53 and pixel G54.
- the parallax image may be acquired from an external device or the parallax image may be received.
- step S20 the display control unit 26 supplies the composite image supplied from the generation unit 25 to the display unit 27 for display.
- the display unit 27 emits light from the backlight 61 based on the supplied composite image, and applies a voltage to the light modulation panel 62 to control the transmittance of light from the backlight 61 for each pixel. Further, the display unit 27 applies a voltage to the barrier element 63 to form a parallax barrier composed of the opening 81 and the shielding unit 82.
- the light transmitted through each pixel of the light modulation panel 62 from the backlight 61 is optically separated by the parallax barrier, and a part of the separated light is incident on the right eye or the left eye of the user,
- the user observes the subject on the parallax image stereoscopically. That is, the parallax image area for the right eye on the synthesized image is observed by the user's right eye, and the parallax image area for the left eye on the synthesized image is observed by the user's left eye.
- the display device 11 outputs the accompanying sound from a speaker (not shown) in accordance with the display of the composite image.
- step S21 the display device 11 determines whether to turn off the power of the display device 11. For example, when an instruction to turn off the power is given by a user operation, it is determined that the power is turned off.
- step S21 If it is determined in step S21 that the power is not turned off, the process returns to step S11 and the above-described process is repeated. That is, according to the movement of the user's viewpoint position, the assignment of the parallax image to the pixel of each channel in the block region is changed, and the composite image generated according to the new assignment is displayed.
- step S21 when it is determined in step S21 that the power is turned off, the display device 11 stops the processing of each unit and turns off the power, and the display process ends.
- step S15 If it is determined in step S15 that stereoscopic display is not possible, the allocation control unit 23 instructs the generation unit 25 to display a two-dimensional parallax image, and the process proceeds to step S22.
- step S22 the generation unit 25 displays a two-dimensional parallax image in response to an instruction from the allocation control unit 23. That is, the generation unit 25 reads out the right-eye or left-eye parallax image from the recording unit 24 and supplies the read-out parallax image to the display control unit 26 as it is.
- the display control unit 26 supplies the parallax image supplied from the generation unit 25 to the display unit 27 to display the parallax image.
- the barrier element 63 does not form a parallax barrier, and the display unit 27 displays the parallax image as it is.
- the parallax image is displayed two-dimensionally (2D display) by causing the display unit 27 to display the parallax image as it is.
- step S22 When the parallax image is displayed in step S22, the process thereafter proceeds to step S21, and the above-described process is performed.
- step S13 If it is determined in step S13 that the user's eyes have not been detected, the detection unit 22 supplies a detection result indicating that no eyes have been detected to the assignment control unit 23, and the process proceeds to step S23.
- step S23 the allocation control unit 23 determines whether or not a predetermined time has elapsed since the user's eyes are not detected.
- step S23 If it is determined in step S23 that the predetermined time has not elapsed, the process proceeds to step S22, and the above-described process is performed. That is, the parallax image is two-dimensionally displayed on the display unit 27.
- step S24 the allocation control unit 23 controls the generation unit 25 so that no image is displayed.
- the generation unit 25 stops the supply of the image to the display control unit 26 according to the control of the allocation control unit 23. As a result, no image is displayed on the display unit 27. That is, the image is erased.
- the power consumption can be suppressed by erasing the image.
- step S24 If it is determined that the image is erased in step S24, then the process proceeds to step S21, the above-described process is performed, and the display process ends.
- the display device 11 calculates the viewing pixel and the viewing position for each block area based on the viewpoint position of the user, and based on the calculation result, the display device 11 applies the right eye to the pixel of each channel in the block area.
- a composite image is generated by assigning parallax images for the left eye or the left eye.
- the user can feel more natural without switching the display of the parallax image in each channel. Can present high-quality images.
- the display device 11 when the user observes the display unit 27 from an area in which stereoscopic display is possible, almost the same position in each block area becomes a visual recognition position. Does not occur.
- the display device 11 is designed so that the viewing position of each block area is substantially the same when the user's viewpoint position is at a position that is approximately half the appropriate viewing distance. The number of boundary positions can be reduced.
- the determination unit 32 records in advance area information for specifying an area that can be stereoscopically displayed.
- area information is not recorded in advance and is visually recognized. Whether or not stereoscopic display is possible may be determined from the pixel calculation result.
- the determination unit 32 uses the calculation result of the visual pixel in each block area calculated by the visual position calculation unit 33. That is, the determination unit 32 determines that stereoscopic display is not possible when there is a block region in which a visual pixel based on the right eye and a visual pixel based on the left eye are pixels of the same channel.
- ⁇ Modification 1> In the above description, it has been described that the display device 11 performs stereoscopic display by the semi-viewing distance display method alone. However, a stereoscopic display by the semi-viewing distance display method is performed by a display system including several devices. It may be.
- the display system is configured as shown in FIG. 15, for example.
- the display system of FIG. 15 includes an imaging device 121, an image processing device 122, and a display device 123.
- parts corresponding to those in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.
- the imaging device 121 captures an image around the display device 123 as a peripheral image and supplies it to the image processing device 122.
- the image processing device 122 generates a composite image using the peripheral image from the imaging device 121 and supplies the composite image to the display device 123.
- the image processing apparatus 122 includes a detection unit 22, an assignment control unit 23, a recording unit 24, and a generation unit 25.
- the detection unit 22 detects the user's eyes from the peripheral image from the imaging device 121 and supplies the detection result to the allocation control unit 23.
- the allocation control unit 23 is based on the detection result from the detection unit 22.
- the parallax image is assigned to the pixel of each channel in the block area.
- the generation unit 25 generates a composite image from the parallax images of the left and right eyes recorded in the recording unit 24 according to the control of the assignment control unit 23 and supplies the composite image to the display device 123.
- the display device 123 is a display device that has the same functions as the display unit 27 and the display control unit 26 and can display a stereoscopic image. Based on the composite image supplied from the generation unit 25, the display device 123 displays a subject on the parallax image. Is displayed in 3D.
- the display unit 27 is a display device capable of stereoscopically displaying parallax images of four viewpoints.
- the display unit 27 can stereoscopically display parallax images of five or more viewpoints. It may be a display device.
- the display unit 27 can stereoscopically display a parallax image of six viewpoints, as illustrated in FIG. 16, an area including pixels of six different channels is set as a block area, and one opening is provided for the block area. A part 81 is provided.
- FIG. 16 the same reference numerals are given to the portions corresponding to those in FIG. 2, and the description thereof will be omitted as appropriate.
- an area including pixels G91 to G96 of six different channels is defined as one block area.
- the viewpoint position of the user who can stereoscopically view the parallax image is, for example, a position where pixels at positions separated by 3 pixels from each other become visual pixels based on the user's right eye and left eye.
- the pixel G95 is visually recognized by the user's right eye ER
- the pixel G92 is visually recognized by the user's left eye EL.
- parallax images for right eye or left eye are assigned to pixels of at least three consecutively arranged channels. For example, in FIG. 16, parallax images for the left eye are allocated to the pixels G91 to G93, and parallax images for the right eye are allocated to the pixels G94 to G96.
- the right and left eye viewing pixels are arranged two or more pixels continuously arranged in the parallax direction.
- a parallax image of the same viewpoint can be assigned to the above pixels.
- the opening width of the opening 81 is too narrow, the screen is bright when the center of the pixel is visually recognized by the user, but the screen is dark when the position between the pixels is visually recognized by the user. In such a case, when the user moves the viewpoint position in the x direction, a state in which the screen becomes brighter or darker at a predetermined cycle is repeated.
- the opening width of the opening 81 is the same as the pixel width or the distance between the pixels.
- the aperture width is a value obtained by subtracting the pixel width from a value twice the distance between the pixels.
- the user's eyes are at a position separated from the display unit 27 in the y direction by a distance Z0 / 2 that is half the appropriate viewing distance (hereinafter also referred to as a semi-appropriate viewing distance).
- a distance Z0 / 2 that is half the appropriate viewing distance (hereinafter also referred to as a semi-appropriate viewing distance).
- the user is looking at the pixel on the light modulation panel 62 through the opening 81.
- the horizontal direction and the vertical direction in the figure indicate the x direction and the y direction.
- pixels G121 to G125 are arranged in the x direction on the light modulation panel 62, and these pixels G121 to G125 are the pixels of channels CH0, CH1, CH2, CH3, and CH0, respectively. ing.
- the numerical value in each pixel represents the channel number of that pixel.
- the user's right eye ER and left eye EL are located at a semi-appropriate viewing distance from the display unit 27, and the user's right eye ER and left eye EL have light modulation panels, respectively.
- a region VR11 and a region VL11 on 62 are visually recognized.
- the region VR11 is approximately the region of the pixel G122 and the region VL11 is approximately the region of the pixel G124, the region at the center of the pixel G122 and the pixel G124 is visually recognized by the user's right eye ER and left eye EL. . Therefore, no crosstalk occurs in this state.
- the region VR12 visually recognized by the user's right eye ER is a region including a part of the pixel G121 and the pixel G122
- the region VL12 visually recognized by the user's left eye EL is the pixel G124.
- the region includes a part of the pixel G125.
- the pixel of the channel CH0 is visible to both the right eye and the left eye of the user, and crosstalk occurs.
- the region VR13 visually recognized by the user's right eye ER is a region including a part of the pixel G122 and the pixel G123
- the region VL13 visually recognized by the user's left eye EL is the pixel G123.
- the region includes a part of the pixel G124.
- the pixel of the channel CH2 is visible to both the right eye and the left eye of the user, and crosstalk occurs.
- FIG. 18 shows an example in which the user's viewpoint position is closer to the display unit 27 than the position of the semi-appropriate viewing distance.
- the horizontal direction indicates the x direction
- one square represents one pixel provided on the light modulation panel 62.
- the numerical values in these pixels indicate the channel number of each pixel.
- each of the regions VR21-1 to VR21-8 indicates a region on the light modulation panel 62 that is visually recognized by the user's right eye ER through each opening 81.
- the regions VL21-1 to VL21-8 indicate regions on the light modulation panel 62 that are visually recognized by the user's left eye EL through the openings 81.
- region VR21-1 to the region VR21-8 are also simply referred to as a region VR21, and if the region VL21-1 to the region VL21-8 are not particularly required to be distinguished, they are also simply referred to as a region VL21.
- the intermediate position between these boundary positions is the final position.
- the right and left parallax images are assigned.
- the straight line LB81 and the straight line LB82 indicate the boundary position with reference to the right eye and the boundary position with reference to the left eye, respectively, and these boundary positions are different positions. Therefore, the position of the straight line LB83 that is in the middle of the straight line LB81 and the straight line LB82 is the final boundary position of the continuous block region.
- a left-eye parallax image is assigned to the channel CH0 and channel CH3 pixels
- a right-eye parallax image is assigned to the channel CH1 and channel CH2 pixels in the region on the left side of the line LB83 in the drawing.
- the left-eye parallax image is assigned to the channel CH2 and channel CH3 pixels
- the right-eye parallax image is assigned to the channel CH0 and channel CH1 pixels.
- a white image is displayed as a parallax image for the right eye and a black image is displayed as a parallax image for the left eye.
- the channel VR1 in this area has a channel CH1. And the pixel region of the channel CH0.
- the visual pixel based on the user's right eye is the channel CH1 pixel.
- the pixel of the channel CH1 but also a partial region of the pixel of the channel CH0 is visually recognized by the user's right eye.
- the parallax image for the left eye is assigned to the pixel of the channel CH0, and therefore, the parallax image for the left eye leaks to the right eye of the user in this area. Will be visible. That is, crosstalk occurs in the user's right eye.
- the portion corresponding to the region from the straight line LB83 to the straight line LB81 becomes a grayish image.
- the crosstalk amount increases in the region closer to the straight line LB83, whereas crosstalk occurs on the right side in the figure of the straight line LB83. Absent. Therefore, a line-shaped crosstalk that is long in the z direction is generated in the image PR11, and the crosstalk becomes somewhat conspicuous.
- the channel VL21 in this area has a channel CH0. And the pixel region of the channel CH3.
- the right eye parallax image is leaked to the left eye of the user in this area because the right eye parallax image is assigned to the pixel of the channel CH0. Will be visible.
- the portion corresponding to the area from the straight line LB83 to the straight line LB82 becomes a whited image.
- the crosstalk amount increases in the region closer to the straight line LB83, whereas crosstalk occurs on the left side in the figure of the straight line LB83. Absent. For this reason, a line-shaped crosstalk that is long in the z direction also occurs in the image PL11.
- the pixel area of the channel CH0 is visually recognized by the left and right eyes of the user, and thus crosstalk occurs regardless of the allocation of the left and right parallax images. End up. Note that when the parallax image is assigned with the position of either the straight line LB81 or the straight line LB82 as the boundary position of the continuous block region, crosstalk hardly occurs in one of the left and right eyes, but a large amount in the other eye Crosstalk will occur.
- the left and right parallax images are blended into the pixels that cause crosstalk, that is, the pixels that are visible to both the left and right eyes. You may make it display.
- the pixel that causes the crosstalk is in a region between the straight line LB81 that is the boundary position with the right eye as a reference and the straight line LB82 that is the boundary position with the left eye as a reference.
- the same reference numerals are given to the portions corresponding to those in FIG. 18, and description thereof will be omitted as appropriate.
- the pixel of the channel CH0 in the region between the straight line LB81 and the straight line LB82 is visually recognized by both eyes of the user. It was.
- the pixels of the left and right parallax images are blended in proportion to the amount of leakage (leakage amount) leaked as crosstalk from the pixels of the channel CH0 in the region between the straight line LB81 and the straight line LB82.
- An image of pixel values obtained by blending the values is displayed.
- the straight line LB83 that is, the pixel of the channel CH0 at the boundary position
- the light (image) from the pixel leaks into the region VR21-4 and the region VL21-5, resulting in crosstalk. It is the same. Therefore, an image having a pixel value obtained by blending pixel values of corresponding pixels of the left and right parallax images at the same ratio is displayed on the pixel of the channel CH0 at the boundary position.
- an image having a pixel value Out (X) obtained by the following equation (1) may be displayed on a pixel that causes crosstalk.
- variable X is the left end position of the light modulation panel 62, that is, the + x direction side end position as the origin, and the right direction ( ⁇ x direction) in the figure is the + X axis direction.
- the position of the pixel on the light modulation panel 62 in the coordinate system is shown.
- R (X) and L (X) indicate the pixel values of the right-eye and left-eye parallax images at the position X, respectively, and X1 and X2 indicate the right eye and the left eye, respectively.
- the reference boundary position is shown.
- Out (X) will be required.
- the pixel value Out (X) is the pixel value of the pixel at the position X of the parallax image for the left eye, weighted by the ratio of the amount of light leakage from the pixel at the position X to the left and right eyes, It is obtained by a weighted average with the pixel value of the pixel at position X of the parallax image for the right eye.
- the ratio (blend ratio) of the amount of light leakage from the pixel at the position X to the left and right eyes is the positional relationship between the position X and the positions X1 and X2, that is, the target in the region to be blended. Is obtained from the pixel position.
- the blend ratio is the ratio of the size of the pixel region that is visually recognized by the left and right eyes of the user. For example, at the position X closer to the position X1, the amount of light from the pixel of the channel CH0 leaks to the left eye more, so that more parallax images for the left eye are blended.
- the composite image displayed here is obtained by blending a partial region of an image composed of a white image as a parallax image for the right eye and a black image as a parallax image for the left eye. This is an image obtained by replacing the obtained image.
- crosstalk slightly occurs on both the left and right sides of the straight line LB83, but the crosstalk is distributed to the left and right of the straight line LB83 by blending the parallax images. Therefore, crosstalk is less noticeable than in the case of the image PR11 and the image PL11. That is, although the crosstalk occurrence area is wide, the amount of leakage in each area is small, so that the deterioration of the image quality of the stereoscopic image caused by the occurrence of crosstalk is improved.
- the light from the pixel of the channel CH0 at the position of the straight line LB83 leaks by approximately the same amount to the left and right eyes of the user. Therefore, compared to the case where only one of the parallax image components is included in each pixel of the composite image displayed on this pixel by including half of the left and right parallax image components, Crosstalk in the right and left eyes is improved.
- the display device As described above, when blending parallax images with respect to pixels that cause crosstalk, the display device is configured as shown in FIG. 20, for example.
- FIG. 20 includes an imaging unit 21, a detection unit 22, an assignment control unit 23, a recording unit 24, a generation unit 25, a display control unit 26, and a display unit 27.
- FIG. 20 parts corresponding to those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted as appropriate.
- the display device 151 in FIG. 20 is different from the display device 11 in FIG. 1 in that a blend ratio calculation unit 161 is provided in the allocation control unit 23 of the display device 151, and the other configurations are the same. .
- the blend ratio calculation unit 161 when trying to display a stereoscopic image by the semi-view distance display method, if there is a pixel of a channel to be blended on the light modulation panel 62, the blend ratio of the parallax image in the pixel of that channel Is calculated.
- a channel of a pixel to be blended is also referred to as a target channel.
- the generation unit 25 calculates a target channel pixel in the region by the blend ratio calculation unit 161 when there is a region that needs to be blended. Based on the blend ratio, blending is performed to generate a composite image.
- or step S58 is the same as the process of FIG.13 S11 thru
- step S59 the blend ratio calculation unit 161 determines whether there is an area to be blended.
- step S57 when the boundary position based on the right eye calculated in the process of step S57 is different from the boundary position based on the left eye, it is determined that there is an area to be blended. At this time, an area between the boundary position with the right eye as a reference and the boundary position with the left eye as a reference is an area to be blended.
- step S59 If it is determined in step S59 that there is no region to be blended, the boundary position calculation unit 34 supplies the allocation result of the left and right parallax images to the pixels of each channel to the generation unit 25, and the process proceeds to step S60. .
- step S ⁇ b> 60 the generation unit 25 generates a composite image based on the allocation result supplied from the boundary position calculation unit 34 and the right-eye and left-eye parallax images read from the recording unit 24, and displays them. It supplies to the control part 26.
- step S60 processing similar to that in step S19 in FIG. 13 is performed. If the process of step S60 is performed, then the process proceeds to step S64.
- step S61 the blend ratio calculation unit 161 calculates a target channel to be blended.
- the blend ratio calculation unit 161 determines the pixel that is visually recognized by the left and right eyes of the user among the pixels in the region between the boundary position with reference to the right eye and the boundary position with reference to the left eye. Find the channel as the target channel.
- the target channel can be obtained from the visual recognition position of the visual pixel in the region between the boundary position based on the right eye and the boundary position based on the left eye.
- the visual pixel of the left eye is the channel CH2 and the visual recognition position is a positive position from the broken line C34, not only the pixel of the channel CH2 but also the channel CH2 It can be seen that the pixel of CH3 is also visually recognized. Therefore, in this case, the channel CH3 is specified as the target channel.
- step S62 the blend ratio calculation unit 161 calculates the blend ratio for each pixel of the target channel in the region to be blended from the calculation of the above-described formula (1). For example, assuming that the pixel position of the target channel to be processed is position X, the blend ratio of the parallax image for the left eye is (X2-X) / (X2-X1), and the blend of the parallax image for the right eye The ratio is (X-X1) / (X2-X1). X1 and X2 indicate boundary positions based on the right eye and the left eye, respectively.
- the blend ratio calculation unit 161 supplies the calculated blend ratio and the assignment result of the left and right parallax images to the pixels of each channel to the generation unit 25, and the process proceeds to step S63.
- step S ⁇ b> 63 the generation unit 25 performs blending based on the blend ratio supplied from the blend ratio calculation unit 161 and the parallax image assignment result, and the right-eye and left-eye parallax images read from the recording unit 24. Processing is performed to generate a composite image.
- the generation unit 25 performs the same process as step S19 in FIG. 13 to generate a composite image. However, at this time, the generation unit 25 performs the calculation of the above-described formula (1) based on the blend ratio for the pixel of the composite image corresponding to the pixel of the target channel in the region to be blended, and the calculated pixel value Is the pixel value of the pixel of the composite image.
- the generating unit 25 When the generating unit 25 generates the composite image, the generating unit 25 supplies the generated composite image to the display control unit 26, and then the process proceeds to step S64.
- step S63 or step S60 When the composite image is generated in step S63 or step S60, the processes in steps S64 to S68 are performed and the display process is terminated. These processes are the same as the processes in steps S20 to S24 in FIG. Therefore, the description is omitted.
- the display device 151 calculates the viewing pixel and the viewing position for each block region based on the viewpoint position of the user, and based on the calculation result, the display device 151 applies the right eye or the pixel to each channel pixel of the block region.
- a composite image is generated by assigning a parallax image for the left eye.
- the display device 151 generates pixels of the composite image corresponding to the pixels of the target channel by blending the left and right parallax images as necessary. Thereby, crosstalk can be reduced and a higher quality image can be presented.
- the display system shown in FIG. 23 includes an imaging device 121, an image processing device 181, and a display device 123.
- the image processing apparatus 181 includes a detection unit 22, an assignment control unit 23, a recording unit 24, and a generation unit 25.
- the image processing device 181 differs from the image processing device 122 in FIG. 15 in that the blend ratio calculation unit 161 is provided in the allocation control unit 23 of the image processing device 181, and the other configurations are the same. It has become.
- the display system shown in FIG. 23 processing similar to the display processing in FIGS. 21 and 22 is performed.
- a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose personal computer or the like.
- FIG. 24 is a block diagram illustrating a configuration example of hardware of a computer that executes the above-described series of processes by a program.
- a CPU Central Processing Unit
- ROM Read Only Memory
- RAM Random Access Memory
- An input / output interface 205 is further connected to the bus 204.
- the input / output interface 205 includes an input unit 206 including a keyboard, a mouse, and a microphone, an output unit 207 including a display and a speaker, a recording unit 208 including a hard disk and nonvolatile memory, and a communication unit 209 including a network interface.
- a drive 210 for driving a removable medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is connected.
- the CPU 201 loads, for example, the program recorded in the recording unit 208 to the RAM 203 via the input / output interface 205 and the bus 204, and executes the program. Is performed.
- Programs executed by the computer (CPU 201) are, for example, a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.), a magneto-optical disk, or a semiconductor.
- the program is recorded on a removable medium 211 that is a package medium including a memory or the like, or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
- the program can be installed in the recording unit 208 via the input / output interface 205 by attaching the removable medium 211 to the drive 210.
- the program can be received by the communication unit 209 via a wired or wireless transmission medium and installed in the recording unit 208.
- the program can be installed in the ROM 202 or the recording unit 208 in advance.
- the program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.
- the present technology can be configured as follows.
- a display unit provided with a plurality of block regions each including pixels of three or more channels; A separation unit that separates an image displayed on a pixel of each channel in the block region; According to the viewpoint position of the user observing the display unit, a parallax image is displayed in a first area consisting of a plurality of pixels adjacent to each other in the block area, and pixels of two or more different channels, and the parallax Any of a plurality of parallax images is displayed on each channel pixel in the block area so that another parallax image having parallax with the image is displayed in a second area different from the first area in the block area.
- An assignment control unit for assigning A display device comprising: a generation unit configured to combine a plurality of parallax images according to the allocation by the allocation control unit and generate a composite image.
- a generation unit configured to combine a plurality of parallax images according to the allocation by the allocation control unit and generate a composite image.
- the allocation control unit Based on the viewpoint position, for each block area, a viewing position calculation unit that obtains a viewing position on a viewing pixel in the block area observed by the user; The position of the block area where the visual recognition position is substantially the center of the visual recognition pixel is calculated as a boundary position, and the block area between the boundary position and another boundary position closest to the boundary position is calculated. And a boundary position calculation unit that assigns the same parallax image to pixels of the same channel in the block region. [5] The boundary position calculation unit is configured to determine the channel of the visible pixel in the block area at the boundary position and the other boundary position with respect to the block area between the boundary position and the other boundary position.
- the display device wherein the same parallax image is assigned to a pixel of the same channel as the channel of the visual recognition pixel in a certain block region.
- the boundary position calculation unit calculates an intermediate position between the boundary position calculated with reference to the user's right eye and the boundary position calculated with reference to the user's left eye as the final boundary position.
- the display device according to [4] or [5].
- the allocation control unit includes the user in the target area from the boundary position calculated with the user's right eye as a reference to the boundary position calculated with the user's left eye as a reference.
- a blend ratio calculation unit that calculates a blend ratio based on a pixel position in the target region for each pixel observed by both the left and right eyes of
- the generator generates the pixel of the composite image displayed on the pixels observed by both the left and right eyes in the target region, the parallax image for the right eye and the parallax image for the left eye.
- the display device according to [6], which is generated by blending at the blend ratio.
- the allocation control unit causes the display unit to display one of the parallax images for the right eye or the left eye when the viewpoint position is outside a predetermined region.
- the display device according to any one of [7].
- 11 display device 21 imaging unit, 22 detection unit, 23 allocation control unit, 25 generation unit, 26 display control unit, 27 display unit, 31 viewpoint position calculation unit, 32 determination unit, 33 visual recognition position calculation unit, 34 boundary position calculation Part, 81-1 to 81-3, 81 opening, 161 blend ratio calculation part
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
[表示装置の構成例]
図1は、本技術を適用した表示装置の一実施の形態の構成例を示す図である。
また、図1の表示部27は、例えば図2に示すように構成される。
例えば、表示装置11を構成する表示部27は、4つの異なる視点の視差画像を表示し、ユーザにそれらの4つの視点のうちの2つの視点の視差画像を観察させることで、視差画像を立体表示可能な4視点用の表示装置とされる。
このような半視距離表示方式で左右の視差画像を表示させる場合、通常の適視距離の約半分の距離だけ離れた位置から表示部27を観察するユーザに、各開口部81を介して同じチャンネルの画素が視認されるようにするには、開口部81間の距離や、開口部81から光変調パネル62までの距離などを適切に定める必要がある。
このように光変調パネル62に対する開口部81の大きさや位置を定める場合、例えば図5に示すように、ユーザが光変調パネル62の真正面から開口部81を見たときに、画素の中心が観察される設計と、画素の間が観察される設計とが考えられる。
次に、左眼用と右眼用の視差画像に基づいて、半視距離表示方式により立体画像を表示させる具体的な制御について説明する。
次に、表示装置11の具体的な動作について説明する。
また、以上においては、表示装置11が単独で半視距離表示方式による立体表示を行なうと説明したが、いくつかの装置からなる表示システムにより、半視距離表示方式での立体表示が行なわれるようにしてもよい。
さらに、以上においては、表示部27が4視点の視差画像を立体表示可能な表示装置である場合を例として説明したが、表示部27は、5以上の複数視点の視差画像を立体表示可能な表示装置であってもよい。
[クロストークの発生と軽減について]
ところで、上述した半視距離表示方式により立体画像を表示すれば、クロストークの発生を抑制し、高品位な画像を提示することができるが、半視距離表示方式においても僅かにクロストークは発生する。
以上のように、クロストーク発生の要因となる画素について、視差画像のブレンドを行なう場合、表示装置は、例えば図20に示すように構成される。
次に、図21および図22のフローチャートを参照して、表示装置151により行なわれる表示処理について説明する。
3以上の複数のチャンネルの画素からなるブロック領域が複数設けられた表示部と、
前記ブロック領域内の各チャンネルの画素に表示された画像を分離させる分離部と、
前記表示部を観察するユーザの視点位置に応じて、前記ブロック領域内の互いに隣接する複数の画素からなり、異なる2以上のチャンネルの画素からなる第1の領域に視差画像が表示され、前記視差画像と視差を有する他の視差画像が前記ブロック領域内の前記第1の領域とは異なる第2の領域に表示されるように、前記ブロック領域内の各チャンネルの画素に複数の視差画像の何れかを割り当てる割り当て制御部と、
前記割り当て制御部による割り当てにしたがって複数の視差画像を合成し、合成画像を生成する生成部と
を備える表示装置。
[2]
前記複数の前記視差画像は、右眼用の前記視差画像と左眼用の前記視差画像である
[1]に記載の表示装置。
[3]
所定の視点位置から前記ユーザが前記表示部を観察した場合、各前記ブロック領域の同じチャンネルの画素が観察される
[2]に記載の表示装置。
[4]
前記割り当て制御部は、
前記視点位置に基づいて、前記ブロック領域ごとに、前記ユーザにより観察される前記ブロック領域内の視認画素上の視認位置を求める視認位置算出部と、
前記視認位置が前記視認画素の略中央となる前記ブロック領域の位置を境界位置として算出するとともに、前記境界位置から、前記境界位置に最も近い他の境界位置までの間にある前記ブロック領域に対して、それらの前記ブロック領域の同じチャンネルの画素に同じ前記視差画像を割り当てる境界位置算出部と
を備える[3]に記載の表示装置。
[5]
前記境界位置算出部は、前記境界位置から前記他の境界位置までの間にある前記ブロック領域に対して、前記境界位置にある前記ブロック領域の前記視認画素のチャンネル、および前記他の境界位置にある前記ブロック領域の前記視認画素のチャンネルと同じチャンネルの画素に、同じ前記視差画像を割り当てる
[4]に記載の表示装置。
[6]
前記境界位置算出部は、前記ユーザの右眼を基準として算出された前記境界位置と、前記ユーザの左眼を基準として算出された前記境界位置との中間の位置を、最終的な前記境界位置とする
[4]または[5]に記載の表示装置。
[7]
前記割り当て制御部は、前記ユーザの右眼を基準として算出された前記境界位置から、前記ユーザの左眼を基準として算出された前記境界位置までを対象領域として、前記対象領域内にある前記ユーザの左右両方の眼で観察される各画素について、前記対象領域における画素位置に基づいてブレンド比率を算出するブレンド比率算出部をさらに備え、
前記生成部は、前記対象領域内の前記左右両方の眼で観察される画素に表示される前記合成画像の画素を、前記右眼用の前記視差画像と前記左眼用の前記視差画像とを前記ブレンド比率でブレンドすることにより生成する
[6]に記載の表示装置。
[8]
前記割り当て制御部は、前記視点位置が予め定められた領域外にある場合、前記右眼用または前記左眼用の前記視差画像のうちの何れかを、前記表示部に表示させる
[2]乃至[7]の何れかに記載の表示装置。
Claims (10)
- 3以上の複数のチャンネルの画素からなるブロック領域が複数設けられた表示部と、
前記ブロック領域内の各チャンネルの画素に表示された画像を分離させる分離部と、
前記表示部を観察するユーザの視点位置に応じて、前記ブロック領域内の互いに隣接する複数の画素からなり、異なる2以上のチャンネルの画素からなる第1の領域に視差画像が表示され、前記視差画像と視差を有する他の視差画像が前記ブロック領域内の前記第1の領域とは異なる第2の領域に表示されるように、前記ブロック領域内の各チャンネルの画素に複数の視差画像の何れかを割り当てる割り当て制御部と、
前記割り当て制御部による割り当てにしたがって複数の視差画像を合成し、合成画像を生成する生成部と
を備える表示装置。 - 前記複数の前記視差画像は、右眼用の前記視差画像と左眼用の前記視差画像である
請求項1に記載の表示装置。 - 所定の視点位置から前記ユーザが前記表示部を観察した場合、各前記ブロック領域の同じチャンネルの画素が観察される
請求項2に記載の表示装置。 - 前記割り当て制御部は、
前記視点位置に基づいて、前記ブロック領域ごとに、前記ユーザにより観察される前記ブロック領域内の視認画素上の視認位置を求める視認位置算出部と、
前記視認位置が前記視認画素の略中央となる前記ブロック領域の位置を境界位置として算出するとともに、前記境界位置から、前記境界位置に最も近い他の境界位置までの間にある前記ブロック領域に対して、それらの前記ブロック領域の同じチャンネルの画素に同じ前記視差画像を割り当てる境界位置算出部と
を備える請求項3に記載の表示装置。 - 前記境界位置算出部は、前記境界位置から前記他の境界位置までの間にある前記ブロック領域に対して、前記境界位置にある前記ブロック領域の前記視認画素のチャンネル、および前記他の境界位置にある前記ブロック領域の前記視認画素のチャンネルと同じチャンネルの画素に、同じ前記視差画像を割り当てる
請求項4に記載の表示装置。 - 前記境界位置算出部は、前記ユーザの右眼を基準として算出された前記境界位置と、前記ユーザの左眼を基準として算出された前記境界位置との中間の位置を、最終的な前記境界位置とする
請求項5に記載の表示装置。 - 前記割り当て制御部は、前記ユーザの右眼を基準として算出された前記境界位置から、前記ユーザの左眼を基準として算出された前記境界位置までを対象領域として、前記対象領域内にある前記ユーザの左右両方の眼で観察される各画素について、前記対象領域における画素位置に基づいてブレンド比率を算出するブレンド比率算出部をさらに備え、
前記生成部は、前記対象領域内の前記左右両方の眼で観察される画素に表示される前記合成画像の画素を、前記右眼用の前記視差画像と前記左眼用の前記視差画像とを前記ブレンド比率でブレンドすることにより生成する
請求項6に記載の表示装置。 - 前記割り当て制御部は、前記視点位置が予め定められた領域外にある場合、前記右眼用または前記左眼用の前記視差画像のうちの何れかを、前記表示部に表示させる
請求項4に記載の表示装置。 - 3以上の複数のチャンネルの画素からなるブロック領域が複数設けられた表示部と、
前記ブロック領域内の各チャンネルの画素に表示された画像を分離させる分離部と、
前記表示部を観察するユーザの視点位置に応じて、前記ブロック領域内の互いに隣接する複数の画素からなり、異なる2以上のチャンネルの画素からなる第1の領域に視差画像が表示され、前記視差画像と視差を有する他の視差画像が前記ブロック領域内の前記第1の領域とは異なる第2の領域に表示されるように、前記ブロック領域内の各チャンネルの画素に複数の視差画像の何れかを割り当てる割り当て制御部と、
前記割り当て制御部による割り当てにしたがって複数の視差画像を合成し、合成画像を生成する生成部と
を備える表示装置の表示方法であって、
前記割り当て制御部が前記ブロック領域内の各チャンネルの画素に視差画像を割り当て、
前記生成部が前記合成画像を生成する
ステップを含む表示方法。 - 3以上の複数のチャンネルの画素からなるブロック領域が複数設けられた表示部と、前記ブロック領域内の各チャンネルの画素に表示された画像を分離させる分離部とを備える表示装置を制御するコンピュータに、
前記表示部を観察するユーザの視点位置に応じて、前記ブロック領域内の互いに隣接する複数の画素からなり、異なる2以上のチャンネルの画素からなる第1の領域に視差画像が表示され、前記視差画像と視差を有する他の視差画像が前記ブロック領域内の前記第1の領域とは異なる第2の領域に表示されるように、前記ブロック領域内の各チャンネルの画素に複数の視差画像の何れかを割り当て、
前記割り当てにしたがって複数の視差画像を合成し、合成画像を生成する
ステップを含む処理を実行させるプログラム。
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12789096.0A EP2717583B1 (en) | 2011-05-26 | 2012-05-17 | Display device and method, and program |
KR1020137029064A KR20140022861A (ko) | 2011-05-26 | 2012-05-17 | 표시 장치 및 방법, 및 프로그램 |
RU2013151418A RU2615330C2 (ru) | 2011-05-26 | 2012-05-17 | Устройство и способ отображения и программа |
KR1020197015914A KR102103681B1 (ko) | 2011-05-26 | 2012-05-17 | 표시 장치 및 방법, 및 프로그램 |
US14/110,486 US9842570B2 (en) | 2011-05-26 | 2012-05-17 | Display device and method, and program |
CN201280024287.0A CN103548346B (zh) | 2011-05-26 | 2012-05-17 | 显示装置和方法 |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011-117650 | 2011-05-26 | ||
JP2011117650 | 2011-05-26 | ||
JP2012-056700 | 2012-03-14 | ||
JP2012056700A JP6050941B2 (ja) | 2011-05-26 | 2012-03-14 | 表示装置および方法、並びにプログラム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012161076A1 true WO2012161076A1 (ja) | 2012-11-29 |
Family
ID=47217154
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/062637 WO2012161076A1 (ja) | 2011-05-26 | 2012-05-17 | 表示装置および方法、並びにプログラム |
Country Status (7)
Country | Link |
---|---|
US (1) | US9842570B2 (ja) |
EP (1) | EP2717583B1 (ja) |
JP (1) | JP6050941B2 (ja) |
KR (2) | KR102103681B1 (ja) |
CN (1) | CN103548346B (ja) |
RU (1) | RU2615330C2 (ja) |
WO (1) | WO2012161076A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103813153A (zh) * | 2014-01-27 | 2014-05-21 | 北京乐成光视科技发展有限公司 | 一种基于加权求和的裸眼3d多视点图像合成方法 |
US20140152663A1 (en) * | 2012-12-03 | 2014-06-05 | Sony Corporation | Image processing device, image processing method, and program |
CN112868226A (zh) * | 2018-08-24 | 2021-05-28 | 三维媒体有限公司 | 适用于具有主导眼的观察者的三维显示器 |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104076592B (zh) * | 2013-03-26 | 2018-06-05 | 上海科斗电子科技有限公司 | 指向光源裸眼3d投影***及其3d成像屏幕 |
JP6931268B2 (ja) * | 2015-06-08 | 2021-09-01 | キヤノン株式会社 | 画像処理装置および画像処理方法 |
KR101963392B1 (ko) * | 2017-08-16 | 2019-03-28 | 한국과학기술연구원 | 무안경식 3차원 영상표시장치의 동적 최대 시역 형성 방법 |
CN107959846B (zh) * | 2017-12-06 | 2019-12-03 | 苏州佳世达电通有限公司 | 影像显示设备及影像显示方法 |
US11356653B2 (en) | 2018-02-23 | 2022-06-07 | Sony Corporation | Display device, display method, and computer program |
EP3989541A4 (en) * | 2019-06-21 | 2023-05-24 | Kyocera Corporation | THREE-DIMENSIONAL DISPLAY DEVICE, THREE-DIMENSIONAL DISPLAY SYSTEM AND MOVABLE OBJECT |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0950019A (ja) | 1995-05-30 | 1997-02-18 | Sanyo Electric Co Ltd | 立体表示装置 |
JP2009077234A (ja) * | 2007-09-21 | 2009-04-09 | Toshiba Corp | 三次元画像処理装置、方法及びプログラム |
US20090123030A1 (en) * | 2006-07-06 | 2009-05-14 | Rene De La Barre | Method For The Autostereoscopic Presentation Of Image Information With Adaptation To Suit Changes In The Head Position Of The Observer |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE59708088D1 (de) * | 1996-12-18 | 2002-10-02 | Dresden 3D Gmbh | Verfahren und anordnung zur dreidimensionalen darstellung von information |
JP2003011423A (ja) | 2001-07-04 | 2003-01-15 | Fuji Photo Film Co Ltd | 画像形成装置 |
US7277121B2 (en) * | 2001-08-29 | 2007-10-02 | Sanyo Electric Co., Ltd. | Stereoscopic image processing and display system |
JP2005110010A (ja) * | 2003-09-30 | 2005-04-21 | Toshiba Corp | 立体画像生成方法および立体画像表示装置 |
DE102004059729B3 (de) * | 2004-12-11 | 2006-04-13 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Verfahren zur autostereoskopischen Erzeugung von dreidimensionalen Bildinformationen aus gerasterten Subpixelauszügen und Anordnung zur Verfahrensdurchführung |
EP1708010A1 (en) * | 2005-03-28 | 2006-10-04 | Kabushiki Kaisha Toshiba | Image display apparatus |
JP4764305B2 (ja) | 2006-10-02 | 2011-08-31 | 株式会社東芝 | 立体画像生成装置、方法およびプログラム |
JP2008134617A (ja) * | 2006-10-23 | 2008-06-12 | Nec Lcd Technologies Ltd | 表示装置、端末装置、表示パネル及び光学部材 |
DE102007055026B4 (de) * | 2007-11-15 | 2011-04-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Verfahren und Vorrichtung zum autostereoskopischen Darstellen von Bildinformationen |
JP5342796B2 (ja) * | 2008-03-27 | 2013-11-13 | 株式会社東芝 | 三次元画像表示方法および装置 |
JP5491702B2 (ja) | 2008-03-28 | 2014-05-14 | 株式会社東芝 | 画像表示装置および画像表示方法 |
JP2011064894A (ja) * | 2009-09-16 | 2011-03-31 | Fujifilm Corp | 立体画像表示装置 |
JP2011081630A (ja) * | 2009-10-07 | 2011-04-21 | Nikon Corp | 画像生成装置、画像生成方法、および、プログラム |
US8964013B2 (en) * | 2009-12-31 | 2015-02-24 | Broadcom Corporation | Display with elastic light manipulator |
-
2012
- 2012-03-14 JP JP2012056700A patent/JP6050941B2/ja active Active
- 2012-05-17 CN CN201280024287.0A patent/CN103548346B/zh active Active
- 2012-05-17 RU RU2013151418A patent/RU2615330C2/ru active
- 2012-05-17 WO PCT/JP2012/062637 patent/WO2012161076A1/ja active Application Filing
- 2012-05-17 KR KR1020197015914A patent/KR102103681B1/ko active IP Right Grant
- 2012-05-17 EP EP12789096.0A patent/EP2717583B1/en active Active
- 2012-05-17 US US14/110,486 patent/US9842570B2/en active Active
- 2012-05-17 KR KR1020137029064A patent/KR20140022861A/ko active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0950019A (ja) | 1995-05-30 | 1997-02-18 | Sanyo Electric Co Ltd | 立体表示装置 |
US20090123030A1 (en) * | 2006-07-06 | 2009-05-14 | Rene De La Barre | Method For The Autostereoscopic Presentation Of Image Information With Adaptation To Suit Changes In The Head Position Of The Observer |
JP2009077234A (ja) * | 2007-09-21 | 2009-04-09 | Toshiba Corp | 三次元画像処理装置、方法及びプログラム |
Non-Patent Citations (1)
Title |
---|
See also references of EP2717583A4 |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140152663A1 (en) * | 2012-12-03 | 2014-06-05 | Sony Corporation | Image processing device, image processing method, and program |
US9282322B2 (en) * | 2012-12-03 | 2016-03-08 | Sony Corporation | Image processing device, image processing method, and program |
CN103856769B (zh) * | 2012-12-03 | 2017-04-12 | 索尼公司 | 图像处理装置和图像处理方法 |
CN103813153A (zh) * | 2014-01-27 | 2014-05-21 | 北京乐成光视科技发展有限公司 | 一种基于加权求和的裸眼3d多视点图像合成方法 |
CN103813153B (zh) * | 2014-01-27 | 2015-12-30 | 万象三维视觉科技(北京)有限公司 | 一种基于加权求和的裸眼3d多视点图像合成方法 |
CN112868226A (zh) * | 2018-08-24 | 2021-05-28 | 三维媒体有限公司 | 适用于具有主导眼的观察者的三维显示器 |
CN112868226B (zh) * | 2018-08-24 | 2023-07-07 | 三维媒体有限公司 | 适用于具有主导眼的观察者的三维显示器 |
Also Published As
Publication number | Publication date |
---|---|
EP2717583A1 (en) | 2014-04-09 |
US20140028670A1 (en) | 2014-01-30 |
RU2615330C2 (ru) | 2017-04-04 |
KR20140022861A (ko) | 2014-02-25 |
JP2013008001A (ja) | 2013-01-10 |
JP6050941B2 (ja) | 2016-12-21 |
US9842570B2 (en) | 2017-12-12 |
KR20190067253A (ko) | 2019-06-14 |
CN103548346B (zh) | 2016-01-20 |
KR102103681B1 (ko) | 2020-04-22 |
RU2013151418A (ru) | 2015-05-27 |
EP2717583A4 (en) | 2014-12-10 |
EP2717583B1 (en) | 2017-11-01 |
CN103548346A (zh) | 2014-01-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5874197B2 (ja) | 表示装置および方法、並びにプログラム | |
JP6050941B2 (ja) | 表示装置および方法、並びにプログラム | |
JP5924046B2 (ja) | 表示装置および方法、情報処理装置および方法、並びにプログラム | |
US8154799B2 (en) | 2D/3D switchable autostereoscopic display apparatus and method | |
US8780013B2 (en) | Display device and method | |
WO2011125368A1 (ja) | 立体画像表示装置、表示システム、駆動方法、駆動装置、表示制御方法、表示制御装置、プログラム、およびコンピュータ読み取り可能な記録媒体 | |
US9253479B2 (en) | Method and apparatus for displaying partial 3D image in 2D image display area | |
US9509984B2 (en) | Three dimensional image display method and device utilizing a two dimensional image signal at low-depth areas | |
MX2013010174A (es) | Dispositivo de visualizacion de imagenes de multiples puntos de vision. | |
JP2010164852A (ja) | 立体画像表示装置、立体画像表示方法 | |
JP2013050538A (ja) | 表示装置および電子機器 | |
JPH0678342A (ja) | 立体表示装置 | |
JP2011186224A5 (ja) | ||
US9019324B2 (en) | Display apparatus and electronic device | |
JP2017520968A (ja) | ディスプレイのための駆動値の生成 | |
KR20150065056A (ko) | 영상 표시 장치 | |
JP2012104375A (ja) | 表示装置およびバックライト装置 | |
JP2019154008A (ja) | 立体画像表示装置、液晶ディスプレイの表示方法、および液晶ディスプレイのプログラム | |
JP2013050539A (ja) | 表示装置および電子機器 | |
EP2737709B1 (en) | Autostereoscopic display system | |
JP5924047B2 (ja) | 表示装置および方法、並びにプログラム | |
JP2013192060A (ja) | 表示装置および情報処理方法、並びにプログラム | |
JP2012203050A (ja) | 立体表示装置並びに信号処理装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12789096 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14110486 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2012789096 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012789096 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 20137029064 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2013151418 Country of ref document: RU Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |