WO2022181156A1 - Système de projection - Google Patents

Système de projection Download PDF

Info

Publication number
WO2022181156A1
WO2022181156A1 PCT/JP2022/002535 JP2022002535W WO2022181156A1 WO 2022181156 A1 WO2022181156 A1 WO 2022181156A1 JP 2022002535 W JP2022002535 W JP 2022002535W WO 2022181156 A1 WO2022181156 A1 WO 2022181156A1
Authority
WO
WIPO (PCT)
Prior art keywords
projector
image
projection
resolution
projection system
Prior art date
Application number
PCT/JP2022/002535
Other languages
English (en)
Japanese (ja)
Inventor
翔吾 久保田
淳弘 千葉
麻里子 西山
龍 宮尾
哲男 池田
真秀 林
裕也 高山
Original Assignee
ソニーグループ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニーグループ株式会社 filed Critical ソニーグループ株式会社
Priority to CN202280015694.9A priority Critical patent/CN116965010A/zh
Publication of WO2022181156A1 publication Critical patent/WO2022181156A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/14—Details
    • G03B21/28—Reflectors in projection beam
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/391—Resolution modifying circuits, e.g. variable screen formats
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor

Definitions

  • the present disclosure relates to a projection system using multiple projectors.
  • a context image projector for rendering a context image a focus image projector for rendering a focus image
  • an image manipulation unit means for detecting a line-of-sight direction
  • an image manipulation unit means for detecting a line-of-sight direction
  • a display device comprising means for detecting viewing direction and a processing unit communicatively connected.
  • a display system with a very wide viewing angle such as a large screen display, a dome theater, a planetarium, or a so-called CAVE system that surrounds a space with multiple screens (hereinafter collectively referred to as a wide viewing angle display)
  • a wide viewing angle display a display system with a very wide viewing angle (field of view)
  • a large screen display such as a large screen display, a dome theater, a planetarium, or a so-called CAVE system that surrounds a space with multiple screens
  • a projection system includes a screen, a first projector that projects a first projection image on the entire area of the screen except one area, and projects a second projection image on the one area of the screen. and one or more mirrors, wherein the optical path of the projection light emitted from the second projector is adjusted by the one or more mirrors to project the second projection image onto one region.
  • an adjustment unit and a lookup table containing correction data for correcting distortion of the second projection image according to the aiming position determined from the line-of-sight information and angle data of one or more mirrors, based on the line-of-sight information, generating a first image signal that forms a first projection image, a second image signal that forms a second projection image, and a mirror angle control signal that controls the angles of one or more mirrors,
  • Each of them includes a first projector, a second projector, and a control section for supplying to the optical path adjusting section.
  • a first projector and a second projector are used to project a first projection image on the entire area of the screen except for one area from the first projector, and a second projector is used.
  • a second projection image corresponding to the one area is projected from the projector of the.
  • the projection system according to an embodiment of the present disclosure further includes an optical path having one or more mirrors for adjusting the optical path of projection light emitted from the second projector and projecting the second projection image onto one region.
  • an adjusting unit for controlling angles of a first image signal forming a first projection image, a second image signal forming a second projection image, and one or more mirrors based on line-of-sight information; a control unit that generates a mirror angle control signal and supplies it to the first projector, the second projector, and the optical path adjustment unit, respectively.
  • the control unit includes a lookup table including correction data for correcting distortion of the second projection image according to the aiming position determined from the line-of-sight information and angle data of one or more mirrors, and a second image The signal is corrected according to the aiming position determined from the line-of-sight information. As a result, a high-quality image is projected onto a desired area (one area).
  • FIG. 1 is a block diagram showing an example configuration of a projection system according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram showing an example of the configuration of a setup projector that includes the projection system shown in FIG. 1
  • FIG. 3 is a schematic diagram showing an example of the configuration of optical systems of two projectors that constitute the projector shown in FIG. 2
  • FIG. 3 is a diagram illustrating another example of a method of adjusting the optical path in the height direction of projection light emitted from a long-focus projector in the setup projector shown in FIG. 2
  • FIG. 3A and 3B are diagrams for explaining an example of a horizontal optical path adjustment method of projection light emitted from a long-focus projector in the setup projector shown in FIG. 2
  • FIG. 9 is a diagram for explaining a method of correcting distortion of the high-resolution image shown in FIG. 8; FIG.
  • FIG. 11 is a schematic diagram showing an example of a configuration of a setup projector viewed from above as Modification 1 of the present disclosure
  • FIG. 12 is a schematic diagram showing an example of the configuration of the setup projector shown in FIG. 11 when viewed from the side
  • FIG. 11 is a schematic diagram showing another example of the configuration of a setup projector as Modified Example 2 of the present disclosure
  • FIG. 11 is a block diagram showing an example of a configuration of a projection system according to modification 6 of the present disclosure
  • FIG. 14 is a block diagram showing an example of a configuration of a projection system according to modification 7 of the present disclosure
  • FIG. 11 is a schematic diagram showing an example of a configuration of a setup projector viewed from above as Modification 1 of the present disclosure
  • FIG. 12 is a schematic diagram showing an example of the configuration of the setup projector shown in FIG. 11 when viewed from the side
  • FIG. 11 is a schematic diagram showing another example of the configuration of a setup projector as Modified Example 2 of the present disclosure
  • FIG. 21 is a schematic diagram showing a configuration example of a setup projector as Modified Example 7 of the present disclosure
  • FIG. 10 is a diagram representing a heat map illustrating Method 1 as Modification 8 of the present disclosure
  • FIG. 11 is a diagram showing an example of an object in Method 2 as Modification 8 of the present disclosure
  • FIG. 21 is a diagram showing another example of the object in Method 2 as Modification 8 of the present disclosure
  • FIG. 21 is a diagram showing another example of the object in Method 2 as Modification 8 of the present disclosure;
  • Embodiment projection system for projecting a high-quality image to a desired position on the screen
  • Modification 2-1 Modification 1 (another example of the projection system) 2-2.
  • Modification 2 another example of projection system) 2-3.
  • Modification 3 another example of projection system
  • Modification 4 another example of projection system) 2-5.
  • Modification 5 another example of projection system
  • Modification 6 another example of projection system
  • Modification 7 another example of projection system
  • Modification 8 another example of projection system) 2-9.
  • Modification 9 another example of projection system
  • FIG. 1 is a block diagram showing an example configuration of a projection system (projection system 1) according to an embodiment of the present disclosure.
  • the projection system 1 includes projectors 10 and 20 , an optical path adjusting section 30 , a control section 40 and a screen 50 .
  • a predetermined area of the projection image projected from the projector 10 onto the entire screen 50 is masked, and a high-resolution projection image is projected from the projector 20 onto the masked area. It projects.
  • the projectors 10 and 20 project, for example, an enlarged projection image (projection light) created by a display device smaller than the size of the projected image (projection image) onto a projection surface such as a wall surface.
  • a projection surface such as a wall surface.
  • the projector 10 can project a projection image on the entire screen 50, for example.
  • the projector 10 corresponds to a specific example of the "first projector" of the present disclosure, and the projected image projected from the projector 10 corresponds to the "first projected image” of the present disclosure.
  • the projector 10 for example, a so-called ultra short focus projector can be used. By using an ultra-short-focus projector as the projector 10, it is possible to prevent the projected image from missing even when the viewer approaches the screen 50.
  • the projector 20 projects a projection image having a higher resolution than the projection image of the projector 10 onto a predetermined area of the screen 50 .
  • the projector 20 corresponds to a specific example of the "second projector" of the present disclosure, and the projected image projected from the projector 20 corresponds to the "second projected image” of the present disclosure.
  • the projector 20 has, for example, a larger projection ratio than the projector 10, and can use, for example, a so-called long focus projector.
  • Table 1 shows an example of the performance of the projector 10 and the projector 20. Although the number of pixels of projector 10 and projector 20 are both 4K, the projection area of projector 20 is 1/25 of the projection area of projector 10 . Therefore, the projector 20 projects an image having 25 times the resolution of the image projected from the projector 10 .
  • FIG. 2 shows an example configuration of a setup projector 100 that includes the projection system 1 shown in FIG.
  • Three projectors 10A, 10B, and 10C are used as the projector 10 in the setup projector 100 .
  • the projection ranges of the three projectors 10A, 10B, and 10C have overlapping ranges that are used for blending with adjacent projectors. In the following description, it is assumed that there is a 20% overlap range.
  • the projection area of the projector 20 is 1/25 of the projection area of the three projectors 10A, 10B, and 10C. Therefore, although the brightness of the projector 20 is 1/25 of the brightness of the projector 10, the image projected from the projector 10 and the image projected from the projector 20 have substantially the same brightness.
  • the projected image projected from the projector 20 is referred to as a "high-resolution image”.
  • FIG. 3 is a schematic diagram showing an example of the configuration of a reflective 3LCD type projector that modulates light using a reflective liquid crystal panel (LCD), as an example of the configuration of the optical system of the projectors 10 and 20 .
  • the projectors 10 and 20 have, for example, a light source section 110 (210), an illumination optical system 120 (220), an optical modulation section 150 (250), and a projection section 140 (240).
  • the light source unit 110 has one or more light sources.
  • a phosphor light source that absorbs light in a predetermined wavelength band as excitation light and emits fluorescence in a wavelength band different from the absorbed excitation light can be used.
  • the light source may be, for example, a solid-state light source that emits light in a predetermined wavelength band.
  • Solid-state light sources include, for example, semiconductor lasers (Laser Diodes: LDs).
  • a light emitting diode (LED) may be used.
  • the light source unit 110 includes, in addition to one or more light sources, for example, a light source driving unit, a light source driver that drives the light source, and a current that sets the current value when driving the light source. and a value setting unit.
  • the light source driver generates a current having a current value set by the current value setting section in synchronization with a signal input from the light source driving section based on power supplied from a power supply section (not shown), for example. The generated current is supplied to the light source.
  • the illumination optical system 120 includes, for example, a pair of fly-eye lenses, a condenser lens, a PS converter 121 (221), and It comprises dichroic mirrors 122 (222), 126 (226) and total reflection mirrors 123 (223), 124 (224), 125 (225).
  • the light modulation unit 150 (250) includes PBSs 151 (251), 152 (252), 153 (253), reflective liquid crystal panels 154R (254R), 154G (254G), 154B (254B), and and a cross prism 155 (255).
  • the projection section 140 (240) projects the synthesized light emitted from the cross prism 155 (255) toward the screen 50. As shown in FIG.
  • the PS converter 121 functions to polarize and transmit the white light Lw incident from the light source section 110 (210).
  • S-polarized light is transmitted as it is, and P-polarized light is converted into S-polarized light.
  • the dichroic mirror 122 (222) has the function of separating the white light Lw transmitted through the PS converter 121 (221) into blue light B and other color lights (red light R, green light G).
  • the total reflection mirror 123 (223) reflects the colored light (red light R, green light G) transmitted through the dichroic mirror 122 (222) toward the total reflection mirror 125 (225). , the reflected light (red light R, green light G) from the total reflection mirror 123 (223) is reflected toward the dichroic mirror 126 (226).
  • the dichroic mirror 126 (226) has a function of separating the color light (red light R, green light G) incident from the total reflection mirror 125 (225) into red light R and green light G.
  • the total reflection mirror 124 (224) reflects the blue light B separated by the dichroic mirror 122 (222) toward the PBS 153 (253).
  • PBSs 151 (251), 152 (252), and 153 (253) are arranged along the optical paths of red light R, green light G, and blue light B, respectively.
  • PBSs (251), 152 (252), and 153 (253) have polarization splitting surfaces 151A (251A), 152A (252A), and 153A (253A), respectively.
  • 252A) and 153A (253A) have the function of separating each incident color light into two mutually orthogonal polarized light components.
  • the polarization separation surfaces 151A (251A), 152A (252A), and 153A (253A) reflect one polarization component (for example, S polarization component) and transmit the other polarization component (for example, P polarization component).
  • Predetermined polarized light components for example, S-polarized component colored light (red light R, green light G and blue light B) is incident.
  • the reflective liquid crystal panels 154R (254R), 154G (254G), and 154B (254B) are driven according to drive voltages applied based on image signals, modulate incident light, and emit the modulated colored light (red light). It functions to reflect light R, green light G and blue light B) toward PBSs 151 (251), 152 (252) and 153 (253), respectively.
  • the cross prism 155 (255) receives predetermined polarized light components emitted from the reflective liquid crystal panels 154R (254R), 154G (254G), and 154B (254B) and transmitted through the PBSs 151 (251), 152 (252), and 153 (253).
  • Colored light (red light R, green light G, and blue light B) of (for example, P-polarized component) is synthesized and emitted toward the projection section 140 (240).
  • the projection unit 140 (240) includes, for example, a plurality of lenses, etc., and magnifies the synthesized light (projection light L1, L2) incident from the light modulation unit 150 (250) and projects the enlarged light onto the screen 50. be.
  • FIG. 2 shows an example of using a reflective liquid crystal panel (LCD) as the display device, but the projectors 10 and 20 are transmissive liquid crystal panels (LCD) that modulate light.
  • LCD liquid crystal panel
  • FIG. 2 shows an example of using a reflective liquid crystal panel (LCD) as the display device, but the projectors 10 and 20 are transmissive liquid crystal panels (LCD) that modulate light.
  • a 3LCD type projector may be used.
  • projectors 10, 20 may use a digital micromirror device (DMD) as a display device.
  • the projectors 10 and 20 may be, for example, laser scanning projectors using Micro Electro Mechanical System (MEMS) mirrors, and may have an optical system different from that shown in FIG.
  • MEMS Micro Electro Mechanical System
  • the optical path adjusting section 30 adjusts the optical path of the projection light L2 emitted from the projector 20 to adjust the projection position of the high-resolution image.
  • the optical path adjustment unit 30 is, for example, a mirror that divides the projection range X of the projector 20 from the center of the screen 50 into the horizontal direction (panning direction (eg, X-axis direction)) and the vertical direction (tilting direction (eg, Z-axis direction)). 31 and a mirror driver 310 .
  • the mirror 31 is composed of, for example, two uniaxial mirrors or one biaxial mirror.
  • uniaxial mirrors include galvanometer mirrors, polygon mirrors, and MEMS mirrors.
  • biaxial mirrors include MEMS mirrors and motorized gimbal mirror holders.
  • the mirror drive unit 310 adjusts the angles of the mirror 31 in the pan direction and the tilt direction.
  • 4 and 5 schematically show how the optical path of the projection light L2 is adjusted by the mirror 31 consisting of two mirrors 31A and 31B, for example.
  • 4 and 5 show an example using a galvanometer mirror as the mirror 31A and a polygon mirror as the mirror 31B.
  • the projection position of the high-resolution image projected from the projector 20 can be adjusted in the Z-axis direction by rotating the reflecting surface 41S of the mirror 31A in the direction of the arrow, as shown in FIG. 4, for example.
  • the projection position of the high-resolution image projected from the projector 20 can be adjusted in the X-axis direction by, for example, rotating a mirror 31B having a plurality of reflecting surfaces 41S1, 41S2, and 41S3 in the direction of the arrow, as shown in FIG. can be adjusted with
  • the control unit 40 has, for example, a high-resolution area determination unit 41, a signal processing unit 42, and a storage unit 43.
  • the line-of-sight information of the observer and the image signal sig0 of the input image are input from an external device.
  • the line-of-sight information is, for example, gazing point coordinates (xy coordinates or ⁇ coordinates) representing which position on the screen 50 the observer is gazing at, and is obtained by, for example, a general tracking technique.
  • the high-resolution area determination unit 41 determines the position of the projection range X (corresponding to "one area” in the present disclosure) of the projector 20 from the input line-of-sight information. Specifically, the projection range of the projector 10 is divided into a plurality of areas in a matrix, for example, and the high-resolution area determination unit 41 determines an area that includes the gaze point coordinates among the plurality of areas. A representative point within this area is defined as the "target position", and the representative point is defined as, for example, central coordinates within the area. The high-resolution area determination unit 41 matches this target position with the center material of the projection range X of the projector 20 . The high-resolution area determination section 41 supplies this aim position information to the signal processing section 42 and the storage section 43 .
  • the signal processing unit 42 performs various signal processing based on the image signal sig0 input from the external device and the target position information supplied from the high-resolution area determining unit 41.
  • the signal processor 42 has, for example, a first image signal generator 421 and a second image signal generator 422 .
  • the image signal sig0 is, for example, an image signal of one high-resolution image covering the entire area of the screen 50, or an image signal of two images with different resolutions as one set.
  • the first image signal generation unit 421 inputs from an external device based on the target position information supplied from the high resolution area determination unit 41.
  • the obtained image signal sig0 is down-converted, for example, and an image signal sig1 (FIG. 6B) is generated by masking (blacking out) the area including the target position into a rectangle or circle, and supplied to the image generation unit 130 of the projector 10. do.
  • This image signal sig1 corresponds to a specific example of the "first image signal" of the present disclosure.
  • the second image signal generation unit 422 generates an image signal sig2 (FIG. 6C) obtained by extracting area information corresponding to the target position information supplied from the high resolution area determination unit 41 from the image signal sig0 input from the external device. It is generated and supplied to the image generating section 230 of the projector 20 .
  • This image signal sig2 corresponds to a specific example of the "second image signal" of the present disclosure.
  • This image signal sig2 may be obtained by up-converting an image signal input from an external device, or by applying super-resolution processing.
  • the first image signal generation unit 421 and the second image signal generation unit 422 perform the following Such signal processing is performed.
  • the image signals having two images with different resolutions as one set are, for example, a low-resolution image signal sig01 (FIG. 7A) that covers the entire area of the screen 50 whose resolution has been reduced in advance by an external device, and a low-resolution image signal sig01 that covers the entire area of the screen 50 It consists of an image signal sig02 (FIG.
  • the first image signal generation unit 421 converts the image signal sig01 input from the external device based on the target position information supplied from the high-resolution area determination unit 41 to the same resolution as in FIG.
  • An image signal sig1 is generated by masking (blacking out) the area including the target position in a rectangle or circle, and is supplied to the image generation unit 130 of the projector 10 .
  • the second image signal generator 422 supplies the image signal sig02 input from the external device to the image generator 230 of the projector 20 as the image signal sig2 (similar to FIG. 6C). Note that the second image signal generation unit 422 may up-convert the image signal sig02 or perform super-resolution processing in the same manner as described above.
  • the image signal sig0 may not be input to the control unit 40 from an external device.
  • it corresponds to the generation of computer graphics (CG) for use in games and amusement.
  • the signal processing unit 42 covers the entire area of the screen 50, a low-resolution image in which a partial area is blackened, and a blackened partial area.
  • the high-resolution images are respectively rendered to generate an image signal sig1 (low-resolution image) and an image signal sig2 (high-resolution image). This reduces the computational load required for rendering.
  • the storage unit 43 includes, for example, a lookup table in which angle data of the pan direction and the tilt direction of the mirror 31 and correction data of the high-resolution image projected from the projector 20 are stored according to the target position information. there is The storage unit 43 reads corresponding angle data and correction data from the target position information supplied from the high-resolution area determination unit 41, and the angle data is sent to the mirror driving unit 310 of the optical path adjustment unit 30, for example, as correction data. are supplied to the image generation unit 230 of the projector 20, for example.
  • the control unit 40 further includes, for example, a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc. (none of which are shown).
  • the CPU reads the control program stored in the ROM, develops it in the RAM, and executes the steps of the program on the RAM.
  • the control unit 40 controls the overall operation of the setup projector 100 by executing the program by this CPU.
  • Correction of high-resolution images is performed, for example, as follows.
  • lookup table for example, as shown in Table 2, pan/tilt mirror angles and projection correction data (map f) are stored for each target position (gazing point coordinates).
  • the projection correction data (map f) is calculated, for example, from the following formula (1).
  • FIG. 9 shows a high-resolution image a of m ⁇ n pixels of the image signal sig2 supplied from the second image signal generation section 422 to the image generation section 230 of the projector 20 by a vertical vector.
  • FIG. 10 shows a high-resolution image b of m′ ⁇ n′ pixels of the image signal sig2′ supplied from the second image signal generator 422 to the image generator 230 of the projector 20 by vertical vectors.
  • the calculation of the following formula (1) is performed for each of R/G/B.
  • b Aa (1) (a: high-resolution image of image signal sig2, b: high-resolution image of image signal sig2′, A: matrix corresponding to mapping f)
  • correction may be performed using a known data format and algorithm in order to reduce the computational load.
  • the image generation unit 130 of the projector 10 performs blending and geometric correction when projecting a projection image over the entire screen 50 using a plurality of projectors 10 (10A, 10B, 10C). to generate an image that is actually projected.
  • the actually projected images are the images displayed on the reflective liquid crystal panels 154R, 154G and 154B of the projectors 10A, 10B and 10C, respectively.
  • a projection image low-resolution image
  • the image signal sig2 supplied from the second image signal generator 422 and the image signal sig2′ subjected to blending and geometric correction based on the correction data supplied from the storage unit 43 are used to generate the projection range X Generate a projection image (high-resolution image) to be projected on the Further, in the image generation unit 230, in order to finely adjust the superimposed position of the high-resolution image on the low-resolution image, an image to be displayed on the reflective liquid crystal panel (for example, the reflective liquid crystal panels 254R, 254G, and 254B) of the projector 20 is generated. You may make it shift up and down, right and left. The amount of adjustment is determined by camera feedback, for example.
  • Projection system 1 of the present embodiment includes projectors 10 and 20 having different projection ratios, an optical path adjustment section 30 that adjusts the optical path of projection light L2 emitted from projector 20, and control section 40.
  • FIG. 1 the projector 20 projects an image of an area including the gaze point coordinates based on line-of-sight information in the input image, and the projector 10 projects an input image of an area other than the area projected from the projector 20.
  • the control unit 40 has a storage unit 43 including a lookup table in which correction data corresponding to the target position is stored. corrected. Thereby, a high-quality image is projected onto a desired area. This will be explained below.
  • an image with a predetermined resolution is projected in areas other than the area of interest, and an image with a higher resolution is projected in the area of interest. I made it project.
  • the projector 10 and the projector 20 having a larger projection ratio than the projector 10 are used, and a projected image having a resolution lower than that of the input image (low-resolution image ), and a projection image (high-resolution image) having a resolution equal to or higher than that of the input image is projected from the projector 20 onto the predetermined area.
  • the high-resolution image projected from the projector 20 is corrected according to the aiming position determined from the line-of-sight information by using the correction data for correcting the distortion according to the aiming position from the lookup table included in the control unit 40.
  • the projection position of the high-resolution image projected from the projector 20 on the screen 50 is adjusted by the optical path adjusting section 30 .
  • the optical path adjusting section 30 has one or more mirrors 31 .
  • the lookup table stores angle data of one or more mirrors according to the target position together with distortion correction data of the high-resolution image according to the target position. ), the angle of the mirror 31 of the optical path adjustment unit 30 is adjusted. This makes it possible to project a high-quality image onto a desired area.
  • the projection system 1 of the present embodiment it is possible to superimpose the low-resolution image projected from the projector 10 and the high-resolution image projected from the projector 20 without distortion.
  • the high-resolution image is selectively projected onto a desired area of the screen 50, and the low-resolution image is projected onto other areas. It is possible to reduce the load of calculation and transmission compared to the case of projecting a high-resolution image on the .
  • FIG. 11 and 12 illustrate an example of a configuration of a setup projector 100A as Modification 1 of the present disclosure.
  • FIG. 11 is a schematic view of the space surrounded by the dome-shaped screen and the setup projector 100A viewed from above
  • FIG. 12 is a schematic view of the space surrounded by the dome-shaped screen shown in FIG. and a schematic view of the setup projector 100A viewed from behind the projector 20.
  • FIG. The projection system 1 of the present disclosure described above can also be applied to, for example, a dome-shaped screen 50 as shown in FIGS. 11 and 12 .
  • FIG. 13 illustrates an example configuration of a setup projector 100B as Modification 2 of the present disclosure.
  • the projection system 1 of the present disclosure described above can also be applied to a so-called CAVE system in which a space is surrounded by a plurality of screens (eg, three screens 50A, 50B, 50C) as shown in FIG.
  • a galvanometer mirror and a polygon mirror are used as the mirrors 31 constituting the optical path adjustment unit 30, so that one projector 20 can display three screens 50A. , 50B and 50C from the projector 20 can be projected at desired positions.
  • Table 3 represents another example of the performance of projector 10 and projector 20 .
  • a brighter projector 20 may be used.
  • a so-called high dynamic range (HDR) projector that raises the maximum brightness that can be expressed may be used.
  • the projector 10 can be made smaller, so power consumption can be reduced. In addition, it becomes possible to improve energy efficiency.
  • Table 4 represents another example of the performance of projector 10 and projector 20 .
  • a high frame rate (HFR) projector may be used.
  • the brightness of the projector 20 is preferably doubled or more.
  • the frame rate of the high-resolution area X can be selectively improved, and the amount of data transfer can be reduced compared to the case where the frame rate of the setup projector 100 as a whole is improved.
  • the frame rate of the setup projector 100 as a whole is improved.
  • Table 5 represents another example of the performance of projector 10 and projector 20 .
  • the light source unit 110 (210) of the projector 10 may use a phosphor light source, and the light source unit 210 of the projector 20 may use a laser light source corresponding to R/G/B.
  • the color gamut of projectors has a trade-off relationship with energy efficiency. Therefore, by using a phosphor light source for the light source unit 110 of the projector 10 and a laser light source for the light source unit 210 of the projector 20, energy efficiency can be improved compared to the case where the color gamut of the entire setup projector 100 is expanded. can be improved.
  • FIG. 14 is a block diagram showing an example of a configuration of a projection system (projection system 2) according to modification 6 of the present disclosure.
  • Projector 20 may further have a zoom mechanism.
  • the high-resolution area determination unit 41 determines the size of the projection range of the projector 20 (hereinafter referred to as the target size) in addition to the target position, and stores target position information and target size information in the signal processing unit 42. It is supplied to the section 43 .
  • the first image signal generation unit 421 generates an image signal sig1 based on the target position information and the target size information, and supplies the image signal sig1 to the image generation unit 130 of the projector 10 .
  • the second image signal generation unit 422 generates an image signal sig ⁇ b>2 by extracting the area information corresponding to the target position information, and supplies the image signal sig ⁇ b>2 to the image generation unit 230 of the projector 20 .
  • the storage unit 43 reads the corresponding angle data, correction data and zoom position data from the aim position information and the aim size information supplied from the high resolution area determination unit 41 .
  • the angle data is supplied to the mirror drive unit 310 of the optical path adjustment unit 30, the correction data is supplied to the image generation unit 230 of the projector 20, for example, and the zoom position data is supplied to the zoom mechanism control unit 260 of the projector 20, for example.
  • FIG. 15 is a block diagram showing an example of a configuration of a projection system (projection system 3) according to modification 7 of the present disclosure.
  • FIG. 16 illustrates an example configuration of a setup projector 100C as Modification 7 of the present disclosure.
  • the projection system 3 further includes a sensing unit 60 that determines the overlap between the optical path of the image light L2 projected from the projector 20 and the current position or future position of the obstructing object Y such as an observer or an obstacle. good too.
  • the sensing unit 60 acquires the three-dimensional position of the shielding object Y, and is composed of, for example, a camera, a TOF (Time Of Flight) sensor, an infrared sensor, or the like. Further, the sensing unit 60 may predict the future position of the shielding object Y from the current positional information of the shielding object Y and the past positional information accumulated during a certain period of time. When the sensing unit 60 determines that the optical path of the image light L2 projected from the projector 20 and the current position of the shielding object Y overlap, this information is supplied to the signal processing unit 42 .
  • TOF Time Of Flight
  • the first image signal generation unit 421 generates an image signal sig1 without blackout without using the target position information and the target size information, and supplies the image signal sig1 to the image generation unit 130 of the projector 10 .
  • the image signal sig0 may be down-converted in the first image signal generator 421 .
  • the signal processing unit 42 supplies the image generating unit 230 of the projector 20 with a signal for turning off the projector 20 , for example, a signal for setting the light source output of the projector 20 to zero and a signal including an all-black display signal.
  • the target position information and the target size in the first image signal generation unit 421 Interruption of generation of the image signal sig1 based on the information and turning off of the projector 20 may be performed gradually.
  • the sensing unit 60 may be configured by an invisible light (eg, infrared light) projection device coaxial with the projector 20 and an invisible light detection unit.
  • the invisible light detection unit for example, an imager capable of monitoring invisible light, specifically, a camera system capable of observing the entire area of the screen 50, a light receiver coaxial with the projector 20, or installed on the back of the screen 50 It can be configured with a When the light receiver is installed on the back surface of the screen 50, the screen 50 is formed with fine holes or the screen 50 is made of a material that transmits invisible light.
  • the invisible light is monitored at a frequency equal to or higher than the frame rate of the projected image, and when there is a change equal to or greater than the threshold, the optical path of the image light L2 projected from the projector 20 and the current of the shielding object Y are detected. It is determined that an overlap with the position has occurred.
  • a sensing unit 60 is added to determine the overlap between the optical path of the image light L2 projected from the projector 20 and the current position or future position of the obstructing object Y such as an observer or an obstacle. As a result, it is possible to prevent the image from being lost and the sense of immersion from being impaired when the observer approaches the screen 50 .
  • line-of-sight information for example, pseudo information generated from image information (image signal) input from an external device may be used. Pseudo line-of-sight information can be generated using, for example, the following method.
  • Method 1 Estimation of statistic information of gaze point
  • the pseudo line-of-sight information is input from an external device from a generator that has learned statistical information (heat map) of gaze points for an image using a machine learning method as teacher data.
  • a heat map for the image information is estimated, and the coordinate with the highest intensity is used as the line-of-sight information (X 0 ).
  • the intensity is represented by shading, and the position where the intensity is lower is shown brighter, and the position where the intensity is higher is shown darker.
  • heat map information may be supplied to the high-resolution area determination unit 41 along with the coordinates, and the target position and target size may be determined from the intensity distribution near the coordinates where the intensity of the heat map is the highest.
  • the pseudo line-of-sight information can be obtained by identifying a desired object (for example, soccer, baseball, etc.) from an image signal input from an external device by means of image recognition.
  • a ball (Fig. 18) is detected in a sports watching video, an artist (Fig. 19) in a concert video, and an explanatory plate (Fig. 20) of an exhibit in a museum, etc.), and the center of the object is used as line-of-sight information (X 0 ). use.
  • an object that is expected to be of high interest to the observer is detected from the image information input from an external device, and the shape of the object that is closed with the contour line or the shape that the object is filled with is detected.
  • the center of gravity or the center of a rectangle surrounding the object is used as line-of-sight information.
  • image information of the shape of the object along with the coordinates may be supplied to the high-resolution region determination unit 41, and the target position and target size may be determined from the shape.
  • the pseudo line-of-sight information is obtained by, for example, dividing an image of an image signal input from an external device into a plurality of regions, performing spatial frequency analysis, and using the central coordinates of the region with the largest high-frequency component as line-of-sight information.
  • two types of image signals having different resolutions may be input to the control unit 40 as input images.
  • the high-resolution image signal is generated by feeding back the line-of-sight information of the frame immediately before input to the transmission unit of the input image. This makes it possible to greatly reduce the load of transmitting the input image from the external device to the control unit 40 as compared with the case of inputting one type of input image.
  • the present disclosure can also be configured as follows. According to the present technology having the following configuration, the first projector and the second projector are used, the first projection image is projected on the entire area of the screen except for one region from the first projector, and the second projector to project a second projection image corresponding to the one area.
  • the projection system according to an embodiment of the present disclosure further includes an optical path having one or more mirrors for adjusting the optical path of projection light emitted from the second projector and projecting the second projection image onto one region.
  • an adjusting unit for controlling angles of a first image signal forming a first projection image, a second image signal forming a second projection image, and one or more mirrors based on line-of-sight information; a control unit that generates a mirror angle control signal and supplies it to the first projector, the second projector, and the optical path adjustment unit, respectively.
  • the control unit includes a lookup table including correction data for correcting distortion of the second projection image according to the aiming position determined from the line-of-sight information and angle data of one or more mirrors, and a second image The signal is corrected according to the aiming position determined from the line-of-sight information.
  • a screen a first projector that projects a first projection image on the entire area of the screen except for one area; a second projector that projects a second projection image onto the first area of the screen; an optical path adjustment unit that includes one or more mirrors and adjusts an optical path of projection light emitted from the second projector by the one or more mirrors to project the second projection image onto the first area; , a lookup table including correction data for correcting distortion of the second projected image according to an aim position determined from line-of-sight information and angle data of the one or more mirrors; generating a first image signal that forms a first projection image, a second image signal that forms the second projection image, and a mirror angle control signal that controls angles of the one or more mirrors; and a control section for supplying to the first projector, the second projector, and the optical path adjustment section, respectively.
  • the projection system according to (1) wherein the first projection image has the one region masked. (3) dividing the projection range of the first projector into a plurality of areas; The projection system according to (1) or (2), wherein the lookup table stores the correction data for each region and the angle data of the one or more mirrors.
  • the control unit has a high-resolution area determination unit, a signal processing unit, and a storage unit including the lookup table, The high-resolution area determination unit determines an area that includes gaze point coordinates among the plurality of areas in the projection range of the first projector, The projection system according to (3), wherein the signal processing section receives information on the region from the high resolution region determination section and generates the first image signal and the second image signal.
  • any one of (1) to (12) above wherein a heat map of gaze points for an input image input to the control unit is estimated in advance, and coordinates having the highest intensity are input to the control unit as the line-of-sight information.
  • the projection system of claim 1. (12) 12. The method according to any one of the above (1) to (12), wherein a predetermined target object is detected from an input image input in advance to the control unit, and central coordinates of the target object are used as the line-of-sight information. projection system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

Un système de projection selon un mode de réalisation de la présente divulgation comprend : un écran ; un premier projecteur qui projette une première image de projection sur la totalité de l'écran à l'exception d'une région de celui-ci ; un second projecteur qui a un rapport de projection supérieur à celui du premier projecteur, et projette une seconde image de projection sur la région de l'écran ; une unité de réglage de chemin optique qui comprend un ou plusieurs miroirs, et utilise le ou les miroirs pour régler le chemin optique de la lumière de projection émise par le second projecteur et projeter la seconde image de projection sur la première région ; et une unité de commande qui comprend une table de conversion comprenant des données d'angle pour le ou les miroirs et des données de correction pour corriger une distorsion de la seconde image de projection, les données correspondant à une position de visée déterminée à partir des informations de regard, génère, sur la base des informations de regard, un premier signal d'image formant la première image de projection, un second signal d'image formant la seconde image de projection et un signal de commande d'angle de miroir qui commande l'angle ou les angles du ou des miroirs, et fournit respectivement ces signaux au premier projecteur, au second projecteur et à l'unité de réglage de chemin optique.
PCT/JP2022/002535 2021-02-26 2022-01-25 Système de projection WO2022181156A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202280015694.9A CN116965010A (zh) 2021-02-26 2022-01-25 投射***

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021031153 2021-02-26
JP2021-031153 2021-02-26

Publications (1)

Publication Number Publication Date
WO2022181156A1 true WO2022181156A1 (fr) 2022-09-01

Family

ID=83049101

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/002535 WO2022181156A1 (fr) 2021-02-26 2022-01-25 Système de projection

Country Status (2)

Country Link
CN (1) CN116965010A (fr)
WO (1) WO2022181156A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008116565A (ja) * 2006-11-01 2008-05-22 Seiko Epson Corp 画像補正装置、プロジェクションシステム、画像補正方法、画像補正プログラム、および記録媒体
WO2016098600A1 (fr) * 2014-12-17 2016-06-23 ソニー株式会社 Dispositif et procédé de traitement d'informations
US9588408B1 (en) * 2014-05-15 2017-03-07 Autofuss Methods and systems for projecting a target portion of an image at a higher resolution
JP2019179390A (ja) * 2018-03-30 2019-10-17 株式会社Ｐｒｅｆｅｒｒｅｄ Ｎｅｔｗｏｒｋｓ 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008116565A (ja) * 2006-11-01 2008-05-22 Seiko Epson Corp 画像補正装置、プロジェクションシステム、画像補正方法、画像補正プログラム、および記録媒体
US9588408B1 (en) * 2014-05-15 2017-03-07 Autofuss Methods and systems for projecting a target portion of an image at a higher resolution
WO2016098600A1 (fr) * 2014-12-17 2016-06-23 ソニー株式会社 Dispositif et procédé de traitement d'informations
JP2019179390A (ja) * 2018-03-30 2019-10-17 株式会社Ｐｒｅｆｅｒｒｅｄ Ｎｅｔｗｏｒｋｓ 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル

Also Published As

Publication number Publication date
CN116965010A (zh) 2023-10-27

Similar Documents

Publication Publication Date Title
US9955149B2 (en) Method and device for projecting a 3-D viewable image
US8556431B2 (en) Apparatus and method for reducing speckle in display of images
US10672349B2 (en) Device for project an image
US9664376B2 (en) Projection-type image display apparatus
US9244275B1 (en) Visual display system using multiple image sources and heads-up-display system using the same
US7052142B2 (en) Enhanced resolution projector
JP5431312B2 (ja) プロジェクタ
US20100097393A1 (en) Display apparatus
KR20120023627A (ko) 고 동적 범위 투사 시스템
JP2008116565A (ja) 画像補正装置、プロジェクションシステム、画像補正方法、画像補正プログラム、および記録媒体
US10298920B2 (en) Projector and method of controlling a projector
RU2629889C1 (ru) Устройство отображения изображения и способ управления устройством отображения изображения
EP3064994A1 (fr) Système et procédé pour une résolution spatiale améliorée
WO2019154942A1 (fr) Appareil d'affichage à champ lumineux et réseau de projection
CN108848359B (zh) 影像显示***及影像显示方法
JP2012018214A (ja) 投写型映像表示装置
CN208903641U (zh) 投影装置
CN111751982B (zh) 一种扫描显示方法及装置
WO2022181156A1 (fr) Système de projection
CN114760451B (zh) 投影图像校正提示方法、装置、投影设备和存储介质
JP2006138895A (ja) 画像表示装置、液晶パネルの駆動方法
JP6931820B2 (ja) 照明装置
CN214480802U (zh) 基于光同步的激光电视投影装置
JP2016181865A (ja) 映像処理装置、表示装置、及び、映像処理方法
CN114257796B (zh) 投影装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22759198

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280015694.9

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22759198

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP