WO2023032956A1 - Display control device, head-up display device, and display control method - Google Patents

Display control device, head-up display device, and display control method Download PDF

Info

Publication number
WO2023032956A1
WO2023032956A1 PCT/JP2022/032526 JP2022032526W WO2023032956A1 WO 2023032956 A1 WO2023032956 A1 WO 2023032956A1 JP 2022032526 W JP2022032526 W JP 2022032526W WO 2023032956 A1 WO2023032956 A1 WO 2023032956A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
length
glow
content image
display
Prior art date
Application number
PCT/JP2022/032526
Other languages
French (fr)
Japanese (ja)
Inventor
華子 本間
Original Assignee
日本精機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本精機株式会社 filed Critical 日本精機株式会社
Publication of WO2023032956A1 publication Critical patent/WO2023032956A1/en

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/27—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving lenticular arrays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/30—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving parallax barriers
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/02—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37—Details of the operation on graphic patterns
    • G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor

Definitions

  • the present disclosure relates to a display control device, a head-up display device, and a head-up display device that are used in a mobile object such as a vehicle and superimpose an image on the foreground of the mobile object (actual view in the forward direction of the mobile object seen from the vehicle occupant). It relates to a display control method and the like.
  • Patent Document 1 display light projected onto a projection target such as a front windshield of a vehicle is reflected toward an occupant (observer) of the vehicle inside the vehicle, thereby presenting a virtual image to the observer.
  • a visual head-up display device (an example of a virtual image display device) is described.
  • the head-up display device described in Patent Literature 1 sets a vanishing point at a predetermined position in front of the vehicle and uses the one-point perspective method to reduce the size of an image (virtual image) in far representation, and to reduce the size of an image (virtual image) in near representation.
  • a head-up display device is described that increases the size of a (virtual image) to give a sense of perspective. This makes it possible to add distance information to the image (virtual image), thereby assisting the observer's spatial recognition or improving the distinguishability of the image (virtual image).
  • the content image may be emphasized by applying a glow effect to the displayed content image.
  • a glow effect to the displayed content image.
  • the outline of the present disclosure relates to providing a display control device, a head-up display device, a display control method, and the like that display an image with high visibility. More specifically, it also relates to suppressing a decrease in image visibility due to a glow effect.
  • the display control device, head-up display device, display control method, etc. described in this specification employ the following means in order to solve the above problems.
  • This embodiment displays a content image in which perspective is expressed, and one or more glow images that are displayed in the horizontal direction of the content image and do not have a clear outline, and content expressed in the distance is displayed.
  • the gist of it is to reduce the size of the glow image relative to the image.
  • the display control device executes display control in a head-up display device that allows an observer to visually recognize a virtual image of an image by projecting the image onto a projection target member.
  • a controller comprising one or more processors, a memory, and one or more computer programs stored in the memory and configured to be executed by the one or more processors;
  • the processor performs content image display processing for displaying a content image in which perspective is expressed, and glow display for displaying one or more glow images that are displayed at least in the horizontal direction of the content image and do not have a clear outline.
  • the content image display process has a first content image having a first length in the horizontal direction and a second length in the horizontal direction that is less than the first length; and displaying a second content image that is farther away than the first content image as seen from the viewer, at the same time or at different timings.
  • displaying a first glow image that is displayed in the horizontal direction of the first content image has a fourth length between the left end and the right end, and is displayed in the horizontal direction of the second content image Display a second glow image that is displayed, and the glow image such that the ratio of the fourth length to the second length is less than the ratio of the third length to the first length.
  • a display control device is a display control device that executes display control in a head-up display device that allows an observer to visually recognize a virtual image of an image by projecting an image onto a projection target member, one or more processors, a memory, and one or more computer programs stored in the memory and configured to be executed by the one or more processors, the processors for generating depth representations
  • a content image display process for displaying a content image to which a perceptible depth of expression is added, and a glow display process for displaying one or more glow images that are displayed at least in the horizontal direction of the content image and do not have a clear outline.
  • the content image display processing includes: a first content image having a first length in the horizontal direction and viewed at a first position as viewed by the viewer; a second content image having a second length shorter than the length and viewed from the viewer at a second position above the first position, and displaying the second content image at the same time or at different timings.
  • the glow display process displays a first glow image that has a third length between the left end and the right end and is displayed in the horizontal direction of the first content image, and displays a first glow image that is displayed in the horizontal direction of the first content image; displaying a second glow image that has a fourth length and is displayed to the left and right of the second content image, and a ratio of the fourth length to the second length is the first A length between the left and right edges of the glow image is set to be less than a third length to length ratio.
  • the processor in the display control device of the second embodiment that can be subordinate to the first embodiment, gradually shortens the horizontal length of the first content image while increasing the width of the first content image.
  • the processor By moving from the position to the second position, the second content image is displayed, and in the glow display process, the ratio of the length of the glow image that moves with the content image to the length of the content image in the horizontal direction is , gradually decreases as the content image moves upward. According to this, by gradually decreasing (shortening) the size (horizontal length) of the content image and moving it upward, the perspective of the content image can be perceived more strongly.
  • it has the advantage that the information indicated by the content image can be easily viewed.
  • the processor increases the transmittance of the glow image when the representation depth is farther than a predetermined threshold.
  • the predetermined threshold is deeper than the second representation depth.
  • the processor hides the glow image when the representation depth is farther than a predetermined threshold, the predetermined threshold being deeper than a second representation depth. In this case, since the glow image is hidden, there is an advantage that the information indicated by the content image can be seen more easily.
  • the processor controls a plurality of image elements in which the second content image is arranged in the horizontal direction. , the ratio of the length of the glow image moving with the content image to the horizontal length of the content image is further reduced. In this case, even when displaying an image in which the identifiability of individual image elements deteriorates, it is possible to suppress the deterioration of the identifiability, and there is an advantage that the information indicated by the content image can be easily viewed.
  • the processor sets the color of the glow image to be similar to the color of the content image, Also, the saturation is set low. In this case, the visual attention is more easily directed to the content image than to the glow image, and an advantage of improving the visibility of the content image is also assumed.
  • the head-up display device includes any display control device according to some embodiments, a light modulation element that emits display light, and display light from the light modulation element. and a relay optical system directed to a projection target. Again, the same advantages as above are assumed.
  • a display control method is a display control method in a head-up display device that allows an observer to visually recognize a virtual image of an image by projecting the image onto a projection target member.
  • a content image display process for displaying a content image to which expression depth is added to make the expression perceptible, and a glow display for displaying one or more glow images that are displayed at least in the horizontal direction of the content image and do not have a clear outline.
  • the content image display processing includes a first content image having a first length in the horizontal direction and viewed from a viewer at a first position; A second content image having a second length shorter than the length and viewed from the observer at a second position above the first position is displayed at the same time or at different timings, and glow display The processing comprises displaying a first glow image having a third length between the left end and the right end and displayed in a horizontal direction of the first content image, and displaying a fourth glow image between the left end and the right end.
  • a length between the left edge and the right edge of the glow image is set to be less than the third length ratio.
  • FIG. 1 is a diagram showing an application example of a vehicle display system to a vehicle.
  • FIG. 2 is a diagram showing the configuration of the head-up display device.
  • FIG. 3 is a diagram showing an example of a foreground visually recognized by an observer and a perceptual image superimposed on the foreground and displayed while the host vehicle is running.
  • FIG. 4 is a diagram showing one aspect of the glow image G. As shown in FIG. FIG. 5 is a display of a first glow image added to a first content image perceived on the near side and a second glow image added to a second content image perceived on the far side.
  • FIG. 4 is a diagram showing an embodiment;
  • FIG. 6 is a block diagram of a vehicle display system of some embodiments.
  • FIG. 7 is a diagram showing changes in the glow ratio Wg with respect to the expression depth E.
  • FIG. 8 is a diagram showing changes in the glow ratio Wg with respect to the expression depth E.
  • FIG. 9 is a diagram showing changes in the glow ratio Wg with respect to the expression depth E.
  • FIG. 10 is a diagram showing changes in the glow ratio Wg with respect to the expression depth E.
  • FIG. 1 is a diagram showing an example of the configuration of a vehicle virtual image display system.
  • the left-right direction of a vehicle (an example of a moving body) 1 (in other words, the width direction of the vehicle 1) is the X axis (the positive direction of the X axis is the left direction when the vehicle 1 faces forward).
  • the vertical direction (in other words, the height direction of the vehicle 1) along a line segment that is perpendicular to the left-right direction and is perpendicular to the ground or a surface corresponding to the ground (here, the road surface 6) is the Y-axis (Y-axis is the upward direction), and the front-rear direction along a line segment perpendicular to each of the left-right direction and the up-down direction is the Z-axis (the positive direction of the Z-axis is the straight-ahead direction of the vehicle 1).
  • the Y-axis is the upward direction
  • the front-rear direction along a line segment perpendicular to each of the left-right direction and the up-down direction is the Z-axis (the positive direction of the Z-axis is the straight-ahead direction of the vehicle 1).
  • a vehicle display system 10 provided in a vehicle (self-vehicle) 1 displays the positions and line-of-sight directions of a left eye 700L and a right eye 700R of an observer (typically, a driver sitting in the driver's seat of the vehicle 1).
  • HUD device up display device
  • the eye position detection unit (line of sight detection unit) 409 and the vehicle exterior sensor 411 may be omitted.
  • FIG. 2 is a diagram showing one aspect of the configuration of the head-up display device.
  • the HUD device 20 is installed, for example, in a dashboard (reference numeral 5 in FIG. 1).
  • the HUD device 20 accommodates a stereoscopic image display device (image display device) 40, a relay optical system 80, and the stereoscopic image display device 40 and the relay optical system 80, and the display light K from the stereoscopic image display device 40 is internally transmitted.
  • the image display device 40 is not limited to a stereoscopic image display device that displays 3D images, and may display 2D images.
  • the stereoscopic image display device 40 is assumed here to be a parallax 3D display device.
  • This stereoscopic display device (parallax type 3D display device) 40 is a display device 50 which is a naked-eye stereoscopic display device using a multi-viewpoint image display system capable of controlling depth representation by visually recognizing left-viewpoint images and right-viewpoint images, and , and a light source unit 60 that functions as a backlight.
  • the display 50 has a light modulation element 51 that modulates the illumination light from the light source unit 60 to generate an image, and, for example, a lenticular lens or a parallax barrier (parallax barrier).
  • a lenticular lens or a parallax barrier parallax barrier
  • Left eye display light such as light rays K11, K12 and K13 (reference symbol K10 in FIG. 1) and right eye display light such as light rays K21, K22 and K23 (in FIG. 1). symbol K20) and an optical layer (an example of a light beam splitting section) 52.
  • the optical layer 52 includes optical filters such as lenticular lenses, parallax barriers, lens arrays, and microlens arrays.
  • the optical layer 52 is not limited to the optical filter described above, and includes all types of optical layers arranged on the front or rear surface of the light modulation element 51 . However, this is an example and is not limited.
  • the light source unit 60 may be configured with a directional backlight unit (an example of the light separating section).
  • left-eye display light such as light rays K11, K12 and K13 (symbol K10 in FIG. 1) and right-eye display light such as light rays K21, K22 and K23 (symbol K20 in FIG. 1). and may be emitted.
  • the display control device 30, which will be described later, causes the light modulation element 51 to display a left-viewpoint image when the directional backlight unit emits illumination light directed toward the left eye 700L.
  • right-eye display light K20 such as right-eye light rays K21, K22, and K23 is directed to the left eye 700L of the observer.
  • this is an example and is not limited.
  • the display control device 30 which will be described later, performs, for example, image rendering processing (graphic processing), display device driving processing, and the like, so that the display light K10 for the left eye of the left viewpoint image V10 and the display light K10 for the left eye and the display light K10 for the right eye 700R of the observer's left eye 700L are displayed.
  • image rendering processing graphics processing
  • display device driving processing and the like
  • the aspect of the perception image FU displayed by the HUD device 20 is controlled. be able to.
  • the display control device 30 controls the display (display device 50) so as to reproduce a light field that (approximately) reproduces light rays output in various directions from a point in a fixed space.
  • the relay optical system 80 has curved mirrors (concave mirrors, etc.) 81 and 82 that reflect the light from the stereoscopic image display device 40 and project the image display lights K10 and K20 onto the windshield (projection target member) 2 .
  • it may further include other optical members (refractive optical members such as lenses, diffractive optical members such as holograms, reflective optical members, or combinations thereof).
  • images with parallax for the left and right eyes are displayed by the stereoscopic image display device 40 of the HUD device 20 .
  • Each parallax image is displayed as V10 and V20 formed on a virtual image display surface (virtual image formation surface) VS, as shown in FIG.
  • the focus of each eye of the observer (person) is adjusted so as to match the position of the virtual image display area VS.
  • the position of the virtual image display area VS is referred to as an "adjustment position (or imaging position)", and a predetermined reference position (for example, the center 205 of the eyebox 200 of the HUD device 20, the observer's viewpoint position, or , a specific position of the vehicle 1, etc.) to the virtual image display area VS is referred to as an adjustment distance (imaging distance).
  • an adjustment position or imaging position
  • imaging distance imaging distance
  • the human brain fuses each image (virtual image), the human is at a position farther back than the adjustment position (for example, due to the convergence angle between the left viewpoint image V10 and the right viewpoint image V20). It is a fixed position, and the position perceived as being farther away from the observer as the angle of convergence decreases) is recognized as a perceptual image (here, an arrowhead figure for navigation) FU is displayed. do.
  • the perceptual image FU may be referred to as a "stereoscopic virtual image”, and may also be referred to as a "stereoscopic image” when the "image” is taken in a broad sense to include virtual images. It may also be referred to as a "stereoscopic image", "3D display", or the like.
  • FIG. 3 is a diagram showing an example of a foreground visually recognized by an observer and a perceptual image superimposed on the foreground and displayed while the vehicle 1 is running.
  • FIG. 3 the vehicle 1 is traveling on a straight road (road surface) 6.
  • the HUD device 20 is installed inside the dashboard 5 .
  • Display light K (K10, K20) is projected from the light exit window 21 of the HUD device 20 onto the projected portion (front windshield of the vehicle 1) 2.
  • FIG. 3 a first content image FU1 that is superimposed on the road surface 6 and indicates the route of the vehicle 1 (indicating straight ahead here), similarly indicates the route of the vehicle 1 (indicating straight ahead here).
  • a second content image FU2 that is perceived farther than the first content image FU1
  • a first glow image G1 that is displayed in the horizontal direction of the first content image FU1 and does not have a clear outline
  • a second A second glow image G2 which is displayed in the left-right direction of the content image FU2 and does not have a clear outline
  • the display control device 30 (HUD device 20) of the present embodiment displays a content image FU and a glow image G displayed in the horizontal direction of the content image FU.
  • Advantages such as decorating the content image FU, emphasizing the content image FU, improving perspective, or a combination of these are assumed.
  • FIG. 4 is a diagram showing one aspect of the glow image G.
  • the horizontal length ⁇ g of the glow image G as viewed by the observer is longer than the horizontal length ⁇ f of the content image FU.
  • the vertical length ⁇ g of the glow image G as seen from the observer is longer than the vertical length ⁇ f of the content image FU (this is not limited).
  • the difference ( ⁇ g ⁇ f) between the horizontal length ⁇ g of the glow image G and the horizontal length ⁇ f of the content image FU is the vertical length ⁇ g of the glow image G and the vertical length of the content image FU. (This is not limited).
  • the vertical length ⁇ g of the glow image G as seen by the observer may be equal to or shorter than the vertical length ⁇ f of the content image FU.
  • the glow image G has a similar color and lower saturation to the content image FU.
  • the similar color means that the angle formed from the center of the color wheel is 60 degrees or less. More preferably, the angle formed by the color of the glow image G and the color of the content image FU from the center of the color wheel is 30 degrees or less (this is not limited).
  • the chromaticity of the glow image G may be similar to the average chromaticity of the pixels of the content image FU, and the saturation may be lowered. .
  • FIG. 5 shows a first glow image G1 added to the first content image FU1 perceived on the near side and a second content image FU2 added to the far side of the first content image FU1.
  • FIG. 10 is a diagram showing a display mode of a second glow image G2 that is shown in FIG.
  • the first content image FU1 has a near-perceived first representation depth E10
  • the second content image FU2 has a far-perceived second representation depth than the first content image FU1. It has E20.
  • “Representational depth” corresponds to the display distance of the image, the size of the image, or a combination thereof.
  • representation depth in some embodiments corresponds to image display distance
  • a first content image FU1 having a first representation depth E10 is displayed near the reference position and a second representation depth E20 is displayed far from the reference position.
  • the representation depth in some embodiments corresponds to the size of the image
  • the first content image FU1 with the first representation depth E10 is displayed large and the second representation depth E20 with the second representation depth E20.
  • 2 content image FU2 is displayed small.
  • the representation depth in some embodiments corresponds to the display distance and size of the image
  • the first content image FU1 having the first representation depth E10 is displayed large near the reference position
  • a second content image FU2 having a second depth of expression E20 is displayed in a small size far from the reference position.
  • the ratio of the horizontal length ⁇ g20 of the second glow image G2 to the horizontal length ⁇ f20 of the second content image FU2 represented at a distance is the horizontal direction of the first content image FU1 perceived on the near side. is smaller than the ratio of the horizontal length ⁇ g10 of the first glow image G1 to the length ⁇ f10 ( ⁇ g20/ ⁇ f20 ⁇ g10/ ⁇ f10). That is, according to some embodiments, as the representation depth E increases, the ratio of the horizontal length ⁇ g of the glow image to the horizontal length ⁇ f of the content image (hereinafter also referred to as the glow ratio). Wg may be made small. As a result, it is possible to make the information indicated by the content image easier to see while expressing perspective.
  • the display control device 30 gradually or continuously changes the ratio (glow ratio) Wg of the horizontal length ⁇ g of the glow image to the horizontal length ⁇ f of the content image.
  • Table data, arithmetic expressions, etc. for reducing the size may be stored in the memory 37 in advance.
  • FIG. 6 is a block diagram of a vehicle virtual image display system according to some embodiments.
  • the display controller 30 comprises one or more I/O interfaces 31 , one or more processors 33 , one or more image processing circuits 35 and one or more memories 37 .
  • FIG. 6 is just one embodiment and the components shown may be combined into fewer components or there may be additional components.
  • image processing circuitry 35 eg, a graphics processing unit
  • processor 33 and image processing circuitry 35 are operatively coupled with memory 37 . More specifically, the processor 33 and the image processing circuit 35 execute a program stored in the memory 37 to generate and/or transmit image data, for example, the vehicle display system 10 (image display device 40) can be controlled.
  • Processor 33 and/or image processing circuitry 35 may include at least one general purpose microprocessor (e.g., central processing unit (CPU)), at least one application specific integrated circuit (ASIC), at least one field programmable gate array (FPGA). , or any combination thereof.
  • Memory 37 includes any type of magnetic media such as hard disks, any type of optical media such as CDs and DVDs, any type of semiconductor memory such as volatile memory, and non-volatile memory. Volatile memory may include DRAM and SRAM, and non-volatile memory may include ROM and NVRAM.
  • processor 33 is operatively coupled with I/O interface 31 .
  • the I / O interface 31 communicates (CAN communication).
  • MOST is a registered trademark
  • a wired communication interface such as UART or USB
  • PAN personal area network
  • a local network such as an 802.11x Wi-Fi network.
  • LAN area network
  • the I / O interface 31 is a wireless wide area network (WWAN0, IEEE802.16-2004 (WiMAX: Worldwide Interoperability for Microwave Access)), IEEE802.16e base (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced,
  • An external communication (external communication) interface such as a wide area communication network (for example, Internet communication network) may be included according to a cellular communication standard such as 5G.
  • the processor 33 is interoperably coupled with the I/O interface 31 to communicate with various other electronic devices and the like connected to the vehicle display system 10 (I/O interface 31). can be given and received.
  • the I/O interface 31 includes, for example, a vehicle ECU 401, a road information database 403, a vehicle position detection unit 405, an operation detection unit 407, an eye position detection unit 409, an external sensor 411, a brightness detection unit 413, an IMU 415, portable information A terminal 417, an external communication device 419, etc. are operatively coupled.
  • the I/O interface 31 may include a function of processing (converting, calculating, and analyzing) information received from other electronic devices or the like connected to the vehicle display system 10 .
  • the image display device 40 is operatively connected to the processor 33 and the image processing circuit 35 . Accordingly, the image displayed by light modulating element 51 may be based on image data received from processor 33 and/or image processing circuitry 35 .
  • the processor 33 and image processing circuit 35 control the image displayed by the light modulation element 51 based on the information obtained from the I/O interface 31 .
  • the software components stored in the memory 37 include a display parameter setting module 510, a graphics module 512, a light source driving module 514, and an actuator driving module 516.
  • Display parameter setting module 510 includes various software components for performing various operations related to setting display parameters of a virtual image to be displayed based on various information and commands obtained from I/O interface 31. including. That is, the display parameter setting module 510 can include table data, arithmetic expressions, etc. for specifying display parameters from various information acquired from the I/O interface 31 .
  • the types of display parameters are as follows: (1) an image layout that has a predetermined positional relationship with a real object positioned outside the vehicle 1 when viewed from the eye position 700 (image display device 40 for controlling the image layout); and/or actuators.), (2) parameters for pre-distorting the image to reduce image distortion that may be caused by, for example, the virtual image optics 90 viewed from the eye position 700.
  • the display parameters set (selected) by the display parameter setting module 510 are not limited to these.
  • the display parameter setting module 510 of this embodiment reduces the size of the glow image G with respect to the content image FU represented at a distance.
  • FIG. 7 to 10 are diagrams showing changes in the glow ratio Wg with respect to the expression depth E.
  • FIG. 7 (1) the horizontal length of the first content image FU1 represented by the first representation depth E11 is ⁇ f11, and the first content image FU1 added to the first content image FU1 The horizontal length of the glow image G1 is ⁇ g11, and the first glow ratio Wg is ⁇ g11/ ⁇ f11.
  • the horizontal length of the second content image FU2 represented by the second representation depth E21 is ⁇ f21, and the horizontal length of the second glow image G2 added to the second content image FU2 is The length in the direction is ⁇ g21 and the second glow ratio Wg is ⁇ g21/ ⁇ f21.
  • the processor 33 (display control device 30) in some embodiments, when the representation depth E is shallower than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11), the representation depth E First, the glow ratio Wg is kept constant at the first glow ratio ( ⁇ g11/ ⁇ f11), while the representation depth E is greater than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11). If it is deep, the glow ratio Wg is kept constant at the second glow ratio ( ⁇ g21/ ⁇ f21) regardless of the expression depth E.
  • the horizontal length of the first content image FU1 represented by the first representation depth E12 is ⁇ f12
  • the first content image FU1 added to the first content image FU1 The horizontal length of the glow image G1 is ⁇ g12
  • the first glow ratio Wg is ⁇ g12/ ⁇ f12.
  • the horizontal length of the second content image FU2 represented by the second expression depth E22 is ⁇ f22
  • the horizontal length of the second glow image G2 added to the second content image FU2 is The direction length is ⁇ g22 and the second glow ratio Wg is ⁇ g22/ ⁇ f22.
  • the processor 33 (display control device 30) in some embodiments, when the representation depth E is shallower than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11), the representation depth E First, the glow ratio Wg is kept constant at the first glow ratio ( ⁇ g11/ ⁇ f11), while the representation depth E is greater than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11).
  • the glow ratio Wg is gradually decreased from the second glow ratio as the expression depth E increases, and when a predetermined value ( ⁇ g21/ ⁇ f21) is reached, the glow ratio Wg remains constant even if the expression depth E increases. maintain.
  • the horizontal length of the first content image FU1 represented by the first representation depth E13 is ⁇ f13
  • the first content image FU1 added to the first content image FU1 The horizontal length of the glow image G1 is ⁇ g13
  • the first glow ratio Wg is ⁇ g13/ ⁇ f13.
  • the horizontal length of the second content image FU2 represented by the second representation depth E23 is ⁇ f23
  • the horizontal length of the second glow image G2 added to the second content image FU2 is The length in the direction is ⁇ g23 and the second glow ratio Wg is ⁇ g23/ ⁇ f23.
  • the processor 33 (display control device 30) in some embodiments, when the representation depth E is shallower than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11), the representation depth E First, the glow ratio Wg is kept constant at the first glow ratio ( ⁇ g11/ ⁇ f11), while the representation depth E is greater than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11).
  • the glow ratio Wg is gradually decreased from the second glow ratio as the expression depth E becomes deeper, and when the expression depth E reaches a predetermined threshold Th1, the glow ratio Wg is set to zero (that is, hide glow image G).
  • the horizontal length of the first content image FU1 represented by the first representation depth E14 is ⁇ f14, and the first content image FU1 added to the first content image FU1
  • the horizontal length of the glow image G1 is ⁇ g14, and the first glow ratio Wg is ⁇ g14/ ⁇ f14.
  • the horizontal length of the second content image FU2 represented by the second expression depth E24 is ⁇ f24, and the horizontal length of the second glow image G2 added to the second content image FU2 is The direction length is ⁇ g24 and the second glow ratio Wg is ⁇ g24/ ⁇ f24.
  • the processor 33 (display control device 30) in some embodiments, when the representation depth E is shallower than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11), the representation depth E First, the glow ratio Wg is kept constant at the first glow ratio ( ⁇ g11/ ⁇ f11), while the representation depth E is greater than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11). When the depth becomes deeper, the glow ratio Wg is kept constant at the second glow ratio ( ⁇ g21/ ⁇ f21) regardless of the expression depth E, and when the expression depth E reaches a predetermined threshold value Th1 or more, the glow image G increase the transmittance of
  • Graphics module 512 includes various known software components for performing image processing such as rendering to generate image data and for driving image display device 40 .
  • the graphic module 512 also controls the type, arrangement (positional coordinates, angle), size, display distance (in the case of 3D), visual effects (for example, brightness, transparency, saturation, contrast, or and other visual characteristics), may include various known software components.
  • the graphic module 512 stores the type of image (one example of display parameters), the positional coordinates of the image (one example of display parameters), the angle of the image (pitch angle with the X direction as the axis, Y direction as the axis, yaw rate angle around the axis, rolling angle around the Z direction, etc., which are examples of display parameters), image size (one example of display parameters), image color (hue, saturation , brightness, etc.), image data can be generated and the light modulation element 51 can be driven so as to be visually recognized by the observer.
  • the light source driving module 514 includes various known software components for performing driving the light source unit 24 .
  • the light source driving module 514 can drive the light source unit 24 based on the set display parameters.
  • Actuator drive module 516 includes various known software components for performing the driving of first actuator 28 and/or second actuator 29. One actuator 28 and a second actuator 29 can be driven.
  • vehicle display system 10 is optionally implemented in hardware, software, or a combination of hardware and software to carry out the principles of the various described embodiments. It is noted that the functional blocks illustrated in FIG. 10 may optionally be combined or separated into two or more sub-blocks to implement the principles of the described embodiments. will be understood by those skilled in the art. Accordingly, the description herein optionally supports any possible combination or division of the functional blocks described herein.
  • Vehicle 3D Parallax 5 : Dashboard 6 : Road surface 10 : Vehicle display system 20 : HUD device 21 : Light exit window 22 : Housing 24 : Light source unit 28 : First actuator 29 : Second actuator 30 : Display Control device 31 : I/O interface 33 : Processor 35 : Image processing circuit 37 : Memory 40 : Image display device 50 : Display 51 : Light modulation element 52 : Optical layer 60 : Light source unit 80 : Relay optical system 90 : Virtual image optics System 200: Eyebox 205: Center 401: Vehicle ECU 403 : Road information database 405 : Vehicle position detection unit 407 : Operation detection unit 409 : Eye position detection unit 411 : Exterior sensor 413 : Brightness detection unit 417 : Portable information terminal 419 : External communication device 510 : Display parameter setting module 512 : graphic module 514 : light source driving module 516 : actuator driving module 700 : eye position 700L : left eye 700R : right eye E : representation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Instrument Panels (AREA)

Abstract

The present invention suppresses a decrease in the visibility of a content image due to a glow effect. A processor displays one or more glow images G displayed at least in the left-hand and right-hand directions of a content image FU and not having a clear outline, displays a first content image FU1 having a first length αf10 in a lateral direction and a second content image FU2 having a second length αf20 shorter than the first length αf10 in the lateral direction and represented at a greater distance than the first content image as seen from a viewer simultaneously or at different timings, displays a first glow image G1 having a third length αg10 and displayed in the left-hand and right-hand directions of the first content image FU1, displays a second glow image G2 having a fourth length αg20 and displayed in the left-hand and right-hand directions of the second content image FU2, and sets the length between a left end and a right end of the glow image G such that αg20/αf20 < αg10/αf10 holds.

Description

表示制御装置、ヘッドアップディスプレイ装置、及び表示制御方法Display control device, head-up display device, and display control method
　本開示は、車両等の移動体で使用され、移動体の前景（車両の乗員から見た移動体の前進方向の実景）に画像を重畳して視認させる表示制御装置、ヘッドアップディスプレイ装置、及び表示制御方法等に関する。 The present disclosure relates to a display control device, a head-up display device, and a head-up display device that are used in a mobile object such as a vehicle and superimpose an image on the foreground of the mobile object (actual view in the forward direction of the mobile object seen from the vehicle occupant). It relates to a display control method and the like.
　特許文献１には、車両のフロントウインドシールド等の被投影部に投射される表示光が、車両の内側にいる車両の乗員（観察者）に向けて反射されることで、観察者に虚像を視認させるヘッドアップディスプレイ装置（虚像表示装置の一例）が記載されている。特に、特許文献１に記載のヘッドアップディスプレイ装置は、車両前方の所定の位置に消失点を設定して一点透視図法により、遠表現では画像（虚像）の大きさを小さくし、近表現では画像（虚像）の大きさを大きくすることで、遠近感を知覚させるヘッドアップディスプレイ装置が記載されている。これにより、画像（虚像）に距離的情報を付加することができ、観察者の空間認識を補助すること、又は画像（虚像）の識別性を向上させることができる。 In Patent Document 1, display light projected onto a projection target such as a front windshield of a vehicle is reflected toward an occupant (observer) of the vehicle inside the vehicle, thereby presenting a virtual image to the observer. A visual head-up display device (an example of a virtual image display device) is described. In particular, the head-up display device described in Patent Literature 1 sets a vanishing point at a predetermined position in front of the vehicle and uses the one-point perspective method to reduce the size of an image (virtual image) in far representation, and to reduce the size of an image (virtual image) in near representation. A head-up display device is described that increases the size of a (virtual image) to give a sense of perspective. This makes it possible to add distance information to the image (virtual image), thereby assisting the observer's spatial recognition or improving the distinguishability of the image (virtual image).
特開２０２０－１５８０１４号公報JP 2020-158014 A
　ところで、表示するコンテンツ画像にグロー効果を施すことで、コンテンツ画像を強調することがある。一点透視図法によりコンテンツ画像を小さくした場合、グロー効果によりコンテンツ画像の視認性が低下するという問題が想定される。 By the way, the content image may be emphasized by applying a glow effect to the displayed content image. When the content image is made smaller by the one-point perspective drawing method, a problem is assumed that the visibility of the content image is lowered due to the glow effect.
　本明細書に開示される特定の実施形態の要約を以下に示す。これらの態様が、これらの特定の実施形態の概要を読者に提供するためだけに提示され、この開示の範囲を限定するものではないことを理解されたい。実際に、本開示は、以下に記載されない種々の態様を包含し得る。 A summary of certain embodiments disclosed herein is provided below. It should be understood that these aspects are presented only to provide the reader with an overview of these particular embodiments and are not intended to limit the scope of this disclosure. Indeed, the present disclosure may encompass various aspects not described below.
　本開示の概要は、視認性の高い画像を表示する表示制御装置、ヘッドアップディスプレイ装置、及び表示制御方法等を提供することに関する。より具体的には、グロー効果による画像の視認性の低下を抑制する、ことにも関する。 The outline of the present disclosure relates to providing a display control device, a head-up display device, a display control method, and the like that display an image with high visibility. More specifically, it also relates to suppressing a decrease in image visibility due to a glow effect.
　したがって、本明細書に記載される表示制御装置、ヘッドアップディスプレイ装置、及び表示制御方法等は、前記課題を解決するため、以下の手段を採用した。本実施形態は、遠近法が表現されたコンテンツ画像と、コンテンツ画像の左右方向に表示され、はっきりとした輪郭を有さない１つ又は複数のグロー画像と、を表示し、遠方表現されたコンテンツ画像に対するグロー画像の大きさを小さくする、ことをその要旨とする。 Therefore, the display control device, head-up display device, display control method, etc. described in this specification employ the following means in order to solve the above problems. This embodiment displays a content image in which perspective is expressed, and one or more glow images that are displayed in the horizontal direction of the content image and do not have a clear outline, and content expressed in the distance is displayed. The gist of it is to reduce the size of the glow image relative to the image.
　したがって、本明細書に記載される第１実施態様における表示制御装置は、画像を被投影部材に投影することで、観察者に画像の虚像を視認させるヘッドアップディスプレイ装置における表示制御を実行する表示制御装置であって、１つ又は複数のプロセッサと、メモリと、メモリに格納され、１つ又は複数のプロセッサによって実行されるように構成される１つ又は複数のコンピュータ・プログラムと、を備え、プロセッサは、遠近法が表現されたコンテンツ画像を表示するコンテンツ画像表示処理と、コンテンツ画像の少なくとも左右方向に表示され、はっきりとした輪郭を有さない１つ又は複数のグロー画像を表示するグロー表示処理と、を実行し、コンテンツ画像表示処理は、横方向に第１の長さを有する第１のコンテンツ画像、及び、横方向に第１の長さより短い第２の長さを有し、観察者から見て第１のコンテンツ画像より遠方表現される第２のコンテンツ画像、を同時又は異なるタイミングで表示させる処理、を含み、グロー表示処理は、左端と右端との間に第３の長さを有し、第１のコンテンツ画像の左右方向に表示される第１のグロー画像を表示させ、左端と右端との間に第４の長さを有し、第２のコンテンツ画像の左右方向に表示される第２のグロー画像を表示させ、及び、第２の長さに対する第４の長さの比率が、第１の長さに対する第３の長さの比率より小さくなるように、グロー画像の左端と右端との間の長さを設定する。この場合、遠近感を表現しつつもコンテンツ画像が示す情報を見やすくすることができるという利点を有している。 Therefore, the display control device according to the first embodiment described in this specification executes display control in a head-up display device that allows an observer to visually recognize a virtual image of an image by projecting the image onto a projection target member. a controller, comprising one or more processors, a memory, and one or more computer programs stored in the memory and configured to be executed by the one or more processors; The processor performs content image display processing for displaying a content image in which perspective is expressed, and glow display for displaying one or more glow images that are displayed at least in the horizontal direction of the content image and do not have a clear outline. and a process, wherein the content image display process has a first content image having a first length in the horizontal direction and a second length in the horizontal direction that is less than the first length; and displaying a second content image that is farther away than the first content image as seen from the viewer, at the same time or at different timings. and displaying a first glow image that is displayed in the horizontal direction of the first content image, has a fourth length between the left end and the right end, and is displayed in the horizontal direction of the second content image Display a second glow image that is displayed, and the glow image such that the ratio of the fourth length to the second length is less than the ratio of the third length to the first length. Sets the length between the left and right edges of the . In this case, there is an advantage that the information indicated by the content image can be easily viewed while expressing perspective.
　好ましい別の第１実施形態における表示制御装置では、画像を被投影部材に投影することで、観察者に画像の虚像を視認させるヘッドアップディスプレイ装置における表示制御を実行する表示制御装置であって、１つ又は複数のプロセッサと、メモリと、メモリに格納され、１つ又は複数のプロセッサによって実行されるように構成される１つ又は複数のコンピュータ・プログラムと、を備え、プロセッサは、奥行き表現を知覚させる表現深度を付加したコンテンツ画像を表示するコンテンツ画像表示処理と、コンテンツ画像の少なくとも左右方向に表示され、はっきりとした輪郭を有さない１つ又は複数のグロー画像を表示するグロー表示処理と、を実行し、コンテンツ画像表示処理は、横方向に第１の長さを有し、観察者から見て第１の位置に視認される第１のコンテンツ画像、及び、横方向に第１の長さより短い第２の長さを有し、観察者から見て第１の位置より上側の第２の位置に視認される第２のコンテンツ画像、を同時又は異なるタイミングで表示させる処理、を含み、グロー表示処理は、左端と右端との間に第３の長さを有し、第１のコンテンツ画像の左右方向に表示される第１のグロー画像を表示させ、左端と右端との間に第４の長さを有し、第２のコンテンツ画像の左右方向に表示される第２のグロー画像を表示させ、及び、第２の長さに対する第４の長さの比率が、第１の長さに対する第３の長さの比率より小さくなるように、グロー画像の左端と右端との間の長さを設定する。この場合、遠近感を表現しつつもコンテンツ画像が示す情報を見やすくすることができるという利点を有している。 A display control device according to another preferable first embodiment is a display control device that executes display control in a head-up display device that allows an observer to visually recognize a virtual image of an image by projecting an image onto a projection target member, one or more processors, a memory, and one or more computer programs stored in the memory and configured to be executed by the one or more processors, the processors for generating depth representations A content image display process for displaying a content image to which a perceptible depth of expression is added, and a glow display process for displaying one or more glow images that are displayed at least in the horizontal direction of the content image and do not have a clear outline. , and the content image display processing includes: a first content image having a first length in the horizontal direction and viewed at a first position as viewed by the viewer; a second content image having a second length shorter than the length and viewed from the viewer at a second position above the first position, and displaying the second content image at the same time or at different timings. , the glow display process displays a first glow image that has a third length between the left end and the right end and is displayed in the horizontal direction of the first content image, and displays a first glow image that is displayed in the horizontal direction of the first content image; displaying a second glow image that has a fourth length and is displayed to the left and right of the second content image, and a ratio of the fourth length to the second length is the first A length between the left and right edges of the glow image is set to be less than a third length to length ratio. In this case, there is an advantage that the information indicated by the content image can be easily viewed while expressing perspective.
　また、第１実施形態に従属し得る第２実施形態の表示制御装置では、プロセッサは、コンテンツ画像表示処理において、第１のコンテンツ画像を、横方向の長さを徐々に短くしつつ、第１の位置から第２の位置に移動させることで、第２のコンテンツ画像を、表示し、グロー表示処理において、コンテンツ画像の横方向の長さに対するコンテンツ画像とともに移動するグロー画像の長さの比率を、コンテンツ画像が上方に移動するに従い、徐々に小さくする。これによれば、コンテンツ画像のサイズ（横方向の長さ）を徐々に小さく（短く）しつつ、上側に移動させることでコンテンツ画像の遠近感をより強く知覚させることができ、このような場合でもコンテンツ画像が示す情報を見やすくすることができるという利点を有している。 Further, in the display control device of the second embodiment that can be subordinate to the first embodiment, in the content image display process, the processor gradually shortens the horizontal length of the first content image while increasing the width of the first content image. By moving from the position to the second position, the second content image is displayed, and in the glow display process, the ratio of the length of the glow image that moves with the content image to the length of the content image in the horizontal direction is , gradually decreases as the content image moves upward. According to this, by gradually decreasing (shortening) the size (horizontal length) of the content image and moving it upward, the perspective of the content image can be perceived more strongly. However, it has the advantage that the information indicated by the content image can be easily viewed.
　また、第１又は第２実施形態に従属し得る第３実施形態の実施形態におけるいずれかの表示制御装置では、プロセッサは、表現深度が所定の閾値より遠い場合、グロー画像の透過率を高くし、所定の閾値は、第２の表現深度より深い。この場合、グロー画像を残しつつも目立たなくなるため、コンテンツ画像が示す情報を見やすくすることができるという利点を有している。また、好ましい別の実施形態におけるいずれかの表示制御装置では、プロセッサは、表現深度が所定の閾値より遠い場合、グロー画像を非表示とし、所定の閾値は、第２の表現深度より深い。この場合、グロー画像が非表示になるため、よりコンテンツ画像が示す情報を見やすくすることができるという利点を有している。 Also, in any of the display control devices in the embodiments of the third embodiment that can be dependent on the first or second embodiment, the processor increases the transmittance of the glow image when the representation depth is farther than a predetermined threshold. , the predetermined threshold is deeper than the second representation depth. In this case, since the glow image remains inconspicuous, there is an advantage that the information indicated by the content image can be easily seen. Also in any of the display controllers in another preferred embodiment, the processor hides the glow image when the representation depth is farther than a predetermined threshold, the predetermined threshold being deeper than a second representation depth. In this case, since the glow image is hidden, there is an advantage that the information indicated by the content image can be seen more easily.
　また、第１乃至３実施形態に従属し得る第４実施形態の実施形態におけるいずれかの表示制御装置では、プロセッサは、グロー表示処理において、第２のコンテンツ画像が左右方向に並ぶ複数の画像要素を含む場合、コンテンツ画像の横方向の長さに対するコンテンツ画像とともに移動するグロー画像の長さの比率をさらに小さくする。この場合、個々の画像要素の識別性が低下する画像を表示する場合でも、識別性低下を抑制することができ、コンテンツ画像が示す情報を見やすくすることができるという利点を有している。 Further, in any one of the display control devices according to the fourth embodiment that can be subordinate to the first to third embodiments, in the glow display processing, the processor controls a plurality of image elements in which the second content image is arranged in the horizontal direction. , the ratio of the length of the glow image moving with the content image to the horizontal length of the content image is further reduced. In this case, even when displaying an image in which the identifiability of individual image elements deteriorates, it is possible to suppress the deterioration of the identifiability, and there is an advantage that the information indicated by the content image can be easily viewed.
　また、第１乃至４実施形態に従属し得る第５実施形態の実施形態におけるいずれかの表示制御装置では、プロセッサは、グロー画像の色を、コンテンツ画像の色に対して、同系色であり、且つ、彩度を低く設定する。この場合、グロー画像よりもコンテンツ画像に視覚的注意が向きやすくなり、コンテンツ画像の視認性を向上させるという利点も想定される。 Further, in any one of the display control devices in the fifth embodiment that can be subordinate to the first to fourth embodiments, the processor sets the color of the glow image to be similar to the color of the content image, Also, the saturation is set low. In this case, the visual attention is more easily directed to the content image than to the glow image, and an advantage of improving the visibility of the content image is also assumed.
　本明細書に記載される第６実施態様におけるヘッドアップディスプレイ装置では、いくつかの実施形態におけるいずれかの表示制御装置と、表示光を出射する光変調素子と、光変調素子からの表示光を被投影部にむけるリレー光学系と、を備える。この場合も、上記と同様の利点が想定される。 The head-up display device according to the sixth embodiment described in this specification includes any display control device according to some embodiments, a light modulation element that emits display light, and display light from the light modulation element. and a relay optical system directed to a projection target. Again, the same advantages as above are assumed.
　本明細書に記載される第７実施態様における表示制御方法では、画像を被投影部材に投影することで、観察者に画像の虚像を視認させるヘッドアップディスプレイ装置における表示制御方法であって、奥行き表現を知覚させる表現深度を付加したコンテンツ画像を表示するコンテンツ画像表示処理と、コンテンツ画像の少なくとも左右方向に表示され、はっきりとした輪郭を有さない１つ又は複数のグロー画像を表示するグロー表示処理と、を含み、コンテンツ画像表示処理は、横方向に第１の長さを有し、観察者から見て第１の位置に視認される第１のコンテンツ画像、及び、横方向に第１の長さより短い第２の長さを有し、観察者から見て第１の位置より上側の第２の位置に視認される第２のコンテンツ画像、を同時又は異なるタイミングで表示させ、グロー表示処理は、左端と右端との間に第３の長さを有し、第１のコンテンツ画像の左右方向に表示される第１のグロー画像を表示させ、左端と右端との間に第４の長さを有し、第２のコンテンツ画像の左右方向に表示される第２のグロー画像を表示させ、及び、第２の長さに対する第４の長さの比率が、第１の長さに対する第３の長さの比率より小さくなるように、グロー画像の左端と右端との間の長さを設定する。 A display control method according to the seventh embodiment described in this specification is a display control method in a head-up display device that allows an observer to visually recognize a virtual image of an image by projecting the image onto a projection target member. A content image display process for displaying a content image to which expression depth is added to make the expression perceptible, and a glow display for displaying one or more glow images that are displayed at least in the horizontal direction of the content image and do not have a clear outline. wherein the content image display processing includes a first content image having a first length in the horizontal direction and viewed from a viewer at a first position; A second content image having a second length shorter than the length and viewed from the observer at a second position above the first position is displayed at the same time or at different timings, and glow display The processing comprises displaying a first glow image having a third length between the left end and the right end and displayed in a horizontal direction of the first content image, and displaying a fourth glow image between the left end and the right end. displaying a second glow image having a length and displayed to the left and right of the second content image, and a ratio of the fourth length to the second length to the first length is A length between the left edge and the right edge of the glow image is set to be less than the third length ratio.
図１は、車両用表示システムの車両への適用例を示す図である。FIG. 1 is a diagram showing an application example of a vehicle display system to a vehicle. 図２は、ヘッドアップディスプレイ装置の構成を示す図である。FIG. 2 is a diagram showing the configuration of the head-up display device. 図３は、自車両の走行中において、観察者が視認する前景と、前記前景に重畳して表示される知覚画像の例を示す図である。FIG. 3 is a diagram showing an example of a foreground visually recognized by an observer and a perceptual image superimposed on the foreground and displayed while the host vehicle is running. 図４は、グロー画像Ｇの一態様を示す図である。FIG. 4 is a diagram showing one aspect of the glow image G. As shown in FIG. 図５は、近傍側に知覚される第１のコンテンツ画像に付加される第１のグロー画像と、遠方側に知覚される第２のコンテンツ画像に付加される第２のグロー画像と、の表示態様を示す図である。FIG. 5 is a display of a first glow image added to a first content image perceived on the near side and a second glow image added to a second content image perceived on the far side. FIG. 4 is a diagram showing an embodiment; 図６は、いくつかの実施形態の車両用表示システムのブロック図である。FIG. 6 is a block diagram of a vehicle display system of some embodiments. 図７は、表現深度Ｅに対するグロー比率Ｗｇの変化を示す図である。FIG. 7 is a diagram showing changes in the glow ratio Wg with respect to the expression depth E. FIG. 図８は、表現深度Ｅに対するグロー比率Ｗｇの変化を示す図である。FIG. 8 is a diagram showing changes in the glow ratio Wg with respect to the expression depth E. FIG. 図９は、表現深度Ｅに対するグロー比率Ｗｇの変化を示す図である。FIG. 9 is a diagram showing changes in the glow ratio Wg with respect to the expression depth E. FIG. 図１０は、表現深度Ｅに対するグロー比率Ｗｇの変化を示す図である。FIG. 10 is a diagram showing changes in the glow ratio Wg with respect to the expression depth E. FIG.
　以下、図１ないし図１０では、例示的な車両用表示システムの構成、及び動作の説明を提供する。なお、本発明は以下の実施形態（図面の内容も含む）によって限定されるものではない。下記の実施形態に変更（構成要素の削除も含む）を加えることができるのはもちろんである。また、以下の説明では、本発明の理解を容易にするために、公知の技術的事項の説明を適宜省略する。 1 through 10 provide a description of the configuration and operation of an exemplary vehicular display system. In addition, the present invention is not limited by the following embodiments (including the contents of the drawings). Of course, modifications (including deletion of constituent elements) can be added to the following embodiments. In addition, in the following description, descriptions of known technical matters are omitted as appropriate in order to facilitate understanding of the present invention.
　図１を参照する。図１は、車両用虚像表示システムの構成の一例を示す図である。なお、図１において、車両（移動体の一例。）１の左右方向（換言すると、車両１の幅方向）をＸ軸（Ｘ軸の正方向は、車両１の前方を向いた際の左方向。）とし、左右方向に直交すると共に、地面又は地面に相当する面（ここでは路面６）に直交する線分に沿う上下方向（換言すると、車両１の高さ方向）をＹ軸（Ｙ軸の正方向は、上方向。）とし、左右方向及び上下方向の各々に直交する線分に沿う前後方向をＺ軸（Ｚ軸の正方向は、車両１の直進方向。）とする。この点は、他の図面においても同様である。 See Figure 1. FIG. 1 is a diagram showing an example of the configuration of a vehicle virtual image display system. In FIG. 1, the left-right direction of a vehicle (an example of a moving body) 1 (in other words, the width direction of the vehicle 1) is the X axis (the positive direction of the X axis is the left direction when the vehicle 1 faces forward). ), and the vertical direction (in other words, the height direction of the vehicle 1) along a line segment that is perpendicular to the left-right direction and is perpendicular to the ground or a surface corresponding to the ground (here, the road surface 6) is the Y-axis (Y-axis is the upward direction), and the front-rear direction along a line segment perpendicular to each of the left-right direction and the up-down direction is the Z-axis (the positive direction of the Z-axis is the straight-ahead direction of the vehicle 1). This point also applies to other drawings.
　図示するように、車両（自車両）１に備わる車両用表示システム１０は、観察者（典型的には車両１の運転席に着座する運転者）の左目７００Ｌと右目７００Ｒの位置や視線方向を検出する瞳（あるいは顔）検出用の目位置検出部（視線検出部）４０９、車両１の前方（広義には周囲）を撮像するカメラ（例えばステレオカメラ）などで構成される車外センサ４１１、ヘッドアップディスプレイ装置（以下では、ＨＵＤ装置とも呼ぶ）２０及び、ＨＵＤ装置２０を制御する表示制御装置３０、を有する。なお、目位置検出部（視線検出部）４０９、及び車外センサ４１１は、省略され得る。 As illustrated, a vehicle display system 10 provided in a vehicle (self-vehicle) 1 displays the positions and line-of-sight directions of a left eye 700L and a right eye 700R of an observer (typically, a driver sitting in the driver's seat of the vehicle 1). An eye position detection unit (line-of-sight detection unit) 409 for detecting a pupil (or face) to be detected, an exterior sensor 411 configured by a camera (for example, a stereo camera) for imaging the front (broadly speaking, the surroundings) of the vehicle 1, a head It has an up display device (hereinafter also referred to as HUD device) 20 and a display control device 30 that controls the HUD device 20 . Note that the eye position detection unit (line of sight detection unit) 409 and the vehicle exterior sensor 411 may be omitted.
　図２は、ヘッドアップディスプレイ装置の構成の一態様を示す図である。ＨＵＤ装置２０は、例えばダッシュボード（図１の符号５）内に設置される。このＨＵＤ装置２０は、立体画像表示装置（画像表示装置）４０、リレー光学系８０及び、これら立体画像表示装置４０とリレー光学系８０を収納し、立体画像表示装置４０からの表示光Ｋを内部から外部に向けて出射可能な光出射窓２１を有する筐体２２、を有する。なお、画像表示装置４０は、３Ｄ画像を表示する立体画像表示装置に限定されるものではなく、２Ｄ画像を表示するものであってもよい。 FIG. 2 is a diagram showing one aspect of the configuration of the head-up display device. The HUD device 20 is installed, for example, in a dashboard (reference numeral 5 in FIG. 1). The HUD device 20 accommodates a stereoscopic image display device (image display device) 40, a relay optical system 80, and the stereoscopic image display device 40 and the relay optical system 80, and the display light K from the stereoscopic image display device 40 is internally transmitted. and a housing 22 having a light exit window 21 that allows light to exit from the housing 22 to the outside. Note that the image display device 40 is not limited to a stereoscopic image display device that displays 3D images, and may display 2D images.
　立体画像表示装置４０は、ここでは視差式３Ｄ表示装置とする。この立体表示装置（視差式３Ｄ表示装置）４０は、左視点画像と右視点画像と視認させることで奥行き表現を制御可能な多視点画像表示方式を用いた裸眼立体表示装置である表示器５０及び、バックライトとして機能する光源ユニット６０、により構成される。 The stereoscopic image display device 40 is assumed here to be a parallax 3D display device. This stereoscopic display device (parallax type 3D display device) 40 is a display device 50 which is a naked-eye stereoscopic display device using a multi-viewpoint image display system capable of controlling depth representation by visually recognizing left-viewpoint images and right-viewpoint images, and , and a light source unit 60 that functions as a backlight.
　表示器５０は、光源ユニット６０からの照明光を光変調して画像を生成する光変調素子５１及び、例えば、レンチキュラレンズやパララックスバリア（視差バリア）等を有し、光変調素子５１から出射される光を、左目用の光線Ｋ１１、Ｋ１２及び、Ｋ１３等の左目用表示光（図１の符号Ｋ１０）と、右目用の光線Ｋ２１、Ｋ２２及び、Ｋ２３等の右目用表示光（図１の符号Ｋ２０）とに分離する光学レイヤ（光線分離部の一例。）５２、を有する。光学レイヤ５２は、レンチキュラレンズ、パララックスバリア、レンズアレイ及び、マイクロレンズアレイなどの光学フィルタを含む。実施形態で光学レイヤ５２は、前述した光学フィルタに限定されることなく、光変調素子５１の前面又は後面に配置される全ての形態の光学レイヤを含む。但し、これは一例であり、限定されるものではない。 The display 50 has a light modulation element 51 that modulates the illumination light from the light source unit 60 to generate an image, and, for example, a lenticular lens or a parallax barrier (parallax barrier). Left eye display light such as light rays K11, K12 and K13 (reference symbol K10 in FIG. 1) and right eye display light such as light rays K21, K22 and K23 (in FIG. 1). symbol K20) and an optical layer (an example of a light beam splitting section) 52. The optical layer 52 includes optical filters such as lenticular lenses, parallax barriers, lens arrays, and microlens arrays. In the embodiments, the optical layer 52 is not limited to the optical filter described above, and includes all types of optical layers arranged on the front or rear surface of the light modulation element 51 . However, this is an example and is not limited.
　また、立体画像表示装置４０は、光学レイヤ（光線分離部の一例。）５２の代わりに又は、それに加えて、光源ユニット６０を指向性バックライトユニット（光線分離部の一例。）で構成することで、左目用の光線Ｋ１１、Ｋ１２及び、Ｋ１３等の左目用表示光（図１の符号Ｋ１０）と、右目用の光線Ｋ２１、Ｋ２２及び、Ｋ２３等の右目用表示光（図１の符号Ｋ２０）と、を出射させてもよい。具体的に、例えば、後述する表示制御装置３０は、指向性バックライトユニットが左目７００Ｌに向かう照明光を照射した際に、光変調素子５１に左視点画像を表示させることで、左目用の光線Ｋ１１、Ｋ１２及び、Ｋ１３等の左目用表示光Ｋ１０を、観察者の左目７００Ｌに向け、指向性バックライトユニットが右目７００Ｒに向かう照明光を照射した際に、光変調素子５１に右視点画像を表示させることで、右目用の光線Ｋ２１、Ｋ２２及び、Ｋ２３等の右目用表示光Ｋ２０を、観察者の左目７００Ｌに向ける。但し、これは一例であり、限定されるものではない。 Also, in the stereoscopic image display device 40, instead of or in addition to the optical layer (an example of the light beam separating section) 52, the light source unit 60 may be configured with a directional backlight unit (an example of the light separating section). left-eye display light such as light rays K11, K12 and K13 (symbol K10 in FIG. 1) and right-eye display light such as light rays K21, K22 and K23 (symbol K20 in FIG. 1). and may be emitted. Specifically, for example, the display control device 30, which will be described later, causes the light modulation element 51 to display a left-viewpoint image when the directional backlight unit emits illumination light directed toward the left eye 700L. When the left-eye display light K10 such as K11, K12, and K13 is directed toward the viewer's left eye 700L, and the directional backlight unit emits illumination light toward the right eye 700R, the right viewpoint image is displayed on the light modulation element 51. By displaying, right-eye display light K20 such as right-eye light rays K21, K22, and K23 is directed to the left eye 700L of the observer. However, this is an example and is not limited.
　後述する表示制御装置３０は、例えば、画像レンダリング処理（グラフィック処理）、表示器駆動処理などを実行することで、観察者の左目７００Ｌへ左視点画像Ｖ１０の左目用表示光Ｋ１０及び、右目７００Ｒへ右視点画像Ｖ２０の右目用表示光Ｋ２０、を向け、左視点画像Ｖ１０及び右視点画像Ｖ２０を調整することで、ＨＵＤ装置２０が表示する（観察者が知覚する）知覚画像ＦＵの態様を制御することができる。なお、後述する表示制御装置３０は、一定空間に存在する点などから様々な方向に出力される光線をそのまま（概ね）再現するライトフィールドを再現するように、ディスプレイ（表示器５０）を制御してもよい。 The display control device 30, which will be described later, performs, for example, image rendering processing (graphic processing), display device driving processing, and the like, so that the display light K10 for the left eye of the left viewpoint image V10 and the display light K10 for the left eye and the display light K10 for the right eye 700R of the observer's left eye 700L are displayed. By directing the display light K20 for the right eye of the right viewpoint image V20 and adjusting the left viewpoint image V10 and the right viewpoint image V20, the aspect of the perception image FU displayed by the HUD device 20 (perceived by the observer) is controlled. be able to. Note that the display control device 30, which will be described later, controls the display (display device 50) so as to reproduce a light field that (approximately) reproduces light rays output in various directions from a point in a fixed space. may
　リレー光学系８０は、立体画像表示装置４０からの光を反射し、画像の表示光Ｋ１０、Ｋ２０を、ウインドシールド（被投影部材）２に投影する曲面ミラー（凹面鏡等）８１、８２を有する。但し、その他の光学部材（レンズなどの屈折光学部材、ホログラムなどの回折光学部材、反射光学部材又は、これらの組み合わせを含んでいてもよい。）を、さらに有してもよい。 The relay optical system 80 has curved mirrors (concave mirrors, etc.) 81 and 82 that reflect the light from the stereoscopic image display device 40 and project the image display lights K10 and K20 onto the windshield (projection target member) 2 . However, it may further include other optical members (refractive optical members such as lenses, diffractive optical members such as holograms, reflective optical members, or combinations thereof).
　図１では、ＨＵＤ装置２０の立体画像表示装置４０によって、左右の各目用の、視差をもつ画像（視差画像）が表示される。各視差画像は、図１に示されるように、虚像表示面（虚像結像面）ＶＳに結像したＶ１０、Ｖ２０として表示される。観察者（人）の各目のピントは、虚像表示領域ＶＳの位置に合うように調節される。なお、虚像表示領域ＶＳの位置を、「調節位置（又は結像位置）」と称し、また、所定の基準位置（例えば、ＨＵＤ装置２０のアイボックス２００の中心２０５、観察者の視点位置、又は、車両１の特定位置など）から虚像表示領域ＶＳまでの距離を調節距離（結像距離）と称する。 In FIG. 1, images with parallax (parallax images) for the left and right eyes are displayed by the stereoscopic image display device 40 of the HUD device 20 . Each parallax image is displayed as V10 and V20 formed on a virtual image display surface (virtual image formation surface) VS, as shown in FIG. The focus of each eye of the observer (person) is adjusted so as to match the position of the virtual image display area VS. Note that the position of the virtual image display area VS is referred to as an "adjustment position (or imaging position)", and a predetermined reference position (for example, the center 205 of the eyebox 200 of the HUD device 20, the observer's viewpoint position, or , a specific position of the vehicle 1, etc.) to the virtual image display area VS is referred to as an adjustment distance (imaging distance).
　但し、実際は、人の脳が、各画像（虚像）を融像するため、人は、調節位置よりもさらに奥側である位置（例えば、左視点画像Ｖ１０と右視点画像Ｖ２０との輻輳角によって定まる位置であり、輻輳角が小さくなるほど、観察者から離れた位置にあるように知覚される位置）に、知覚画像（ここでは、ナビゲーション用の矢先の図形）ＦＵが表示されているように認識する。なお、知覚画像ＦＵは、「立体虚像」と称される場合があり、また、「画像」を広義に捉えて虚像も含まれるとする場合には、「立体画像」と称することもできる。また、「立体像」、「３Ｄ表示」等と称される場合がある。 However, in reality, since the human brain fuses each image (virtual image), the human is at a position farther back than the adjustment position (for example, due to the convergence angle between the left viewpoint image V10 and the right viewpoint image V20). It is a fixed position, and the position perceived as being farther away from the observer as the angle of convergence decreases) is recognized as a perceptual image (here, an arrowhead figure for navigation) FU is displayed. do. Note that the perceptual image FU may be referred to as a "stereoscopic virtual image", and may also be referred to as a "stereoscopic image" when the "image" is taken in a broad sense to include virtual images. It may also be referred to as a "stereoscopic image", "3D display", or the like.
　次に、図３を参照する。図３は、車両１の走行中において、観察者が視認する前景と、前記前景に重畳して表示される知覚画像の例を示す図である。 Next, refer to Figure 3. FIG. 3 is a diagram showing an example of a foreground visually recognized by an observer and a perceptual image superimposed on the foreground and displayed while the vehicle 1 is running.
　図３において、車両１は、直線状の道路（路面）６を走行している。ＨＵＤ装置２０は、ダッシュボード５内に設置されている。ＨＵＤ装置２０の光出射窓２１から表示光Ｋ（Ｋ１０，Ｋ２０）を被投影部（車両１のフロントウインドシールド）２に投影する。図３の例では、路面６に重畳し、車両１の経路（ここでは直進を示す。）を指示する第１のコンテンツ画像ＦＵ１、同じく車両１の経路（ここでは直進を示す。）を指示し、第１のコンテンツ画像ＦＵ１より遠方に知覚される第２のコンテンツ画像ＦＵ２、第１のコンテンツ画像ＦＵ１の左右方向に表示され、はっきりとした輪郭を有さない第１のグロー画像Ｇ１、第２のコンテンツ画像ＦＵ２の左右方向に表示され、はっきりとした輪郭を有さない第２のグロー画像Ｇ２、を表示する。 In FIG. 3, the vehicle 1 is traveling on a straight road (road surface) 6. The HUD device 20 is installed inside the dashboard 5 . Display light K (K10, K20) is projected from the light exit window 21 of the HUD device 20 onto the projected portion (front windshield of the vehicle 1) 2. FIG. In the example of FIG. 3, a first content image FU1 that is superimposed on the road surface 6 and indicates the route of the vehicle 1 (indicating straight ahead here), similarly indicates the route of the vehicle 1 (indicating straight ahead here). , a second content image FU2 that is perceived farther than the first content image FU1, a first glow image G1 that is displayed in the horizontal direction of the first content image FU1 and does not have a clear outline, a second A second glow image G2, which is displayed in the left-right direction of the content image FU2 and does not have a clear outline, is displayed.
　本実施形態の表示制御装置３０（ＨＵＤ装置２０）は、コンテンツ画像ＦＵと、このコンテンツ画像ＦＵの左右方向に表示されるグロー画像Ｇを表示する。これにより、コンテンツ画像ＦＵを加飾する、強調する、遠近感を向上させる、又はこれらの組み合わせなどの利点が想定される。 The display control device 30 (HUD device 20) of the present embodiment displays a content image FU and a glow image G displayed in the horizontal direction of the content image FU. Advantages such as decorating the content image FU, emphasizing the content image FU, improving perspective, or a combination of these are assumed.
　図４は、グロー画像Ｇの一態様を示す図である。図示するように、観察者から見たグロー画像Ｇの横方向の長さαｇは、コンテンツ画像ＦＵの横方向の長さαｆより長い。また、観察者から見たグロー画像Ｇの縦方向の長さβｇは、コンテンツ画像ＦＵの縦方向の長さβｆより長い（これは限定されない）。また、グロー画像Ｇの横方向の長さαｇとコンテンツ画像ＦＵの横方向の長さαｆとの差（αｇ－αｆ）は、グロー画像Ｇの縦方向の長さβｇとコンテンツ画像ＦＵの縦方向の長さβｆとの差（βｇ－βｆ）より長い（これは限定されない）。他の実施形態の一例として、観察者から見たグロー画像Ｇの縦方向の長さβｇは、コンテンツ画像ＦＵの縦方向の長さβｆと同じ又はそれより短くてもよい。 FIG. 4 is a diagram showing one aspect of the glow image G. FIG. As illustrated, the horizontal length αg of the glow image G as viewed by the observer is longer than the horizontal length αf of the content image FU. Also, the vertical length βg of the glow image G as seen from the observer is longer than the vertical length βf of the content image FU (this is not limited). Further, the difference (αg−αf) between the horizontal length αg of the glow image G and the horizontal length αf of the content image FU is the vertical length βg of the glow image G and the vertical length of the content image FU. (This is not limited). As an example of another embodiment, the vertical length βg of the glow image G as seen by the observer may be equal to or shorter than the vertical length βf of the content image FU.
　また、グロー画像Ｇは、コンテンツ画像ＦＵに対して、同系色で且つ彩度を低くすることが好ましい。ここで、同系色とは、色相環における中心からのなす角度が６０度以下であることをいう。より好ましくは、グロー画像Ｇの色とコンテンツ画像ＦＵの色とが、色相環における中心からのなす角度が３０度以下となるようにする（これは限定されない）。なお、コンテンツ画像ＦＵが複数色で構成されている場合、グロー画像Ｇの色度が、コンテンツ画像ＦＵの画素の平均色度に対して、同系色で且つ彩度を低くするようにしてもよい。 Also, it is preferable that the glow image G has a similar color and lower saturation to the content image FU. Here, the similar color means that the angle formed from the center of the color wheel is 60 degrees or less. More preferably, the angle formed by the color of the glow image G and the color of the content image FU from the center of the color wheel is 30 degrees or less (this is not limited). When the content image FU is composed of a plurality of colors, the chromaticity of the glow image G may be similar to the average chromaticity of the pixels of the content image FU, and the saturation may be lowered. .
　図５は、近傍側に知覚される第１のコンテンツ画像ＦＵ１に付加される第１のグロー画像Ｇ１と、第１のコンテンツ画像ＦＵ１より遠方側に知覚される第２のコンテンツ画像ＦＵ２に付加される第２のグロー画像Ｇ２と、の表示態様を示す図である。第１のコンテンツ画像ＦＵ１は、近傍側に知覚される第１の表現深度Ｅ１０を有し、第２のコンテンツ画像ＦＵ２は、第１のコンテンツ画像ＦＵ１より遠方側に知覚される第２の表現深度Ｅ２０を有する。『表現深度』は、画像の表示距離、画像の大きさ、又はこれらの組み合わせに対応する。いくつかの実施形態における表現深度が、画像の表示距離に対応する場合、第１の表現深度Ｅ１０を有する第１のコンテンツ画像ＦＵ１は、前記基準位置の近傍に表示され、第２の表現深度Ｅ２０を有する第２のコンテンツ画像ＦＵ２は、前記基準位置の遠方に表示される。また、いくつかの実施形態における表現深度が、画像の大きさに対応する場合、第１の表現深度Ｅ１０を有する第１のコンテンツ画像ＦＵ１は、大きく表示され、第２の表現深度Ｅ２０を有する第２のコンテンツ画像ＦＵ２は、小さく表示される。また、いくつかの実施形態における表現深度が、画像の表示距離及び大きさに対応する場合、第１の表現深度Ｅ１０を有する第１のコンテンツ画像ＦＵ１は、前記基準位置の近傍に大きく表示され、第２の表現深度Ｅ２０を有する第２のコンテンツ画像ＦＵ２は、前記基準位置の遠方に小さく表示される。 FIG. 5 shows a first glow image G1 added to the first content image FU1 perceived on the near side and a second content image FU2 added to the far side of the first content image FU1. FIG. 10 is a diagram showing a display mode of a second glow image G2 that is shown in FIG. The first content image FU1 has a near-perceived first representation depth E10, and the second content image FU2 has a far-perceived second representation depth than the first content image FU1. It has E20. "Representational depth" corresponds to the display distance of the image, the size of the image, or a combination thereof. If representation depth in some embodiments corresponds to image display distance, a first content image FU1 having a first representation depth E10 is displayed near the reference position and a second representation depth E20 is displayed far from the reference position. Also, if the representation depth in some embodiments corresponds to the size of the image, the first content image FU1 with the first representation depth E10 is displayed large and the second representation depth E20 with the second representation depth E20. 2 content image FU2 is displayed small. Further, when the representation depth in some embodiments corresponds to the display distance and size of the image, the first content image FU1 having the first representation depth E10 is displayed large near the reference position, A second content image FU2 having a second depth of expression E20 is displayed in a small size far from the reference position.
　遠方表現される第２のコンテンツ画像ＦＵ２の横方向の長さαｆ２０に対する第２のグロー画像Ｇ２の横方向の長さαｇ２０の比率は、近傍側に知覚される第１のコンテンツ画像ＦＵ１の横方向の長さαｆ１０に対する第１のグロー画像Ｇ１の横方向の長さαｇ１０の比率より小さい（αｇ２０／αｆ２０＜αｇ１０／αｆ１０）。すなわち、いくつかの実施形態によれば、表現深度Ｅが深くなるに従い、コンテンツ画像の横方向の長さαｆに対するグロー画像の横方向の長さαｇの比率（以下では、グロー比率とも呼ぶ。）Ｗｇを小さくしてもよい。これにより、遠近感を表現しつつもコンテンツ画像が示す情報を見やすくすることができる。すなわち、表示制御装置３０は、表現深度Ｅが深くなるに従い、コンテンツ画像の横方向の長さαｆに対するグロー画像の横方向の長さαｇの比率（グロー比率）Ｗｇを段階的又は、連続的に小さくするためのテーブルデータや演算式等をメモリ３７に予め記憶しておいてもよい。 The ratio of the horizontal length αg20 of the second glow image G2 to the horizontal length αf20 of the second content image FU2 represented at a distance is the horizontal direction of the first content image FU1 perceived on the near side. is smaller than the ratio of the horizontal length αg10 of the first glow image G1 to the length αf10 (αg20/αf20<αg10/αf10). That is, according to some embodiments, as the representation depth E increases, the ratio of the horizontal length αg of the glow image to the horizontal length αf of the content image (hereinafter also referred to as the glow ratio). Wg may be made small. As a result, it is possible to make the information indicated by the content image easier to see while expressing perspective. That is, as the depth of expression E increases, the display control device 30 gradually or continuously changes the ratio (glow ratio) Wg of the horizontal length αg of the glow image to the horizontal length αf of the content image. Table data, arithmetic expressions, etc. for reducing the size may be stored in the memory 37 in advance.
　図６は、いくつかの実施形態に係る、車両用虚像表示システムのブロック図である。表示制御装置３０は、１つ又は複数のＩ／Ｏインタフェース３１、１つ又は複数のプロセッサ３３、１つ又は複数の画像処理回路３５、及び１つ又は複数のメモリ３７を備える。図６は、１つの実施形態に過ぎず、図示された構成要素は、より数の少ない構成要素に組み合わされてもよく、又は追加の構成要素があってもよい。例えば、画像処理回路３５（例えば、グラフィック処理ユニット）が、１つ又は複数のプロセッサ３３に含まれてもよい。 FIG. 6 is a block diagram of a vehicle virtual image display system according to some embodiments. The display controller 30 comprises one or more I/O interfaces 31 , one or more processors 33 , one or more image processing circuits 35 and one or more memories 37 . FIG. 6 is just one embodiment and the components shown may be combined into fewer components or there may be additional components. For example, image processing circuitry 35 (eg, a graphics processing unit) may be included in one or more processors 33 .
　図示するように、プロセッサ３３及び画像処理回路３５は、メモリ３７と動作可能に連結される。より具体的には、プロセッサ３３及び画像処理回路３５は、メモリ３７に記憶されているプログラムを実行することで、例えば画像データを生成、及び／又は送信するなど、車両用表示システム１０（画像表示装置４０）の制御を行うことができる。プロセッサ３３及び／又は画像処理回路３５は、少なくとも１つの汎用マイクロプロセッサ（例えば、中央処理装置（ＣＰＵ））、少なくとも１つの特定用途向け集積回路（ＡＳＩＣ）、少なくとも１つのフィールドプログラマブルゲートアレイ（ＦＰＧＡ）、又はそれらの任意の組み合わせを含むことができる。メモリ３７は、ハードディスクのような任意のタイプの磁気媒体、ＣＤ及びＤＶＤのような任意のタイプの光学媒体、揮発性メモリのような任意のタイプの半導体メモリ、及び不揮発性メモリを含む。揮発性メモリは、ＤＲＡＭ及びＳＲＡＭを含み、不揮発性メモリは、ＲＯＭ及びＮＶＲＡＭを含んでもよい。 As shown, processor 33 and image processing circuitry 35 are operatively coupled with memory 37 . More specifically, the processor 33 and the image processing circuit 35 execute a program stored in the memory 37 to generate and/or transmit image data, for example, the vehicle display system 10 (image display device 40) can be controlled. Processor 33 and/or image processing circuitry 35 may include at least one general purpose microprocessor (e.g., central processing unit (CPU)), at least one application specific integrated circuit (ASIC), at least one field programmable gate array (FPGA). , or any combination thereof. Memory 37 includes any type of magnetic media such as hard disks, any type of optical media such as CDs and DVDs, any type of semiconductor memory such as volatile memory, and non-volatile memory. Volatile memory may include DRAM and SRAM, and non-volatile memory may include ROM and NVRAM.
　図示するように、プロセッサ３３は、Ｉ／Ｏインタフェース３１と動作可能に連結されている。Ｉ／Ｏインタフェース３１は、例えば、車両に設けられた後述の車両ＥＣＵ４０１及び／又は、他の電子機器（後述する符号４０３～４１９）と、ＣＡＮ（Controller Area Network）の規格に応じて通信（ＣＡＮ通信とも称する）を行う。なお、Ｉ／Ｏインタフェース３１が採用する通信規格は、ＣＡＮに限定されず、例えば、ＣＡＮＦＤ（ＣＡＮ with Flexible Data Rate）、ＬＩＮ（Local Interconnect Network）、Ｅｔｈｅｒｎｅｔ（登録商標）、ＭＯＳＴ（Media Oriented Systems Transport：ＭＯＳＴは登録商標）、ＵＡＲＴ、もしくはＵＳＢなどの有線通信インタフェース、又は、例えば、Ｂｌｕｅｔｏｏｔｈ（登録商標）ネットワークなどのパーソナルエリアネットワーク（ＰＡＮ）、８０２．１１ｘ Ｗｉ－Ｆｉ（登録商標）ネットワークなどのローカルエリアネットワーク（ＬＡＮ）等の数十メートル内の近距離無線通信インタフェースである車内通信（内部通信）インタフェースを含む。また、Ｉ／Ｏインタフェース３１は、無線ワイドエリアネットワーク（ＷＷＡＮ０、ＩＥＥＥ８０２．１６－２００４（ＷｉＭＡＸ：Worldwide Interoperability for Microwave Access））、ＩＥＥＥ８０２．１６ｅベース（Ｍｏｂｉｌｅ　ＷｉＭＡＸ）、４Ｇ、４Ｇ－ＬＴＥ、ＬＴＥ　Ａｄｖａｎｃｅｄ、５Ｇなどのセルラー通信規格により広域通信網（例えば、インターネット通信網）などの車外通信（外部通信）インタフェースを含んでいてもよい。 As shown, processor 33 is operatively coupled with I/O interface 31 . For example, the I / O interface 31 communicates (CAN communication). Note that the communication standard adopted by the I/O interface 31 is not limited to CAN. : MOST is a registered trademark), a wired communication interface such as UART or USB, or a personal area network (PAN) such as a Bluetooth network, a local network such as an 802.11x Wi-Fi network. It includes an in-vehicle communication (internal communication) interface, which is a short-range wireless communication interface within several tens of meters such as an area network (LAN). In addition, the I / O interface 31 is a wireless wide area network (WWAN0, IEEE802.16-2004 (WiMAX: Worldwide Interoperability for Microwave Access)), IEEE802.16e base (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced, An external communication (external communication) interface such as a wide area communication network (for example, Internet communication network) may be included according to a cellular communication standard such as 5G.
　図示するように、プロセッサ３３は、Ｉ／Ｏインタフェース３１と相互動作可能に連結されることで、車両用表示システム１０（Ｉ／Ｏインタフェース３１）に接続される種々の他の電子機器等と情報を授受可能となる。Ｉ／Ｏインタフェース３１には、例えば、車両ＥＣＵ４０１、道路情報データベース４０３、自車位置検出部４０５、操作検出部４０７、目位置検出部４０９、車外センサ４１１、明るさ検出部４１３、ＩＭＵ４１５、携帯情報端末４１７、及び外部通信機器４１９などが動作可能に連結される。なお、Ｉ／Ｏインタフェース３１は、車両用表示システム１０に接続される他の電子機器等から受信する情報を加工（変換、演算、解析）する機能を含んでいてもよい。 As shown, the processor 33 is interoperably coupled with the I/O interface 31 to communicate with various other electronic devices and the like connected to the vehicle display system 10 (I/O interface 31). can be given and received. The I/O interface 31 includes, for example, a vehicle ECU 401, a road information database 403, a vehicle position detection unit 405, an operation detection unit 407, an eye position detection unit 409, an external sensor 411, a brightness detection unit 413, an IMU 415, portable information A terminal 417, an external communication device 419, etc. are operatively coupled. Note that the I/O interface 31 may include a function of processing (converting, calculating, and analyzing) information received from other electronic devices or the like connected to the vehicle display system 10 .
　画像表示装置４０は、プロセッサ３３及び画像処理回路３５に動作可能に連結される。したがって、光変調素子５１によって表示される画像は、プロセッサ３３及び／又は画像処理回路３５から受信された画像データに基づいてもよい。プロセッサ３３及び画像処理回路３５は、Ｉ／Ｏインタフェース３１から取得される情報に基づき、光変調素子５１が表示する画像を制御する。 The image display device 40 is operatively connected to the processor 33 and the image processing circuit 35 . Accordingly, the image displayed by light modulating element 51 may be based on image data received from processor 33 and/or image processing circuitry 35 . The processor 33 and image processing circuit 35 control the image displayed by the light modulation element 51 based on the information obtained from the I/O interface 31 .
　メモリ３７に記憶されたソフトウェア構成要素は、表示パラメータ設定モジュール５１０、グラフィックモジュール５１２、光源駆動モジュール５１４、及びアクチュエータ駆動モジュール５１６、を含む。 The software components stored in the memory 37 include a display parameter setting module 510, a graphics module 512, a light source driving module 514, and an actuator driving module 516.
　表示パラメータ設定モジュール５１０は、Ｉ／Ｏインタフェース３１から取得される様々な情報やコマンドに基づき、表示する虚像の表示パラメータを設定することに関係する様々な動作を実行するための様々なソフトウェア構成要素を含む。すなわち、表示パラメータ設定モジュール５１０は、Ｉ／Ｏインタフェース３１から取得される様々な情報から、表示パラメータを特定するためのテーブルデータ、演算式、などを含み得る。 Display parameter setting module 510 includes various software components for performing various operations related to setting display parameters of a virtual image to be displayed based on various information and commands obtained from I/O interface 31. including. That is, the display parameter setting module 510 can include table data, arithmetic expressions, etc. for specifying display parameters from various information acquired from the I/O interface 31 .
　表示パラメータの種類は、（１）目位置７００から見て、車両１の外側に位置する実オブジェクトと所定の位置関係になるような画像の配置（画像の配置を制御するために画像表示装置４０を制御するパラメータ、及び／又はアクチュエータを制御すパラメータ。）、（２）目位置７００から見た虚像光学系９０などにより生じ得る画像の歪みを軽減するために画像を事前に歪ませるためのパラメータ（画像表示装置４０上で表示される画像を事前に歪ませるために画像表示装置４０を制御するパラメータであり、ワーピングパラメータとも呼ばれる。）、（３）目位置７００に、画像の光を向け、目位置７００以外の表示パラメータには画像の光を向けない（又は光を弱くする）指向性表示をするためのパラメータ（画像表示装置４０を制御するパラメータ、画像表示装置４０の前記光源を制御するパラメータ、アクチュエータを制御するパラメータ、又はこれらの組み合わせを含むパラメータ。）、（４）目位置から見て、所望の遠近感を表現するためのパラメータ（画像表示装置４０を制御するパラメータ、画像表示装置４０の前記光源を制御するパラメータ、アクチュエータを制御するパラメータ、又はこれらの組み合わせを含むパラメータ。）、などを含む。ただし、表示パラメータ設定モジュール５１０が設定（選択）する表示パラメータは、これらに限定されない。 The types of display parameters are as follows: (1) an image layout that has a predetermined positional relationship with a real object positioned outside the vehicle 1 when viewed from the eye position 700 (image display device 40 for controlling the image layout); and/or actuators.), (2) parameters for pre-distorting the image to reduce image distortion that may be caused by, for example, the virtual image optics 90 viewed from the eye position 700. (parameters that control the image display device 40 to pre-distort the image displayed on the image display device 40, also called warping parameters); (3) directing the light of the image to the eye position 700; Parameters (parameters for controlling the image display device 40, parameters for controlling the light source of the image display device 40, and parameters, parameters for controlling the actuators, or parameters including a combination thereof), (4) parameters for expressing a desired perspective viewed from the eye position (parameters for controlling the image display device 40, image display device 40 parameters controlling the light sources, parameters controlling actuators, or parameters comprising combinations thereof.), and the like. However, the display parameters set (selected) by the display parameter setting module 510 are not limited to these.
　本実施形態の表示パラメータ設定モジュール５１０は、遠方表現されたコンテンツ画像ＦＵに対するグロー画像Ｇの大きさを小さくする。 The display parameter setting module 510 of this embodiment reduces the size of the glow image G with respect to the content image FU represented at a distance.
　図７乃至図１０は、表現深度Ｅに対するグロー比率Ｗｇの変化を示す図である。図７に示す例では、（１）第１の表現深度Ｅ１１で表現される第１のコンテンツ画像ＦＵ１の横方向の長さがαｆ１１であり、第１のコンテンツ画像ＦＵ１に付加される第１のグロー画像Ｇ１の横方向の長さがαｇ１１であり、第１のグロー比率Ｗｇがαｇ１１／αｆ１１である。また、（２）第２の表現深度Ｅ２１で表現される第２のコンテンツ画像ＦＵ２の横方向の長さがαｆ２１であり、第２のコンテンツ画像ＦＵ２に付加される第２のグロー画像Ｇ２の横方向の長さがαｇ２１であり、第２のグロー比率Ｗｇがαｇ２１／αｆ２１である。いくつかの実施形態におけるプロセッサ３３（表示制御装置３０）は、表現深度Ｅが所定の閾値Ｔｈ０（所定の閾値Ｔｈ０は、第１の表現深度Ｅ１１よりも深い）より浅い場合、表現深度Ｅによらず、グロー比率Ｗｇを第１のグロー比率（αｇ１１／αｆ１１）で一定に維持し、一方、表現深度Ｅが所定の閾値Ｔｈ０（所定の閾値Ｔｈ０は、第１の表現深度Ｅ１１よりも深い）より深い場合、表現深度Ｅによらず、グロー比率Ｗｇを第２のグロー比率（αｇ２１／αｆ２１）で一定に維持する。 7 to 10 are diagrams showing changes in the glow ratio Wg with respect to the expression depth E. FIG. In the example shown in FIG. 7, (1) the horizontal length of the first content image FU1 represented by the first representation depth E11 is αf11, and the first content image FU1 added to the first content image FU1 The horizontal length of the glow image G1 is αg11, and the first glow ratio Wg is αg11/αf11. (2) The horizontal length of the second content image FU2 represented by the second representation depth E21 is αf21, and the horizontal length of the second glow image G2 added to the second content image FU2 is The length in the direction is αg21 and the second glow ratio Wg is αg21/αf21. The processor 33 (display control device 30) in some embodiments, when the representation depth E is shallower than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11), the representation depth E First, the glow ratio Wg is kept constant at the first glow ratio (αg11/αf11), while the representation depth E is greater than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11). If it is deep, the glow ratio Wg is kept constant at the second glow ratio (αg21/αf21) regardless of the expression depth E.
　図８に示す例では、（１）第１の表現深度Ｅ１２で表現される第１のコンテンツ画像ＦＵ１の横方向の長さがαｆ１２であり、第１のコンテンツ画像ＦＵ１に付加される第１のグロー画像Ｇ１の横方向の長さがαｇ１２であり、第１のグロー比率Ｗｇがαｇ１２／αｆ１２である。また、（２）第２の表現深度Ｅ２２で表現される第２のコンテンツ画像ＦＵ２の横方向の長さがαｆ２２であり、第２のコンテンツ画像ＦＵ２に付加される第２のグロー画像Ｇ２の横方向の長さがαｇ２２であり、第２のグロー比率Ｗｇがαｇ２２／αｆ２２である。いくつかの実施形態におけるプロセッサ３３（表示制御装置３０）は、表現深度Ｅが所定の閾値Ｔｈ０（所定の閾値Ｔｈ０は、第１の表現深度Ｅ１１よりも深い）より浅い場合、表現深度Ｅによらず、グロー比率Ｗｇを第１のグロー比率（αｇ１１／αｆ１１）で一定に維持し、一方、表現深度Ｅが所定の閾値Ｔｈ０（所定の閾値Ｔｈ０は、第１の表現深度Ｅ１１よりも深い）より深くなった場合、表現深度Ｅが深くなるに従い、グロー比率Ｗｇを第２のグロー比率を徐々に減少し、所定の値（αｇ２１／αｆ２１）に到達したら、表現深度Ｅが深くなっても一定に維持する。 In the example shown in FIG. 8, (1) the horizontal length of the first content image FU1 represented by the first representation depth E12 is αf12, and the first content image FU1 added to the first content image FU1 The horizontal length of the glow image G1 is αg12, and the first glow ratio Wg is αg12/αf12. (2) the horizontal length of the second content image FU2 represented by the second expression depth E22 is αf22, and the horizontal length of the second glow image G2 added to the second content image FU2 is The direction length is αg22 and the second glow ratio Wg is αg22/αf22. The processor 33 (display control device 30) in some embodiments, when the representation depth E is shallower than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11), the representation depth E First, the glow ratio Wg is kept constant at the first glow ratio (αg11/αf11), while the representation depth E is greater than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11). When the expression depth E becomes deeper, the glow ratio Wg is gradually decreased from the second glow ratio as the expression depth E increases, and when a predetermined value (αg21/αf21) is reached, the glow ratio Wg remains constant even if the expression depth E increases. maintain.
　図９に示す例では、（１）第１の表現深度Ｅ１３で表現される第１のコンテンツ画像ＦＵ１の横方向の長さがαｆ１３であり、第１のコンテンツ画像ＦＵ１に付加される第１のグロー画像Ｇ１の横方向の長さがαｇ１３であり、第１のグロー比率Ｗｇがαｇ１３／αｆ１３である。また、（２）第２の表現深度Ｅ２３で表現される第２のコンテンツ画像ＦＵ２の横方向の長さがαｆ２３であり、第２のコンテンツ画像ＦＵ２に付加される第２のグロー画像Ｇ２の横方向の長さがαｇ２３であり、第２のグロー比率Ｗｇがαｇ２３／αｆ２３である。いくつかの実施形態におけるプロセッサ３３（表示制御装置３０）は、表現深度Ｅが所定の閾値Ｔｈ０（所定の閾値Ｔｈ０は、第１の表現深度Ｅ１１よりも深い）より浅い場合、表現深度Ｅによらず、グロー比率Ｗｇを第１のグロー比率（αｇ１１／αｆ１１）で一定に維持し、一方、表現深度Ｅが所定の閾値Ｔｈ０（所定の閾値Ｔｈ０は、第１の表現深度Ｅ１１よりも深い）より深くなった場合、表現深度Ｅが深くなるに従い、グロー比率Ｗｇを第２のグロー比率を徐々に減少させ、表現深度Ｅが所定の閾値Ｔｈ１に到達したら、グロー比率Ｗｇをゼロにする（すなわち、グロー画像Ｇを非表示する）。 In the example shown in FIG. 9, (1) the horizontal length of the first content image FU1 represented by the first representation depth E13 is αf13, and the first content image FU1 added to the first content image FU1 The horizontal length of the glow image G1 is αg13, and the first glow ratio Wg is αg13/αf13. Also, (2) the horizontal length of the second content image FU2 represented by the second representation depth E23 is αf23, and the horizontal length of the second glow image G2 added to the second content image FU2 is The length in the direction is αg23 and the second glow ratio Wg is αg23/αf23. The processor 33 (display control device 30) in some embodiments, when the representation depth E is shallower than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11), the representation depth E First, the glow ratio Wg is kept constant at the first glow ratio (αg11/αf11), while the representation depth E is greater than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11). When the expression depth E becomes deeper, the glow ratio Wg is gradually decreased from the second glow ratio as the expression depth E becomes deeper, and when the expression depth E reaches a predetermined threshold Th1, the glow ratio Wg is set to zero (that is, hide glow image G).
　図１０に示す例では、（１）第１の表現深度Ｅ１４で表現される第１のコンテンツ画像ＦＵ１の横方向の長さがαｆ１４であり、第１のコンテンツ画像ＦＵ１に付加される第１のグロー画像Ｇ１の横方向の長さがαｇ１４であり、第１のグロー比率Ｗｇがαｇ１４／αｆ１４である。また、（２）第２の表現深度Ｅ２４で表現される第２のコンテンツ画像ＦＵ２の横方向の長さがαｆ２４であり、第２のコンテンツ画像ＦＵ２に付加される第２のグロー画像Ｇ２の横方向の長さがαｇ２４であり、第２のグロー比率Ｗｇがαｇ２４／αｆ２４である。いくつかの実施形態におけるプロセッサ３３（表示制御装置３０）は、表現深度Ｅが所定の閾値Ｔｈ０（所定の閾値Ｔｈ０は、第１の表現深度Ｅ１１よりも深い）より浅い場合、表現深度Ｅによらず、グロー比率Ｗｇを第１のグロー比率（αｇ１１／αｆ１１）で一定に維持し、一方、表現深度Ｅが所定の閾値Ｔｈ０（所定の閾値Ｔｈ０は、第１の表現深度Ｅ１１よりも深い）より深くなった場合、表現深度Ｅによらず、グロー比率Ｗｇを第２のグロー比率（αｇ２１／αｆ２１）で一定に維持し、さらに、表現深度Ｅが所定の閾値Ｔｈ１以上に到達したら、グロー画像Ｇの透過率を高くする。 In the example shown in FIG. 10, (1) the horizontal length of the first content image FU1 represented by the first representation depth E14 is αf14, and the first content image FU1 added to the first content image FU1 The horizontal length of the glow image G1 is αg14, and the first glow ratio Wg is αg14/αf14. (2) The horizontal length of the second content image FU2 represented by the second expression depth E24 is αf24, and the horizontal length of the second glow image G2 added to the second content image FU2 is The direction length is αg24 and the second glow ratio Wg is αg24/αf24. The processor 33 (display control device 30) in some embodiments, when the representation depth E is shallower than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11), the representation depth E First, the glow ratio Wg is kept constant at the first glow ratio (αg11/αf11), while the representation depth E is greater than a predetermined threshold Th0 (the predetermined threshold Th0 is deeper than the first representation depth E11). When the depth becomes deeper, the glow ratio Wg is kept constant at the second glow ratio (αg21/αf21) regardless of the expression depth E, and when the expression depth E reaches a predetermined threshold value Th1 or more, the glow image G increase the transmittance of
　再び図６を参照する。グラフィックモジュール５１２は、レンダリングなどの画像処理をして画像データを生成し、画像表示装置４０を駆動するための様々な既知のソフトウェア構成要素を含む。また、グラフィックモジュール５１２は、表示される画像の、種類、配置（位置座標、角度）、サイズ、表示距離（３Ｄの場合。）、視覚的効果（例えば、輝度、透明度、彩度、コントラスト、又は他の視覚特性）、を変更するための様々な既知のソフトウェア構成要素を含んでいてもよい。グラフィックモジュール５１２は、画像の種類（表示パラメータの例の１つ。）、画像の位置座標（表示パラメータの例の１つ。）、画像の角度（Ｘ方向を軸としたピッチング角、Ｙ方向を軸としたヨーレート角、Ｚ方向を軸としたローリング角などであり、表示パラメータの例の１つ。）、画像のサイズ（表示パラメータの例の１つ。）、画像の色（色相、彩度、明度などで設定される表示パラメータの例の１つ。）で観察者に視認されるように画像データを生成し、光変調素子５１を駆動し得る。 Refer to Figure 6 again. Graphics module 512 includes various known software components for performing image processing such as rendering to generate image data and for driving image display device 40 . The graphic module 512 also controls the type, arrangement (positional coordinates, angle), size, display distance (in the case of 3D), visual effects (for example, brightness, transparency, saturation, contrast, or and other visual characteristics), may include various known software components. The graphic module 512 stores the type of image (one example of display parameters), the positional coordinates of the image (one example of display parameters), the angle of the image (pitch angle with the X direction as the axis, Y direction as the axis, yaw rate angle around the axis, rolling angle around the Z direction, etc., which are examples of display parameters), image size (one example of display parameters), image color (hue, saturation , brightness, etc.), image data can be generated and the light modulation element 51 can be driven so as to be visually recognized by the observer.
　光源駆動モジュール５１４は、光源ユニット２４を駆動することを実行するための様々な既知のソフトウェア構成要素を含む。光源駆動モジュール５１４は、設定された表示パラメータに基づき、光源ユニット２４を駆動し得る。 The light source driving module 514 includes various known software components for performing driving the light source unit 24 . The light source driving module 514 can drive the light source unit 24 based on the set display parameters.
　アクチュエータ駆動モジュール５１６は、第１アクチュエータ２８及び／又は第２アクチュエータ２９を駆動することを実行するための様々な既知のソフトウェア構成要素を含むアクチュエータ駆動モジュール５１６は、設定された表示パラメータに基づき、第１アクチュエータ２８及び第２アクチュエータ２９を駆動し得る。 Actuator drive module 516 includes various known software components for performing the driving of first actuator 28 and/or second actuator 29. One actuator 28 and a second actuator 29 can be driven.
　上述の処理プロセスの動作は、汎用プロセッサ又は特定用途向けチップなどの情報処理装置の１つ以上の機能モジュールを実行させることにより実施することができる。これらのモジュール、これらのモジュールの組み合わせ、及び／又はそれらの機能を代替えし得る公知のハードウェアとの組み合わせは全て、本発明の保護の範囲内に含まれる。 The operations of the processing processes described above can be implemented by executing one or more functional modules of an information processing device such as a general-purpose processor or an application-specific chip. These modules, combinations of these modules, and/or combinations with known hardware that can replace their functions are all within the scope of protection of the present invention.
　車両用表示システム１０の機能ブロックは、任意選択的に、説明される様々な実施形態の原理を実行するために、ハードウェア、ソフトウェア、又はハードウェア及びソフトウェアの組み合わせによって実行される。図１０で説明する機能ブロックが、説明される実施形態の原理を実施するために、任意選択的に、組み合わされ、又は１つの機能ブロックを２以上のサブブロックに分離されてもいいことは、当業者に理解されるだろう。したがって、本明細書における説明は、本明細書で説明されている機能ブロックのあらゆる可能な組み合わせ若しくは分割を、任意選択的に支持する。 The functional blocks of vehicle display system 10 are optionally implemented in hardware, software, or a combination of hardware and software to carry out the principles of the various described embodiments. It is noted that the functional blocks illustrated in FIG. 10 may optionally be combined or separated into two or more sub-blocks to implement the principles of the described embodiments. will be understood by those skilled in the art. Accordingly, the description herein optionally supports any possible combination or division of the functional blocks described herein.
１　　　　：車両
３Ｄ　　　：視差式
５　　　　：ダッシュボード
６　　　　：路面
１０　　　：車両用表示システム
２０　　　：ＨＵＤ装置
２１　　　：光出射窓
２２　　　：筐体
２４　　　：光源ユニット
２８　　　：第１アクチュエータ
２９　　　：第２アクチュエータ
３０　　　：表示制御装置
３１　　　：Ｉ／Ｏインタフェース
３３　　　：プロセッサ
３５　　　：画像処理回路
３７　　　：メモリ
４０　　　：画像表示装置
５０　　　：表示器
５１　　　：光変調素子
５２　　　：光学レイヤ
６０　　　：光源ユニット
８０　　　：リレー光学系
９０　　　：虚像光学系
２００　　：アイボックス
２０５　　：中心
４０１　　：車両ＥＣＵ
４０３　　：道路情報データベース
４０５　　：自車位置検出部
４０７　　：操作検出部
４０９　　：目位置検出部
４１１　　：車外センサ
４１３　　：明るさ検出部
４１７　　：携帯情報端末
４１９　　：外部通信機器
５１０　　：表示パラメータ設定モジュール
５１２　　：グラフィックモジュール
５１４　　：光源駆動モジュール
５１６　　：アクチュエータ駆動モジュール
７００　　：目位置
７００Ｌ　：左目
７００Ｒ　：右目
Ｅ　　　　：表現深度
Ｅ１０、Ｅ１１、Ｅ１２、Ｅ１３、Ｅ１４　：第１の表現深度
Ｅ２０、Ｅ２１、Ｅ２２、Ｅ２３、Ｅ２４　：第２の表現深度
ＦＵ　　　：コンテンツ画像（知覚画像）
ＦＵ１　　：第１のコンテンツ画像
ＦＵ２　　：第２のコンテンツ画像
Ｇ　　　　：グロー画像
Ｇ１　　　：第１のグロー画像
Ｇ２　　　：第２のグロー画像
Ｋ　　　　：表示光
Ｔｈ０　　：閾値
Ｔｈ１　　：閾値
ＶＳ　　　：虚像表示領域
Ｗｇ　　　　：グロー比率 1 : Vehicle 3D : Parallax 5 : Dashboard 6 : Road surface 10 : Vehicle display system 20 : HUD device 21 : Light exit window 22 : Housing 24 : Light source unit 28 : First actuator 29 : Second actuator 30 : Display Control device 31 : I/O interface 33 : Processor 35 : Image processing circuit 37 : Memory 40 : Image display device 50 : Display 51 : Light modulation element 52 : Optical layer 60 : Light source unit 80 : Relay optical system 90 : Virtual image optics System 200: Eyebox 205: Center 401: Vehicle ECU
403 : Road information database 405 : Vehicle position detection unit 407 : Operation detection unit 409 : Eye position detection unit 411 : Exterior sensor 413 : Brightness detection unit 417 : Portable information terminal 419 : External communication device 510 : Display parameter setting module 512 : graphic module 514 : light source driving module 516 : actuator driving module 700 : eye position 700L : left eye 700R : right eye E : representation depths E10, E11, E12, E13, E14 : first representation depths E20, E21, E22, E23, E24: second representation depth FU: content image (perceptual image)
FU1: first content image FU2: second content image G: glow image G1: first glow image G2: second glow image K: display light Th0: threshold Th1: threshold VS: virtual image display area Wg: glow ratio

Claims (7)

  1. 　画像を被投影部材に投影することで、観察者に前記画像の虚像を視認させるヘッドアップディスプレイ装置における表示制御を実行する表示制御装置であって、
    　１つ又は複数のプロセッサと、
    　メモリと、
    　前記メモリに格納され、前記１つ又は複数のプロセッサによって実行されるように構成される１つ又は複数のコンピュータ・プログラムと、を備え、
    　前記プロセッサは、
    　遠近法が表現されたコンテンツ画像（ＦＵ）を表示するコンテンツ画像表示処理と、
    　前記コンテンツ画像（ＦＵ）の少なくとも左右方向に表示され、はっきりとした輪郭を有さない１つ又は複数のグロー画像（Ｇ）を表示するグロー表示処理と、を実行し、
    　　前記コンテンツ画像表示処理は、
    　　　横方向に第１の長さ（αｆ１０）を有する第１のコンテンツ画像（ＦＵ１）、及び、
    　　　横方向に前記第１の長さ（αｆ１０）より短い第２の長さ（αｆ２０）を有し、観察者から見て前記第１のコンテンツ画像より遠方表現される第２のコンテンツ画像（ＦＵ２）、を同時又は異なるタイミングで表示させる処理、を含み、
    　　前記グロー表示処理は、
    　　　左端と右端との間に第３の長さ（αｇ１０）を有し、前記第１のコンテンツ画像（ＦＵ１）の左右方向に表示される第１のグロー画像（Ｇ１）を表示させ、
    　　　左端と右端との間に第４の長さ（αｇ２０）を有し、前記第２のコンテンツ画像（ＦＵ２）の左右方向に表示される第２のグロー画像（Ｇ２）を表示させ、及び、
    　　　前記第２の長さ（αｆ２０）に対する前記第４の長さ（αｇ２０）の比率が、前記第１の長さ（αｆ１０）に対する前記第３の長さ（αｇ１０）の比率より小さくなる（αｇ２０／αｆ２０＜αｇ１０／αｆ１０）ように、前記グロー画像（Ｇ）の左端と右端との間の長さを設定する、
    表示制御装置。     A display control device that executes display control in a head-up display device that allows an observer to visually recognize a virtual image of the image by projecting the image onto a projection target member,
    one or more processors;
    memory;
    one or more computer programs stored in said memory and configured to be executed by said one or more processors;
    The processor
    content image display processing for displaying a content image (FU) in which perspective is expressed;
    a glow display process for displaying one or more glow images (G) that are displayed at least in the horizontal direction of the content image (FU) and do not have a clear outline,
    The content image display processing includes:
    a first content image (FU1) having a first length (αf10) in the horizontal direction; and
    A second content image (FU2) that has a second length (αf20) that is shorter than the first length (αf10) in the horizontal direction and that is expressed farther than the first content image when viewed from an observer. , at the same time or at different times,
    The glow display processing includes:
    displaying a first glow image (G1) having a third length (αg10) between the left end and the right end and displayed in the horizontal direction of the first content image (FU1);
    displaying a second glow image (G2) having a fourth length (αg20) between the left end and the right end and displayed in the horizontal direction of the second content image (FU2); and
    The ratio of the fourth length (αg20) to the second length (αf20) is smaller than the ratio of the third length (αg10) to the first length (αf10) (αg20/ setting the length between the left edge and the right edge of the glow image (G) such that αf20<αg10/αf10);
    Display controller.
  2. 　前記プロセッサは、
    　前記コンテンツ画像表示処理において、前記第１のコンテンツ画像（ＦＵ１）を、前記横方向の長さを徐々に短くしつつ、前記第１の位置から前記第２の位置に移動させることで、前記第２のコンテンツ画像（ＦＵ２）を、表示し、
    　前記グロー表示処理において、前記コンテンツ画像（ＦＵ）の横方向の長さに対する前記コンテンツ画像とともに移動する前記グロー画像の長さの比率を、前記コンテンツ画像（ＦＵ）が上方に移動するに従い、徐々に小さくする、
    請求項１に記載の表示制御装置。     The processor
    In the content image display process, by moving the first content image (FU1) from the first position to the second position while gradually shortening the length in the horizontal direction, 2 content image (FU2),
    In the glow display process, the ratio of the length of the glow image moving with the content image to the length of the content image (FU) in the horizontal direction is gradually increased as the content image (FU) moves upward. make smaller,
    The display control device according to claim 1.
  3. 　前記プロセッサは、
    　前記コンテンツ画像の表現深度が所定の閾値（Ｔｈ１）より遠い場合、前記グロー画像の透過率を高くする、又は非表示とし、
    　前記所定の閾値（Ｔｈ１）は、前記第２の表現深度（Ｅ２０）より深い、
    請求項１に記載の表示制御装置。     The processor
    increasing the transmittance of the glow image or hiding the glow image when the expression depth of the content image is farther than a predetermined threshold (Th1);
    the predetermined threshold (Th1) is deeper than the second representation depth (E20);
    The display control device according to claim 1.
  4. 　前記プロセッサは、
    　前記グロー表示処理において、前記第２のコンテンツ画像が左右方向に並ぶ複数の画像要素を含む場合、前記コンテンツ画像（ＦＵ）の横方向の長さに対する前記コンテンツ画像とともに移動する前記グロー画像の長さの比率をさらに小さくする、
    請求項１に記載の表示制御装置。     The processor
    In the glow display processing, when the second content image includes a plurality of image elements arranged in the horizontal direction, the length of the glow image moving together with the content image relative to the horizontal length of the content image (FU) further reduce the ratio of
    The display control device according to claim 1.
  5. 　前記プロセッサは、
    　　前記グロー画像（Ｇ）の色を、前記コンテンツ画像（ＦＵ）の色に対して、同系色であり、且つ、彩度を低く設定する、
    　請求項１に記載の表示制御装置。     The processor
    setting the color of the glow image (G) to be similar to the color of the content image (FU) and with low saturation;
    The display control device according to claim 1.
  6. 　請求項１に記載の表示制御装置と、
    　表示光を出射する光変調素子と、
    　前記光変調素子からの前記表示光を被投影部にむけるリレー光学系と、を備える、ヘッドアップディスプレイ装置（２０）。     A display control device according to claim 1;
    a light modulation element that emits display light;
    A head-up display device (20) comprising a relay optical system for directing the display light from the light modulation element to a projection target.
  7. 　画像を被投影部材に投影することで、観察者に前記画像の虚像を視認させるヘッドアップディスプレイ装置における表示制御方法であって、
    　奥行き表現を知覚させる表現深度を付加したコンテンツ画像（ＦＵ）を表示するコンテンツ画像表示処理と、
    　前記コンテンツ画像（ＦＵ）の少なくとも左右方向に表示され、はっきりとした輪郭を有さない１つ又は複数のグロー画像（Ｇ）を表示するグロー表示処理と、を含み、
    　　前記コンテンツ画像表示処理は、
    　　　横方向に第１の長さ（αｆ１０）を有し、観察者から見て第１の位置に視認される第１のコンテンツ画像（ＦＵ１）、及び、
    　　　横方向に前記第１の長さ（αｆ１０）より短い第２の長さ（αｆ２０）を有し、観察者から見て前記第１の位置より上側の第２の位置に視認される第２のコンテンツ画像（ＦＵ２）、を同時又は異なるタイミングで表示させ、
    　　前記グロー表示処理は、
    　　　左端と右端との間に第３の長さ（αｇ１０）を有し、前記第１のコンテンツ画像（ＦＵ１）の左右方向に表示される第１のグロー画像（Ｇ１）を表示させ、
    　　　左端と右端との間に第４の長さ（αｇ２０）を有し、前記第２のコンテンツ画像（ＦＵ２）の左右方向に表示される第２のグロー画像（Ｇ２）を表示させ、及び、
    　　　前記第２の長さ（αｆ２０）に対する前記第４の長さ（αｇ２０）の比率が、前記第１の長さ（αｆ１０）に対する前記第３の長さ（αｇ１０）の比率より小さくなる（αｇ２０／αｆ２０＜αｇ１０／αｆ１０）ように、前記グロー画像（Ｇ）の左端と右端との間の長さを設定する、
    表示制御方法。

          A display control method in a head-up display device that allows an observer to visually recognize a virtual image of the image by projecting the image onto a projection target member,
    a content image display process for displaying a content image (FU) to which an expression depth for perceiving a depth expression is added;
    a glow display process of displaying one or more glow images (G) that are displayed at least in the horizontal direction of the content image (FU) and do not have a clear outline,
    The content image display processing includes:
    A first content image (FU1) having a first length (αf10) in the horizontal direction and viewed at a first position from the observer's point of view; and
    A second length (αf20) that is shorter than the first length (αf10) in the lateral direction and is visually recognized at a second position above the first position as seen from the observer. displaying the content image (FU2) at the same time or at different timings,
    The glow display processing includes:
    displaying a first glow image (G1) having a third length (αg10) between the left end and the right end and displayed in the horizontal direction of the first content image (FU1);
    displaying a second glow image (G2) having a fourth length (αg20) between the left end and the right end and displayed in the horizontal direction of the second content image (FU2); and
    The ratio of the fourth length (αg20) to the second length (αf20) is smaller than the ratio of the third length (αg10) to the first length (αf10) (αg20/ setting the length between the left edge and the right edge of the glow image (G) such that αf20<αg10/αf10);
    Display control method.
PCT/JP2022/032526 2021-08-31 2022-08-30 Display control device, head-up display device, and display control method WO2023032956A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021141371 2021-08-31
JP2021-141371 2021-08-31

Publications (1)

Publication Number Publication Date
WO2023032956A1 true WO2023032956A1 (en) 2023-03-09

Family

ID=85411227

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/032526 WO2023032956A1 (en) 2021-08-31 2022-08-30 Display control device, head-up display device, and display control method

Country Status (1)

Country Link
WO (1) WO2023032956A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05324855A (en) * 1992-05-20 1993-12-10 Pfu Ltd Shading display system
JP2013078964A (en) * 2011-09-30 2013-05-02 Toshiba Corp Display device and display method
WO2017046937A1 (en) * 2015-09-18 2017-03-23 日産自動車株式会社 Display apparatus for vehicle and display method for vehicle
US20190147656A1 (en) * 2017-11-14 2019-05-16 Volkswagen Aktiengesellschaft Detection and visualization of system uncertainty in the representation of augmented image content in heads-up displays
JP2019186762A (en) * 2018-04-11 2019-10-24 日本電信電話株式会社 Video generation apparatus, video generation method, program, and data structure
JP2019202589A (en) * 2018-05-22 2019-11-28 日本精機株式会社 Display device
JP2022072954A (en) * 2020-10-30 2022-05-17 日本精機株式会社 Display control device, head-up display device, and display control method
JP2022104225A (en) * 2020-12-28 2022-07-08 日本精機株式会社 Display control device, head-up display apparatus and display control method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05324855A (en) * 1992-05-20 1993-12-10 Pfu Ltd Shading display system
JP2013078964A (en) * 2011-09-30 2013-05-02 Toshiba Corp Display device and display method
WO2017046937A1 (en) * 2015-09-18 2017-03-23 日産自動車株式会社 Display apparatus for vehicle and display method for vehicle
US20190147656A1 (en) * 2017-11-14 2019-05-16 Volkswagen Aktiengesellschaft Detection and visualization of system uncertainty in the representation of augmented image content in heads-up displays
JP2019186762A (en) * 2018-04-11 2019-10-24 日本電信電話株式会社 Video generation apparatus, video generation method, program, and data structure
JP2019202589A (en) * 2018-05-22 2019-11-28 日本精機株式会社 Display device
JP2022072954A (en) * 2020-10-30 2022-05-17 日本精機株式会社 Display control device, head-up display device, and display control method
JP2022104225A (en) * 2020-12-28 2022-07-08 日本精機株式会社 Display control device, head-up display apparatus and display control method

Similar Documents

Publication Publication Date Title
EP2914002B1 (en) Virtual see-through instrument cluster with live video
JP7098452B2 (en) Image processing methods, image processing equipment, computer programs and recording media
KR102270483B1 (en) Method and apparatus for minimizing error due to surrounding environment of three dimentional head-up display
US20190241070A1 (en) Display control device and display control method
US11106045B2 (en) Display system, movable object, and design method
WO2019131160A1 (en) Information processing device, information processing method, and recording medium
WO2023032956A1 (en) Display control device, head-up display device, and display control method
KR20220032448A (en) Method and apparatus of correcting crosstalk
WO2023048213A1 (en) Display control device, head-up display device, and display control method
JP7167918B2 (en) vehicle display
JP2019083385A (en) Head-up display unit
JP7503239B2 (en) Head-up display device
CN111971197B (en) Display control device and head-up display apparatus
JP2022072954A (en) Display control device, head-up display device, and display control method
JP2022104225A (en) Display control device, head-up display apparatus and display control method
JP2023046339A (en) Display control device, head-up display apparatus and display control method
WO2023054307A1 (en) Display control device, head-up display device, and display control method
JP2023034899A (en) Display control device, head-up display device, and display control method
JP2022083609A (en) Display control device, head-up display apparatus and display control method of image
WO2021065700A1 (en) Display control device, head-up display device, and method
JP2023065856A (en) Display control device, head-up display device, and display control method
WO2023003045A1 (en) Display control device, head-up display device, and display control method
JP7415516B2 (en) display control device
JP7238739B2 (en) display controller
JP2023093913A (en) Display control device, head-up display device, and display control method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22864538

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE