WO2017033992A1 - Head-mounted image display device - Google Patents

Head-mounted image display device Download PDF

Info

Publication number
WO2017033992A1
WO2017033992A1 PCT/JP2016/074764 JP2016074764W WO2017033992A1 WO 2017033992 A1 WO2017033992 A1 WO 2017033992A1 JP 2016074764 W JP2016074764 W JP 2016074764W WO 2017033992 A1 WO2017033992 A1 WO 2017033992A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
color
control unit
light
image display
Prior art date
Application number
PCT/JP2016/074764
Other languages
French (fr)
Japanese (ja)
Inventor
岩井　順一
Original Assignee
株式会社テレパシージャパン
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社テレパシージャパン filed Critical 株式会社テレパシージャパン
Publication of WO2017033992A1 publication Critical patent/WO2017033992A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02—Viewing or reading apparatus
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers

Definitions

  • the present invention relates to a head-mounted image display device, and more specifically, includes a control unit that displays an image according to a remaining battery level that allows a user to easily recognize the remaining battery level and extend operating time.
  • the present invention relates to a head-mounted image display device.
  • HMD head mounted display
  • a type of projecting image light based on image data onto the user's eyes while the user recognizes an external image has been proposed.
  • Patent Documents 1 and 2 disclose conventional HMDs.
  • Patent Document 1 discloses a head-mounted display device including a support block that holds a monocular video display unit in a position close to a user's head.
  • This head-mounted display device displays an output image such as data from a personal computer on a viewer unit, which is a display unit, and allows the user's eyes to observe the display screen and the see-through screen of the surrounding external environment together. It is configured.
  • Patent Document 2 describes a head-mounted image display device that projects an image displayed on an image display element onto a user's eye through an optical system.
  • the image display device includes means for switching a state related to image display according to a state in which the user is observing the display image, so that a high-quality or high-quality image can be observed during gaze observation, while non-gaze observation is performed.
  • a configuration is disclosed in which wasteful power consumption is suppressed by displaying an image in a state with low displayability (low resolution, low luminance, low frame rate, or the like).
  • the HMDs described in Patent Documents 1 and 2 are all displayed on a small display device that receives image information from a television, video, image information supply device such as a personal computer, and is held in front of the user's eyes. Thus, the user can perform a separate operation while viewing the display screen of the display device.
  • the present invention has been made in view of the above-described conventional problems, and an object of the present invention is to respond to the remaining battery level that allows the user to easily recognize the remaining battery level and extend the operating time.
  • An object of the present invention is to provide a head-mounted image display device provided with image display control means.
  • a head-mounted image display device includes a display optical system that emits image light based on image data, and image light emitted from the display optical system.
  • An image display unit comprising an eyepiece optical system that projects onto an eye, and a support unit that supports the display optical system and the eyepiece optical system so as to be disposed along an optical path that passes through free space, and the image display unit
  • a control unit having a battery for driving an image, a control unit for controlling the operation of the image display unit, a storage unit for storing various programs and data, and a communication unit for controlling communication with an external device, and the image display A holding member for holding the unit and the control unit on a user's head, wherein the control unit detects the remaining battery level.
  • the battery remaining amount detecting unit when detecting that the remaining amount of the battery is equal to or lower than a predetermined first determination level, transmits a first battery remaining amount decrease signal to the control unit;
  • the control unit controls the image light emitted from the display optical system to be changed to image light corresponding to a predetermined warning display mode upon receiving the first battery remaining amount decrease signal.
  • the display optical system of the image display unit includes a light source that generates irradiation light, and an image display element that receives the irradiation light and converts the light into image light based on the image data, and the light source includes a red light emitting element.
  • Each of the colors based on the image data corresponding to the respective colors by the image display element.
  • the single color image light of each color that has been sequentially converted is additively mixed by a field sequential method so that the user can visually recognize the color image as one frame, When the battery remaining amount decrease signal is received, the light source and the image display element are controlled, and the color image for one frame is converted into a predetermined one of the monochromatic image lights of the respective colors.
  • a first warning display mode for displaying with a single color image light, or a second warning display for converting the color image for one frame into a grayscale image and displaying with a single color image light of a predetermined one of the colors Can change to mode.
  • the monochromatic image light corresponding to the first warning display mode corresponds to a light emitting element of a predetermined color among the light emitting elements of each color in a lighting period for each color provided in the period of one frame.
  • the monochromatic image light obtained by turning on the illumination light and converting the illuminated irradiation light by the image display element, the control unit of the control unit corresponds to the remaining color provided in the one frame period During the lighting period, the light emitting elements corresponding to the remaining colors can be controlled to be in an off state.
  • the monochromatic image light corresponding to the second warning display mode is combined with the image data of each color for the one frame by the control unit of the control unit, and then converted into grayscale image data of a predetermined color of each color.
  • the converted irradiation light is emitted by turning on a light emitting element of a predetermined color among the light emitting elements of each color during a corresponding period in a lighting period for each color provided in the period of the one frame.
  • the control unit of the control unit corresponds to the remaining color provided in the period of the one frame.
  • the light emitting elements corresponding to the remaining colors can be controlled to be in an off state.
  • control unit of the control unit When the control unit of the control unit receives the first low battery level signal, the control unit controls the light source and the image display element so that a color image corresponding to one frame for each separated frame is included in each color. A single color image light corresponding to the first or second warning display mode of a predetermined color may be displayed.
  • a second battery remaining level decrease signal is output.
  • the control unit of the control unit controls the light source and the image display element to enter the first or second warning display mode.
  • the corresponding monochromatic image light can be changed to a different preset color and emitted from the display optical system.
  • the control unit of the control unit controls the light source and the image display element to display the color screen for one frame for each separated frame in each color. A single color image light corresponding to the first or second warning display mode of a predetermined color may be displayed.
  • the image display unit further includes a proximity sensor, and when the user wears the image display unit on the head, a wearing signal is transmitted from the proximity sensor to the control unit of the control unit, and the control unit of the control unit includes: When the mounting signal is received, the battery remaining amount data is acquired from the battery remaining amount detecting unit or the storage unit, and the battery remaining amount detecting unit determines whether the battery remaining amount is equal to or lower than a predetermined first determination level. If the first battery remaining amount reduction signal is received from the battery remaining amount detection unit, the image light emitted from the display optical system corresponds to the predetermined warning display mode. It can be controlled to change to the image light.
  • the head-mounted image display device of the present invention since the user can easily recognize the remaining battery level of the head-mounted image display device at a glance, troubles caused by sudden battery exhaustion after the start of use can be prevented. Workability is improved. In addition, since the power required for the screen display after the remaining battery level drops below a predetermined value can be greatly reduced, the operation time can be extended and it is easy to take measures to avoid inconvenience due to the stop of the apparatus.
  • FIG. 1 It is the schematic which shows each component in the state with which the user of the head mounted image display apparatus by one Embodiment of this invention was mounted
  • the head mounted image display device it is a conceptual diagram showing an example of an image display method when the remaining battery level is low.
  • the head-mounted image display device according to the present embodiment it is a conceptual diagram showing another example of an image display method when the remaining battery level is low.
  • FIG. 1 is a schematic view showing each component in a state in which a user of a head-mounted image display device according to an embodiment of the present invention is worn.
  • the head-mounted image display device 10 includes an image display unit 100 and a control unit 200.
  • the image display unit 100 includes a display optical system 20 and an eyepiece optical system 30, and the control unit 200 incorporates a control unit and a battery for controlling the head-mounted image display device 10 in its housing, and the user's temporal region. It is fixedly supported by the part via the holding member 300.
  • the holding member 300 includes a rigid structure 320 made of a plastic material or the like and a flexible structure member 310 made of a flexible material.
  • the image display unit 100 can adjust the position of the optical axis so that the image light enters the user's eye E through the flexible flexible structure member 310.
  • the head-mounted image display device 10 of the present embodiment is not limited to this, and the image display unit 100 is directly coupled to the holding member 300, and the control unit 200 is separated from the image display unit 100 to hold the holding member 300. It can be implemented in various forms such as a configuration in which the other end is connected via a separate connecting member (not shown).
  • FIG. 2 is a diagram schematically showing a configuration of a housing that houses the control unit and the image display unit of the head-mounted image display device according to the embodiment of the present invention shown in FIG. ) Is a plan view, and (b) is a front view.
  • the control unit 200 has a rectangular parallelepiped-like casing 200a extending forward along the user's head side.
  • the control unit 200 includes a camera unit 211 at one end thereof, and the head-mounted image display device 10 is included in the casing 200a.
  • a control unit 220 that controls overall functions and operations, a battery 230, a communication unit 240, a storage unit 250, an audio processing unit 260, and an operation input unit 270 are provided.
  • a housing portion that is connected to the housing 200a housing the control unit 200 and houses the display optical system 20 of the image display unit 100 constitutes a first housing chamber 20a described later.
  • the first storage chamber 20a includes an image display element 24 that includes an image display element that converts image data into image light and an electronic circuit that controls driving of the light source, and is provided on the surface on the user side of the first storage chamber 20a. Is provided with a proximity sensor 25.
  • a proximity sensor 25 As the proximity sensor 25, an infrared proximity sensor or other various types of proximity sensors can be used.
  • FIG. 3 is a schematic diagram showing the configuration of the image display unit according to the present embodiment shown in FIG. 2, wherein FIG. 3A is a plan view of the image display unit, and FIG. 3B is a front view.
  • the image display unit 100 includes a light source 21, a condenser lens 22, and a display optical system 20 including an image display element 23 that displays image data, and image light L emitted from the display optical system 20.
  • An eyepiece optical system 30 that leads to the eye E, and a support unit 50 that supports the display optical system 20 and the eyepiece optical system 30 so as to be arranged along an optical path that passes through free space.
  • An emission window 60 through which the image light L emitted from the display optical system 20 is transmitted is formed in the first storage chamber 20a, and an incident light through which the image light L from the display optical system 20 is transmitted into the second storage chamber 30a.
  • An eyepiece window 90 through which light guided by the window 80 and the eyepiece optical system 30 is transmitted toward the user's eye E is provided.
  • a protect plate (not shown) made of a transparent elastic member for protecting the user's eyes may be disposed on the surface of the second storage chamber 30a facing the user's eyes.
  • the support unit 50 includes a support member 51 that connects the first storage chamber 20 a that stores the display optical system 20 and the second storage chamber 30 a that stores the eyepiece optical system 30.
  • the support member 51 is composed of two support plates (51a, 51b) facing each other in the vertical direction (Z-axis direction), and there is a space between the support plates. Therefore, the user's line of sight is not blocked by the support member 51.
  • the support member 51 can be covered with a member such as a transparent resin in order to reinforce both support plates (51a, 51b).
  • the support member 51 is formed by two support plates (51a, 51b) facing each other, but is not limited thereto. For example, it can be formed of a single support plate or column. Moreover, you may form a support plate or a support
  • the display optical system 20 includes a homogenizing element and a polarizing element for homogenizing light from the light source 21, and image data is converted into image light by an image display element 23 that is driven and controlled by the image display unit 24.
  • the light is converted and emitted from the emission window 60.
  • the image display element 23 displays an image by modulating incident light according to image data.
  • a transmissive liquid crystal display in which pixels serving as regions through which light passes is arranged in a matrix. It is composed of an element (LCD).
  • the light source 21 is composed of a set of monochromatic light sources composed of light emitting elements that emit light of each color of R (red), G (green), and B (blue). Diode).
  • the light from the light source 21 is condensed through the condenser lens 22 and supplied to the image display element 23.
  • the eyepiece optical system 30 is an optical system that guides the image light L emitted from the display optical system 20 to the user's eye E.
  • the eyepiece optical system 30 includes a prism 31 and an eyepiece lens 32.
  • the prism 31 is a light guide member that functions as means for reflecting the optical path of the image light incident from the display optical system 20 in the direction of the user's eye E.
  • the prism 31 has a shape having an incident surface 31a for image light, a reflecting surface 31b, and an exit surface 31c.
  • the eyepiece lens 32 has positive power (refractive power) and condenses the image light L on the user's eye E.
  • the prism 31 is configured by a single prism or a combination of a plurality of prisms. In the present embodiment, the prism 31 is formed integrally with the eyepiece 32 that is bonded to the incident surface 31a.
  • the reflecting surface 31b of the prism 31 is configured by a total reflection surface or a half mirror surface.
  • the light emitted from the light source 21 is collected by the condenser lens 22 and enters the transmissive image display element 23, and is modulated by the image display element 23 to become image light L, which is an eyepiece optical system.
  • 30 incident windows 80 enter.
  • the entrance window 80 corresponds to the entrance surface of the eyepiece 32 joined to the entrance surface 31a of the prism 31 in FIG.
  • the image light L enters the prism 31 from the incident surface 31a via the eyepiece lens 32, travels in the prism 31 along the lateral (X) direction, and the optical path is reflected on the reflecting surface 31b. It is bent and travels in the direction of the depth (Y) direction.
  • the image light is guided to the user's eye E through the exit surface 31c of the prism 31 (corresponding to the eyepiece window in the present embodiment), and the user observes an enlarged virtual image of the image displayed by the image display element 23. can do.
  • the method of converting image data into image light is not limited to the configuration using the above-described transmission type image display element.
  • a reflection type liquid crystal display element and a polarization beam splitter (PBS) are used. Can be configured.
  • FIG. 4 is a block diagram schematically showing components of the head-mounted image display device according to the present embodiment shown in FIG.
  • the control unit of the head-mounted image display apparatus 10 includes a camera unit 211, a control unit 220, a battery 230, a communication unit 240, a storage unit 250, an audio processing unit 260, and an operation input unit. 270 and the like, and controls the image display unit.
  • the control unit 220 includes a CPU 221 that controls each component for the general operation of the head-mounted image display device 10, an image processing unit 222 that performs desired image processing on displayed image data, and an input / output unit.
  • An input / output control unit 223 that determines the type of data and controls connection switching between the corresponding interface and the component is provided.
  • the control unit 220 receives input from the proximity sensor 25, detects attachment / detachment of the apparatus by the user, and controls image output on / off.
  • the image processing unit 222 is dedicated to performing data conversion processing of image data captured by the camera unit 211 or image data received via the communication unit 240, and separation or synthesis processing of RGB image data under the control of the CPU 221.
  • a processor for example, a DSP
  • the image display unit 24 of the image display unit 100 receives these signals and drives and controls the image display element 23 and the light source 21 to emit image light. Details of the image display control will be described later.
  • the battery 230 supplies power to each component of the head-mounted image display device 10.
  • the output of the battery is monitored by the battery remaining amount detection unit 231.
  • the battery remaining amount detection unit 231 controls the battery remaining amount decrease signal.
  • the control unit 220 controls to change the image light emitted from the display optical system to the image light corresponding to a predetermined warning display mode upon receiving the battery remaining amount decrease signal. Details of the display mode control due to the remaining battery level will be described later.
  • the battery remaining amount detecting unit 231 performs a battery remaining amount detecting operation spontaneously or performs a battery remaining amount detecting operation in accordance with a command from the CPU 221.
  • the communication unit 240 controls the control of the control unit 220 to form a communication channel for voice communication with a wired or wirelessly connected external device and a communication channel for transmitting and receiving image data or character data. Do it below.
  • the communication unit 240 forms a voice call channel, a character data communication channel such as an e-mail, an image data communication channel, and the like with an external mobile communication system.
  • the head-mounted image display device 10 controls to output various information such as communication destination list information to the image display unit 100.
  • the head-mounted image display device 10 controls to output various information other than images to the image display unit 100.
  • the communication unit 240 includes Bluetooth (registered trademark), WiFi (registered trademark), and the like.
  • the storage unit 250 includes a flash memory (flash EEPROM), a RAM (not shown), a program area for storing various application programs necessary for the functional operation of the head-mounted image display device, and data for storing various data. Consists of regions.
  • the program area includes an OS (Operating System) for activation of the head-mounted image display device 10 and operation of each of the above-described components, an application program for executing various functions, for example, a call function support
  • An application program, a web browser for connecting to an Internet server, an MP3 application program for reproducing audio data, an image output application program for displaying still images, and a moving image compression / reproduction application program are stored.
  • the program area of the present embodiment includes an application program related to image display control based on the remaining battery level.
  • the data area is an area for storing various data generated by using the head-mounted image display device 10, and stores menu map information, at least one icon corresponding to various functions, or various contents.
  • image data captured by the camera unit 211, image data received from the outside, various content information data, and the like are temporarily stored.
  • the data area of the present embodiment stores the remaining battery level data detected by the remaining battery level detection unit 231 at the time when the use of the apparatus is ended or temporarily stopped in the nonvolatile memory area, and is used for starting or restarting the apparatus. Accordingly, when the application program related to the image display control based on the battery remaining amount is activated, the stored battery remaining amount data can be transmitted to the control unit 220.
  • the audio processing unit 260 outputs the audio data transmitted / received during a call, the audio data included in the received message, the audio data obtained by playing an audio file received from the external storage device, and the like to the earphone 262, and the user's voice or Other audio signals are collected through the microphone 261.
  • the operation input unit 270 is configured by a touch switch or the like disposed on the side of the housing 200a of the control unit 200, and inputs for the user to instruct the type of the image output to the image display unit 100, a specific function, and the like. Receive.
  • the head-mounted image display device 10 projects image light based on image data or character data received via the communication unit 240 or image data captured by the camera unit 211 to the user's eyes. The user visually recognizes this as a virtual image.
  • FIG. 5 is a schematic diagram showing an image display method of the head-mounted image display device according to the embodiment of the present invention. With reference to FIG. 5, the image display by the sequential color method which is the display image generation method according to the present embodiment will be described.
  • a single modulator image display element
  • three (red, green, and blue) primary color modulation images for each video frame As a sub-frame of each video frame, it is a method of sequentially displaying at high speed so as to create a full-color image in the human visual system. That is, a full-color image is generated by utilizing the relatively slow reaction time of the human eye.
  • each frame period When displaying a video frame, each frame period is divided into at least three time periods, and a primary color image is generated during each of these time periods.
  • primary color images for one frame are continuously generated at high speed, the user's eyes recognize this as a single full-color image.
  • FIG. 5 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times of t 0 to t 3 in one video frame.
  • light of only one color is irradiated on the display surface of the image display element 23 during each time period within one frame period.
  • the time period (t 0 ⁇ t 1) the light source only red light source R in (21 in FIG. 3) is turned, the display sub-frame image corresponding to the red light on the display surface 123 of the image display device 23 Is done.
  • the display surface 123 of the image display element is, for example, a display surface of an LCD panel or an LCOS (Liquid crystal on silicon) panel, but is not limited thereto. Therefore, during the first time period (t 0 to t 1 ), the image display element (23 in FIG. 3) generates red image light 114.
  • the image display element 23 In the time period (t 1 to t 2 ), only the green light source G of the light source 21 is turned on, and the green light is irradiated onto the display surface 123 on which the subframe image corresponding to the green light of the image display element 23 is displayed. . Thus, the image display element 23 generates the green image light 115 during the second time period (t 1 to t 2 ). Finally, in the time period (t 2 to t 3 ), only the blue light source B of the light source 21 is turned on, and the blue light is irradiated onto the surface 123 on which the sub-frame image corresponding to the blue light of the image display element 23 is displayed. Is done. Thus, the image display element 23 generates the blue image light 116 during the last time period (t 2 to t 3 ).
  • the image light of each color corresponding to the red image, the green image, and the blue image that are sub-frame images for each video frame is sequentially emitted, and the full-color display image is visually recognized by the user's eyes.
  • the series of image light is generated in the same manner for subsequent images to be displayed and sequentially emitted from the display optical system.
  • FIG. 6 is a flowchart showing an example of image display control based on the remaining battery level that is executed while the head-mounted image display device according to the present embodiment is in operation.
  • step S100 when the head-mounted image display device is activated (step S100), the control unit 220 instructs the battery remaining amount detection unit 231 to detect the battery remaining amount, and receives the command.
  • the detection unit 231 detects the remaining battery level, and acquires remaining battery level data as a detection result.
  • the control unit 220 may acquire the remaining battery level data at startup by reading the remaining battery level data stored in the storage unit 250 (step S110).
  • the activation of the head-mounted image display apparatus in step S100 is activated by turning on the main power supply of the apparatus, or activation from a standby state based on an input from an infrared proximity sensor included in the apparatus, That is, including restart.
  • the battery remaining amount detecting unit 231 compares the battery remaining amount data acquired in step S110 with a predetermined first determination level (reference remaining amount) set in advance (step S120). When it is detected that the remaining battery level is equal to or lower than a predetermined first determination level, the remaining battery level detection unit 231 transmits a first remaining battery level decrease signal to the control unit 220.
  • control unit 220 sequentially generates a normal display mode, that is, three-color sub-frame images for the image display unit of the image display unit. Control is performed to display a full-color image (step S130). Thereafter, the control branches to before step S110, and the subsequent steps are repeated.
  • the first remaining battery level decrease signal is transmitted from the remaining battery level detection unit 231 to the control unit 220, and the process proceeds to step S140.
  • the control unit 220 receives the first remaining battery level lowering signal, and in response to this, sets a display image for the image display unit in advance. It changes to warning display mode, and it controls to produce
  • control unit 220 checks whether or not an event for the user to remove the device from the head is generated (step S150). When there is no occurrence of an input event for detaching the device from the head, the control unit 220 controls to branch before step S140 and repeat the subsequent steps.
  • control unit 220 stores the remaining battery level data detected by the remaining battery level detection unit 231 at the time of the input event in the nonvolatile memory area (step S160). ).
  • the control unit 220 temporarily stops the operation of the head-mounted image display device 10 and branches before step S100 and waits in a standby state or the main power supply by the user. Is turned off to end the operation (step S170).
  • FIG. 7 is a conceptual diagram illustrating an example of an image display method when the remaining battery level is reduced in the head-mounted image display device according to the present embodiment.
  • a method of generating a display image corresponding to the first warning display mode when the remaining battery level is reduced will be described.
  • FIG. 7 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times t 0 to t 3 in one video frame corresponding to FIG.
  • the first warning display mode of the present embodiment light of only one color is irradiated on the display surface of the display element 23 in one video frame.
  • the green light source G of the light source 21 is lit and green light is displayed during the time period (t 1 to t 2 ) within the period (t 0 to t 3 ) of one frame.
  • the display surface 123 on which the sub-frame image corresponding to the green light of the element 23 is displayed is irradiated, and the red and blue light sources are not turned on during other time periods.
  • the image for one frame is displayed with any one predetermined single color image light (green image light 115 in this example) of each single color image light. It is possible to easily recognize that the remaining amount has decreased, and at the same time, the power required for image display is reduced to approximately one third.
  • FIG. 8 is a conceptual diagram showing another example of the image display method when the remaining battery level is reduced in the head-mounted image display device according to the present embodiment.
  • a method of generating a display image corresponding to the second warning display mode when the remaining battery level is reduced will be described.
  • FIG. 8 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times t 0 to t 3 in one video frame corresponding to FIG.
  • the images corresponding to the respective colors in one video frame are synthesized, they are converted into a grayscale image of a predetermined one of the colors.
  • the image of the color is displayed on the display surface 123 of the image display element 23, and the light of the color is irradiated on the display surface of the image display element 23.
  • the green light source G of the light source 21 is turned on during the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), and the green light is displayed as an image. Irradiation is performed on the display surface 123 on which the green grayscale image of the element 23 is displayed, and the red and blue light sources are not turned on during other time periods.
  • the image of one frame is converted into a single-color grayscale image and displayed with a single color image light (green in this example) of each color. It is possible to easily recognize that the amount has decreased, and at the same time, the power required for image display is reduced.
  • FIG. 9 is a conceptual diagram showing another example of a display image generation method corresponding to the first warning display mode when the remaining battery level is low.
  • control is performed so that monochromatic image light is emitted for each predetermined spaced frame with respect to the remaining amount of the battery below a predetermined first determination level (reference remaining amount).
  • irradiation light of any one of the colors in one video frame is irradiated on the display surface of the display element 23.
  • the display surface of the display element 23 For example, during the time period (t 1 to t 2 ) within the period of one frame (t 0 to t 3 ), only the green light source G of the light source 21 is turned on, and the green light corresponds to when the green light of the display element 23 is turned on. Irradiation is performed on the display surface 123 on which the subframe image to be displayed is displayed, and the red and blue light sources are not turned on during other periods. Further, the display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period.
  • FIG. 10 is a conceptual diagram illustrating another example of a method for generating image light corresponding to the second warning display mode when the remaining battery level is low.
  • control is performed so that monochromatic image light is emitted for each predetermined spaced frame with respect to the remaining amount of the battery below a predetermined first determination level (reference remaining amount).
  • a period in which an image corresponding to each color in one video frame is synthesized and then converted into a predetermined single-color grayscale image of any one of the colors and an image of that color is displayed.
  • the display surface 123 of the image display element 23 are displayed on the display surface 123 of the image display element 23, and the light of the color is irradiated onto the display surface of the image display element 23. That is, only the green light source G of the light source 21 is turned on during the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), and the green light is green when the green light of the image display element 23 is turned on.
  • the display surface 123 on which the grayscale image is displayed is irradiated, and the red and blue light sources are not turned on during other periods.
  • the image display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period. Further, not all sub-frame images are generated in the time period (t 3 to t 6 ) that is the next frame period. That is, monochromatic grayscale image light (green in this example) is displayed at a normal half frame rate. Therefore, in this example, the power required for image display is further reduced.
  • a predetermined level (reference remaining amount) of the remaining battery level that shifts to the warning display mode is defined as a first determination level, and the remaining battery level further falls below the first determination level (reference remaining amount).
  • a second determination level corresponding to the case is set in advance, and when the remaining battery level becomes equal to or lower than the second determination level, control is performed to change the color of the monochromatic image light to a preset different color.
  • FIG. 11 is a flowchart showing another example of image display control based on the remaining battery level that is executed while the head-mounted image display device according to the present embodiment is operating.
  • the head-mounted image display device restarts from the start-up or standby state (step S200), and the control unit 220 acquires battery remaining amount data from the battery remaining amount detection unit 231 or the storage unit 250 (step S200).
  • step S210 the remaining battery level data acquired in step S210 by the remaining battery level detection unit 231 is compared with a predetermined first determination level (reference remaining level) (step S220).
  • a predetermined first determination level reference remaining level
  • control unit 220 sequentially generates a normal display mode, that is, three-color sub-frame images for the image display unit of the image display unit. Control is performed to display a full-color image (step S230). Thereafter, control is performed so as to branch before step S210 and repeat the subsequent steps.
  • the first remaining battery level signal is transmitted from the remaining battery level detection unit 231 to the control unit 220, and the process proceeds to step S240.
  • control unit 220 When the remaining battery level is equal to or lower than a predetermined first determination level, the control unit 220 receives a first battery remaining level lowering signal and enters a warning display mode in which a display image is set in advance for the image display unit. Then, control is performed to generate and emit monochromatic image light corresponding to the first or second warning display mode shown in FIGS. 7 and 8 (step S240).
  • control unit 220 instructs the remaining battery level detection unit 231 to monitor the remaining battery level, and the received remaining battery level detection unit 231 detects the remaining battery level and detects the remaining battery level as a detection result.
  • Data is acquired (step S250).
  • the remaining battery level detection unit 231 compares the remaining battery level data acquired in step S250 with a second determination level corresponding to the case where the remaining battery level further falls below the first determination level (reference remaining level) (step S260). ). If the remaining battery level is not less than or equal to the second determination level, the control unit 220 continues to emit the monochromatic image light corresponding to step S240, branches before step S240, and repeats the subsequent steps. To do.
  • the remaining battery level detection unit 231 transmits a second lower battery level signal to the control unit 220, and the control unit 220 receives the second battery level.
  • the image display unit is controlled to emit the display image by changing the display image to single color image light corresponding to the preset first or second warning display mode of another color. (Step S270). Thereafter, control is performed so that the user corresponding to step S150 in FIG. 6 branches before the step of confirming whether or not an event for detaching the apparatus from the head is generated and the subsequent steps are performed.
  • FIG. 12 is a conceptual diagram showing a display image generation method corresponding to the first warning display mode when the remaining battery level shown in FIG. 11 is lowered.
  • the control unit 220 displays light of only one color within one video frame. Control is performed so that the display surface of the element 23 is irradiated. For example, in the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), only the green light source G of the light source 21 is turned on, and the green light corresponds to when the green light of the display element 23 is turned on. The display surface 123 on which the subframe image is displayed is irradiated, and the red and blue light sources are not turned on during other periods.
  • the display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period. Thereafter, when the remaining battery level in the frame immediately before time t 30 falls below a second determination level set in advance, the time period (t 30 ) within the time period (t 30 to t 33 ) that is the next frame period. T 31 ), only the red light source G of the light source 21 is turned on, and the red light is irradiated on the display surface 123 on which the corresponding sub-frame image is displayed when the red light of the display element 23 is turned on. In addition, the green and blue light sources are not lit. That is, the monochromatic image light is changed from green to red. In the subsequent frames, red image light is emitted. Therefore, the user can easily recognize that the remaining battery level is further reduced.
  • the remaining battery level is equal to or lower than the second determination level, it is possible to change the frame display interval of the display image shown in FIG. 9 in addition to the change of the color of the image light.
  • FIG. 13 is a conceptual diagram showing a display image generation method corresponding to the second warning display mode when the remaining battery level shown in FIG. 11 is reduced.
  • the control unit 220 combines images corresponding to the respective colors in one video frame. Later, it is converted into a predetermined single-color grayscale image of any one of the colors and displayed on the display surface 123 of the image display element 23 during a period in which the image of the color is displayed.
  • the display surface is controlled so as to be irradiated.
  • the green light source G of the light source 21 is turned on, and the green light is green when the green light of the image display element 23 is turned on.
  • the display surface 123 on which the grayscale image is displayed is irradiated, and the red and blue light sources are not turned on during other periods.
  • the image display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period.
  • the remaining battery level is equal to or lower than the second determination level, it is possible to change the frame display interval of the display image shown in FIG. 10 in addition to the change of the color of the image light.
  • the present invention since the user can easily recognize the remaining battery level of the head-mounted image display device at a glance, when the user wears the device and works, Therefore, it is possible to provide a head-mounted image display device with improved operability even when the size and weight are reduced.
  • the power required for the screen display can be greatly reduced, the operation time can be extended, and it is possible to avoid the inconvenience due to the sudden disappearance of the screen during work.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Liquid Crystal Display Device Control (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

Provided is a head-mounted image display device which allows remaining battery capacity to be readily recognized by the user and that allows extended operation time. This head-mounted image display device is provided with: an image display unit composed of a display optical system for emitting image light, an ocular optical system for projecting image light to an eye of a user, and a support section for supporting the display optical system and the ocular optical system; a control unit having a battery, a control section, a storage section, and a communication section; and a holding member for holding the image display unit and the control unit on the head of the user. The control unit furthermore includes a remaining battery capacity detection section for detecting remaining battery capacity, the remaining battery capacity detection section transmits a first battery-capacity-low signal when the remaining battery capacity is equal to or less than a predetermined first assessment level, the control section receives the first battery-capacity-low signal and changes the image light emitted from the display optical system to an image light corresponding to a predetermined warning display mode.

Description

頭部装着型画像表示装置Head-mounted image display device
　本発明は、頭部装着型画像表示装置に関し、より詳しくは、ユーザが容易にバッテリー残量を認識できて稼働時間の延長を可能にするバッテリー残量に応じた画像表示を行う制御手段を備える頭部装着型画像表示装置に関する。 The present invention relates to a head-mounted image display device, and more specifically, includes a control unit that displays an image according to a remaining battery level that allows a user to easily recognize the remaining battery level and extend operating time. The present invention relates to a head-mounted image display device.
　近年、ユーザの身体に取り付けて使用することのできるウェアラブルデバイスへの需要が高まりつつある。特に頭部に装着して使用するヘッドマウントディスプレイ（ＨＭＤ）では、ユーザがＨＭＤを装着した状態で活動を行うときに、必要な情報を確認したり、他のユーザと情報交換を行ったりする利用形態をサポートするため、ユーザが外界像を認識しながら、画像データに基づく画像光をユーザの眼に投影するタイプのものが提案されている。 In recent years, there is an increasing demand for wearable devices that can be attached to a user's body. In particular, a head mounted display (HMD) that is worn on the head is used to check necessary information or exchange information with other users when the user performs activities while wearing the HMD. In order to support the form, a type of projecting image light based on image data onto the user's eyes while the user recognizes an external image has been proposed.
　例えば、特許文献１、２には、従来のＨＭＤが開示されている。
　特許文献１には、単眼式の映像表示手段をユーザの頭部に近接する位置に保持する支持ブロックを備えた頭部装着型表示装置が開示されている。この頭部装着型表示装置は、パーソナルコンピュータからのデータ等の出力画像を表示部であるビュワー部に表示し、ユーザの眼にこの表示画面と周りの外界のシースルー画面とを合わせて観察できるように構成されている。 For example, Patent Documents 1 and 2 disclose conventional HMDs.
Patent Document 1 discloses a head-mounted display device including a support block that holds a monocular video display unit in a position close to a user's head. This head-mounted display device displays an output image such as data from a personal computer on a viewer unit, which is a display unit, and allows the user's eyes to observe the display screen and the see-through screen of the surrounding external environment together. It is configured.
　特許文献２には、画像表示素子に表示された画像を、光学系を通してユーザの眼に投写する頭部装着型画像表示装置が記載されている。この画像表示装置では、ユーザが表示画像を観察している状態に応じて、画像表示に関する状態を切り換える手段を備えることで、注視観察時には高画質ないし高品位の画像を観察させる一方、非注視観察時には表示性の低い状態（低解像度、低輝度、低フレームレート等）で画像表示を行うことで無駄な電力消費を抑える構成が開示されている。 Patent Document 2 describes a head-mounted image display device that projects an image displayed on an image display element onto a user's eye through an optical system. The image display device includes means for switching a state related to image display according to a state in which the user is observing the display image, so that a high-quality or high-quality image can be observed during gaze observation, while non-gaze observation is performed. In some cases, a configuration is disclosed in which wasteful power consumption is suppressed by displaying an image in a state with low displayability (low resolution, low luminance, low frame rate, or the like).
　特許文献１、２に記載されたＨＭＤは、いずれも、テレビ、ビデオをはじめ、パーソナルコンピュータ等の画像情報供給装置から画像情報の供給を受け、ユーザの眼前に保持された小型の表示装置で表示する構造を備え、これにより、ユーザは当該表示装置の表示画面を見ながら、別途の作業等を行うことができる。 The HMDs described in Patent Documents 1 and 2 are all displayed on a small display device that receives image information from a television, video, image information supply device such as a personal computer, and is held in front of the user's eyes. Thus, the user can perform a separate operation while viewing the display screen of the display device.
　一方、上述した従来のＨＭＤをユーザが装着して使用する場合、使用中不意に当該装置がバッテリー切れにより停止すると、作業に支障が生じることが問題となる。バッテリー残量をユーザに認知させるため、従来の携帯機器では、表示画面にバッテリー残量を示すアイコン等を表示する方法が採用されているが、頭部に装着するために小型軽量化が求められるＨＭＤでは、サブディスプレイ等を付加することは難しく、使用開始前に一見してバッテリー残量を確認する手段がなかった。また、使用を開始した後に、表示画面上にバッテリー残量をアイコン等で表示する方法では、作業に必要な情報を表示画面から読み取ることに加えて、付随的なバッテリー残量表示を確認することは煩わしく、作業効率の点からも問題であった。 On the other hand, when a user wears the above-described conventional HMD and uses it, if the device stops unexpectedly during use due to running out of battery, there is a problem in that the work is troubled. In order to allow the user to recognize the remaining battery level, a method of displaying an icon or the like indicating the remaining battery level on the display screen is adopted in the conventional portable device. In the HMD, it is difficult to add a sub-display or the like, and there is no means for confirming the remaining battery level at first glance before the start of use. In addition, in the method of displaying the battery level on the display screen with an icon after starting use, in addition to reading the information necessary for the work from the display screen, confirming the accompanying battery level display Was bothersome and problematic from the viewpoint of work efficiency.
特開２００１－１１７０４７号公報JP 2001-117047 A 特開２００２－１８９４６４号公報JP 2002-189464 A
　本発明は、上記従来の問題点に鑑みてなされたものであって、本発明の目的は、ユーザが容易にバッテリー残量を認識できて稼働時間の延長を可能にするバッテリー残量に応じた画像表示制御手段を備える頭部装着型画像表示装置を提供することにある。 The present invention has been made in view of the above-described conventional problems, and an object of the present invention is to respond to the remaining battery level that allows the user to easily recognize the remaining battery level and extend the operating time. An object of the present invention is to provide a head-mounted image display device provided with image display control means.
　上記目的を達成するためになされた本発明の一態様による頭部装着型画像表示装置は、画像データに基づく画像光を出射する表示光学系、前記表示光学系から出射された画像光をユーザの眼に投射する接眼光学系、及び前記表示光学系と前記接眼光学系とが自由空間を経由する光経路に沿って配置されるように支持する支持部から成る画像表示ユニットと、前記画像表示ユニットを駆動するためのバッテリー、前記画像表示ユニットの動作を制御する制御部、各種のプログラム及びデータを保存する記憶部、及び外部機器との通信を制御する通信部を有する制御ユニットと、前記画像表示ユニット及び前記制御ユニットをユーザの頭部に保持する保持部材と、を備え、前記制御ユニットは、前記バッテリーの残量を検出するバッテリー残量検出部を更に含み、前記バッテリー残量検出部は、前記バッテリーの残量が所定の第１判定レベル以下であることを検出すると、第１のバッテリー残量低下信号を前記制御部に送信し、前記制御部は、前記第１のバッテリー残量低下信号を受信して前記表示光学系から出射される前記画像光を所定の警告表示モードに対応する画像光に変更するように制御することを特徴とする。 In order to achieve the above object, a head-mounted image display device according to an aspect of the present invention includes a display optical system that emits image light based on image data, and image light emitted from the display optical system. An image display unit comprising an eyepiece optical system that projects onto an eye, and a support unit that supports the display optical system and the eyepiece optical system so as to be disposed along an optical path that passes through free space, and the image display unit A control unit having a battery for driving an image, a control unit for controlling the operation of the image display unit, a storage unit for storing various programs and data, and a communication unit for controlling communication with an external device, and the image display A holding member for holding the unit and the control unit on a user's head, wherein the control unit detects the remaining battery level. The battery remaining amount detecting unit, when detecting that the remaining amount of the battery is equal to or lower than a predetermined first determination level, transmits a first battery remaining amount decrease signal to the control unit; The control unit controls the image light emitted from the display optical system to be changed to image light corresponding to a predetermined warning display mode upon receiving the first battery remaining amount decrease signal. And
　前記画像表示ユニットの表示光学系は、照射光を生成する光源と、前記照射光を受光して前記画像データに基づく画像光に変換する画像表示素子と、を備え、前記光源は、赤色発光素子、緑色発光素子、及び青色発光素子から成り、前記制御ユニットの制御部は、前記各色の発行素子を順次に点灯させて各色の照射光を前記画像表示素子により各色に対応する画像データに基づく各色の単色画像光に変換し、順次に変換された連続する前記各色の単色画像光を面順次（フィールドシーケンシャル）方式により加法混色して１フレーム分のカラー画像としてユーザに視認させ、前記第１のバッテリー残量低下信号を受信すると、前記光源及び前記画像表示素子を制御して、前記１フレーム分のカラー画像を前記各色の単色画像光の中の所定の１色の単色画像光で表示する第１の警告表示モード又は前記１フレーム分のカラー画像をグレースケール画像に変換して前記各色の中の所定の１色の単色画像光で表示する第２の警告表示モードに変更し得る。
　前記第１の警告表示モードに対応する単色画像光は、前記各色の発光素子の中の所定の１色の発光素子を前記１フレームの期間内に設けられた色毎の点灯期間の中の対応する期間に点灯させて、該点灯させた照射光を前記画像表示素子によって変換した単色画像光であり、前記制御ユニットの制御部は、前記１フレームの期間内に設けられた残りの色に対応する点灯期間中に前記残りの色に対応する発光素子をオフ状態に制御し得る。
　前記第２の警告表示モードに対応する単色画像光は、前記制御ユニットの制御部により前記１フレーム分の各色の画像データを合成した後、各色の中の所定の１色のグレースケール画像データに変換し、前記各色の発光素子の中の所定の１色の発光素子を前記１フレームの期間内に設けられた色毎の点灯期間の中の対応する期間に点灯させて該点灯させた照射光を前記画像表示素子によって前記グレースケール画像データに基づく当該色の画像光に変換した単色画像光であり、前記制御ユニットの制御部は、前記１フレームの期間内に設けられた残りの色に対応する点灯期間中に前記残りの色に対応する発光素子をオフ状態に制御し得る。
　前記制御ユニットの制御部は、前記第１のバッテリー残量低下信号を受信すると、前記光源及び前記画像表示素子を制御して、離隔したフレーム毎に前記１フレーム分のカラー画像を各色の中の所定の１色の前記第１又は第２の警告表示モードに対応する単色画像光で表示し得る。 The display optical system of the image display unit includes a light source that generates irradiation light, and an image display element that receives the irradiation light and converts the light into image light based on the image data, and the light source includes a red light emitting element. Each of the colors based on the image data corresponding to the respective colors by the image display element. The single color image light of each color that has been sequentially converted is additively mixed by a field sequential method so that the user can visually recognize the color image as one frame, When the battery remaining amount decrease signal is received, the light source and the image display element are controlled, and the color image for one frame is converted into a predetermined one of the monochromatic image lights of the respective colors. A first warning display mode for displaying with a single color image light, or a second warning display for converting the color image for one frame into a grayscale image and displaying with a single color image light of a predetermined one of the colors Can change to mode.
The monochromatic image light corresponding to the first warning display mode corresponds to a light emitting element of a predetermined color among the light emitting elements of each color in a lighting period for each color provided in the period of one frame. The monochromatic image light obtained by turning on the illumination light and converting the illuminated irradiation light by the image display element, the control unit of the control unit corresponds to the remaining color provided in the one frame period During the lighting period, the light emitting elements corresponding to the remaining colors can be controlled to be in an off state.
The monochromatic image light corresponding to the second warning display mode is combined with the image data of each color for the one frame by the control unit of the control unit, and then converted into grayscale image data of a predetermined color of each color. The converted irradiation light is emitted by turning on a light emitting element of a predetermined color among the light emitting elements of each color during a corresponding period in a lighting period for each color provided in the period of the one frame. Is converted into image light of the color based on the grayscale image data by the image display element, and the control unit of the control unit corresponds to the remaining color provided in the period of the one frame. During the lighting period, the light emitting elements corresponding to the remaining colors can be controlled to be in an off state.
When the control unit of the control unit receives the first low battery level signal, the control unit controls the light source and the image display element so that a color image corresponding to one frame for each separated frame is included in each color. A single color image light corresponding to the first or second warning display mode of a predetermined color may be displayed.
　前記制御ユニットのバッテリー残量検出部は、前記バッテリーの残量が前記第１判定レベルよりも低い予め設定した第２判定レベル以下であることを検出すると、第２のバッテリー残量低下信号を前記制御部に送信し、前記制御ユニットの制御部は、前記第２のバッテリー残量低下信号を受信すると、前記光源及び前記画像表示素子を制御して、前記第１又は第２の警告表示モードに対応する単色画像光を予め設定した別色に変更して前記表示光学系から出射し得る。
　前記制御ユニットの制御部は、前記第２のバッテリー残量低下信号を受信すると、前記光源及び前記画像表示素子を制御して、離隔したフレーム毎に前記１フレーム分のカラー画面を各色の中の所定の１色の前記第１又は第２の警告表示モードに対応する単色画像光で表示し得る。
　前記画像表示ユニットは、近接センサーを更に備え、ユーザが前記画像表示ユニットを頭部に装着すると、前記近接センサーから装着信号が前記制御ユニットの制御部に伝達され、前記制御ユニットの制御部は、前記装着信号を受信すると、前記バッテリー残量検出部又は前記記憶部から前記バッテリーの残量データを取得して、前記バッテリー残量検出部に前記バッテリーの残量が所定の第１判定レベル以下か否かを検出するように制御し、前記バッテリー残量検出部から前記第１のバッテリー残量低下信号を受信すると、前記表示光学系から出射される前記画像光を前記所定の警告表示モードに対応する画像光に変更するように制御し得る。 When the remaining battery level detection unit of the control unit detects that the remaining battery level is equal to or lower than a preset second determination level that is lower than the first determination level, a second battery remaining level decrease signal is output. When the control unit of the control unit receives the second low battery level signal, the control unit of the control unit controls the light source and the image display element to enter the first or second warning display mode. The corresponding monochromatic image light can be changed to a different preset color and emitted from the display optical system.
When the control unit of the control unit receives the second low battery level signal, the control unit controls the light source and the image display element to display the color screen for one frame for each separated frame in each color. A single color image light corresponding to the first or second warning display mode of a predetermined color may be displayed.
The image display unit further includes a proximity sensor, and when the user wears the image display unit on the head, a wearing signal is transmitted from the proximity sensor to the control unit of the control unit, and the control unit of the control unit includes: When the mounting signal is received, the battery remaining amount data is acquired from the battery remaining amount detecting unit or the storage unit, and the battery remaining amount detecting unit determines whether the battery remaining amount is equal to or lower than a predetermined first determination level. If the first battery remaining amount reduction signal is received from the battery remaining amount detection unit, the image light emitted from the display optical system corresponds to the predetermined warning display mode. It can be controlled to change to the image light.
　本発明の頭部装着型画像表示装置によれば、頭部装着型画像表示装置のバッテリー残量をユーザが一見して容易に認識できるため、使用開始後に突然のバッテリー切れによるトラブル発生を防ぐことができ、作業性が向上する。また、バッテリー残量が既定値以下に低下した後の画面表示に要する電力を大幅に削減できるため、稼働時間を延長でき、装置停止による不都合を回避する対応を取ることが容易になる。 According to the head-mounted image display device of the present invention, since the user can easily recognize the remaining battery level of the head-mounted image display device at a glance, troubles caused by sudden battery exhaustion after the start of use can be prevented. Workability is improved. In addition, since the power required for the screen display after the remaining battery level drops below a predetermined value can be greatly reduced, the operation time can be extended and it is easy to take measures to avoid inconvenience due to the stop of the apparatus.
本発明の一実施形態による頭部装着型画像表示装置のユーザが装着した状態における各構成要素を示す概略図である。It is the schematic which shows each component in the state with which the user of the head mounted image display apparatus by one Embodiment of this invention was mounted | worn. 図１に示す本実施形態による頭部装着型画像表示装置の制御ユニットと画像表示ユニットとを収納する筺体の構成を概略的に示す図であり、（ａ）は平面図、（ｂ）は正面図である。It is a figure which shows schematically the structure of the housing which accommodates the control unit and image display unit of the head mounted image display apparatus by this embodiment shown in FIG. 1, (a) is a top view, (b) is a front view FIG. 図２に示す本実施形態による画像表示ユニットの構成を示す概略図であり、（ａ）は画像表示ユニットの平面図、（ｂ）は正面図である。It is the schematic which shows the structure of the image display unit by this embodiment shown in FIG. 2, (a) is a top view of an image display unit, (b) is a front view. 図２に示した本実施形態による頭部装着型画像表示装置の構成要素を概略的に示すブロック図である。It is a block diagram which shows roughly the component of the head mounted image display apparatus by this embodiment shown in FIG. 本発明の一実施形態による頭部装着型画像表示装置の画像表示方法を示す模式図である。It is a schematic diagram which shows the image display method of the head mounted image display apparatus by one Embodiment of this invention. 本実施形態による頭部装着型画像表示装置が作動中に実行するバッテリー残量に基づく画像表示制御の一例を示すフローチャートである。It is a flowchart which shows an example of the image display control based on the battery remaining charge performed during the operation | movement of the head mounted image display apparatus by this embodiment. 本実施形態による頭部装着型画像表示装置において、バッテリー残量が低下した場合の画像表示方法の一例を示す概念図である。In the head mounted image display device according to the present embodiment, it is a conceptual diagram showing an example of an image display method when the remaining battery level is low. 本実施形態による頭部装着型画像表示装置において、バッテリー残量が低下した場合の画像表示方法の他の例を示す概念図である。In the head-mounted image display device according to the present embodiment, it is a conceptual diagram showing another example of an image display method when the remaining battery level is low. バッテリー残量が低下した場合の第１の警告表示モードに対応する表示画像の生成方法の他の例を示す概念図である。It is a conceptual diagram which shows the other example of the production | generation method of the display image corresponding to 1st warning display mode when a battery remaining charge falls. バッテリー残量が低下した場合の第２の警告表示モードに対応する表示画像の生成方法の他の例を示す概念図である。It is a conceptual diagram which shows the other example of the production | generation method of the display image corresponding to 2nd warning display mode when a battery remaining charge falls. 本実施形態による頭部装着型画像表示装置が作動中に実行するバッテリー残量に基づく画像表示制御の他の例を示すフローチャートである。It is a flowchart which shows the other example of the image display control based on the battery residual amount performed during the operation | movement of the head mounted image display apparatus by this embodiment. 図１１に示すバッテリー残量が低下した場合の第１の警告表示モードに対応する表示画像の生成方法を示す概念図である。It is a conceptual diagram which shows the production | generation method of the display image corresponding to 1st warning display mode when the battery remaining charge shown in FIG. 11 falls. 図１１に示すバッテリー残量が低下した場合の第２の警告表示モードに対応する表示画像の生成方法を示す概念図である。It is a conceptual diagram which shows the production | generation method of the display image corresponding to 2nd warning display mode when the battery remaining charge shown in FIG. 11 falls.
　以下、本発明を実施するための形態の具体例を、図面を参照しながら詳細に説明する。 Hereinafter, specific examples of embodiments for carrying out the present invention will be described in detail with reference to the drawings.
　図１は、本発明の一実施形態による頭部装着型画像表示装置のユーザが装着した状態における各構成要素を示す概略図である。 FIG. 1 is a schematic view showing each component in a state in which a user of a head-mounted image display device according to an embodiment of the present invention is worn.
　頭部装着型画像表示装置１０は、画像表示ユニット１００及び制御ユニット２００を備える。画像表示ユニット１００は、表示光学系２０及び接眼光学系３０からなり、制御ユニット２００は、その筐体内に頭部装着型画像表示装置１０を制御する制御部及びバッテリーを内蔵し、ユーザの側頭部に保持部材３００を介して固定支持される。保持部材３００は、プラスティック素材等から成る剛性構造体３２０及び可撓性を有する素材からなる柔構造部材３１０で構成される。 The head-mounted image display device 10 includes an image display unit 100 and a control unit 200. The image display unit 100 includes a display optical system 20 and an eyepiece optical system 30, and the control unit 200 incorporates a control unit and a battery for controlling the head-mounted image display device 10 in its housing, and the user's temporal region. It is fixedly supported by the part via the holding member 300. The holding member 300 includes a rigid structure 320 made of a plastic material or the like and a flexible structure member 310 made of a flexible material.
　画像表示ユニット１００は、可撓性の柔構造部材３１０を介して画像光がユーザの眼Ｅに入るように光軸の位置調整が可能である。なお、本実施形態の頭部装着型画像表示装置１０は、これに限定されず、画像表示ユニット１００を保持部材３００に直接結合し、制御ユニット２００を画像表示ユニット１００から分離して保持部材３００の他の端部に別途の連結部材（図示せず）を介して接続する構成など、多様な形態で具現可能である。 The image display unit 100 can adjust the position of the optical axis so that the image light enters the user's eye E through the flexible flexible structure member 310. The head-mounted image display device 10 of the present embodiment is not limited to this, and the image display unit 100 is directly coupled to the holding member 300, and the control unit 200 is separated from the image display unit 100 to hold the holding member 300. It can be implemented in various forms such as a configuration in which the other end is connected via a separate connecting member (not shown).
　図２は、図１に示す本発明の一実施形態による頭部装着型画像表示装置の制御ユニットと画像表示ユニットとを収納する筺体の構成を概略的に示す図であり、図２の（ａ）は平面図、（ｂ）は正面図である。制御ユニット２００は、ユーザの頭側に沿って前方へ延びる直方体様の筐体２００ａを有し、その一端部にカメラ部２１１を備え、筐体２００ａ内に、頭部装着型画像表示装置１０の機能及び動作全般を制御する制御部２２０、バッテリー２３０、通信部２４０、記憶部２５０、オーディオ処理部２６０、及び操作入力部２７０を備える。制御ユニット２００を収納した筺体２００ａに連結されて画像表示ユニット１００の表示光学系２０を収納する筺体部分は、後述の第１収納室２０ａを構成する。また、第１収納室２０ａ内には画像データを画像光に変換する画像表示素子及び光源の駆動を制御する電子回路からなる画像表示部２４を備え、第１収納室２０ａのユーザ側の表面上には近接センサー２５が設けられる。なお、近接センサー２５には、赤外線近接センサー又はその他の多様な形式の近接センサーを使用し得る。 FIG. 2 is a diagram schematically showing a configuration of a housing that houses the control unit and the image display unit of the head-mounted image display device according to the embodiment of the present invention shown in FIG. ) Is a plan view, and (b) is a front view. The control unit 200 has a rectangular parallelepiped-like casing 200a extending forward along the user's head side. The control unit 200 includes a camera unit 211 at one end thereof, and the head-mounted image display device 10 is included in the casing 200a. A control unit 220 that controls overall functions and operations, a battery 230, a communication unit 240, a storage unit 250, an audio processing unit 260, and an operation input unit 270 are provided. A housing portion that is connected to the housing 200a housing the control unit 200 and houses the display optical system 20 of the image display unit 100 constitutes a first housing chamber 20a described later. Further, the first storage chamber 20a includes an image display element 24 that includes an image display element that converts image data into image light and an electronic circuit that controls driving of the light source, and is provided on the surface on the user side of the first storage chamber 20a. Is provided with a proximity sensor 25. As the proximity sensor 25, an infrared proximity sensor or other various types of proximity sensors can be used.
　図３は、図２に示す本実施形態による画像表示ユニットの構成を示す概略図であり、図３の（ａ）は画像表示ユニットの平面図、（ｂ）は正面図である。 FIG. 3 is a schematic diagram showing the configuration of the image display unit according to the present embodiment shown in FIG. 2, wherein FIG. 3A is a plan view of the image display unit, and FIG. 3B is a front view.
　図３に示すように、画像表示ユニット１００は、光源２１、集光レンズ２２、及び画像データを表示する画像表示素子２３を備える表示光学系２０、表示光学系２０から出射した画像光Ｌをユーザの眼Ｅに導く接眼光学系３０、及び表示光学系２０と接眼光学系３０とが自由空間を経由する光経路に沿って配置されるように支持する支持部５０を備える。 As shown in FIG. 3, the image display unit 100 includes a light source 21, a condenser lens 22, and a display optical system 20 including an image display element 23 that displays image data, and image light L emitted from the display optical system 20. An eyepiece optical system 30 that leads to the eye E, and a support unit 50 that supports the display optical system 20 and the eyepiece optical system 30 so as to be arranged along an optical path that passes through free space.
　第１収納室２０ａには、表示光学系２０から射出された画像光Ｌが透過する出射窓６０が形成され、第２収納室３０ａには、表示光学系２０からの画像光Ｌが透過する入射窓８０及び接眼光学系３０により導かれる光がユーザの眼Ｅに向かって透過する接眼窓９０が設けられる。なお、第２収納室３０ａのユーザの眼に対向する面には、ユーザの眼を保護するための透明な弾性部材からなるプロテクト板（図示せず）を配置してもよい。 An emission window 60 through which the image light L emitted from the display optical system 20 is transmitted is formed in the first storage chamber 20a, and an incident light through which the image light L from the display optical system 20 is transmitted into the second storage chamber 30a. An eyepiece window 90 through which light guided by the window 80 and the eyepiece optical system 30 is transmitted toward the user's eye E is provided. A protect plate (not shown) made of a transparent elastic member for protecting the user's eyes may be disposed on the surface of the second storage chamber 30a facing the user's eyes.
　支持部５０は、表示光学系２０を収納する第１収納室２０ａと、接眼光学系３０を収納する第２収納室３０ａとを連結する支持部材５１で構成される。
　支持部材５１は、上下方向（Ｚ軸方向）に互いに対面する２枚の支持板（５１ａ、５１ｂ）で構成され、両支持板の間には空間が存在する。したがって、支持部材５１によってユーザの視線は遮られない。なお、両支持板（５１ａ、５１ｂ）を補強するために支持部材５１を透明樹脂などの部材で覆うことも可能である。また、本実施形態で、支持部材５１は互いに対面する２枚の支持板（５１ａ、５１ｂ）で形成されるが、これに限定されない。例えば、単一の支持板または支柱で形成され得る。また、支持板または支柱は透明部材で形成してもよい。 The support unit 50 includes a support member 51 that connects the first storage chamber 20 a that stores the display optical system 20 and the second storage chamber 30 a that stores the eyepiece optical system 30.
The support member 51 is composed of two support plates (51a, 51b) facing each other in the vertical direction (Z-axis direction), and there is a space between the support plates. Therefore, the user's line of sight is not blocked by the support member 51. The support member 51 can be covered with a member such as a transparent resin in order to reinforce both support plates (51a, 51b). Further, in the present embodiment, the support member 51 is formed by two support plates (51a, 51b) facing each other, but is not limited thereto. For example, it can be formed of a single support plate or column. Moreover, you may form a support plate or a support | pillar with a transparent member.
　表示光学系２０は、図示しないが、光源２１からの光を均一化するための均一化素子及び偏光素子を含み、画像表示部２４によって駆動制御される画像表示素子２３により画像データを画像光に変換して出射窓６０から射出する。
　画像表示素子２３は、入射光を画像データに応じて変調することにより、画像を表示するものであって、例えば、光が通過する領域となる各画素がマトリクス状に配置された透過型液晶表示素子（ＬＣＤ）で構成される。 Although not shown, the display optical system 20 includes a homogenizing element and a polarizing element for homogenizing light from the light source 21, and image data is converted into image light by an image display element 23 that is driven and controlled by the image display unit 24. The light is converted and emitted from the emission window 60.
The image display element 23 displays an image by modulating incident light according to image data. For example, a transmissive liquid crystal display in which pixels serving as regions through which light passes is arranged in a matrix. It is composed of an element (LCD).
　光源２１は、Ｒ（赤色）、Ｇ（緑色）、Ｂ（青色）の各色の光を放出する発光素子からなる単色光源の組で構成され、各単色光源の発光素子には、例えばＬＥＤ（発光ダイオード）が用いられる。光源２１からの光は、集光レンズ２２を介して集光されて画像表示素子２３に供給される。 The light source 21 is composed of a set of monochromatic light sources composed of light emitting elements that emit light of each color of R (red), G (green), and B (blue). Diode). The light from the light source 21 is condensed through the condenser lens 22 and supplied to the image display element 23.
　接眼光学系３０は、表示光学系２０から出射された画像光Ｌをユーザの眼Ｅに導く光学系である。接眼光学系３０は、プリズム３１及び接眼レンズ３２を備える。 The eyepiece optical system 30 is an optical system that guides the image light L emitted from the display optical system 20 to the user's eye E. The eyepiece optical system 30 includes a prism 31 and an eyepiece lens 32.
　プリズム３１は、表示光学系２０から入射した画像光の光路をユーザの眼Ｅの方向に反射する手段として機能する導光部材である。プリズム３１は、画像光の入射面３１ａと、反射面３１ｂと、出射面３１ｃとを有する形状である。
　接眼レンズ３２は、正のパワー（屈折力）を持ち、画像光Ｌをユーザの眼Ｅに集光する。なお、プリズム３１は、単一のプリズムで構成されるか、または複数プリズムを組み合わせて構成される。本実施形態で、プリズム３１は、入射面３１ａに接合された接眼レンズ３２と一体に形成される。また、プリズム３１の反射面３１ｂは、全反射面もしくはハーフミラー面で構成される。 The prism 31 is a light guide member that functions as means for reflecting the optical path of the image light incident from the display optical system 20 in the direction of the user's eye E. The prism 31 has a shape having an incident surface 31a for image light, a reflecting surface 31b, and an exit surface 31c.
The eyepiece lens 32 has positive power (refractive power) and condenses the image light L on the user's eye E. The prism 31 is configured by a single prism or a combination of a plurality of prisms. In the present embodiment, the prism 31 is formed integrally with the eyepiece 32 that is bonded to the incident surface 31a. The reflecting surface 31b of the prism 31 is configured by a total reflection surface or a half mirror surface.
　上記構成によって、光源２１から出射された光は、集光レンズ２２で集光されて透過型の画像表示素子２３に入射し、画像表示素子２３によって変調されて画像光Ｌになり、接眼光学系３０の入射窓８０に入射する。入射窓８０は、図３においてプリズム３１の入射面３１ａに接合された接眼レンズ３２の入射面に相当する。接眼光学系３０では、画像光Ｌが接眼レンズ３２を介して入射面３１ａからプリズム３１の内部に入射し、プリズム３１の内部を横（Ｘ）方向に沿って進行し、反射面３１ｂで光路が折り曲げられて奥行き（Ｙ）方向手前に向きを変えて進行する。これにより、画像光はプリズム３１の出射面３１ｃ（本実施形態における接眼窓に対応）を介してユーザの眼Ｅに導かれ、ユーザは、画像表示素子２３によって表示された画像の拡大虚像を観察することができる。 With the above configuration, the light emitted from the light source 21 is collected by the condenser lens 22 and enters the transmissive image display element 23, and is modulated by the image display element 23 to become image light L, which is an eyepiece optical system. 30 incident windows 80 enter. The entrance window 80 corresponds to the entrance surface of the eyepiece 32 joined to the entrance surface 31a of the prism 31 in FIG. In the eyepiece optical system 30, the image light L enters the prism 31 from the incident surface 31a via the eyepiece lens 32, travels in the prism 31 along the lateral (X) direction, and the optical path is reflected on the reflecting surface 31b. It is bent and travels in the direction of the depth (Y) direction. Thereby, the image light is guided to the user's eye E through the exit surface 31c of the prism 31 (corresponding to the eyepiece window in the present embodiment), and the user observes an enlarged virtual image of the image displayed by the image display element 23. can do.
　なお、画像データを画像光に変換する方法は、上述した透過型の画像表示素子を用いる構成に限定されず、例えば、図示しないが反射型液晶表示素子と偏光ビームスプリッター（ＰＢＳ）とを用いて構成し得る。 The method of converting image data into image light is not limited to the configuration using the above-described transmission type image display element. For example, although not shown, a reflection type liquid crystal display element and a polarization beam splitter (PBS) are used. Can be configured.
　図４は、図２に示した本実施形態による頭部装着型画像表示装置の構成要素を概略的に示すブロック図である。 FIG. 4 is a block diagram schematically showing components of the head-mounted image display device according to the present embodiment shown in FIG.
　図４及び図２を参照すると、頭部装着型画像表示装置１０の制御ユニットは、カメラ部２１１、制御部２２０、バッテリー２３０、通信部２４０、記憶部２５０、オーディオ処理部２６０、及び操作入力部２７０等を備え、画像表示ユニットを制御する。 4 and 2, the control unit of the head-mounted image display apparatus 10 includes a camera unit 211, a control unit 220, a battery 230, a communication unit 240, a storage unit 250, an audio processing unit 260, and an operation input unit. 270 and the like, and controls the image display unit.
　制御部２２０は、頭部装着型画像表示装置１０の全般的な動作のために各構成要素を制御するＣＰＵ２２１、表示する画像データに対して所望の画像処理を行う画像処理部２２２、及び入出力データの種別を判定して対応するインターフェイスと構成要素との接続切換え等を制御する入出力制御部２２３を備える。
　また、制御部２２０は、近接センサー２５からの入力を受けて、ユーザによる本装置の着脱を検出し、画像出力のオン・オフを制御する。 The control unit 220 includes a CPU 221 that controls each component for the general operation of the head-mounted image display device 10, an image processing unit 222 that performs desired image processing on displayed image data, and an input / output unit. An input / output control unit 223 that determines the type of data and controls connection switching between the corresponding interface and the component is provided.
The control unit 220 receives input from the proximity sensor 25, detects attachment / detachment of the apparatus by the user, and controls image output on / off.
　画像処理部２２２は、ＣＰＵ２２１の制御の下で、カメラ部２１１で撮影した画像データ又は通信部２４０を介して受信した画像データのデータ変換処理、及びＲＧＢ画像データの分離又は合成処理などを行う専用プロセッサ（例えば、ＤＳＰ）を備え、表示する画像データに対応した画像信号及び制御信号に所望の処理を行って画像表示ユニット１００の画像表示部２４に供給する。
　画像表示ユニット１００の画像表示部２４は、これらの信号を受信して画像表示素子２３及び光源２１を駆動制御して画像光を出射する。画像表示制御の詳細については後述する。 The image processing unit 222 is dedicated to performing data conversion processing of image data captured by the camera unit 211 or image data received via the communication unit 240, and separation or synthesis processing of RGB image data under the control of the CPU 221. A processor (for example, a DSP) is provided, performs desired processing on the image signal and control signal corresponding to the image data to be displayed, and supplies the image signal to the image display unit 24 of the image display unit 100.
The image display unit 24 of the image display unit 100 receives these signals and drives and controls the image display element 23 and the light source 21 to emit image light. Details of the image display control will be described later.
　バッテリー２３０は、頭部装着型画像表示装置１０の各構成要素に電力を供給する。バッテリーの出力はバッテリー残量検出部２３１によってモニターされ、モニター結果としてバッテリー残量が所定の第１判定レベル以下であることを検出すると、バッテリー残量検出部２３１はバッテリーの残量低下信号を制御部２２０に送信する。制御部２２０は、バッテリー残量の低下信号を受信して表示光学系から出射する画像光を所定の警告表示モードに対応する画像光に変更するように制御する。バッテリー残量の低下による表示モード制御の詳細は後述する。なお、バッテリー残量検出部２３１は、自発的にバッテリー残量検出動作を行うか又はＣＰＵ２２１からの指令に従ってバッテリー残量検出動作を行う。 The battery 230 supplies power to each component of the head-mounted image display device 10. The output of the battery is monitored by the battery remaining amount detection unit 231. When it is detected as a monitoring result that the battery remaining amount is equal to or lower than the predetermined first determination level, the battery remaining amount detection unit 231 controls the battery remaining amount decrease signal. To the unit 220. The control unit 220 controls to change the image light emitted from the display optical system to the image light corresponding to a predetermined warning display mode upon receiving the battery remaining amount decrease signal. Details of the display mode control due to the remaining battery level will be described later. Note that the battery remaining amount detecting unit 231 performs a battery remaining amount detecting operation spontaneously or performs a battery remaining amount detecting operation in accordance with a command from the CPU 221.
　通信部２４０は、有線又は無線接続された外部機器との間に音声通話のための通信チャネルの形成、及び画像データ又は文字データを送受信するための通信チャネルの形成などを制御部２２０の制御の下に行う。例えば、通信部２４０は、音声通話チャネル、電子メール等の文字データ通信チャネル、及び画像データ通信チャネルなどを外部の移動通信システムとの間に形成する。通信部２４０の運用のために、頭部装着型画像表示装置１０は、様々な情報、例えば通信先リスト情報などを画像表示ユニット１００に出力するように制御する。通信部２４０の運用により、頭部装着型画像表示装置１０は、画像以外の様々な情報を画像表示ユニット１００に出力するように制御する。通信部２４０は、ブルートゥース（登録商標）、ＷｉＦｉ（登録商標）などを含んで構成される。 The communication unit 240 controls the control of the control unit 220 to form a communication channel for voice communication with a wired or wirelessly connected external device and a communication channel for transmitting and receiving image data or character data. Do it below. For example, the communication unit 240 forms a voice call channel, a character data communication channel such as an e-mail, an image data communication channel, and the like with an external mobile communication system. For the operation of the communication unit 240, the head-mounted image display device 10 controls to output various information such as communication destination list information to the image display unit 100. Through the operation of the communication unit 240, the head-mounted image display device 10 controls to output various information other than images to the image display unit 100. The communication unit 240 includes Bluetooth (registered trademark), WiFi (registered trademark), and the like.
　記憶部２５０は、図示しないがフラッシュメモリ（フラッシュＥＥＰＲＯＭ）、ＲＡＭ等で構成され、頭部装着型画像表示装置の機能動作に必要な各種アプリケーションプログラムを保存するプログラム領域及び各種のデータを保存するデータ領域からなる。 The storage unit 250 includes a flash memory (flash EEPROM), a RAM (not shown), a program area for storing various application programs necessary for the functional operation of the head-mounted image display device, and data for storing various data. Consists of regions.
　プログラム領域は、頭部装着型画像表示装置１０の起動及び上述した各構成要素の運用のためのＯＳ（Ｏｐｅｒａｔｉｎｇ　Ｓｙｓｔｅｍ）、様々な機能を実行するためのアプリケーションプログラム、例えば、通話機能サポートのためのアプリケーションプログラム、インターネットサーバーに接続するためのウェブブラウザ、オーディオデータを再生するためのＭＰ３アプリケーションプログラム、静止画像などを表示するためのイメージ出力アプリケーションプログラム、動画像圧縮再生アプリケーションプログラムなどを保存する。
　特に、本実施形態のプログラム領域は、バッテリー残量に基づく画像表示制御に関するアプリケーションプログラムを含む。 The program area includes an OS (Operating System) for activation of the head-mounted image display device 10 and operation of each of the above-described components, an application program for executing various functions, for example, a call function support An application program, a web browser for connecting to an Internet server, an MP3 application program for reproducing audio data, an image output application program for displaying still images, and a moving image compression / reproduction application program are stored.
In particular, the program area of the present embodiment includes an application program related to image display control based on the remaining battery level.
　データ領域は、頭部装着型画像表示装置１０の使用によって発生する各種データが保存される領域であり、メニューマップ情報、各種機能に対応する少なくとも１つのアイコン又は様々なコンテンツを保存する。また、データ領域には、カメラ部２１１で撮影した画像データ、外部から受信した画像データ、及び各種コンテンツ情報データなどが一時保存される。また、本実施形態のデータ領域は、本装置を使用終了又は一時停止した時点におけるバッテリー残量検出部２３１で検出したバッテリー残量データを不揮発性メモリ領域に保存し、本装置の起動又は再開に応じて、バッテリー残量に基づく画像表示制御に関するアプリケーションプログラムの活性化時に、保存されたバッテリー残量データを制御部２２０に送信することが可能になる。 The data area is an area for storing various data generated by using the head-mounted image display device 10, and stores menu map information, at least one icon corresponding to various functions, or various contents. In the data area, image data captured by the camera unit 211, image data received from the outside, various content information data, and the like are temporarily stored. The data area of the present embodiment stores the remaining battery level data detected by the remaining battery level detection unit 231 at the time when the use of the apparatus is ended or temporarily stopped in the nonvolatile memory area, and is used for starting or restarting the apparatus. Accordingly, when the application program related to the image display control based on the battery remaining amount is activated, the stored battery remaining amount data can be transmitted to the control unit 220.
　オーディオ処理部２６０は、通話時に送受信されるオーディオデータ、受信したメッセージに含まれるオーディオデータ、及び外部記憶装置から受信したオーディオファイル再生によるオーディオデータなどをイヤホン２６２に出力し、通話時にユーザの音声又はその他のオーディオ信号を、マイク２６１を通じて収集する。 The audio processing unit 260 outputs the audio data transmitted / received during a call, the audio data included in the received message, the audio data obtained by playing an audio file received from the external storage device, and the like to the earphone 262, and the user's voice or Other audio signals are collected through the microphone 261.
　操作入力部２７０は、制御ユニット２００の筺体２００ａ側部に配置されるタッチスイッチ等で構成され、画像表示ユニット１００に出力される画像の種類や特定の機能等をユーザが指示するための入力を受信する。 The operation input unit 270 is configured by a touch switch or the like disposed on the side of the housing 200a of the control unit 200, and inputs for the user to instruct the type of the image output to the image display unit 100, a specific function, and the like. Receive.
　上述した構成により、頭部装着型画像表示装置１０は、通信部２４０を介して受信した画像データや文字データ、又はカメラ部２１１で撮影された画像データに基づく画像光をユーザの眼に投影し、ユーザはこれを虚像として視認する。 With the above-described configuration, the head-mounted image display device 10 projects image light based on image data or character data received via the communication unit 240 or image data captured by the camera unit 211 to the user's eyes. The user visually recognizes this as a virtual image.
　以下、本発明の一実施形態による頭部装着型画像表示装置における画像表示の制御方法をより詳細に説明する。 Hereinafter, an image display control method in the head-mounted image display device according to the embodiment of the present invention will be described in more detail.
　図５は、本発明の一実施形態による頭部装着型画像表示装置の画像表示方法を示す模式図である。図５を参照して、本実施形態による表示画像の生成方法であるシーケンシャルカラー方式による画像表示について説明する。 FIG. 5 is a schematic diagram showing an image display method of the head-mounted image display device according to the embodiment of the present invention. With reference to FIG. 5, the image display by the sequential color method which is the display image generation method according to the present embodiment will be described.
　シーケンシャルカラー方式は、単一の変調器（画像表示素子）を使用して、１つのビデオフレーム毎に３つ（赤色、緑色、および青色）の原色の変調画像を作成し、各色の変調画像を各ビデオフレームのサブフレームとして、人間の視覚系においてフルカラー画像を作成するように高速で順次表示する方式である。すなわち、人間の眼の反応時間が比較的遅いことを利用してフルカラー画像を生成する。ビデオフレームの表示に際して、各フレーム周期は少なくとも３つの時間期間に分けられ、これらの各時間期間中に原色画像が生成される。１フレーム分の原色画像が連続して高速に生成されると、ユーザの眼はこれを単一のフルカラー画像として認識する。 In the sequential color method, a single modulator (image display element) is used to create three (red, green, and blue) primary color modulation images for each video frame. As a sub-frame of each video frame, it is a method of sequentially displaying at high speed so as to create a full-color image in the human visual system. That is, a full-color image is generated by utilizing the relatively slow reaction time of the human eye. When displaying a video frame, each frame period is divided into at least three time periods, and a primary color image is generated during each of these time periods. When primary color images for one frame are continuously generated at high speed, the user's eyes recognize this as a single full-color image.
　図５は、１つのビデオフレーム内の、ｔ０～ｔ３という異なる時間における変調器、すなわち画像表示素子２３の表示面１２３を模式的に示している。 FIG. 5 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times of t 0 to t 3 in one video frame.
　図５に示すように、１フレームの期間内の各時間期間中に一色のみの色の光が画像表示素子２３の表示面上に照射される。たとえば時間期間（ｔ０～ｔ１）では、光源（図３の２１）中の赤色光源Ｒのみが点灯され、画像表示素子２３の表示面１２３上には赤色光に対応するサブフレーム画像が表示される。画像表示素子の表示面１２３は、たとえばＬＣＤパネルまたはＬＣＯＳ（Ｌｉｑｕｉｄ　ｃｒｙｓｔａｌ　ｏｎ　ｓｉｌｉｃｏｎ）パネルの表示面であるが、これらに限定されない。したがって、第１の時間期間（ｔ０～ｔ１）中に、画像表示素子（図３の２３）は赤色画像光１１４を生成する。時間期間（ｔ１～ｔ２）では、光源２１の緑色光源Ｇのみが点灯され、緑色光が画像表示素子２３の緑色光に対応するサブフレーム画像が表示された表示面１２３上に照射される。これにより、第２の時間期間（ｔ１～ｔ２）中に、画像表示素子２３は緑色画像光１１５を生成する。最後に、時間期間（ｔ２～ｔ３）では、光源２１の青色光源Ｂのみが点灯され、青色光が画像表示素子２３の青色光に対応するサブフレーム画像が表示された面１２３上に照射される。これにより、最後の時間期間（ｔ２～ｔ３）中に、画像表示素子２３は青色画像光１１６を生成する。 As shown in FIG. 5, light of only one color is irradiated on the display surface of the image display element 23 during each time period within one frame period. For example, in the time period (t 0 ~ t 1), the light source only red light source R in (21 in FIG. 3) is turned, the display sub-frame image corresponding to the red light on the display surface 123 of the image display device 23 Is done. The display surface 123 of the image display element is, for example, a display surface of an LCD panel or an LCOS (Liquid crystal on silicon) panel, but is not limited thereto. Therefore, during the first time period (t 0 to t 1 ), the image display element (23 in FIG. 3) generates red image light 114. In the time period (t 1 to t 2 ), only the green light source G of the light source 21 is turned on, and the green light is irradiated onto the display surface 123 on which the subframe image corresponding to the green light of the image display element 23 is displayed. . Thus, the image display element 23 generates the green image light 115 during the second time period (t 1 to t 2 ). Finally, in the time period (t 2 to t 3 ), only the blue light source B of the light source 21 is turned on, and the blue light is irradiated onto the surface 123 on which the sub-frame image corresponding to the blue light of the image display element 23 is displayed. Is done. Thus, the image display element 23 generates the blue image light 116 during the last time period (t 2 to t 3 ).
　上述のように、１つのビデオフレーム毎のサブフレーム画像である赤色画像、緑色画像、及び青色画像に対応する各色の画像光が順次に出射されて、フルカラー表示画像がユーザの眼に視認される。上記一連の画像光は、表示すべき後続画像に対しても同様に生成されて、順次表示光学系から出射される。 As described above, the image light of each color corresponding to the red image, the green image, and the blue image that are sub-frame images for each video frame is sequentially emitted, and the full-color display image is visually recognized by the user's eyes. . The series of image light is generated in the same manner for subsequent images to be displayed and sequentially emitted from the display optical system.
　次に、図６及び図７を用いて、本実施形態による頭部装着型画像表示装置における表示画像の表示モード切換え動作を説明する。 Next, the display image display mode switching operation in the head-mounted image display device according to the present embodiment will be described with reference to FIGS.
　図６は、本実施形態による頭部装着型画像表示装置が作動中に実行するバッテリー残量に基づく画像表示制御の一例を示すフローチャートである。 FIG. 6 is a flowchart showing an example of image display control based on the remaining battery level that is executed while the head-mounted image display device according to the present embodiment is in operation.
　図６において、頭部装着型画像表示装置が起動される（ステップＳ１００）と、制御部２２０は、バッテリー残量検出部２３１にバッテリー残量を検出するよう指令し、指令を受けたバッテリー残量検出部２３１はバッテリー残量を検出して、検出結果であるバッテリー残量データを取得する。あるいは、制御部２２０は、記憶部２５０に保存されたバッテリー残量データを読み込むことで、起動時にバッテリー残量データを取得してもよい（ステップＳ１１０）。
　なお、ステップＳ１００における頭部装着型画像表示装置の起動は、当該装置の主電源をオンにすることによる起動、または当該装置に具備される赤外線近接センサーからの入力に基づくスタンバイ状態からの起動、すなわち再開を含む。 In FIG. 6, when the head-mounted image display device is activated (step S100), the control unit 220 instructs the battery remaining amount detection unit 231 to detect the battery remaining amount, and receives the command. The detection unit 231 detects the remaining battery level, and acquires remaining battery level data as a detection result. Alternatively, the control unit 220 may acquire the remaining battery level data at startup by reading the remaining battery level data stored in the storage unit 250 (step S110).
Note that the activation of the head-mounted image display apparatus in step S100 is activated by turning on the main power supply of the apparatus, or activation from a standby state based on an input from an infrared proximity sensor included in the apparatus, That is, including restart.
　バッテリー残量検出部２３１は、ステップＳ１１０で取得したバッテリー残量データを予め設定した所定の第１判定レベル（基準残量）と比較する（ステップＳ１２０）。バッテリー残量が所定の第１判定レベル以下であることを検出すると、バッテリー残量検出部２３１は第１のバッテリー残量低下信号を制御部２２０に送信する。 The battery remaining amount detecting unit 231 compares the battery remaining amount data acquired in step S110 with a predetermined first determination level (reference remaining amount) set in advance (step S120). When it is detected that the remaining battery level is equal to or lower than a predetermined first determination level, the remaining battery level detection unit 231 transmits a first remaining battery level decrease signal to the control unit 220.
　制御部２２０は、バッテリー残量が所定の第１判定レベル以下ではない場合、画像表示ユニットの画像表示部に対して、通常の表示モード、すなわち、３色のサブフレーム画像を順次に生成してフルカラー画像を表示するように制御する（ステップＳ１３０）。その後、ステップＳ１１０の前に分岐し、以降のステップを繰り返して行うように制御する。 When the remaining battery level is not equal to or lower than the predetermined first determination level, the control unit 220 sequentially generates a normal display mode, that is, three-color sub-frame images for the image display unit of the image display unit. Control is performed to display a full-color image (step S130). Thereafter, the control branches to before step S110, and the subsequent steps are repeated.
　一方、バッテリー残量が所定の第１判定レベル以下である場合、バッテリー残量検出部２３１から第１のバッテリー残量低下信号が制御部２２０に送信されて、ステップＳ１４０に移行する。 On the other hand, when the remaining battery level is equal to or lower than the predetermined first determination level, the first remaining battery level decrease signal is transmitted from the remaining battery level detection unit 231 to the control unit 220, and the process proceeds to step S140.
　制御部２２０は、バッテリー残量が所定の第１判定レベル以下である場合、第１のバッテリー残量低下信号を受信し、これを受けて、画像表示ユニットに対して、表示画像を予め設定した警告表示モードに変更し、警告表示モードに対応する画面を生成して表示するように制御する（ステップＳ１４０）。警告表示モードの詳細は後述する。 When the remaining battery level is equal to or lower than a predetermined first determination level, the control unit 220 receives the first remaining battery level lowering signal, and in response to this, sets a display image for the image display unit in advance. It changes to warning display mode, and it controls to produce | generate and display the screen corresponding to warning display mode (step S140). Details of the warning display mode will be described later.
　その後、制御部２２０は、ユーザが当該装置を頭部から脱着するイベントが生成されるか否かを確認する（ステップＳ１５０）。当該装置を頭部から脱着する入力イベントの発生がない場合、制御部２２０は、ステップＳ１４０の前に分岐して、以降のステップを繰り返して行うように制御する。 Thereafter, the control unit 220 checks whether or not an event for the user to remove the device from the head is generated (step S150). When there is no occurrence of an input event for detaching the device from the head, the control unit 220 controls to branch before step S140 and repeat the subsequent steps.
　一方、当該装置を頭部から脱着する入力イベントが発生した場合、制御部２２０は、入力イベント時点におけるバッテリー残量検出部２３１で検出したバッテリー残量データを不揮発性メモリ領域に保存する（ステップＳ１６０）。バッテリー残量データの保存が終了すると、制御部２２０は、頭部装着型画像表示装置１０の作動を一時停止してステップＳ１００の前に分岐して、スタンバイ状態で待機するか又はユーザにより主電源がオフにされて作動を終了する（ステップＳ１７０）。 On the other hand, when an input event for detaching the device from the head occurs, the control unit 220 stores the remaining battery level data detected by the remaining battery level detection unit 231 at the time of the input event in the nonvolatile memory area (step S160). ). When the storage of the battery remaining amount data is finished, the control unit 220 temporarily stops the operation of the head-mounted image display device 10 and branches before step S100 and waits in a standby state or the main power supply by the user. Is turned off to end the operation (step S170).
　図７は、本実施形態による頭部装着型画像表示装置において、バッテリー残量が低下した場合の画像表示方法の一例を示す概念図である。以下、図７を参照して、バッテリー残量が低下した場合の第１の警告表示モードに対応する表示画像の生成方法を説明する。 FIG. 7 is a conceptual diagram illustrating an example of an image display method when the remaining battery level is reduced in the head-mounted image display device according to the present embodiment. Hereinafter, with reference to FIG. 7, a method of generating a display image corresponding to the first warning display mode when the remaining battery level is reduced will be described.
　図７は、図５に対応する１つのビデオフレーム内の、ｔ０～ｔ３という異なる時間における変調器、すなわち画像表示素子２３の表示面１２３を模式的に示している。 FIG. 7 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times t 0 to t 3 in one video frame corresponding to FIG.
　図７に示すように、本実施形態の第１の警告表示モードでは、１つのビデオフレーム内で一色のみの色の光が表示素子２３の表示面上に照射される。具体的に、図７に示す例では、１フレームの期間（ｔ０～ｔ３）内の時間期間（ｔ１～ｔ２）に、光源２１の緑色光源Ｇのみが点灯され、緑色光が表示素子２３の緑色光に対応するサブフレーム画像が表示された表示面１２３上に照射され、これ以外の時間期間には、赤色及び青色光源は点灯されない。 As shown in FIG. 7, in the first warning display mode of the present embodiment, light of only one color is irradiated on the display surface of the display element 23 in one video frame. Specifically, in the example shown in FIG. 7, only the green light source G of the light source 21 is lit and green light is displayed during the time period (t 1 to t 2 ) within the period (t 0 to t 3 ) of one frame. The display surface 123 on which the sub-frame image corresponding to the green light of the element 23 is displayed is irradiated, and the red and blue light sources are not turned on during other time periods.
　したがって、第１の警告表示モードでは、１フレーム分の画像を、各単色画像光の中のいずれか１つの所定の単色画像光（本例では緑色画像光１１５）で表示するため、ユーザはバッテリー残量が低下したことを容易に認識可能であり、同時に、画像表示に要する電力が概ね３分の１に削減される。 Accordingly, in the first warning display mode, the image for one frame is displayed with any one predetermined single color image light (green image light 115 in this example) of each single color image light. It is possible to easily recognize that the remaining amount has decreased, and at the same time, the power required for image display is reduced to approximately one third.
　図８は、本実施形態による頭部装着型画像表示装置において、バッテリー残量が低下した場合の画像表示方法の他の例を示す概念図である。以下、図８を参照して、バッテリー残量が低下した場合の第２の警告表示モードに対応する表示画像の生成方法を説明する。 FIG. 8 is a conceptual diagram showing another example of the image display method when the remaining battery level is reduced in the head-mounted image display device according to the present embodiment. Hereinafter, with reference to FIG. 8, a method of generating a display image corresponding to the second warning display mode when the remaining battery level is reduced will be described.
　図８は、図５に対応する１つのビデオフレーム内の、ｔ０～ｔ３という異なる時間における変調器、すなわち画像表示素子２３の表示面１２３を模式的に示している。 FIG. 8 schematically shows the modulator, that is, the display surface 123 of the image display element 23 at different times t 0 to t 3 in one video frame corresponding to FIG.
　図８に示すように、本実施形態の第２の警告表示モードでは、１つのビデオフレーム内の各色に対応する画像を合成した後に、各色の中の所定の１色のグレースケール画像に変換して当該色の画像を表示する期間に画像表示素子２３の表示面１２３に表示し、当該色の光が画像表示素子２３の表示面上に照射される。具体的に、図８示す例では、１フレームの期間（ｔ０～ｔ３）内の時間期間（ｔ１～ｔ２）に、光源２１の緑色光源Ｇのみが点灯され、緑色光が画像表示素子２３の緑色グレースケール画像が表示された表示面１２３上に照射され、これ以外の時間期間には、赤色及び青色光源は点灯されない。 As shown in FIG. 8, in the second warning display mode of the present embodiment, after the images corresponding to the respective colors in one video frame are synthesized, they are converted into a grayscale image of a predetermined one of the colors. Thus, the image of the color is displayed on the display surface 123 of the image display element 23, and the light of the color is irradiated on the display surface of the image display element 23. Specifically, in the example shown in FIG. 8, only the green light source G of the light source 21 is turned on during the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), and the green light is displayed as an image. Irradiation is performed on the display surface 123 on which the green grayscale image of the element 23 is displayed, and the red and blue light sources are not turned on during other time periods.
　したがって、第２の警告表示モードでは、１フレームの画像を、単色グレースケール画像に変換して各色の中の所定の一色の単色画像光（本例では緑色）で表示するため、ユーザはバッテリー残量が低下したことを容易に認識可能であり、同時に、画像表示に要する電力が削減される。 Therefore, in the second warning display mode, the image of one frame is converted into a single-color grayscale image and displayed with a single color image light (green in this example) of each color. It is possible to easily recognize that the amount has decreased, and at the same time, the power required for image display is reduced.
　図９は、バッテリー残量が低下した場合の第１の警告表示モードに対応する表示画像の生成方法の他の例を示す概念図である。本実施例では、所定の第１判定レベル（基準残量）以下のバッテリーの残量に対して、予め設定した離隔したフレーム毎に単色画像光を出射するように制御する。 FIG. 9 is a conceptual diagram showing another example of a display image generation method corresponding to the first warning display mode when the remaining battery level is low. In the present embodiment, control is performed so that monochromatic image light is emitted for each predetermined spaced frame with respect to the remaining amount of the battery below a predetermined first determination level (reference remaining amount).
　図９に示すように、１つのビデオフレーム内の各色の中のいずれか一色の照射光が表示素子２３の表示面上に照射される。例えば、１フレームの期間（ｔ０～ｔ３）内の時間期間（ｔ１～ｔ２）に、光源２１の緑色光源Ｇのみが点灯され、緑色光が表示素子２３の緑色光の点灯時に対応するサブフレーム画像が表示された表示面１２３上に照射され、これ以外の期間には、赤色及び青色光源は点灯されない。また、表示素子２３も、赤色及び青色光に対応する各サブフレーム画像を表示せず、この期間は駆動オフ状態にしてもよい。さらに、次のフレーム期間である時間期間（ｔ３～ｔ６）には、全てのサブフレーム画像光が生成されない。すなわち、通常の半分のフレームレートで、単色画像光（本例では緑色）が表示される。したがって、この例では、画像表示に要する電力が更に削減される。 As shown in FIG. 9, irradiation light of any one of the colors in one video frame is irradiated on the display surface of the display element 23. For example, during the time period (t 1 to t 2 ) within the period of one frame (t 0 to t 3 ), only the green light source G of the light source 21 is turned on, and the green light corresponds to when the green light of the display element 23 is turned on. Irradiation is performed on the display surface 123 on which the subframe image to be displayed is displayed, and the red and blue light sources are not turned on during other periods. Further, the display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period. Further, not all the sub-frame image light is generated in the time period (t 3 to t 6 ) that is the next frame period. That is, monochromatic image light (green in this example) is displayed at a normal half frame rate. Therefore, in this example, the power required for image display is further reduced.
　図１０は、バッテリー残量が低下した場合の第２の警告表示モードに対応する画像光の生成方法の他の例を示す概念図である。本実施例では、所定の第１判定レベル（基準残量）以下のバッテリーの残量に対して、予め設定した離隔したフレーム毎に単色画像光を出射するように制御する。 FIG. 10 is a conceptual diagram illustrating another example of a method for generating image light corresponding to the second warning display mode when the remaining battery level is low. In the present embodiment, control is performed so that monochromatic image light is emitted for each predetermined spaced frame with respect to the remaining amount of the battery below a predetermined first determination level (reference remaining amount).
　図１０に示すように、１つのビデオフレーム内の各色に対応する画像を合成した後に、各色の中のいずれか１色の所定の単色グレースケール画像に変換して当該色の画像を表示する期間に画像表示素子２３の表示面１２３に表示し、当該色の光が画像表示素子２３の表示面上に照射される。すなわち、１フレーム期間（ｔ０～ｔ３）内の時間期間（ｔ１～ｔ２）に、光源２１の緑色光源Ｇのみが点灯され、緑色光が画像表示素子２３の緑色光の点灯時に緑色グレースケール画像が表示された表示面１２３上に照射され、これ以外の期間には、赤色及び青色光源は点灯されない。また、画像表示素子２３も、赤色及び青色光に対応する各サブフレーム画像を表示せず、この期間は駆動オフ状態にしてもよい。さらに、次のフレーム期間である時間期間（ｔ３～ｔ６）には、全てのサブフレーム画像が生成されない。すなわち、通常の半分のフレームレートで、単色グレースケール画像光（本例では緑色）が表示される。したがって、この例では、画像表示に要する電力が更に削減される。 As shown in FIG. 10, a period in which an image corresponding to each color in one video frame is synthesized and then converted into a predetermined single-color grayscale image of any one of the colors and an image of that color is displayed. Are displayed on the display surface 123 of the image display element 23, and the light of the color is irradiated onto the display surface of the image display element 23. That is, only the green light source G of the light source 21 is turned on during the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), and the green light is green when the green light of the image display element 23 is turned on. The display surface 123 on which the grayscale image is displayed is irradiated, and the red and blue light sources are not turned on during other periods. Further, the image display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period. Further, not all sub-frame images are generated in the time period (t 3 to t 6 ) that is the next frame period. That is, monochromatic grayscale image light (green in this example) is displayed at a normal half frame rate. Therefore, in this example, the power required for image display is further reduced.
　次に、図１１及び図１２を用いて、本実施形態による頭部装着型画像表示装置における表示画像の表示モード切換え動作の他の例を説明する。
　本実施例では、警告表示モードに移行するバッテリー残量の所定レベル（基準残量）を第１判定レベルと定義し、この第１判定レベル（基準残量）よりもバッテリー残量がさらに低下した場合に対応する第２判定レベルを予め設定し、バッテリー残量が、この第２判定レベル以下になると、単色画像光の色を予め設定した別色に変更するよう制御する。 Next, another example of the display image display mode switching operation in the head-mounted image display device according to the present embodiment will be described with reference to FIGS. 11 and 12.
In the present embodiment, a predetermined level (reference remaining amount) of the remaining battery level that shifts to the warning display mode is defined as a first determination level, and the remaining battery level further falls below the first determination level (reference remaining amount). A second determination level corresponding to the case is set in advance, and when the remaining battery level becomes equal to or lower than the second determination level, control is performed to change the color of the monochromatic image light to a preset different color.
　図１１は、本実施形態による頭部装着型画像表示装置が作動中に実行するバッテリー残量に基づく画像表示制御の他の例を示すフローチャートである。 FIG. 11 is a flowchart showing another example of image display control based on the remaining battery level that is executed while the head-mounted image display device according to the present embodiment is operating.
　図１１において、頭部装着型画像表示装置が起動又スタンバイ状態から再開して（ステップＳ２００）、制御部２２０が、バッテリー残量検出部２３１又は記憶部２５０からバッテリー残量データを取得し（ステップＳ２１０）、バッテリー残量検出部２３１によりステップＳ２１０で取得したバッテリー残量データを予め設定した所定の第１判定レベル（基準残量）と比較する（ステップＳ２２０）。バッテリー残量が所定の第１判定レベル以下であることを検出すると、バッテリー残量検出部２３１が第１のバッテリー残量低下信号を制御部２２０に送信する各段階は、図６に示したフローと同様であるので、説明を省略する。 In FIG. 11, the head-mounted image display device restarts from the start-up or standby state (step S200), and the control unit 220 acquires battery remaining amount data from the battery remaining amount detection unit 231 or the storage unit 250 (step S200). In step S210, the remaining battery level data acquired in step S210 by the remaining battery level detection unit 231 is compared with a predetermined first determination level (reference remaining level) (step S220). When it is detected that the remaining battery level is equal to or lower than the predetermined first determination level, each stage in which the remaining battery level detecting unit 231 transmits the first remaining battery level lowering signal to the control unit 220 is performed according to the flow shown in FIG. Since it is the same as that, the description is omitted.
　制御部２２０は、バッテリー残量が所定の第１判定レベル以下ではない場合、画像表示ユニットの画像表示部に対して、通常の表示モード、すなわち、３色のサブフレーム画像を順次に生成してフルカラー画像を表示するように制御する（ステップＳ２３０）。その後、ステップＳ２１０の前に分岐し、以降のステップを繰り返して行うように制御する。 When the remaining battery level is not equal to or lower than the predetermined first determination level, the control unit 220 sequentially generates a normal display mode, that is, three-color sub-frame images for the image display unit of the image display unit. Control is performed to display a full-color image (step S230). Thereafter, control is performed so as to branch before step S210 and repeat the subsequent steps.
　一方、バッテリー残量が所定の第１判定レベル以下である場合、バッテリー残量検出部２３１から第１のバッテリー残量低下信号が制御部２２０に送信されて、ステップＳ２４０に移行する。 On the other hand, when the remaining battery level is equal to or lower than the predetermined first determination level, the first remaining battery level signal is transmitted from the remaining battery level detection unit 231 to the control unit 220, and the process proceeds to step S240.
　制御部２２０は、バッテリー残量が所定の第１判定レベル以下である場合、第１のバッテリー残量低下信号を受信して、画像表示ユニットに対して、表示画像を予め設定した警告表示モードに変更し、図７及び図８に示した第１又は第２の警告表示モードに対応する単色画像光を生成して出射するように制御する（ステップＳ２４０）。 When the remaining battery level is equal to or lower than a predetermined first determination level, the control unit 220 receives a first battery remaining level lowering signal and enters a warning display mode in which a display image is set in advance for the image display unit. Then, control is performed to generate and emit monochromatic image light corresponding to the first or second warning display mode shown in FIGS. 7 and 8 (step S240).
　その後、制御部２２０は、バッテリー残量検出部２３１にバッテリー残量をモニターするよう指令し、指令を受けたバッテリー残量検出部２３１はバッテリー残量を検出して、検出結果であるバッテリー残量データを取得する（ステップＳ２５０）。 After that, the control unit 220 instructs the remaining battery level detection unit 231 to monitor the remaining battery level, and the received remaining battery level detection unit 231 detects the remaining battery level and detects the remaining battery level as a detection result. Data is acquired (step S250).
　バッテリー残量検出部２３１は、ステップＳ２５０で取得したバッテリー残量データを第１判定レベル（基準残量）よりもバッテリー残量がさらに低下した場合に対応する第２判定レベルと比較する（ステップＳ２６０）。バッテリー残量が第２判定レベル以下ではない場合、制御部２２０は、ステップＳ２４０に対応する単色画像光の出射を継続し、ステップＳ２４０の前に分岐して以降のステップを繰り返して行うように制御する。 The remaining battery level detection unit 231 compares the remaining battery level data acquired in step S250 with a second determination level corresponding to the case where the remaining battery level further falls below the first determination level (reference remaining level) (step S260). ). If the remaining battery level is not less than or equal to the second determination level, the control unit 220 continues to emit the monochromatic image light corresponding to step S240, branches before step S240, and repeats the subsequent steps. To do.
　一方、バッテリー残量が第２判定レベル以下であることを検出すると、バッテリー残量検出部２３１は第２のバッテリー残量低下信号を制御部２２０に送信し、制御部２２０は、第２のバッテリー残量低下信号を受信して、画像表示ユニットに対して、表示画像を予め設定した別色の第１又は第２の警告表示モードに対応する単色画像光に変更して出射するように制御する（ステップＳ２７０）。その後、図６のステップＳ１５０に対応するユーザが当該装置を頭部から脱着するイベントが生成されるか否かを確認するステップの前に分岐して以降のステップを行うように制御する。 On the other hand, when it is detected that the remaining battery level is equal to or lower than the second determination level, the remaining battery level detection unit 231 transmits a second lower battery level signal to the control unit 220, and the control unit 220 receives the second battery level. Upon receiving the remaining amount reduction signal, the image display unit is controlled to emit the display image by changing the display image to single color image light corresponding to the preset first or second warning display mode of another color. (Step S270). Thereafter, control is performed so that the user corresponding to step S150 in FIG. 6 branches before the step of confirming whether or not an event for detaching the apparatus from the head is generated and the subsequent steps are performed.
　図１２は、図１１に示すバッテリー残量が低下した場合の第１の警告表示モードに対応する表示画像の生成方法を示す概念図である。 FIG. 12 is a conceptual diagram showing a display image generation method corresponding to the first warning display mode when the remaining battery level shown in FIG. 11 is lowered.
　図１２に示すように、バッテリー残量が第１の判定レベルである所定レベル（基準残量）以下に低下した後、制御部２２０は、１つのビデオフレーム内で一色のみの色の光が表示素子２３の表示面上に照射されるように制御する。例えば、１フレーム期間（ｔ０～ｔ３）内の時間期間（ｔ１～ｔ２）に、光源２１の緑色光源Ｇのみが点灯され、緑色光が表示素子２３の緑色光の点灯時に対応するサブフレーム画像が表示された表示面１２３上に照射され、これ以外の期間に、赤色及び青色光源は点灯されない。また、表示素子２３も、赤色及び青色光に対応する各サブフレーム画像を表示せず、この期間は駆動オフ状態にしてもよい。その後、時間ｔ３０の直前のフレームでバッテリーの残量が予め設定した第２の判定レベル以下に低下すると、次のフレーム期間である時間期間（ｔ３０～ｔ３３）内の時間期間（ｔ３０～ｔ３１）に、光源２１の赤色光源Ｇのみが点灯され、赤色光が表示素子２３の赤色光の点灯時に対応するサブフレーム画像が表示された表示面１２３上に照射され、これ以外の期間に、緑色及び青色光源は点灯されない。すなわち、単色画像光が緑色から赤色に変更される。そして、以降のフレームは赤色画像光が出射される。したがって、ユーザはバッテリー残量が更に低下していることを容易に認識できる。 As shown in FIG. 12, after the remaining battery level falls below a predetermined level (reference remaining level) that is the first determination level, the control unit 220 displays light of only one color within one video frame. Control is performed so that the display surface of the element 23 is irradiated. For example, in the time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), only the green light source G of the light source 21 is turned on, and the green light corresponds to when the green light of the display element 23 is turned on. The display surface 123 on which the subframe image is displayed is irradiated, and the red and blue light sources are not turned on during other periods. Further, the display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period. Thereafter, when the remaining battery level in the frame immediately before time t 30 falls below a second determination level set in advance, the time period (t 30 ) within the time period (t 30 to t 33 ) that is the next frame period. T 31 ), only the red light source G of the light source 21 is turned on, and the red light is irradiated on the display surface 123 on which the corresponding sub-frame image is displayed when the red light of the display element 23 is turned on. In addition, the green and blue light sources are not lit. That is, the monochromatic image light is changed from green to red. In the subsequent frames, red image light is emitted. Therefore, the user can easily recognize that the remaining battery level is further reduced.
　なお、バッテリー残量が、第２判定レベル以下になった場合に、画像光の色の変更に加えて、図９に示した表示画像のフレーム表示の間隔を変更することも可能である。 In addition, when the remaining battery level is equal to or lower than the second determination level, it is possible to change the frame display interval of the display image shown in FIG. 9 in addition to the change of the color of the image light.
　図１３は、図１１に示すバッテリー残量が低下した場合の第２の警告表示モードに対応する表示画像の生成方法を示す概念図である。 FIG. 13 is a conceptual diagram showing a display image generation method corresponding to the second warning display mode when the remaining battery level shown in FIG. 11 is reduced.
　図１３に示すように、バッテリー残量が第１の判定レベルである所定レベル（基準残量）以下に低下した後、制御部２２０は、１つのビデオフレーム内の各色に対応する画像を合成した後に各色の中のいずれか１色の所定の単色グレースケール画像に変換して当該色の画像を表示する期間に画像表示素子２３の表示面１２３に表示し、当該色の光が画像表示素子２３の表示面上に照射されるように制御する。 As shown in FIG. 13, after the remaining battery level drops below a predetermined level (reference remaining level) that is the first determination level, the control unit 220 combines images corresponding to the respective colors in one video frame. Later, it is converted into a predetermined single-color grayscale image of any one of the colors and displayed on the display surface 123 of the image display element 23 during a period in which the image of the color is displayed. The display surface is controlled so as to be irradiated.
　例えば、１フレーム期間（ｔ０～ｔ３）内の時間期間（ｔ１～ｔ２）に、光源２１の緑色光源Ｇのみが点灯され、緑色光が画像表示素子２３の緑色光の点灯時に緑色グレースケール画像が表示された表示面１２３上に照射され、これ以外の期間には、赤色及び青色光源は点灯されない。また、画像表示素子２３も、赤色及び青色光に対応する各サブフレーム画像を表示せず、この期間は駆動オフ状態にしてもよい。 For example, in a time period (t 1 to t 2 ) within one frame period (t 0 to t 3 ), only the green light source G of the light source 21 is turned on, and the green light is green when the green light of the image display element 23 is turned on. The display surface 123 on which the grayscale image is displayed is irradiated, and the red and blue light sources are not turned on during other periods. Further, the image display element 23 may not display each sub-frame image corresponding to red and blue light, and may be in a drive-off state during this period.
　その後、時間ｔ３０の直前のフレームでバッテリーの残量が予め設定した第２の判定レベル以下に低下すると、次のフレーム期間である時間期間（ｔ３０～ｔ３３）内の時間期間（ｔ３０～ｔ３１）に、光源２１の赤色光源Ｇのみが点灯され、赤色光が画像表示素子２３の赤色光の点灯時に赤色グレースケール画像が表示された表示面１２３上に照射され、これ以外の期間には、緑色及び青色光源は点灯されない。すなわち、単色画像光が緑色から赤色に変更される。そして、以降のフレームは赤色画像光が出射される。したがって、ユーザはバッテリー残量が更に低下していることを容易に認識できる。 Thereafter, when the remaining battery level in the frame immediately before time t 30 falls below a second determination level set in advance, the time period (t 30 ) within the time period (t 30 to t 33 ) that is the next frame period. To t 31 ), only the red light source G of the light source 21 is turned on, and red light is irradiated on the display surface 123 on which the red grayscale image is displayed when the red light of the image display element 23 is turned on. The green and blue light sources are not lit. That is, the monochromatic image light is changed from green to red. In the subsequent frames, red image light is emitted. Therefore, the user can easily recognize that the remaining battery level is further reduced.
　なお、バッテリー残量が、第２判定レベル以下になった場合に、画像光の色の変更に加えて、図１０に示した表示画像のフレーム表示の間隔を変更することも可能である。 In addition, when the remaining battery level is equal to or lower than the second determination level, it is possible to change the frame display interval of the display image shown in FIG. 10 in addition to the change of the color of the image light.
　上述のように、本発明によれば、頭部装着型画像表示装置のバッテリー残量を、ユーザが一見して容易に認識できるため、当該装置を装着して作業している時に、表示画面内のアイコン等を注視して確認する必要がなく、小型軽量化した場合でも操作性を向上させた頭部装着型画像表示装置を提供することができる。また、画面表示に要する電力を大幅に削減できるため、稼働時間を延長でき、作業中に急に画面が消えることによる不都合を回避する対応が可能となる。 As described above, according to the present invention, since the user can easily recognize the remaining battery level of the head-mounted image display device at a glance, when the user wears the device and works, Therefore, it is possible to provide a head-mounted image display device with improved operability even when the size and weight are reduced. In addition, since the power required for the screen display can be greatly reduced, the operation time can be extended, and it is possible to avoid the inconvenience due to the sudden disappearance of the screen during work.
　以上、本発明の実施形態について図面を参照しながら詳細に説明したが、本発明は、上述の実施形態に限定されるものではなく、本発明の技術的範囲から逸脱しない範囲内で多様に変更実施することが可能である。 As mentioned above, although embodiment of this invention was described in detail, referring drawings, this invention is not limited to the above-mentioned embodiment, In the range which does not deviate from the technical scope of this invention, it changes variously. It is possible to implement.
　１０　　頭部装着型画像表示装置
　２０　　表示光学系
　２０ａ　　第１収納室
　２１　　光源
　２２　　集光レンズ
　２３　　画像表示素子
　２４　　画像表示部
　２５　　近接センサー
　３０　　接眼光学系
　３０ａ　　第２収納室
　３１　　プリズム
　３１ａ　　入射面
　３１ｂ　　反射面
　３１ｃ　　出射面
　３２　　接眼レンズ
　５０　　支持部
　５１　　支持部材
　５１ａ、５１ｂ　　支持板
　６０　　出射窓
　８０　　入射窓
　９０　　接眼窓
　１００　　画像表示ユニット
　１１４　　赤色画像光
　１１５　　緑色画像光
　１１６　　青色画像光
　１２３　　表示面
　２００　　制御ユニット
　２００ａ　　筐体
　２１０　　保持部
　２１１　　カメラ部
　２２０　　制御部
　２２１　　ＣＰＵ
　２２２　　画像処理部
　２２３　　入出力制御部
　２３０　　バッテリー
　２３１　　バッテリー残量検出部
　２４０　　通信部
　２５０　　記憶部
　２６０　　オーディオ処理部
　２６１　　マイク
　２６２　　イヤホン
　２７０　　操作入力部
　３００　　保持部材
　３１０　　柔構造部材
　３２０　　剛性構造体 DESCRIPTION OF SYMBOLS 10 Head-mounted image display apparatus 20 Display optical system 20a 1st storage chamber 21 Light source 22 Condensing lens 23 Image display element 24 Image display part 25 Proximity sensor 30 Eyepiece optical system 30a 2nd storage chamber 31 Prism 31a Incident surface 31b Reflection Surface 31c Emission surface 32 Eyepiece 50 Support unit 51 Support member 51a, 51b Support plate 60 Emission window 80 Entrance window 90 Eyepiece window 100 Image display unit 114 Red image light 115 Green image light 116 Blue image light 123 Display surface 200 Control unit 200a Case 210 Holding unit 211 Camera unit 220 Control unit 221 CPU
222 Image processing unit 223 Input / output control unit 230 Battery 231 Battery remaining amount detection unit 240 Communication unit 250 Storage unit 260 Audio processing unit 261 Microphone 262 Earphone 270 Operation input unit 300 Holding member 310 Flexible structure member 320 Rigid structure

Claims (8)

  1. 　画像データに基づく画像光を出射する表示光学系、前記表示光学系から出射された画像光をユーザの眼に投射する接眼光学系、及び前記表示光学系と前記接眼光学系とが自由空間を経由する光経路に沿って配置されるように支持する支持部から成る画像表示ユニットと、
    　前記画像表示ユニットを駆動するためのバッテリー、前記画像表示ユニットの動作を制御する制御部、各種のプログラム及びデータを保存する記憶部、及び外部機器との通信を制御する通信部を有する制御ユニットと、
    　前記画像表示ユニット及び前記制御ユニットをユーザの頭部に保持する保持部材と、を備え、
    　前記制御ユニットは、
    　前記バッテリーの残量を検出するバッテリー残量検出部を更に含み、
    　前記バッテリー残量検出部は、前記バッテリーの残量が所定の第１判定レベル以下であることを検出すると、第１のバッテリー残量低下信号を前記制御部に送信し、
    　前記制御部は、前記第１のバッテリー残量低下信号を受信して前記表示光学系から出射される前記画像光を所定の警告表示モードに対応する画像光に変更するように制御することを特徴とする頭部装着型画像表示装置。     A display optical system that emits image light based on image data, an eyepiece optical system that projects image light emitted from the display optical system onto a user's eye, and the display optical system and the eyepiece optical system via free space An image display unit comprising a support unit that supports the optical path so as to be disposed along the light path;
    A control unit having a battery for driving the image display unit, a control unit for controlling the operation of the image display unit, a storage unit for storing various programs and data, and a communication unit for controlling communication with an external device; ,
    A holding member for holding the image display unit and the control unit on a user's head,
    The control unit is
    A battery remaining amount detecting unit for detecting the remaining amount of the battery;
    The battery remaining amount detection unit, when detecting that the remaining amount of the battery is equal to or lower than a predetermined first determination level, transmits a first battery remaining amount decrease signal to the control unit,
    The control unit controls the image light emitted from the display optical system to be changed to image light corresponding to a predetermined warning display mode upon receiving the first battery remaining amount decrease signal. A head-mounted image display device.
  2. 　前記画像表示ユニットの表示光学系は、
    　照射光を生成する光源と、
    　前記照射光を受光して前記画像データに基づく画像光に変換する画像表示素子と、を備え、
    　前記光源は、赤色発光素子、緑色発光素子、及び青色発光素子から成り、
    　前記制御ユニットの制御部は、
    　前記各色の発光素子を順次に点灯させて各色の照射光を前記画像表示素子により各色に対応する画像データに基づく各色の単色画像光に変換し、順次に変換された連続する前記各色の単色画像光を面順次（フィールドシーケンシャル）方式により加法混色して１フレーム分のカラー画像としてユーザに視認させ、
    　前記第１のバッテリー残量低下信号を受信すると、前記光源及び前記画像表示素子を制御して、前記１フレーム分のカラー画像を前記各色の単色画像光の中の所定の１色の単色画像光で表示する第１の警告表示モード又は前記１フレーム分のカラー画像をグレースケール画像に変換して前記各色の中の所定の１色の単色画像光で表示する第２の警告表示モードに変更するように制御することを特徴とする請求項１に記載の頭部装着型画像表示装置。     The display optical system of the image display unit is:
    A light source that generates illumination light;
    An image display element that receives the irradiation light and converts it into image light based on the image data,
    The light source comprises a red light emitting element, a green light emitting element, and a blue light emitting element,
    The control unit of the control unit is
    The light emitting elements of each color are sequentially turned on, and the irradiation light of each color is converted into single color image light of each color based on image data corresponding to each color by the image display element, and the continuous single color image of each color is sequentially converted. Light is additively mixed by a field sequential method to make the user visually recognize a color image for one frame,
    When the first battery remaining amount decrease signal is received, the light source and the image display element are controlled, and the color image for one frame is converted into a single color image light of a predetermined color in the single color image light of each color. The first warning display mode displayed in the above or the second warning display mode in which the color image for one frame is converted into a grayscale image and displayed with a predetermined single color image light of each color is changed. The head mounted image display apparatus according to claim 1, wherein the head mounted image display apparatus is controlled as described above.
  3. 　前記第１の警告表示モードに対応する単色画像光は、前記各色の発光素子の中の所定の１色の発光素子を前記１フレームの期間内に設けられた色毎の点灯期間の中の対応する期間に点灯させて、該点灯させた照射光を前記画像表示素子によって変換した単色画像光であり、
    　前記制御ユニットの制御部は、前記１フレームの期間内に設けられた残りの色に対応する点灯期間中に前記残りの色に対応する発光素子をオフ状態に制御することを特徴とする請求項２に記載の頭部装着型画像表示装置。     The monochromatic image light corresponding to the first warning display mode corresponds to a light emitting element of a predetermined color among the light emitting elements of each color in a lighting period for each color provided in the period of one frame. It is a monochromatic image light that is lit during the period to be converted, and the illuminated display light is converted by the image display element,
    The control unit of the control unit controls a light emitting element corresponding to the remaining color to an off state during a lighting period corresponding to the remaining color provided in the period of the one frame. 2. A head-mounted image display device according to 2.
  4. 　前記第２の警告表示モードに対応する単色画像光は、前記制御ユニットの制御部により前記１フレーム分の各色の画像データを合成した後、各色の中の所定の１色のグレースケール画像データに変換し、前記各色の発光素子の中の所定の１色の発光素子を前記１フレームの期間内に設けられた色毎の点灯期間の中の対応する期間に点灯させて該点灯させた照射光を前記画像表示素子によって前記グレースケール画像データに基づく当該色の画像光に変換した単色画像光であり、
    　前記制御ユニットの制御部は、前記１フレームの期間内に設けられた残りの色に対応する点灯期間中に前記残りの色に対応する発光素子をオフ状態に制御することを特徴とする請求項２に記載の頭部装着型画像表示装置。     The monochromatic image light corresponding to the second warning display mode is combined with the image data of each color for the one frame by the control unit of the control unit, and then converted into grayscale image data of a predetermined color of each color. The converted irradiation light is emitted by turning on a light emitting element of a predetermined color among the light emitting elements of each color during a corresponding period in a lighting period for each color provided in the period of the one frame. Is a monochromatic image light converted into image light of the color based on the grayscale image data by the image display element,
    The control unit of the control unit controls a light emitting element corresponding to the remaining color to an off state during a lighting period corresponding to the remaining color provided in the period of the one frame. 2. A head-mounted image display device according to 2.
  5. 　前記制御ユニットの制御部は、前記第１のバッテリー残量低下信号を受信すると、前記光源及び前記画像表示素子を制御して、離隔したフレーム毎に前記１フレーム分のカラー画像を各色の中の所定の１色の前記第１又は第２の警告表示モードに対応する単色画像光で表示することを特徴とする請求項２に記載の頭部装着型画像表示装置。 When the control unit of the control unit receives the first low battery level signal, the control unit controls the light source and the image display element so that a color image corresponding to one frame for each separated frame is included in each color. 3. The head-mounted image display device according to claim 2, wherein display is performed with monochromatic image light corresponding to the first or second warning display mode of a predetermined color.
  6. 　前記制御ユニットのバッテリー残量検出部は、前記バッテリーの残量が前記第１判定レベルよりも低い予め設定した第２判定レベル以下であることを検出すると、第２のバッテリー残量低下信号を前記制御部に送信し、
    　前記制御ユニットの制御部は、前記第２のバッテリー残量低下信号を受信すると、前記光源及び前記画像表示素子を制御して、前記第１又は第２の警告表示モードに対応する単色画像光を予め設定した別色に変更して前記表示光学系から出射することを特徴とする請求項２に記載の頭部装着型画像表示装置。     When the remaining battery level detection unit of the control unit detects that the remaining battery level is equal to or lower than a preset second determination level that is lower than the first determination level, a second battery remaining level decrease signal is output. To the control unit,
    When the control unit of the control unit receives the second battery remaining amount decrease signal, the control unit controls the light source and the image display element to output monochromatic image light corresponding to the first or second warning display mode. The head-mounted image display apparatus according to claim 2, wherein the head-mounted image display apparatus changes to a different color set in advance and emits light from the display optical system.
  7. 　前記制御ユニットの制御部は、前記第２のバッテリー残量低下信号を受信すると、前記光源及び前記画像表示素子を制御して、離隔したフレーム毎に前記１フレーム分のカラー画像を各色の中の所定の１色の前記第１又は第２の警告表示モードに対応する単色画像光で表示することを特徴とする請求項６に記載の頭部装着型画像表示装置。 When the control unit of the control unit receives the second low battery level signal, the control unit controls the light source and the image display element so that a color image corresponding to one frame for each separated frame is included in each color. 7. The head-mounted image display device according to claim 6, wherein display is performed with monochromatic image light corresponding to the first or second warning display mode of a predetermined color.
  8. 　前記画像表示ユニットは、近接センサーを更に備え、
    　ユーザが前記画像表示ユニットを頭部に装着すると、前記近接センサーから装着信号が前記制御ユニットの制御部に伝達され、
    　前記制御ユニットの制御部は、
    　前記装着信号を受信すると、前記バッテリー残量検出部又は前記記憶部から前記バッテリーの残量データを取得して、前記バッテリー残量検出部に前記バッテリーの残量が所定の第１判定レベル以下か否かを検出するように制御し、
    　前記バッテリー残量検出部から前記第１のバッテリー残量低下信号を受信すると、前記表示光学系から出射される前記画像光を前記所定の警告表示モードに対応する画像光に変更するように制御することを特徴とする請求項１に記載の頭部装着型画像表示装置。     The image display unit further includes a proximity sensor,
    When the user wears the image display unit on the head, a wearing signal is transmitted from the proximity sensor to the control unit of the control unit,
    The control unit of the control unit is
    When the mounting signal is received, the battery remaining amount data is acquired from the battery remaining amount detecting unit or the storage unit, and the battery remaining amount detecting unit determines whether the battery remaining amount is equal to or lower than a predetermined first determination level. Control to detect whether or not
    When receiving the first battery remaining amount reduction signal from the battery remaining amount detecting unit, the image light emitted from the display optical system is controlled to be changed to image light corresponding to the predetermined warning display mode. The head-mounted image display device according to claim 1.
PCT/JP2016/074764 2015-08-25 2016-08-25 Head-mounted image display device WO2017033992A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015166158A JP2018173430A (en) 2015-08-25 2015-08-25 Head-mounted image display device
JP2015-166158 2015-08-25

Publications (1)

Publication Number Publication Date
WO2017033992A1 true WO2017033992A1 (en) 2017-03-02

Family

ID=58100501

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/074764 WO2017033992A1 (en) 2015-08-25 2016-08-25 Head-mounted image display device

Country Status (2)

Country Link
JP (1) JP2018173430A (en)
WO (1) WO2017033992A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018163974A1 (en) * 2017-03-07 2018-09-13 シャープ株式会社 Display device, virtual image display device, and method for controlling display device
WO2019231108A1 (en) * 2018-05-29 2019-12-05 Samsung Electronics Co., Ltd. Virtual reality resource management for virtual reality head mounted display devices
JP2019219628A (en) * 2018-06-22 2019-12-26 カシオ計算機株式会社 Display device, display method and display program

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7298393B2 (en) * 2019-08-29 2023-06-27 セイコーエプソン株式会社 wearable display

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002032980A (en) * 2000-07-18 2002-01-31 Aiwa Co Ltd Display device for battery residual quantity
JP2003248463A (en) * 2002-02-25 2003-09-05 Matsushita Electric Ind Co Ltd Liquid crystal display device
JP2009135719A (en) * 2007-11-30 2009-06-18 Casio Hitachi Mobile Communications Co Ltd Mobile terminal device and program
JP2009192583A (en) * 2008-02-12 2009-08-27 Konica Minolta Holdings Inc Head-mounted type video display device
JP2010145669A (en) * 2008-12-18 2010-07-01 Brother Ind Ltd Head mounted display
JP2015154420A (en) * 2014-02-18 2015-08-24 株式会社島津製作所 display device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002032980A (en) * 2000-07-18 2002-01-31 Aiwa Co Ltd Display device for battery residual quantity
JP2003248463A (en) * 2002-02-25 2003-09-05 Matsushita Electric Ind Co Ltd Liquid crystal display device
JP2009135719A (en) * 2007-11-30 2009-06-18 Casio Hitachi Mobile Communications Co Ltd Mobile terminal device and program
JP2009192583A (en) * 2008-02-12 2009-08-27 Konica Minolta Holdings Inc Head-mounted type video display device
JP2010145669A (en) * 2008-12-18 2010-07-01 Brother Ind Ltd Head mounted display
JP2015154420A (en) * 2014-02-18 2015-08-24 株式会社島津製作所 display device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018163974A1 (en) * 2017-03-07 2018-09-13 シャープ株式会社 Display device, virtual image display device, and method for controlling display device
WO2019231108A1 (en) * 2018-05-29 2019-12-05 Samsung Electronics Co., Ltd. Virtual reality resource management for virtual reality head mounted display devices
US10978018B2 (en) 2018-05-29 2021-04-13 Samsung Electronics Co., Ltd. Virtual reality resource management for virtual reality head mounted display devices
JP2019219628A (en) * 2018-06-22 2019-12-26 カシオ計算機株式会社 Display device, display method and display program

Also Published As

Publication number Publication date
JP2018173430A (en) 2018-11-08

Similar Documents

Publication Publication Date Title
US10009602B2 (en) Head-mounted display device and control method for the head-mounted display device
JP6459711B2 (en) Display device and control method of display device
WO2017033992A1 (en) Head-mounted image display device
US8896500B2 (en) Head-mounted display device and control method for the head-mounted display device
JP6089705B2 (en) Display device and control method of display device
US20150268720A1 (en) Device, head mounted display, control method of device and control method of head mounted display
US9348144B2 (en) Display device and control method thereof
WO2012133021A1 (en) Head-mounted display
JP5742271B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP2011091789A (en) Head-mounted display
JP2013122519A (en) Transmission type display device, display method and display program
US20130249946A1 (en) Head-mounted display device
JP2009251154A (en) Head mounted type video display
WO2012133020A1 (en) Head-mounted display
JP2013114123A (en) Transmission type display device, display method and display program
JP2007052224A (en) Image display apparatus
JP6464729B2 (en) Display device and control method of display device
JP2017116562A (en) Display device, control method for the same and program
JP2015115849A (en) Information processor and control method of the same
JP5803193B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP5742270B2 (en) Head-mounted display device and method for controlling head-mounted display device
JP2018054976A (en) Head-mounted display device and display control method of head-mounted display device
JP6609920B2 (en) Display device and control method of display device
CN113050823A (en) Data processing apparatus, display system, and data processing method
JP5747815B2 (en) Image display device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16839339

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16839339

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP