WO2018142597A1 - Imaging device, imaging system, moving body, method, and program - Google Patents
Imaging device, imaging system, moving body, method, and program Download PDFInfo
- Publication number
- WO2018142597A1 WO2018142597A1 PCT/JP2017/004108 JP2017004108W WO2018142597A1 WO 2018142597 A1 WO2018142597 A1 WO 2018142597A1 JP 2017004108 W JP2017004108 W JP 2017004108W WO 2018142597 A1 WO2018142597 A1 WO 2018142597A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- frequency
- optical member
- imaging device
- control unit
- imaging
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 247
- 238000000034 method Methods 0.000 title description 64
- 230000003287 optical effect Effects 0.000 claims abstract description 199
- 238000010408 sweeping Methods 0.000 claims description 20
- 230000007246 mechanism Effects 0.000 claims description 18
- 238000006243 chemical reaction Methods 0.000 claims description 15
- 239000000428 dust Substances 0.000 description 65
- 230000008569 process Effects 0.000 description 39
- 238000012545 processing Methods 0.000 description 31
- 238000004891 communication Methods 0.000 description 14
- 239000000758 substrate Substances 0.000 description 10
- 230000004044 response Effects 0.000 description 9
- 239000003381 stabilizer Substances 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 230000033001 locomotion Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000010365 information processing Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000017525 heat dissipation Effects 0.000 description 2
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N silicon dioxide Inorganic materials O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 230000001464 adherent effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 239000010453 quartz Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B11/00—Filters or other obturators specially adapted for photographic purposes
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/02—Bodies
Definitions
- the present invention relates to an imaging apparatus, an imaging system, a moving object, a method, and a program.
- Patent Document 1 first driving is performed to supply AC voltages having different phases to two piezoelectric elements, the phase difference of the two piezoelectric elements is different from that of the first driving, and the amplitude and frequency are set to the first.
- a foreign matter collecting method is disclosed in which second driving is performed to supply alternating voltages having different phases that are larger than those of the first driving.
- the imaging device may include an image sensor.
- the imaging device may include an optical member disposed in front of the image sensor.
- the imaging apparatus vibrates the optical member at a first frequency that is the resonance frequency of the optical member, and further sweeps from the first frequency to a second frequency that is not the resonance frequency of the optical member, and then vibrates the optical member at the first frequency.
- a control unit may be provided.
- the control unit oscillates the optical member at the first frequency to jump up the adhering matter attached to the optical member, and sweeps the adhering matter from the first frequency to the second frequency to move the adhering matter on the optical member.
- the deposit may be removed from the optical member by causing the deposit to jump up again by vibrating the optical member at a frequency.
- the first frequency may be the first resonance frequency of the optical member.
- the second frequency may be closer to the first frequency than the second resonance frequency of the optical member adjacent to the first resonance frequency.
- the first frequency exists between the second frequency and a third frequency that is not the resonance frequency of the optical member.
- the control unit may vibrate the optical member at the first frequency.
- the first frequency may be the first resonance frequency of the optical member.
- the second frequency may be closer to the first frequency than the second resonance frequency of the optical member adjacent to the first resonance frequency.
- the third frequency may be closer to the first frequency than the third resonance frequency of the optical member adjacent to the first resonance frequency and different from the second resonance frequency.
- the first frequency may be a secondary or higher resonance frequency of the optical member.
- the imaging apparatus may further include an electromechanical conversion element attached to the optical member.
- the control unit may vibrate the optical member by supplying a control signal for controlling the vibration of the optical member to the electromechanical conversion element.
- An imaging system may include the imaging device.
- the imaging system may include a support mechanism that supports the imaging device and adjusts the attitude of the imaging device.
- the moving body according to one embodiment of the present invention may move with the imaging system.
- the method according to an aspect of the present invention may include the step of vibrating the optical member at a first frequency that is a resonance frequency of the optical member disposed in front of the image sensor.
- the method may comprise sweeping from a first frequency to a second frequency that is not the resonant frequency of the optical member.
- the method may comprise vibrating the optical member at a first frequency.
- the program may cause the computer to execute a step of vibrating the optical member at a first frequency that is a resonance frequency of the optical member arranged in front of the image sensor.
- the program may cause the computer to execute a step of sweeping from the first frequency to a second frequency that is not the resonance frequency of the optical member.
- the program may cause the computer to execute a step of vibrating the optical member at the first frequency.
- a block is either (1) a stage in a process in which an operation is performed or (2) an apparatus responsible for performing the operation. May represent a “part”.
- Certain stages and “units” may be implemented by programmable circuits and / or processors.
- Dedicated circuitry may include digital and / or analog hardware circuitry.
- Integrated circuits (ICs) and / or discrete circuits may be included.
- the programmable circuit may include a reconfigurable hardware circuit.
- Reconfigurable hardware circuits include logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logical operations, flip-flops, registers, field programmable gate arrays (FPGA), programmable logic arrays (PLA), etc.
- the memory element or the like may be included.
- the computer readable medium may include any tangible device capable of storing instructions to be executed by a suitable device.
- a computer readable medium having instructions stored thereon comprises a product that includes instructions that can be executed to create a means for performing the operations specified in the flowcharts or block diagrams.
- Examples of computer readable media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like.
- Computer readable media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), Electrically erasable programmable read only memory (EEPROM), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), Blu-ray (RTM) disc, memory stick, integrated A circuit card or the like may be included.
- RAM random access memory
- ROM read only memory
- EPROM or flash memory erasable programmable read only memory
- EEPROM Electrically erasable programmable read only memory
- SRAM static random access memory
- CD-ROM compact disc read only memory
- DVD digital versatile disc
- RTM Blu-ray
- the computer readable instructions may include either source code or object code written in any combination of one or more programming languages.
- the source code or object code includes a conventional procedural programming language.
- Conventional procedural programming languages include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or Smalltalk, JAVA, C ++, etc. It may be an object-oriented programming language and a “C” programming language or a similar programming language.
- Computer readable instructions may be directed to a general purpose computer, special purpose computer, or other programmable data processing device processor or programmable circuit locally or in a wide area network (WAN) such as a local area network (LAN), the Internet, etc. ).
- WAN wide area network
- LAN local area network
- the Internet etc.
- the processor or programmable circuit may execute computer readable instructions to create a means for performing the operations specified in the flowcharts or block diagrams.
- Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.
- FIG. 1 shows an example of the appearance of an unmanned aerial vehicle (UAV) 10.
- the UAV 10 includes a UAV main body 20, a gimbal 50, a plurality of imaging devices 60, an imaging device 100, and a lens device 200.
- the gimbal 50, the imaging device 100, and the lens device 200 are examples of an imaging system.
- the UAV 10 is an example of a moving body propelled by a propulsion unit.
- the moving body is a concept including, in addition to UAV, other aircraft that moves in the air, vehicles that move on the ground, ships that move on the water, and the like.
- the UAV main body 20 includes a plurality of rotor blades.
- the plurality of rotor blades is an example of a propulsion unit.
- the UAV main body 20 causes the UAV 10 to fly by controlling the rotation of a plurality of rotor blades.
- the UAV main body 20 causes the UAV 10 to fly using four rotary wings.
- the number of rotor blades is not limited to four.
- the UAV 10 may be a fixed wing machine that does not have a rotating wing.
- the imaging apparatus 100 is an imaging camera that images a subject included in a desired imaging range.
- the gimbal 50 supports the imaging device 100 and the lens device 200 in a rotatable manner.
- the gimbal 50 is an example of a support mechanism.
- the gimbal 50 supports the imaging device 100 and the lens device 200 so as to be rotatable about a pitch axis using an actuator.
- the gimbal 50 further supports the imaging device 100 and the lens device 200 so as to be rotatable around the roll axis and the yaw axis using an actuator.
- the gimbal 50 may support the imaging device 100 or the lens device 200.
- the imaging device 100 may include a lens device 200.
- the gimbal 50 may change the posture of the imaging device 100 by rotating the imaging device 100 and the lens device 200 around at least one of the yaw axis, the pitch axis, and the roll axis.
- the imaging device 100 generates and records image data of an optical image formed through the lens device 200.
- the lens device 200 may be provided integrally with the imaging device 100.
- the lens device 200 may be a so-called interchangeable lens, and may be provided so as to be detachable from the imaging device 100.
- the plurality of imaging devices 60 are sensing cameras that image the surroundings of the UAV 10 in order to control the flight of the UAV 10.
- Two imaging devices 60 may be provided in the front which is the nose of UAV10.
- Two other imaging devices 60 may be provided on the bottom surface of the UAV 10.
- the two imaging devices 60 on the front side may be paired and function as a so-called stereo camera.
- the two imaging devices 60 on the bottom side may also be paired and function as a stereo camera. Based on images picked up by a plurality of image pickup devices 60, three-dimensional spatial data around the UAV 10 may be generated.
- the number of imaging devices 60 included in the UAV 10 is not limited to four.
- the UAV 10 only needs to include at least one imaging device 60.
- the UAV 10 may include at least one imaging device 60 on each of the nose, the tail, the side surface, the bottom surface, and the ceiling surface of the UAV 10.
- the angle of view that can be set by the imaging device 60 may be wider than the angle of view that can be set by the imaging device 100.
- the imaging device 60 may have a single focus lens or a fisheye lens.
- FIG. 2 shows an example of functional blocks of the UAV10.
- the UAV 10 includes a UAV control unit 30, a memory 32, a communication interface 34, a propulsion unit 40, a gimbal 50, an imaging device 60, an imaging device 100, and a lens device 200.
- the communication interface 34 communicates with an external transmitter.
- the communication interface 34 receives various commands for the UAV control unit 30 from a remote transmitter.
- the memory 32 stores a program necessary for the UAV control unit 30 to control the propulsion unit 40, the gimbal 50, the imaging device 60, the imaging device 100, and the lens device 200.
- the memory 32 may be a computer-readable recording medium and may include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
- the memory 32 may be provided inside the UAV main body 20. It may be provided so as to be removable from the UAV main body 20.
- the UAV control unit 30 controls the flight and imaging of the UAV 10 according to a program stored in the memory 32.
- the UAV control unit 30 may be configured by a microprocessor such as a CPU or MPU, a microcontroller such as an MCU, or the like.
- the UAV control unit 30 controls the flight and imaging of the UAV 10 according to instructions received from a remote transmitter via the communication interface 34.
- the propulsion unit 40 propels the UAV 10.
- the propulsion unit 40 includes a plurality of rotating blades and a plurality of drive motors that rotate the plurality of rotating blades.
- the propulsion unit 40 causes the UAV 10 to fly by rotating a plurality of rotor blades via a plurality of drive motors in accordance with a command from the UAV control unit 30.
- the lens apparatus 200 includes a plurality of lenses 210, a lens moving mechanism 212, and a lens control unit 220.
- the plurality of lenses 210 may function as a zoom lens, a varifocal lens, and a focus lens. At least some or all of the plurality of lenses 210 are arranged to be movable along the optical axis.
- the plurality of lenses 210 may be interchangeable lenses that are detachably attached to the lens device 200.
- the lens moving mechanism 212 moves at least some or all of the plurality of lenses 210 along the optical axis.
- the lens control unit 220 drives the lens moving mechanism 212 in accordance with a lens control command from the imaging apparatus 100 to move one or a plurality of lenses 210 along the optical axis direction.
- the lens control command is, for example, a zoom control command and a focus control command.
- the imaging apparatus 100 includes an image sensor 120, a control unit 110, a memory 130, and a dust removal unit 300.
- the dust removing unit 300 includes an optical member 302 and an electromechanical conversion element 303.
- the optical member 302 is disposed in front of the image sensor 120.
- the optical member 302 may be made of a light transmissive material such as glass or quartz.
- the optical member 302 may be configured in a plate shape. “Light transmissive” means having a property of transmitting light.
- the light-transmitting material may be a material having a property that the light transmittance in the visible light region (350 nm to 780 nm) exceeds at least 50%.
- the electromechanical conversion element 303 is attached to the optical member 302.
- the electromechanical conversion element 303 converts electrical energy into mechanical energy.
- the electromechanical conversion element 303 may be, for example, a piezoelectric element.
- the control unit 110 includes an imaging control unit 112 and a dust removal control unit 114.
- the imaging control unit 112 controls imaging by the imaging device 100.
- the dust removal control unit 114 controls the dust removal process performed by the dust removal unit 300.
- FIG. 3 shows an example of the configuration of the dust removing unit 300.
- the dust removing unit 300 includes a frame 301, an optical member 302, an electromechanical conversion element 303, a wiring 304, and a wiring 305.
- the frame 301 supports the optical member 302.
- the electromechanical conversion element 303 may be attached to the optical member 302 via the frame 301.
- the electromechanical conversion element 303 is electrically connected to the dust removal control unit 114 via the wiring 304 and the wiring 305.
- a control signal supplied from the dust removal control unit 114 is transmitted to the electromechanical conversion element 303 via the wiring 304 and the wiring 305.
- the electromechanical conversion element 303 vibrates according to the control signal, and vibrates the optical member 302. By virtue of the vibration of the optical member 302, deposits such as dust attached to the optical member 302 are removed.
- FIG. 4 shows an appearance of an example of an imaging mechanism 400 that is a part of the imaging apparatus 100.
- the imaging mechanism 400 includes a support substrate 401, a heat sink 402, a lens mount 407, and a dust removal unit 300.
- a support substrate 401 is provided on one surface of the heat sink 402.
- the support substrate 401 supports the image sensor 120.
- An optical member 302 is provided on a surface of the support substrate 401 opposite to the heat dissipation plate 402 via a frame 301.
- a lens mount 407 is provided on the surface of the frame 301 opposite to the support substrate 401.
- the lens mount 407 has a support 404 on the outer periphery.
- the support 404 is configured integrally with the lens mount 407.
- the support body 404 is fixed to the support substrate 401 via a spring 403.
- the spring 403 adjusts the tilt of the support substrate 401.
- the support substrate 401 includes wiring 405.
- the support substrate 401 is connected to the control unit 110 via the wiring 405.
- the lens mount 407 has at least one electrical contact 408 and a wiring 406.
- the electrical contact 408 is connected to the control unit 110 via the wiring 406.
- a lens control command is transmitted from the imaging apparatus 100 to the lens apparatus 200 via the electrical contact 408.
- FIG. 5 shows an example of the relationship between the resonance frequency of the optical member 302 and the amplitude intensity.
- the optical member 302 is vibrated using one resonance frequency, there are cases where it is difficult to remove deposits near the node.
- By vibrating the optical member 302 using two or more resonance frequencies it is possible to eliminate places where the optical member 302 hardly removes deposits.
- the number of man-hours can be significantly reduced in the case where the number of resonance frequencies to be used is one than in the case where the number of resonance frequencies to be used is plural.
- the dust removal control unit 114 executes the dust removal process more efficiently using one resonance frequency.
- FIG. 6 is a diagram illustrating an example of functional blocks of the dust removal control unit 114.
- the dust removal control unit 114 includes a vibration control unit 115 and a specifying unit 116.
- the vibration control unit 115 controls the vibration by the dust removing unit 300.
- the vibration control unit 115 may control the vibration by the dust removing unit 300 in accordance with a vibration control command from the UAV control unit 30.
- the UAV control unit 30 may receive a dust removal request from the user via the communication interface 34.
- the UAV control unit 30 may transmit a vibration control command to the vibration control unit 115 in response to receiving the dust removal request.
- the vibration control unit 115 vibrates the optical member 302 at the first frequency that is the resonance frequency of the optical member 302, and further sweeps from the first frequency to a second frequency that is not the resonance frequency of the optical member 302, and then at the first frequency.
- the optical member 302 is vibrated.
- the resonance frequency is a concept including a frequency band including a frequency in a predetermined range around a reference frequency.
- the resonance frequency is a concept including a frequency band including a frequency having an amplitude intensity of 70%, 80%, or 90% of the reference amplitude intensity from a frequency having the reference amplitude intensity.
- the resonance frequency is a concept including a frequency band including a frequency having an amplitude intensity from a frequency having a reference amplitude intensity to an amplitude intensity reduced by a predetermined decibel, for example, 3 decibels from the reference amplitude intensity. .
- the vibration control unit 115 oscillates the optical member 302 at the first frequency to jump up the adhering matter attached to the optical member 302 and sweeps the adhering matter on the optical member 302 by sweeping from the first frequency to the second frequency.
- the deposit may be removed from the optical member 302 by moving it and vibrating the optical member 302 at the first frequency so that the deposit jumps up again.
- the first frequency may be the first resonance frequency of the optical member 302.
- the first frequency may be a secondary or higher resonance frequency of the optical member 302.
- the second frequency may be closer to the first frequency than the second resonance frequency of the optical member 302 adjacent to the first resonance frequency.
- the second frequency may be a frequency having an amplitude intensity that is monotonically reduced from the amplitude intensity of the first frequency.
- the vibration control unit 115 may vibrate the optical member 302 at the first frequency after sweeping to the second frequency and further sweeping from the second frequency to a third frequency that is not the resonance frequency of the optical member 302.
- the first frequency may be between the second frequency and the third frequency.
- the third frequency may be closer to the first frequency than the third resonance frequency of the optical member 302 adjacent to the first resonance frequency and different from the second resonance frequency.
- the third frequency may be a frequency having an amplitude intensity that is monotonically reduced from the amplitude intensity of the first frequency.
- the vibration control unit 115 vibrates the optical member 302 over a period t1 at a first frequency (eg, 60 kHz) that is a resonance frequency (eg, secondary resonance frequency) of the optical member 302, Further, after sweeping from the first frequency to a second frequency (for example, 70 kHz) that is not the resonance frequency of the optical member 302 over the period t2, the optical member is vibrated again at the first frequency over the period t3, thereby performing vibration processing. May be performed.
- a first frequency eg, 60 kHz
- a resonance frequency eg, secondary resonance frequency
- FIG. 8A, FIG. 8B, and FIG. 8C show an example of the movement of the deposit when the vibration process shown in FIG. 7 is executed.
- the vibration control unit 115 causes the optical member 302 to vibrate at a first frequency that is a resonance frequency, so that the deposit 500 attached to the optical member 302 jumps up.
- the vibration control unit 115 moves the deposit 500 on the optical member 302 by sweeping from the first frequency to the second frequency that is not the resonance frequency. By sweeping, the node of the optical member 302 moves, and the deposit 500 existing on the node portion also moves on the optical member 302. After that, as illustrated in FIG.
- the vibration control unit 115 causes the optical member 302 to vibrate at the first frequency, so that the deposit 500 jumps up again. Thereby, the deposit 500 is removed from the optical member 302.
- the vibration control unit 115 can remove the deposit 500 more reliably by repeating the above vibration processing. In this way, the deposit 500 in the vicinity of the node can be moved by sweeping the deposit 500 once at the resonance frequency and then sweeping it. Furthermore, the deposit 500 can be moved in a state where the adsorbing force between the deposit 500 and the optical member 302 is weakened. Therefore, according to this embodiment, deposits such as dust can be efficiently removed from the optical member 302 using one resonance frequency. Since one resonance frequency is used, the design of the optical member 302, the electromechanical transducer 303, etc. is facilitated.
- FIG. 9 shows another example of vibration processing using one resonance frequency.
- the vibration control unit 115 vibrates the optical member 302 over a period t1 at a first frequency (for example, 60 kHz) that is a resonance frequency (for example, a secondary resonance frequency) of the optical member 302, and further starts the optical member 302 from the first frequency. Sweep over a period t2 up to a second frequency (for example, 70 kHz) that is not the resonance frequency. Thereafter, the vibration control unit 115 suspends the vibration of the optical member 302 over the period t3, and then sweeps over the period t4 from the second frequency to a third frequency that is not the resonance frequency of the optical member 302 (for example, 48 kHz). To do. Thereafter, the optical member 302 is vibrated again over the period t5 at the first frequency.
- a first frequency for example, 60 kHz
- a resonance frequency for example, a secondary resonance frequency
- FIG. 10 shows another example of vibration processing using one resonance frequency.
- the vibration control unit 115 vibrates the optical member 302 over a period t1 at a first frequency (for example, 60 kHz) that is a resonance frequency (for example, a secondary resonance frequency) of the optical member 302, and further starts the optical member 302 from the first frequency. Sweep over a period t2 up to a second frequency (for example, 70 kHz) that is not the resonance frequency. Thereafter, the vibration control unit 115 suspends the vibration of the optical member 302 over the period t3, and then sweeps over the period t4 from the second frequency to a third frequency that is not the resonance frequency of the optical member 302 (for example, 48 kHz). To do. Thereafter, the vibration control unit 115 suspends the vibration of the optical member 302 over the period t5, and then vibrates the optical member 302 over the period t6 again at the first frequency.
- a first frequency for example, 60 kHz
- a resonance frequency for example,
- the vibration control unit 115 may start vibration processing of the optical member 302 at an arbitrary timing. For example, the vibration control unit 115 may start the vibration process of the optical member 302 in response to the calibration of the gimbal 50 being executed.
- the gimbal 50 performs calibration by rotating the imaging device 100 and the lens device 200 around at least one of the yaw axis, the pitch axis, and the roll axis.
- the posture of the imaging device 100 changes.
- the posture of the imaging device 100 is shaken up and down and left and right.
- the suction force between the optical member 302 and the deposit is weakened, and the deposit is easy to move. Therefore, the attached matter can be efficiently removed by starting the vibration processing of the optical member 302 in response to the calibration of the gimbal 50 being executed.
- the calibration of the gimbal 50 is executed at the time of initialization executed before the UAV 10 starts flying, for example.
- FIG. 11 is a flowchart showing an example of the start procedure of the dust removal process.
- the UAV control unit 30 initializes the configuration of the UAV 10 (S100). For example, the UAV control unit 30 initializes the configuration of the UAV 10 by confirming operations of various sensors included in the UAV 10, a drive motor that rotates the rotating blades, the gimbal 50, and the like. The UAV control unit 30 calibrates the gimbal 50 when confirming the operation of the gimbal 50.
- the dust removal control unit 114 starts dust removal processing (S102).
- the gimbal 50 controls the posture of the imaging device 100 so that the imaging device 100 faces downward
- the surface of the optical member 302 opposite to the image sensor 120 faces downward.
- the dust removing unit 300 is operated in consideration of the posture of the imaging device 100, so that the deposits attached to the optical member 302 can be effectively removed.
- the posture of the image capturing apparatus 100 is controlled so that the image capturing apparatus 100 faces downward, the deposits removed from the optical member 302 may adhere to the lens 210. For this reason, it is preferable that the imaging apparatus 100 face downward so that the deposits removed from the optical member 302 do not fall on the lens 210.
- the specifying unit 116 specifies whether or not the posture of the imaging device 100 satisfies a predetermined posture condition.
- the specifying unit 116 is configured so that the orientation angle indicating the angle formed by the optical axis and the horizontal axis of the imaging device 100 is such that the imaging device 100 faces downward so that the attached matter removed from the optical member 302 does not fall on the lens 210. It may be specified whether the angle is within a predetermined allowable angle.
- the predetermined allowable angle may be determined based on at least one of the flange back of the imaging device 100, the mount inner diameter of the imaging device 100, and the sensor size of the image sensor 120.
- the flange back indicates the distance from the mount surface on which the lens device 200 of the imaging device 100 is mounted to the imaging surface of the image sensor 120.
- the mount inner diameter of the image pickup apparatus 100 indicates the diameter of the opening of the mount surface of the image pickup apparatus 100.
- the allowable angle ⁇ is defined by the following equation (1). May be.
- the specifying unit 116 specifies that the posture of the imaging device 100 satisfies a predetermined posture condition when the posture angle of the imaging device 100 is equal to or smaller than the allowable angle ⁇ .
- the vibration control unit 115 executes a vibration process of the optical member 302 when the posture of the imaging apparatus 100 satisfies a predetermined posture condition. Thereby, the vibration processing of the optical member 302 is executed, and the deposits removed from the optical member 302 can be prevented from falling into the lens device 200.
- FIG. 13 is a flowchart showing an example of the dust removal processing procedure.
- the procedure illustrated in FIG. 13 may be executed in a UAV 10 that includes the imaging device 100 and the gimbal 50 or an imaging system other than the UAV 10.
- the power of the imaging device 100 and the gimbal 50 is turned on (S200).
- the gimbal 50 starts an initial operation (S202). In the initial operation, the gimbal 50 performs calibration by rotating the imaging device 100 and the lens device 200 around at least one of the yaw axis, the pitch axis, and the roll axis.
- the gimbal 50 adjusts the posture of the imaging device 100 to the posture for dust removal processing (S204).
- the gimbal 50 adjusts the posture of the imaging device 100 so that the posture angle of the imaging device 100 is equal to or smaller than the allowable angle ⁇ .
- the vibration control unit 115 starts the dust removal process by vibrating the optical member 302 (S206).
- the gimbal 50 restores the orientation of the imaging device 100 (S208).
- the gimbal 50 may adjust the posture of the imaging device 100 so that the optical axis of the imaging device 100 is horizontal.
- the deposits removed from the optical member 302 can be prevented from falling into the lens device 200.
- the imaging apparatus 100 when the lens apparatus 200 is large, when the gimbal 50 is operated in a state where the UAV 10 has landed and the attitude of the imaging apparatus 100 is set to a predetermined attitude, the imaging apparatus 100 is directed downward. 200 may hit the ground. Therefore, it is preferable to raise the height of the imaging system including the imaging device 100 and the lens device 200 to a certain level before the orientation of the imaging device 100 is lowered. In other words, it is preferable to raise the UAV 10 until the height of the UAV 10 reaches a certain level before the orientation of the imaging device 100 is lowered.
- the specifying unit 116 may specify the height of the imaging system.
- the specifying unit 116 may specify the height of the UAV 10 as the height of the imaging system.
- the specifying unit 116 may acquire information indicating the altitude acquired from the barometric altimeter or the GPS receiver included in the UAV 10 via the UAV control unit 30.
- the specifying unit 116 may specify the height of the imaging system from information indicating the altitude.
- the vibration control unit 115 controls the gimbal 50 so that the posture of the imaging device 100 satisfies the predetermined posture condition, so that the vibration of the optical member 302 is performed. Processing may begin.
- the vibration control unit 115 may control the posture of the imaging device 100 to a predetermined posture via the UAV control unit 30 and the gimbal 50 when the height of the UAV 10 satisfies a predetermined condition.
- FIG. 14 is a flowchart illustrating an example of a procedure for executing the dust removal process.
- the UAV 10 starts taking off (S300).
- the specifying unit 116 specifies the altitude of the UAV 10 as the height of the imaging system.
- the vibration control unit 115 determines whether the UAV 10 has risen to a predetermined height after the UAV 10 has taken off (S302). If the UAV 10 has risen above a predetermined height, the vibration control unit 115 controls the gimbal 50 via the UAV control unit 30 to control the posture of the imaging device 100 to a predetermined posture ( S304).
- the vibration control unit 115 may control the attitude of the imaging device 100 by controlling the gimbal 50 via the UAV control unit 30 so that the attitude angle of the imaging device 100 falls within the allowable angle ⁇ .
- the vibration control unit 115 activates the dust removal unit 300 to start the dust removal process (S306).
- the posture of the imaging device 100 is changed downward. Therefore, even if the lens apparatus 200 provided in the imaging apparatus 100 is large, the lens apparatus 200 is prevented from colliding with the landing surface of the UAV 10 such as the ground when the attitude of the imaging apparatus 100 is to be lowered. it can.
- the orientation of the imaging apparatus 100 is downward, the surface of the optical member 302 opposite to the image sensor 120 is downward.
- the dust removing unit 300 is operated in this state, the adhered matter attached to the surface of the optical member 302 opposite to the image sensor 120 is likely to fall down in the vertical direction. Therefore, the removal of deposits can be performed efficiently.
- the posture angle of the imaging device 100 falls within the allowable angle ⁇
- the deposit removed from the optical member 302 falls into the lens device 200 and adheres to the lens 210 and the like. Can be prevented.
- the imaging device 100 may have already performed shooting before the UAV 10 has taken off. Therefore, if the orientation of the imaging apparatus 100 is turned downward in response to the UAV 10 reaching a predetermined altitude, the imaging performed by the imaging apparatus 100 that has already been performed may be affected.
- the vibration control unit 115 is configured to perform the imaging of the imaging device 100 via the UAV control unit 30 and the gimbal 50. It is preferable to control the posture to a predetermined posture.
- the vibration control unit 115 causes the imaging device 100 to face downward via the UAV control unit 30 and the gimbal 50 when the height of the imaging system satisfies a predetermined condition and shooting by the imaging device 100 is not being executed.
- the attitude of the imaging apparatus 100 may be controlled.
- FIG. 15 is a flowchart showing an example of a procedure for executing the dust removal process.
- the vibration control unit 115 is different from the flowchart shown in FIG. 14 in that it determines whether or not shooting by the imaging device 100 is in progress before controlling the posture of the imaging device 100.
- the specifying unit 116 specifies the altitude of the UAV 10 as the height of the imaging system.
- the vibration control unit 115 determines whether the UAV 10 has risen to a predetermined height after the UAV 10 has taken off (S302). If the UAV 10 has risen above a predetermined height, the specifying unit 116 specifies whether or not shooting is being performed by the imaging device 100.
- the vibration control unit 115 determines whether shooting by the imaging device 100 is being executed based on the specification result by the specifying unit 116 (S303). If shooting by the imaging device 100 is not being executed, the vibration control unit 115 controls the gimbal 50 via the UAV control unit 30 to control the posture of the imaging device 100 to a predetermined posture (S304).
- the vibration control unit 115 may control the gimbal 50 via the UAV control unit 30 to control the posture of the imaging device 100 so that the imaging device 100 faces downward.
- the gimbal 50 may adjust the posture of the imaging device 100 so that the posture angle of the imaging device 100 is equal to or smaller than the allowable angle ⁇ .
- the vibration control unit 115 activates the dust removal unit 300 to start the dust removal process (S306).
- the posture of the imaging device 100 is changed when shooting by the imaging device 100 is not executed.
- the posture of the imaging device 100 is not changed regardless of the shooting while shooting by the imaging device 100 is being executed.
- the dust removing unit 300 can be operated in a state in which the surface opposite to the image sensor 120 of the optical member 302 faces downward without affecting the photographing performed by the imaging apparatus 100. Therefore, the dust removal processing by the dust removal unit 300 can be efficiently executed without affecting the photographing by the imaging device 100.
- the vibration control unit 115 After controlling the gimbal 50 so that the posture of the imaging device 100 satisfies the predetermined posture condition when the posture of the imaging device 100 does not satisfy the predetermined posture condition, the vibration control unit 115 performs the optical member 302.
- the vibration process may be executed. Therefore, the specifying unit 116 may specify whether or not the posture of the imaging device 100 satisfies a predetermined posture condition.
- the vibration control unit 115 may execute the vibration process of the optical member 302 when the posture of the imaging apparatus 100 satisfies a predetermined posture condition.
- the vibration control unit 115 controls the gimbal 50 so that the attitude of the imaging apparatus 100 satisfies a predetermined attitude condition.
- the vibration process may be started.
- the vibration control unit 115 notifies that the posture of the imaging device 100 should be adjusted so that the predetermined posture condition is satisfied when the posture of the imaging device 100 does not satisfy the predetermined posture condition, and the imaging device
- the vibration processing of the optical member 302 may be started in response to the 100 posture satisfying a predetermined posture condition.
- FIG. 16 is a flowchart showing an example of a procedure for executing the dust removal process.
- the imaging apparatus 100 and the gimbal 50 are turned on (S500).
- the power of the UAV 10 is turned on.
- the specifying unit 116 detects the posture of the imaging device 100 (S502).
- the vibration control unit 115 determines whether the posture angle of the imaging device 100 is within the allowable angle ⁇ (S504). If the attitude angle of the imaging device 100 is within the allowable angle ⁇ , the vibration control unit 115 starts dust removal processing (S506).
- the vibration control unit 115 controls the posture of the imaging device 100 so that the posture angle of the imaging device 100 is within the allowable angle ⁇ (S508).
- the vibration control unit 115 may control the attitude of the imaging device 100 by controlling the gimbal 50 via the UAV control unit 30 and the gimbal 50.
- the vibration control unit 115 may control the posture of the imaging apparatus 100 by controlling the posture of the UAV 10 via the UAV control unit 30.
- the vibration control unit 115 may control the attitude of the imaging apparatus 100 by controlling the gimbal 50 and the UAV 10 via the UAV control unit 30 and the gimbal 50.
- the vibration control unit is controlled after controlling the posture of the imaging device 100 so that the posture angle of the imaging device 100 is within the allowable angle ⁇ .
- 115 executes vibration processing of the optical member 302. Therefore, it is possible to more reliably prevent the deposit removed from the optical member 302 from falling into the lens device 200.
- FIG. 17 is a flowchart showing an example of a procedure for executing the dust removal process.
- the imaging apparatus 100 and the gimbal 50 are turned on (S500).
- the power of the UAV 10 is turned on.
- the specifying unit 116 detects the posture of the imaging device 100 (S502).
- the vibration control unit 115 determines whether the posture angle of the imaging device 100 is within the allowable angle ⁇ (S504). If the attitude angle of the imaging device 100 is within the allowable angle ⁇ , the vibration control unit 115 starts dust removal processing (S506).
- the vibration control unit 115 warns the user to keep the posture angle of the imaging device 100 within the allowable angle ⁇ (S510).
- the vibration control unit 115 may warn the user by notifying that the posture of the imaging apparatus 100 should be adjusted so that a predetermined posture condition is satisfied.
- the vibration control unit 115 may notify the user by displaying a message “Please keep the camera posture within a predetermined range” on the display unit of the terminal operated by the user.
- a message may be displayed on a display unit provided in a transmitter that operates the UAV 10.
- the user may control at least one of the gimbal 50 and the UAV 10 via the transmitter to control the attitude of the imaging apparatus 100 so that the attitude angle of the imaging apparatus 100 is within the allowable angle ⁇ .
- the vibration control unit 115 may display the message on the display unit included in the imaging device 100. Then, the user may adjust the posture of the imaging device 100 so that the posture angle of the imaging device 100 is within the allowable angle ⁇ . Thereafter, when the specifying unit 116 detects that the posture angle of the imaging apparatus 100 is within the allowable angle ⁇ , the vibration control unit 115 may start the dust removal process.
- the vibration control unit 115 executes vibration processing of the optical member 302. Therefore, it is possible to more reliably prevent the deposit removed from the optical member 302 from falling into the lens device 200.
- FIG. 18 is an external perspective view showing an example of the stabilizer 800.
- the UAV 10 in which the imaging device 100 having the dust removing unit 300 is mounted has been described.
- the imaging device 100 having the dust removing unit 300 may not be mounted on the UAV 10.
- the imaging device 100 having the dust removing unit 300 may be mounted on a moving body other than the UAV 10.
- the camera unit 813 mounted on the stabilizer 800 may have the dust removing unit 300.
- the stabilizer 800 includes a camera unit 813, a gimbal 820, and a handle portion 803.
- the gimbal 820 supports the camera unit 813 in a rotatable manner.
- the gimbal 820 has a pan axis 809, a roll axis 810, and a tilt axis 811.
- the gimbal 820 supports the camera unit 813 so as to be rotatable about a pan axis 809, a roll axis 810, and a tilt axis 811.
- the gimbal 820 is an example of a support mechanism.
- the camera unit 813 is an example of an imaging device.
- the camera unit 813 has a dust removing unit 300 inside.
- the camera unit 813 has a slot 812 for inserting a memory.
- the gimbal 820 is fixed to the handle portion 803 via the holder 807.
- the handle portion 803 has various buttons for operating the gimbal 820 and the camera unit 813.
- the handle portion 803 includes a shutter button 804, a recording button 805, and an operation button 806. By pressing the shutter button 804, a still image can be recorded by the camera unit 813.
- the recording button 805 is pressed, a moving image can be recorded by the camera unit 813.
- the device holder 801 is fixed to the handle portion 803.
- the device holder 801 holds a mobile device 802 such as a smartphone.
- the mobile device 802 is communicably connected to the stabilizer 800 via a wireless network such as WiFi. Thereby, an image captured by the camera unit 813 can be displayed on the screen of the mobile device 802.
- deposits can be efficiently removed using one resonance frequency.
- the deposits removed from the optical member 302 can be more reliably prevented from falling into the lens device 200.
- FIG. 19 illustrates an example of a computer 1200 in which aspects of the present invention may be embodied in whole or in part.
- a program installed in the computer 1200 can cause the computer 1200 to function as an operation associated with the apparatus according to the embodiment of the present invention or as one or more “units” of the apparatus.
- the program can cause the computer 1200 to execute the operation or the one or more “units”.
- the program can cause the computer 1200 to execute a process according to an embodiment of the present invention or a stage of the process.
- Such a program may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.
- the computer 1200 includes a CPU 1212 and a RAM 1214, which are connected to each other by a host controller 1210.
- the computer 1200 also includes a communication interface 1222 and an input / output unit, which are connected to the host controller 1210 via the input / output controller 1220.
- Computer 1200 also includes ROM 1230.
- the CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit.
- the communication interface 1222 communicates with other electronic devices via a network.
- a hard disk drive may store programs and data used by the CPU 1212 in the computer 1200.
- the ROM 1230 stores therein a boot program executed by the computer 1200 at the time of activation and / or a program depending on the hardware of the computer 1200.
- the program is provided via a computer-readable recording medium such as a CR-ROM, a USB memory, or an IC card or a network.
- the program is installed in the RAM 1214 or the ROM 1230 that is also an example of a computer-readable recording medium, and is executed by the CPU 1212.
- Information processing described in these programs is read by the computer 1200 to bring about cooperation between the programs and the various types of hardware resources.
- An apparatus or method may be configured by implementing information operations or processing in accordance with the use of computer 1200.
- the CPU 1212 executes a communication program loaded in the RAM 1214 and performs communication processing on the communication interface 1222 based on the processing described in the communication program. You may order.
- the communication interface 1222 reads transmission data stored in a RAM 1214 or a transmission buffer area provided in a recording medium such as a USB memory under the control of the CPU 1212 and transmits the read transmission data to a network, or The reception data received from the network is written into a reception buffer area provided on the recording medium.
- the CPU 1212 allows the RAM 1214 to read all or necessary portions of a file or database stored in an external recording medium such as a USB memory, and executes various types of processing on the data on the RAM 1214. Good. The CPU 1212 may then write back the processed data to an external recording medium.
- the CPU 1212 describes various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, and information retrieval that are described throughout the present disclosure for data read from the RAM 1214 and specified by the instruction sequence of the program. Various types of processing may be performed, including / replacement, etc., and the result is written back to RAM 1214.
- the CPU 1212 may search for information in files, databases, etc. in the recording medium. For example, when a plurality of entries each having an attribute value of the first attribute associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 specifies the attribute value of the first attribute. The entry that matches the condition is searched from the plurality of entries, the attribute value of the second attribute stored in the entry is read, and thereby the first attribute that satisfies the predetermined condition is associated. The attribute value of the obtained second attribute may be acquired.
- the program or software module described above may be stored in a computer-readable storage medium on the computer 1200 or in the vicinity of the computer 1200.
- a recording medium such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program is transferred to the computer 1200 via the network.
- An imaging apparatus comprising: [Item 2] The control unit oscillates the optical member at the first frequency to jump up the adhering matter attached to the optical member, and sweeps the adhering matter to the second frequency from the first frequency to the second frequency.
- the first frequency is a first resonance frequency of the optical member
- the imaging device according to item 1 wherein the second frequency is closer to the first frequency than a second resonance frequency of the optical member adjacent to the first resonance frequency.
- the first frequency exists between the second frequency and a third frequency that is not the resonance frequency of the optical member. 2.
- the first frequency is a first resonance frequency of the optical member, The second frequency is closer to the first frequency than the second resonance frequency of the optical member adjacent to the first resonance frequency, 5.
- the imaging device according to item 4 wherein the third frequency is adjacent to the first resonance frequency and is closer to the first frequency than a third resonance frequency of the optical member that is different from the second resonance frequency.
- the imaging device according to Item 1 wherein the first frequency is a secondary or higher resonance frequency of the optical member.
- the imaging device according to any one of items 1 to 7, A support mechanism for supporting the imaging device and adjusting the posture of the imaging device;
- An imaging system comprising: [Item 9] 9.
- the control unit controls the support mechanism so that the posture of the imaging device satisfies a predetermined posture condition, so that the vibration processing of the optical member is performed.
- Item 9 The imaging system according to Item 8, wherein [Item 11] The imaging system according to item 10, wherein the predetermined posture condition is determined based on at least one of a sensor size of the image sensor, a flange back of the imaging device, and a mount inner diameter of the imaging device.
- [Item 12] Further comprising a specifying unit for specifying the height of the imaging system, When the height of the imaging system satisfies a predetermined height condition, the control unit controls the support mechanism so that the attitude of the imaging apparatus satisfies a predetermined attitude condition, and the optical member Item 9.
- the predetermined posture condition is determined based on at least one of a sensor size of the image sensor, a flange back of the imaging device, and a mount inner diameter of the imaging device.
- the specifying unit specifies the height of the imaging system and whether or not the imaging system is performing shooting using the image sensor,
- the control unit is configured so that the height of the imaging system satisfies a predetermined height condition and the posture of the imaging device satisfies a predetermined posture condition when the photographing is not being performed.
- Item 13 The imaging system according to Item 12, wherein the vibration processing of the optical member is started by controlling.
- the control unit controls the support mechanism so that the posture of the imaging device satisfies the predetermined posture condition when the posture of the imaging device does not satisfy the predetermined posture condition, and the optical device Item 16.
- the imaging system according to Item 15 which starts vibration processing of a member.
- the controller notifies that the posture of the imaging device should be adjusted so that the predetermined posture condition is satisfied when the posture of the imaging device does not satisfy the predetermined posture condition; 16.
- the predetermined posture condition is determined based on at least one of a sensor size of the image sensor, a flange back of the imaging device, and a mount inner diameter of the imaging device.
- [Item 20] Oscillating the optical member at a first frequency that is a resonance frequency of the optical member disposed in front of the image sensor; Sweeping from the first frequency to a second frequency that is not the resonant frequency of the optical member; Vibrating the optical member at the first frequency;
- a method comprising: [Item 21] Oscillating the optical member at a first frequency that is a resonance frequency of the optical member disposed in front of the image sensor; Sweeping from the first frequency to a second frequency that is not the resonant frequency of the optical member; Vibrating the optical member at the first frequency;
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
- Camera Bodies And Camera Details Or Accessories (AREA)
Abstract
Description
特許文献1 特開2010-44100号公報 In
[項目1]
イメージセンサと、
上記イメージセンサの前方に配置される光学部材と、
上記光学部材の共振周波数である第1周波数で上記光学部材を振動させ、さらに上記第1周波数から上記光学部材の共振周波数ではない第2周波数まで掃引した後、上記第1周波数で上記光学部材を振動させる制御部と、
を備える撮像装置。
[項目2]
上記制御部は、上記第1周波数で上記光学部材を振動させることで上記光学部材に付着した付着物を跳ね上げ、上記第1周波数から上記第2周波数まで掃引することで上記付着物を上記光学部材上で移動させ、上記第1周波数で上記光学部材を振動させることで上記付着物を再び跳ね上げることで上記付着物を上記光学部材から除去する、項目1に記載の撮像装置。
[項目3]
上記第1周波数は、上記光学部材の第1共振周波数であり、
上記第2周波数は、上記第1共振周波数に隣接する上記光学部材の第2共振周波数より上記第1周波数に近い、項目1に記載の撮像装置。
[項目4]
上記第1周波数は、上記第2周波数と上記光学部材の共振周波数ではない第3周波数との間に存在する。上記制御部は、上記第2周波数まで掃引した後、さらに、上記第2周波数から上記第3周波数まで掃引した後、上記第1周波数で上記光学部材を振動させる、項目1に記載の撮像装置。
[項目5]
上記第1周波数は、上記光学部材の第1共振周波数であり、
上記第2周波数は、上記第1共振周波数に隣接する上記光学部材の第2共振周波数より上記第1周波数に近く、
上記第3周波数は、上記第1共振周波数に隣接し、上記第2共振周波数とは異なる上記光学部材の第3共振周波数より上記第1周波数に近い、項目4に記載の撮像装置。
[項目6]
上記第1周波数は、上記光学部材の2次以上の共振周波数である、項目1に記載の撮像装置。
[項目7]
上記光学部材に取り付けられている電気機械変換素子をさらに備え、
上記制御部は、上記光学部材の振動を制御するための制御信号を上記電気機械変換素子に供給することで上記光学部材を振動させる、項目1に記載の撮像装置。
[項目8]
項目1から7の何れか1つに記載の撮像装置と、
上記撮像装置を支持し、上記撮像装置の姿勢を調整する支持機構と、
を備える撮像システム。
[項目9]
上記制御部は、上記支持機構のキャリブレーションが実行されたことに応じて、上記光学部材の振動処理を開始する、項目8に記載の撮像システム。
[項目10]
上記制御部は、上記支持機構のキャリブレーションが実行されたことに応じて、上記撮像装置の姿勢が予め定められた姿勢条件を満たすように上記支持機構を制御して、上記光学部材の振動処理を開始する、項目8に記載の撮像システム。
[項目11]
上記予め定められた姿勢条件は、上記イメージセンサのセンササイズ、上記撮像装置のフランジバック、上記撮像装置のマウント内径の少なくとも1つに基づいて定められる、項目10に記載の撮像システム。
[項目12]
上記撮像システムの高さを特定する特定部をさらに備え、
上記制御部は、上記撮像システムの高さが予め定められた高さ条件を満たす場合、上記撮像装置の姿勢が予め定められた姿勢条件を満たすように上記支持機構を制御して、上記光学部材の振動処理を開始する、項目8に記載の撮像システム。
[項目13]
上記予め定められた姿勢条件は、上記イメージセンサのセンササイズ、上記撮像装置のフランジバック、上記撮像装置のマウント内径の少なくとも1つに基づいて定められる、項目12に記載の撮像システム。
[項目14]
上記特定部は、上記撮像システムの高さ、及び上記撮像システムが上記イメージセンサを用いる撮影を実行中か否かを特定し、
上記制御部は、上記撮像システムの高さが予め定められた高さ条件を満たし、上記撮影が実行中でない場合に、上記撮像装置の姿勢が予め定められた姿勢条件を満たすように上記支持機構を制御して、上記光学部材の振動処理を開始する、項目12に記載の撮像システム。
[項目15]
上記撮像装置の姿勢が予め定められた姿勢条件を満たすか否かを特定する特定部をさらに備え、
上記制御部は、上記撮像装置の姿勢が上記予め定められた姿勢条件を満たす場合、上記光学部材の振動処理を実行する、項目8に記載の撮像システム。
[項目16]
上記制御部は、上記撮像装置の姿勢が上記予め定められた姿勢条件を満たさない場合、上記撮像装置の姿勢が上記予め定められた姿勢条件を満たすように上記支持機構を制御して、上記光学部材の振動処理を開始する、項目15に記載の撮像システム。
[項目17]
上記制御部は、上記撮像装置の姿勢が上記予め定められた姿勢条件を満たさない場合、上記予め定められた姿勢条件が満たされるように上記撮像装置の姿勢を調整すべきことを通知し、上記撮像装置の姿勢が上記予め定められた姿勢条件を満たしたことに対応して、上記光学部材の振動処理を開始する、項目15に記載の撮像システム。
[項目18]
上記予め定められた姿勢条件は、上記イメージセンサのセンササイズ、上記撮像装置のフランジバック、及び上記撮像装置のマウント内径の少なくとも1つに基づいて定められる、項目15に記載の撮像システム。
[項目19]
項目8に記載の撮像システムを備えて移動する移動体。
[項目20]
イメージセンサの前方に配置される光学部材の共振周波数である第1周波数で上記光学部材を振動させる段階と、
上記第1周波数から上記光学部材の共振周波数ではない第2周波数まで掃引する段階と、
上記第1周波数で上記光学部材を振動させる段階と、
を備える方法。
[項目21]
イメージセンサの前方に配置される光学部材の共振周波数である第1周波数で上記光学部材を振動させる段階と、
上記第1周波数から上記光学部材の共振周波数ではない第2周波数まで掃引する段階と、
上記第1周波数で上記光学部材を振動させる段階と、
をコンピュータに実行させるためのプログラム。 The execution order of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior”. It should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for the sake of convenience, it means that it is essential to carry out in this order. is not.
[Item 1]
An image sensor;
An optical member disposed in front of the image sensor;
The optical member is vibrated at a first frequency that is the resonance frequency of the optical member, and further swept from the first frequency to a second frequency that is not the resonance frequency of the optical member, and then the optical member is moved at the first frequency. A control unit to vibrate;
An imaging apparatus comprising:
[Item 2]
The control unit oscillates the optical member at the first frequency to jump up the adhering matter attached to the optical member, and sweeps the adhering matter to the second frequency from the first frequency to the second frequency. The imaging apparatus according to
[Item 3]
The first frequency is a first resonance frequency of the optical member,
The imaging device according to
[Item 4]
The first frequency exists between the second frequency and a third frequency that is not the resonance frequency of the optical member. 2. The imaging apparatus according to
[Item 5]
The first frequency is a first resonance frequency of the optical member,
The second frequency is closer to the first frequency than the second resonance frequency of the optical member adjacent to the first resonance frequency,
5. The imaging device according to
[Item 6]
The imaging device according to
[Item 7]
An electromechanical conversion element attached to the optical member;
The imaging device according to
[Item 8]
The imaging device according to any one of
A support mechanism for supporting the imaging device and adjusting the posture of the imaging device;
An imaging system comprising:
[Item 9]
9. The imaging system according to item 8, wherein the control unit starts vibration processing of the optical member in response to the calibration of the support mechanism being executed.
[Item 10]
In response to the calibration of the support mechanism being performed, the control unit controls the support mechanism so that the posture of the imaging device satisfies a predetermined posture condition, so that the vibration processing of the optical member is performed. Item 9. The imaging system according to Item 8, wherein
[Item 11]
The imaging system according to
[Item 12]
Further comprising a specifying unit for specifying the height of the imaging system,
When the height of the imaging system satisfies a predetermined height condition, the control unit controls the support mechanism so that the attitude of the imaging apparatus satisfies a predetermined attitude condition, and the optical member Item 9. The imaging system according to Item 8, wherein the vibration processing is started.
[Item 13]
13. The imaging system according to item 12, wherein the predetermined posture condition is determined based on at least one of a sensor size of the image sensor, a flange back of the imaging device, and a mount inner diameter of the imaging device.
[Item 14]
The specifying unit specifies the height of the imaging system and whether or not the imaging system is performing shooting using the image sensor,
The control unit is configured so that the height of the imaging system satisfies a predetermined height condition and the posture of the imaging device satisfies a predetermined posture condition when the photographing is not being performed. Item 13. The imaging system according to Item 12, wherein the vibration processing of the optical member is started by controlling.
[Item 15]
A specifying unit for specifying whether or not the posture of the imaging device satisfies a predetermined posture condition;
The imaging system according to item 8, wherein the control unit executes a vibration process of the optical member when the attitude of the imaging apparatus satisfies the predetermined attitude condition.
[Item 16]
The control unit controls the support mechanism so that the posture of the imaging device satisfies the predetermined posture condition when the posture of the imaging device does not satisfy the predetermined posture condition, and the optical device Item 16. The imaging system according to Item 15, which starts vibration processing of a member.
[Item 17]
The controller notifies that the posture of the imaging device should be adjusted so that the predetermined posture condition is satisfied when the posture of the imaging device does not satisfy the predetermined posture condition; 16. The imaging system according to item 15, wherein vibration processing of the optical member is started in response to the attitude of the imaging apparatus satisfying the predetermined attitude condition.
[Item 18]
16. The imaging system according to item 15, wherein the predetermined posture condition is determined based on at least one of a sensor size of the image sensor, a flange back of the imaging device, and a mount inner diameter of the imaging device.
[Item 19]
A moving body that moves with the imaging system according to item 8.
[Item 20]
Oscillating the optical member at a first frequency that is a resonance frequency of the optical member disposed in front of the image sensor;
Sweeping from the first frequency to a second frequency that is not the resonant frequency of the optical member;
Vibrating the optical member at the first frequency;
A method comprising:
[Item 21]
Oscillating the optical member at a first frequency that is a resonance frequency of the optical member disposed in front of the image sensor;
Sweeping from the first frequency to a second frequency that is not the resonant frequency of the optical member;
Vibrating the optical member at the first frequency;
A program that causes a computer to execute.
20 UAV本体
30 UAV制御部
32 メモリ
34 通信インタフェース
40 推進部
50 ジンバル
60 撮像装置
100 撮像装置
110 制御部
112 撮像制御部
114 塵除去制御部
115 振動制御部
116 特定部
120 イメージセンサ
130 メモリ
200 レンズ装置
210 レンズ
212 レンズ移動機構
220 レンズ制御部
300 塵除去部
301 フレーム
302 光学部材
303 電気機械変換素子
304,305,405,406 配線
400 撮像機構
401 支持基板
402 放熱板
404 支持体
407 レンズマウント
408 電気接点
500 付着物
800 スタビライザ
801 デバイスホルダ
802 モバイルデバイス
803 持ち手部
804 シャッターボタン
805 録画ボタン
806 操作ボタン
807 ホルダ
809 パン軸
810 ロール軸
811 チルト軸
812 スロット
813 カメラユニット
820 ジンバル
1200 コンピュータ
1210 ホストコントローラ
1212 CPU
1214 RAM
1220 入力/出力コントローラ
1222 通信インタフェース
1230 ROM 10 UAV
20
1214 RAM
1220 Input /
Claims (11)
- イメージセンサと、
前記イメージセンサの前方に配置される光学部材と、
前記光学部材の共振周波数である第1周波数で前記光学部材を振動させ、さらに前記第1周波数から前記光学部材の共振周波数ではない第2周波数まで掃引した後、前記第1周波数で前記光学部材を振動させる制御部と
を備える撮像装置。 An image sensor;
An optical member disposed in front of the image sensor;
The optical member is vibrated at a first frequency that is a resonance frequency of the optical member, and further swept from the first frequency to a second frequency that is not the resonance frequency of the optical member, and then the optical member is moved at the first frequency. An imaging apparatus comprising: a control unit that vibrates. - 前記制御部は、前記第1周波数で前記光学部材を振動させることで前記光学部材に付着した付着物を跳ね上げ、前記第1周波数から前記第2周波数まで掃引することで前記付着物を前記光学部材上で移動させ、前記第1周波数で前記光学部材を振動させることで前記付着物を再び跳ね上げることで前記付着物を前記光学部材から除去する、請求項1に記載の撮像装置。 The control unit oscillates the optical member at the first frequency to jump up the adhering matter adhering to the optical member and sweeps the adhering matter from the first frequency to the second frequency. The imaging apparatus according to claim 1, wherein the deposit is removed from the optical member by moving the member on a member and vibrating the optical member at the first frequency to splash the deposit again.
- 前記第1周波数は、前記光学部材の第1共振周波数であり、
前記第2周波数は、前記第1共振周波数に隣接する前記光学部材の第2共振周波数より前記第1周波数に近い、請求項1に記載の撮像装置。 The first frequency is a first resonance frequency of the optical member;
The imaging apparatus according to claim 1, wherein the second frequency is closer to the first frequency than a second resonance frequency of the optical member adjacent to the first resonance frequency. - 前記第1周波数は、前記第2周波数と、前記光学部材の共振周波数ではない第3周波数との間に存在し、
前記制御部は、前記第2周波数まで掃引した後、さらに、前記第2周波数から前記第3周波数まで掃引した後、前記第1周波数で前記光学部材を振動させる、請求項1に記載の撮像装置。 The first frequency exists between the second frequency and a third frequency that is not a resonance frequency of the optical member,
2. The imaging apparatus according to claim 1, wherein the controller vibrates the optical member at the first frequency after sweeping from the second frequency to the third frequency after sweeping to the second frequency. . - 前記第1周波数は、前記光学部材の第1共振周波数であり、
前記第2周波数は、前記第1共振周波数に隣接する前記光学部材の第2共振周波数より前記第1周波数に近く、
前記第3周波数は、前記第1共振周波数に隣接し、前記第2共振周波数とは異なる前記光学部材の第3共振周波数より前記第1周波数に近い、請求項4に記載の撮像装置。 The first frequency is a first resonance frequency of the optical member;
The second frequency is closer to the first frequency than the second resonance frequency of the optical member adjacent to the first resonance frequency,
The imaging device according to claim 4, wherein the third frequency is adjacent to the first resonance frequency and is closer to the first frequency than a third resonance frequency of the optical member that is different from the second resonance frequency. - 前記第1周波数は、前記光学部材の2次以上の共振周波数である、請求項1に記載の撮像装置。 The imaging apparatus according to claim 1, wherein the first frequency is a secondary or higher resonance frequency of the optical member.
- 前記光学部材に取り付けられている電気機械変換素子をさらに備え、
前記制御部は、前記光学部材の振動を制御するための制御信号を前記電気機械変換素子に供給することで前記光学部材を振動させる、請求項1に記載の撮像装置。 An electromechanical conversion element attached to the optical member;
The imaging apparatus according to claim 1, wherein the control unit vibrates the optical member by supplying a control signal for controlling vibration of the optical member to the electromechanical conversion element. - 請求項1から7の何れか1つに記載の撮像装置と、
前記撮像装置を支持し、前記撮像装置の姿勢を調整する支持機構と
を備える撮像システム。 An imaging device according to any one of claims 1 to 7,
An imaging system comprising: a support mechanism that supports the imaging device and adjusts the posture of the imaging device. - 請求項8に記載の撮像システムを備えて移動する移動体。 A moving body that moves with the imaging system according to claim 8.
- イメージセンサの前方に配置される光学部材の共振周波数である第1周波数で前記光学部材を振動させる段階と、
前記第1周波数から前記光学部材の共振周波数ではない第2周波数まで掃引する段階と、
前記第1周波数で前記光学部材を振動させる段階と
を備える方法。 Vibrating the optical member at a first frequency that is a resonance frequency of an optical member disposed in front of the image sensor;
Sweeping from the first frequency to a second frequency that is not the resonant frequency of the optical member;
Oscillating the optical member at the first frequency. - イメージセンサの前方に配置される光学部材の共振周波数である第1周波数で前記光学部材を振動させる段階と、
前記第1周波数から前記光学部材の共振周波数ではない第2周波数まで掃引する段階と、
前記第1周波数で前記光学部材を振動させる段階と
をコンピュータに実行させるためのプログラム。 Vibrating the optical member at a first frequency that is a resonance frequency of an optical member disposed in front of the image sensor;
Sweeping from the first frequency to a second frequency that is not the resonant frequency of the optical member;
A program for causing a computer to execute the step of vibrating the optical member at the first frequency.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2017/004108 WO2018142597A1 (en) | 2017-02-03 | 2017-02-03 | Imaging device, imaging system, moving body, method, and program |
JP2017559881A JP6439166B1 (en) | 2017-02-03 | 2017-02-03 | Imaging apparatus, imaging system, moving object, method, and program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2017/004108 WO2018142597A1 (en) | 2017-02-03 | 2017-02-03 | Imaging device, imaging system, moving body, method, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018142597A1 true WO2018142597A1 (en) | 2018-08-09 |
Family
ID=63040361
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2017/004108 WO2018142597A1 (en) | 2017-02-03 | 2017-02-03 | Imaging device, imaging system, moving body, method, and program |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP6439166B1 (en) |
WO (1) | WO2018142597A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111936927A (en) * | 2018-10-31 | 2020-11-13 | 深圳市大疆创新科技有限公司 | Control device, imaging device, system, control method, and program |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012034176A (en) * | 2010-07-30 | 2012-02-16 | Nikon Corp | Imaging apparatus |
JP2012138768A (en) * | 2010-12-27 | 2012-07-19 | Hitachi Kokusai Electric Inc | Dome type monitor camera system |
JP2015212820A (en) * | 2014-04-18 | 2015-11-26 | キヤノン株式会社 | Dust removal device and imaging apparatus |
-
2017
- 2017-02-03 WO PCT/JP2017/004108 patent/WO2018142597A1/en active Application Filing
- 2017-02-03 JP JP2017559881A patent/JP6439166B1/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2012034176A (en) * | 2010-07-30 | 2012-02-16 | Nikon Corp | Imaging apparatus |
JP2012138768A (en) * | 2010-12-27 | 2012-07-19 | Hitachi Kokusai Electric Inc | Dome type monitor camera system |
JP2015212820A (en) * | 2014-04-18 | 2015-11-26 | キヤノン株式会社 | Dust removal device and imaging apparatus |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111936927A (en) * | 2018-10-31 | 2020-11-13 | 深圳市大疆创新科技有限公司 | Control device, imaging device, system, control method, and program |
Also Published As
Publication number | Publication date |
---|---|
JP6439166B1 (en) | 2018-12-19 |
JPWO2018142597A1 (en) | 2019-02-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11161608B2 (en) | Unmanned aerial vehicle and flying control method thereof | |
JP6399498B1 (en) | Control apparatus, imaging system, moving object, control method, and program | |
JP6493702B2 (en) | Control method, imaging apparatus, imaging system, moving object, control method, and program | |
JP6439166B1 (en) | Imaging apparatus, imaging system, moving object, method, and program | |
JP2019191428A (en) | Control device, imaging device, moving body, control method and program | |
JP6286732B1 (en) | Imaging system, moving object, method and program | |
JP6565072B2 (en) | Control device, lens device, flying object, control method, and program | |
JP6838231B2 (en) | Controls, unmanned aerial vehicles, control methods, and programs | |
JP6972458B1 (en) | Control devices, imaging systems, moving objects, control methods, and programs | |
JP6543875B2 (en) | Control device, imaging device, flying object, control method, program | |
JP6464444B2 (en) | Imaging apparatus, imaging system, moving object, method, and program | |
WO2018207366A1 (en) | Control device, imaging device, imaging system, moving body, control method, and program | |
WO2018116417A1 (en) | Control device, imaging device, moving body, control method, and program | |
JP6265577B1 (en) | IMAGING DEVICE, IMAGING SYSTEM, MOBILE BODY, METHOD, AND PROGRAM | |
JP6519886B2 (en) | Imaging device, imaging system, moving object, method, and program | |
WO2018047283A1 (en) | Imaging device, imaging system, mobile body, method and program | |
JP6565071B2 (en) | Control device, imaging device, flying object, control method, and program | |
JP6409239B1 (en) | Imaging apparatus, imaging system, flying object, recording method, and program | |
JP2019205047A (en) | Controller, imaging apparatus, mobile body, control method and program | |
JP6852243B1 (en) | Control devices, imaging systems, moving objects, control methods, and programs | |
JP6488521B2 (en) | Control device, support system, imaging system, moving object, control method, and program | |
JP6557936B2 (en) | Control device, lens device, imaging device, imaging system, moving object, control method, and program | |
JP2021189368A (en) | Control device, imaging system, control method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2017559881 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17894754 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11.11.2019) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17894754 Country of ref document: EP Kind code of ref document: A1 |