US20170208252A1 - Medical observation device, medical observation system, and image shake correction method - Google Patents

Medical observation device, medical observation system, and image shake correction method Download PDF

Info

Publication number
US20170208252A1
US20170208252A1 US15/398,157 US201715398157A US2017208252A1 US 20170208252 A1 US20170208252 A1 US 20170208252A1 US 201715398157 A US201715398157 A US 201715398157A US 2017208252 A1 US2017208252 A1 US 2017208252A1
Authority
US
United States
Prior art keywords
unit
vibration
image
observation
shake correction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/398,157
Other languages
English (en)
Inventor
Shigeru Tamura
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Olympus Medical Solutions Inc
Original Assignee
Sony Olympus Medical Solutions Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Olympus Medical Solutions Inc filed Critical Sony Olympus Medical Solutions Inc
Assigned to SONY OLYMPUS MEDICAL SOLUTIONS INC. reassignment SONY OLYMPUS MEDICAL SOLUTIONS INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TAMURA, SHIGERU
Publication of US20170208252A1 publication Critical patent/US20170208252A1/en
Priority to US16/553,174 priority Critical patent/US11284000B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H04N5/23287—
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/20—Surgical microscopes characterised by non-optical aspects
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/20—Surgical microscopes characterised by non-optical aspects
    • A61B90/25—Supports therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/361—Image-producing devices, e.g. surgical cameras
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G02B23/2407—Optical details
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G02B23/2476—Non-optical details, e.g. housings, mountings, supports
    • G02B23/2484—Arrangements in relation to a camera or imaging device
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/64—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
    • G02B27/646—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image compensating for small deviations, e.g. due to vibration or shake
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/685—Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687—Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
    • H04N5/2256—
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00147—Holding or positioning arrangements
    • A61B1/00149—Holding or positioning arrangements using articulated arms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2048—Tracking techniques using an accelerometer or inertia sensor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50—Supports for surgical instruments, e.g. articulated arms
    • A61B2090/5025—Supports for surgical instruments, e.g. articulated arms with a counter-balancing mechanism
    • A61B2090/504—Supports for surgical instruments, e.g. articulated arms with a counter-balancing mechanism with a counterweight
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50—Supports for surgical instruments, e.g. articulated arms
    • A61B2090/506—Supports for surgical instruments, e.g. articulated arms using a parallelogram linkage, e.g. panthograph
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/001—Counterbalanced structures, e.g. surgical microscopes
    • H04N2005/2255—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes

Definitions

  • the present disclosure relates to a medical observation device, a medical observation system, and an image shake correction method.
  • observation unit In surgical operations, a technique is used in which surgery is performed while observing the surgical site with observation equipment (hereinafter also called the observation unit) enabling magnified observation of the surgical site, such as a microscope.
  • observation equipment hereinafter also called the observation unit
  • a medical observation device that holds the observation unit with an arm unit (support unit) is used to move and lock the position and orientation of the observation unit with high precision.
  • the observation unit may vibrate in some cases, because of factors such as the footsteps of medical staff moving inside the operating room, for example. Since such vibrations induce shaking in the observation image (image shake) during magnified observation, in some cases work may not be performed until the shaking subsides, thereby increasing the mental strain on the surgeon, and also lowering the efficiency of surgery.
  • JP H8-5922A discloses technology in which a microscope is equipped with an acceleration sensor for detecting vibration, and by driving the objective lens at the inverse phase of the vibration detected by the acceleration sensor, enables a stable observation image to be obtained.
  • JP H8-5922A does not target a microscope unit supported by an arm unit, and in addition, does not presuppose the application of observing a surgical site during surgery. In this way, the technology described in JP H8-5922A is not necessarily suited to a medical observation device.
  • the present disclosure proposes a new and improved medical observation device, medical observation system, and image shake correction method capable of obtaining a stable observation image less affected by vibration.
  • a medical observation device including: an observation unit configured to perform magnified observation of a surgical site; a vibration sensor that detects a vibration of the observation unit; a support unit that supports the observation unit; and a control unit that conducts an image shake correction that corrects a shake in an image observed by the observation unit, based on a detection value from the vibration sensor.
  • a medical observation system including: a medical observation device including an imaging unit that captures an image of a surgical site, a vibration sensor that detects a vibration of the imaging unit, a support unit that supports the imaging unit, and a control unit that conducts an image shake correction that corrects a shake in an image captured by the imaging unit, based on a detection value from the vibration sensor; and a display device that displays an image subjected to the image shake correction by the medical observation device.
  • an image shake correction method conducted in a medical observation device that includes an observation unit configured to perform magnified observation of a surgical site, a vibration sensor that detects a vibration of the observation unit, and a support unit that supports the observation unit, the image shake correction method including: conducting an image shake correction that corrects a shake in an image observed by the observation unit, based on a detection value from the vibration sensor.
  • vibration of the observation unit is detected by a vibration sensor, and based on the detection value, image shake correction that corrects shake in the image obtained by the observation unit is conducted. Consequently, it becomes possible to obtain a stable observation image less affected by vibration. Thus, it becomes possible to reduce the mental strain on the surgeon during surgery, and also help surgery proceed smoothly.
  • FIG. 1 is a diagram illustrating an example configuration of an observation system according an embodiment
  • FIG. 2 is a diagram illustrating an example configuration of a vibration suppression mechanism that may be provided in each rotation axis unit;
  • FIG. 3 is a diagram illustrating another example configuration of a vibration suppression mechanism that may be provided in each rotation axis unit;
  • FIG. 4 is a block diagram illustrating an example of a functional configuration of a control unit that realizes an image shake correction process according to an embodiment
  • FIG. 5 is a block diagram illustrating an example of a functional configuration of a control unit that realizes an image shake correction process according to a modification of an embodiment
  • FIG. 6 is a flowchart illustrating an example of a processing procedure of an image shake correction method according to an embodiment.
  • the user who performs various operations on an observation device is designated the surgeon for the sake of convenience.
  • this designation does not limit the user who uses the observation device, and the various operation on the observation device may also be executed by any user, such as another member of the medical staff
  • FIG. 1 is a diagram illustrating an example configuration of an observation system according the present embodiment.
  • An observation system 1 is a medical observation device used for medical procedures such as surgeries and examinations.
  • the observation system 1 is made up of an observation device 10 , which is equipped with a microscope unit 110 and which captures images of the surgical site of a patient with the microscope unit 110 , and a display device 20 , which displays images of the surgical site captured by the observation device 10 (still images and moving images).
  • the surgeon observes the surgical site and performs various treatments on the surgical site while referring to images captured by the observation device 10 and displayed on the display device 20 .
  • the display device 20 displays images of the patient's surgical site captured by the observation device 10 .
  • the display device 20 is installed in a location visible to the surgeon inside the operating room, such as on a wall of the operating room, for example.
  • the type of the display device 20 is not particularly limited, and any of various known types of display devices may be used as the display device 20 , such as a cathode ray tube (CRT) display device, a liquid crystal display device, a plasma display device, or an electroluminescence (EL) display device.
  • the display device 20 is not necessarily required to be installed inside the operating room, and may also be mounted onboard a device used by being worn on the surgeon's body, such as a head-mounted display (HMD) or an eyeglasses-type wearable device.
  • HMD head-mounted display
  • the observation device 10 is equipped with a microscope unit 110 for performing magnified observation of the patient's surgical site, a support unit 120 (arm unit 120 ) that holds the microscope unit 110 , a base unit 130 to which one end of the support unit 120 is connected and which supports the microscope unit 110 and the support unit 120 , and a control device 140 that controls the operation of the observation device 10 .
  • the base unit 130 supports the microscope unit 110 and the support unit 120 .
  • the base unit 130 includes a platform 131 having a planar shape, and multiple casters 132 provided on the bottom face of the platform 131 .
  • One end of the support unit 120 is connected to the top face of the platform 131
  • the microscope unit 110 is connected to the other end of the support unit 120 extending from the platform 131 (the leading end).
  • the observation device 10 is in contact with the floor through the casters 132 , and is configured to be movable across the floor by the casters 132 .
  • the direction perpendicular to the floor on which the observation device 10 is installed is defined to be the z-axis direction.
  • the z-axis direction is also called the up-and-down direction or the vertical direction.
  • the two mutually orthogonal directions to the z-axis direction are defined to be the x-axis direction and the y-axis direction.
  • the direction parallel to the x-y plane is also called the horizontal direction.
  • the microscope unit 110 is made up of a microscope body for performing magnified observation of the patient's surgical site.
  • the optical axis direction of the microscope unit 110 is approximately aligned with the z-axis direction.
  • the microscope unit 110 has a configuration corresponding to a microscope of the electronic imaging type, and is made up of a barrel unit 112 having an approximately cylindrical shape, and an imaging unit 111 provided inside the barrel unit 112 .
  • the imaging unit 111 is made up of an optical system such as an objective lens and a zoom lens, and an image sensor that captures an image of a subject (namely, the surgical site) with light passing through the optical system.
  • the microscope unit 110 is provided with a vibration sensor 113 for detecting vibration of the imaging unit 111 .
  • the aperture on the bottom end of the barrel unit 112 is provided with a cover glass for protecting the imaging unit 111 .
  • a light source is also provided inside the barrel unit 112 , and during image capture, the subject is irradiated with illuminating light radiating from the light source through the cover glass. Of this illuminating light, the light reflecting back from the subject (observation light) is incident on the imaging unit 111 via the cover glass, and as a result, a signal corresponding to an image of the surgical site (image signal) is acquired by the imaging unit 111 .
  • any of various known types of image sensors may be applied as the image sensor of the imaging unit 111 , such as a charge-coupled device (CCD) sensor or a complementary metal-oxide-semiconductor (CMOS) sensor.
  • the imaging unit 111 may also be configured as a stereo camera equipped with a pair of image sensors.
  • any of various known types of configurations may be applied to the optical system of the imaging unit 111 .
  • any of various types of functions typically provided in electronic imaging microscope units such as an autofocus (AF) function and an optical zoom function, may be provided onboard the imaging unit 111 .
  • the vibration sensor 113 is a sensor that detects vibration of the imaging unit 111 (such as the vibration direction, amplitude, and frequency, for example). Any of various known types of sensors typically used to detect vibration, such as an acceleration sensor or a gyro sensor, may be used as the vibration sensor 113 . However, as discussed later, in the present embodiment, since an image shake correction process that corrects shake in an image captured by the imaging unit 111 (in other words, shake in the observation image) is conducted based on a detection value from the vibration sensor 113 , a sensor able to detect at least vibration in the plane parallel to the photosensitive face of the image sensor is used as the vibration sensor 113 . Also, the vibration sensor 113 preferably is installed near the imaging unit 111 to enable more precise detection of vibration of the imaging unit 111 . Furthermore, preferably, the vibration sensor 113 is also comparatively compact so that the microscope unit 110 is more compact.
  • the image signal acquired by the microscope unit 110 is transmitted to the control device 140 .
  • various types of image processing are performed on the image signal, such as gamma correction, white balance adjustment, magnification and pixel interpolation related to the electronic zoom function.
  • image processing various types of image processing typically performed to display images may be performed.
  • a detection value from the vibration sensor 113 is also transmitted to the control device 140 .
  • the control device 140 includes a function of deciding a vibration mode of the imaging unit 111 , and the control device 140 executes an image shake correction process based on the decided vibration mode and the detection value. Note that the image shake correction process will be described in further detail in the later section (2. Details of image shake correction process).
  • An image signal that has been subjected to the above image processing as well as image shake correction is transmitted to the display device 20 provided in the operating room, and an image of the surgical site is displayed on the display device 20 , appropriately magnified at a desired magnification by an optical zoom function and/or an electronic zoom function, for example.
  • the communication between the control device 140 and the display device 20 may be realized by any of various known wired or wireless methods.
  • a processing circuit for performing the above image processing may be provided in the microscope unit 110 , and the above image processing may be performed by the processing circuit of the microscope unit 110 , without being performed by the control device 140 .
  • image information after suitable image processing has been performed in the processing circuit onboard the microscope unit 110 may be transmitted from the microscope unit 110 to the display device 20 provided in the operating room.
  • the communication between the microscope unit 110 and the display device 20 may be realized by any of various known wired or wireless methods.
  • the microscope unit 110 is provided with various types of switches for controlling the operation of the microscope unit 110 .
  • the microscope unit 110 is provided with a zoom switch 151 (zoom SW 151 ) and a focus switch 152 (focus SW 152 ) for adjusting the image capture parameters of the microscope unit 110 , as well as an operating mode toggle switch 153 (operation mode toggle SW 153 ) for toggling the operating mode of the support unit 120 .
  • the surgeon by operating the zoom SW 151 and the focus SW 152 , is able to adjust the magnification and the focal length of the microscope unit 110 , respectively. Also, by operating the operating mode toggle SW 153 , the surgeon is able to toggle the operating mode of the support unit 120 between a locked mode and a free mode.
  • the locked mode is an operating mode in which the position and the orientation of the microscope unit 110 are locked by using a brake to restrain rotation about each rotation axis provided in the support unit 120 .
  • the free mode is an operating mode in which the brake is released, thereby allowing free rotation about each rotation axis provided in the support unit 120 , and enabling the surgeon to adjust the position and the orientation of the microscope unit 110 with direct operations.
  • direct operations mean operations in which the surgeon grips the microscope unit 110 with his or her hand, for example, and directly moves the microscope unit 110 .
  • the operating mode of the support unit 120 becomes the free mode while the surgeon is pressing the operating mode toggle SW 153
  • the operating mode of the support unit 120 becomes the locked mode while the surgeon releases his or her hand from the operating mode toggle SW 153 .
  • these switches are not necessarily required to be provided on the microscope unit 110 .
  • the observation device 10 it is sufficient for the observation device 10 to be provided with a mechanism for accepting operating input having functions similar to these switches, and the specific configuration of such a mechanism is not limited.
  • these switches may also be provided on another section of the observation device 10 .
  • an input device such as a remote control may be used, and commands corresponding to these switches may be input into the observation device 10 remotely.
  • the barrel unit 112 of the microscope unit 110 is illustrated as a simple cylindrically-shaped member in FIG. 1 for the sake of simplicity, the barrel unit 112 may also be provided with a grip unit gripped by the surgeon.
  • a grip unit may be realized by having a structure such as a handle to be gripped by the surgeon be formed around the outer circumference of the barrel unit 112 .
  • such a grip unit may be realized by having the shape of the barrel unit 112 be formed into a shape that is gripped easily by the surgeon. For example, when in the free mode, operations of moving the microscope unit 110 with the surgeon gripping the barrel unit 112 directly in hand may be anticipated.
  • the shape of the barrel unit 112 and the placement of the operating mode toggle SW 153 may be decided appropriately with consideration for operability by the surgeon while in the free mode.
  • the placement of the zoom SW 151 and the focus SW 152 may be decided appropriately with similar consideration for operability by the surgeon.
  • the control device 140 is made up of a processor, such as a central processing unit (CPU) or a digital signal processor (DSP), for example, or a control board on which these processors are mounted together with components such as memory. By executing computational processing according to a certain program, the control device 130 controls the operation of the observation device 10 .
  • a processor such as a central processing unit (CPU) or a digital signal processor (DSP), for example, or a control board on which these processors are mounted together with components such as memory.
  • control device 140 includes a function of toggling the operating mode of the support unit 120 discussed earlier by controlling the driving of the brake provided in each joint unit of the support unit 120 in response to operating input performed by the surgeon via the above operating mode toggle SW 153 .
  • control device 140 includes a function of appropriately driving the optical system in the imaging unit 111 of the microscope unit 110 to adjust the magnification and the focal length of the microscope unit 110 in response to operating input performed by the surgeon via the above zoom SW 151 and focus SW 152 .
  • control device 140 includes a function of performing various types of image processing on an image signal acquired by the microscope unit 110 , and causing the display device 20 to display the processed image signal. At this point, in the present embodiment, an image shake correction process is conducted by the control device 140 , and an image with suppressed image shake is displayed on the display device 20 .
  • control device 140 is provided as a separate configuration from the microscope unit 110 , the support unit 120 , and the base unit 130 , and is connected to the base unit 130 by a cable.
  • the present embodiment is not limited to such an example.
  • a processor, a control board, or the like that realizes functions similar to the control device 140 may also be disposed inside the base unit 130 .
  • the control device 140 and the microscope unit 110 may be configured in an integrated manner.
  • the support unit 120 holds the microscope unit 110 , and moves the microscope unit 110 three-dimensionally while also locking the position and the orientation of the microscope unit 110 after moving.
  • the support unit 120 is configured as a balance arm having six degrees of freedom.
  • the present embodiment is not limited to such an example, and the support unit 120 may also be configured to have a different number of degrees of freedom, insofar as the support unit 120 is configured sufficiently to allow the microscope unit 110 to move appropriately according to the intended purpose.
  • the support unit 120 is provided with six rotation axes corresponding to the six degrees of freedom (first axis O 1 , second axis O 2 , third axis O 3 , fourth axis O 4 , fifth axis O 5 , and sixth axis O 6 ).
  • the members constituting each rotation axis will be referred to collectively as the rotation axis unit.
  • the rotation axis unit may be made up of components such as a bearing, a shaft rotatably inserted into the bearing, and a brake that restrains rotation about the rotation axis.
  • the parallelogram link mechanism 240 discussed later may also be considered to be one of the rotation axis units.
  • the support unit 120 is made up of a first rotation axis unit 210 , a second rotation axis unit 220 , a third rotation axis unit 230 , a fourth rotation axis unit 240 , a fifth rotation axis unit 250 , and a sixth rotation axis unit 260 corresponding to each rotation axis, a first arm unit 271 , a second arm unit 272 , a third arm unit 273 , and a fourth arm unit 274 rotatably connected to each other by the first rotation axis unit 210 to the sixth rotation axis unit 260 , and a counterweight 280 for maintaining equilibrium of the moment of the microscope unit 110 and the support unit 120 as a whole.
  • the fourth rotation axis unit 240 corresponds to the parallelogram link mechanism 240 .
  • the side on which the microscope unit 110 is provided may also be called the leading end side or the leading end unit, while the side near the base unit 130 may also be called the base end side or the base end unit.
  • the first rotation axis unit 210 has an approximately cylindrical shape, and is connected to the base end unit of the barrel unit 112 of the microscope unit 110 so that the central axis is approximately aligned with the central axis of the barrel unit 112 of the microscope unit 110 .
  • the first rotation axis unit 210 rotatably supports the microscope unit 110 , with the rotation axis direction (first axis O 1 direction) being a direction approximately aligned with the optical axis of the microscope unit 110 .
  • the first axis O 1 is provided as a rotation axis approximately parallel to the z-axis.
  • part of the imaging unit 111 of the microscope unit 110 is stored inside the cylindrical housing constituting the first rotation axis unit 210 .
  • the microscope unit 110 and the first rotation axis unit 210 are configured as an integrated member.
  • the present embodiment is not limited to such an example, and the first rotation axis unit 210 and the microscope unit 110 may also be configured as mutually separate members.
  • the leading end of the first arm unit 271 extending in a direction approximately perpendicular to the first axis O 1 is connected to the first rotation axis unit 210 .
  • the second rotation axis unit 220 that rotatably supports the first arm unit 271 , with the rotation axis direction (second axis O 2 direction) being a direction approximately parallel to the extension direction of the first arm unit 271 .
  • the second axis O 2 is a rotation axis approximately perpendicular to the first axis O 1 , and in the example illustrated in FIG. 1 , is provided as a rotation axis approximately parallel to the y-axis.
  • the leading end of the second arm unit 272 extending in a direction approximately perpendicular to both the first axis O 1 and the second axis O 2 is connected to the second rotation axis unit 220 .
  • the base end side of the second arm unit 272 is curved in an L-shape, and at the position corresponding to the curved short side, there is provided the third rotation axis unit 230 that rotatably supports the second arm unit 272 , with the rotation axis direction (third axis O 3 direction) being a direction approximately parallel to the extension direction of the part corresponding to the long side of the second arm unit 272 .
  • the third axis O 3 is a rotation axis approximately perpendicular to the first axis O 1 and the second axis O 2 , and in the example illustrated in FIG. 1 , is provided as a rotation axis approximately parallel to the x-axis.
  • the support unit 120 is configured so that as a result of rotation about the second axis O 2 and the third axis O 3 being controlled respectively, the orientation of the microscope unit 110 is controlled.
  • the second rotation axis unit 220 and the third rotation axis unit 230 may be the rotation axis units that prescribe the orientation of the microscope unit 110 .
  • the leading end of the top side of the parallelogram link mechanism 240 is connected to the base end side of the third rotation axis unit 230 .
  • the parallelogram link mechanism 240 is made up of four arms (arms 241 , 242 , 243 , and 244 ) arranged in a parallelogram shape, and four joint units (joint units 245 , 246 , 247 , and 248 ) respectively provided at positions corresponding to the approximate vertices of the parallelogram.
  • the leading end of the arm 241 extending in a direction approximately parallel to the third axis O 3 is connected to the third rotation axis unit 230 .
  • the joint unit 245 is provided near the leading end of the arm 241
  • the joint unit 246 is provided near the base end of the arm 241 .
  • the leading end of the arms 242 and 243 are connected to the joint units 245 and 246 , respectively, allowing rotation about respective rotation axes (fourth axis O 4 ) approximately perpendicular to the extension direction of the arm 241 and approximately parallel to each other.
  • the joint units 247 and 248 are provided on the base end of the arms 242 and 243 , respectively.
  • the leading end and the base end of the arm 244 are connected to these joint units 247 and 248 , respectively, allowing rotation about the fourth axis O 4 , and also approximately parallel to the arm 241 .
  • the four joint units constituting the parallelogram link mechanism 240 include rotation axes (fourth axis O 4 ) approximately parallel to each other and approximately in the same direction, which operate in conjunction with each other about the fourth axis O 4 .
  • the fourth axis O 4 is provided as a rotation axis approximately parallel to the y-axis.
  • the parallelogram link mechanism 240 includes multiple joint units that rotate in conjunction with each other around rotation axes disposed in mutually different positions but in the same direction, and fulfills the role of a transmission mechanism that transmits an operation on one end to the other end.
  • the motion of the configuration on the leading end side past the parallelogram link mechanism 240 (that is, the microscope unit 110 , the first rotation axis unit 210 , the second rotation axis unit 220 , the third rotation axis unit 230 , the first arm unit 271 , and the second arm unit 272 ) is transmitted to the base end side of the parallelogram link mechanism 240 .
  • the fifth rotation axis unit 250 that rotatably supports the parallelogram link mechanism 240 , with the rotation axis direction (fifth axis O 5 direction) being a direction perpendicular to the extension direction of the arm 242 .
  • the fifth axis O 5 is a rotation axis approximately parallel to the fourth axis O 4 , and in the example illustrated in FIG. 1 , is provided as a rotation axis approximately parallel to the y-axis.
  • the leading end of the third arm unit 273 running in the z-axis direction is connected to the fifth rotation axis unit 250 , and the microscope unit 110 , the first arm unit 271 , the second arm unit 272 , and the parallelogram link mechanism 240 are allowed to rotate with respect to the third arm unit 273 via the fifth rotation axis unit 250 , with the rotation axis being the fifth axis O 5 .
  • the third arm unit 273 is approximately L-shaped, with the base end side curved to be approximately parallel to the floor.
  • the sixth rotation axis unit 260 that allows the third arm unit 273 to rotate about a rotation axis (sixth axis O 6 ) orthogonal to the fifth axis O 5 is connected to the face approximately parallel to the floor on the third arm unit 273 .
  • the sixth axis O 6 is provided as a rotation axis approximately parallel to the z-axis.
  • the sixth rotation axis unit 260 is integrated with the fourth arm unit 274 that extends in the vertical direction.
  • the leading end of the fourth arm unit 274 is connected to the face approximately parallel to the floor on the base end of the third arm unit 273 .
  • the base end of the fourth arm unit 274 is connected to the top face of the platform 131 of the base unit 130 .
  • the arm 244 constituting the bottom side of the parallelogram link mechanism 240 is formed to be longer than the arm 241 constituting the top side, and the end of the arm 242 which is positioned diagonally opposite the part where the third rotation axis unit 230 is connected on the parallelogram link mechanism 240 is extended to the outside of the parallelogram link mechanism 240 .
  • the counterweight 280 is provided on the extended end of the arm 244 .
  • the mass and the placement of the counterweight 280 are adjusted so that the angular moment produced about the fourth axis O 4 and the angular moment produced about the fifth axis O 5 may be cancelled out by the mass of the configuration disposed farther on the leading end side than the counterweight 280 itself (that is, the microscope unit 110 , the first rotation axis unit 210 , the second rotation axis unit 220 , the third rotation axis unit 230 , the first arm unit 271 , the second arm unit 272 , and the parallelogram link mechanism 240 ).
  • the placement of the fifth rotation axis unit 250 is adjusted so that the center of gravity of the configuration disposed farther on the leading end side than the fifth rotation axis unit 250 is positioned on the fifth axis O 5 .
  • the placement of the sixth rotation axis unit 260 is adjusted so that the center of gravity of the configuration disposed farther on the leading end side than the sixth rotation axis unit 260 is positioned on the sixth axis O 6 .
  • the support unit 120 may be configured as a balance arm that maintains equilibrium of the moment of the microscope unit 110 and the support unit 120 as a whole.
  • the support unit 120 By configuring the support unit 120 as a balance arm, when the surgeon attempts to move the microscope unit 110 with a direct operation, the surgeon becomes able to move the microscope unit 110 with less external force, almost like a weightless state. Consequently, user operability may be improved.
  • Each of the first rotation axis unit 210 to the sixth rotation axis unit 260 of the support unit 120 is provided with a brake that restrains rotation in the first rotation axis unit 210 to the sixth rotation axis unit 260 , respectively.
  • the driving of these brakes is controlled by the control device 140 . By releasing these brakes all at once under control from the control device 140 , the operating mode of the support unit 120 switches to the free mode. Also, by similarly driving these brakes all at once under control from the control device 140 , the operating mode of the support unit 120 switches to the locked mode.
  • any of various types of brakes used in a typical balance arm may be applied, and the specific mechanism is not limited.
  • these brakes may be mechanically driven, or may also be electrically driven electromagnetic brakes.
  • the above thus describes a configuration of the observation system 1 according to the present embodiment and the observation device 10 according to the present embodiment with reference to FIG. 1 .
  • a vibration sensor 113 for detecting vibration of the imaging unit 111 is provided in the observation device 10 according to the present embodiment.
  • the control device 140 includes a function of detecting the vibration mode of the imaging unit 111 . Additionally, the control device 140 performs image shake correction based on the decided vibration mode and the detection value from the vibration sensor 113 . Consequently, it becomes possible to obtain a stable image with less image shake.
  • each of the first rotation axis unit 210 to the sixth rotation axis unit 260 may also be provided with a vibration suppression mechanism.
  • a vibration suppression mechanism is a dynamic vibration absorber, for example, is made of a vibration-damping member such as a damper, and is able to suppress vibration in each rotation axis unit.
  • FIG. 2 is a diagram illustrating an example configuration of a vibration suppression mechanism that may be provided in each rotation axis unit.
  • a vibration suppression mechanism 401 is provided between a barrel-shaped first member 403 and a second member 405 when connecting these two members, and has a function of suppressing the transmission of vibration between these two members.
  • the second member 405 (weighted member 405 ) is fitted inside the barrel-shaped first member 403 to be damped (damped member 403 ) so as to allow the second member 405 to slide in the axial direction (the up-and-down direction in the drawing), thereby connecting the two members together.
  • a viscoelastic member 407 acting as a viscous drag element and a spring 409 are provided between the damped member 403 and the weighted member 405 .
  • the vibration suppression mechanism 401 is a dynamic vibration absorber made up of the viscoelastic member 407 and the spring 409 .
  • the viscoelastic member 407 has both mechanical properties and spring-like properties, and is made of a rubber material such as silicon rubber or urethane rubber, for example.
  • the viscoelastic member 407 and the spring 409 expands and contracts in the axial direction in response to vibration of the damped member 403 and the weighted member 405 , and has a function of attenuating the vibration.
  • the natural frequency of the vibration suppression mechanism 401 is decided according to the characteristics of the viscoelastic member 407 and the spring 409 , but the damping effect is maximally exhibited when this natural frequency approximately matches the natural frequency of the support unit 120 to be damped. Consequently, the vibration suppression mechanism 401 may be configured to allow the viscoelastic member 407 and the spring 409 to be interchanged with parts having different characteristics. Consequently, the vibration suppression mechanism 401 may be configured appropriately according to the configuration of the support unit 120 so that the natural frequency of the vibration suppression mechanism 401 approximately matches the natural frequency of the support unit 120 , and a large damping effect may be obtained.
  • FIG. 3 is a diagram illustrating another example configuration of a vibration suppression mechanism that may be provided in each rotation axis unit.
  • a vibration suppression mechanism 451 is provided between an approximately rod-shaped first member 453 and a second member 455 when connecting these two members, and has a function of suppressing the transmission of vibration between these two members.
  • a concave seat 459 formed from an elastic material capable of absorbing vibration, such as rubber, is provided on the connecting end of the first member 453 .
  • an axial unit 457 formed with a narrower diameter than other parts is provided on the connecting end of the second member 455 .
  • the seat 459 may constitute the vibration suppression mechanism 451 that absorbs slight vibration.
  • an elastic material capable of absorbing vibration, such as rubber, may also be interposed between the screw 461 and the first member 453 , and the vibration suppression mechanism 451 may be made up of the seat 459 and the elastic member.
  • the seat 459 has a concave shape, vibration in all three axis directions may be suppressed favorably.
  • the vibration suppression mechanism 451 the transmission of vibration produced in either one of the first member 453 and the second member 455 to the other may be suppressed more effectively.
  • vibration of the microscope unit 110 that is, the imaging unit 111
  • an image with even less image shake may be obtained.
  • active image shake correction may be performed by the control device 140 as discussed earlier
  • passive image shake suppression may also be performed by the vibration suppression mechanism provided in the first rotation axis unit 210 to the sixth rotation axis unit 260 .
  • FIG. 4 is a block diagram illustrating an example of a functional configuration of a control unit for realizing an image shake correction process according to the present embodiment.
  • a control unit 340 for realizing an image shake correction process functionally includes an image shake correction unit 341 and a display control unit 346 . Additionally, the image shake correction unit 341 functionally includes a vibration mode decision unit 342 , a control parameter calculation unit 343 , a correction amount calculation unit 344 , and an image processing unit 345 . By including these functions of the control unit 340 onboard the control device 140 illustrated in FIG. 1 , an image shake correction process is executed in the observation device 10 .
  • the imaging unit 310 corresponds to the imaging unit 111 of the microscope unit 110 illustrated in FIG. 1 .
  • the imaging unit 310 provides information about a captured image of the surgical site to the image processing unit 345 .
  • the operating unit 320 corresponds to an input device by which the surgeon issues instruction input to the observation device 10 , such as the various switches (zoom SW 151 , focus SW 152 , and operating mode toggle SW 153 ) provided on the microscope unit 110 illustrated in FIG. 1 .
  • Information about the surgeon's operating input with respect to the operating unit 320 is provided to the vibration mode decision unit 342 .
  • the vibration detection unit 330 corresponds to the vibration sensor 113 provided in the microscope unit 110 illustrated in FIG. 1 .
  • the vibration detection unit 330 provides a detection value of vibration of the imaging unit 111 to the correction amount calculation unit 344 .
  • the display unit 350 corresponds to the display device 20 illustrated in FIG. 1 .
  • the display unit 350 under control from the display control unit 346 , displays a surgical site image that has been subjected to image shake correction.
  • the vibration mode decision unit 342 decides the vibration mode of the imaging unit 111 , based on information about the surgeon's operating input with respect to the operating unit 320 .
  • the vibration mode refers to a classification of the state of vibration of the imaging unit 111 according to the characteristics of the vibration.
  • the following three vibrations are anticipated as vibrations that may occur in the imaging unit 111 during surgery.
  • Vibration produced by persons such as medical staff walking inside the operating room The frequency of such vibration is approximately from 1 Hz to 100 Hz, for example.
  • the frequency of such vibration is approximately from 1 Hz to 15 Hz, for example.
  • Vibration produced after moving and positioning the microscope unit 110 that is, the imaging unit 111 ), as a result of the surgeon switching from the free mode to the locked mode, and releasing his or her hand from the microscope unit 110 .
  • the frequency of such vibration is approximately from 0.1 Hz to 10 Hz, for example.
  • the vibration mode decision unit 342 judges which of these vibrations has a high likelihood of occurring in the imaging unit 111 , and decides the vibration mode of the imaging unit 111 as one of these vibrations, or as a combination of these vibrations.
  • footstep vibration has a high likelihood of occurring continuously during surgery. Consequently, the vibration mode decision unit 342 judges that footstep vibration has a high likelihood of occurring in the imaging unit 111 , irrespectively of the surgeon's operating input with respect to the operating unit 320 .
  • imaging unit movement vibration and imaging unit locking vibration is produced according to operations on the microscope unit 110 by the surgeon, as described above.
  • the operating mode of the support unit 120 is the free mode, and thus there is a high likelihood of imaging unit movement vibration occurring.
  • the instant at which the surgeon releases his or her hand from the operating mode toggle SW 153 is the instant at which the operating mode of the support unit 120 switches from the free mode to the locked mode, and thus there is a high likelihood of imaging unit locking vibration occurring for a certain time after that.
  • the vibration mode decision unit 342 judges that there is a high likelihood that imaging unit movement vibration is occurring in the imaging unit 111 . Also, for a certain time after the operating mode toggle SW 153 changes from a pressed state to a released state (in other words, for a certain time after information indicating that the operating mode toggle SW 153 changed from the pressed state to the released state is input from the operating unit 320 as information about the surgeon's operating input), the vibration mode decision unit 342 judges that there is a high likelihood that imaging unit locking vibration is occurring in the imaging unit 111 .
  • the vibration mode decision unit 342 decides the following three types of vibration modes, according to the surgeon's operating input with respect to the operating unit 320 .
  • the vibration mode decision unit 342 decides an operating mode in which both footstep vibration and imaging unit movement vibration are occurring in the imaging unit 111 (hereinafter also designated vibration mode 1).
  • the vibration mode decision unit 342 decides an operating mode in which both footstep vibration and imaging unit locking vibration are occurring in the imaging unit 111 (hereinafter also designated vibration mode 2).
  • the certain time may be decided based on experiment, simulation, or the like. For example, the vibration occurring in the microscope unit 110 (imaging unit 111 ) after locking the position of the microscope unit 110 and releasing one's hand may be measured actually, or calculated by simulation, and by conducting frequency analysis or the like on the measurement result or the calculation result and investigating the time over which vibration thought to be imaging unit locking vibration continues, the certain time may be decided.
  • the vibration mode decision unit 342 decides an operating mode in which footstep vibration is occurring in the imaging unit 111 (hereinafter also designated vibration mode 3).
  • the vibration mode decision unit 342 provides information about the decided vibration mode of the imaging unit 111 to the control parameter calculation unit 343 .
  • information about the vibration mode may also be stored in advance in a storage unit (not illustrated) provided in the observation device 10 .
  • information about the vibration mode information about vibration predicted to occur possibly in the imaging unit 111 and information about vibration modes of the imaging unit 111 which may be predicted may be input into the storage unit in advance by a person such as the surgeon or a designer of the observation system 1 .
  • the vibration mode decision unit 342 may select and decide an appropriate vibration mode according to the surgeon's operations from among several preset vibration modes.
  • the control parameter calculation unit 343 calculates a control parameter for image shake correction, based on the vibration mode of the imaging unit 111 decided by the vibration mode decision unit 342 .
  • an electronic correction method is a method of correcting image shake by correcting the observation light capture position for each pixel of the image sensor, based on the detected vibration state, at the stage of image processing on the image signal acquired by the image sensor.
  • an optical correction method is a method of correcting image shake by moving the optical system of the imaging unit 310 (such as a lens, for example) or the position of the image sensor, based on the detected vibration state, and thereby adjusting the light-sensing position for observation light in the image sensor.
  • the optical correction method involves a driving mechanism that moves the lens or image sensor.
  • the electronic correction method is executable by electronic processing on the image signal, and thus the configuration of the microscope unit 110 may be made simpler and more compact.
  • the electronic correction method preferably is used.
  • the functional configuration of the control unit 340 illustrated in FIG. 4 also illustrates a functional configuration corresponding to a case in which the electronic correction method is used in the image shake correction process. Additionally, the description of the control unit 340 hereinafter also takes a case in which the electronic correction method is used as an example.
  • the control parameter calculation unit 343 based on the vibration mode of the imaging unit 111 , is able to obtain information about the state of the presumed vibration occurring in the imaging unit 111 (such as the frequency characteristics, for example). For example, if the vibration mode 1 has been decided, the control parameter calculation unit 343 is able to judge that combined vibration from footstep vibration (for example, vibration with a frequency approximately from 1 Hz to 100 Hz) and imaging unit movement vibration (for example, vibration with a frequency approximately from 1 Hz to 15 Hz) is occurring in the imaging unit 111 .
  • the control parameter calculation unit 343 analyzes the vibration by using the fast Fourier transform (FFT) or the like, and acquires characteristics of the vibration (such as gain characteristics and phase characteristics, for example).
  • FFT fast Fourier transform
  • control parameter calculation unit 343 calculates various control parameters used to calculate a correction amount in the electronic correction method (specifically, the capture positions of pixels in the image sensor, the change over time in the capture positions, and the like).
  • the control parameters may be similar to parameters used in any of various known electronic correction methods.
  • the control parameter calculation unit 343 calculates the filter characteristics of various filters (high-pass filter (HPF) and low-pass filter (LPF)), an integration coefficient, and a phase compensation amount as the control parameters.
  • HPF high-pass filter
  • LPF low-pass filter
  • the control parameter calculation unit 343 provides information about the calculated control parameters to the correction amount calculation unit 344 . Note that the control parameter calculation unit 343 is able to execute a process of calculating the control parameters described above by referencing the storage unit in which the information about the vibration mode discussed above is stored.
  • the correction amount calculation unit 344 calculates a correction amount for performing image shake correction, based on the control parameters calculated by the control parameter calculation unit 343 and the detection value of vibration of the imaging unit 111 provided by the vibration detection unit 330 .
  • the correction amount calculation unit 344 calculates the capture positions of pixels in the image sensor, the change over time in the capture positions, and the like as correction amounts related to electronic image shake correction.
  • the correction amount calculation unit 344 provides information about the calculated correction amount to the image processing unit 345 .
  • the image processing unit 345 performs various types of image processing on the image signal acquired by the imaging unit 310 to cause the display unit 350 to display an image based on the image signal.
  • various types of signal processing typically conducted for image display may be conducted, such as gamma correction, white balance adjustment, magnification and pixel interpolation related to an electronic zoom function, and the like, for example.
  • any of various known techniques may be used, and thus detailed description is omitted herein.
  • the image processing unit 345 executes image shake correction based on the correction amount calculated by the correction amount calculation unit 344 .
  • the image processing unit 345 corrects image shake by generating an image in which the capture position of the observation image is shifted according to the correction amount.
  • control parameter calculation process by the control parameter calculation unit 343 the correction amount calculation process by the correction amount calculation unit 344 , and the image processing related to image shake correction by the image processing unit 345 , any of various known methods typically used as an electronic correction method in the technical field of shake correction in an imaging device such as a digital camera, for example, may be used, and thus detailed description is omitted herein.
  • the image processing unit 345 provides the display control unit 346 with an image signal that has been subjected to various types of image processing, including image shake correction.
  • the display control unit 346 drives the display unit 350 , and causes the display unit 350 to display an image of the surgical site based on the image signal subjected to such image processing. Consequently, a stable image less affected by vibration, and in which image shake has been corrected, is displayed on the display unit 350 , and the visibility of the surgical site to the surgeon is improved. Consequently, safer and smoother execution of surgery may be realized.
  • the vibration mode of the imaging unit 111 is decided from the current state of the support unit 120 , and an image shake correction process that also accounts for the vibration mode is conducted. Consequently, an optimal image shake correction process according to the vibration mode of the imaging unit 111 may be conducted, making it possible to conduct image shake correction more precisely.
  • an image shake correction function according to the present embodiment is installed onboard an existing observation device, if the electronic correction method is adopted, in terms of hardware, it is sufficient merely to add the vibration sensor 113 to the microscope unit 110 . Consequently, it becomes possible to realize the observation device 10 with an image shake correction function according to the present embodiment installed onboard at comparatively low cost.
  • control unit 340 that executes an image shake correction process according to the present embodiment with reference to FIG. 4 .
  • FIG. 5 is a block diagram illustrating an example of a functional configuration of a control unit that realizes an image shake correction process according to a modification of the present embodiment.
  • the control unit 340 a functionally includes an image shake correction unit 341 a and a display control unit 346 . Additionally, the image shake correction unit 341 a functionally includes a vibration mode decision unit 342 , a control parameter calculation unit 343 a , a correction amount calculation unit 344 a , an image processing unit 345 a , and a drive control unit 347 .
  • control unit 340 a corresponds to changing the method of image shake correction to the optical correction method in the control unit 340 described earlier.
  • functional configuration of the control unit 340 a corresponds to partially changing the functions of the control parameter calculation unit 343 , the correction amount calculation unit 344 , and the image processing unit 345 in the control unit 340 illustrated in FIG. 4 , and also adding the drive control unit 347 . Since the details of the other functions are mostly similar to the functions corresponding to the control unit 340 , description will be reduced or omitted herein.
  • the control parameter calculation unit 343 a calculates a parameter corresponding to the optical correction method as a control parameter for image shake correction.
  • Known optical correction methods include a technique of moving the optical system that guides observation light to the image sensor in the imaging unit 310 based on the vibration state (lens shift technique), and a technique of moving the image sensor in the imaging unit 310 based on the vibration state (imager shift technique), for example.
  • the control parameter calculation unit 343 a similarly to the control parameter calculation unit 343 discussed earlier, analyzes the vibration corresponding to the vibration mode by using the fast Fourier transform or the like, and acquires characteristics of the vibration (such as gain characteristics and phase characteristics, for example). Additionally, the control parameter calculation unit 343 a follows the adopted correction technique, and based on the characteristics of the analyzed vibration, calculates various control parameters used to calculate a correction amount in the optical correction method (specifically, a displacement amount of the optical system and the displacement change over time, or a displacement amount of the image sensor amount and the displacement change over time, or the like).
  • a correction amount in the optical correction method specifically, a displacement amount of the optical system and the displacement change over time, or a displacement amount of the image sensor amount and the displacement change over time, or the like.
  • control parameters may be similar to parameters calculated in any of various known optical correction methods.
  • the control parameter calculation unit 343 a calculates the filter characteristics of various filters (HPF and LPF), an integration coefficient, and a phase compensation amount as the control parameters.
  • the control parameter calculation unit 343 a provides information about the calculated control parameters to the correction amount calculation unit 344 a.
  • the correction amount calculation unit 344 a calculates a correction amount for performing image shake correction, based on the control parameters calculated by the control parameter calculation unit 343 a and the detection value of vibration of the imaging unit 111 provided by the vibration detection unit 330 .
  • the correction amount calculation unit 344 a follows the adopted correction technique and calculates a displacement amount of the optical system and displacement change over time, or a displacement amount of the image sensor and displacement change over time, or the like as correction amounts related to optical image shake correction.
  • the correction amount calculation unit 344 a provides information about the calculated correction amount to the drive control unit 347 .
  • the imaging unit 310 includes a drive mechanism, such as an actuator for moving the position of the optical system or the image sensor, according to the adopted image shake correction technique.
  • the drive control unit 347 controls the driving of such a drive mechanism, and moves the optical system or the image sensor in accordance with the correction amount calculated by the correction amount calculation unit 344 a .
  • the imaging unit 310 provides the image processing unit 345 a with an image signal that has been subjected to image shake correction.
  • the image processing unit 345 a similarly to the image processing unit 345 discussed earlier, performs various types of image processing on the image signal acquired by the imaging unit 310 to cause the display unit 350 to display an image based on the image signal.
  • the present modification differs from the embodiment discussed earlier in that the image processing unit 345 a does not conduct image processing related to image shake correction, but instead conducts only various types of image processing for general image display. This is because, as described above, in the present modification, there is obtained an image signal that has been subjected to image shake correction during the shooting of the surgical site.
  • control parameter calculation process by the control parameter calculation unit 343 a and the correction amount calculation process by the correction amount calculation unit 344 a any of various known methods typically used as an electronic correction method in the technical field of shake correction in an imaging device such as a digital camera, for example, may be used, and thus detailed description is omitted herein.
  • the image processing unit 345 a provides the display control unit 346 with an image signal that has been subjected to image processing, and the display control unit 346 drives the display unit 350 and causes the display unit 350 to display an image of the surgical site based on the image signal subjected to such image processing.
  • the above thus describes a functional configuration of the control unit 340 a according to a modification of the present embodiment. Even with the configuration according to the present modification, it becomes possible to obtain a more stable image less affected by vibration, similarly to the foregoing embodiment.
  • the electronic correction method is considered to have an advantage in being realizable at low cost compared to the optical correction method, but depending on factors such as the configuration of the observation device 10 to which image shake correction according to the present embodiment is to be applied, the optical correction method may be considered easier to adopt in some cases, such as if the optical correction method is simple to implement, for example.
  • vibration modes 1 to 3 three vibration types for the vibration of the imaging unit 111 , as well as three vibration modes (vibration modes 1 to 3) based on these vibration types.
  • these three vibration types and three vibration modes are merely one example, and in the present embodiment, various other types of vibrations which may occur in the imaging unit 111 may also be considered, and a vibration mode may be decided appropriately according to such other types of vibrations. For example, if a device that may produce vibration, such as a compressor, exists inside the operating room, vibration produced in the imaging unit 111 due to the vibration of the compressor may also be considered when deciding the vibration mode.
  • the vibration produced in the imaging unit 111 due to the vibration of a motor in the actuator may also be considered when deciding the vibration mode.
  • the frequency of footstep vibration is prescribed to be approximately from 1 Hz to 100 Hz
  • the frequency of imaging unit movement vibration is prescribed to be approximately from 1 Hz to 15 Hz
  • the frequency of imaging unit locking vibration is prescribed to be approximately from 0.1 Hz to 10 Hz.
  • these frequency bands are merely one example.
  • the anticipated characteristics of each vibration may vary depending on the configuration of the support unit 120 and the type of the vibration source, for example. Consequently, it is preferable if the characteristics of each vibration constituting a vibration mode are prescribed respectively to match reality, such as by experiment or simulation, for example.
  • the magnification and/or the focal length of the microscope unit 110 may also be considered. This is because the observation image to correct also changes depending on the magnification and the focal length of the microscope unit 110 .
  • information about the surgeon's operations with respect to the zoom SW 151 and/or the focus SW 152 may also be provided from the operating unit 320 to the control parameter calculation unit 343 or 343 a and/or the correction amount calculation unit 344 or 344 a .
  • control parameter calculation unit 343 or 343 a and/or the correction amount calculation unit 344 or 344 a ascertain the magnification and/or the focal length of the microscope unit 110 when an image signal is acquired, and are able to take this information into account to calculate a control parameter and/or a correction amount, respectively.
  • control units 340 and 340 a are realized by having a processor such as a CPU operate according to a certain computer program. It is also possible to develop a computer program for realizing the respective functions of the control units 340 and 340 a , and implement the computer program in a personal computer or the like.
  • a computer-readable recording medium storing such a computer program may also be provided.
  • the recording medium may be a magnetic disc, an optical disc, a magneto-optical disc, or flash memory, for example.
  • the above computer program may also be delivered via a network, for example, without using a recording medium.
  • FIG. 6 is a flowchart illustrating an example of a processing procedure of an image shake correction method according to the present embodiment. Note that each process illustrated in FIG. 6 corresponds to a process conducted by the control unit 340 illustrated in FIG. 4 or the control unit 340 a illustrated in FIG. 5 . Since the content of these processes has been described already with reference to FIG. 4 or 5 , detailed description is omitted herein.
  • a vibration mode is decided according to the surgeon's operating input with respect to the operating unit (step S 101 ).
  • the process illustrated in step S 101 corresponds to the process conducted in the vibration mode decision unit 342 illustrated in FIG. 4 or 5 .
  • control parameters for calculating a correction amount of image shake correction are calculated, based on the decided vibration mode (step S 103 ).
  • the process illustrated in step S 103 corresponds to the process conducted in the control parameter calculation unit 343 illustrated in FIG. 4 or the control parameter calculation unit 343 a illustrated in FIG. 5 .
  • step S 105 the correction amount of image shake correction is calculated, based on the calculated control parameters and the detection value of vibration.
  • the process illustrated in step S 105 corresponds to the process conducted in the correction amount calculation unit 344 illustrated in FIG. 4 or the correction amount calculation unit 344 a illustrated in FIG. 5 .
  • step S 107 an image signal that has been subjected to image shake correction is generated, based on the calculated correction amount.
  • step S 107 various types of image processing for image display as well as image processing for image shake correction based on the correction amount are conducted on the image signal acquired by the imaging unit 310 illustrated in FIG. 4 , and an image signal in which image shake has been corrected is generated.
  • step S 107 various types of image processing for image display are conducted on the image signal acquired by the imaging unit 310 in a state in which the optical system or the image sensor has been shifted in accordance with the correction amount, and an image signal in which image shake has been corrected is generated.
  • the process illustrated in step S 107 corresponds to the process conducted in the image processing unit 345 illustrated in FIG. 4 or the image processing unit 345 a illustrated in FIG. 5 .
  • the correction amount is calculated using both the vibration mode of the imaging unit 111 and the detection value of vibration of the imaging unit 111 .
  • the vibration mode decision process may also not be conducted, and the correction amount may be calculated based on only the detection value of vibration of the imaging unit 111 . In this case, in the function configuration illustrated in FIGS.
  • the functions of the vibration mode decision unit 342 and the control parameter calculation unit 343 or 343 a are not provided, and the correction amount calculation unit 344 or 344 a is able to use typical control parameters, for example, to calculate the correction amount based on only the detection value of vibration of the imaging unit 111 provided by the vibration detection unit 330 . Even with such a configuration, the advantageous effects of image shake correction may be obtained to some degree.
  • the foregoing embodiment realizes precise image shake correction.
  • the observation device 10 is a microscope device equipped with a microscope unit 110 of the electronic imaging type, but the present technology is not limited to such an example.
  • the observation device 10 may also be a microscope device equipped with a microscope unit of the optical type instead of the microscope unit 110 . Note that in this case, since the microscope unit of the optical type is not provided with an imaging unit, it is sufficient to conduct image shake correction similar to that of the imaging unit 111 in the foregoing embodiment, but targeting the microscope unit of the optical type itself.
  • the observation device 10 may also be an endoscopic device equipped with an endoscope (a lens barrel, and a camera head connected to the base end of the lens barrel) instead of the microscope unit 110 , for example.
  • the camera head is supported by the support unit 120 , and a configuration similar to the imaging unit 111 discussed earlier is provided inside the camera head. It is sufficient to conduct image shake correction similar to that of the imaging unit 111 in the foregoing embodiment, but targeting the imaging unit inside the camera head.
  • the present technology is applicable to various types of observation devices, insofar as the observation device uses an arm unit to support an observation unit for performing magnified observation of a surgical site on a patient, and the type of the observation unit is not limited. Since shaking of the observation unit during magnified observation leads to large swings in the field of view, applying the present technology irrespectively of the type of observation unit makes it possible to further suppress shaking of the observation image and execute smooth surgery.
  • present technology may also be configured as below.
  • a medical observation device including:
  • a medical observation system including:
  • An image shake correction method conducted in a medical observation device that includes an observation unit configured to perform magnified observation of a surgical site, a vibration sensor that detects a vibration of the observation unit, and a support unit that supports the observation unit, the image shake correction method including:

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Molecular Biology (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Astronomy & Astrophysics (AREA)
  • Biophysics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Microscoopes, Condenser (AREA)
  • Instruments For Viewing The Inside Of Hollow Bodies (AREA)
  • Accessories Of Cameras (AREA)
  • Adjustment Of Camera Lenses (AREA)
  • Studio Devices (AREA)
US15/398,157 2016-01-19 2017-01-04 Medical observation device, medical observation system, and image shake correction method Abandoned US20170208252A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/553,174 US11284000B2 (en) 2016-01-19 2019-08-28 Medical observation device, medical observation system, and image shake correction method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016007621A JP6704255B2 (ja) 2016-01-19 2016-01-19 医療用観察装置、医療用観察システム及び画揺れ補正方法
JP2016-007621 2016-01-19

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/553,174 Continuation US11284000B2 (en) 2016-01-19 2019-08-28 Medical observation device, medical observation system, and image shake correction method

Publications (1)

Publication Number Publication Date
US20170208252A1 true US20170208252A1 (en) 2017-07-20

Family

ID=59313983

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/398,157 Abandoned US20170208252A1 (en) 2016-01-19 2017-01-04 Medical observation device, medical observation system, and image shake correction method
US16/553,174 Active US11284000B2 (en) 2016-01-19 2019-08-28 Medical observation device, medical observation system, and image shake correction method

Family Applications After (1)

Application Number Title Priority Date Filing Date
US16/553,174 Active US11284000B2 (en) 2016-01-19 2019-08-28 Medical observation device, medical observation system, and image shake correction method

Country Status (2)

Country Link
US (2) US20170208252A1 (ja)
JP (1) JP6704255B2 (ja)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11006093B1 (en) 2020-01-22 2021-05-11 Photonic Medical Inc. Open view, multi-modal, calibrated digital loupe with depth sensing
US20210244260A1 (en) * 2018-09-11 2021-08-12 Sony Corporation Medical observation system, medical observation apparatus and medical observation method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102021126658B8 (de) 2021-10-14 2023-01-05 Carl Zeiss Meditec Ag Medizinisches Visualisierungsystem und Verfahren zur Video-Stabilisierung bei einem solchen System

Family Cites Families (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2136759A (en) * 1934-04-20 1938-11-15 Ryan James Jay Vibration instrument
CH687425A5 (de) 1992-12-24 1996-11-29 Anschuetz & Co Gmbh Mikroskop.
US6734901B1 (en) * 1997-05-20 2004-05-11 Canon Kabushiki Kaisha Vibration correction apparatus
US6246054B1 (en) * 1997-06-10 2001-06-12 Olympus Optical Co., Ltd. Scanning probe microscope suitable for observing the sidewalls of steps in a specimen and measuring the tilt angle of the sidewalls
US6392795B2 (en) * 1998-08-28 2002-05-21 Olympus Optical Co., Ltd. Microscope with a dynamic damper
JP4441057B2 (ja) * 1999-05-12 2010-03-31 オリンパス株式会社 医療用光学機器の支持装置
JP4716545B2 (ja) * 2000-06-28 2011-07-06 オリンパス株式会社 手術用顕微鏡装置
JP3857888B2 (ja) * 2000-07-11 2006-12-13 ペンタックス株式会社 ビデオ式顕微鏡への防振機構の組込みの決定方法
US6628457B2 (en) * 2000-07-11 2003-09-30 Asahi Kogaku Kogyo Kabushiki Kaisha Antivibration microscope
US6615811B1 (en) 2002-03-04 2003-09-09 Delphi Technologies, Inc. Ignition coil integrated ion sense with combustion and knock outputs
DE10306440A1 (de) * 2003-02-15 2004-08-26 Leica Microsystems (Schweiz) Ag Mikroskop mit Stativ
JP2005173160A (ja) * 2003-12-10 2005-06-30 Canon Inc 像振れ補正装置および光学機器
JP2005198700A (ja) * 2004-01-13 2005-07-28 Olympus Corp 手術用顕微鏡システム
DE102004004602B4 (de) * 2004-01-29 2022-09-08 Carl Zeiss Meditec Ag Stativvorrichtung für ein medizinisch-optisches Instrument
JP2006030814A (ja) * 2004-07-21 2006-02-02 Casio Comput Co Ltd 撮像装置
JP2006201592A (ja) * 2005-01-21 2006-08-03 Fujinon Corp 防振システム
IL177550A0 (en) * 2006-08-17 2006-12-31 Sialo Technology Israel Ltd All-in-one optical microscopic handle
US7920312B2 (en) * 2006-09-14 2011-04-05 Optiscan Pty Ltd. Optical fiber scanning apparatus
US20080149832A1 (en) * 2006-12-20 2008-06-26 Miguel Zorn Scanning Probe Microscope, Nanomanipulator with Nanospool, Motor, nucleotide cassette and Gaming application
JP5189301B2 (ja) * 2007-03-12 2013-04-24 オリンパス株式会社 レーザー走査型顕微鏡
DE102007021981B4 (de) * 2007-05-10 2009-10-08 Leica Microsystems (Schweiz) Ag Optisches Gerät mit Vibrationskompensation
JP5001075B2 (ja) * 2007-06-20 2012-08-15 浜松ホトニクス株式会社 観察装置及び方法
DE102007034286A1 (de) * 2007-07-20 2009-01-22 Carl Zeiss Surgical Gmbh Stativanordnung und Stativ für ein medizinisch-optisches Instrument
CN101952706B (zh) * 2008-01-24 2012-08-29 株式会社岛津制作所 扫描探针显微镜
JP2009180828A (ja) * 2008-01-29 2009-08-13 Nikon Corp 顕微鏡と、顕微鏡の像ぶれ補正結像レンズと、顕微鏡の像ぶれ補正方法
JP5061013B2 (ja) * 2008-04-03 2012-10-31 エスアイアイ・ナノテクノロジー株式会社 装置構造及びその構造を備えた走査型プローブ顕微鏡
JP2010026277A (ja) * 2008-07-22 2010-02-04 Hoya Corp カメラの手ぶれ補正装置
DE102009009562A1 (de) * 2009-02-19 2010-09-09 Integrated Dynamics Engineering Gmbh Kombinierter Bewegungssensor zum Einsatz in Feedback-Regelsystemen zur Schwingungsisolation
CN103887134B (zh) * 2009-05-15 2017-01-11 Fei 公司 带集成探测器的电子显微镜
US20110190580A1 (en) * 2009-09-28 2011-08-04 Bennett James D Analysis engine within a network supporting intravaginal monitoring
KR101022938B1 (ko) * 2009-11-10 2011-03-16 삼성전기주식회사 카메라모듈의 손떨림 보정기구
DE102010038547B4 (de) * 2010-07-28 2012-07-19 Leica Microsystems (Schweiz) Ag Bildstabilisierungs- und -aufnahmesensor für eine Bildaufnahmevorrichtung eines Operationsmikroskops
US8982464B2 (en) * 2010-10-22 2015-03-17 Tdk Taiwan Corporation Tilt-type anti-shake compensation structure for auto-focus module
JP5815258B2 (ja) * 2011-03-25 2015-11-17 株式会社日立ハイテクサイエンス カンチレバーの振動特性測定方法
US9766441B2 (en) * 2011-09-22 2017-09-19 Digital Surgicals Pte. Ltd. Surgical stereo vision systems and methods for microsurgery
JP5959181B2 (ja) * 2011-11-16 2016-08-02 オリンパス株式会社 顕微鏡システム
JP2013105155A (ja) * 2011-11-16 2013-05-30 Olympus Corp 顕微鏡システム
JP5722265B2 (ja) * 2012-03-28 2015-05-20 オリンパス株式会社 可動部材制御装置及びそれを備えた撮像装置
WO2014009859A2 (en) * 2012-07-10 2014-01-16 Aïmago S.A. Perfusion assessment multi-modality optical medical device
KR101961478B1 (ko) * 2012-09-19 2019-03-22 엘지이노텍 주식회사 카메라 모듈
US8769710B2 (en) * 2012-11-13 2014-07-01 Agilent Technologies, Inc. Atomic force microscope system using selective active damping
CN104106002B (zh) * 2012-11-16 2017-10-13 松下电器（美国）知识产权公司 相机驱动装置
JP6108801B2 (ja) * 2012-12-06 2017-04-05 キヤノン株式会社 補正光学装置、画像振れ補正装置、及び撮像装置
US9285566B2 (en) 2013-08-08 2016-03-15 Apple Inc. Mirror tilt actuation
JP6272885B2 (ja) * 2013-09-24 2018-01-31 ソニー・オリンパスメディカルソリューションズ株式会社 医療用ロボットアーム装置、医療用ロボットアーム制御システム、医療用ロボットアーム制御方法及びプログラム
JP6303382B2 (ja) * 2013-10-15 2018-04-04 ソニー株式会社 駆動制御装置、撮像装置および駆動制御方法
CN108828874A (zh) * 2013-12-11 2018-11-16 旭化成微电子株式会社 照相机模块及其光学元件的位置控制方法
WO2015129474A1 (ja) * 2014-02-28 2015-09-03 ソニー株式会社 ロボットアーム装置、ロボットアーム制御方法及びプログラム
US10556345B2 (en) * 2014-02-28 2020-02-11 Sony Corporation Robot arm apparatus and calibration method
CN106068175B (zh) * 2014-03-14 2020-04-28 索尼公司 机器人手臂设备、机器人手臂控制方法及程序
EP3135445B1 (en) * 2014-03-28 2021-04-28 Sony Corporation Robot arm device
US9596411B2 (en) * 2014-08-25 2017-03-14 Apple Inc. Combined optical and electronic image stabilization
US10376181B2 (en) * 2015-02-17 2019-08-13 Endochoice, Inc. System for detecting the location of an endoscopic device during a medical procedure
CA2979398A1 (en) * 2015-03-12 2016-09-15 Purdue Research Foundation Biodynamic microscopes and methods of use thereof
EP3076656B1 (en) * 2015-04-02 2017-03-08 Axis AB Method and system for image stabilization
JP6667220B2 (ja) * 2015-07-14 2020-03-18 キヤノン株式会社 振動型アクチュエータの制御装置とその制御方法、駆動装置、撮像装置、及び自動ステージ
JP2017034656A (ja) * 2015-08-04 2017-02-09 ソニー・オリンパスメディカルソリューションズ株式会社 医療用撮像装置、医療用画像取得システム及び内視鏡装置
WO2017068650A1 (ja) * 2015-10-20 2017-04-27 オリンパス株式会社 挿入体支援システム
JP6866128B2 (ja) * 2015-12-04 2021-04-28 キヤノン株式会社 振動型アクチュエータの駆動方法、振動型駆動装置及び機械装置
KR20160016732A (ko) * 2015-12-22 2016-02-15 유니크 (주) 손떨림 보정용 ois 액츄에이터
WO2019104413A1 (en) * 2017-12-03 2019-06-06 Frank Jones Enhancing the performance of near-to-eye vision systems

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210244260A1 (en) * 2018-09-11 2021-08-12 Sony Corporation Medical observation system, medical observation apparatus and medical observation method
US11969144B2 (en) * 2018-09-11 2024-04-30 Sony Corporation Medical observation system, medical observation apparatus and medical observation method
US11006093B1 (en) 2020-01-22 2021-05-11 Photonic Medical Inc. Open view, multi-modal, calibrated digital loupe with depth sensing
US11166006B2 (en) 2020-01-22 2021-11-02 Photonic Medical Inc. Open view, multi-modal, calibrated digital loupe with depth sensing
US11412202B2 (en) 2020-01-22 2022-08-09 Photonic Medical Inc. Open view, multi-modal, calibrated digital loupe with depth sensing
US11611735B2 (en) 2020-01-22 2023-03-21 Photonic Medical Inc. Open view, multi-modal, calibrated digital loupe with depth sensing

Also Published As

Publication number Publication date
US11284000B2 (en) 2022-03-22
JP2017129649A (ja) 2017-07-27
US20190394400A1 (en) 2019-12-26
JP6704255B2 (ja) 2020-06-03

Similar Documents

Publication Publication Date Title
US11850103B2 (en) Surgical microscope device and surgical microscope system
US11284000B2 (en) Medical observation device, medical observation system, and image shake correction method
US11422346B2 (en) Medical observation device, image movement correcting method, and medical observation system
US20160131880A1 (en) Medical observation apparatus, medical video microscope apparatus, and medical video microscope system
US11510751B2 (en) Medical observation apparatus
JP6858750B2 (ja) 医療用観察装置、駆動制御方法、医療用観察システム及び支持アーム装置
US10451861B2 (en) Medical observation device and medical observation system
US11513332B2 (en) Microscope apparatus and control method
JP6935409B2 (ja) 医療用観察装置及び医療用観察システム
US11648082B2 (en) Medical holding device, and medical observation device
US10983319B2 (en) Surgical microscope device and surgical microscope system

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY OLYMPUS MEDICAL SOLUTIONS INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TAMURA, SHIGERU;REEL/FRAME:041245/0800

Effective date: 20161212

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO PAY ISSUE FEE