EP3504575A1 - Procédé de formation d'image dans un microscope avec éclairage de biais - Google Patents

Procédé de formation d'image dans un microscope avec éclairage de biais

Info

Publication number
EP3504575A1
EP3504575A1 EP17755484.7A EP17755484A EP3504575A1 EP 3504575 A1 EP3504575 A1 EP 3504575A1 EP 17755484 A EP17755484 A EP 17755484A EP 3504575 A1 EP3504575 A1 EP 3504575A1
Authority
EP
European Patent Office
Prior art keywords
illumination
microscope
digital image
contrast
imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP17755484.7A
Other languages
German (de)
English (en)
Inventor
Benjamin DEISSLER
Albrecht Weiss
Alexander Weiss
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leica Microsystems CMS GmbH
Original Assignee
Leica Microsystems CMS GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leica Microsystems CMS GmbH filed Critical Leica Microsystems CMS GmbH
Publication of EP3504575A1 publication Critical patent/EP3504575A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/90—Dynamic range modification of images or parts thereof
    • G06T5/92—Dynamic range modification of images or parts thereof based on global image properties
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/06—Means for illuminating specimens
    • G02B21/08—Condensers
    • G02B21/082—Condensers for incident illumination only
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image

Definitions

  • the present invention relates to a method for imaging in a microscope with oblique illumination, wherein an object is illuminated by an obliquely incident on the object plane of the microscope illumination beam path and a microscopic image of the object and a corresponding digital image signal are generated.
  • the method of oblique illumination can be used to increase the contrast and to produce a plastic relief impression in low-contrast samples.
  • a decentral section in the aperture diaphragm plane ie a section substantially outside the optical axis of the aperture diaphragm, is illuminated, so that the wavefronts of the illumination light pass through the preparation more or less obliquely, ie inclined in a certain angular range to the optical axis.
  • the differently inclined wavefronts are not sufficient for interference in the image, which results in an edge in the object being rendered bright on one side and dark on the other side, resulting in a relief-like image impression.
  • Incident light and transmitted light microscopy with oblique illumination are advantageously used for phase objects and represent a technically simple and thus cost-effective alternative to interference microscopy.
  • Köhler illumination is used, with oblique illumination on one side, for example by decentration of the light Aperture, can be obtained, as proposed in DE 35 27 426 C1.
  • the aperture diaphragm proposed there can be moved on both sides out of the optical axis
  • Contrasting methods on the basis of the described oblique illumination are used for various low-contrast sample types, in particular also in connection with microtiter plates.
  • oblique lighting When using the oblique lighting When focusing in the z-direction, ie in the direction of the optical axis of the microscope objective, there is a lateral shift of the image.
  • the gain in contrast due to oblique illumination is the stronger, the more decentralized the objective pupil is illuminated.
  • this leads to problems in the use of microtiter plates since on the one hand due to the depth of the wells geometrically caused shadowing and on the other hand the meniscus on the liquid surface a shift of the illuminated surface in the objective pupil as a function of the xy movement caused the sample.
  • the object of the present invention is to specify a method for imaging in a microscope with slant illumination, with which the imaging of this contrasting method is improved and in particular the abovementioned disadvantages are to be avoided. Disclosure of the invention
  • the present invention proposes a method for imaging in a microscope with oblique illumination with the features of claim 1.
  • Advantageous embodiments are the subject of the dependent claims and the following description.
  • an object is illuminated by an illumination beam path incident obliquely on the object plane.
  • a microscopic image of this object is generated.
  • the microscope considered here essentially has a microscope objective, with different lenses often being available for selection, as well as a tube optic.
  • the microscopic image of the object can be viewed directly by a viewer and / or via a camera. To display the image on a digital camera, it is necessary to generate a digital image signal from the existing microscopic optical image.
  • a digital image for example for documentation purposes, is generated without direct consideration.
  • the relief-like image impression produced by the oblique illumination is again increased with increased contrast by processing the digital image signal by means of digital image processing using a convolution kernel (also referred to as convolution filter or convolution filter) to increase the contrast and from this a contrast-enhanced image digital image is generated.
  • a convolution kernel also referred to as convolution filter or convolution filter
  • the oblique illumination beam path is generated by illuminating a decentralized area in or near an aperture plane of an illumination arrangement of the microscope, this illuminated area being conjugate to a half pupil size one arranged entrance pupil of the microscope objective may amount.
  • the illuminated area may in particular be larger than would typically be necessary to produce a sufficient contrast gain and relief impression in the case of oblique illumination imaging.
  • the illuminated area is preferably 100%, in particular 70%, in particular 50% larger than necessary for imaging with oblique illumination.
  • This contrast-enhanced image is then further processed to increase the contrast with the aid of digital image processing.
  • a Köhler illumination arrangement can be used to produce the oblique illumination, a structure as known from the aforementioned patent DE 10 2010 042351 B4. With regard to construction and mode of operation, reference is expressly made again to this document.
  • the orientation of the convolution kernel is aligned in relation to the direction of the oblique illumination in such a way that the contrast-increasing effects increase. This is especially the case when the direction from which the oblique illumination hits the sample coincides with the direction of the sequence of numbers (2, 1, -2) of the convolution kernel, here considered as a vector, assuming that the Sample and the image of the sample are aligned the same (north of the image coincides with north of the sample).
  • a symmetrical square convolution kernel is used whose symmetry axis is oriented perpendicular to the direction of the oblique illumination.
  • Digital image processing can be performed anywhere in the presence of a digital image signal. It is advantageous if the digital image is recorded by a camera and displayed by a central computer (CPU) or a monitor of the microscope connected to it. The digital processing then takes place, for example, anywhere between the camera and the CPU, for example directly in the camera, in a separate module between the camera and the CPU or in the CPU itself. It takes place in real time, so that the process takes place in an online image For example, it can be used for navigation in the object field.
  • CPU central computer
  • the information (for example, one byte for each of the colors red, green, and blue) of each image pixel is recalculated using the corresponding information of the adjacent pixels with the weight given by the convolution kernel. It is furthermore advantageous if the illuminated decentralized area in or near a (conjugate) aperture plane of an illumination arrangement of the microscope and / or the convolution kernel used is determined as a function of a microscope objective used. In this way, when using different objectives with different magnification and aperture, the relationship between slant illumination and relief filter can be adjusted by changing or adjusting apertures in said aperture plane and / or by using another convolution kernel. This can ensure sufficient illumination of the object field and shadowing can be minimized. It should be noted that the method according to the invention can be used both in a microscope with a finite imaging beam path and in a microscope with an infinite imaging beam path.
  • the illumination beam path can form an incident-light illumination beam path or a transmitted-light illumination beam path.
  • the invention has the advantage that it is possible to obtain a contrast-enhanced image with a relief impression without the above-described problems noticeably coming to fruition, which would be caused by oblique illumination on the one hand and digital image processing alone on the other hand.
  • the lateral image shift in focusing as well as the noise and the loss of object similarity by the convolution are minimized. This effect could not be expected.
  • the invention is particularly suitable for the use of samples in microtiter plates, since due to the depth of the wells and because of the liquid meniscus, neither the oblique illumination alone nor any known phase contrasting methods can be used to effectively increase the contrast.
  • the differential interference contrast (DIC) is not applicable when using plastic microtiter plates because of the loss of polarization direction.
  • FIG. 1 shows a schematic cross-sectional view of the structure of an oblique illumination
  • FIG. 2 schematically shows an embodiment of a microscope for imaging with slanted transmitted light illumination
  • FIG. 3 schematically shows an embodiment of a microscope for imaging with slant incident illumination
  • FIG. 4 shows schematically the method sequence according to the invention.
  • the basic principle of the oblique illumination is shown in FIG.
  • the illustrated illumination arrangement has an aperture stop 101 and a condenser 103.
  • a decentral area 105 of the aperture 101 is illuminated by an illumination beam path 102.
  • the decentralized area 105 lies outside the optical axis 106 or lies largely outside this optical axis 106, but may contain these.
  • the decisive factor is that the decentralized region 105 is not symmetrical with respect to the optical axis 106, as shown in FIG.
  • the illumination light is collected by a condenser 103 and focused on the object plane 104. As shown in FIG.
  • FIG. 2 shows a possible embodiment of a microscope 200 for imaging with oblique illumination, in which case the case of transmitted light illumination is shown.
  • a possible embodiment of the oblique illumination in a microscope with epi-illumination can be seen in FIG.
  • FIG. 2 very schematically shows a microscope 200, which has the essential components of the microscope objective 208 and the tube optics 209.
  • the objective 208 defines an optical axis 206.
  • the microscope 200 further comprises a microscope stage 215, on which an object is mounted in an object plane 204, which is to be examined microscopically in transmitted light.
  • a camera 230 captures the microscopic optical image and converts it to a digital image.
  • the digital image may be displayed on a monitor 242 for a viewer.
  • the digital microscope 200 considered here has a central control unit or CPU 241 for controlling the various microscope components.
  • a central control unit or CPU 241 for controlling the various microscope components.
  • an aperture control 243 is shown here, which is controlled by the CPU 241. This will be discussed below.
  • the CPU 241 also typically controls the microscope stage 215 to move the same, selecting a lens 218, and other components.
  • the illumination arrangement of the microscope 200 comprises a light source 201, a downstream lens 202, a further lens 203 and a diaphragm 210 arranged in the aperture plane or near the aperture plane.
  • the diaphragm 210 is followed by a condenser 212, which projects the illumination beam path 211 onto the object plane 204 focused.
  • the beam path shown here is the realization of Köhler's transmitted light illumination.
  • the diaphragm 210 is arranged in a plane conjugate to the light source 201.
  • the diaphragm 210 is in an entrance pupil of the microscope objective 208 conjugated level arranged. In this way, a uniform illumination of the object plane 204 and thus of the observed preparation section is achieved.
  • the light source 201 is imaged into the aperture diaphragm plane via the illumination optics consisting of the lenses 202 and 203.
  • a decentered illumination beam path 211 is generated from the original illumination beam path 211 'by means of an aperture 205 located there it is also an aperture disk with different apertures, as described in detail in DE 10 2010 042 351 B4 In this respect, reference should again be made explicitly to this document with regard to construction and mode of operation.
  • the corresponding digital image signal is digitally reworked in embodiments shown here in a computing unit 240.
  • the arithmetic unit 240 shown here may be part of the camera 230, but also part of the CPU 241.
  • the digital processing can therefore take place directly in the camera 230 or directly in the CPU 241 or, as shown here, in the arithmetic unit 240.
  • the digital image processing by means of a particularly square convolution kernel can be carried out in real time, so that the processed image without noticeable delay for a user as an online image, for example, for navigation in the object field on a monitor 242 can be displayed.
  • the orientation in the above example given by the direction of the sequence of numbers (2, 1, -2), which is perpendicular to the axis of symmetry (0, 1, 0), in relation to the direction of the oblique illumination, here coming from the south align to further increase the contrast increase.
  • the direction of the oblique illumination is aligned with respect to the course of such structures in order to be able to represent them optimally plastically.
  • the size of the illuminated region 205 of the diaphragm 210 is particularly advantageous initially to select the size of the illuminated region 205 of the diaphragm 210 in such a way that an image with oblique illumination is conventionally generated. Subsequently, the size of the region 205 can be increased, for example, until the half-side illumination of the objective pupil. This is possible due to the subsequent digital image processing without loss of image quality.
  • the region 205 is enlarged, for example, by introducing a slightly larger aperture into the illumination beam path 211.
  • the diaphragm 210 may be designed, for example, as an aperture wheel.
  • the control of the diaphragm 210 via the aperture control 243 which in turn is controlled by the CPU 241. It is particularly preferred if the illuminated region 205 is selected to be about 50% -70% larger than is conventionally necessary for imaging with oblique illumination.
  • a suitable convolution kernel is selected in particular by the CPU 241 and transferred to the arithmetic unit 240 for image processing.
  • the respectively used folding core and / or the illuminated decentralized region 205 could furthermore be determined in particular depending on the microscope objective 208 used.
  • the magnification ß réelle and aperture of the lens 208 may be an adapted illuminated area 205 and an adapted convolution core be advantageous. This ensures sufficient illumination of the object and shading can be minimized.
  • the present structure is particularly advantageous for samples in microtiter plates, in particular those in plastic wells which are examined in transmitted light illumination.
  • FIG. 3 which shows an embodiment of a microscope 200 for imaging with slant reflected illumination
  • FIG. 3 shows an embodiment of a microscope 200 for imaging with slant reflected illumination
  • the microscope 200 uses a lighting arrangement for reflected-light illumination.
  • the illumination arrangement in turn comprises a light source 201 and downstream lenses 202, 203 and an aperture 210 arranged in the aperture plane or near the aperture plane.
  • the lenses 202 and 203 define an optical axis 206 of the illumination arrangement. From the symmetric illumination beam path 211 '210 an asymmetrically opposed to the optical axis 206 area is cut out by the decentralized illuminated region 205 of the diaphragm, which is used to as an illumination path 211 for the oblique illumination.
  • the two downstream lenses 213 and 207 generate a parallel illumination beam path 211, which is coupled by a beam splitter 220 in the direction of the optical axis 206 of the microscope objective 208.
  • the microscope objective 208 focuses the illumination beam path 211 onto the object plane 204. All other details for imaging in the microscope 200, for digital image processing and for controlling the diaphragm 220 are in complete analogy to those of Figure 2. To avoid repetition, reference is therefore made to the statements there.
  • step S1 a microscope image is taken with slant illumination.
  • All information about the parameters of the oblique illumination are available to the CPU 241 and are taken into account in the next step S2 in the selection of a suitable convolution kernel.
  • the parameters of the oblique illumination include magnification and aperture of the objective 208 used, as well as size, geometry and position of the illuminated region 205 of the diaphragm 210.
  • Step S3 The contrast enhanced digital image may be displayed on a monitor 242 in step S4, for example.
  • the method described in FIG. 4 can also be executed in the structure of a microscope according to FIG.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

La présente invention concerne un procédé de formation d'image dans un microscope (200) avec éclairage de biais. Un objet est éclairé selon une trajectoire d'éclairage (211) tombant de biais sur le plan d'objet (204) du microscope (200) et une image microscopique de l'objet ainsi qu'un signal d'image numérique correspondant sont produits. Le signal d'image numérique est traité au moyen d'un traitement d'image numérique à l'aide d'un noyau de convolution servant à augmenter le contraste et il en ressort qu'une image numérique à contraste augmenté est produite.
EP17755484.7A 2016-08-25 2017-08-17 Procédé de formation d'image dans un microscope avec éclairage de biais Withdrawn EP3504575A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102016115856.9A DE102016115856B4 (de) 2016-08-25 2016-08-25 Verfahren zur Bildgebung in einem Mikroskop mit schiefer Beleuchtung
PCT/EP2017/070882 WO2018036911A1 (fr) 2016-08-25 2017-08-17 Procédé de formation d'image dans un microscope avec éclairage de biais

Publications (1)

Publication Number Publication Date
EP3504575A1 true EP3504575A1 (fr) 2019-07-03

Family

ID=59686945

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17755484.7A Withdrawn EP3504575A1 (fr) 2016-08-25 2017-08-17 Procédé de formation d'image dans un microscope avec éclairage de biais

Country Status (4)

Country Link
US (1) US10823951B2 (fr)
EP (1) EP3504575A1 (fr)
DE (1) DE102016115856B4 (fr)
WO (1) WO2018036911A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117242330A (zh) * 2021-05-24 2023-12-15 贝克曼库尔特有限公司 使用流通显微镜术成像的样本的倾斜照明

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3527426C1 (de) 1985-07-31 1986-07-10 Dietmar 4290 Bocholt Enk Opakilluminator für ein Mikroskop
DE10229113A1 (de) * 2002-06-28 2004-01-22 Siemens Ag Verfahren zur Grauwert-basierten Bildfilterung in der Computer-Tomographie
WO2006103663A1 (fr) * 2005-03-29 2006-10-05 Yoel Arieli Camera d'imagerie spectrale et applications
JP5814684B2 (ja) * 2010-09-03 2015-11-17 オリンパス株式会社 位相物体の可視化方法及び可視化装置
DE102010042351B4 (de) 2010-10-12 2014-02-13 Leica Microsystems Cms Gmbh Mikroskopbeleuchtungssystem, Mikroskop und Verfahren zur schrägen Auflichtbeleuchtung
WO2014132485A1 (fr) * 2013-02-28 2014-09-04 オリンパス株式会社 Procédé d'observation d'un échantillon et dispositif d'observation d'un échantillon
US9229213B2 (en) 2013-05-24 2016-01-05 Steven E. Richfield Coincident focus microscope having superior resolution and contrast in three dimensions

Also Published As

Publication number Publication date
DE102016115856A1 (de) 2018-03-01
US20190391380A1 (en) 2019-12-26
WO2018036911A1 (fr) 2018-03-01
US10823951B2 (en) 2020-11-03
DE102016115856B4 (de) 2020-01-02

Similar Documents

Publication Publication Date Title
DE102012218382B4 (de) Verfahren zum Festlegen eines Lasermikrodissektionsbereichs und zugehöriges Lasermikrodissektionssystem
EP3186672A2 (fr) Formation d'images de contraste de phase
EP3452858B1 (fr) Réduction des artefacts lors d'un éclairage sélectif en fonction de l'angle
DE3707487A1 (de) Verfahren zur autofokussierung von mikroskopen und mikroskope mit einer autofokussierung
EP3304165B1 (fr) Agencement et procédé de formation de faisceau et de microscopie à feuille de lumière
DE102011082756A1 (de) Autofokussierverfahren und -einrichtung für ein Mikroskop
EP3608831A1 (fr) Procédé de fourniture d'un moyen d'évaluation pour au moins un système d'application optique d'une technologie d'application microscopique
WO2015001007A1 (fr) Procédé d'acquisition d'images pour un système de microscope et système de microscope associé
EP2557451B1 (fr) Procédé et dispositif pour la détection optique d'un échantillon éclairé
EP3692409A1 (fr) Microscope confocal à grande résolution
EP3712670A1 (fr) Procédé de microscopie à balayage haute résolution
EP2465001A1 (fr) Microscope pour mesurer la fluorescence par réflexion totale
DE202013011877U1 (de) Mikroskopsystem
EP3504575A1 (fr) Procédé de formation d'image dans un microscope avec éclairage de biais
EP3953684A1 (fr) Microscope à feuille de lumière et procédé de détermination de l'indice de réfraction d'objets dans la chambre à échantillons
WO2018054944A1 (fr) Système d'éclairage structuré de microscope
DE602004012274T2 (de) Rasterabbildungseinrichtung für die konfokale mikroskopie mit bildsubstraktion
EP3988989B1 (fr) Procédé et microscope doté d'un dispositif de détection des déplacements d'un échantillon par rapport à une lentille
WO2019007698A1 (fr) Détermination numérique de position de mise au point
DE102013208872B4 (de) Verfahren zur Erzeugung eines Bildes einer Probe
DE102020204615A1 (de) Schiefeebenemikroskop mit verbesserter Sammeleffizienz
WO2020094851A1 (fr) Procédé de contraste en microscopie à lumière transmise
WO2016045913A1 (fr) Dispositif de projection d'un échantillon
EP3899502A1 (fr) Microscopie à lumière fluorescente avec résolution axiale augmentée
DE102007015599A1 (de) Vermeidung von Halos um intensive Lichtquellen bei optischen Systemen, insbesondere bei Nachtsichtsystemen

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190215

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230414

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20230301