AU2013204570B2 - Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions - Google Patents

Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions Download PDF

Info

Publication number
AU2013204570B2
AU2013204570B2 AU2013204570A AU2013204570A AU2013204570B2 AU 2013204570 B2 AU2013204570 B2 AU 2013204570B2 AU 2013204570 A AU2013204570 A AU 2013204570A AU 2013204570 A AU2013204570 A AU 2013204570A AU 2013204570 B2 AU2013204570 B2 AU 2013204570B2
Authority
AU
Australia
Prior art keywords
arrangement
signal
anatomical structure
electromagnetic radiation
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2013204570A
Other versions
AU2013204570A1 (en
Inventor
Brett Eugene Bouma
Melissa Suter
Guillermo J. Tearney
Benjamin J. Vakoc
Dvir Yelin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Hospital Corp
Original Assignee
General Hospital Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2006299659A external-priority patent/AU2006299659A1/en
Application filed by General Hospital Corp filed Critical General Hospital Corp
Priority to AU2013204570A priority Critical patent/AU2013204570B2/en
Publication of AU2013204570A1 publication Critical patent/AU2013204570A1/en
Application granted granted Critical
Publication of AU2013204570B2 publication Critical patent/AU2013204570B2/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

Method, apparatus and arrangement according an exemplary embodiment of the present invention can be provided for analyzing and/or illustrating at least one portion of an anatomical structure. For example, light can be forwarded to such portion so as to generate first information which is related to the portion. For example, the light can be provided on or within a subject. The first information can be received, and at least one section of the portion may be selected based on the first information so as to generate second information. A magnification of a display of the portion may be progressively modified as a function of the second information.

Description

P/00/0111 Regulation 3.2 AUSTRALIA Patents Act 1990 COMPLETE SPECIFICATION STANDARD PATENT Invention Title: Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions The following statement is a full description of this invention, including the best method of performing it known to us: METHOD AND APPARATUS FOR METHOD FOR VIEWING AND ANALYZING OF ONE OR MORE BIOLOGICAL SAMPLES WITH PROGRESSIVELY INCREASING RESOLUTIONS CROSS-REFERENCE TO RELATED APPLICATION(S) 5 [0001] This application is based upon and claims the benefit of priority from U.S. Patent Application Serial No. 60/721,802, filed September 29, 2005, the entire disclosure of which is incorporated herein by reference. FIELD OF THE INVENTION 10 [0002] The present invention relates to relates to methods and arrangements for viewing and analyzing of one or more biological samples and anatomic structures with changing magnifications, preferably progressively increasing resolutions. BACKGROUND OF THE INVENTION 15 [00031 Radiological techniques such as X-ray computed tomography ("CT"), magnetic resonance imaging ("MRI"), and ultrasound can enable noninvasive visualization of human pathology at the organ level. Although these modalities may be capable of identifying large-scale pathology, the diagnosis of cancer can require the evaluation of microscopic structures that is beyond the resolution of conventional imaging techniques. 20 Consequently, biopsy and histopathologic examination may be required for diagnosis. Because precancerous growth and early stage cancers often arise on a microscopic scale, they can present significant challenges for identification and diagnosis. Conventional screening and surveillance of these pathologies relies on unguided biopsy and morphological analysis of Hematoxylin and Eosin ("H&E") stained slides. Although this approach may be regarded as a current standard for 25 microscopic diagnosis, it requires the removal of tissue from the patient and significant processing time to generate slides. More importantly, histopathology is inherently a point sampling technique; frequently only a very small fraction of the diseased tissue can be excised and often less than 1% of a biopsy sample may be examined by a pathologist. 1 A [00041 It may be preferable to obtain microscopic diagnoses from an entire organ or biological system in a living human patient. However, the lack of an appropriate imaging technology can greatly limits options for screening for pre-neoplastic conditions (e.g. metaplasia) and dysplasia. In addition, an inability to identify areas of dysplasia and 5 carcinoma in situ has led to screening procedures such as, e.g., random biopsy of the prostate, colon, esophagus, and bladder, etc., which can be highly undesirable and indiscriminate. Many diagnostic tasks presently referred to a frozen section laboratory, such as the delineation of surgical tumor margins, could be improved by a diagnostic modality capable of rapidly imaging large tissue volumes on a microscopic scale. A 10 technology that could fill this gap between pathology and radiology would be of great benefit to patient management and health care. [00051 Technical advances have been made to increase the resolution of non-invasive imaging techniques such as, e.g., micro-CT, micro-PET, and magnetic resonance imaging ("MRI") microscopy. Resolutions approaching 20 prm have been achieved by these 15 technologies, but fundamental physical limitations can still prevent their application in patients. Microscopic optical biopsy techniques, performed in situ, have recently been advanced for non-excisional histopathologic diagnosis. Reflectance confocal microscopy ("RCM") may be particularly well-suited for non-invasive microscopy in patients, as it is capable of measuring microscopic structure without tissue contact and does not require 20 the administration of extrinsic contrast agents. RCM can reject out of focus light and detects backscattered photons selectively originating from a single plane within the tissue. RCM can be implemented, e.g., by rapidly scanning a focused beam of electromagnetic radiation in a plane parallel to a tissue surface, yielding transverse or en face images of tissue. The large numerical aperture (NA) that may be used in RCM can 25 yield a very high spatial resolution (1-2 um), enabling visualization of subcellular structures. High NA imaging, however, can be particularly sensitive to aberrations that arise as light propagates through inhomogeneous tissue. Also, high-resolution imaging with RCM is typically limited to a depth of about 100-400 pm. 100061 RCM has been extensively demonstrated as a viable imaging technique for 30 skin tissue. Development of endoscopic confocal microscopy systems has been more 2 difficult, owing at least in part to the substantial technical challenges involved in miniaturizing a scanning microscope. One major obstacle to direct application of the concepts of confocal microscopy to endoscopy is the engineering of a mechanism for rapidly rastering a focused beam at the distal end of a small-diameter, flexible probe. A variety of approaches have been proposed 5 to address this problem, including the use of distal micro-electromechanical systems ("MEMS") beam scanning devices and proximal scanning of single-mode fiber bundles. Also, RCM may provide microscopic images only at discrete locations - a "point sampling" technique. As currently implemented, point sampling can be inherent to RCM because it has a limited field of view, which may be comparable to or less than that of an excisional biopsy, and the imaging rate 10 can be too slow for comprehensive large field microscopy. [00071 Another challenge in adapting confocal microscopy to endoscopic applications can include miniaturization of high NA objectives that may be used for optical sectioning. Such miniaturization may be achieved by providing, e.g., a gradient index lens system, dual-axis objectives, or custom designs of miniature objectives. For example, detailed images of the 15 morphology of cervical epithelium may be obtained in vivo using a fiber optic bundle coupled to a miniature objective lens, and fluorescencebased images of colorectal lesions may be achieved using commercial instruments such as those which may be obtained, e.g., from Olympus Corp. and Pentax/Optiscan. [00081 Despite these advances, there may be a need to provide methods and 20 arrangements that can parse data (e.g., provided either at the cellular level, architectural level or both that can be obtained from large surface areas or even possibly entire organs) so that it may be appropriately interpreted in a timely, accurate manner. Indeed, the amount of this data can be large and difficult to view at one time such data, and thus such methods and arrangements would be beneficial for viewing and analysis thereof. 25 [0008a] It is not admitted that any background information presented or referred to in this specification forms part of the common general knowledge in Australia or any other jurisdiction. 3 OBJECTS AND SUMMARY OF THE INVENTION [00091 One of the objects of the present invention is to overcome certain deficiencies and shortcomings of the prior art systems (including those described herein above), and provide exemplary embodiments of methods and arrangements for viewing and analyzing of one or more 5 biological samples and anatomic structures with changing magnifications, preferably at progressively increasing resolutions. Such exemplary methods and arrangements can be used along with a visual inspection of the data or by automatic processing procedures of the data to guide the visualization of areas that are most likely to contain abnormal and/or unhealthy tissue. [0010] Accordingly, method, apparatus and arrangement according to exemplary embodiments 10 of the present invention can be provided and which may analyze and/or illustrate at least one portion of an anatomical structure. [001 0a] In a first aspect, the invention provides an apparatus comprising: at least one first arrangement configured to forward an electromagnetic radiation to an anatomical structure, and continuously scan an entire region of at least one portion of the 15 anatomical structure using the electromagnetic radiation to generate at least one signal, wherein the entire region has an area that is greater than 1mm 2; and at least one second arrangement configured to review the signal and to generate at least one image based on the signal that has a transverse resolution that is better than 1 0pim. [001 Ob] in a second aspect, the invention provides a method for imaging a region of an ?0 anatomical structure comprising: forwarding at least one electromagnetic radiation to an anatomical structure; continuously scanning an entire region of at least one portion of the anatomical structure using the electromagnetic radiation, wherein the entire region has an area that is greater than 1 mm2 25 obtaining at least one signal based on the electromagnetic radiation; and generating at least one image based on the signal, wherein the image has a transverse resolution that is better than 10im. [0010c] Also disclosed herein but not claimed is a method for at least one of analyzing or 30 illustrating at least one portion of an anatomical structure, comprising: 4 forwarding light to the at least one portion so as to generate first information which is related to the at least one portion, wherein a generating arrangement is situated within a subject containing the anatomical structure and provides the light is provided on or within the 5 subject, the generating arrangement generating the first information, which first information is associated with an image; receiving the first information, and selecting at least one section of the at least one portion based on the first information so as to generate second information; and progressively modifying a magnification of a display of the at least one portion 10 as a function of the second information. [0010d] Further disclosed herein but not claimed is an apparatus for at least one of analyzing or illustrating at least one portion of an anatomical structure, comprising: at least one first arrangement which is situated within a subject containing the 15 anatomical structure and configured to forward light to the at least one portion so as to generate first information which is related to the at least one portion, the first information being associated with an image; at least one second arrangement which is configured to receive the first information, and select at least one section of the at least one portion based on the first 20 information so as to generate second information; and at least one third arrangement which is configured to progressively modify a magnification of a display of the at least one portion as a function of the second information. [0010e] Still further disclosed herein but not claimed is an arrangement for at least one of analyzing or illustrating at least one portion of an anatomical structure, comprising: 25 a tangible computer-accessible medium which stores software thereon comprising: a first set of instructions which, when executed by a computer processing arrangement, configures the computer processing arrangement to receive first information which is related to the at least one portion, the first information being generated by a generating arrangement in response to light being forwarded by the generating arrangement to the at least one portion, the 30 generating arrangement being situated within a subject containing the anatomical structure, the first information being associated with an image; a second set of instructions which, when executed by the computer processing arrangement, configures the 4A computer processing arrangement to receive the first information, and allows at least one of the computer processing arrangement or a user to select at least one section of the at least one portion based on the first information so as to generate second information; and 5 a third set of instructions which, when executed by the computer processing arrangement, configures the computer processing arrangement to progressively modify a magnification of display of the at least one portion as a function of the second information. [0011] In an exemplary embodiment of the present invention, display of position and/or depth of the at least one portion can be modified (e.g., within the anatomical structure). 10 The second information can be associated with a region provided within such portion, and/or may be obtained by user-selecting the region. The selection can be automatically performed by a processing arrangement without an input from a user. An area of an abnormality within the at least one portion can be determined, and the processing arrangement may perform the selection and modification so as to display at least one section of the abnormality. An area of an 15 abnormality can be determined within the portion using the processing arrangement so as to generate third information, and the selection can be performed by the user and/or the processing arrangement as a function of the third information. [00121 According to yet another exemplary embodiment of the present invention, the first information can be associated with two-, three- or four or more-dimensional, representation ?0 of the portion. Further, the portion can have an area that is greater than 1 mm 2 and/or 10 mm 2 . A displayed section of the portion can have an area is less than 1 cm 2 , 1 mm 2 and/or 100 pm 2 . The first information can be associated with a confocal 4B microscopy procedure, a spectrally-encoded confocal microscopy procedure, an optical coherence tomography procedure, and/or an optical frequency domain interferometry procedure. An arrangement can be situated within the anatomical structure so as to provide the light to the portion. 5 100131 Other features and advantages of the present invention will become apparent upon reading the following detailed description of embodiments of the invention, when taken in conjunction with the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS [00141 Further objects, features and advantages of the present invention will become 10 apparent from the following detailed description taken in conjunction with the accompanying figures showing illustrative embodiments of the present invention, in which: [0015] FIG. 1 is a schematic illustration of an exemplary spectrally encoded confocal microscopy (SECM) system;. 15 [0016] FIG. 2A is an exemplary SECM image of a swine intestinal epithelium, obtained ex vivo, 100 [Lm from the tissue surface using a single mode source and single mode detection (SM-MM) configuration; [00171 FIG. 2B is another exemplary SECM image of a swine intestinal epithelium, obtained using a single-mode source and multi-mode detection (SM-MM) configuration; 20 [00181 FIG. 2C is a magnified view of an SECM image of a swine intestinal epithelium; [00191 FIG. 3A is an exemplary SECM image of a swine intestinal epithelium, obtained ex vivo, after compression of the bowel wall at an imaging depth of 50 tm; 100201 FIG. 3B is an exemplary SECM image of a swine intestinal epithelium, 25 obtained ex vivo, after compression of the bowel wall at an imaging depth of 100 [tm; 5 100211 FIG. 4 is a schematic illustration of an exemplary SECM apparatus; [00221 FIG. 5 is an exemplary SECM image of a USAF chart; [00231 FIG. 6A is an exemplary SECM image based on data taken from a lens paper sample, displayed at a magnification of lx; 5 [00241 FIG. 6B is an exemplary SECM image based on data taken from a lens paper sample, displayed at a magnification of 4.5x; [0025] FIG. 6C is an exemplary SECM image based on data taken from a lens paper sample, displayed at a magnification of 16.7x; 100261 FIG. 6D is an exemplary SECM image based on data taken from a lens paper 10 sample, displayed at a magnification of 50x; [00271 FIG. 6E is an exemplary SECM image based on data taken from a lens paper sample, displayed at a magnification of 125x; 100281 FIG. 7 is a series of exemplary SECM data obtained from a lens paper sample at five different focal positions, together with a combine image that was generated by 15 combining the data in the five individual images; [0029] FIG. 8A is an exemplary SECM image based on data taken from a swine intestinal tissue fragment, displayed at a magnification of lx; [0030] FIG. 8B is an exemplary SECM image based on data taken from a swine intestinal tissue fragment, displayed at a magnification of 4x; 20 [0031 FIG. 8C is an exemlary SECM image based on data taken from a swine intestinal tissue fragment, displayed at a magnification of 20x; [0032] FIG. 8D is an exemplary SECM image based on data taken from a swine intestinal tissue fragment, displayed at a magnification of 40x; 6 [00331 FIG. 9A are front and elevation side views of microscopic images of a porcine esophagus in vivo which shows a vascular network within the submucosa without image enhancement or exogenous contrast agents using an exemplary embodiment of a method and an arrangement according to the present invention; 5 [00341 FIG. 9B is a side view of the microscopic image of a longitudinal cross section through a wall of the esophageal at a location illustrated in FIG. 9A; [00351 FIG. 9C is a side view of an unwrapped transverse section at the location illustrated in A; [00361 FIG. 9D is a side view of an expanded view of a selected section of the image 10 illustrated in FIG. 9C; 100371 FIG. 9E is an exemplary image of a representative histology section obtained from the anatomical region corresponding to the image illustrated in FIG. 9D; 100381 FIG. 10 is a flow diagram of an exemplary embodiment of the method for progressively zooming into a microscopy dataset of an anatomical structure of the present 15 invention; [00391 FIG. 11 is a series of exemplary images of esophageal mucosa obtained using optical coherence tomography ("OCT") techniques, demonstrating an implementation of an exemplary embodiment of an automatic processing procedure for identifying normal squamous mucosa as compared to Barrett's esophagus and adenocarcinoma; 20 [0040] FIG. 12 is a set of exemplary images of atherosclerotic plaque obtained using the OCT techniques, which have been processed to identify a macrophage density; and [0041] FIG. 13 is a flow diagram of another exemplary embodiment of the method according to the present invention for progressively zooming to a microscopy dataset of an anatomical structure based on the results obtained via a signal processing technique to 25 automatically identify regions of interest that may be viewed at a high magnification. 7 [0042] Throughout the figures, the same reference numerals and characters, unless otherwise stated, are used to denote like features, elements, components or portions of the illustrated embodiments. Moreover, while the subject invention will now be described in detail with reference to the figures, it is done so in connection with the illustrative 5 embodiments. It is intended that changes and modifications can be made to the described embodiments without departing from the true scope and spirit of the subject invention as defined by the appended claims. DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS [0043] In accordance with exemplary embodiments of the present invention, methods 10 and arrangements according to exemplary embodiments of the present invention can be provided for viewing and analyzing of one or more biological samples and anatomic structures with progressively increasing resolutions. Such exemplary methods and arrangements can be used along with a visual inspection of the data or by automatic processing procedures of the data to guide the visualization of areas that are most likely 15 to contain abnormal and/or unhealthy tissue. [0044] An exemplary SECM technique is shown in FIG. 1. The output from a single mode optical fiber 100, which may be located at a distal end of a probe, can be collimated by a collimating lens 110, and then illuminate a dispersive optical element (such as, e.g., a transmission diffraction grating 120). An objective lens 130 can then focus each 20 diffracted wavelength to a distinct spatial location within the specimen, resulting in a transverse line focus 140 where each point on the line may be characterized by a distinct wavelength. After reflection from the specimen, which may be, e.g., biological tissue, the optical signal can be recombined by the diffraction element 120 and collected by the single-mode fiber 100. The core aperture of the single-mode fiber 100 can provide a 25 spatial filtering mechanism that is capable of rejecting out-of-focus light. Outside the probe (and optionally within a system console) the spectrum of the returned light can be measured and converted into confocal reflectance as a function of transverse displacement within the specimen. The spectral decoding can be perfonned rapidly. 8 Thus an image created by scanning the beam in a direction orthogonal to the line focus can be accomplished by relatively slow and straightforward mechanical actuation. [0045] SECM techniques may allow the use of endoscopic RCM, and it can be capable of providing image data at extremely high rates using high-speed linear CCD 5 cameras. Commercially available linear CCD arrays can obtain data at a rate greater than about 60 million pixels per second. When incorporated into an SECM spectrometer, these arrays can produce confocal images at speeds that are about 10 times faster than a typical video rate and up to 100 times faster than some endoscopic RCM techniques. The rapid imaging rate and fiber-optic design of typical SECM systems can permit 10 comprehensive, large area microscopy through an endoscopic probe. 100461 Techniques using optical coherence tomography ("OCT") and variations thereof may be used for comprehensive architectural screening. Acquiring an OCT signal in the wavelength domain, rather than in the time domain, can provide orders of magnitude improvement in imaging speed while maintaining excellent image quality. 15 Using spectral domain OCT ("SD-OCT") techniques, high-resolution ranging can be conducted in biological tissue by detecting spectrally resolved interference between a tissue sample and a reference. Because SD-OCT systems can utilize the same high-speed linear CCD's as SECM systems, they can also be capable of capturing images at 60 million pixels/s, which is approximately two orders of magnitude faster than conventional 20 time-domain OCT ("TD-OCT") systems. With this acquisition rate and resolution,
SD
OCT systems can provide comprehensive volumetric microscopy at the architectural level in a clinical environment. 100471 The information provided by SD-OCT and SECM systems can be complementary, and a hybrid platform utilizing both techniques can provide information 25 on the architectural and cellular structure of tissue that may be essential to accurate diagnosis. Although a combination of disparate technologies typically requires extensive engineering and may compromises perfonnance, SECM and SD-OCT systems can share key components, and a high-performance multi-modality system can be provided without substantially increasing complexity or cost of the individual systems. 9 {0048] An SECM system in accordance with certain exemplary embodiments of the present invention can utilize a wavelength-swept 1300 nm source and a single-element photodetector to obtain spectrally encoded information as a function of time. With this system, images can be acquired at rates of up to about 30 frames/second having high 5 lateral (1.4 ptm) and axial (6 [im) resolutions, over a 400 tm field of view ("FOV"). Images of freshly excised swine duodenum segments were imaged ex vivo with a high speed system to illustrate the capability of an SECM system to identify subeellular structures that may be found in specialized intestinal metaplasia ("SIM"), the metaplastic change of BE. 10 [00491 FIGS. 2A-2C depict exemplary SECM images of a swine intestinal epithelium obtained ex vivo using two imaging modes and corresponding fiber configurations: a single-mode illumination with single-mode detection ("SM-SM"), and a single-mode illumination with multi-mode detection ("SM-MM"). The SM-SM image in FIG. 2A shows the epithelium structure 100 ptm from the tissue surface using a single mode 15 source and single-mode detection. The image of the same tissue region shown in FIG. 2B, obtained using a using a single mode source and multi-mode detection (SM-MM) with a core:aperture ratio of 1:4, appears smoother and may be more easily interpreted because of the reduction in speckle noise. FIG. 2C is a magnified view of the image shown in FIG. 2B that shows evidence of villi containing a poorly reflecting core (e.g., 20 lamina propria or "lp") and a more highly scattering columnar epithelium. Bright image densities visible at the base of the columnar cells, consistent with nuclei (indicated by arrows) are evident in FIG. 2C. [0050] The thickness of an esophageal wall being imaged in vivo using OCT techniques can be decreased, e.g., by about a factor of two using an inflated balloon. The 25 swine intestinal sample shown in FIGS. 2A-2C was decreased by the same amount, and the subcellular features observed using SECM techniques were well preserved. FIGS. 3A and 3B show images of this thinned sample obtained at a depth of 50 pm and 100 jnm, respectively. 10 100511 The penetration depth of a commercial 800 rn laser scanning confocal microscope was observed to be reduced by about 20% as compared to that obtained with a 1300 un SECM system. This reduced penetration may be a result of increased scattering of the shorter wavelength source. Thus an SECM system using an 840 nm 5 source may provide sufficient penetration to identify subcellular structure of, e.g., an intestinal epithelium. [00521 An apparatus in accordance with certain exemplary embodiments of the present invention that is configured to provide comprehensive SECM images is illustrated schematically in FIG. 4. This exemplary apparatus can be configured to obtain 10 images from a cylindrical sample having a length of 2.5 cm and a diameter of 2.0 cm, which are approximately the dimensions of the distal esophagus. A fiber-coupled 2.0 mW superluminescent diode 200, having a wavelength centered at 800 rn and a bandwidth of 45 nm (QSSL-790-2, qPhotonics, Chesapeake, VA) was configured to illuminate a 50/50 single-mode fiber optic beam splitter 405. Light transmitted through 15 one port of the splitter was collimated by a collimator 410 and transmitted through a fiber 412 to a focusing apparatus 415 and to a grating-lens pair that includes a grating 420 (1780 lpmm, Holographix, LLC, Hudson, MA) and a 350230-B asphere lens 425 (Thor Labs, Inc., Newton, NJ) having a focal length, f, of 4.5 mm, a clear aperture of 5.0 mm, and a NA of 0.55. This arrangement was capable of producing a 500 pm longitudinal 20 linear array, or line, of focused, spectrally-encoded spots 430 on an interior surface of the cylindrical sample. The grating-lens pair was affixed to the shaft of a motor 435 (1516SR, 15 mm diameter, MicroMo Electronics, Inc., Clearwater, FL) by a housing 440. As the motor 435 rotated, the spectrally encoded line was scanned across the inner circumference of the cylindrical sample. The motor 435, housing 440, and grating-lens 25 pair were translated along a longitudinal axis of the cylindrical sample during rotation of the motor 435 using a computer-controlled linear stage 445 (Nanomotion II, 2.5 cm range, Melles Griot, Rochester, NY). This procedure produced a helical scan of the entire interior surface of the cylindrical sample. [0053] Light reflected from the sample was transmitted back through the optical 30 system into the single-mode fiber 412 and provided by the fiber 412 to a spectrometer 11 450 and linear CCD 455 that includes 2048 pixels and has a 30 kHz line rate (Basler L104K, Basler Vision Technologies, Exton, PA). A computer 460 was used to store, analyze and display image data provided by the spectrometer 450 and CCD 455. Approximately 60,000 points per motor rotation (at 0.5 Hz, or 30 rpm) were digitized. to 5 achieve a 1.0 jim circumferential sampling density. The longitudinal velocity of the motor was 0.25 min/s and the time required for one complete scan of the cylindrical sample was 100 seconds. [00541 The 1/e 2 diameter of the collimated beam on the grating-lens pair was 4.0 mm. As a result, the effective NA of this exemplary apparatus was approximately 0.4, which 10 corresponds to a theoretical spot diameter of approximately 1.2 jim and a confocal parameter of approximately 2.5 jim. In a system that is free of optical aberrations, the theoretical spectral resolution on the sample may be 0.8 A, which can yield up to approximately 630 resolvable points across the spectrally encoded line 430. The spectrometer 450 in the detection arm was designed to exceed the predicted spectral 15 resolution of the probe. [00551 An SECM scan of a 1951 USAF resolution chart obtained using this apparatus is shown in FIG. 5. The smallest bars in this Figure, which are separated by 2.2 Im, were resolved. A transverse line spread function full-width-half-maximum ("FWHM") and an axial FWHM function obtained using a mirror scanned through the focus were measured 20 as 2.1 pim and 5.5 pim, respectively. The field of view was observed to be about 500 pim. These measurements were slightly lower than corresponding theoretical values, which may be attributed to aberrations in the optical path. These actual parameters indicate that the exemplary apparatus described herein is capable of providing sufficient resolution to be used for confocal microscopy in biological tissue. 25 100561 SECM image data for a complete pullback image of a 2.5 cm phantom specimen are shown in FIG. 6. Polar coordinates were converted to rectangular coordinates prior to generating these displayed images. The phantom specimen was made using lens paper affixed to the inner surface of a 2.1 cm inner diameter Teflon tube. In a low magnification image shown in FIG. 6A, macroscopic structure of the paper, 12 including folds and voids, can be observed. Circumferential stripes that are visible may have resulted from the lower spectral power and lens aberrations that may be present at or near the ends of the spectrally-encoded line. Individual fibers and fiber microstructure can be clearly resolved in regions of this data set that are presented at higher 5 magnifications, as shown in FIGS. 6B-6E. 10057] By adjusting the focusing apparatus 415 in FIG. 4A, cylindrical two dimensional ("2D") images of the phantom sample were acquired at five discrete focal depths over a range of 120 pm. These five images 710-750 shown in FIG. 7 were then summed to create an integrated image 760, which demonstrates a nearly complete 10 coverage of the surface of the phantom sample. [00581 Imaging biological samples using an SECM apparatus such as that described herein can be complicated by the lack of a centering apparatus for the optical scan head. In order to provide further improvements for generating wide-field microscopy images and data, a sample of swine intestine was placed on top of a 2.0 cm diameter transparent 15 cylinder. A 3600 scan of this sample, which was acquired in 1 second, is shown in FIG. 8A. Imaged tissue appears in only one sector of the cylindrical scan because the probe was not centered and the sample did not wrap completely around the cylinder. FIGS. 8B 8D show a sequence of magnified regions of this tissue sample. The image shown in FIG. 8B is an expansion of a 1.5 cm sector outlined by a dotted rectangle in FIG. 8A. 20 Similarly, the image in FIG. 8C represents an expansion of the rectangle outlined in FIG. 8B, and the image in FIG. 8D represents an expansion of the rectangle outlined in FIG. 8C. Magnified images of the tissue in the image FIG. 8B are suggestive of a glandular structure. The magnified images in FIGS. 8C-8D exhibit villi and nuclear features that are similar to those observed using a 1300 nm SECM system, as shown in FIGS. 2 and 3. 25 Other areas of the SECM scan in FIG. 8A show artifacts, including specular reflectance from the transparent cylinder and complete signal dropout, both of which may result from improper positioning of a focused SECM beam. 10059] Conducting comprehensive confocal microscopy in patients can present a variety of technical challenges. Such challenges may include, e.g., increasing the 13 imaging rate, miniaturizing the probe optics and mechanical components, incorporating a centering mechanism, and implementing a technique for dynamically changing the focal plane. [00601 The image acquisition speed of an SECM system can be improved by, e.g., a 5 factor of about 2-4 as compared with the exemplary system described hereinabove. Such an improvement can be realized by providing certain modifications. For example, a higher power semiconductor light source (such as, e.g., a Superlum Diode, T-840 HP: 25 mW, 840 nm, 100 mn spectral bandwidth) can provide 1000 spectrally resolvable points. The increase in optical power can improve sensitivity and the larger bandwidth may 10 widen the field of view, making it possible to scan the SECM beam approximately two times faster. Also, using an optical circulator such as, e.g., an OC-3-850 (Optics for Research, Caldwell, NJ) can increase the efficiency of light delivered to the probe and collected from the probe. Using a faster, more sensitive linear CCD such as, for example, an AVIIVA M4-2048 having 2048 pixels and a 60 kfHz readout rate (Atmel Corporation,) 15 can provide a twofold increase in data acquisition speed and an improved spectral response over the wavelength range used to generate image data. Performance may also be improved by using, e.g., a Camera Link interface that can be capable of transferring data at a rate of approximately 120 MB/s from a camera to a hard-drive array for storage. {00611 Sensitivity, which can be understood to refer to a minimum detectable 20 reflectance, is a system parameter that can affect confocal image quality and penetration depth. A fraction of the incident light, which may be approximately 10 4 to 10-7, can be reflected from skin at depths up to approximately 300 ptm when using a near-infrared RCM technique. Based on the NA of the objective lens used in the exemplary system in accordance with certain exemplary embodiments of the present invention described 25 herein and the observation that skin may attenuate light more significantly than non keratinized epithelial mucosa, the exemplary SECM probe objective described herein may collect approximately 3x1 04 to 3x10 7 of the illuminating light reflected from deep within tissue. The 25 mW light source may be separated into, e.g., approximately 1000 independent beams. A maximum double pass insertion loss can be estimated to be 30 approximately 10 dB (6 dB from the probe, and 4 dB from the fiber optics and 14 spectrometer). Each pixel in an array may thus be illuminated by approximately 50 to 50,000 photons/pixel for each line integration period based on these estimated parameters. [0062] Using a multi-mode detection technique, a factor of 10 signal gain may be 5 achieved, resulting in approximately 500 to 500,000 photons/pixel per scan for such a configuration. A single pixel on an Atmel AVIIVA M4 camera, e.g., can reliably detect light if a signal is above the dark current fluctuation that occurs at approximately 240 photons. If this device has approximately a 50% quantum efficiency at these wavelengths, a minimum detectable signal can be produced at approximately 480 10 photons/pixel per scan. Based on these approximations, an Atmel camera may have sufficient sensitivity to allow SECM imaging at deeper tissue depths. Quantum noise limited detection of a predicted minimum reflectance can be achieved by using a multi mode fiber for collection or by increasing the source power. 100631 According to one exemplary embodiment of the present invention, methods 15 and arrangements can be provided for navigating, analyze and display large microscopic datasets from anatomical structures. [00641 FIGS. 9A-9E illustrate various images of a porcine esophagus in vivo obtained using comprehensive microscopy and the exemplary embodiments of the methods and arrangements of the present invention. These exemplary images can be 20 generated by a computer 460 (e.g., personal computer, mini computer, etc.) shown in FIG. 4 or another processing arrangement which may be configured (e.g., by software) to forward such images to a display 470 of FIG. 4 or another output arrangement. In addition, the computer 460 can control various component of the exemplary system of FIG. 4 (e.g., motor 435, line translator 445, focusing apparatus 415, etc.) to focus on 25 various areas of anatomical structures automatically and/or under a manual control which would enable the navigation, analysis and display of the large microscopic datasets associated with the anatomical structures. [00651 For example, FIG. 9A shows front and elevation side views 900, 905, respectively, of microscopic images of a porcine esophagus in vivo which provides a 15 vascular network within the submucosa without image enhancement or exogenous contrast agents using such exemplary embodiment of the method and arrangement. Indeed, e.g., 14 GB volumetric data set of FIG. 9A can be rendered and downsampled for a presentation in arbitrary orientations and perspectives. The vascular network within the 5 submucosa is shown without such image enhancement or exogenous contrast agents. Cross-sectional images can be located on the volume image for higher resolution viewing using the computer 460 configured for such exemplary task(s) and other components of the system of FIG. 4. 100661 FIG. 9B shows a side view 910 of the microscopic image of a longitudinal 10 cross-section through a wall of the esophageal at a location illustrated in FIG. 9A. For example, this image 910 is inverted with epithelium at the top; dimensions: 45 mm horizontal, 2.6 mm vertical. In the raw data, a periodic vertical offset corresponding to the motion of the beating heart can be observed. An exemplary embodiment of a surface aligning procedure can be used to reduce this artifact but a residual vertical banding, that 15 may still be observed with a period of 300 microns corresponding to a heart rate of 90 beats/min. The exemplary longitudinal pitch between adjacent A-lines is shown as 32 pim. 100671 FIG. 9C shows a side view 920 of an unwrapped transverse section (e.g., cylindrical coordinates r & 0 are mapped to vertical and horizontal) at the location 20 illustrated in FIG. 9A. For example, the exemplary dimensions of the illustration are as follows: 57 min - horizontal, 2.6 mm - vertical. Both FIGS. 9B and 9C illustrate the imaging through the entire esophageal wall, and can enable an identification of the squamous epithelium (e), lamina propria (lp), muscularis mucosa (mm), submucosa (s), and muscularis propria (mp). FIG. 9D shows a side view 930 of an expanded view of a 25 selected section of the image illustrated in FIG. 9C which can be used to assist with such identification. FIG. 9E shows an exemplary image of a representative histology section (H&E stain) obtained from the anatomical region corresponding to the image illustrated in FIG. 9D. 16 100681 For example, FIG. 10 depicts a flow diagram describing an exemplary embodiment of a method or a procedure according to the present invention for analyzing and/or viewing the data set at progressively higher resolutions, which can be executed using the computer 460 shown in FIG. 4. Particularly, in step 1000, a microscopic 5 dataset, which can have a resolution of less than 10 tm, may be acquired over a large area of tissue or from a volume of tissue, or organ therein. The data can then be formatted (in step 1010) in a representation that may illustrate a low magnification or low power view of the entire data set or a portion of the data set. In step 1020, the user may view the data set, and using a computer interface, can select (a) a rectangular region, (b) a 10 point, (c) an arbitrary shaped region, and/or (d) a depth in which to visualize a higher magnification view. The new region can be viewed in step 1020, and the user can (a) select another region, (b) zoom in at a point, (c) zoom out, (d) translate the current view in three dimensions, and/or (e) change the depth location of viewing within the dataset. [00691 The entire exemplary process illustrated in FIG. 10 can be repeated until the 15 area or areas of interest can be identified for visualization. The user can select different images at any magnification or view to store for later inspection. Labeling of each individual view can also be conducted during the exemplary navigation procedure. Various regions/images at different magnifications/locations can be bookmarked so that the user can return to the same region/image during a subsequent navigation session. 20 FIGS. 6A-6E, 7 and 9A-9E illustrate examples of the progressive magnification while viewing a large area microscopic dataset. [00701 The exemplary embodiment of the navigation procedure described herein can be implemented by the computer 460, and also utilize various processing techniques to assist the user in determining various areas to magnify and view the sample, and different 25 portions and regions thereof. For example, FIG. 11 depicts a series of exemplary images of esophageal mucosa obtained using optical coherence tomography ("OCT") techniques, demonstrating an implementation of an exemplary embodiment of an automatic processing procedure for identifying nonnal or benign squamous mucosa as compared to Barrett's esophagus and adenocarcinoima via an analysis of OCT image spatial 30 frequencies. 17 [00711 As shown in FIG. 11, OCT images 1100, 1110, and 1120 and spatial frequency distributions 1105, 1115, and 1125 of different disease states are shown. Squamous epithelium 1100 (SE) has vertical spatial frequencies (see arrows 1007 in panel 1105), corresponding to horizontal layers that may not be present in SIM. A widely 5 varying spatial frequency distribution are shown in the exemplary OCT images of adenocarcinoma (CA) 1120 and its corresponding spatial frequencies 1125 compared with SIMND 1110 and 1115. FIG 12 depicts an illustration of a macrophage content 1210 obtained from OCT images of atherosclerotic plaques 1200 by determining the nonnalized standard deviation parameter (NSD). The density of macrophages can be 10 obtained and displayed as an image using a color table 1220. [00721 These and other exemplary image processing analysis procedures and steps can be applied to the microscopic data set and utilized to highlight regions of potential disease for subsequent directed navigation. FIG. 13 depicts a flow diagram of an exemplary embodiment of the method and procedure according to the present invention 15 for navigating and evaluating the microscopic image data set. In this exemplary method/procedure, a microscopic dataset can be obtained in step 1300, which preferably has a resolution of less than 10 pim, possibly acquired over a large area of tissue or from a volume of tissue or organ therein. The data' is then processed automatically by a processing arrangement (e.g., using the computer 460) in step 1310 to identify 20 regions/locations that either contain areas suspect for disease or conversely areas that are suspected to contain no disease (i.e., healthy portions). In step 1320, the unhealthy areas can be represented using a color or other marking method, and then viewed at low magnification of the entire microscopic data volume in step 1330. 100731 The user can then select a region to view in step 1340, guided by the 25 processing data and the representation thereof. The user may then view the data set and, using a computer interface, select (a) a rectangular region, (a) a point, (c) an arbitrary shaped region, and/or (d) a depth in which to visualize a higher magnification view. The new region can be viewed, and the user (or the computer 460) can manually or automatically (a) select another region, (b) zoom in at a point/zoom out (step 1350), (d) 30 translate the current view in three dimensions, and/or (e) change the depth location of 18 viewing within the dataset. Further; in step 1360, the user can view the newly illustrated region. The exemplary method/procedure may be repeated until the area(s) of interest is/are identified for visualization. The user or the computer 460 can select different images at any magnification or view to store for later inspection. Labeling of each 5 individual view can also be conducted during the exemplary navigation process. The regions/images at different magnifications/locations can be bookmarked and stored so that the user can return to the same region/image during a subsequent navigation session. [0074] The foregoing merely illustrates the principles of the invention. Various modifications and alterations to the described embodiments will be apparent to those 10 skilled in the art in view of the teachings herein. Indeed, the arrangements, systems and methods according to the exemplary embodiments of the present invention can be used with any OCT system, OFDI system, SD-OCT system or other imaging systems, and for example with those described in International Patent Application PCT/US2004/029148, filed September 8, 2004, U.S. Patent Application No. 11/266,779, filed November 2, 15 2005, and U.S. Patent Application No. 10/501,276, filed July 9, 2004, the disclosures of which are incorporated by reference herein in their entireties. It will thus be appreciated that those skilled in the art will be able to devise numerous systems, arrangements and methods which, although not explicitly shown or described herein, embody the principles of the invention and are thus within the spirit and scope of the present invention. In 20 addition, to the extent that the prior art knowledge has not been explicitly incorporated by reference herein above, it is explicitly being incorporated herein in its entirety. All publications referenced herein above are incorporated herein by reference in their entireties. 19

Claims (29)

1. An apparatus comprising: at least one first arrangement configured to forward an electromagnetic radiation to an anatomical structure, and continuously scan an entire region of at least one portion of the 5 anatomical structure using the electromagnetic radiation to generate at least one signal, wherein the entire region has an area that is greater than 1mm 2 ; and at least one second arrangement configured to review the signal and to generate at least one image based on the signal that has a transverse resolution that is better than 10pm. 0
2. The apparatus according to claim 1, wherein the entire region is a volume of the structure.
3. The apparatus according to claim 1, wherein the at least one image is contiguous without substantial gaps therein. 5
4. The apparatus according to claim 1, wherein the at least one portion is provided on a surface of the anatomical structure.
5. The apparatus according to claim, wherein the at least one portion is provided 20 below a surface of the anatomical structure.
6. The apparatus according to claim 1, wherein the electromagnetic radiation comprises a plurality of wavelengths. 5
7. The apparatus according to claim 1, wherein the electromagnetic radiation comprises one or more wavelengths that vary over time.
8. The apparatus according to claim 1, wherein at least one of the at least one first arrangement or the at least one second arrangement includes a microscope arrangement, and 20 where the microscope arrangement, and where the microscope arrangement is at least one of a multiphoton microscope arrangement or a confocal microscope arrangement.
9. The apparatus according to claim 8, wherein the microscope arrangement includes a 5 spectral encoding arrangement.
10. The apparatus according to claim 1, wherein the at least one anatomical structure is an internal organ. 0
11. The apparatus according to claim 1, wherein at least one of the at least one first arrangement forwards the electromagnetic radiation via an optical fiber arrangement, or at least one second arrangement receives the signal via an optical fiber arrangement.
12. The apparatus according to claim 11, wherein the optical fiber arrangement 5 includes a plurality of electromagnetic radiation guiding arrangements.
13. The apparatus according to claim 1, wherein the signal is associated with at least one portion of an intensity of the electromagnetic radiation received from the anatomical structure. ?0
14. The apparatus according to claim 1, wherein the at least one first arrangement is provided in a probe.
15. The apparatus according to claim 1, wherein the first arrangement includes at least 5 one optical component which is configured to compensate for at least one optical aberration.
16. The apparatus according to claim 15, wherein the at least one optical component comprises a curved surface. 21
17. The apparatus according to claim 16, wherein the at least one optical aberration is an astigmatism.
18. The apparatus of claim 1, further comprising a positioning arrangement configured 5 to position at least one of the at least one first arrangement or the at least one second arrangement at a particular location relative to the anatomical structure.
19. The apparatus according to claim 1, wherein the at least one first arrangement is further configured to position a focus of the electromagnetic radiation at a plurality of depths 0 within the anatomical structure.
20. The apparatus according to claim 1, further comprising at least one third arrangement configured to: generate a further signal; 5 determine at least one location of a particular section associated with the anatomical structure based on the further signal; and control at least one of a motion or a position of a focus of the at least one electromagnetic radiation to a further location within the anatomical structure based on the further signal. 0
21. The apparatus according to claim 20, wherein the further signal is the signal.
22. The apparatus according to claim 21, wherein the further signal is at least one of an interferometric signal, a time-of-flight signal, or an intensity of the electromagnetic radiation. ?5
23. The apparatus according to claim 20, wherein the further signal is associated with at least one distance between at least one location within the region of the anatomical structure and at least one component of the at least one first arrangement. 22
24. The apparatus according to claim 1, further comprising: at least one third arrangement which is different from the first and second arrangements and configured to receive the signal and an additional signal from a reference to generate an interferometric signal. 5
25. The apparatus according to claim 1, further comprising at least one third arrangement configured to automatically control a position of a focus of the at least one first arrangement as a function of the signal to the predetermined location within the anatomical structure. 0
26. The apparatus according to claim 25, wherein the automatic control of the position of the focus by the at least one third arrangement is performed approximately parallel to an optical axis of the electromagnetic radiation that impinges on the anatomical structure. 5
27. The apparatus according to claim 25, wherein the predetermined location is determined based on an interferometric structure.
28. The apparatus according to claim 1, wherein the signal is at least one signal provided from the anatomical structure. -o
29. A method for imaging a region of an anatomical structure comprising: forwarding at least one electromagnetic radiation to an anatomical structure; continuously scanning an entire region of at least one portion of the anatomical structure using the electromagnetic radiation, wherein the entire region has an area that is greater 25 than 1 mm 2 ; obtaining at least one signal based on the electromagnetic radiation; and generating at least one image based on the signal, wherein the image has a transverse resolution that is better than 10tm. 0 23
AU2013204570A 2005-09-29 2013-04-12 Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions Ceased AU2013204570B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2013204570A AU2013204570B2 (en) 2005-09-29 2013-04-12 Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US60/721,802 2005-09-29
AU2006299659A AU2006299659A1 (en) 2005-09-29 2006-09-29 Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions
AU2013204570A AU2013204570B2 (en) 2005-09-29 2013-04-12 Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
AU2006299659A Division AU2006299659A1 (en) 2005-09-29 2006-09-29 Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions

Publications (2)

Publication Number Publication Date
AU2013204570A1 AU2013204570A1 (en) 2013-05-09
AU2013204570B2 true AU2013204570B2 (en) 2015-09-24

Family

ID=48239499

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2013204570A Ceased AU2013204570B2 (en) 2005-09-29 2013-04-12 Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions

Country Status (1)

Country Link
AU (1) AU2013204570B2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111353932B (en) * 2020-03-27 2023-04-25 浙江大华技术股份有限公司 Coordinate conversion method and device, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6191862B1 (en) * 1999-01-20 2001-02-20 Lightlab Imaging, Llc Methods and apparatus for high speed longitudinal scanning in imaging systems
WO2001027679A1 (en) * 1999-10-15 2001-04-19 Cellavision Ab Microscope and method for manufacturing a composite image with a high resolution
US6341036B1 (en) * 1998-02-26 2002-01-22 The General Hospital Corporation Confocal microscopy with multi-spectral encoding
US6450949B1 (en) * 2000-06-30 2002-09-17 Inner Vision Imaging, Inc. Endoscope

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6341036B1 (en) * 1998-02-26 2002-01-22 The General Hospital Corporation Confocal microscopy with multi-spectral encoding
US6191862B1 (en) * 1999-01-20 2001-02-20 Lightlab Imaging, Llc Methods and apparatus for high speed longitudinal scanning in imaging systems
WO2001027679A1 (en) * 1999-10-15 2001-04-19 Cellavision Ab Microscope and method for manufacturing a composite image with a high resolution
US6450949B1 (en) * 2000-06-30 2002-09-17 Inner Vision Imaging, Inc. Endoscope

Also Published As

Publication number Publication date
AU2013204570A1 (en) 2013-05-09

Similar Documents

Publication Publication Date Title
US20070121196A1 (en) Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions
Oh et al. Optical fibers for high-resolution in vivo microendoscopic fluorescence imaging
US9332942B2 (en) Systems, processes and computer-accessible medium for providing hybrid flourescence and optical coherence tomography imaging
US9557154B2 (en) Systems, devices, methods, apparatus and computer-accessible media for providing optical imaging of structures and compositions
Elson et al. Miniaturized side-viewing imaging probe for fluorescence lifetime imaging (FLIM): validation with fluorescence dyes, tissue structural proteins and tissue specimens
CN116134361A (en) System and method for microscopic analysis of a sample
AU2013204570B2 (en) Method and apparatus for method for viewing and analyzing of one or more biological samples with progressively increasing resolutions
Patel et al. High-speed, 3D SCAPE Microscopy of Fresh Tissues for in situ Histopathology
Sung Fiber optic confocal reflectance microscopy: in vivo detection of pre-cancerous lesions in epithelial tissue
Luck et al. Confocal microscopy [detecting and diagnosing cancers]

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)
MK14 Patent ceased section 143(a) (annual fees not paid) or expired