EP1101083A1 - Topographie spectrale de matiere d'origine mammalienne - Google Patents

Topographie spectrale de matiere d'origine mammalienne

Info

Publication number
EP1101083A1
EP1101083A1 EP99937539A EP99937539A EP1101083A1 EP 1101083 A1 EP1101083 A1 EP 1101083A1 EP 99937539 A EP99937539 A EP 99937539A EP 99937539 A EP99937539 A EP 99937539A EP 1101083 A1 EP1101083 A1 EP 1101083A1
Authority
EP
European Patent Office
Prior art keywords
image
matter
specimen
slice
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP99937539A
Other languages
German (de)
English (en)
Inventor
Sandor G. Vari
Jeremy M. Lerner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cedars Sinai Medical Center
Original Assignee
Cedars Sinai Medical Center
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cedars Sinai Medical Center filed Critical Cedars Sinai Medical Center
Publication of EP1101083A1 publication Critical patent/EP1101083A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum
    • G01J3/2823—Imaging spectrometer

Definitions

  • This invention relates to clinical pathology and more particularly to systems and methods that assist in the automatic analysis and diagnosis of diseased cells and tissue.
  • Tissue biopsies are often sliced into very thin sections and stained using one of, or a combination of, well-known staining techniques, such as H and E (hematoxylin & eosin) staining.
  • H and E hematoxylin & eosin staining techniques
  • Cell smears are similarly stained. Areas of abnormality are visually compared with representations of known disorders to determine whether and what disorders are presented.
  • the fluorescent microscope is another diagnostic tool often used by pathologists. Instead of passing incandescent, "white” light through the specimen, the illuminating "high energy excitation” light, from a source such as a Xenon or mercury lamp, is passed through one or more filter sets that passes only certain wavelengths of light onto (not through) the specimen. In response to the light incident upon it, the specimen, usually, but not necessarily, stained, then variously fluoresces, or produces lower-energy emissions of measurable wavelengths (colors) and intensities, thus providing diagnostically valuable information about the tissue or cells.
  • a source such as a Xenon or mercury lamp
  • Fluorescent microscopy techniques can be classified into two categories, namely, those that involve endogenous (or natural) fluorophores, or reactions, and those that are exogenous (originating from outside the specimen).
  • the former includes two types of reactions, namely, autofluorescence. whereby tissue compounds, such as elastin and collagen, naturally fluoresce without any augmentation from outside the specimen, and immunofluorescence. whereby naturally fiuorescing antibodies locate antigen in the tissues by combining with the specific antigen for that antibody (antigen-antibody reaction) and naturally fluoresce upon such combination.
  • the latter implies fluorescent tagging, or labeling, of a cell.
  • a molecule such as a peptide, protein or antigen, that attaches to a highly specific target is "tagged" with a fluorophore such as fluorscein in order to detect whether there is a positive interaction.
  • a fluorescein conjugated monoclonal antibody is used to identify a specific antigen. This technique is often used to assist in the identification and diagnosis of nuclear-based diseases, such as viruses, but may also be used to identify bacterium and malignant tissue, for example.
  • FISH fluorescent in situ hybridization
  • CCD charge- coupled device
  • A-D analog-to-digital
  • Neural networking which is a non-linear, system that sorts out patterns from the data with which it is presented and learns from discerning and extracting the mathmenatical relationships that underlie the data, is one such processing structure.
  • neural network systems compare specimen data collected by a CCD array to learned patterns of data representative of healthy and diseased tissue and cells in order to automatically characterize and assess the specimen for particular disorders. 3. Spectroscopy
  • Spectroscopy is the study of the spectral characteristics of objects, and more particularly, the study of the component parts (individual wavelengths) of the light of objects and the intensity of those wavelengths. It has long been used as a tool in the field of chemistry for identifying elements since each element possesses it own unique spectra. Since it was first realized that it can provide detailed information about both the chemical and physical nature of matter, spectroscopy has shown great promise for the field of medical diagnostics as well. For example, it has been demonstrated that certain spectral characteristics, such as fluorescence, indicate the presence of a malignancy or the metabolic condition of tissue. This information can be correlated to the object's location in the target field of view.
  • the conventional fluorescent microscope uses one filter to block all but a single wavelength of light to excite the specimen, and another filter that permits only the reemited light (and blocks the higher energy excitation light) to pass to the optical output. Since the specimen is usually stained with a fluorophore that fluoresces at a single wavelength in the spectrum, this method provides useful diagnostic information about the specimen at this single wavelength only.
  • the entire image In order to gather more, and more meaningful, information about the specimen, the entire image must be captured again at a second wavelength through a second set of filters. This process is repeated many times until the desired number of spectral frames collectively obtain the "spectral envelope" of the object.
  • Each frame is stored in a computer and the composite image can analyzed by the processing software described above and/or displayed on a display. This is known as multispectral imaging ("MSI").
  • the present invention addresses these need by providing a system and method that automatically assesses mammalian matter, notably one or more cells or tissue, for evidence of acute disease via multispectral acquisition of images of the matter.
  • the system has three primary components, namely, an image transmitter, a unique multispectral imaging spectroscopy subsystem and a processor.
  • the image transmitter includes a source of light that illuminates the matter and an optical output, and is adapted to transmit an image of a section of the matter to the optical output.
  • the multispectral imaging spectroscopy subsystem is connected to the optical output and substantially, simultaneously spectrally disperses the transmitted image into multiple component wavelengths to create a spectral image.
  • the processor then processes the spectral image to provide diagnostic data representative of the image.
  • This system provides the advantages of obtaining, in a single acquisition, a complete multispectral image of, not just a single point, but a substantial section of the matter, while eliminating the need for sequential filtering.
  • the multispectral imaging spectroscopy subsystem includes an imaging spectrograph and a charged coupled device (CCD) camera.
  • the spectrograph has an entrance slit that permits the passage of light from a slice of the transmitted image of the section of the matter and a spectrum dispersing prism and mirror arrangement that disperses the light passed through the entrance slit into multiple component wavelengths of a predetermined spectral range to create a spectral image.
  • the charge-coupled-device (CCD) camera is coupled to the spectrograph to acquire, and prepare the spectral image.
  • the preparation of the acquired image typically entails two steps, namely, digitizing the image and pre-processing the digitized image with appropriate digital signal processing algorithms, as is well known in the art of image processing.
  • the processor resides in a computer subsystem that processes the digitized spectral image and provides diagnostic data representative of the slice of the image.
  • This system provides several important advantages.
  • the spectrograph of this invention is a low cost device that eliminates the time intensive sequential capture of multiple wavelengths of a given portion of a specimen in favor of capturing the entire spectrum simultaneously. This enables rapid data processing which contributes to the system real-time diagnosis capability.
  • the spectrograph together with the digital camera and the computer data processing, provides an extremely simple, efficient and low cost tool for diagnosis of any suspect matter whose image can be transmitted to the spectrograph. Further, the entire system is a fraction of the cost of other MSI systems, such as the interferometer.
  • the image transmitter is a lens-based image magnification system or telescope, broadly defined as any of various magnifying optical instruments.
  • the present also provides a low cost, efficient system that automatically assesses the pathology of prepared cytopathology and histopathology specimens via multispectral acquisition of images of those specimens whose images are illuminated, magnified and transmitted to the optical output via a microscope.
  • the optical output of the microscope may also include a standard camera interface, such as a "C-mount" connection for rapidly connecting and disconnecting the imaging spectrograph thereto.
  • the microscope includes an automatic x-y stage capable of controllably translating the slide for sequential MSI acquisition of the entire specimen.
  • the computer-controlled x-y stage automatically sequences, or moves, the specimen so that the image of an adjacent slice of the specimen can pass the image-acquiring, entrance slit for spectral dispersion and acquisition of that slice. This process repeats until the entire sample, or as much as is desired, has been acquired and investigated.
  • a second CCD camera is provided in order to capture video images of the magnified sections of the specimen from the microscope and to provide the image for display and/or further processing.
  • a beam directing assembly may be disposed between the microscope and the spectrograph in order to alternatively direct the magnified optical output to either the first CCD camera or the second CCD camera.
  • the system is capable of providing the pathologist with two diagnostic tools in one, one being traditional video imaging and the other being spectral topography data, the latter provided in the form of graphical display, called spectral graphs, tabular form, an actual diagnosis printout, prognosis or suggestions (after such data is operated on by the neural network) and/or a combination of all of the above.
  • a beam splitter cube may be disposed between the microscope and the spectrograph in order to simultaneously direct the optical output from the microscope to both the spectrograph and the second CCD camera.
  • the area of the sample submitted to the 5 mm long entrance slit is approximately 1.25 ⁇ m wide by 125 ⁇ m long.
  • the spectrograph is capable of acquiring spectral data at approximately each 0.5 ⁇ m along the slice. Each such 0.5 ⁇ m by 1.25 ⁇ m wide section is called an "object.” With the specific design of the preferred spectrograph and CCD array capacity, a maximum of 240 objects can be captured simultaneously from each slice of the target sample.
  • each spectrum for each object contains up to a maximum of 740 wavelength data points in the 380 nm to 800 nm range, with a spectral resolution of lnm at the 400nm wavelength to approximately 15 nm at 700 nm.
  • the neural network algorithm may alternatively comprise an unsupervised neural network (USNN), a supervised neural network (SNN), or a combination of the two.
  • USNN operates to automatically recognize and map (i.e. to train for) the presence of "fingerprint" spectra.
  • the SNN may be implemented to act to automate the system and perform routine autocalibration.
  • One preferred method of spectrally analyzing matter for the presence of disease based upon a spectral analysis of the morphologic and physiologic deviation of the matter from the norm includes illuminating the matter with a light source, transmitting an image of the matter to a multispectral imaging spectrograph, spectrally dispersing the transmitted image through a prism and mirror arrangement into multiple component wavelengths of a predetermined spectral range, acquiring the spectrally dispersed image of the multiple component wavelengths, digitizing the acquired image and manipulating the digitized image, and processing the manipulated spectrally dispersed image to provide a diagnosis.
  • the image transmitter provides a source of filtered light to the matter and transmits an image of fluorescent light reemitted from a section of the matter to the optical outlet.
  • the matter comprises a prepared pathology sample and the image transmitter is a fluorescent microscope.
  • the present invention eliminates the need for multiple filters by acquiring the entire spectra of all fluorophores from a section of the fluorescing matter simultaneously.
  • a method of practicing this more specific embodiment entails illuminating the matter with filtered light of a specified wavelength to cause the matter to fluoresce, transmitting an image of a section of the fluorescing matter to an optical output, spectrally dispersing the transmitted image of the slice into multiple component wavelengths of a predetermined spectral range, acquiring and preparing the spectrally dispersed image and processing data representative of the image with a processor to classify the slice of the image into one of a preset number of categories indicative of the condition of the slice of the image.
  • the system and method of the present invention is effective in evaluating diseases through the analysis of the fluorescent features of mammalian cells and tissue that fluoresce either via endogenous or exogenous reaction.
  • the former also referred to as natural fluorescence, includes biological matter having an autofluorescing component, such as the elastin compound found in the aorta wall, arteries and other tissue.
  • the analysis of such matter using the present invention yields diagnostically valuable information without any fluorescent staining preparations.
  • the immunofluorescent method also falls into the endogenous category.
  • the matter is typically prepared with at least one immunoglobulin antibody labeled with a tag, such as fluorescein. and is useful for the analysis of the kidney and heart, for example.
  • the matter, or specimen may be treated with at least one fluorochrome. More particularly, the specimen may be treated with a histochemical probe labeled with a fluorochrome. Even more particularly, a fluorescent in situ hybridization ("FISH assay") is performed on the specimen and the processor provides data indicative of the presence of at least one strain of one of a genetic disorder, malignancy, bacteria and virus, such as the Human Papilloma Virus (HPV).
  • the specimen may be prepared with an immunohistochemical stain having immunohistological markers, including one of monoclonal and polyclonal antibodies conjugated to a fluorescent tag.
  • DIF direct immunofluorescent assay
  • CT chlamydia trachomatis
  • the system is capable of simultaneously quantifying a specimen treated with multiple probes labeled with different fluorochromes, immunohistochemical markers or a combination of all of the above, in order to diagnose the condition that each stain or fiuorophore probe, individually, is designed to isolate.
  • the present invention can provide a significant advance in the field of cervical cytology by providing a tool that automatically assesses a Pap smear or cervical biopsy for both various HPV strains and CT bacteria.
  • a Pap smear specimen may be prepared using a both a FISH assay for HPV identification and with a direct immunofluorescent (DIF) stain directed to detect CT.
  • DIF direct immunofluorescent
  • a smear may be tagged with well-known fluorescent stains, such as rhodamine/auramine to produce a fluorescent reaction that can be exploited by the present invention for the identification of several diseases, such as tuberculosis.
  • FIG. 1 A is basic schematic showing the automated multispectral topography system of the present invention wherein light transilluminates through a mammalian matter, such as tissue or cells;
  • FIG. IB is a variant of the image transmitter of FIG. 1 A. wherein the light incident on the matter is either reflected off of the matter or is absorbed by the matter which reemits light of a lower energy (i.e. fluoresces);
  • FIG. 2 is a schematic of a more detailed embodiment of the present invention wherein the matter is prepared on a slide and the image transmitter is a fluorescent microscope;
  • FIG. 2A depicts the matter prepared on the slide shown in FIG. 2 in greater detail
  • FIG. 3 is a flow chart describing one preferred method of the present invention
  • FIG. 4 is an observed video image of a section of a fluorescing, TB-positive, sputum sample stained with auramine/rhodamine, with a slice of the section bounded by a rectangle;
  • FIG. 5 is a false color representation of the spectra present in the slice shown in FIG. 4;
  • FIG. 6 is a more refined version of the spectral image of FIG. 5, after profiling with an unsupervised neural network;
  • FIG. 7 is a graph of 25 spectra representing the spectral fingerprint of the 25 channels of the section of the image shown in FIGS. 5 and 6;
  • FIG. 8 is a chart showing the unsupervised neural network presentation of the analysis of, in the two left columns, the calibration smear shown in FIGS. 4-7, and, in the right two columns, a patient sample;
  • FIG. 9 is a graph showing spectral curves of autofluorescing specimens, one being a portion of a healthy aorta wall and the other a degenerated aorta wall;
  • FIG. 10 is a graph showing the spectral curves of diseased native and transplanted kidneys
  • FIG. 11 is a graph showing the spectral curves of three slices of an immunofluorescing kidney sample, each stained for IgA, IgG and IgM, respectively;
  • FIG. 12 is a graph showing the spectral curves of sections of two heart biopsies whereby no rejection is recorded for either section.
  • the invention may also be applied to other types of mammalian matter, such as that which is not suspected to be diseased, but identification of its morphological and physiological characteristics is nonetheless desirable.
  • the matter is illuminated with a source of light, with one specific source providing filtered light to enable analysis of the fluorescent characteristics of the matter.
  • the present invention is employed to reveal the hidden morphologies of suspect cell and tissues, whether in vivo or prepared specimens, by illuminating them with a light source, and analyzing their spectral content with the aid of a unique multispectral imaging spectrograph and sophisticated processing algorithms.
  • the system acquires a small slice of the field and passes it through a specialized wavelength dispersive spectrograph that acquires the entire spectrum of the slice simultaneously. To cover the entire field it is necessary to move on to the next, adjacent slice. Concatenating each acquisition enables the entire field to be covered.
  • This method is often referred to as "push broom" spectral topography because the sample is "pushed" across the spectrograph entrance aperture, or slit, and is, in numerous ways, more versatile and efficient than the prior described method of multispectral imaging acquisition.
  • the present invention uses push broom multispectral image acquisition of suspect mammalian tissue and cells to reveal, in the case of specimens prepared on slides, their hidden morphologies and, in the case of in vivo analysis, their hidden physiologies, and to ultimately provide clinical diagnosis of the tissue and cells.
  • FIG. 1 A is a block diagram showing the basic components of the system.
  • An image transmitter 1 includes a light source 2 and an optical output 3.
  • the light source 2 illuminates the mammalian matter 4 to be analyzed, whose image is transmitted to the optical output 3.
  • An imaging spectroscopy subsystem 6 substantially simultaneously spectrally disperses the transmitted image into multiple component wavelengths of a given range.
  • This method of spectral dispersion uses a spectrograph originally designed for remote, telescopic earth monitoring and astronomy and is currently in use for both applications in military and civilian environments. The original spectrograph was patented to Warren et al. (patent no.
  • a processor 8 such as a PC computer loaded with the appropriate software, operates on data representative of the spectrally dispersed image to ultimately provide a diagnostic output 8 relating to the condition of the matter 4.
  • This diagnostic output 10 could be provided at a computer screen, at a printout, or at any conventional output device.
  • FIG. 1A depicts an image transmitter arrangement whereby the light source 2 transilluminates through the matter 4. This is typically the case when, for example, a transmission microscope is the image transmitter that provides white light for a relatively thin specimen, such as a cell smear, or a very thin tissue biopsy.
  • FIG. IB shows an alternative arrangement for the image transmitter 1 , which is representative of one of two optical scenarios. In one scenario, the light from the source 2 is reflected off of the matter 4 and to the optical output 3. Reflection could be used in several situations, one being where the suspect tissue biopsy is too thick for the light to meaningfully transilluminate therethrough, and another being where the matter to be analyzed is not removed from the patient, but is rather in vivo. In the second scenario represented by FIG.
  • the light from the source is filtered, and this filtered light 2 is absorbed by the matter 4.
  • the tissue or cells reemit light of a lower energy level.
  • This fluorescent light is provided to the multispectral imaging spectroscopy subsystem for dispersion and analysis.
  • FIG. 2 is a schematic of a more detailed embodiment of the present invention wherein the image transmitter is a fluorescent microscope.
  • the primary components of this multispectral topography system 12 include a fluorescent microscope 40, a prism and mirror imaging spectrograph 30, a first CCD camera 34, a processor 70 and a diagnostic output device 80.
  • the fluorescent microscope 40 found in many laboratories and research facilities, has an eyepiece 41 and an optical output 42 having a standard camera interface, such as a video port with a "C-type" mount.
  • the light source 43 of the microscope is filtered by internal filters and is absorbed by a specimen 18 which has been prepared on a slide 16.
  • the specimen then reemits light of a lower energy level and of varying intensities across the specimen, and lenses magnify the image of a section of the fluorescing specimen 18 and supply such image to the both the eyepiece 41 and optical output 42.
  • the specimen is typically prepared using conventional dyes and/or labeled with conventional tags, using conventional techniques, but need not be.
  • a spectroscopy subsystem connected to the microscope 40 includes the prism and mirror, wavelength dispersive imaging spectrograph 30 having an entrance slit 32.
  • the slit permits the image of a slice 20, as seen in greater detail in FIG. 2A, of the specimen 18, the slice itself comprising many "objects" 21, to pass therethrough and into the spectrograph 30, and a first CCD camera 34.
  • the novel and modified spectrograph 30 provides good image quality over a broad range of operating wavelengths simultaneously, allowing large spectral intervals to be surveyed without moving any of the elements of the system.
  • a beam directing assembly 60 also called a "beam splitter," constructed with a
  • the "flip" mirror 62 provides both a video image and spectral acquisition.
  • the spectrally dispersed light is focused on, and acquired by, the first CCD matrix array 36 of the camera 34.
  • the analog image is then prepared for viewing and further processing.
  • the image is digitized by an analog-to-digital (A to D) converter and is then manipulated, or pre-processed, by the spectral image pre-processor 37, often called a digital signal processor (DSP).
  • DSP digital signal processor
  • the prepared spectral image can then be fed into the processor 70, as discussed in detail below, and/or displayed on a display 38 such as a CRT, LCD screen, or other conventional display.
  • the visual, microscopically magnified image i.e. a video image
  • the matrix array 56 of the second CCD camera 54 This image is also digitized by an A-to-D converter and advanced image processing algorithms 57 (another DSP) manipulate the image for high quality display on a conventional display 58.
  • DSP digital signal processor
  • Conventional image pre-processing algorithms in DSP's include smoothing, normalization, background substraction, principal component analysis (PCA) and partial least squares (PLS). In this way, both spectral imaging data and visual imaging data of the specimen can be displayed for the pathologist, stored, analyzed and/or further manipulated.
  • a beam splitter cube replaces the beam directing assembly 60 to send light simultaneously to the spectrograph 30 and the observed-image CCD camera 54.
  • the spectrograph 30 uses a prism made of inexpensive flint glass.
  • the support and body of the unit may be in either cast aluminum, or ribbed metal plate, or any other material that provides for lightweight and for enhanced rigidity.
  • the optical system is fully ray-traced.
  • the system, with or without the beam director 62 is easily assembled to the optical output of a conventional microscope, typically a video port, with the use of a standard "C-type *" mounting or any other acceptable connecting means.
  • each slice 20 captured through the slit 32 and by the spectrograph 30 is approximately 1.25 ⁇ m wide by 125 ⁇ m long. Further, the system is capable of acquiring spectral data at approximately each 0.5 ⁇ m along the slice 20. Each 0.5 ⁇ m by 1.25 ⁇ m wide section is called an "object" 21. With the specific design of the preferred spectrograph and CCD array capacity, a maximum of 240 objects can be captured simultaneously from each slice of the target sample.
  • each spectrum for each object contains up to a maximum of 740 wavelength data points in the 380 nm to 800 nm range, with a spectral resolution of lnm at the 400nm wavelength to approximately 15 nm at 700 nm. It is understood, however, that other slit sizes and CCD cameras having other resolution capacities may be used, resulting in different (and greater) object and spectral envelope resolutions.
  • Sequentially scanning the entire image of the specimen 18 is achieved by scanning the microscope stage under computer control in the histology or cytopathology setting.
  • the first CCD matrix array detector 36 collects individual spectra along rows of pixels from objects located in the entrance slit 32. This format is sometimes referred to as an "open image" because there are no restrictions on the area of the object to be examined and is certainly the least expensive and most flexible method for pathology samples subject to microscopic examination. All spectra of all objects in a slice are acquired simultaneously in milliseconds, depending on signal strength. Photo-bleaching is reduced especially if objects such as single cells or glomeruli are selected by automated pattern recognition and correlated with signal strength at certain wavelengths.
  • the processor 70 which will typically be part of a computer system, such as a PC, contains a powerful neural network 72 that provides near instantaneous recognition of the spectral fingerprints of the objects 21 of the specimen 18.
  • a powerful neural network 72 that provides near instantaneous recognition of the spectral fingerprints of the objects 21 of the specimen 18.
  • the relatively small file size for each acquisition greatly enhances computation speed and simplifies memory management.
  • FIG. 3 illustrates how the push-broom methodology is applied to the present invention for multispectral analysis mammalian matter.
  • step 100 an image of the matter, whether prepared on a slide or in vivo, transmitted to the optical output.
  • the image can be transmitted via any known means, such as transillumination through or reflection off the matter, or fluorescing from the matters.
  • microscopy transmission or fluorescent
  • a particular field, or section, of a magnified specimen is presented to the entrance slit 32 of the spectrograph 30.
  • step 102 a single slice 20 of the section, containing up to 100 objects 21, passes through the slit 32 and, in step 104, strikes the first curved surface of the prism, is refracted, strikes the second surface, and exits to strike the spherical mirror as is described in the Warren et al. patent.
  • the wavelength dispersed light then returns through the prism to be focused and stored onto a first CCD matrix array, step 106, which acquires and prepares the light.
  • the preparation may entail digitizing and pre-processing the spectrally dispersed light, but not necessarily.
  • the preprocessing, or manipulation, of the digital image is accomplished with conventional DSP algorithms to improve its appearance. Over 80% to 90% of all light, over the entire wavelength range, is transmitted through the system.
  • the processor then processes the spectral data representing the spectral envelopes of each object in the slice, step 108, using the neural network that sorts out the morphological patterns in the objects of the cell(s).
  • the system then inquires into the status of the acquisitions, step 110. If only a single acquisition is needed or desired, the process halts in step 112 and the diagnostic data may be output for review by the pathologist. However, if as is usually the case, an additional slice of the specimen is to be spectrally dispersed and analyzed, i.e. the answer to inquiry 110 is "no," and an adjacent slice of the image is transmitted through entrance slit, step 114.
  • the specimen slide is moved by the x-y stage of the microscope 40 to permit the passage of light representing a slice adjacent to the previously dispersed slice. Then, the process reverts to step 104 for spectral dispersal, acquisition and analysis of the objects in that second slice. This process is repeated until the entire or enough of the specimen is analyzed in this fashion. Once this sequential acquisition process is complete and the spectral data for each object is stored in the appropriate memory "bins," as described below, the processor may then synthesize this data to produce a complete diagnosis for the specimen.
  • a full acquisition according one preferred embodiment of the present invention includes 240 spectra, each with 740 data points, yet is only 185KB. A file of this size is easily handled, resulting in very rapid data processing and decision making. Further, the entire system costs much less than other methods of analysis, such as the interferometer. This method also enables fast low-resolution assessments to determine gross parameters prior to high-resolution scans.
  • the system can "paint" the video image of the specimen with false color "fingerprint” spectra indicative of normal and diseased tissue.
  • the system also differentiates between chronic and acute disease as well as evidence of anti-rejection drug toxicity.
  • the neural network (NN) 72 performs calculations in parallel, in an analogous way to the human brain, to perform non-linear transformations.
  • the system has been powered by an unsupervised neural network (USNN).
  • USNN unsupervised neural network
  • SNN supervised neural network
  • the USNN collects each spectrum from each object, characterizes it, sorts it, and places it into a "bin" of unique spectral signatures. It can thus be employed to automatically recognize and map (i.e. to train for) the presence of "fingerprint" spectra, i.e., to identify bins containing identical spectral signatures.
  • the SNN may then be used to determine the special features that differentiate the spectra in each bin from those in other bins.
  • the system can then compare the presenting spectra of the objects of the matter under analysis with the map to identify the presence of the disorder.
  • the USNN can be thought of as a "filter” or “sieve” that characterizes and sorts each spectrum as it is collected and places it into its morphological bin or "class” of similar spectral signatures.
  • the process is analogous to alphabetizing the words in a book by combining those that are the same or have a common root. By the end of this procedure, the number of bins represents the number of spectral objects defined by their spectral- morphological characteristics.
  • the process is referred to as "digital chromatography” because the function is almost identical to the process used in analytical chemistry for the separation of mixtures of chemical compounds.
  • the big difference is that the USNN program adds the extra dimension of providing spatial information by mapping a particular class of spectrum back to the sample itself.
  • the operator can decide to combine some spectral classes, such as background features, or eliminate others. This is achieved by "thresholding” either by the user or the computer. This is a process that enables the USNN to delineate, identify and separate identical and non-identical spectra within user defined limits of the application.
  • the incorporation of human "wet neurons" to set up the thresholds enables human experience to control the operating limits of the software.
  • the USNN becomes a "white box " ' rather than a "black box” because the sensitivity and the operating parameters of the network are available to operator influence at all times.
  • the USNN compares each newly acquired spectrum against the spectral classes and categories it recognizes.
  • the USNN identifies matches, near matches, and no match spectra in the new acquisition(s).
  • Each class of spectrum is coded into a few bytes of data and stored in memory. Every future spectral acquisition is similarly coded and compared to the stored data. This process reduces a spectrum of 740 data points to a block of memory only a few bytes in size, consequently recognition of hundreds of spectra is performed in near real-time. Training can take up to two minutes for complex materials and a few seconds for simple spectra. After training, recognition is within a second.
  • the processor 70 may also incorporate a Supervised Neural Net (SNN) that works in conjunction with the USNN.
  • SNN Supervised Neural Net
  • the SNN would identify the special features of each bin, automates the system and performs routine autocalibration.
  • Past experience has shown that combining these two neural net architectures is very effective for controlling many variables, some or all of which can change with time. Most humans tend to overlook or "accommodate" certain changes. In a multi-parametric system, such as cellular pathology, this is very dangerous because a change in one variable can result in non-linear affects elsewhere in the process and compromise the accuracy of an assessment.
  • the two neural network systems could form a transparent alliance to automatically ensure that conditions necessary for accurate repeatable diagnoses are not compromised by changes in temperature, mechanical maladjustment or operator error.
  • One or, more likely, many systems of the invention may be trained and retrained by USNN's in order to spectrally characterize the morphologies of the cells of all presenting pathological disorders and diseases, thus creating a "library" of spectral fingerprints representative of those presenting conditions. It is expected that, eventually, the entire and finite universe of categories of pathological disorders will be spectrally characterized by USNN's. When this milestone is achieved, systems could then be equipped with SNN's which include databases containing the all pre-trained, spectral fingerprints of the various possible conditions.
  • the SNN When a specimen whose pathology is unknown is presented to the system of the present invention, the SNN will rapidly compare and map its spectral fingerprint with that of all fingerprints stored in the database or, in the appropriate category of the database. With the availability of powerful, fast and low cost personal computer systems with large amounts of memory capacity, a single personal computer system will be capable of storing the an entire "spectral library" thereby providing automatic diagnosis of the condition of any cellular or tissue specimen presented to it.
  • the system of the preferred embodiment is capable of providing several diagnostic outputs.
  • Figures 4, 5, 6, 7, and 8, discussed in greater detail below illustrate some of these outputs from analysis of mammalian matter, namely, a section of a sputum sample from a patient positive for tuberculosis, wherein the sample is stained with the chemical dye preparation, auramine/rhodamine.
  • the slide viewed under epi-fluorescence, enabled the system to provide spectral characterization and mapping of the fluorescing tuberculosis bacteria.
  • the neural network monitors intensity and when multiple spectra are presented (while not necessary for this example wherein only a single fluorophore and thus a single emitted wavelength is present) deconvolution requirements and paints back to a computer monitor the location on the sample of an identified and processed spectrum.
  • FIG.4 shows a grey scale video, or "observed,” image of a fluorescing and magnified section of the specimen on the video display 58.
  • the video display can be any conventional display, such as a CRT or LCD screen, or equivalent.
  • FIG. 5 shows the same image with a false color representation of the spectra present down the slice.
  • FIG. 6 is a more refined version of the spectral image of the slice identified in FIG. 5, but partitioned into "channels" after profiling with the USNN.
  • FIG. 7 is a graph of 25 spectra out of a possible 240. The y-axis represents the intensity, or magnitude, of the light emitted from the object of the slice of the specimen across its spectrum.
  • FIG. 8 shows how the USNN associated each spectrum of similar nature to an object. In particular, it is a chart representing the objects in a training set on the left half and on the right, objects of another sample.
  • the system via the neural network, is designed to provide an actual diagnosis of the condition presented by the matter under observation.
  • This diagnosis can be provided on any conventional output medium, such as on a display, in hard copy, stored to memory, transmitted to another computer system, or any combination of the above.
  • fluorescent techniques have been found very effective in the analysis of a variety of types of biological mammalian matter. Some techniques exploit the endogenous characteristics of the particular matter (i.e. natural fluorescence), including autofluorescence (such as in the aorta wall and arteries) and immunofluorescence (for example, for analysis of kidney and heart tissue). Other fluorescent techniques that are not endogenous include immunofluorescence using fluorescence-labeled, monoclonal or polyclonal antibodies (immunohistologic markers), in situ hybridization techniques, and standard dye methodologies.
  • mammalian matter as used in this section, includes any of the aforementioned types of matter prepared by any of these fluorescent techniques, and, in the case of matter that autofluoresces, may have no fluorescent preparation at all. In all of these cases, however, the analysis of such matter is greatly enhanced by the incorporation of the automated spectral topography system of the present invention. The remaining discussion details some specific applications of the present invention and the experiments conducted which verify its efficacy for diagnosis of pathological disorders. 1. Applied to Naturally Fluorescing Matter (Endogens)
  • Matter that is recognized to contain a substantial autofluorescence compound, such the elastin present in the aorta wall and arteries, or collagen present in other matter, may be analyzed by the present invention with no fluorescent staining to evaluate autofluorescent patterns of diseased and normal aortas and arteries and to yield basic, diagnostic information.
  • analysis of the natural fluorescence of cell and tissue matter from both native and transplanted organs, such as the kidney, heart and other organs, using an immunofluorescent staining technique, including fluoresceinated antisera to immunoglobulins, in order to diagnose both native diseases and rejection can also be greatly enhanced by the use of the multispectral imaging spectrometer system of the present invention, a.
  • FIG. 9 shows the spectral features of two samples of aorta walls, which possess autofluorescent elastin layers. The samples were examined under an epi-fluorescence microscope excited at 436 nm and exhibited strong blue-green fluorescence.
  • the spectral features provided by the spectroscopy subsystem of the present invention and shown in the figure clearly differentiate between a normal aorta wall (curve 1) and an aorta wall showing degeneration (curve 2).
  • the system of the present invention will be capable of analyzing and diagnosing any aorta wall sample of unknown diagnosis.
  • ESRD end stage renal disease
  • DS Duplex Doppler Sonography
  • renal parenchymal disease such as acute or chronic rejection, "de novo” or recurrent glomerular disease, immunosuppression nephrotoxicity, (mainly by cyclosporine A) that contribute to graft malfunction, can typically only be diagnosed by renal histopathologic study.
  • the system of the present invention was thus used to evaluate fluorescence patterns in organ specimens stained for immunoglobulins, complement components, and plasma proteins and was correlated with light microscopic and standard immunofluorescence findings and clinical data. It was found that spectral analysis of the following histopathological specimens using the system of the present invention provided qualitative as well as quantitative information that is extremely valuable in the diagnosis of these specimens, i. Applied to Kidney Biopsies The system of the present invention was tested and was found to assist in the early diagnostic evaluation of biopsies from patients with renal disease, and with routine monitoring of patients who have undergone transplantation.
  • spectral images from the system can be compared to clinical findings and standard light and immunofluorescence studies to categorize the disease state and quantifies its severity.
  • immunofluorescence is graded crudely (0 to +4).
  • the system adds quantitative as well as qualitative new insights into the structural abnormalities underlying immune and non-immune system based renal diseases.
  • the experiment entailed analyzing archival slides of patients with suspect renal or heart transplants or native organs presenting with evidence of disease.
  • the samples had been treated with immunofluorescent stains specific to IgA, IgG or IgM. They were also treated with Hematoxylin/Eosin (H&E) staining to observe and analyze the samples under transmission (white light) microscopy.
  • H&E Hematoxylin/Eosin
  • the excitation wavelength was 405 nm and spectra were acquired through a long pass filter that allowed all light of greater than 470 nm to pass, and blocked the excitation wavelength and all wavelengths shorter than 470 nm.
  • An Olympus BH2 epi-fluorescence microscope was used.
  • FIG. 10 shows that spectral topography differentiates between native kidney with chronic disease, (curve 1) and transplanted kidney showing signs of rejection with and without cyclosporin toxicity, (curves 2 and 3). All these biopsy samples were stained with fluoresceinated anti-sera to human IgA:
  • Curve 1 (14058) Diabetic, chronic diabetic nephropathy, and glomerulosclerosis.
  • Curve 2 (12815) Diabetic, 7-year-old transplant with chronic cyclosporine toxicity and signs of rejection.
  • Curve 3 (13487) 1 year transplant, chronic transplant rejection, glomerulopathy and segmental sclerosis.
  • FIG. 11 shows clear differentiation between the spectra of immunofluorescence staining for IgA, IgM and IgG in the spectral region from 550nm to 650 nm:
  • Curve 1 (14058A3) Patient with chronic diabetic nephropathy and glomerulosclerosis. Stained for IgA.
  • Curve 2 (14058G4) Patient with chronic diabetic nephropathy and glomerulosclerosis. Stained for IgG.
  • Curve 3 (14058M2). Patient with chronic diabetic nephropathy and glomerulosclerosis. Stained for IgM.
  • Non-rejection pathology is frequently seen post transplant to include ischemia or catecholamine effects, interstitial fibrosis, myocardial calcification, and cyclosporine-associated endocardial infiltrates called the Quilty effect. It is therefore very important to be able to automatically diagnose evidence of immunosuppressive disorders even if there is no evidence of cellular rejection.
  • FIG. 12 shows two spectra from two patients, both negative for humoral rejection with an ISHT grate 0 and also negative for Quilty effect. Both were of right ventricular septal endocardial biopsies of heart transplant patients. The slides were stained with FITC conjugated antisera to immunoglobulins, the third component of complement and fibrinogen. Both spectra are fundamentally the same. The results summarized are: Curve 1 : (16757) Negative Quilty effect, negative rejection, ISHT Grade 0. Curve 2: (16471) Negative Quilty effect, negative rejection, ISHT Grade 0.
  • This example provides a good indication that spectra are consistent between patients with similar findings.
  • Immunohistochemical reactions comprise one category of reactions and include mononclonal and polyclonal antibody staining with immunohistologic markers.
  • Fluorescent in situ hybridization is another category and can be directed to genetic analysis or protein analysis. In the former, hybridization takes place between a nucleotide label probe (called the "antisense strand") and an endogenous nucleotide (e.g. mRNA, called the "sense strand"). This is referred to as a paired-nucleotide interaction. In the latter, proteins are labeled and incubated with tissue that includes the target binding protein in what is called a protein-protein interaction. Examples of the application of the present invention for the diagnosis of disorders resident in such matter is now set forth, a. Applied To Cervicovaginal Disorders
  • cancer-associated HPV genotypes in the nucleus of cervicovaginal cells are detectable by DNA analysis of the cells in a PAP smear slide via use of a fluorescence based in situ hybridization (FISH) assay. Images of the cells acquired (filtered) with a fluorescent microscope are then digitally captured by a CCD camera, and then analyzed using algorithms which detect all cell nuclei from images of the DNA counterstain. The images of the nuclei can then be used as a mask and mapped over the FISH image of the same microscopic scene to quantify the corresponding fluorescent HPV signal from each nucleus.
  • FISH fluorescence based in situ hybridization
  • Chlamydia Trachomatis CT
  • DIF direct immunofluorescence
  • the present invention has utility as a low cost, rapid and efficient diagnostic tool and method that could assist in the identification of these "early risk” disorders together with (in addition to) the PAP smear screening, all in a single test.
  • the present invention can automate the analysis of normal and diseased cells that are identifiable using a sensitive FISH assay and DIF staining, to more objectively, cost effectively, and rapidly identify the presence of HPV and CT from a PAP smear.
  • HPV Human Papilloma Virus
  • FNR false-negative ratio
  • HPV genotypes have been described, and about 20 of these are associated with anogenital lesions. These 20 can be characterized into "high risk” and “low risk” groups, in accordance with their association with benign and malignant tumors.
  • a FISH assay has been developed to detect HPV 16 and 18 in cervical smears, these two sequences being most identified with malignant lesions. The speed, specificity and accuracy of multiple HPV type identification can be greatly enhanced by the use of multiple fluorescent tag probes.
  • the multispectral topography system is a tool that enables the use of such multiple tagging by collecting entire spectra and using deconvolution algorithms to accurately differentiate the various spectral signals that contribute to an observed fluorescent envelope.
  • CT Chlamydia Trachomatis
  • CT specific monoclonal antibodies, conjugated to fluorescein isothiocyanate provides highly specific fiuorescein-staining. This test is well suited to sampling and handling similar, and, as with the FISH assay, is consistent with that of a PAP smear.
  • FIG. 4 shows the video image of a calibration smear known to be positive for TB coded cTBl 1299sp3. The "observed" image camera uses false color enhancement for easy identification of areas in the smear with high intensity emission.
  • FIG. 5 shows the spectral file acquired by the spectrograph. also with false color enhancement, as observed on the computer monitor. Each acquisition captures a slice of the smear, as shown by the rectangular box in FIG. 4. Objects marked 1 and 2 correlate with the spectral image in FIGS. 5 and 6 and the spectra in FIG. 7. The video camera of the system had no difficulty in observing areas of intense light for those samples with TB and a noticeable absence of light in samples without TB.
  • FIG. 6 shows the spectral image partitioned into "channels " . Each channel is the spectrum of an area in the slice. For simplicity in presenting this concept, only 25 channels are shown representing an area on the smear of 8 by 2.5 ⁇ m.
  • each channel corresponding to one row of pixels.
  • each of 240 objects is 1 ⁇ m by 2.5 ⁇ m when submitted with a 20X objective, and are all acquired simultaneously. Partitioning is set-up either by the operator or automatically by the computer. If a filter set is in the system, blocking wavelengths below a certain value, it is usual to establish channels to eliminate the bulk of absent wavelength data.
  • Each spectrum corresponds to a specific location on the sample smear that correlate to channel number.
  • the Y-axis provides signal intensity that can be calibrated to quantify the signal present against the object emitting the signal.
  • the bands in FIG. 6 indicate the location of identical spectra that can be painted back to the original observed image. Each of these spectra indicate the presence TB and were identified with the USNN described in the following section.
  • fluorescent signals are composed of natural fluorescence as well as from "tags”. It was found that signal intensity levels of a smear positive for TB would greatly exceed the signal from natural fluorescence (also referred to as autofluorescence). The system produces a very large number of spectra simultaneously, many of which can be different from its neighbor, and indicative of differences in condition or state at a particular location.
  • the calibration smear ctbl l299sp3 was used to train the USNN to recognize the spectral characteristics of a smear presenting TB, as previously shown in FIGS. 4, 5, 6, and 7. Spectral and observed images were then captured from a smear known to be positive for TB, coded as tbl2110sp2. The same channel selection was used as for the calibration acquisition.
  • FIG. 8 shows the USNN presentation of the analysis of the calibration smear, ctbl 1299sp3, and the patient sample coded tbl2110sp2.
  • the top left indicates that the first acquisition was a training set and there were 9 spectral features identified. If the threshold (sensitivity) of the USNN were adjusted, then it would locate either fewer spectra, by only looking for gross differences, or more spectra by looking for subtle differences.
  • the first column shows channel number, the second the spectral object associated with that particular channel.
  • the third and fourth columns show the search for recognized spectral objects in tbl2110sp2. A pathologist confirmed that the area-emitting object 1 was clearly that of TB.
  • the fourth column indicates that there are 12 recurrences of object 1.
  • the spectrography subsystem may operate with any type of light image transmitter capable of transmitting an image mammalian cells and tissue, such as any lens based, telescopic, system, or a fiber optic based imaging system, such as an endoscope.
  • the matter is not limited to prepared slides.
  • the system could automatically analyze the spectral characteristics of cervico-vaginal tissue during an actual gynecological examination by connecting the spectroscopy subsystem and computer to a colposcope, for example.
  • this system is not limited to use as a primary diagnostic tool. It may also be used as a tool to improve quality control in the pathology lab.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Image Processing (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Investigating Or Analysing Biological Materials (AREA)

Abstract

La présente invention concerne un système et un procédé de topographie multispectrale qui consiste à éclairer une matière d'origine mammalienne (18) au moyen d'une source lumineuse (43) et à transmettre une image d'une coupe (20) de ladite matière à un prisme imageur multispectral et à un spectrographe à miroir (30), lesquels dispersent plus ou moins simultanément la lumière transmise. L'image spectrale ainsi obtenue est préparée en vue d'un traitement ultérieur. Le processeur (37), qui est généralement intégré à un système informatique, traite les données spectrales numériques au moyen d'un réseau neuronal aux fins de diagnostic. La source lumineuse peut être constituée par de la lumière filtrée absorbée par une matière destinée spécifiquement à ré-émettre de la lumière (fluorescence). La matière peut être constituée par des spécimens pathologiques qui doivent être grossis et analysés au microscope (électronique à transmission ou par fluorescence) ou bien se présenter sous sa forme in vivo, auquel cas l'image est transmise par un autre transmetteur classique d'images tel qu'un endoscope. Ce système peut également afficher l'image visuelle transmise ainsi que l'image spectrale dans le cadre du travail de diagnostic.
EP99937539A 1998-07-27 1999-07-27 Topographie spectrale de matiere d'origine mammalienne Withdrawn EP1101083A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12287698A 1998-07-27 1998-07-27
PCT/US1999/017004 WO2000006980A1 (fr) 1998-07-27 1999-07-27 Topographie spectrale de matiere d'origine mammalienne
US122876 2002-04-12

Publications (1)

Publication Number Publication Date
EP1101083A1 true EP1101083A1 (fr) 2001-05-23

Family

ID=22405360

Family Applications (1)

Application Number Title Priority Date Filing Date
EP99937539A Withdrawn EP1101083A1 (fr) 1998-07-27 1999-07-27 Topographie spectrale de matiere d'origine mammalienne

Country Status (5)

Country Link
EP (1) EP1101083A1 (fr)
JP (1) JP2002521685A (fr)
AU (1) AU5235299A (fr)
CA (1) CA2338675A1 (fr)
WO (1) WO2000006980A1 (fr)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6364829B1 (en) 1999-01-26 2002-04-02 Newton Laboratories, Inc. Autofluorescence imaging system for endoscopy
NZ513117A (en) 1999-01-26 2004-04-30 Newton Lab Inc Autofluorescence imaging system for endoscopy
US6759235B2 (en) 2000-04-06 2004-07-06 Quantum Dot Corporation Two-dimensional spectral imaging system
JP2004219092A (ja) * 2003-01-09 2004-08-05 Univ Waseda リアルタイム分光画像分析装置及び分析方法
DE10304267B9 (de) 2003-02-03 2005-12-15 Carl Zeiss Augenchirurgie-Mikroskopiesystem
DE102005045961B4 (de) 2005-09-26 2018-11-15 Siemens Healthcare Gmbh Verfahren und Vorrichtung zur Darstellung eines einen Fluoreszenzfarbstoff enthaltenden Gewebes
WO2009006696A1 (fr) * 2007-07-10 2009-01-15 Molecular Discovery Systems Procédé de pathologie
US9240043B2 (en) * 2008-09-16 2016-01-19 Novartis Ag Reproducible quantification of biomarker expression
KR101379140B1 (ko) * 2009-10-05 2014-03-28 후지쯔 가부시끼가이샤 생체 정보 처리 장치, 생체 정보 처리 방법 및 생체 정보 처리용 컴퓨터 프로그램이 기록된 컴퓨터로 읽을 수 있는 기록 매체
JP5384453B2 (ja) * 2010-09-09 2014-01-08 シャープ株式会社 測定装置、測定システム、測定方法、制御プログラム、および、記録媒体
JP5766958B2 (ja) * 2011-01-21 2015-08-19 オリンパス株式会社 顕微鏡システム、情報処理装置、及び情報処理プログラム
CN102721469B (zh) * 2012-06-14 2015-05-13 中国科学院自动化研究所 双相机的多光谱成像***和方法
CN102809429A (zh) * 2012-07-26 2012-12-05 中国科学院自动化研究所 基于双相机的多光谱成像***和方法
CN107923851A (zh) * 2015-06-02 2018-04-17 国立大学法人旭川医科大学 观察辅助装置、信息处理方法以及程序
WO2017223206A1 (fr) * 2016-06-21 2017-12-28 Sri International Procédés et appareils d'imagerie hyperspectrale
JP6896971B2 (ja) * 2017-04-13 2021-06-30 シーメンス・ヘルスケア・ダイアグノスティックス・インコーポレーテッドＳｉｅｍｅｎｓ Ｈｅａｌｔｈｃａｒｅ Ｄｉａｇｎｏｓｔｉｃｓ Ｉｎｃ． 試料の特性評価中にラベル数を決定するための方法および装置
PL3662271T3 (pl) 2017-07-31 2024-02-19 Smiths Detection Inc. System do określania obecności substancji będącej przedmiotem zainteresowania w próbce
EP3614191A1 (fr) * 2018-08-20 2020-02-26 Till GmbH Dispositif de microscope
GB2600719B (en) * 2020-11-05 2023-10-11 Oxford Nanoimaging Ltd Fluorescence assay
CN114820502B (zh) * 2022-04-21 2023-10-24 济宁医学院附属医院 一种用于肠粘膜组织中蛋白激酶ck2的着色检测方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5784162A (en) * 1993-08-18 1998-07-21 Applied Spectral Imaging Ltd. Spectral bio-imaging methods for biological research, medical diagnostics and therapy
US5528368A (en) * 1992-03-06 1996-06-18 The United States Of America As Represented By The Department Of Health And Human Services Spectroscopic imaging device employing imaging quality spectral filters
US5424827A (en) * 1993-04-30 1995-06-13 Litton Systems, Inc. Optical system and method for eliminating overlap of diffraction spectra
US5793049A (en) * 1995-07-06 1998-08-11 Yale University Optical filtering and spectroscopic imaging

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO0006980A1 *

Also Published As

Publication number Publication date
WO2000006980A1 (fr) 2000-02-10
JP2002521685A (ja) 2002-07-16
AU5235299A (en) 2000-02-21
CA2338675A1 (fr) 2000-02-10

Similar Documents

Publication Publication Date Title
WO2000006980A1 (fr) Topographie spectrale de matiere d'origine mammalienne
US8290236B2 (en) Quantitative, multispectral image analysis of tissue specimens stained with quantum dots
US6337472B1 (en) Light imaging microscope having spatially resolved images
US6181414B1 (en) Infrared spectroscopy for medical imaging
US6690817B1 (en) Spectral bio-imaging data for cell classification using internal reference
US7570356B2 (en) System and method for classifying cells and the pharmaceutical treatment of such cells using Raman spectroscopy
US20090002702A1 (en) Distinguishing between renal oncocytoma and chromophobe renal cell carcinoma using raman molecular imaging
EP1065496A2 (fr) Procédé et dispositif pour l'extraction d'images séparées à partir d'une pluralité de chromogènes dans un échantillon biologique
US20120083678A1 (en) System and method for raman chemical analysis of lung cancer with digital staining
Li et al. AOTF based molecular hyperspectral imaging system and its applications on nerve morphometry
US7956996B2 (en) Distinguishing between invasive ductal carcinoma and invasive lobular carcinoma using raman molecular imaging
US20120078524A1 (en) System and method for diagnosis tissue samples using fluorescence and raman techniques
US7316904B1 (en) Automated pap screening using optical detection of HPV with or without multispectral imaging
WO2000010451A1 (fr) Systeme et procede de topographie spectrale de substances provenant de mammiferes, utilisant une illumination par lumiere blanche
Vari et al. Telepathology and imaging spectroscopy as a new modality in histopathology
Lerner et al. Spectral topography of histopathological samples
CA2279945A1 (fr) Spectroscopie infrarouge pour l'imagerie medicale
CA2858931C (fr) Procede d'analyse d'un echantillon biologique, et dispositif mettant en oeuvre ce procede
WO2023157756A1 (fr) Dispositif de traitement d'informations, système d'analyse d'échantillon biologique et procédé d'analyse d'échantillon biologique
Tsurui et al. Hyperspectral imaging of pathology samples
LERNER Telepathology and Imaging Spectroscopy as a New Modality in Histopathology

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20010131

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

17Q First examination report despatched

Effective date: 20010611

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20011227