CN115236015B - Puncture sample pathology analysis system and method based on hyperspectral imaging technology - Google Patents
Puncture sample pathology analysis system and method based on hyperspectral imaging technology Download PDFInfo
- Publication number
- CN115236015B CN115236015B CN202210863506.XA CN202210863506A CN115236015B CN 115236015 B CN115236015 B CN 115236015B CN 202210863506 A CN202210863506 A CN 202210863506A CN 115236015 B CN115236015 B CN 115236015B
- Authority
- CN
- China
- Prior art keywords
- sample
- puncture
- hyperspectral
- module
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000701 chemical imaging Methods 0.000 title claims abstract description 42
- 238000004458 analytical method Methods 0.000 title claims abstract description 37
- 230000007170 pathology Effects 0.000 title claims abstract description 35
- 238000000034 method Methods 0.000 title claims abstract description 17
- 238000005516 engineering process Methods 0.000 title claims abstract description 15
- 238000010827 pathological analysis Methods 0.000 claims abstract description 18
- 230000003287 optical effect Effects 0.000 claims description 39
- 238000000926 separation method Methods 0.000 claims description 36
- 238000003384 imaging method Methods 0.000 claims description 20
- 239000007788 liquid Substances 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 claims description 11
- 239000007787 solid Substances 0.000 claims description 11
- 238000011010 flushing procedure Methods 0.000 claims description 10
- 238000001228 spectrum Methods 0.000 claims description 10
- 238000013461 design Methods 0.000 claims description 7
- 238000002372 labelling Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000001514 detection method Methods 0.000 claims description 3
- 230000002093 peripheral effect Effects 0.000 claims description 3
- 238000003491 array Methods 0.000 claims 2
- 238000007405 data analysis Methods 0.000 abstract description 2
- 230000003595 spectral effect Effects 0.000 description 3
- 238000010521 absorption reaction Methods 0.000 description 2
- 238000001574 biopsy Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000000877 morphologic effect Effects 0.000 description 2
- 230000001575 pathological effect Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 206010028980 Neoplasm Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000000601 blood cell Anatomy 0.000 description 1
- 210000004027 cell Anatomy 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 239000012535 impurity Substances 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012335 pathological evaluation Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 210000004881 tumor cell Anatomy 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B10/00—Other methods or instruments for diagnosis, e.g. instruments for taking a cell sample, for biopsy, for vaccination diagnosis; Sex determination; Ovulation-period determination; Throat striking implements
- A61B10/02—Instruments for taking cell samples or for biopsy
- A61B10/0233—Pointed or sharp biopsy instruments
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
- G01N2021/0106—General arrangement of respective parts
- G01N2021/0112—Apparatus in one mechanical, optical or electronic block
Landscapes
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Chemical & Material Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Biomedical Technology (AREA)
- Engineering & Computer Science (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
The invention discloses a puncture sample pathology analysis system and method based on hyperspectral imaging technology, and belongs to the field of pathology auxiliary systems. The pathology analysis system includes: the system comprises a sample acquisition module, a hyperspectral imaging module and a pathology analysis module; the sample acquisition module is used for acquiring a puncture sample; the hyperspectral imaging module is used for acquiring hyperspectral images of the puncture sample; and the pathology analysis module is used for obtaining hyperspectral characteristic information based on the hyperspectral image so as to realize the pathology analysis of the puncture sample. The pathological analysis method comprises the following steps: obtaining a puncture sample; acquiring a hyperspectral image of the puncture sample; and obtaining hyperspectral characteristic information based on the hyperspectral image so as to realize pathological analysis of the puncture sample. According to the technical scheme, accurate data analysis can be performed on the puncture sample, and a doctor is assisted in rapid pathological analysis.
Description
Technical Field
The invention belongs to the field of pathology auxiliary systems, and particularly relates to a puncture sample pathology analysis system and method based on hyperspectral imaging technology.
Background
Hyperspectral imaging is becoming an emerging technology for biomedical visualization, and research in the biomedical field is receiving attention. Hyperspectral imaging can capture the slight spectral differences of tissues under different pathological conditions, provide analysis information about the physiological, morphological and biochemical components of the tissues, and further provide more auxiliary information for medical analysis.
At present, puncture pathology analysis has higher requirements on the specificity and experience of pathologists, the professional development is unbalanced, auxiliary equipment is needed to assist doctors in analysis, and the popularization rate of performing rapid pathological analysis on puncture sites in areas with insufficient professional doctors is improved. The hyperspectral imaging instrument has not been widely applied to the analysis of puncture tissues obtained by medical clinical operation, and the research of a hardware system for assisting rapid puncture pathological analysis based on the hyperspectral imaging technology under the guidance of endoscope ultrasound on the operation site of fine needle puncture aspiration/biopsy operation is yet to be developed.
Disclosure of Invention
The invention aims to provide a puncture sample pathology analysis system and method based on hyperspectral imaging technology, so as to solve the problems in the prior art.
To achieve the above object, the present invention provides a puncture sample pathology analysis system based on hyperspectral imaging technology, comprising: the system comprises a sample acquisition module, a hyperspectral imaging module and a pathology analysis module; the sample acquisition module, the hyperspectral imaging module and the pathology analysis module are sequentially connected;
the sample acquisition module is used for acquiring a puncture sample;
The hyperspectral imaging module is used for acquiring hyperspectral images of the puncture samples;
and the pathology analysis module obtains hyperspectral characteristic information based on the hyperspectral image so as to realize the pathology analysis of the puncture sample.
Preferably, the hyperspectral imaging module comprises: the device comprises a sample placement unit, an optical path imaging unit and an image display unit; the sample placing unit, the light path imaging unit and the image display unit are sequentially connected;
The sample placement unit is used for placing a puncture sample;
The optical path imaging unit is used for acquiring a hyperspectral image of the puncture sample;
The image display unit is used for displaying the hyperspectral image.
Preferably, the sample placing unit includes a motorized stage and a sample separation vessel, wherein the sample separation vessel is placed on the motorized stage.
Preferably, the optical path imaging unit comprises a gray-scale camera, an acousto-optic tunable filter, a color camera, an optical path adjusting module, a lens selecting module, an optical filter, a wide-spectrum transmission light source and an acousto-optic tunable filter driver;
The gray level camera, the acousto-optic tunable filter, the color camera, the light path adjusting module, the lens selecting module, the electric object stage, the optical filter and the wide spectrum transmission light source are sequentially connected through light paths; and the output end of the acousto-optic tunable filter driver is connected with the input end of the acousto-optic tunable filter.
Preferably, the image display unit comprises a computer, wherein the computer is connected with the grayscale camera, the color camera, the motorized stage and the acousto-optic tunable filter driver, respectively.
Preferably, the sample separation vessel comprises: transparent separating vessel, separating vessel with scale, separating vessel with groove, and separating vessel with microfluidic array.
In order to achieve the technical aim, the invention provides a puncture sample pathology analysis method based on hyperspectral imaging technology, which is characterized in that,
Obtaining a puncture sample;
Acquiring a hyperspectral image of the puncture sample;
and obtaining hyperspectral characteristic information based on the hyperspectral image so as to realize pathological analysis of the puncture sample.
Preferably, the process of obtaining hyperspectral imaging of the puncture sample comprises:
Adjusting the filter based on a type of sample separation dish, wherein the sample separation dish comprises: transparent separating vessel, separating vessel with scale, separating vessel with groove, separating vessel with micro-fluidic array;
moving a motorized stage, wherein the sample separation vessel is placed on the motorized stage;
and selecting a gray level camera based on a moving result, and shooting a puncture sample in a sample separation vessel through the gray level camera to obtain a hyperspectral image of the puncture sample.
Preferably, the process of obtaining hyperspectral characteristic information to realize pathological analysis of the puncture sample comprises the following steps:
preprocessing and labeling the hyperspectral imaging to obtain a preprocessed labeling hyperspectral image;
And extracting the characteristics of the marked hyperspectral image, establishing a sample database based on the extracted characteristic image, and obtaining hyperspectral information based on the sample database to realize pathological analysis of the puncture sample.
The invention has the technical effects that:
The invention obtains a puncture sample by a sample obtaining module through a puncture biopsy operation; acquiring a hyperspectral image of the puncture sample through a hyperspectral imaging module; and obtaining hyperspectral characteristic information based on the hyperspectral image through a pathology analysis module so as to realize pathological analysis of a puncture sample. By the puncture sample pathology analysis system and the puncture sample pathology analysis method based on the hyperspectral imaging technology, accurate data analysis can be performed on the puncture sample, doctors can be assisted in performing pathology analysis, and the popularization rate of performing rapid pathology analysis on the puncture site in areas with insufficient specialized doctors is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application. In the drawings:
FIG. 1 is a schematic diagram of a system architecture in an embodiment of the present invention;
FIG. 2 is a flow chart of a method in an embodiment of the invention;
FIG. 3 is a schematic diagram of an adjustable multi-functional sample separation vessel in accordance with an embodiment of the present invention;
Reference numerals: 1-gray scale camera, 2-acousto-optic tunable filter, 3-color camera, 4-light path adjustment module, 5-lens switching module, 6-precision triaxial electric stage, 7-sample separation dish, 8-filter, 9-transmission light source, 10-driver, 11 control computer, 12-sample separation dish sidewall, 13-sample separation dish sample stage, 14-transparent separation dish accessory, 15-graduated separation dish accessory, 16-grooved separation dish accessory, 17-microfluidic array separation dish accessory.
Detailed Description
It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other. The application will be described in detail below with reference to the drawings in connection with embodiments.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is illustrated in the flowcharts, in some cases the steps illustrated or described may be performed in an order other than that illustrated herein.
Example 1
As shown in fig. 1, in this embodiment, a puncture sample pathology analysis system based on hyperspectral imaging technology is provided, which includes: the system comprises a sample acquisition module, a hyperspectral imaging module and a pathology analysis module; the sample acquisition module, the hyperspectral imaging module and the pathology analysis module are sequentially connected;
The sample acquisition module is used for acquiring a puncture sample;
the hyperspectral imaging module is used for acquiring hyperspectral images of the puncture sample;
and the pathology analysis module is used for obtaining hyperspectral characteristic information based on the hyperspectral image so as to realize the pathology analysis of the puncture sample.
In some embodiments, the hyperspectral imaging module comprises: the device comprises a sample placement unit, an optical path imaging unit and an image display unit; the sample placing unit, the light path imaging unit and the image display unit are sequentially connected;
a sample placement unit for placing a puncture sample;
the optical path imaging unit is used for acquiring a hyperspectral image of the puncture sample;
and an image display unit for displaying the hyperspectral image.
In some embodiments, the sample placement unit comprises a motorized stage 6 and a sample separation dish 7, wherein the sample separation dish 7 is placed on the motorized stage 6.
In some embodiments, the optical path imaging unit comprises a grayscale camera 1, an acousto-optic tunable filter 2, a color camera 3, an optical path adjustment module 4, a lens selection module 5, a filter 8, a broad spectrum transmission light source 9, and an acousto-optic tunable filter driver 10; the gray level camera 1, the acousto-optic tunable filter 2, the color camera 3, the light path adjusting module 4, the lens selecting module 5, the electric object stage 6, the optical filter 8 and the wide spectrum transmission light source 9 are sequentially connected through light paths; the output end of the acousto-optic tunable filter driver 10 is connected with the input end of the acousto-optic tunable filter 2.
In some embodiments, the image display unit comprises a computer 11, wherein the computer 11 is connected to the grayscale camera 1, the color camera 3, the motorized stage 6, and the acousto-optic tunable filter driver 10, respectively.
In some embodiments, the sample separation vessel 7 comprises: transparent separating vessel, separating vessel with scale, separating vessel with groove, and separating vessel with microfluidic array.
The system of the embodiment specifically comprises: a scientific grade complementary metal oxide semiconductor gray scale industrial camera (gray scale camera) 1, an acousto-optic tunable filter 2, a driver 10 thereof, a color charge coupled device industrial camera (color camera) 3, an optical path adjusting module 4, a lens switching module 5, a precision triaxial electric stage 6, a multifunctional sample separating vessel 7, an optical filter 8, a transmission light source 9 and a control computer 11. The transmission light source 9 selects a broad spectrum light source containing visible light-near infrared band, and the lens switching module 5 comprises a macro lens and a micro objective.
In this embodiment, the transmission light source 9, the optical filter 8, the macro lens or micro objective, the optical path adjustment module 4, the color camera 3, the acousto-optic tunable filter (AOTF) 2, and the grayscale camera 1 are connected in an optical path. The optical path adjusting module 4 integrates optical paths of different lenses and divides two paths of optical paths to be respectively connected to the input ends of the color camera 3 and the AOTF. The control output of AOTF driver 10 is connected to the control input of AOTF; a control input of AOTF driver 10 is connected to a control output of control computer 11. A control input end of the electric object stage 6 is connected to a control output end of the control computer 11; the control output of the control computer 11 is connected to the control input of the transmissive light source 9.
In this embodiment, the function of the scientific-grade cmos grayscale industrial camera 1 is to capture hyperspectral images.
In this embodiment, the acousto-optic tunable filter 2 is used for receiving the output light of the light path adjustment module 4 and separating the light with the specified wavelength for the gray-scale camera 1.
In this embodiment, the color industrial camera 3 is operative to capture a color image of the current field of view.
In this embodiment, two optical path adjusting modules 4 are used, one of which is for outputting different optical paths of the micro objective lens and the macro lens, and the optical path is readjusted as the input of the subsequent optical device; secondly, the light is distributed to two light paths of the gray level camera 1 and the color camera 3 according to a specified proportion under the action of light splitting, so that the system can collect the color image and the hyperspectral image of the sample target area at the same time, and the working efficiency of the system is further improved.
In this embodiment, the lens switching module 5 provides two modes of macroscopic imaging and microscopic imaging for the system, the macroscopic macro lens shoots the whole form and general distribution of the sample, and the magnification of the micro objective lens is 10 times, 20 times and 40 times, so that the microscopic puncture, tissue and other information of the sample can be shot; in actual operation, a suitable lens is selected, the light path module is manually adjusted, and the imaging effect is previewed by the control computer 11. The macro micro-lens and the micro-objective are combined and integrated into the lens conversion module, and the optical path adjustment module is added on the lens conversion module according to the optical path structures of different lenses, so that the optical path can work normally, and the requirements of macro imaging and micro imaging are met.
In this embodiment, the precise triaxial electric stage 6 functions to achieve precise displacement and record the position. The electric object stage can be controlled to move in three directions of XYZ by a control computer; meanwhile, a plurality of sample separating vessel placing clamping grooves are designed on the objective table, so that a clinician can observe a plurality of puncture samples simultaneously or observe different surface characteristics of the same sample by matching with a multifunctional separating vessel accessory.
In this embodiment, the function of the multifunctional sample separating vessel 7 is to separate the puncture sample from solid and liquid, the sample separating vessel is composed of an inner protruding platform and an outer vessel edge, the middle protruding platform is used for placing the puncture sample, the puncture sample can be processed in the next step only by being flushed with a specific solution, after being flushed, the solid is placed on a central sample platform to observe or shoot an image, the sample flushing liquid flows into a peripheral groove to be collected, a tip design is made at one corner of the separating vessel, so that sample flushing liquid is conveniently poured out and detected in the next step, and the sample on the platform can be observed by naked eyes in a macroscopic manner or can acquire macroscopic/microscopic hyperspectral image data more clearly and is connected with subsequent image processing. In view of the fact that the actually penetrated tissue is not completely complete and fine sample scraps exist, the invention designs a sample brush for collecting fine tissue, and the brush head is fine and soft, so that the fine sample can be swept to a collecting device without damaging the sample.
As shown in fig. 3, the multifunctional sample separating vessel 7 is designed to fully consider the requirement of image acquisition and the requirement of a clinician for processing samples, and the middle sample stage and the surrounding grooves facilitate the placement of solid samples and the preservation of liquid samples, and the placement of the solid samples on the sample stage also facilitates the selection of the field of view during image acquisition. The hollow white sample separator plate fitting 14 is the most basic form of the multifunctional sample separator plate and is mainly used for color image/hyperspectral image acquisition; the sample separating vessel fitting 15 with scales is mainly used for macroscopic observation, can primarily estimate the sample amount and size, and can primarily judge whether the sample is effectively collected by matching with the use of an optical filter; the sample separating vessel fitting 16 with the groove can separate solid samples, so that the conditions of adhesion, overlapping, winding and the like of the solid samples are avoided, and macroscopic observation and image acquisition are influenced; the sample separating dish fitting 17 with the microfluidic array can capture specific types of puncture cells, and can capture blood cells in blood puncture, tumor cells in tumor puncture and the like according to different array forms. The multifunctional sample separating vessel has extremely simple use method, and only the accessory is required to be sleeved on the platform with the middle bulge. With these sample station accessories, the clinician can observe more sample information. The design of the tip in the upper right corner of the front view of fig. 3 facilitates pouring of sample rinse after sample rinsing.
In this embodiment, the filter 8 is used to selectively separate the light source excited by the transmission light source 9 into a specific wavelength, so that the clinician can visually observe the sample preliminarily, and the wavelength of the filter is determined by the optical absorption characteristics of the core tissue in the sample. The design of the optical filter is added between the light source and the objective table, the design separates light with specific wavelength from the transmission light source according to the spectral absorption characteristics of different core samples, and the general distribution characteristics of different substances in the sample are matched with the naked eyes of a clinician under macroscopic conditions, and the initial operation is carried out on the puncture sample in the sample separation dish.
In this embodiment, the transmissive light source 9 serves to provide an excitation light source of a wide range of wavelengths for the sample. The wide-spectrum light source is adopted, the visible light wave band can be covered to the near infrared wave band, the corresponding micro-lens, the micro-objective lens and the gray level/color camera can also be covered to the near infrared wave band, the three-dimensional combined space-spectrum information of the hyperspectral imaging technology is utilized, the fine spectrum difference of the puncture tissue under different pathological conditions is captured under wider spectrum, and the diagnosis information about the physiological, morphological and biochemical components of the tissue is provided, so that the pathological diagnosis of a clinician is assisted.
In this embodiment, the acousto-optic tunable filter driver 10 is used for outputting an electric tuning signal to control the acousto-optic tunable filter 2 to pass through the wavelength range of light and interface with the control computer 11. The acousto-optic tunable filter (AOTF) and the gray level camera can cover a first near infrared band, are matched with a wide spectrum light source, can collect hyperspectral images of a visible light band and a near infrared band, and are more abundant in collected image information.
In this embodiment, the control computer 11 is used to provide a real-time preview image of a software interface, so that an operator can implement interaction with hardware in software, and provide computing power and storage support for each image processing method.
Compared with the prior art, the invention has the following advantages:
The imaging system designed by the embodiment can collect hyperspectral images from visible light wave bands to near infrared wave bands, is provided with a macroscopic macro lens and a microscopic micro objective lens, meets the requirements of macroscopic imaging and microscopic imaging, and can accurately analyze data of samples and assist doctors to carry out rapid pathological evaluation by rich spectral characteristics provided by the hyperspectral images, so that the satisfaction degree and diagnostic efficiency of puncture samples are improved.
The sample separating vessel and the fittings thereof designed by the embodiment can fully meet macroscopic observation tasks of clinicians on sample size, form, tissue distribution and the like, and can facilitate the separation of solid tissues of a puncture sample and puncture flushing fluid by the clinicians and the respective subsequent treatment of the solid and the liquid.
Example two
As shown in fig. 2, to solve the technical problem, the present embodiment provides a method for pathological analysis of a puncture sample based on hyperspectral imaging technology, which is characterized in that,
Obtaining a puncture sample;
Acquiring a hyperspectral image of a puncture sample;
And obtaining hyperspectral characteristic information based on the hyperspectral image so as to realize pathological analysis of the puncture sample.
In some embodiments, the process of obtaining hyperspectral imaging of a puncture sample comprises: -adjusting the filter (8) based on the type of sample separation dish (7), wherein the sample separation dish (7) comprises: transparent separating vessel, separating vessel with scale, separating vessel with groove, separating vessel with micro-fluidic array; moving the motorized stage 6, wherein the sample separating vessel 7 is placed on the motorized stage 6; based on the movement result, a gray-scale camera 1 is selected, and the sample separating dish 7 is photographed by the gray-scale camera 1 to obtain a hyperspectral image of the puncture sample.
In the embodiment, according to the observation or image acquisition requirement, selecting a proper separating dish accessory to be mounted on a sample table; placing the puncture sample on a sample stage; the clinician performs a flushing operation on the sample, the rest solid sample is placed on a sample table, and the sample flushing liquid obtained by flushing is poured into a test tube through a discharge spout for subsequent relevant detection;
In this embodiment, when macroscopic viewing is performed, the optical filter is switched to obtain light with a required wavelength, the lens selects a macro lens, and the hyperspectral imaging system (the light source, the AOTF and the driver thereof, the color camera and the gray-scale camera) is started after the light path is adjusted. Adjusting the stage to a suitable spatial position, the clinician can view the sample directly by eye or on a computer screen; at the same time, different cuvette assemblies can be replaced to observe macroscopic features of the sample; when data acquisition is carried out, the optical filter is adjusted to be blank, and a transparent separating dish accessory is selected. The gray level camera/color camera is selected by the computer, and the object stage is controlled to move in three directions of XYZ to select a proper view field for image shooting.
In some embodiments, obtaining hyperspectral information to enable pathological analysis of a puncture sample includes: preprocessing and labeling the hyperspectral imaging to obtain preprocessed labeling hyperspectral imaging; feature extraction is carried out on the labeling hyperspectral imaging, a sample database is established based on the extracted feature image, and hyperspectral information is obtained based on the sample database so as to realize pathological analysis of the puncture sample.
In this embodiment, performing subsequent image processing on the collected color image/hyperspectral image data includes: 1, data preprocessing: eliminating the influence of light path impurities and background noise; 2, image annotation: marking out a core tissue portion in the field of view; 3, image analysis algorithm: and sending the image characteristic representation to a classification/segmentation network to obtain the image characteristic representation.
The present application is not limited to the above-mentioned embodiments, and any changes or substitutions that can be easily understood by those skilled in the art within the technical scope of the present application are intended to be included in the scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims (4)
1. A hyperspectral imaging technique-based puncture sample pathology analysis system, comprising: the system comprises a sample acquisition module, a hyperspectral imaging module and a pathology analysis module; the sample acquisition module, the hyperspectral imaging module and the pathology analysis module are sequentially connected;
the sample acquisition module is used for acquiring a puncture sample;
The hyperspectral imaging module is used for acquiring hyperspectral images of the puncture samples;
the pathology analysis module is used for obtaining hyperspectral characteristic information through data processing based on the hyperspectral image so as to realize pathology analysis of a puncture sample;
the hyperspectral imaging module includes: the device comprises a sample placement unit, an optical path imaging unit and an image display unit; the sample placing unit, the light path imaging unit and the image display unit are sequentially connected;
The sample placement unit is used for placing a puncture sample;
The optical path imaging unit is used for acquiring a hyperspectral image of the puncture sample;
the image display unit is used for displaying the hyperspectral image;
The sample placement unit comprises a motorized stage (6) and a sample separation vessel (7), wherein the sample separation vessel (7) is placed on the motorized stage (6);
The sample separating dish (7) comprises: transparent separating vessel fittings, separating vessel fittings with scales, separating vessel fittings with grooves and separating vessel fittings with microfluidic arrays; wherein the sample separating vessel (7) is matched with the optical filter (8);
The sample separation vessel (7) is used for carrying out solid-liquid separation on a puncture sample, the sample separation vessel (7) consists of a middle protruding platform and an outer vessel edge, accessories are sleeved on the middle protruding platform, the middle protruding platform is used for placing the puncture sample, the puncture sample can be subjected to next treatment only by being flushed by a specific solution, after being flushed, solids are placed on the middle protruding platform and used for observing or shooting images, sample flushing liquid flows into a peripheral groove for collection, one corner of the sample separation vessel (7) is provided with a leakage nozzle design for pouring out sample flushing liquid and carrying out next detection;
The optical path imaging unit comprises a gray level camera (1), an acousto-optic tunable filter (2), a color camera (3), an optical path adjusting module (4), a lens selecting module (5), an optical filter (8), a wide-spectrum transmission light source (9) and an acousto-optic tunable filter driver (10);
the gray level camera (1), the acousto-optic tunable filter (2), the color camera (3), the light path adjusting module (4), the lens selecting module (5), the electric object stage (6), the optical filter (8) and the wide spectrum transmission light source (9) are sequentially connected through light paths; the output end of the acousto-optic tunable filter driver (10) is connected with the input end of the acousto-optic tunable filter (2).
2. The hyperspectral imaging technique based puncture sample pathology analysis system according to claim 1, wherein the image display unit comprises a computer (11), wherein the computer (11) is connected with the grayscale camera (1), the color camera (3), the motorized stage (6) and the acousto-optic tunable filter driver (10), respectively.
3. A puncture sample pathology analysis method based on hyperspectral imaging technology is characterized in that,
Obtaining a puncture sample;
Acquiring a hyperspectral image of the puncture sample;
based on the hyperspectral image, hyperspectral characteristic information is obtained through data processing so as to realize pathological analysis of a puncture sample;
the process of acquiring a hyperspectral image of the puncture sample comprises:
-adjusting the filter (8) based on the type of sample separation dish (7), wherein the sample separation dish (7) comprises: transparent separating vessel fittings, separating vessel fittings with scales, separating vessel fittings with grooves and separating vessel fittings with microfluidic arrays; wherein the sample separating vessel (7) is matched with the optical filter (8);
The sample separation vessel (7) is used for carrying out solid-liquid separation on a puncture sample, the sample separation vessel (7) consists of a middle protruding platform and an outer vessel edge, accessories are sleeved on the middle protruding platform, the middle protruding platform is used for placing the puncture sample, the puncture sample can be subjected to next treatment only by being flushed by a specific solution, after being flushed, solids are placed on the middle protruding platform and used for observing or shooting images, sample flushing liquid flows into a peripheral groove for collection, one corner of the sample separation vessel (7) is provided with a leakage nozzle design for pouring out sample flushing liquid and carrying out next detection;
-moving an electric stage (6), wherein the sample separation vessel (7) is placed on the electric stage (6);
And selecting a gray level camera (1) based on a moving result, and shooting a puncture sample in a sample separation vessel (7) through the gray level camera (1) to obtain a hyperspectral image of the puncture sample.
4. The method for pathological analysis of a puncture sample based on hyperspectral imaging technology as set forth in claim 3, wherein the process of obtaining hyperspectral characteristic information to realize pathological analysis of the puncture sample comprises:
preprocessing and labeling the hyperspectral imaging to obtain a preprocessed labeling hyperspectral image;
and extracting the characteristics of the marked hyperspectral image, establishing a sample database based on the extracted characteristic image, and obtaining hyperspectral characteristic information based on the sample database to realize pathological analysis of the puncture sample.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210863506.XA CN115236015B (en) | 2022-07-21 | 2022-07-21 | Puncture sample pathology analysis system and method based on hyperspectral imaging technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210863506.XA CN115236015B (en) | 2022-07-21 | 2022-07-21 | Puncture sample pathology analysis system and method based on hyperspectral imaging technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115236015A CN115236015A (en) | 2022-10-25 |
| CN115236015B true CN115236015B (en) | 2024-05-03 |
Family
ID=83674520
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210863506.XA Active CN115236015B (en) | 2022-07-21 | 2022-07-21 | Puncture sample pathology analysis system and method based on hyperspectral imaging technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115236015B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204536030U (en) * | 2015-03-09 | 2015-08-05 | 史平 | Broken little pathology applicator |
| CN106901696A (en) * | 2017-02-23 | 2017-06-30 | 马青山 | A kind of cancer site prediction servicing unit and the method that data analysis is carried out using the device |
| CN106963459A (en) * | 2017-04-28 | 2017-07-21 | 山东大学 | A kind of bone marrow aspiration endoscopic imaging system and method |
| CN107064019A (en) * | 2017-05-18 | 2017-08-18 | 西安交通大学 | The device and method for gathering and splitting for dye-free pathological section high spectrum image |
| CN209553801U (en) * | 2019-03-18 | 2019-10-29 | 荣建胜 | Facilitate the sample apparatus for placing of sampling |
| CN111349603A (en) * | 2019-12-13 | 2020-06-30 | 上海欧易生物医学科技有限公司 | Dissociation method of breast cancer clinical puncture sample |
| CN111358573A (en) * | 2020-02-26 | 2020-07-03 | 西安交通大学医学院第二附属医院 | Hyperspectral imaging surgical area rapid detection and marking device and detection method |
| CN215692020U (en) * | 2021-09-13 | 2022-02-01 | 台州恩泽医疗中心(集团) | Operation specimen filtering bowl |
| CN114445362A (en) * | 2022-01-25 | 2022-05-06 | 腾讯科技（深圳）有限公司 | Image processing method, apparatus, device, readable storage medium and program product |
-
2022
- 2022-07-21 CN CN202210863506.XA patent/CN115236015B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204536030U (en) * | 2015-03-09 | 2015-08-05 | 史平 | Broken little pathology applicator |
| CN106901696A (en) * | 2017-02-23 | 2017-06-30 | 马青山 | A kind of cancer site prediction servicing unit and the method that data analysis is carried out using the device |
| CN106963459A (en) * | 2017-04-28 | 2017-07-21 | 山东大学 | A kind of bone marrow aspiration endoscopic imaging system and method |
| CN107064019A (en) * | 2017-05-18 | 2017-08-18 | 西安交通大学 | The device and method for gathering and splitting for dye-free pathological section high spectrum image |
| CN209553801U (en) * | 2019-03-18 | 2019-10-29 | 荣建胜 | Facilitate the sample apparatus for placing of sampling |
| CN111349603A (en) * | 2019-12-13 | 2020-06-30 | 上海欧易生物医学科技有限公司 | Dissociation method of breast cancer clinical puncture sample |
| CN111358573A (en) * | 2020-02-26 | 2020-07-03 | 西安交通大学医学院第二附属医院 | Hyperspectral imaging surgical area rapid detection and marking device and detection method |
| CN215692020U (en) * | 2021-09-13 | 2022-02-01 | 台州恩泽医疗中心(集团) | Operation specimen filtering bowl |
| CN114445362A (en) * | 2022-01-25 | 2022-05-06 | 腾讯科技（深圳）有限公司 | Image processing method, apparatus, device, readable storage medium and program product |
Non-Patent Citations (3)
| Title |
|---|
| 基于显微高光谱成像和深度神经网络的肺癌组织病理分析方法研究;宋璟;《中国优秀硕士学位论文全文数据库 医药卫生科技辑》(第12期);E072-111 * |
| 基于深度学习的胆管癌显微高光谱图像识别方法研究;段依璠;《中国优秀硕士学位论文全文数据库 医药卫生科技辑》(第12期);E072-303 * |
| 王华梁等.《医学实验室建设与质量管理》.上海：上海科学技术出版社,2021,第321页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115236015A (en) | 2022-10-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210076943A1 (en) | Optical speculum | |
| US6181414B1 (en) | Infrared spectroscopy for medical imaging | |
| US20020007122A1 (en) | Methods of diagnosing disease | |
| KR102567918B1 (en) | Optical speculum | |
| CN108319977B (en) | Cervical biopsy region identification method and device based on channel information multi-mode network | |
| JP2010181833A (en) | Microscopic observation system | |
| US8837790B2 (en) | Medical diagnosis support device | |
| CN109674438B (en) | Objective lens adjustable cavity endoscope detection device and laser scanning cavity endoscope | |
| CN101539456B (en) | General hyperspectral imaging component | |
| RU2504777C2 (en) | Method for cellular analysis of probe by means of virtual analytical plate | |
| JP2010261762A (en) | Specimen preparing device and specimen preparing method | |
| CN115236015B (en) | Puncture sample pathology analysis system and method based on hyperspectral imaging technology | |
| CN207600940U (en) | For the micro-imaging spectroscopic system of biological pathology slice assistant analysis | |
| US20210174147A1 (en) | Operating method of image processing apparatus, image processing apparatus, and computer-readable recording medium | |
| CN102369473A (en) | Method for preparing a processed virtual analysis plate | |
| CN109744983B (en) | Zoom type cavity endoscope detection device and laser scanning cavity endoscope | |
| CN109656014B (en) | Multipath fluorescence collection device and three-dimensional nonlinear laser scanning cavity endoscope | |
| Gawedzinski et al. | Toward development of a large field-of-view cancer screening patch (CASP) to detect cervical intraepithelial neoplasia | |
| CN110967302A (en) | Microbial panoramic smear detection device and detection method | |
| CN109730626B (en) | Cavity endoscope detection device and three-dimensional nonlinear laser scanning cavity endoscope | |
| JP3999615B2 (en) | Inspection image processing method | |
| CN115032780A (en) | Rapid processing system of tissue pathological picture and working method thereof | |
| Emam et al. | Comparative Study of Small Size Tumors using a Home-made Confocal Laser Scanning System and Spectroscopic Techniques | |
| CN117631253A (en) | Sample formed component analysis method and system | |
| CN118068030A (en) | Automatic urine sample analysis method and device combined with microscopic hyperspectral imaging technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |