CN103308452B - Optical projection tomography image capturing method based on depth-of-field fusion - Google Patents

Optical projection tomography image capturing method based on depth-of-field fusion Download PDF

Info

Publication number
CN103308452B
CN103308452B CN201310199983.1A CN201310199983A CN103308452B CN 103308452 B CN103308452 B CN 103308452B CN 201310199983 A CN201310199983 A CN 201310199983A CN 103308452 B CN103308452 B CN 103308452B
Authority
CN
China
Prior art keywords
image
matrix
dimensional image
pixel value
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310199983.1A
Other languages
Chinese (zh)
Other versions
CN103308452A (en
Inventor
田捷
郭进
董迪
杨鑫
马喜波
杨玉洁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Automation of Chinese Academy of Science
Original Assignee
Institute of Automation of Chinese Academy of Science
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Automation of Chinese Academy of Science filed Critical Institute of Automation of Chinese Academy of Science
Priority to CN201310199983.1A priority Critical patent/CN103308452B/en
Publication of CN103308452A publication Critical patent/CN103308452A/en
Application granted granted Critical
Publication of CN103308452B publication Critical patent/CN103308452B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

The invention discloses an optical projection tomography image capturing method based on depth-of-field fusion. The method comprises the following steps: step one, moving the relative position of a sample and a microscopic device under the same rotation angle, acquiring two-dimensional image sequences on different focusing positions; step two, selecting the clearest points of pixel positions in the two-dimensional image sequence, synthesizing to generate a panorama deep image. The different focusing position images acquired by optical projection tomography system can be fused through the method disclosed by the invention, the obtained panorama deep image is used for three-dimensional reconstruction, and the resolution of the three-dimensional image is improved.

Description

A kind of optical projection fault imaging image acquiring method merged based on the depth of field
Technical field
The present invention relates to a kind of optical projection tomography technology field, particularly relate to a kind of optical projection fault imaging image acquiring method merged based on the depth of field.
Background technology
Optical projection fault imaging (Optical Projection Tomography, OPT) technology can realize structure and the molecular specificity imaging of 1-10 mm-scale biological specimen.Thinner and the relative transparent of sample in OPT imaging process, visible ray is negligible through scattering effect during sample, and sample is absorption to photon main manifestations, therefore can think that light linearly propagates across sample.During OPT scanning, sample is fixed on a high-precision rotary platform, the LED of employing high stable or laser instrument are as irradiation source, be radiated on sample, highly sensitive electron multiplication formula ccd detector is transferred to after being amplified by microscope equipment through the light signal of sample, by ccd detector collection and imaging, system often gathers a width two-dimension projection, and universal stage rotates a fixed angle, piece image under system acquisition, the data for projection within the scope of gathering 360 ° altogether successively.Therefore, optical projection computed tomography (SPECT) system scanning collection to data be under a series of different angles light through the two-dimensional projection image of sample.Use filtered back-projection method to rebuild all projected images, can 3-D view be obtained.Two-dimension projection whether clear, is directly connected to the height of 3-D view resolution.
Optical projection tomography technology belongs to micro-imaging.In microoptic imaging, low-power microscope operating distance is long, and the depth of field is larger, and because micro objective focal depth range is little, along with the increase of enlargement factor, the depth of field can corresponding reduction.Only have those structures near focussing plane or its to be only visible, structure be the simplest even if this makes, the object of three dimensional depth relatively flat also can not in piece image focusing effect clear.And in optical projection fault imaging, sample thickness is generally 2 ~ 3mm, after high multiple amplifies, depth of field problem becomes particularly serious.And when observing sample, requiring that microscope imaging should have higher resolution to have the enough depth of field again, this is the contradiction of traditional optical hardware.But for optical projection fault imaging, this is again the problem having to solve, so depth of field problem is the bottleneck that restriction optical projection fault imaging obtains high-definition picture.
Summary of the invention
For solving the problem, the invention provides a kind of optical projection fault imaging image acquiring method merged based on the depth of field.The method comprises:
Step 1, by under the same anglec of rotation, the relative position of mobile sample and microscope equipment, gathers the two-dimensional image sequence on different focal position;
Step 2, in described two-dimensional image sequence, choose each location of pixels and synthesize the most clearly in this two-dimensional image sequence, generate full depth map.
The present invention can realize the different focal position image co-registration that optical projection computed tomography (SPECT) system gathers, and the full depth image obtained, for three-dimensional reconstruction, improves the resolution of 3-D view.
Accompanying drawing explanation
Fig. 1 is the principle schematic based on imaging system data acquisition in the optical projection fault imaging image acquiring method of depth of field fusion in the embodiment of the present invention;
Fig. 2 is the flow chart of steps based on Images uniting in the optical projection fault imaging image acquiring method of depth of field fusion in the embodiment of the present invention;
Fig. 3 is the specific experiment result figure based on the optical projection fault imaging image acquiring method of depth of field fusion in the embodiment of the present invention.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly understand, below in conjunction with specific embodiment, and with reference to accompanying drawing, the present invention is described in more detail.Although herein can providing package containing the demonstration of the parameter of particular value, should be appreciated that, parameter without the need to definitely equaling corresponding value, but is similar to described value in acceptable error margin or design constraint.
The invention discloses a kind of optical projection fault imaging image acquiring method merged based on the depth of field.The present invention specially for optical projection fault imaging under a certain fixing anglec of rotation, different focal position image carries out depth of field fusion, the pixel value choosing each location of pixels most articulation point on image sequence carries out image co-registration as the gray-scale value of this pixel on composograph, generate full depth map, thus improve the resolution of 3-D view.
Said method disclosed by the invention is divided into two key steps: data acquisition, image co-registration.Wherein, for utilizing, optical projection fault imaging gathers under a certain fixing anglec of rotation data acquisition step, the two-dimensional sequence image of different focal position; Image co-registration step, for synthesizing the most clearly in this two-dimensional image sequence according to location of pixels each in accessed two-dimensional image sequence, generates full depth map, for three-dimensional reconstruction, thus improves three-dimensional reconstruction body resolution.
The detailed step of said method disclosed by the invention is as follows:
Step S1: by under the same anglec of rotation, the relative position of mobile sample and microscope equipment, collects the two-dimensional image sequence on different focal position.
Optical projection tomography technology belongs to micro-imaging, when sample-size is very little, needs the microscope equipment adopting high-amplification-factor, carries out optical signal amplification.And during high multiple amplification, the depth of field becomes very little, and this will cause collecting each position image very clearly under a certain fixed angle thereupon.But when reality uses optical projection computed tomography (SPECT) system, require that imaging should have high resolution to have the enough depth of field again, this is the contradiction of traditional optical hardware.Effective ways of head it off utilize digital image processing techniques, carries out depth of field fusion to image sequence.
Fig. 1 shows imaging system in the present invention and carries out the principle schematic of data acquisition.As shown in Figure 1, microscope equipment and sample rotation center are on the same axis.By moving radially the relative position of sample and microscope equipment, and image data, all clear part of sample is included in collected image sequence.Horizontal moving stage step pitch is selected to move translation stage by one direction, makes sample image on the detector by fuzzy to clear, then to fuzzy.In whole process, after first time is fuzzy, the position of appearance first focus is the starting point of this image sequence acquisition, progressively equidistant mobile sample, after making image again fuzzy, a front focus position is terminal, records moved step number and step pitch, repeat the data acquisition of next angle, until gathered all data within the scope of 360 ° under different rotary angle.Wherein, before collection image, need adjustment sample position to be in the imaging region of detector, between collected two-dimensional image sequence, Y-axis and Z axis position do not change, and the sharpness of the full depth image that step pitch (position namely in the X-direction) impact between them finally generates; Horizontal moving stage move through computer software control, thus step pitch can be obtained accurately and uniform two-dimensional image sequence.
Step S2: in described two-dimensional image sequence, the pixel value choosing each location of pixels most articulation point on image sequence carries out image co-registration as the gray-scale value of this pixel on composograph, generates full depth map.The two-dimensional sequence image of multiple the different focal positions under a certain angle namely obtained for step S1, carries out depth of field fusion.
Fig. 2 shows the flow chart of steps of in the present invention, the sequence image of different focal position being carried out to depth of field fusion.As shown in Figure 2, this step specifically comprises:
The first step, according to the size of institute's acquisition sequence image, target setting composograph picture element matrix M 0with the size of the matrix T for intermediate data process, its size equals the pixel size of gathered image, and by M 0null matrix is initialized as with T, meanwhile, initialization comparison diagram sequence i=1;
Second step, inputs figure number of plies N to be compared, i.e. the image of the different focal position of a total N width;
3rd step, judge whether image to be compared has completed and compare, namely whether i equals N, compares if do not complete, then i=i+1, and turns to the 4th step, otherwise turns to the 6th step;
4th step, by image pixel matrix M to be compared iwith target composograph picture element matrix M 0compare, generate intermediary matrix T, in T, whole element is 0 or 1,1 representative M on relevant position ielement be greater than M 0in element; 0 representative M on relevant position ielement be not more than M 0in element; Wherein, image pixel matrix M to be compared iin the element pixel value that is image to be compared in gathered sequence image.
5th step, according to the intermediary matrix T more fresh target composograph picture element matrix M generated 0, namely in intermediary matrix, element is the position of 1, uses M iin element substitution M 0the element of relevant position, uses image M iin pixel value alternate image M 0the pixel value of relevant position, so far, completes the fusion of a tomographic image; Turn to the 3rd step to continue to judge, compare if do not complete, then repeat the 4th, the 5th step, otherwise turn to the 6th step;
6th step, completes image co-registration, exports target composograph picture element matrix M 0;
7th step, the depth of field of a certain angle merges and terminates, M 0corresponding image is the depth of field fused images under this angle.
Fig. 3 shows in the present invention and utilizes said method to carry out the result figure of imaging experiment to fruit bat pupa live body.Adopt live body fruit bat pupa to carry out the optical projection fault imaging of depth of field fusion treatment in experiment, the two dimensional image under gathering 360 ° altogether, the image of each angle acquisition 6 different focal positions, namely horizontal moving stage moves 5 times.
This experimental selection translation stage stepping 0.25 millimeter, mobile 5 times, gathers 6 images altogether.Its result as shown in Fig. 31,2,3,4,5,6, the two dimensional image collected under representing asynchronous distance respectively.Visible, in image sequence image by fuzzy to clear again to fuzzy, and often open and have part clearly.The image collected is preserved in order successively, is convenient to image co-registration.Wherein 7 be depicted as this angle under use the depth of field to merge the full depth image obtained, as seen from the figure, the clear position in this image collection Fig. 3 in 1 ~ 6 width figure.This will obviously improve the deficiency of single image, improves sharpness and the packets of information content of result images, for further scientific research analysis provides more sample information.
Above-described specific embodiment; object of the present invention, technical scheme and beneficial effect are further described; be understood that; the foregoing is only specific embodiments of the invention; be not limited to the present invention; within the spirit and principles in the present invention all, any amendment made, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (12)

1., based on the optical projection fault imaging image acquiring method that the depth of field merges, comprising:
Step 1, by under the same anglec of rotation, the relative position of mobile sample and microscope equipment, gathers the two-dimensional image sequence on different focal position;
Step 2, in described two-dimensional image sequence, choose each location of pixels and synthesize the most clearly in this two-dimensional image sequence, generate full depth map;
Wherein, step 2 specifically comprises:
The first step, according to the size of image in gathered two-dimensional image sequence, target setting composograph picture element matrix M 0with the size of the matrix T for intermediate data process, its size equals the pixel size of gathered image, and by M 0null matrix is initialized as with T, meanwhile, initialization movement images sequence number i=1;
Second step, inputs picture number N to be compared;
3rd step, judge whether image to be compared has completed and compare, namely whether i equals N, compares if do not complete, then i=i+1, and turns to the 4th step, otherwise turns to the 6th step;
4th step, by image pixel matrix M to be compared iwith target composograph picture element matrix M 0compare, generate intermediary matrix T, in T, whole element is 0 or 1,1 representative M on relevant position ielement be greater than M 0in element; 0 representative M on relevant position ielement be not more than M 0in element; Wherein, image pixel matrix M to be compared iin element be the pixel value of image to be compared in described two-dimensional image sequence;
5th step, according to the intermediary matrix T more fresh target composograph picture element matrix M generated 0, namely in intermediary matrix, element is the position of 1, uses M iin element substitution M 0the element of relevant position, uses image M iin pixel value alternate image M 0the pixel value of relevant position, so far, completes the fusion of a tomographic image; Turn to the 3rd step to continue to judge, compare if do not complete, then repeat the 4th, the 5th step, otherwise turn to the 6th step;
6th step, completes image co-registration, exports target composograph picture element matrix M 0;
7th step, the depth of field of a certain angle merges and terminates, M 0corresponding image is the depth of field fused images under this angle.
2. by method according to claim 1, it is characterized in that, the method gathers the two-dimensional image sequence within the scope of 360 ° under different rotary angle, after it first gathers the two-dimensional image sequence of the different focal positions under a certain angle, then rotate the two-dimensional image sequence gathering the different focal positions of this next angle to next angle.
3. by method according to claim 1, it is characterized in that, the relative position of described mobile sample and microscope equipment is that the position of moving sample in the X-axis direction by horizontal moving stage realizes.
4. by method according to claim 3, it is characterized in that, before gathering image, adjustment sample position is in the imaging region of detector.
5., by method according to claim 1, it is characterized in that, between collected two-dimensional image sequence, Y-axis and Z axis position do not change, and the sharpness of the full depth image that the step pitch impact between them finally generates.
6. by method according to claim 1, it is characterized in that, the computing machine that moves through of horizontal moving stage controls, thus can obtain step pitch accurately and uniform two-dimensional image sequence.
7. by method according to claim 1, it is characterized in that, the two dimensional image in step 2 on different focal position, according to the pixel value of every width image, to be chosen on this position the pixel value of pixel value as composograph of most articulation point.
8. by method according to claim 7, it is characterized in that, in step 2, image co-registration is by realizing by the respective pixel values of amplitude ratio compared with width image every in two-dimensional image sequence.
9. by method according to claim 8, it is characterized in that, during by amplitude ratio comparatively, first initialized target composograph picture element matrix, intermediary matrix and two-dimensional image sequence sequence number to be compared, utilize target composograph picture element matrix and image pixel matrix to be compared to generate intermediary matrix, and realized by the element pixel value in intermediary matrix more fresh target composograph picture element matrix.
10. by method according to claim 9, it is characterized in that, intermediary matrix is 0,1 matrix, if the element pixel value in image pixel matrix to be compared is greater than the respective element pixel value of target composograph picture element matrix, then the respective element of intermediary matrix is set to 1, otherwise is 0.
11. by method according to claim 9, it is characterized in that, intermediary matrix is used for the renewal of element pixel value in target composograph picture element matrix, is wherein that the element pixel value of the target composograph pixel corresponding to element position of 1 replaces with corresponding element pixel value in image pixel matrix to be compared by element value in intermediary matrix.
12. by method according to claim 9, and it is characterized in that, after completeer last piece image, the image that the target composograph picture element matrix obtained is corresponding is the full depth map finally obtained.
CN201310199983.1A 2013-05-27 2013-05-27 Optical projection tomography image capturing method based on depth-of-field fusion Active CN103308452B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310199983.1A CN103308452B (en) 2013-05-27 2013-05-27 Optical projection tomography image capturing method based on depth-of-field fusion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310199983.1A CN103308452B (en) 2013-05-27 2013-05-27 Optical projection tomography image capturing method based on depth-of-field fusion

Publications (2)

Publication Number Publication Date
CN103308452A CN103308452A (en) 2013-09-18
CN103308452B true CN103308452B (en) 2015-05-06

Family

ID=49133911

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310199983.1A Active CN103308452B (en) 2013-05-27 2013-05-27 Optical projection tomography image capturing method based on depth-of-field fusion

Country Status (1)

Country Link
CN (1) CN103308452B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104065859B (en) * 2014-06-12 2017-06-06 青岛海信电器股份有限公司 A kind of acquisition methods and camera head of full depth image
CN105451010A (en) * 2014-08-18 2016-03-30 惠州友华微电子科技有限公司 Depth of field acquisition device and acquisition method
CN105118088A (en) * 2015-08-06 2015-12-02 曲阜裕隆生物科技有限公司 3D imaging and fusion method based on pathological slice scanning device
TWI555378B (en) * 2015-10-28 2016-10-21 輿圖行動股份有限公司 An image calibration, composing and depth rebuilding method of a panoramic fish-eye camera and a system thereof
CN105407280B (en) * 2015-11-11 2019-02-12 Oppo广东移动通信有限公司 Panoramic image synthesis method and system
CN106339476B (en) * 2016-08-30 2019-10-29 北京寺库商贸有限公司 A kind of image processing method and system
JP7039179B2 (en) * 2017-04-13 2022-03-22 キヤノン株式会社 Information processing equipment, information processing system, information processing method and program
CN108495032B (en) * 2018-03-26 2020-08-04 Oppo广东移动通信有限公司 Image processing method, image processing device, storage medium and electronic equipment
CN111381357B (en) * 2018-12-29 2021-07-20 中国科学院深圳先进技术研究院 Image three-dimensional information extraction method, object imaging method, device and system
CN110160956B (en) * 2019-05-27 2022-04-01 广州英特美迪科技有限公司 Pathological section scanning image analysis system and scanning method thereof
CN111242880B (en) * 2019-12-30 2023-05-02 广州市明美光电技术有限公司 Multi-depth-of-field image superposition method, equipment and medium for microscope
CN111861915B (en) * 2020-07-08 2021-08-13 北京科技大学 Method and device for eliminating defocusing diffusion effect in microscopic imaging scene
WO2023102724A1 (en) * 2021-12-07 2023-06-15 宁德时代新能源科技股份有限公司 Image processing method and system
CN114881907B (en) * 2022-06-30 2022-09-23 江苏集萃苏科思科技有限公司 Optical microscopic image multi-depth-of-field focus synthesis method and system and image processing method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101615289A (en) * 2009-08-05 2009-12-30 北京优纳科技有限公司 The three-dimensional acquisition of biopsy tissues and fusion method of multilayer images
CN102727188A (en) * 2012-07-26 2012-10-17 中国科学院自动化研究所 Optical projection tomography method based on merged spiral scanning mode
CN102973246A (en) * 2012-12-03 2013-03-20 中国科学院自动化研究所 Optical projection tomography method capable of automatically processing depth of field
CN103065359A (en) * 2013-01-14 2013-04-24 厦门大学 Optical imaging three-dimensional contour reconstruction system and reconstruction method
CN103110425A (en) * 2013-03-11 2013-05-22 西安电子科技大学 Cone-beam X-ray luminescence tomography system of combination imaging and method thereof

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8508591B2 (en) * 2010-02-05 2013-08-13 Applied Vision Corporation System and method for estimating the height of an object using tomosynthesis-like techniques

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101615289A (en) * 2009-08-05 2009-12-30 北京优纳科技有限公司 The three-dimensional acquisition of biopsy tissues and fusion method of multilayer images
CN102727188A (en) * 2012-07-26 2012-10-17 中国科学院自动化研究所 Optical projection tomography method based on merged spiral scanning mode
CN102973246A (en) * 2012-12-03 2013-03-20 中国科学院自动化研究所 Optical projection tomography method capable of automatically processing depth of field
CN103065359A (en) * 2013-01-14 2013-04-24 厦门大学 Optical imaging three-dimensional contour reconstruction system and reconstruction method
CN103110425A (en) * 2013-03-11 2013-05-22 西安电子科技大学 Cone-beam X-ray luminescence tomography system of combination imaging and method thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
旋转扫描序列图像的全景图拼接方法;王会峰;《光学学报》;20090531;第29卷(第5期);第1211-1215页 *

Also Published As

Publication number Publication date
CN103308452A (en) 2013-09-18

Similar Documents

Publication Publication Date Title
CN103308452B (en) Optical projection tomography image capturing method based on depth-of-field fusion
CN102980664B (en) Superpixel micro-scanning method and corresponding infrared super-resolution real-time imaging device
CA2904111C (en) High-resolution computed tomography
CN105158893B (en) The optical field imaging method of programmable aperture microscopic system based on LCD
CN104390981B (en) The method of quick and precisely focusing scanning pathological section tissue based on image collecting device
CN107709968A (en) Fluorescence biopsy sample imager and method
CN105264360A (en) Helical computed tomography
JP2017063414A (en) Method and apparatus for generating data representative of light field
CN109118544A (en) Synthetic aperture imaging method based on perspective transform
CN113267141B (en) Microscopic three-dimensional information acquisition equipment
Piccinini et al. Automated image mosaics by non‐automated light microscopes: the MicroMos software tool
CN104459971A (en) Structured light illuminating microscopic imaging system based on integrated photonic chip
CN102822660A (en) Tomographic Light Field Microscope
CN105704371A (en) Light field refocusing method
CN106908942A (en) The parallel microscopic imaging apparatus of high-resolution based on microlens array
CN107145052B (en) Holographic microscopic imaging method based on digital interpolative and phase iteration
CN104713864B (en) The geometric correction method of the optical projection computed tomography (SPECT) system based on imitative body
CN109856169A (en) A kind of micro- power spectrum CT imaging method and system of high-resolution
CN106530226A (en) Realization method for obtaining high-resolution high-definition industrial image
CN105651699B (en) It is a kind of based on the dynamic of area array cameras with burnt method
CN106934110A (en) A kind of filtered back-projection method and device that light field is rebuild by focusing storehouse
CN102727188B (en) Optical projection tomography method based on merged spiral scanning mode
US7813529B1 (en) Optical 3-d surface tomography using depth from focus of partially overlapping 2-d images
CN106097411B (en) CT machine image rebuilding method and high resolution ct scanning machine
Gao et al. Single-cell volumetric imaging with light field microscopy: Advances in systems and algorithms

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant