CN115560700B - Icing three-dimensional shape online measurement method based on color polarization imaging - Google Patents

Icing three-dimensional shape online measurement method based on color polarization imaging Download PDF

Info

Publication number
CN115560700B
CN115560700B CN202211546549.1A CN202211546549A CN115560700B CN 115560700 B CN115560700 B CN 115560700B CN 202211546549 A CN202211546549 A CN 202211546549A CN 115560700 B CN115560700 B CN 115560700B
Authority
CN
China
Prior art keywords
channel
laser
dimensional
icing
line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211546549.1A
Other languages
Chinese (zh)
Other versions
CN115560700A (en
Inventor
左承林
马军
魏龙涛
孙冬宁
熊浩
梁磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Low Speed Aerodynamics Institute of China Aerodynamics Research and Development Center
Original Assignee
Low Speed Aerodynamics Institute of China Aerodynamics Research and Development Center
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Low Speed Aerodynamics Institute of China Aerodynamics Research and Development Center filed Critical Low Speed Aerodynamics Institute of China Aerodynamics Research and Development Center
Priority to CN202211546549.1A priority Critical patent/CN115560700B/en
Publication of CN115560700A publication Critical patent/CN115560700A/en
Application granted granted Critical
Publication of CN115560700B publication Critical patent/CN115560700B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/002Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B64AIRCRAFT; AVIATION; COSMONAUTICS
    • B64FGROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
    • B64F5/00Designing, manufacturing, assembling, cleaning, maintaining or repairing aircraft, not otherwise provided for; Handling, transporting, testing or inspecting aircraft components, not otherwise provided for
    • B64F5/60Testing or inspecting aircraft components or systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Manufacturing & Machinery (AREA)
  • Transportation (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention relates to the technical field of ice shape measurement, and provides an icing three-dimensional shape online measurement method based on color polarization imaging. Performing multi-channel separation on a calibration plate image acquired by a color polarization camera to obtain a multi-channel image, wherein the multi-channel image comprises different colors and different polarization states; then, respectively processing the multi-channel images, extracting laser lines and then resolving three-dimensional coordinates of the laser lines; carrying out plane fitting on the three-dimensional coordinates of the laser lines of each channel; then, calculating the laser line three-dimensional coordinates of each channel obtained by on-line measurement based on the calibrated plane fitting result of the laser line of each channel; and finally, unifying the three-dimensional coordinates of the laser lines of all the channels into a world coordinate system, thereby obtaining a complete ice-shaped three-dimensional profile. The icing three-dimensional shape online measuring method can improve the definition of an icing shooting image and improve the measuring precision.

Description

Icing three-dimensional shape online measurement method based on color polarization imaging
Technical Field
The invention relates to the technical field of ice shape measurement, in particular to an icing three-dimensional shape online measurement method based on color polarization imaging.
Background
Researches find that icing phenomenon in the flight process is one of main causes of airplane flight safety. Icing at different parts of the airplane can cause influence in different degrees, for example, icing at wings and the tail of the airplane can cause change of a turbulent flow field, so that aerodynamic performance, maneuverability and stability of the airplane are seriously influenced; icing of the engine inlet may cause the engine to stall, compromising flight safety. Therefore, the method has important significance in exploring the icing mechanism, evaluating the aerodynamic performance and safety of the aircraft under the icing meteorological condition, and carrying out research works such as ice prevention and removal and the like. In order to explore the icing mechanism and perform researches such as aircraft aerodynamic performance evaluation under icing meteorological conditions, researchers need to measure and research the icing appearance of a flight component under different meteorological environments. There are mainly 3 ways to obtain the icing profile: carrying out numerical simulation calculation; carrying out flight test; and (5) performing ground simulation test. The ground simulation test is a main means for acquiring the icing appearance due to low cost and capability of obtaining quantitative results. The ground simulation test is usually performed in an icing wind tunnel. The refined icing three-dimensional shape information has important value for improving the calculation accuracy of the airplane aerodynamic force CFD under the icing condition. Therefore, there is an urgent need for a method that can be used for on-line three-dimensional measurement of ice shape during ice growth.
Scholars at home and abroad try to carry out semi-online measurement on the ice cross section outline and the three-dimensional shape by adopting a three-dimensional scanner non-contact measurement method based on surface structured light, but because the reflection coefficient and the transmission coefficient of an ice surface are low and high, a dark coating needs to be sprayed on the ice surface to obtain a high-contrast coding pattern image, so that the application range of the measurement method is greatly limited, and the method cannot be used for online measurement.
Compared with the coding stripes projected by a projector, the line laser projected by the laser has the advantages of concentrated brightness, high image contrast and the like, is widely applied to the field of industrial three-dimensional measurement, and can obtain a better observation image without spraying dark paint on the frozen surface. A series of research works and a series of exploratory experiments conducted by later students prove the feasibility of the laser triangulation method in the surface profile measurement of the icing model and the advantages of the laser triangulation method over the traditional ice shape measurement method.
However, the reflectance of the ice is very low over the entire recorded spectral range, and in the visible range, only less than 2% of the incident light is reflected at the object plane. Because the transparency of the ice is high and the surface is smooth, the line laser is projected on the surface of the ice, most light rays are projected into the ice, only a small part of the light rays are reflected by the surface of the ice, so that the laser band area of the collected image is seriously diffused and is a bright spot area on the image, and the camera is difficult to obtain clear light bar patterns, so that the measurement precision is low, and the ice-shaped structure cannot be accurately obtained.
Patent CN201910943972.7 discloses a polarization imaging-based ice shape three-dimensional measurement method, which uses a polarization camera to filter out the influence of scattered stray light, thereby performing ice shape three-dimensional measurement. However, in practice, it is found that although the method can improve the definition of the obtained light bar to a certain extent, the clear light bar still cannot be obtained when the open ice is measured in three dimensions, and the problem that the measurement precision is low and the ice-shaped structure cannot be accurately obtained still exists.
Disclosure of Invention
In order to solve the defects in the prior art, the icing three-dimensional shape online measuring method is characterized in that a color polarization camera is adopted to perform online measurement on the icing three-dimensional shape, a shot laser line image is separated into 4H channel images, the images of each channel are processed independently, after the laser lines are extracted, the three-dimensional coordinates of the laser lines are respectively calculated and then are combined and unified into the same world coordinate system, and therefore a clear three-dimensional ice shape outline is obtained.
The application provides an icing three-dimensional shape online measuring method based on color polarization imaging, which comprises the following steps:
s00, calibrating the color polarization camera;
s01, placing the calibration plate at the j-th pose, projecting laser sheet light to the surface of the calibration plate by the line laser to form a laser line, and acquiring an image of the calibration plate at the j-th pose by using a color polarization camera;
the color filter array of the color polarization camera is in a Bayer format, and H polarization filter arrays in different directions are superposed on each color filter;
s02. Let j = j +1, repeat step S01, j =1,2, ·, M; m is the total pose number of the calibration plate;
s03, separating each acquired calibration board image into 4H channel images;
s04, respectively calibrating all calibration plate images based on each channel to obtain camera internal reference matrixes corresponding to different channels, rotation matrixes and translation vectors between camera coordinate systems of different channels and calibration plate coordinate systems of different poses, and rotation matrixes and translation vectors between camera coordinate systems of different channels and a world coordinate system;
s05, extracting laser lines from all the calibration plate images of each channel, and resolving to obtain three-dimensional coordinates of the laser lines;
s06, performing plane fitting on the three-dimensional coordinates of the laser line of each channel to obtain a plane equation coefficient (a) of the laser sheet light under each channel i ,b i ,c i ) Wherein i =1,2, …, N; i is a channel number, and N =4H;
s07, controlling the line laser to rotate and scan, and repeating the steps S00-S06 at each rotating position to obtain the plane equation coefficient of the laser sheet light under each channel at different rotating positions
Figure 575439DEST_PATH_IMAGE001
l=1,2,…,L;lIs the line laser rotational position and L is the total number of rotational positions.
Further, in step S05, a specific algorithm for calculating the three-dimensional coordinate of the laser line is as follows:
Figure 383864DEST_PATH_IMAGE002
wherein, the first and the second end of the pipe are connected with each other,
Figure 96605DEST_PATH_IMAGE003
is the three-dimensional coordinate of the kth point on the laser line on the surface of the calibration plate at the jth pose under the camera coordinate system corresponding to the ith channel image,
Figure 83015DEST_PATH_IMAGE004
is the three-dimensional coordinate of the kth point on the laser line on the surface of the calibration plate at the jth pose under the coordinate system of the calibration plate at the jth pose,
Figure 264729DEST_PATH_IMAGE005
the coordinate of the kth point on the laser line of the surface of the calibration plate at the jth pose in the ith channel image of the calibration plate at the jth pose is determined,
Figure 361998DEST_PATH_IMAGE006
is a proportionality coefficient, A i For calibrating the camera internal reference matrix corresponding to the ith channel image,
Figure 194825DEST_PATH_IMAGE007
and
Figure 86558DEST_PATH_IMAGE008
a rotation matrix and a translation vector between a camera coordinate system corresponding to the ith channel image and a calibration plate coordinate system of the jth pose are obtained;
s10, icing measurement is carried out;
s11, restoring the line laser to a calibrated initial position, controlling the line laser to rotate, enabling the laser line projected to the icing surface to scan the icing, and synchronously triggering a color polarization camera to acquire a laser line image of the icing surface at each calibrated rotating position;
s12, separating the laser line images at all the rotating positions into 4H channel images;
s13, extracting laser lines from the laser line images of all the channels at each rotating position to obtain two-dimensional image coordinates of the laser lines, and resolving to obtain three-dimensional coordinates of the laser lines under a camera coordinate system of each channel based on the calibrated camera internal reference matrix corresponding to each channel at the rotating position and the plane equation coefficient of the laser sheet light to obtain an ice-shaped three-dimensional profile:
Figure 254103DEST_PATH_IMAGE009
wherein the content of the first and second substances,
Figure 155062DEST_PATH_IMAGE010
is as followslThree-dimensional coordinates of the kth point on the laser line of each rotation position in the camera coordinate system corresponding to the ith channel image,
Figure 576816DEST_PATH_IMAGE011
Is as followslThe corresponding two-dimensional image coordinates of the k point on the laser line of each rotation position,
Figure 905030DEST_PATH_IMAGE006
is a proportionality coefficient, A i Calibrating a camera internal reference matrix corresponding to the ith channel image;
and S14, unifying the ice-shaped three-dimensional profiles obtained by resolving different channels into the same world coordinate system based on the calibrated rotation matrix and translation vector between the camera coordinate system corresponding to each channel and the world coordinate system at different rotation positions to obtain a complete ice-shaped three-dimensional profile.
Compared with the prior art, the icing three-dimensional shape online measuring method based on the color polarization imaging at least has the following beneficial effects:
(1) According to the method and the device, the images acquired by the color polarization camera are separated, processed respectively and then combined, so that the characteristic information can be extracted respectively for processing by utilizing the reaction characteristics of light and ice in different colors and different polarization states, the ice shooting effect is improved, and the definition of the shot images is improved;
(2) The method can finish multiple measurements after once calibration, is simple and easy to implement on-line measurement, has high speed and high precision, and is very suitable for on-line ice shape measurement of open ice and mixed ice.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention or the description of the prior art will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a calibration method of a color polarization camera according to embodiment 1;
FIG. 2 is a schematic diagram showing an image format of the color polarization camera of embodiment 1;
FIG. 3 is a schematic view of an image separated by the polarization state of FIG. 2 in example 1;
FIG. 4 is a schematic diagram of an image separated by color channels from the image of FIG. 3 in the 90 ° polarization state in example 1;
fig. 5 is a schematic flow chart of an icing three-dimensional shape online measurement method based on color polarization imaging in embodiment 1.
Detailed Description
The following description provides many different embodiments, or examples, for implementing different features of the invention. The particular examples set forth below are illustrative only and are not intended to be limiting.
Example 1
An icing three-dimensional shape online measurement method based on color polarization imaging is shown in fig. 5, and comprises the following steps: s00, calibrating the color polarization camera; namely, the camera is calibrated first, as shown in fig. 1, the camera calibration includes the following steps:
s01, placing the calibration plate at the j-th pose, projecting laser sheet light to the surface of the calibration plate by the line laser to form a laser line, and acquiring an image of the calibration plate at the j-th pose by using a color polarization camera;
the color filter array of the color polarization camera is in a Bayer format, and H polarization filter arrays in different directions are superposed on each color filter;
s02. Let j = j +1, repeat step S01, j =1,2,. Once, M; and M is the total pose number of the calibration plate.
The Bayer format is RGGB, R is red, and a red filter transmits red wavelength; g is green, and a green filter transmits green wavelength; b is blue, and the blue filter transmits blue wavelengths. In this embodiment, each color filter is superimposed with 4 polarization filter arrays in different directions, which are polarization filters of 0 °,45 °,90 °, and 135 °, respectively, and the image format of the formed color polarization camera is as shown in fig. 2. In this embodiment, the pose of the calibration board is greater than or equal to 2.
S03, separating each acquired calibration board image into 4H channel images;
in this step, each of the calibration plate images acquired in steps S01 and S02 is subjected to multi-pass separation, specifically, as shown in fig. 2 to 4.
Firstly, separation is performed according to polarization states, 4 polarization states (i.e. H = 4) are adopted in this embodiment, and taking an image in a certain pose as an example, four images are separated according to polarization states of 0 °,45 °,90 °, and 135 °, as shown in fig. 3;
secondly, further separating the images of each polarization state according to the color channels to obtain the images of the following 16 channels: r channel image at 0 degree polarization state, G at 0 degree polarization state 1 Channel image, G at 0 ° polarization 2 A channel image, a B channel image in a 0-degree polarization state;
r channel image at 45 ° polarization, G at 45 ° polarization 1 Channel image, G at 45 ° polarization 2 A channel image, a B channel image in a 45-degree polarization state;
r channel image in 90 ° polarization state, G in 90 ° polarization state 1 Channel image, G at 90 ° polarization 2 Channel image, B channel image in 90 ° polarization state, as shown in fig. 4;
r channel image at 135 ° polarization, G at 135 ° polarization 1 Channel image, G at 135 ° polarization 2 Channel image, B-channel image in 135 ° polarization state.
After the images of 16 channels are obtained, the 16 images are respectively subjected to interpolation demosaicing processing to improve the resolution of the images, and a specific method is the prior art in the field and is not described herein any more, so that a complete image of 16 channels can be obtained.
S04, respectively calibrating all calibration board images based on each channel to obtain camera internal reference matrixes A corresponding to different channels i Rotation matrix between different channel camera coordinate systems and different pose calibration plate coordinate systems
Figure 795756DEST_PATH_IMAGE007
And translation vector
Figure 500407DEST_PATH_IMAGE008
(ii) a Wherein i is the number of channels;
in this step, rotation matrixes between the coordinate systems of the cameras of different channels and the world coordinate system need to be acquired simultaneously
Figure 42247DEST_PATH_IMAGE012
And translation vector
Figure 541361DEST_PATH_IMAGE013
And the device is convenient to use in the subsequent measurement process.
Preferably, a Zhang Zhengyou calibration method is adopted for calibration, and since the Zhang Zhengyou calibration method is the prior art, the details are not described herein;
s05, extracting laser lines from all the calibration plate images of each channel, and resolving to obtain three-dimensional coordinates of the laser lines: preferably, the steger algorithm is used for laser line extraction, which is not described herein.
Figure 417919DEST_PATH_IMAGE002
Wherein the content of the first and second substances,
Figure 395103DEST_PATH_IMAGE003
is the three-dimensional coordinate of the kth point on the laser line on the surface of the calibration plate at the jth pose under the camera coordinate system corresponding to the ith channel image,
Figure 260291DEST_PATH_IMAGE004
is the three-dimensional coordinate of the kth point on the laser line on the surface of the calibration plate at the jth pose under the coordinate system of the calibration plate at the jth pose,
Figure 399148DEST_PATH_IMAGE005
setting a two-dimensional image of a k point on a laser line on the surface of the calibration plate in the j position on the ith channel image of the calibration plate in the j positionThe target is a number of items,
Figure 44893DEST_PATH_IMAGE006
is a scale factor.
S06, performing plane fitting on the three-dimensional coordinates of the laser line of each channel, preferably performing plane fitting by using a least square method, and obtaining a plane equation coefficient (a) of the laser sheet light under each channel i ,b i ,c i ) Wherein i =1,2, …, N; i is a channel number, and N =4H;
this yields the plane equation for the 16-channel laser sheet:
Figure 294609DEST_PATH_IMAGE014
i=1,2,…,16;
wherein x, y and z are axes of a space rectangular coordinate system;
s07, controlling the line laser to rotate and scan, repeating the steps S00-S06 at each rotating position, and obtaining the plane equation coefficient of the laser sheet light under each channel at different rotating positions
Figure 92931DEST_PATH_IMAGE015
l=1,2,…,L;lIs the line laser rotational position and L is the total number of rotational positions.
In the rotation process of the line laser, an initial position can be set, and the line laser starts to rotate from the initial position every time of calibration and/or measurement, or starts from any rotation position without setting the initial position until the calibration and measurement of all rotation positions are completed.
And starting to carry out icing measurement after the camera is calibrated. It should be noted that camera calibration is not required before each icing measurement, and those skilled in the art will appreciate that multiple icing measurements may be taken after the camera has been calibrated under the same conditions.
The step of icing measurement comprises:
s11, restoring the line laser to a calibrated initial position, controlling the line laser to rotate, enabling the laser line projected to the icing surface to scan the icing, and synchronously triggering a color polarization camera to acquire a laser line image of the icing surface at each calibrated rotating position;
in the step, the line laser starts scanning from a calibrated initial position, rotates within the scanning range of the laser, completes scanning of all calibrated positions, and shoots laser line images of all calibrated positions.
S12, separating the laser line images at all the rotating positions into 4H channel images;
in this step, the laser line image separation method of each channel is the same as the image separation method of each channel when the camera is calibrated, and details are not described herein, but it should be noted that, in the measurement process, the selected polarization state should be the same as the polarization state selected when the camera is calibrated, so that the measurement accuracy can be ensured.
S13, extracting laser lines from the laser line images of all the channels at all the rotating positions to obtain two-dimensional image coordinates of the laser lines
Figure 402690DEST_PATH_IMAGE011
Based on the calibrated camera internal reference matrix A corresponding to each channel at the rotation position i And the plane equation coefficient of the laser sheet
Figure 801310DEST_PATH_IMAGE015
Resolving to obtain three-dimensional coordinates of the laser lines under the camera coordinate system of each channel to obtain an ice-shaped three-dimensional profile:
Figure 120296DEST_PATH_IMAGE009
wherein the content of the first and second substances,
Figure 960076DEST_PATH_IMAGE010
is as followslThe three-dimensional coordinates of the kth point on the laser line of each rotation position in the camera coordinate system corresponding to the ith channel image,
Figure 440736DEST_PATH_IMAGE011
is a firstlLaser line of a rotating positionThe coordinates of the corresponding two-dimensional image of the k-th point,
Figure 44762DEST_PATH_IMAGE006
is a proportionality coefficient, A i Calibrating a camera internal reference matrix corresponding to the ith channel image;
s14, based on the rotation matrix between the camera coordinate system and the world coordinate system corresponding to each channel under different calibrated rotation positions
Figure 901859DEST_PATH_IMAGE012
And translation vector
Figure 658463DEST_PATH_IMAGE013
Unifying the ice-shaped three-dimensional profiles obtained by resolving different channels into the same world coordinate system to obtain a complete ice-shaped three-dimensional profile:
Figure 310024DEST_PATH_IMAGE016
wherein the content of the first and second substances,
Figure 433969DEST_PATH_IMAGE017
is as followsiIce-shaped three-dimensional profile obtained by resolving individual channelkIs spotted oniThree-dimensional coordinates in a camera coordinate system corresponding to the channel images,
Figure 94757DEST_PATH_IMAGE018
the three-dimensional coordinates of the kth point in the ice-shaped three-dimensional contour under the unified world coordinate system are obtained.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims (8)

1. An icing three-dimensional shape online measurement method based on color polarization imaging is characterized by comprising the following steps:
s00, calibrating the color polarization camera;
s01, placing the calibration plate at the j-th pose, projecting laser sheet light to the surface of the calibration plate by the line laser to form a laser line, and acquiring an image of the calibration plate at the j-th pose by using a color polarization camera;
the color filter array of the color polarization camera is in a Bayer format, and H polarization filter arrays in different directions are superposed on each color filter;
s02. Let j = j +1, repeat step S01 until j = M; j =1,2, · M; m is the total pose number of the calibration plate;
s03, separating each acquired calibration board image into 4H channel images;
s04, respectively calibrating based on all calibration plate images of each channel to obtain camera internal reference matrixes corresponding to different channels, rotation matrixes and translation vectors between camera coordinate systems of different channels and calibration plate coordinate systems of different poses, and rotation matrixes and translation vectors between camera coordinate systems of different channels and a world coordinate system;
s05, extracting laser lines from all the calibration plate images of each channel, and resolving to obtain three-dimensional coordinates of the laser lines;
s06, performing plane fitting on the three-dimensional coordinates of the laser line of each channel to obtain a plane equation coefficient (a) of the laser sheet light under each channel i , b i , c i ) Wherein i =1,2, …, N; i is a channel number, and N =4H;
s07, controlling the line laser to rotate and scan, and repeating the steps S00-S06 at each rotating position to obtain the plane equation coefficient of the laser sheet light under each channel at different rotating positions
Figure 896861DEST_PATH_IMAGE001
l=1,2,…,L;lIs the rotation position of the line laser, and L is the total number of the rotation positions;
s10, icing measurement is carried out;
s11, restoring the line laser to a calibrated initial position, controlling the line laser to rotate, enabling the laser line projected to the icing surface to scan the icing, and synchronously triggering a color polarization camera to acquire a laser line image of the icing surface at each calibrated rotating position;
s12, separating the laser line images at all the rotating positions into 4H channel images;
s13, extracting laser lines from the laser line images of all the channels at each rotating position to obtain two-dimensional image coordinates of the laser lines, and resolving to obtain three-dimensional coordinates of the laser lines under a camera coordinate system of each channel based on the calibrated camera internal reference matrix corresponding to each channel at the rotating position and the plane equation coefficient of the laser sheet light to obtain an ice-shaped three-dimensional profile:
Figure 984903DEST_PATH_IMAGE002
wherein the content of the first and second substances,
Figure 314253DEST_PATH_IMAGE003
is as followslThe three-dimensional coordinates of the kth point on the laser line of each rotation position in the camera coordinate system corresponding to the ith channel image,
Figure 513154DEST_PATH_IMAGE004
is as followslThe corresponding two-dimensional image coordinates of the k point on the laser line of each rotation position,
Figure 493617DEST_PATH_IMAGE005
is a proportionality coefficient, A i Calibrating a camera internal reference matrix corresponding to the ith channel image;
and S14, unifying the ice-shaped three-dimensional profiles obtained by resolving different channels into the same world coordinate system based on the calibrated rotation matrix and translation vector between the camera coordinate system corresponding to each channel and the world coordinate system at different rotation positions to obtain a complete ice-shaped three-dimensional profile.
2. The icing three-dimensional shape online measuring method based on color polarization imaging according to claim 1, wherein the 4H channel image comprises: r color H polarization channel, G1 color H polarization channel, G2 color H polarization channel, B color H polarization channel, H = 1.
3. The method for on-line measurement of three-dimensional ice formation appearance based on color polarization imaging as claimed in claim 2, wherein H =4.
4. The method as claimed in claim 3, wherein the 4 polarizing filter arrays with different directions comprise filters arranged at 0 °,45 °,90 °,135 °.
5. The icing three-dimensional shape online measuring method based on color polarization imaging according to any one of claims 1 to 4, wherein in the step S05, a specific algorithm for calculating the three-dimensional coordinates of the laser line is as follows:
Figure 18139DEST_PATH_IMAGE006
wherein the content of the first and second substances,
Figure 772468DEST_PATH_IMAGE007
is the three-dimensional coordinate of the kth point on the laser line on the surface of the calibration plate at the jth pose under the camera coordinate system corresponding to the ith channel image,
Figure 322530DEST_PATH_IMAGE008
is the three-dimensional coordinate of the kth point on the laser line on the surface of the calibration plate at the jth pose under the coordinate system of the calibration plate at the jth pose,
Figure 845915DEST_PATH_IMAGE009
the coordinate of the k point on the laser line on the surface of the calibration plate in the j pose in the ith channel image of the calibration plate in the j pose is calibrated,
Figure 338076DEST_PATH_IMAGE005
is a proportionality coefficient, A i For calibrating the camera internal reference matrix corresponding to the obtained ith channel image,
Figure 314122DEST_PATH_IMAGE010
and
Figure 854825DEST_PATH_IMAGE011
and a rotation matrix and a translation vector between a camera coordinate system corresponding to the ith channel image and a calibration board coordinate system of the jth pose are obtained.
6. The method for on-line measurement of the three-dimensional icing shape based on the color polarization imaging as claimed in claim 1, wherein in step S04, a Zhang Zhengyou calibration method is adopted for calibration.
7. The method for on-line measurement of three-dimensional icing shape based on color polarization imaging as claimed in claim 1, wherein in step S03 and step S12, after the 4H channel images are separated, interpolation demosaicing processing is performed on each channel image.
8. The method for on-line measurement of three-dimensional icing shape based on color polarization imaging as claimed in claim 1, wherein a steger algorithm is used for laser line extraction.
CN202211546549.1A 2022-12-05 2022-12-05 Icing three-dimensional shape online measurement method based on color polarization imaging Active CN115560700B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211546549.1A CN115560700B (en) 2022-12-05 2022-12-05 Icing three-dimensional shape online measurement method based on color polarization imaging

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211546549.1A CN115560700B (en) 2022-12-05 2022-12-05 Icing three-dimensional shape online measurement method based on color polarization imaging

Publications (2)

Publication Number Publication Date
CN115560700A CN115560700A (en) 2023-01-03
CN115560700B true CN115560700B (en) 2023-02-03

Family

ID=84770318

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211546549.1A Active CN115560700B (en) 2022-12-05 2022-12-05 Icing three-dimensional shape online measurement method based on color polarization imaging

Country Status (1)

Country Link
CN (1) CN115560700B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116499362B (en) * 2023-06-26 2023-09-15 太原科技大学 Steel plate size online measurement system
CN117387524B (en) * 2023-12-13 2024-02-13 中国空气动力研究与发展中心低速空气动力研究所 High dynamic range three-dimensional measurement method and system
CN117490969B (en) * 2023-12-27 2024-03-19 中国空气动力研究与发展中心低速空气动力研究所 Complete ice shape online measurement method for icing wind tunnel

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2158030A1 (en) * 1993-03-09 1994-09-15 Joseph J. Gerardi Method of and apparatus for measuring ice distribution profiles
CN102753818A (en) * 2009-07-23 2012-10-24 利瓦斯有限责任公司 Detection of ice on airfoils
WO2013188520A2 (en) * 2012-06-12 2013-12-19 Yale University Multimode optical fiber spectrometer
EP3399338A1 (en) * 2017-05-04 2018-11-07 The Boeing Company Light detection and ranging (lidar) ice detection system
EP3437998A1 (en) * 2017-08-01 2019-02-06 Honeywell International Inc. Managing response to icing threat
CN109544576A (en) * 2018-11-23 2019-03-29 中国空气动力研究与发展中心低速空气动力研究所 A kind of model aircraft ice shape contour extraction method based on machine vision
CN109813429A (en) * 2019-03-27 2019-05-28 北京理工大学 A kind of point-by-point scaling method of polarized imaging system
CN110645921A (en) * 2019-09-30 2020-01-03 武汉理工大学 Ice-shaped three-dimensional measurement method based on polarization imaging
CN110929691A (en) * 2019-12-11 2020-03-27 中国科学院长春光学精密机械与物理研究所 Ice layer detection method, device, equipment and readable storage medium
CN111047649A (en) * 2018-10-15 2020-04-21 华东交通大学 Camera high-precision calibration method based on optimal polarization angle
CN111289206A (en) * 2020-04-28 2020-06-16 中国空气动力研究与发展中心低速空气动力研究所 Ice shape measurement auxiliary device and method
CN114485483A (en) * 2022-04-15 2022-05-13 中国空气动力研究与发展中心低速空气动力研究所 Multi-camera combined imaging-based ice shape online measurement method and device
CN114485477A (en) * 2022-04-15 2022-05-13 中国空气动力研究与发展中心低速空气动力研究所 Icing three-dimensional shape online measuring method and device

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2158030A1 (en) * 1993-03-09 1994-09-15 Joseph J. Gerardi Method of and apparatus for measuring ice distribution profiles
CN102753818A (en) * 2009-07-23 2012-10-24 利瓦斯有限责任公司 Detection of ice on airfoils
WO2013188520A2 (en) * 2012-06-12 2013-12-19 Yale University Multimode optical fiber spectrometer
EP3399338A1 (en) * 2017-05-04 2018-11-07 The Boeing Company Light detection and ranging (lidar) ice detection system
CN108802743A (en) * 2017-05-04 2018-11-13 波音公司 Light detection and ranging LIDAR ice detecting systems
EP3437998A1 (en) * 2017-08-01 2019-02-06 Honeywell International Inc. Managing response to icing threat
CN111047649A (en) * 2018-10-15 2020-04-21 华东交通大学 Camera high-precision calibration method based on optimal polarization angle
CN109544576A (en) * 2018-11-23 2019-03-29 中国空气动力研究与发展中心低速空气动力研究所 A kind of model aircraft ice shape contour extraction method based on machine vision
CN109813429A (en) * 2019-03-27 2019-05-28 北京理工大学 A kind of point-by-point scaling method of polarized imaging system
CN110645921A (en) * 2019-09-30 2020-01-03 武汉理工大学 Ice-shaped three-dimensional measurement method based on polarization imaging
CN110929691A (en) * 2019-12-11 2020-03-27 中国科学院长春光学精密机械与物理研究所 Ice layer detection method, device, equipment and readable storage medium
CN111289206A (en) * 2020-04-28 2020-06-16 中国空气动力研究与发展中心低速空气动力研究所 Ice shape measurement auxiliary device and method
CN114485483A (en) * 2022-04-15 2022-05-13 中国空气动力研究与发展中心低速空气动力研究所 Multi-camera combined imaging-based ice shape online measurement method and device
CN114485477A (en) * 2022-04-15 2022-05-13 中国空气动力研究与发展中心低速空气动力研究所 Icing three-dimensional shape online measuring method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于线结构光扫描的结冰冰形三维测量;王斌 等;《测控技术》;20210422;全文 *

Also Published As

Publication number Publication date
CN115560700A (en) 2023-01-03

Similar Documents

Publication Publication Date Title
CN115560700B (en) Icing three-dimensional shape online measurement method based on color polarization imaging
CN112669393B (en) Laser radar and camera combined calibration method
CA2707176A1 (en) Method and apparatus for rapid three-dimensional restoration
CN112308916B (en) Target pose recognition method based on image target
CN114485477B (en) Icing three-dimensional shape online measuring method and device
CN109118534B (en) Method for acquiring icing type detailed information on surface of model in icing wind tunnel in real time
KR102461468B1 (en) Method for detecting a red tide using multispectral images and system thereof
CN107102165B (en) Surface flow field measuring method based on particle image velocimetry
Ciortan et al. A practical reflectance transformation imaging pipeline for surface characterization in cultural heritage
CN102243103A (en) Method for quickly measuring colors and three-dimensional profile of object
CN112365545B (en) Calibration method of laser radar and visible light camera based on large-plane composite target
CN115546320B (en) Camera calibration and online ice shape measurement method for measuring ice shape
CN110455720B (en) Infrared sensor waveband optimization method based on mirror-diffuse ratio model
CN108663043A (en) Distributed boss's POS node relative pose measurement method based on single camera auxiliary
CN110827360B (en) Photometric stereo measurement system and method for calibrating light source direction thereof
CN108416091A (en) A kind of measurement method of easy camera ground resolution and drone flying height relationship
Aghaei et al. A flying gray ball multi-illuminant image dataset for color research
CN110208777B (en) Accurate geometric error measuring method for corner reflector
CN112557325A (en) Fruit tree fruit quality near-surface remote sensing monitoring device and method
CN115619878B (en) Laser line extraction fusion and online ice shape measurement method for ice shape measurement
CN108519058B (en) Method for estimating annual sea ice thickness by optical remote sensing image
CN116071434A (en) BP neural network-based binocular camera and laser radar space external parameter calibration method
CN110298082B (en) Method for obtaining coating bidirectional reflection distribution function simulation parameters through imaging method
Wu et al. Binocular vision monitoring method research of wing sweep angles for morphing aircraft in complex climate environments
CN112836561A (en) Real-time acquisition system for three-dimensional ice form frozen on surface of airplane wing

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant