CN114331814A - Distorted picture correction method and display equipment - Google Patents
Distorted picture correction method and display equipment Download PDFInfo
- Publication number
- CN114331814A CN114331814A CN202111601584.4A CN202111601584A CN114331814A CN 114331814 A CN114331814 A CN 114331814A CN 202111601584 A CN202111601584 A CN 202111601584A CN 114331814 A CN114331814 A CN 114331814A
- Authority
- CN
- China
- Prior art keywords
- picture
- correction
- display device
- display
- correction pattern
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012937 correction Methods 0.000 title claims abstract description 140
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000007781 pre-processing Methods 0.000 claims abstract description 11
- 230000008859 change Effects 0.000 claims description 13
- 230000000877 morphologic effect Effects 0.000 claims description 7
- 230000009466 transformation Effects 0.000 claims description 7
- 238000009877 rendering Methods 0.000 claims description 5
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims description 4
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 claims description 3
- 229910052710 silicon Inorganic materials 0.000 claims description 3
- 239000010703 silicon Substances 0.000 claims description 3
- 230000001788 irregular Effects 0.000 abstract description 3
- 230000003287 optical effect Effects 0.000 abstract description 3
- 230000000694 effects Effects 0.000 description 12
- 238000012545 processing Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000012634 optical imaging Methods 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 238000005260 corrosion Methods 0.000 description 2
- 230000007797 corrosion Effects 0.000 description 2
- 230000003628 erosive effect Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 238000003702 image correction Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 241000226585 Antennaria plantaginifolia Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
Abstract
The embodiment of the invention discloses a distorted picture correcting method and display equipment. The correction method comprises the following steps: acquiring a shooting picture of a standard correction pattern displayed by a display device; preprocessing a shot picture, and extracting the coordinates of feature points in the shot picture; selecting a preset number of characteristic points in the central area of the shot picture, and adjusting the rotation and the scale of the shot picture according to the selected characteristic points to obtain a corrected picture; calculating the offset of each characteristic point of the correction picture relative to the corresponding position of the standard correction pattern according to the correction picture and the standard correction pattern; and correcting the actual display screen of the display device according to the offset. The distorted picture correcting method provided by the embodiment of the invention can be used for correcting irregular distortion generated after the near-eye display equipment is refracted by the optical structure, and the user experience is improved.
Description
Technical Field
The embodiment of the invention relates to a display technology, in particular to a distorted picture correction method and display equipment.
Background
In the imaging process of various optical imaging systems, various distortions are inevitably generated, the distortion correction in the prior art is generally to fit distortion coefficients according to a preset formula to realize the offset of the deformation effect, the traditional distortion removal algorithm is generally used for correcting the distortion influence caused by various optical imaging lenses, and the distortions have relatively definite distortion effects, such as pincushion distortion, barrel distortion and the like.
The method for fitting the distortion coefficient by using the formula has the advantages that the complex distortion effect corresponds to the complex correction model, the prior of the distortion type is favorable for selecting the proper correction model, and the correction effect of the picture is further favorable for improving. At present, the mainstream distortion correction algorithm is mostly used for processing the image distortion caused by the optical imaging module, and the default distortion effect is rotational symmetry. But some near-to-eye display devices (e.g. wearable virtual reality VR devices, augmented reality AR devices, etc.) can cause the virtual image to generate irregular distortion after being refracted by the optical structure, the distortion effect is similar to the influence generated by the composite effect of multiple distortion types, and it is difficult to realize the anti-distortion processing of the picture by using a conventional coefficient fitting mode, which affects the user experience.
Disclosure of Invention
The embodiment of the invention provides a distorted picture correction method and display equipment, wherein the correction method can be used for correcting irregular distortion generated after near-eye display equipment is refracted by an optical structure, and user experience is improved.
In a first aspect, an embodiment of the present invention provides a distorted picture correction method, including:
s1, acquiring a shooting picture of the standard correction pattern displayed by the display device;
s2, preprocessing the shot picture, and extracting the coordinates of the feature points in the shot picture;
s3, selecting a preset number of feature points in the central area of the shot picture, and adjusting the rotation and the scale of the shot picture according to the selected feature points to obtain a corrected picture;
s4, calculating the offset of each characteristic point of the correction picture relative to the corresponding position of the standard correction pattern according to the correction picture and the standard correction pattern;
and S5, correcting the actual display screen of the display device according to the offset.
Optionally, the method further includes:
and circularly executing the steps from S1 to S4 for a preset number of times until a circulation termination condition is reached.
Optionally, the cycle termination condition includes that the number of cycles exceeds a preset maximum value or the maximum offset of the feature point is smaller than a preset threshold.
Optionally, the acquiring the shot picture of the standard correction pattern displayed by the display device includes:
fixing the display device on a fixture table;
controlling the display device to display a standard correction pattern;
and fixing a shooting camera at the clamp slot position, and shooting and storing the standard correction pattern to obtain the shot picture.
Optionally, the standard correction pattern includes a plurality of white display areas arranged in an array;
preprocessing the shot picture, wherein extracting the feature point coordinates in the shot picture comprises the following steps:
carrying out contrast enhancement on the shot picture, and removing discrete noise points by using morphological opening operation;
calculating gray scale change gradients of adjacent pixels in a first direction and a second direction, and selecting the edge of the pixel with the maximum gray scale change gradient as the boundary of the white display area;
taking the coordinate of the central point of the white display area as the coordinate of the characteristic point;
the first direction is parallel to the row direction of the array of the white display areas, and the second direction is parallel to the column direction of the array of the white display areas.
Optionally, the shape of the white display area includes a rectangle, a circle, or a triangle.
Optionally, before the preprocessing the shot picture, the method further includes:
the shooting camera performs distortion correction on a shot picture.
Optionally, selecting a preset number of feature points in a central area of the shot picture, and adjusting the rotation and the scale of the shot picture according to the selected feature points to obtain a corrected picture, including:
selecting 6 x 6 characteristic point coordinates of the central area of the shot picture, and calculating the rotation angle and the scaling scale of the shot picture relative to the standard correction pattern;
and adjusting the shooting picture according to the rotation angle and the zooming scale to obtain the correction picture.
Optionally, calculating, according to the correction picture and the standard correction pattern, an offset of each feature point in the standard correction pattern includes:
filling the picture of the central area of the correction picture to the periphery to form a correction pattern with the size consistent with that of the standard correction pattern;
and aligning the correction pattern and the standard correction pattern according to a central area, and counting the offset of each characteristic point outside the central area.
Optionally, modifying the actual display screen of the display device according to the offset includes:
and performing corresponding stretching, shrinking and affine transformation on the original texture picture displayed by the display device by using a graphic rendering interface according to the offset, and then remapping the original texture picture to a display area corresponding to the display device so as to realize actual display picture correction.
In a second aspect, an embodiment of the present invention further provides a display apparatus, including a display device and a distorted picture correcting device, where the distorted picture correcting device prestores offset amounts of the respective feature points acquired by the distorted picture correcting method, and is configured to correct a display picture output by the display device according to the offset amounts.
Optionally, the display device comprises a wearable display device based on a silicon-based display.
The distorted picture correcting method provided by the embodiment of the invention comprises the steps of firstly controlling a display device to display a standard correcting pattern and shooting a shot picture of the standard correcting pattern; then preprocessing the shot picture, and extracting the coordinates of the feature points in the shot picture; selecting a preset number of characteristic points in the central area of the shot picture, and rotating and scaling the shot picture according to the selected characteristic points to obtain a corrected picture; calculating the offset of each characteristic point of the correction pattern relative to the corresponding position of the standard correction pattern according to the correction picture and the standard correction pattern; and finally, correcting the actual display picture of the display device according to the offset. According to the technical scheme of the embodiment of the invention, aiming at the influence of various uncertain factors possibly existing in a display device on a display picture, a specific standard correction pattern is designed and projected, the display device is shot by a camera, the actual viewing effect of a user is simulated, after a series of image processing technologies, the standard correction pattern and a processed correction picture are registered based on the assumed condition that the center of the picture has no obvious distortion, the offset of corresponding key points is found out, the coordinate positions of the key points are reversely modified according to the proportion, the picture correction is realized, and the user experience is improved.
Drawings
FIG. 1 is a schematic flow chart illustrating a method for correcting a distorted image according to an embodiment of the present invention;
FIG. 2 is a diagram of a standard calibration pattern according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating an offset in a distorted image correction method according to an embodiment of the present invention;
fig. 4 is a schematic flow chart of another distortion correction method according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. It should be noted that the terms "upper", "lower", "left", "right", and the like used in the description of the embodiments of the present invention are used in the angle shown in the drawings, and should not be construed as limiting the embodiments of the present invention. In addition, in this context, it is also to be understood that when an element is referred to as being "on" or "under" another element, it can be directly formed on "or" under "the other element or be indirectly formed on" or "under" the other element through an intermediate element. The terms "first," "second," and the like, are used for descriptive purposes only and not for purposes of limitation, and do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
Fig. 1 is a schematic flow chart of a distorted picture correction method according to an embodiment of the present invention, and referring to fig. 1, the distorted picture correction method according to the embodiment includes:
and S1, acquiring a shooting picture of the standard correction pattern displayed by the display device.
The display device in the embodiment of the present invention may be a near-eye display device, such as a VR or AR device. The standard correction pattern may be a preset black and white pattern, such as a checkerboard pattern, and the photographed picture may be acquired by a camera. Optionally, the acquiring the shot picture of the standard correction pattern displayed by the display device includes:
and S11, fixing the display device on the clamp table.
The clamp table can be specifically customized according to the display device, a clamping groove for fixing the shooting camera is arranged at a specific position, the shooting camera is used for simulating human eyes, the clamp table can be designed according to actual conditions during specific implementation, and the embodiment of the invention is not limited.
And S12, controlling the display device to display the standard correction pattern.
The standard calibration pattern may be a black-and-white pattern, for example, including a plurality of white display regions arranged in an array (in a specific implementation, the white display regions may be white squares, each white square may be composed of a plurality of pixels displaying white), and a black interval is disposed between the white display regions, and the black interval includes a plurality of pixels displaying black. The specific number of the white display areas can be manually set by an operator, the number is too small, the excessive effect of partial areas of the corrected picture is obvious, and the correction effect is poor; for example, fig. 2 is a schematic diagram of a standard correction pattern provided in an embodiment of the present invention, in this embodiment, under a trade-off between the number of white squares and the number of black spaces between the white squares, which are uniformly arranged by 32 × 32, the pattern is selected as the standard correction pattern. In other embodiments, the standard calibration pattern is not limited to the number of white squares, and is not limited to the use of squares, for example, the standard calibration pattern may be a rectangle, a circle, a triangle, or the like, the feature pattern (in this embodiment, the white squares) in the specific calibration pattern is selected to be of a type convenient for the computer language to search, and the geometric center of the feature pattern is consistent with the segmentation point after the pattern is cut in equal proportion. In some embodiments, the standard calibration pattern is not limited to be a black-and-white pattern, for example, a plurality of red squares may be provided, and green spaces are provided between the red squares, and the standard calibration pattern may be flexibly set according to actual situations in specific implementations.
And S13, fixing the shooting camera at the clamp slot position, and shooting and storing the standard correction pattern to obtain a shot picture.
The specific shooting camera may be selected according to actual conditions, which is not limited in the embodiment of the present invention.
And S2, preprocessing the shot picture and extracting the coordinates of the feature points in the shot picture.
The feature point in the captured image is the geometric center of each feature pattern (e.g., a white square in the present embodiment).
Preprocessing a shot picture, wherein extracting the coordinates of the feature points in the shot picture comprises the following steps:
and S21, carrying out contrast enhancement on the shot picture, and removing discrete noise by using morphological opening operation.
It will be appreciated that for a picture taken by a camera, it may appear dark or bright overall, due to the small range of grey values of the picture, i.e. low contrast. For a picture with low contrast, the gray level of the picture can be amplified to a specified degree by using a contrast enhancement technology, for example, the gray level range of a picture shot by a camera is 200-250, and the contrast range of the picture can be extended to 100-250 by using an algorithm, so that the contrast enhancement is realized. Specific contrast enhancement methods include linear transformation, piecewise linear transformation, gamma transformation, histogram normalization, histogram equalization, local adaptive histogram equalization, and the like, and can be selected according to actual conditions during specific implementation. After contrast enhancement, due to the amplification of gray scale, some discrete white noise may appear in the black interval region, and then morphological separation operation is performed, which has the functions of eliminating fine objects, separating objects at fine positions and smoothing the boundaries of larger objects, so as to remove the discrete noise in the shot picture. Wherein the morphological opening operation comprises an erosion followed by an expansion operation, the erosion of structure A by structure B being defined as: and moving the structure B, if the intersection of the structure B and the structure A completely belongs to the area of the structure A, storing the position point, wherein all the points meeting the condition form the result that the structure A is corroded by the structure B. The definition of structure a expanded by structure B is: and performing convolution operation on the structure B on the structure A, and if an overlapping area exists with the structure A in the process of moving the structure B, recording the position, wherein the set of the positions where the intersection exists between the moving structure B and the structure A is the expansion result of the structure A under the action of the structure B. Specifically, in this embodiment, the picture is first etched, specifically, the picture pixels are traversed, some white pixels are located at the edge of the white square and adjacent to the black pixels, and the white pixels are modified to be black; and then performing expansion operation, and re-modifying the black pixels adjacent to the white pixels into white, wherein the white area corresponding to the noise points is small, the whole area can be directly removed after the corrosion step, and further expansion is not performed, the area corresponding to the white square in the standard correction pattern is large, partial white pixels are still remained after corrosion, and further expansion operation can be restored to the initial state, so that the white noise points are effectively removed while the standard correction pattern is not influenced.
S22, calculating the gray scale change gradient of the adjacent pixels in the first direction and the second direction, and selecting the edge of the pixel with the maximum gray scale change gradient as the boundary of the white display area.
The first direction is parallel to the row direction of the array formed by the white display areas, and the second direction is parallel to the column direction of the array formed by the white display areas. Each white display area comprises a plurality of pixels which are displayed as white, the black interval comprises a plurality of pixels which are displayed as black, if two adjacent pixels are both displayed as white or both displayed as black, the gray scale change gradient of the two pixels is small, if one of the two adjacent pixels is displayed as white, and the other one is displayed as black, the gray scale change gradient of the two pixels is large, so that the pixels at the boundary position of the white display area can be searched according to the gray scale change gradient to serve as the boundary of the white display area, and the size of the white display area is determined. The gray scale variation gradient of the pixel is defined as
Wherein f (x) represents the gray-scale value of the corresponding pixel, f (x +1) and f (x-1) represent the gray-scale values of two adjacent pixels of the corresponding pixel point in the first direction or the second direction, and f' (x) represents the gray-scale variation gradient of the corresponding pixel position. The position where the gray scale change gradient is the largest indicates that the white and black have jump, and is the boundary position of the white display area.
And S23, taking the coordinate of the central point of the white display area as the coordinate of the characteristic point.
When a shot picture is processed, a corresponding rectangular coordinate system may be established according to the picture, and after a boundary of a white display area is obtained according to a pixel gray scale change gradient, for example, for a white square, coordinates of four vertices of the white square may be calculated.
And S3, selecting a preset number of feature points in the central area of the shot picture, and adjusting the rotation and the scale of the shot picture according to the selected feature points to obtain a corrected picture.
In a picture taken by a camera, a central area is generally less likely to be distorted than an edge area, and the feature point of the central area is used as a reference in the present embodiment on the assumption that the central area is not distorted. Specifically, in a certain embodiment, selecting a preset number of feature points in a central area of a shot picture, and adjusting the rotation and the scale of the shot picture according to the selected feature points to obtain a corrected picture, includes:
and S31, selecting the coordinates of 6 multiplied by 6 characteristic points of the central area of the shot picture, and calculating the rotation angle and the scaling of the shot picture relative to the standard correction pattern.
It can be understood that the picture taken by the camera and the picture displayed by the display device are not exactly the same, and there may be a certain rotation angle and scaling, and in this embodiment, the coordinates of 6 × 6 feature points in the central area of the taken picture are selected to be compared with the standard correction pattern, so that the rotation angle and scaling of the taken picture can be calculated. Wherein, the calculation formulas of the picture slope b and the Scale are respectively as follows:
And S32, adjusting the shot picture according to the rotation angle and the scaling scale to obtain a corrected picture.
For example, when a shot picture is processed, it is calculated that the shot picture rotates clockwise by a certain angle relative to an original picture, and then the shot picture rotates counterclockwise; and calculating that the shot picture is amplified by a certain times relative to the original picture, and then reversely deducing the proportion required to be reduced from the shot picture according to the proportion to adjust the shot picture.
And S4, calculating the offset of each characteristic point of the correction picture relative to the corresponding position of the standard correction pattern according to the correction picture and the standard correction pattern.
The correction picture is obtained by shooting and processing a standard correction pattern through a camera, due to the influence of picture distortion, a certain offset (the offset is 0 for a point without offset) exists in the corresponding position of each feature point in the correction picture relative to the standard correction pattern, the correction picture is aligned with the standard correction pattern, and the offset of each feature point can be calculated according to the feature point of the correction picture and the coordinate of the position in the standard correction pattern according to the same coordinate system.
Optionally, calculating the offset of each feature point in the standard correction pattern according to the correction picture and the standard correction pattern includes:
and S41, filling the picture in the central area of the correction picture to the periphery to form a correction pattern with the size consistent with that of the standard correction pattern.
In this embodiment, assuming that the central area is not distorted, since the standard correction pattern is a regular pattern, the patterns of the respective areas are the same, and the pattern of the central area of the correction screen can be expanded outward to form a correction pattern. By replacing the pattern of the peripheral area with the picture of the central area, the problem that the extraction error of the coordinates of the characteristic points is large due to large picture distortion of the peripheral area can be avoided, and the offset calculation precision is improved.
And S42, aligning the correction pattern and the standard correction pattern according to the central area, and counting the offset of each characteristic point outside the central area.
Wherein the offset of the feature point is determined according to difference (i, j) ═ Δ xij,Δyij) Calculation where i and j are both integers, Δ xijAnd ΔyijIs the offset in the row and column directions. In specific implementation, considering the existence of errors, the result of single calculation may have deviation, and in order to eliminate the influence of the single error on the final result as much as possible, the present solution may adopt an iterative solution manner to count the accumulated result of the offset value.
Exemplarily, fig. 3 is a schematic diagram of an offset amount in the distorted picture correction method according to the embodiment of the present invention, and fig. 3 schematically illustrates twelve white squares, where an edge of a feature pattern in a correction pattern is represented by a dotted line, a center of a white square in a standard correction pattern is a, a center of a white square in a corresponding correction pattern is B, an oblique line segment AB represents an offset amount of a feature point B, and other offset amounts in the diagram are all represented by corresponding written line segments.
And S5, correcting the actual display screen of the display device according to the offset.
After the offset of each feature point is calculated, the feature pattern where the feature point is located and an adjacent partial black space (for example, a region which surrounds the feature pattern and occupies a half width of the black space) may be used as a correction region, and all the pixels in the correction region perform image correction using the offset of the corresponding feature point.
Optionally, the modifying the actual display screen of the display device according to the offset includes:
and performing corresponding stretching, shrinking and affine transformation on the original texture picture displayed by the display device by using a graphic rendering interface according to the offset, and then remapping the original texture picture to the display area of the corresponding display device so as to realize the correction of the actual display picture.
In this embodiment, the actual picture of the display device is corrected based on the rendering characteristic of OpenGL texture mapping, so that the user experience is improved.
The technical scheme of the embodiment of the invention comprises the steps of firstly controlling a display device to display a standard correction pattern and shooting a shooting picture of the standard correction pattern; then preprocessing the shot picture, and extracting the coordinates of the feature points in the shot picture; selecting a preset number of characteristic points in the central area of the shot picture, and rotating and scaling the shot picture according to the selected characteristic points to obtain a corrected picture; calculating the offset of each characteristic point of the correction picture relative to the corresponding position of the standard correction pattern according to the correction picture and the standard correction pattern; and finally, correcting the actual display picture of the display device according to the offset. According to the technical scheme of the embodiment of the invention, aiming at the influence of various uncertain factors possibly existing in a display device on a display picture, a specific standard correction pattern is designed and projected, the display device is shot by a camera, the actual viewing effect of a user is simulated, after a series of image processing technologies, the standard correction pattern and a processed correction picture are registered based on the assumed condition that the center of the picture has no obvious distortion, the offset of corresponding key points is found out, the coordinate positions of the key points are reversely modified according to the proportion, the picture correction is realized, and the user experience is improved.
Optionally, the distortion correction method provided in the embodiment of the present invention further includes:
and circularly executing the steps from S1 to S4 for a preset number of times until a circulation termination condition is reached.
Optionally, the cycle termination condition includes that the number of cycles exceeds a preset maximum value or the maximum offset of the feature point is smaller than a preset threshold.
Fig. 4 is a schematic flow chart of another distortion correction method according to an embodiment of the present invention, referring to fig. 4, first fixing a display device on a fixture table, and controlling the display device to display a standard correction pattern, where the display device may be a near-eye display device such as AR or VR, and the standard correction pattern may be the pattern shown in fig. 2. And fixing the shooting camera at the clamp slot position, and shooting and storing the standard correction pattern to obtain a shot picture. After the shot picture is obtained, the shooting camera performs distortion correction on the shot picture. Among them, the distortion correction of the photographing camera is a correction of a picture based on the prior art inside the photographing camera. And then, contrast enhancement is carried out on the shot picture, the morphological opening operation is utilized to remove the discrete noise, the subsequent image processing is facilitated after the contrast enhancement, but the discrete noise is easily introduced, and the morphological opening operation of firstly corroding and then expanding is utilized to remove the discrete noise. Calculating gray scale change gradients of adjacent pixels in the first direction and the second direction, selecting the edge where the pixel with the largest gray scale change gradient is located as the boundary of the white display area, calculating the vertex coordinates of the white display area according to the boundary of the white display area, and further taking the coordinates of the center point of the white display area as the coordinates of the characteristic point. Based on the assumption that the central area is not distorted, 6 x 6 characteristic point coordinates of the central area of the shot picture are selected, the rotation angle and the scaling scale of the shot picture relative to the standard correction pattern are calculated, the shot picture is adjusted according to the rotation angle and the scaling scale, and the corrected picture can be obtained. In order to avoid overlarge extraction error of the feature point coordinates of the peripheral area, the periphery of the picture of the central area of the corrected picture is filled, a corrected pattern with the same size of the standard pattern is formed, the corrected pattern and the standard corrected pattern are aligned according to the central area, the offset of each feature point outside the central area is counted, in order to improve the calculation accuracy of the offset, the steps are repeated for iteration operation, when the iteration times exceed a set maximum value T or the maximum offset of the corresponding key point is smaller than a threshold value sigma, the iteration is stopped, a graph rendering interface is used for performing corresponding stretching, contraction and affine transformation on the original texture picture displayed by the display device according to the offset, and the original texture picture is mapped to the display area of the corresponding display device again to realize the correction of the actual display picture.
The embodiment of the invention also provides display equipment which comprises a display device and a distorted picture correcting device, wherein the distorted picture correcting device is prestored with the offset of each characteristic point acquired by the distorted picture correcting method, and the distorted picture correcting device is used for correcting the display picture output by the display device according to the offset. Since the display device in the embodiment of the present invention can perform the distorted picture correction method provided in the above-described embodiment, the same or corresponding technical effects are obtained.
Optionally, the display device comprises a wearable display device based on a silicon-based display. For example, it may be a VR or AR display device.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious modifications, rearrangements, combinations and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (12)
1. A method for correcting a distorted picture, comprising:
s1, acquiring a shooting picture of the standard correction pattern displayed by the display device;
s2, preprocessing the shot picture, and extracting the coordinates of the feature points in the shot picture;
s3, selecting a preset number of feature points in the central area of the shot picture, and adjusting the rotation and the scale of the shot picture according to the selected feature points to obtain a corrected picture;
s4, calculating the offset of each characteristic point of the correction picture relative to the corresponding position of the standard correction pattern according to the correction picture and the standard correction pattern;
and S5, correcting the actual display screen of the display device according to the offset.
2. A distorted picture correction method as set forth in claim 1, further comprising:
and circularly executing the steps from S1 to S4 for a preset number of times until a circulation termination condition is reached.
3. A distorted picture correction method as claimed in claim 2, wherein the loop termination condition includes that the number of loops exceeds a preset maximum value or that the maximum shift amount of the feature point is less than a preset threshold.
4. A distorted picture correction method as claimed in claim 1, wherein the acquiring of the shot picture of the standard correction pattern displayed by the display device comprises:
fixing the display device on a fixture table;
controlling the display device to display a standard correction pattern;
and fixing a shooting camera at the clamp slot position, and shooting and storing the standard correction pattern to obtain the shot picture.
5. A distorted picture correcting method according to claim 1, wherein the standard correction pattern includes a plurality of white display areas arranged in an array;
preprocessing the shot picture, wherein extracting the feature point coordinates in the shot picture comprises the following steps:
carrying out contrast enhancement on the shot picture, and removing discrete noise points by using morphological opening operation;
calculating gray scale change gradients of adjacent pixels in a first direction and a second direction, and selecting the edge of the pixel with the maximum gray scale change gradient as the boundary of the white display area;
taking the coordinate of the central point of the white display area as the coordinate of the characteristic point;
the first direction is parallel to the row direction of the array of the white display areas, and the second direction is parallel to the column direction of the array of the white display areas.
6. A distorted picture correction method as claimed in claim 5, wherein the shape of the white display area comprises a rectangle, a circle or a triangle.
7. A distorted picture correcting method according to claim 1, further comprising, before preprocessing the taken picture:
the shooting camera performs distortion correction on a shot picture.
8. A method for correcting a distorted picture according to claim 1, wherein selecting a predetermined number of feature points in the center area of the captured picture, and adjusting the rotation and scale of the captured picture according to the selected feature points to obtain a corrected picture comprises:
selecting 6 x 6 characteristic point coordinates of the central area of the shot picture, and calculating the rotation angle and the scaling scale of the shot picture relative to the standard correction pattern;
and adjusting the shooting picture according to the rotation angle and the zooming scale to obtain the correction picture.
9. A distorted picture correction method as claimed in claim 1, wherein calculating the shift amount of each feature point in the standard correction pattern from the correction picture and the standard correction pattern comprises:
filling the picture of the central area of the correction picture to the periphery to form a correction pattern with the size consistent with that of the standard correction pattern;
and aligning the correction pattern and the standard correction pattern according to a central area, and counting the offset of each characteristic point outside the central area.
10. A distorted picture correction method as claimed in claim 1, wherein the correction of the actual display picture of the display device in accordance with the offset amount comprises:
and performing corresponding stretching, shrinking and affine transformation on the original texture picture displayed by the display device by using a graphic rendering interface according to the offset, and then remapping the original texture picture to a display area corresponding to the display device so as to realize actual display picture correction.
11. A display apparatus comprising a display device and a distorted picture correcting device, wherein the distorted picture correcting device prestores offset amounts of each feature point acquired by the distorted picture correcting method according to any one of claims 1 to 10, and the distorted picture correcting device is configured to correct a display picture output by the display device according to the offset amounts.
12. The display apparatus of claim 11, wherein the display device comprises a silicon-based display-based wearable display device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111601584.4A CN114331814A (en) | 2021-12-24 | 2021-12-24 | Distorted picture correction method and display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111601584.4A CN114331814A (en) | 2021-12-24 | 2021-12-24 | Distorted picture correction method and display equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114331814A true CN114331814A (en) | 2022-04-12 |
Family
ID=81013581
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111601584.4A Pending CN114331814A (en) | 2021-12-24 | 2021-12-24 | Distorted picture correction method and display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114331814A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116071272A (en) * | 2023-03-07 | 2023-05-05 | 上海聚跃检测技术有限公司 | Image correction method and device, electronic equipment and storage medium thereof |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105192982A (en) * | 2015-09-07 | 2015-12-30 | 北京小鸟看看科技有限公司 | Image correcting method and system for adjustable virtual reality headset |
| CN107424126A (en) * | 2017-05-26 | 2017-12-01 | 广州视源电子科技股份有限公司 | Image correction method, device, equipment and system, image pickup equipment and display equipment |
| CN108932698A (en) * | 2017-11-17 | 2018-12-04 | 北京猎户星空科技有限公司 | Bearing calibration, device, electronic equipment and the storage medium of pattern distortion |
| CN110035273A (en) * | 2019-03-07 | 2019-07-19 | 北京理工大学 | A kind of distortion correction method, device and the display equipment using it |
| CN110738707A (en) * | 2019-10-16 | 2020-01-31 | 北京华捷艾米科技有限公司 | Distortion correction method, device, equipment and storage medium for cameras |
| CN111010560A (en) * | 2019-11-28 | 2020-04-14 | 青岛小鸟看看科技有限公司 | Anti-distortion adjusting method and device for head-mounted display equipment and virtual reality system |
| CN111586384A (en) * | 2020-05-29 | 2020-08-25 | 燕山大学 | Projection image geometric correction method based on Bessel curved surface |
| JP2020161994A (en) * | 2019-03-27 | 2020-10-01 | 日本放送協会 | Correction amount calculation device of positional deviation, and program |
| CN111812845A (en) * | 2020-07-31 | 2020-10-23 | 深圳珑璟光电技术有限公司 | Near-to-eye display device and display method |
| CN112348751A (en) * | 2020-10-27 | 2021-02-09 | 京东方科技集团股份有限公司 | Anti-distortion method and device for near-eye display equipment |
-
2021
- 2021-12-24 CN CN202111601584.4A patent/CN114331814A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105192982A (en) * | 2015-09-07 | 2015-12-30 | 北京小鸟看看科技有限公司 | Image correcting method and system for adjustable virtual reality headset |
| CN107424126A (en) * | 2017-05-26 | 2017-12-01 | 广州视源电子科技股份有限公司 | Image correction method, device, equipment and system, image pickup equipment and display equipment |
| CN108932698A (en) * | 2017-11-17 | 2018-12-04 | 北京猎户星空科技有限公司 | Bearing calibration, device, electronic equipment and the storage medium of pattern distortion |
| CN110035273A (en) * | 2019-03-07 | 2019-07-19 | 北京理工大学 | A kind of distortion correction method, device and the display equipment using it |
| JP2020161994A (en) * | 2019-03-27 | 2020-10-01 | 日本放送協会 | Correction amount calculation device of positional deviation, and program |
| CN110738707A (en) * | 2019-10-16 | 2020-01-31 | 北京华捷艾米科技有限公司 | Distortion correction method, device, equipment and storage medium for cameras |
| CN111010560A (en) * | 2019-11-28 | 2020-04-14 | 青岛小鸟看看科技有限公司 | Anti-distortion adjusting method and device for head-mounted display equipment and virtual reality system |
| CN111586384A (en) * | 2020-05-29 | 2020-08-25 | 燕山大学 | Projection image geometric correction method based on Bessel curved surface |
| CN111812845A (en) * | 2020-07-31 | 2020-10-23 | 深圳珑璟光电技术有限公司 | Near-to-eye display device and display method |
| CN112348751A (en) * | 2020-10-27 | 2021-02-09 | 京东方科技集团股份有限公司 | Anti-distortion method and device for near-eye display equipment |
Non-Patent Citations (2)
| Title |
|---|
| 李久芳;: "基于标准棋盘格的图像校准方法", 电子工业专用设备, no. 11, 30 November 2010 (2010-11-30), pages 4 - 6 * |
| 申夏晶;程梦娇;肖江剑;宋文祥: "基于迭代校正的鱼眼棋盘格图像角点检测", 激光与光电子学进展, no. 2016, 31 May 2016 (2016-05-31), pages 181 - 187 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116071272A (en) * | 2023-03-07 | 2023-05-05 | 上海聚跃检测技术有限公司 | Image correction method and device, electronic equipment and storage medium thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021115071A1 (en) | Three-dimensional reconstruction method and apparatus for monocular endoscope image, and terminal device | |
| CN110717942B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| JP5437311B2 (en) | Image correction method, image correction system, angle estimation method, and angle estimation device | |
| CN112767542A (en) | Three-dimensional reconstruction method of multi-view camera, VR camera and panoramic camera | |
| CN101540046B (en) | Panoramagram montage method and device based on image characteristics | |
| CN106447602A (en) | Image mosaic method and device | |
| CN113744142B (en) | Image restoration method, electronic device and storage medium | |
| CN111866523B (en) | Panoramic video synthesis method and device, electronic equipment and computer storage medium | |
| CN113516719B (en) | Camera calibration method, system and storage medium based on multiple homography matrixes | |
| CN114331814A (en) | Distorted picture correction method and display equipment | |
| CN106846250B (en) | Super-resolution reconstruction method based on multi-scale filtering | |
| CN112184609B (en) | Image fusion method and device, storage medium and terminal | |
| US20120038785A1 (en) | Method for producing high resolution image | |
| Wang et al. | A bilateral filtering based ringing elimination approach for motion-blurred restoration image | |
| CN113497886B (en) | Video processing method, terminal device and computer-readable storage medium | |
| CN113938578B (en) | Image blurring method, storage medium and terminal equipment | |
| CN107590790A (en) | A kind of unzoned lens fringe region deblurring method based on symmetrical edge filling | |
| CN113409375A (en) | Image processing method, image processing apparatus, and non-volatile storage medium | |
| CN117710250B (en) | Method for eliminating honeycomb structure imaged by fiberscope | |
| CN106169175B (en) | Image processing apparatus, image processing method, and recording medium | |
| CN115348437B (en) | Video processing method, device, equipment and storage medium | |
| CN110222230B (en) | Wide dynamic image storage method for multi-lens shooting | |
| JP7504614B2 (en) | Image processing device, image processing method, and program | |
| CN106952218A (en) | A kind of extracting method of panorama picture of fisheye lens effective coverage | |
| CN106408499A (en) | Method and device for getting reverse mapping table for image processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |