CN106488211A - The bearing calibration of stereoscopic display device and system - Google Patents
The bearing calibration of stereoscopic display device and system Download PDFInfo
- Publication number
- CN106488211A CN106488211A CN201510542549.8A CN201510542549A CN106488211A CN 106488211 A CN106488211 A CN 106488211A CN 201510542549 A CN201510542549 A CN 201510542549A CN 106488211 A CN106488211 A CN 106488211A
- Authority
- CN
- China
- Prior art keywords
- display device
- stereoscopic display
- crosstalk
- parameter
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012937 correction Methods 0.000 claims abstract description 326
- 238000001514 detection method Methods 0.000 claims abstract description 38
- 238000013519 translation Methods 0.000 claims description 96
- 238000000034 method Methods 0.000 claims description 83
- 238000004364 calculation method Methods 0.000 claims description 40
- 238000010191 image analysis Methods 0.000 claims description 16
- 238000004458 analytical method Methods 0.000 claims description 12
- 239000011159 matrix material Substances 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 35
- 230000008569 process Effects 0.000 description 24
- 230000000694 effects Effects 0.000 description 16
- 230000008859 change Effects 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 239000007787 solid Substances 0.000 description 4
- 238000003491 array Methods 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012896 Statistical algorithm Methods 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 241000526960 Amaranthus acanthochiton Species 0.000 description 1
- 101100384865 Neurospora crassa (strain ATCC 24698 / 74-OR23-1A / CBS 708.71 / DSM 1257 / FGSC 987) cot-1 gene Proteins 0.000 description 1
- 101100505735 Neurospora crassa (strain ATCC 24698 / 74-OR23-1A / CBS 708.71 / DSM 1257 / FGSC 987) cot-2 gene Proteins 0.000 description 1
- 101100500679 Neurospora crassa (strain ATCC 24698 / 74-OR23-1A / CBS 708.71 / DSM 1257 / FGSC 987) cot-3 gene Proteins 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 230000000704 physical effect Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Abstract
The present invention proposes a kind of bearing calibration of stereoscopic display device and system, the correction system of its stereoscopic display device includes stereoscopic display device, the correction system of filming apparatus and stereoscopic display device, the correction system of stereoscopic display device further includes image acquisition unit, crosstalk fringe detection unit, computing unit and parameter acquiring unit, image acquisition unit is located at, for obtaining stereoscopic display device, the stereo-picture showing during at least two fixed positions, crosstalk fringe detection unit is used for detecting the crosstalk striped in described stereo-picture, Dip countion unit is used for calculating the stripe angle of the crosstalk striped detecting, parameter acquiring unit is used for when the stripe angle of the crosstalk striped calculating meets predetermined angle scope, then obtain the correction parameter of described stereoscopic display device, the application corrects efficiency high, accuracy is high.
Description
Technical Field
The present invention relates to the field of stereoscopic display technologies, and in particular, to a method and a system for correcting a stereoscopic display device.
Background
The imaging principle of the stereoscopic image display technology is as follows: based on binocular parallax of the viewer, the left eye and the right eye of the viewer respectively perceive parallax images with image difference, and the brain of the viewer forms a stereoscopic image based on the perceived image difference.
As shown in fig. 1, a conventional stereoscopic display device 1 includes a light-splitting device 2 and a display panel 3, and the light-splitting device 2 is provided on a light-emitting side of the display panel 3. The display panel 2 provides left and right views with image disparity, the left view enters the left eye of the viewer and the right view enters the right eye of the viewer by the light splitting action of the light splitting device 3, and the brain of the viewer forms a stereoscopic image vision based on the perceived image disparity.
During displaying, the light splitting device 2 and the display panel 3 are required to be accurately matched, so that the crosstalk problem that a left view enters the right eye of a viewer and a right view enters the left eye of the viewer is avoided. However, in the assembling process, the assembling error between the light splitter 2 and the display panel 3 cannot be avoided, so that the light splitter 2 cannot be accurately attached to the display panel 3 according to the design requirement, and the problems of crosstalk, poor stereoscopic display effect, and even incapability of meeting the stereoscopic imaging requirement and the like occur. If the stereoscopic display device is not processed before leaving the factory, the user experience is directly affected, and the development of the stereoscopic display technology is further limited.
Disclosure of Invention
The embodiment of the invention aims to provide a correction method and a correction system of a stereoscopic display device, which are used for solving the display problems of crosstalk and the like of the stereoscopic image display device due to assembly errors.
In one aspect, the present invention provides a correction method of a stereoscopic display device, including:
acquiring a stereoscopic image displayed when the stereoscopic display equipment is positioned at least two fixed points;
detecting crosstalk stripes in the stereo image acquired when the stereo display device is located at least two fixed points, wherein the stereo image comprises at least one crosstalk stripe;
calculating the stripe inclination angle and the stripe width of the detected crosstalk stripes;
when the calculated stripe inclination angle of the crosstalk stripe meets a preset angle range, acquiring a correction parameter of the stereo image for correcting the stereo display equipment;
and correcting the stereoscopic display equipment according to the acquired correction parameters of the stereoscopic image.
In another aspect, the present invention provides a correction system for a stereoscopic display device, including a stereoscopic display device, a camera, and a correction parameter acquiring device for the stereoscopic display device, where the correction parameter acquiring device for the stereoscopic display device further includes:
the image acquisition unit is used for receiving the shot stereoscopic images displayed by the display equipment when the stereoscopic body is positioned at least two fixed point positions;
a crosstalk stripe detection unit, configured to detect crosstalk stripes in the stereoscopic image at each fixed point position when the stereoscopic display device is located at least two fixed point positions;
the inclination angle calculation unit is used for calculating the stripe inclination angle and the stripe width of the detected crosstalk stripes;
and the parameter acquisition unit is used for acquiring the correction parameters of the stereo image when the calculated stripe inclination angle of the crosstalk stripe meets a preset angle range so as to correct the stereo display equipment.
Compared with the prior art, the invention has the beneficial effects that: according to the method and the device, the stereoscopic display equipment is corrected at multiple fixed point positions, the correction parameters are obtained by utilizing the inclination angles of the crosstalk stripes, the accuracy of the calculated correction parameters is high, and the correction efficiency can be greatly improved.
Drawings
Fig. 1 is a schematic structural diagram of a stereoscopic display device provided in the prior art;
fig. 2 is an architecture diagram of a calibration system of a stereoscopic display device according to an embodiment of the invention;
fig. 3 is a structural diagram of a calibration parameter obtaining apparatus of a stereoscopic display device according to an embodiment of the invention;
FIG. 4 is a schematic diagram of a stereo image to be corrected according to an embodiment of the present invention;
FIG. 5 is a block diagram of a tilt angle calculation unit according to an embodiment of the present invention;
FIG. 6 is a block diagram of another inclination calculation unit according to an embodiment of the present invention;
FIG. 7 is a diagram of a parameter obtaining unit according to an embodiment of the present invention;
FIG. 8 is a diagram illustrating an embodiment of searching pixel parameters by binary method;
FIG. 9 is a diagram illustrating a linear relationship between a reference value of a pixel parameter and a reference value of an angle calibration parameter according to an embodiment of the present invention;
FIG. 10 is a block diagram of another parameter obtaining unit according to an embodiment of the present invention;
FIG. 11 is a block diagram of a further parameter obtaining unit according to an embodiment of the present invention;
FIG. 12 is a schematic view of an optimal viewing position of a stereoscopic image according to an embodiment of the invention;
FIG. 13 is a schematic diagram of a camera positioned behind a best-view position according to an embodiment of the present invention
Fig. 14 is a schematic view of a camera head of an embodiment of the present invention placed in front of an optimal viewing position.
FIG. 15 is a graph illustrating a selected translational quantity fine tuning parameter array according to an embodiment of the present invention;
FIG. 16 is a graphical illustration of another selected translational quantity trim parameter array in accordance with an embodiment of the present invention;
FIG. 17 is a graphical illustration of a further selected translational quantity trim parameter array in accordance with an embodiment of the present invention;
fig. 18 is a structural diagram of a calibration parameter obtaining apparatus of another stereoscopic display device according to an embodiment of the invention;
FIG. 19 is a block diagram of an image analysis unit according to an embodiment of the present invention;
FIG. 20 is a block diagram of a determination subunit in accordance with an embodiment of the present invention;
fig. 21 is a structural diagram of a correction parameter obtaining apparatus of a stereoscopic display device according to another embodiment of the invention;
fig. 22 is a flowchart illustrating a calibration method of a stereoscopic display device according to an embodiment of the invention;
FIG. 23 is a flowchart illustrating a method for detecting crosstalk fringes in a stereo image according to an embodiment of the present invention;
FIG. 24 is a flowchart illustrating a process of calculating the tilt angle of the crosstalk stripe detected according to an embodiment of the present invention;
FIG. 25 is a flowchart illustrating an exemplary process of obtaining an angle calibration parameter according to an embodiment of the present invention;
FIG. 26 is a flowchart illustrating another exemplary embodiment of obtaining angle calibration parameters;
fig. 27 is a flowchart of obtaining a fine adjustment parameter of a translation amount according to an embodiment of the present invention;
fig. 28 is a flowchart illustrating a process of acquiring a stereoscopic image displayed by a stereoscopic display device according to an embodiment of the present invention;
fig. 29 is a flowchart illustrating a process of detecting a screen region in a received stereo image according to an embodiment of the present invention;
FIG. 30 is a schematic view of an embodiment of the present invention in which the fixed point position is linear;
FIG. 31 is a schematic view of a pointing device according to an embodiment of the present invention in the shape of a cross;
FIG. 32 is a diagram of a parameter obtaining unit according to an embodiment of the present invention;
FIG. 33 is a diagram of a parameter obtaining unit according to an embodiment of the present invention;
fig. 34 is a flowchart illustrating a process of calculating a raster pixel correction parameter and a raster focal length correction parameter of a light splitting device of a stereoscopic display apparatus according to an embodiment of the present invention.
Detailed Description
The foregoing and other technical and scientific aspects, features and advantages of the present invention will be apparent from the following detailed description of preferred embodiments, which is to be read in connection with the accompanying drawings. While the present invention has been described in connection with the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but is intended to cover various modifications, equivalent arrangements, and specific embodiments thereof.
Fig. 2 is an architecture diagram of a calibration system of a stereoscopic display device according to an embodiment of the present invention, which includes a stereoscopic display device 22, a camera 23, and a calibration parameter obtaining device 21 of the stereoscopic display device. The stereoscopic display device 22 is configured to display a stereoscopic image, the shooting device 23 is configured to shoot an image picture including a display screen of the stereoscopic display device 22, and transmit the shot image picture to the correction parameter obtaining device 21 of the stereoscopic display device, the correction parameter obtaining device 21 of the stereoscopic display device processes the received image picture, determines a screen area of the stereoscopic display device 21 in the image picture, calculates an inclination angle of a crosstalk stripe of the stereoscopic image in the screen area, and obtains the stereoscopic display device 22 when the inclination angle falls within a preset angle range, where the correction parameter is used to correct an assembly error of the stereoscopic display device 22. When the user starts the stereoscopic display device 22, the stereoscopic display device 22 corrects the assembly error according to the correction parameter, and eliminates the adverse effect of the assembly error on the display effect of the stereoscopic display device 22, thereby improving the display effect of the stereoscopic display device.
In this embodiment, the stereoscopic display device 22 may be a mobile terminal, or may be an electronic device with a display function, such as a computer, and the correction parameter acquiring device 21 of the stereoscopic display device may be a device with processing and communication functions, such as a computer or a mobile terminal. In this embodiment, it is preferable that the correction parameter acquiring device 21 of the stereoscopic display apparatus is a computer, the stereoscopic display apparatus 22 is connected to the correction parameter acquiring device 21 of the stereoscopic display apparatus through a data line, and the camera 3 is connected to the correction parameter acquiring device 21 of the stereoscopic display apparatus through a data line.
The photographing device 23 may include at least one camera that photographs a stereoscopic image displayed by the stereoscopic display apparatus 22. In the embodiment, the shooting device 23 comprises a left camera 24 and a right camera 25 which are arranged at intervals, and the structures and physical properties of the left camera 24 and the right camera 25 are the same. The distance between the left camera 24 and the right camera 25 is preferably the interpupillary distance of human eyes, and meets the requirement of stereo imaging.
A tracking device (not shown) may be installed on the stereoscopic display device 22, and the tracking device is used to measure the distance from the camera 23 to the stereoscopic display device 22, and the tracking device may be a tracking camera, for example. In order to facilitate the recognition of the stereoscopic display device 22, the camera 23 may be a human face model, and the two cameras are respectively installed at left and right eye positions of the human face model.
Specifically, the system of this embodiment sequentially sets the stereoscopic display device 22 at a plurality of fixed points, the distances from the fixed points to the camera 23 are different, the camera 23 sequentially transmits the stereoscopic image captured at each fixed point to the correction parameter acquiring device 21 of the stereoscopic display device, and the correction parameter acquiring device 21 of the stereoscopic display device acquires the correction parameters of the stereoscopic display device 22, so that the stereoscopic display device 22 can perform correction by using the acquired correction parameters, thereby improving the stereoscopic display effect.
The fixed point position of the stereoscopic display device 22 can be set according to the requirement, and in this embodiment, the fixed point position is preferably arranged in a straight line or a cross shape, as shown in fig. 30 and 31. In fig. 30, the fixed point positions 301 are arranged in a straight line. In fig. 31, the fixed point positions 401 are arranged in a cross shape, and unlike a straight line shape, the fixed point positions are arranged in a cross shape in such a manner that a wide angle of view is also taken into consideration for correction, and the reliability of correction is higher. Of course, the fixed point positions may be arranged in other arrangements, such as a circle or a rectangle, which is not limited herein.
During the calibration process, the fixed point position of the stereoscopic display device may be replaced in the form of a slide rail, that is, a slide rail with a preset shape (for example, a straight line shape or a cross shape) is laid in advance, and then the stereoscopic display device 22 is placed on the slide rail, moved along the slide rail, and then fixed at the set fixed point position. Of course, the imaging device 23 may be mounted on a slide rail and moved, and the fixed point position may be changed in the same manner.
In the present embodiment, the stereoscopic image provided by the stereoscopic display device 22 includes a stereoscopic image having an image disparity, for example, a left view and a right view having an image disparity. For the convenience of identification and detection, the left view and the right view can both be pure color images, but the left view and the right view are different in color. For example, the left view is a first color image and the right view is a second color image. The first color image and the second color image are different in color. Thus, the perspective view with image disparity may be a red/green perspective view, a black/white perspective view, or a solid image with two other different colors. Of course, the stereoscopic images of the left and right views provided by the embodiment of the present invention are determined by the stereoscopic display device 22, and are not limited to the pure color images.
Before correction, crosstalk and other phenomena of images due to assembly errors often occur in the left view and the right view, and the crosstalk fringes are often included in the left view and the right view, and refer to fringes caused by concentrated display of patterns on two images, which should be the left view and the right view, on one image, for example, an image is composed of a plurality of red fringes and green fringes at intervals. One of the main purposes of the correction of the present invention is to eliminate these crosstalk fringes, so that both the left view and the right view present their original images, for example, the above-mentioned image composed of multiple red fringes and green fringe intervals, and after the correction, the left view presents a pure red image and the right view presents a pure green image. For convenience of explanation, the crosstalk stripes in the present embodiment are all explained by taking red and green stripes as an example.
When the stereoscopic display device 22 is located at least two different fixed point position information, the photographing means 23 respectively photographs image pictures when the stereoscopic display device 22 is located at two fixed point positions, and transmits the image pictures to the correction parameter acquiring means 21. The correction parameter obtaining device 21 detects crosstalk fringes and calculates a fringe inclination angle according to the received image, and obtains a correction parameter of the stereoscopic display device 22 when the fringe inclination angles of the stereoscopic image corresponding to the calculated at least two fixed point position information satisfy a preset angle range, so as to correct the stereoscopic display device 22.
For example, if the stereoscopic display device 22 is located at the first fixed point position information, the shooting device 23 shoots an image frame of the stereoscopic display device located at the first fixed point position, and sends the image frame to the correction parameter obtaining device 21. If the calibration parameter acquiring device 21 of the stereoscopic display device receives the image frame sent by the shooting device 23, it will determine the screen area of the stereoscopic display device in the image frame, and acquire the stereoscopic image displayed in the screen area, and at the same time, detect the crosstalk stripe on the stereoscopic image by using the image analysis technology. If the crosstalk stripes do not exist on the stereo image, the stereo image is displayed normally and does not need to be corrected. If there is crosstalk stripe on the stereo image, the correction parameter obtaining device 21 of the stereo display device calculates the tilt angle of the crosstalk stripe, and obtains the correction parameter of the stereo image corresponding to the tilt angle when the tilt angle of the crosstalk stripe satisfies the preset angle range, then changes the fixed point position information of the stereo display device 22, for example, moves from the first fixed point position information to the second fixed point position information, and then obtains the correction parameter of the stereo image corresponding to the tilt angle when the stereo display device is located at the second fixed point position information according to the method for obtaining the correction parameter of the stereo image corresponding to the tilt angle when the stereo display device 22 is located at the first fixed point position information. By analogy, correction parameters corresponding to the stereoscopic image when the stereoscopic display device 22 is located at a plurality of fixed points can be obtained, and the plurality of correction parameters are selected and calculated, so that the correction parameters of the stereoscopic display device are obtained to correct the stereoscopic display device 22. For the correction parameters of the stereoscopic display device to be obtained in this application, some correction parameters may be obtained at a single fixed point position, that is, at any fixed point position of the stereoscopic display device 22, for example, angle correction parameters, and some correction parameters may be obtained only by using multiple fixed point positions, for example, raster pixel correction parameters, raster focal length correction parameters, and the like. Hereinafter, the acquisition process of the respective correction parameters of the stereoscopic display device will be described in detail.
In the embodiment of the present invention, the stripe inclination of the crosstalk stripe refers to: the included angle between the crosstalk fringe and the horizontal direction or the included angle between the crosstalk fringe and the vertical direction. When the inclination angle of the crosstalk stripe is the included angle between the crosstalk stripe and the horizontal direction, the preset angle range of the crosstalk stripe may be [ -90 °, -70 ° ] or [70 °, 90 ° ], and if the inclination angle of the crosstalk stripe falls into the above-mentioned interval, the crosstalk stripe of the stereoscopic image displayed by the stereoscopic display device is considered to be vertical at this time, and meanwhile, the correction parameter of the stereoscopic image corresponding to the inclination angle of the crosstalk stripe is obtained. When the inclination angle of the crosstalk stripe is the included angle between the crosstalk stripe and the vertical direction, the preset angle range of the crosstalk stripe may be [ -20 °, 0 ° ] or [0 °, 20 ° ], and if the inclination angle of the crosstalk stripe falls into the above-mentioned interval, it is determined that the crosstalk stripe on the stereoscopic image displayed by the stereoscopic display device is vertical at this time, and meanwhile, the correction parameter of the stereoscopic image corresponding to the inclination angle of the crosstalk stripe is obtained.
Please refer to fig. 3, which is a block diagram of the calibration parameter acquiring apparatus of the stereoscopic display device in fig. 2. The apparatus includes an image acquisition unit 31, a crosstalk fringe detection unit 32, a calculation unit 33, and a parameter acquisition unit 34.
The image acquisition unit 31 is configured to acquire a stereoscopic image displayed by the stereoscopic display device 22. In the calibration process, it is often necessary to adjust the display parameters of the stereoscopic display device 22 multiple times to find the optimal parameters. And the photographing device 23 performs tracking photographing on the image picture including the display screen of the stereoscopic display apparatus 22 in real time and transmits the photographed image picture to the image acquiring unit 31.
The image acquisition unit 31 acquires a stereoscopic image displayed by the stereoscopic display device 22 from the received image picture to acquire a change of the image at each parameter adjustment, and transmits the acquired stereoscopic image to the crosstalk stripe detection unit 32.
Since the image frame acquired by the camera 23 includes not only the stereoscopic image displayed by the stereoscopic display device but also the external environment outside the display area, in order to avoid the external environment from affecting the accuracy of the correction parameter, the image acquisition unit 31 needs to first determine the display area of the stereoscopic display device 22 in the image frame before acquiring the stereoscopic image to determine the displayed stereoscopic image in the display area.
Specifically, the image acquisition unit 31 includes a receiving subunit and a determining subunit. The receiving subunit is configured to receive an image picture captured by the capturing device 23 and including a display screen of the stereoscopic display apparatus 22; the determining subunit is configured to determine a screen region of the stereoscopic display device 22 in the image picture received by the receiving subunit, and acquire a stereoscopic image displayed by the screen region. The determining subunit may extract an image channel value in the display area by using an image analysis technique, then detect a boundary point and a boundary curve of the display area by using edge detection, and detect the display area by combining an image area.
Further, referring to fig. 20, the determining subunit includes: an image brightness analysis subunit 204, a binarization processing subunit 201, an area search subunit 202, and a merge division subunit 203.
The image brightness analysis subunit 204 is configured to obtain brightness values of pixel points in an image frame.
The binarization processing subunit 201 is configured to perform binarization processing on the stereo image according to a preset brightness threshold, where there are at least two preset brightness thresholds, to obtain corresponding quasi-screen regions. The binarization of the image is to set the gray value of a pixel point on the image to 0 or 255, that is, the whole image has a visual effect of only black and white. So that the screen area can be roughly resolved.
The area search subunit 202 is configured to search for an area of a set shape on the quasi-screen area subjected to the binarization processing. The set-shaped region may be a rectangular region or a circular region. Triangular regions, etc., according to the source stereoscopic picture in the stereoscopic display device.
The merging and dividing subunit 203 is configured to merge and divide the searched region with the set shape to determine a screen region of the stereoscopic display device in the image picture. The number of the setting regions searched by the region searching subunit 202 may be many, and the setting regions may have sizes and positions overlapping, staggered or separated from each other. The merging process may be to assign a weight value according to the number of times of coincidence of the searched areas, that is, a higher weight is assigned when the number of times of coincidence of a certain area is greater. The dividing process is to remove the area with the weight less than a certain value according to the weight distribution of the merged area and to re-divide the area with the set shape as the screen area.
The crosstalk stripe detection unit 32 is configured to detect crosstalk stripes in the stereo image. The crosstalk stripe detection unit 32 may obtain crosstalk stripes in the stereo image by calculating color values of pixel points in the stereo image. For example, the value on the color component may be obtained by converting the stereo image into an HSV space, which is a color space that embodies the intuitive property of color and is also called a hexagonal cone Model (Hexcone Model), and the color space has three color parameters: hue (Hue), Saturation (Saturation), and brightness (Value). For red and green crosstalk fringes, the region with the color value between 0 and 20 is red, and the region with the color value between 40 and 60 is green, so that the color distribution on the stereo image can be known, and whether the crosstalk fringes exist on the stereo image can be detected. Referring to fig. 4 in combination, which is a three-dimensional image to be corrected, black areas represent red and blank areas represent green, it can be seen from fig. 4 that the three-dimensional image has six crosstalk stripes, three red, three green and six crosstalk stripes.
The tilt calculation unit 33 is configured to calculate a fringe tilt of the detected crosstalk fringes. As can be seen from fig. 4, the cross-talk fringes tend to be tilted, and the entire correction process, if embodied in a continuous image, is to make the width of the cross-talk fringes in the image gradually larger to reduce the number of cross-talk fringes, and then to shift until a single tone occupies the display area. In order to achieve a good light splitting effect and prevent a corner from appearing on the stereo image (a corner means that a certain region on the stereo image does not display a pattern, for example, a pure red rectangular stereo image, and one corner does not display a red pattern), the embodiment obtains the correction parameters through the parameter obtaining unit 34 under the condition that the crosstalk stripes are vertical, so as to achieve a good display effect and correction efficiency. Of course, it is also possible to obtain the correction parameter in the case of the crosstalk fringe level, and the present application is not limited to this.
Further, the tilt angle calculation unit 33 may calculate the tilt angle of the boundary line as the tilt angle of the crosstalk fringes by acquiring the boundary line between the crosstalk fringes. Please refer to fig. 5, which is a structural diagram of a tilt angle calculating unit according to an embodiment of the present invention. The tilt angle calculation unit 33 further includes a boundary acquisition subunit 51 and a calculation subunit 52. The boundary acquiring subunit 51 is configured to determine a boundary between the crosstalk stripes according to color values of pixel points in the stereo image. The calculation subunit 52 is configured to calculate the tilt angle of the boundary determined by the boundary acquisition subunit 51 as the tilt angle of the crosstalk stripe. For example, in the stereo image of red and green crosstalk fringes shown in fig. 4, the region having a color value between 0 and 20 is red, and the region having a color value between 40 and 60 is green, so that the pixel points whose color values do not belong to the two regions in the image can be regarded as the pixel points on the boundary between the crosstalk fringes. After obtaining the pixel points on the boundary, the inclination calculation unit 33 may fit the boundary by a least square method or an M estimation algorithm, and calculate the inclination of the boundary between the crosstalk fringes.
Further, in order to improve the calculation accuracy of the tilt angle, the tilt angle calculation unit 33 may calculate the tilt angles of a plurality of boundary lines in the stereoscopic image and calculate an average value as the tilt angle of the crosstalk stripe. For example, the stereoscopic image of fig. 4, which includes five boundary lines, the inclination calculation unit 33 can respectively find the inclination angles of the five boundary lines and then calculate the average value of the inclination angles of the five boundary lines, thereby also making the calculation result more accurate.
Further, the tilt angle calculation unit 33 calculates the boundary by fitting pixels into a line, so that the calculated boundary of the crosstalk fringe may be a curved line, and there is no way to calculate the tilt angle of the boundary, and if the line is fitted by using a least square method and the like and then the tilt angle is calculated, an incorrect value will be obtained. The linear distribution of the borderlines between the crosstalk fringes can be detected using a statistical algorithm before calculating the tilt angle of the borderlines. Please refer to fig. 6, which is a block diagram of another tilt angle calculating unit according to an embodiment of the present invention. Compared to fig. 5, the inclination calculation unit 33 shown in fig. 6 includes a linear detection subunit 61 in addition to the boundary acquisition subunit 51 and the calculation subunit 52. The linear detecting subunit 61 is configured to detect, by using a statistical algorithm, whether the linear distribution of the fitted line satisfies a preset linear distribution condition after the boundary obtaining subunit 51 obtains the boundary. If the linear detecting subunit 61 detects that the preset linear distribution condition is satisfied, for example, the boundary is a straight line, the inclination angle calculating unit 33 calculates the inclination angle of the boundary. If the boundary is detected to be not a straight line, the calculation of the inclination angle of the boundary is directly discarded.
Specifically, assume that the coordinate sequence of the pixel points on the boundary of the crosstalk fringes of the stereo image is:
{(x0,y0),(x1,y1),(x2,y2),(x3,y3)…..(xn,yn)},
the linear detection subunit 61 can judge its linear distribution by calculating the covariance matrix of this coordinate sequence. The covariance matrix is calculated by decentralizing the data, so the mean (vector) of the point sequence is:
then the covariance matrix is:
then, the linear detection subunit 61 calculates eigenvalues E0 and E1 of the covariance matrix, and the eigenvalue distribution at this time represents the maximum and minimum variances of the distribution that can be achieved by the pixel points in a certain direction, so that the linearity of the curve can be determined by comparing the ratio E0/E1 of the maximum eigenvalue to the minimum eigenvalue. A threshold (preferably 7) may be set, and when the ratio E0/E1 of the maximum eigenvalue to the minimum eigenvalue is greater than the threshold, the boundary may be considered as a straight line, otherwise, a curved line may be determined without involving the calculation of the tilt angle of the crosstalk fringes.
If the calculation result of the inclination calculation unit 33 satisfies the condition that the crosstalk stripe is vertical, the parameter obtaining unit 34 records a parameter value corresponding to the inclination of the current stereo image for calculating an optimal correction parameter. The vertical condition of the crosstalk fringes is a condition that the calculation of the correction parameter is most accurate, and in practical application, a specific range of the set angle that the tilt angle of the crosstalk fringes needs to satisfy may be set according to needs, for example, the horizontal tilt angle of the crosstalk fringes satisfies between 80 degrees and 100 degrees, or the tilt angle of the crosstalk fringes satisfies a preset angle range, which is not limited herein. The correction parameters of the stereoscopic display device 22 include an angle correction parameter, a raster pixel correction parameter, a raster focal length correction parameter, a translation amount correction parameter, and the like. The rough correction parameter of the translation amount is an intermediate parameter in the process of correcting the stereoscopic display equipment, and the purpose of obtaining the parameter is to obtain a raster pixel correction parameter and a raster focal length correction parameter of the stereoscopic display equipment.
Because the light splitting device of the stereoscopic display device is obliquely arranged on the display panel, the light splitting units on the light splitting device are arranged along one direction, the display units on the display panel are arranged along the other direction, an included angle between the two directions is an error which is easy to generate during assembly, if the angle error is not corrected, the conditions that the display effect is influenced by image inclination, hanging angles, crosstalk, granular sensation and the like are generated, and the angle correction parameter is used for correcting the error.
The calculation mode of the correction parameters can be determined according to actual needs. It should be noted that, when acquiring the angle parameter of the stereoscopic display device, the stereoscopic display device 22 is only required to be located at a fixed point. Therefore, at the time of the specific acquisition, the angle correction parameter of the stereoscopic display device is acquired while the stereoscopic display device 22 is located at any one of the fixed point positions. For the angle correction parameter of the stereoscopic display device, the present application provides two calculation methods, which will be described in detail below.
Please refer to fig. 7, which is a block diagram of a parameter obtaining unit according to an embodiment of the present invention. This parameter acquisition unit 34 includes: a reference value acquisition subunit 71, a linear relationship calculation subunit 72, and an angle pixel calculation subunit 73.
The reference value obtaining subunit 71 is configured to obtain, according to a plurality of pixel parameters corresponding to the plurality of stereoscopic images when the inclination angle satisfies a preset angle range, angle correction parameter reference values corresponding to the plurality of pixel parameters. The stereoscopic display device displays a stereoscopic image according to different pixel parameters. When the stereo display equipment displays the stereo image according to each pixel parameter, the angle parameter is finely adjusted, so that the angle correction parameter reference value corresponding to each pixel parameter and meeting the preset angle range of the crosstalk fringe dip angle can be found out according to the analysis of the displayed stereo image, and an array of the pixel parameter and the angle correction parameter reference value can be formed.
The linear relation calculating subunit 72 is configured to calculate a linear relation between the pixel parameter and the angle correction parameter reference value according to the array of the pixel parameter and the angle correction parameter reference value.
The angle pixel calculation subunit 73 is configured to select an optimal angle correction parameter reference value from an array (pitch, cot) according to a linear relationship between the pixel parameter and the angle correction parameter reference value, a grating physical parameter t and a preset grating focal length parameter f1 of a light splitting device of the stereoscopic display device, fixed point position information of the stereoscopic display device (the fixed point position information refers to a distance from a camera to the stereoscopic display device), and an optical principle of stereoscopic imaging, so as to serve as the angle correction parameter of the stereoscopic display device.
For example, assuming that the pitch parameter is a pixel parameter and the cot parameter is an angle correction parameter reference value, first, a pitch parameter reference value is set, so that the stereoscopic display device displays a stereoscopic image according to the set pitch parameter reference value, then, the value of the cot parameter is adjusted, so that the angle of the crosstalk stripe on the stereoscopic image is changed, and the inclination angle of the crosstalk stripe is calculated in real time. When the crosstalk stripe is calculated to be in a vertical state (or the inclination angle meets a preset angle range), recording the pitch parameter reference value and the cot parameter reference value at the moment. Then another pitch parameter reference value is set according to a preset detection interval, the value of the cot parameter is adjusted until the crosstalk stripes of the stereo image are vertical, and the pitch parameter reference value and the cot parameter reference value are recorded again. By analogy, arrays of (pitch1, cot1), (pitch2, cot2), (pitch3, cot3), (… ) can be obtained.
When the cot parameter of the (pitch, cot) array is searched, the binary method can be adopted to accelerate the searching speed. Please refer to fig. 8, which is a diagram illustrating a binary search for pixel parameters. The solid black line is the inclination angle of the crosstalk stripe displayed by the stereo image when the two ends of the retrieval interval of the cot parameter are taken, that is, under the condition that the reference value of the pitch parameter is selected, the inclination change of the crosstalk stripe on the stereo image displayed by adjusting the cot parameter can only be between two black realizations according to the physical characteristics of the display panel and the light splitting device of the stereo display equipment. Three dotted lines in fig. 8 are the tilt directions of the crosstalk fringes shown when the middle value of the search interval of the cot parameter is selected, wherein the dotted line labeled 3 is the tilt direction of the crosstalk fringes when the reference value of the target cot parameter is selected.
When the binary search is started, the search range is wide, the search interval is between the cot parameter values corresponding to the two black solid lines, firstly, an attempt is made at the middle value between the cot parameter values corresponding to the two black solid lines, namely, the cot parameter value corresponding to the dotted line of the label 1 is selected, then, the inclination angle of the dotted line of the label 1 is calculated according to the stereo image, and the fact that the dotted line of the label 1 is closer to the vertical direction than the black solid line on the right side is found, so that the search interval of the cot parameter is updated to be the cot parameter value corresponding to the black solid line on the left side to the cot parameter value corresponding to the dotted line of the label. Then, selecting the middle value of the cot parameter value corresponding to the dotted line from the left black solid line to the label 1, namely the cot parameter value corresponding to the dotted line from the label 2, then calculating the inclination angle of the dotted line from the label 2 according to the stereo image, and finding that the dotted line from the label 2 is closer to the vertical direction than the left black solid line, so that the search interval of the cot parameter is updated to the cot parameter value corresponding to the dotted line from the label 2 to the cot parameter value corresponding to the dotted line from the label 1. Then, selecting the middle value from the cot parameter value corresponding to the dotted line of the label 2 to the cot parameter value corresponding to the dotted line of the label 1, namely the cot parameter value corresponding to the dotted line of the label 3, and recording the cot parameter value corresponding to the dotted line of the label 3 as a cot parameter reference value into an array of (pitch, cot) after calculating the crosstalk fringe inclination angle of the stereo image and finding that the dotted line of the label 3 is vertical. Therefore, the number of values selected in the search interval can be greatly reduced by adopting the dichotomy, and the search efficiency is improved.
After obtaining the (pitch, cot) array, calculating the linear relationship between the pitch and the cot in the array, please refer to fig. 9, which is a schematic diagram of the linear relationship between the reference value of the pixel parameter and the reference value of the angle correction parameter, where each dot is a pair of values, the abscissa is the pitch, and the ordinate is the cot, and it can also be seen from the figure that the array (pitch, cot) substantially satisfies the linear relationship of the straight line. Thus, there is a relationship between pitch and cot that is:
pitch=k*cot+b
the values of k and b are then calculated. And finally, selecting an optimal angle correction parameter reference value from an array (pitch, cot) according to the values of k and b, a grating physical grating distance parameter t of the light splitting device, a preset grating focal distance parameter f1 of the light splitting device and fixed point position information (the fixed point position information refers to the distance from the shooting device to the stereoscopic display equipment) by combining the optical principle of stereoscopic imaging, and taking the optimal angle correction parameter reference value as an angle correction parameter of the stereoscopic display equipment.
Please refer to fig. 10, which is a block diagram of another parameter obtaining unit according to an embodiment of the present invention. This parameter acquisition unit 34 includes: a screening acquisition subunit 101 and an analysis acquisition subunit 102.
The screening and acquiring subunit 101 is configured to acquire a stereo image with an inclination angle of the crosstalk fringe satisfying a set angle and a corresponding angle correction parameter.
The analysis and acquisition subunit 102 is configured to perform image analysis on the stereo image in which the inclination angle of the crosstalk stripe satisfies the set angle range, acquire the stereo image including the maximum-width crosstalk stripe, and acquire a corresponding pixel correction parameter. It should be noted that, during the adjustment process of the pixel parameters at the end of the stereoscopic display device 22, the width of the crosstalk stripes on the displayed stereoscopic image may gradually change, and due to the limitation of the width of the display area, if there are more than three crosstalk stripes on the stereoscopic image, the crosstalk stripes near the edge of the display area may gradually be ejected out of the display area in the process that the width of the crosstalk stripes near the middle of the display area is increased, that is, the width of some crosstalk stripes may be increased, and the width of some crosstalk stripes may be decreased, until only two crosstalk stripes remain in the display area. In the case that only two crosstalk stripes are included in the display area, as long as the boundary between the two crosstalk stripes is not located at the centerline position of the display area, the area occupied by the remaining two crosstalk stripes in the display area still changes with the change of the pixel parameters, i.e., the width of one crosstalk stripe becomes larger, and the width of the corresponding other crosstalk stripe becomes smaller. When the width of one crosstalk stripe reaches the maximum, which indicates that the current pixel parameter is the optimal parameter, the analysis and acquisition subunit 102 records the stereo image and acquires the corresponding pixel parameter. When the width of the crosstalk stripe on the stereoscopic image is calculated, the width of the crosstalk stripe may be determined according to the color distribution based on the analysis of the color value on the stereoscopic image, or the distance from the boundary line to the boundary line of the display area may be calculated and used as the width of the crosstalk stripe. Specifically, assuming that the pitch parameter is a pixel parameter and the cot parameter is an angle correction parameter reference value parameter, the difference from the embodiment of fig. 7 is that the cot parameter is first adjusted, a bisection method may be adopted to take a value of the cot parameter, an inclination angle of a crosstalk stripe in a stereoscopic image displayed by a stereoscopic display device is calculated, and when the crosstalk stripe is vertical, the cot parameter at this time is selected as an optimal cot parameter. And then selecting a cot parameter to be unchanged, adjusting the pitch parameter, performing image analysis on the stereo image displayed by the stereo display equipment, and acquiring the corresponding pitch parameter as the optimal pitch parameter when one crosstalk stripe in the stereo image is the maximum width. In this case, there are two cases in the display effect of the stereoscopic image, and if the crosstalk stripe is a red-green stripe, and the width of the crosstalk stripe is the largest, there is a case where the whole stereoscopic image is occupied by pure red or green, which indicates that the intended purpose of correction is achieved. In another case, only one boundary of crosstalk fringes exists in the stereo image, and the red and green pure colors occupy two sides of the boundary, which requires adjusting the translation correction parameters (including coarse adjustment and fine adjustment) subsequently, so as to achieve the purpose that the pure colors occupy the whole stereo image.
The light splitting device of the stereoscopic display equipment is obliquely arranged on the display panel, because the light splitting unit of the light splitting device is not matched with the display unit arrangement period of the display panel, a translation error can be generated, the translation correction parameter is used for correcting the translation error, and if the translation error is not corrected, the stereoscopic image can generate an image crosstalk problem.
Further, if the stereoscopic display device is located at a certain position and the angle correction parameter is obtained, the stereoscopic display device displays the stereoscopic image according to the obtained angle correction parameter, and at this time, a plurality of crosstalk stripes may still exist on the stereoscopic image because the width of the crosstalk stripe is smaller than that of the display area, so that although the crosstalk stripe is in a vertical state, more than three crosstalk stripes still exist in the display area.
For the situation, the scheme adopted by the application is as follows: firstly, roughly adjusting the translation amount, adjusting the central point of the crosstalk stripe to the central position of the display area, then increasing the width of the crosstalk stripe until the width of the crosstalk stripe is larger than or equal to the width of the display area, and finally finely adjusting to enable the set pure color to occupy the whole display area. Therefore, it is necessary to obtain the rough correction parameter of the translation amount of the stereo image corresponding to the tilt angle when the stereo display device is located at each fixed point position.
Please refer to fig. 33, which is a block diagram of a parameter obtaining unit according to an embodiment of the present invention. This parameter acquisition unit 34 includes a center point detection subunit 311 and a coarse panning parameter acquisition subunit 312. The central point detecting subunit 311 is configured to determine whether a central point of the crosstalk stripe on the stereo image is located in a central area of the screen area. The rough translation parameter obtaining subunit 312 is configured to, when the central point of the crosstalk stripe is located in the central area of the screen area, obtain a corresponding translation parameter as the rough translation correction parameter. If the central point of the crosstalk stripe is not located in the central area of the screen area, adjusting the translation parameter of the stereoscopic image, so that the stereoscopic display equipment displays the stereoscopic image according to the adjusted translation parameter; and then repeatedly judging whether the central point of the crosstalk stripe is in the stereo image screen area.
Specifically, the central area refers to a certain abscissa range in the screen area, for example, the abscissa of the central line in the screen area is 5, and this area may be (4, 6). The translation amount parameter is adjusted in a preset interval, and the stereo image displayed by the stereo display device can be analyzed by utilizing an image analysis technology. If the stereo image has at least three crosstalk stripes, detecting whether the central point of the corresponding crosstalk stripe is in the central area of the screen display area, for example, the stereo image is a left view, and if a pure green image should be displayed in an ideal display state, finding out the central points of all green crosstalk stripes on the stereo image, and detecting whether the central point of one green crosstalk stripe is in the central area of the screen area. And if the central point of one green crosstalk stripe is in the central area of the screen area, taking the translation parameter at the moment as a rough translation correction parameter. If two crosstalk stripes are obvious on the stereo image, the central point of the crosstalk stripe is necessarily deviated from the central area of the screen area at the moment, the crosstalk stripe is gradually translated by adjusting the translation parameter until the central point of one crosstalk stripe is positioned in the central area of the screen area, and the translation parameter recorded at the moment is taken as a translation rough correction parameter; or until the color of one crosstalk stripe is full of the whole screen area, the correction purpose is achieved at the moment, and the translation parameter at the moment is recorded as a translation rough correction parameter.
Corresponding translation amount rough correction parameters are obtained at a plurality of fixed point positions, and pixel parameters can be adjusted on the basis to enable crosstalk stripes to cover the whole screen area, so that grating pixel correction parameters and grating focal length correction parameters of the light splitting device are calculated and obtained. The purpose of obtaining the coarse correction parameter of the translation amount is to enable the crosstalk stripe to cover the whole screen area more quickly, so as to calculate the grating pixel correction parameter and the grating focal length correction parameter of the light splitting device.
The method is used for calculating raster pixel correction parameters and raster focal length correction parameters of a light splitting device of the three-dimensional display equipment, and aims to compare the raster pixel correction parameters and the raster focal length correction parameters with preset values, so that the problems that raster distance and raster focal length are not matched with the preset values and display effect is influenced due to assembly process errors are solved. Therefore, the embodiment of the invention can also acquire the grating focal length correction parameter f. Meanwhile, the embodiment of the invention can also obtain a raster pixel correction parameter t 0. In a specific implementation, when the width of the crosstalk stripe covers the screen area, the corresponding grating focal length parameter and grating pixel parameter are considered to be optimal at this time, and may be used as the grating pixel correction parameter and the grating focal length correction parameter of the stereoscopic display device. When the central point of the crosstalk stripe on the stereo image is located in the central area of the screen area, whether the width of the crosstalk stripe covers the screen area can be judged, if the width of the crosstalk stripe does not cover the screen area, the width of the crosstalk stripe can be increased by adjusting the pixel parameter until the width of the crosstalk stripe covers the screen area.
Please refer to fig. 32, which is a structural diagram of a parameter obtaining unit according to an embodiment of the present invention, wherein the parameter obtaining unit 34 includes a stripe width detecting subunit 321 and a pixel focal length parameter obtaining subunit 322. The stripe width detection subunit 321 is configured to determine whether the width of the crosstalk stripe covers the screen area. The pixel focal length parameter acquiring subunit 322 is configured to, when the width of the crosstalk stripe covers the screen area, use a grating pixel parameter corresponding to the acquired pixel parameter of the stereoscopic image as the grating pixel correction parameter, and use a grating focal length parameter corresponding to the pixel parameter of the stereoscopic image as the grating focal length correction parameter.
Specifically, the pixel parameters are adjusted in a preset interval, so that the width of crosstalk fringes in a stereo image displayed by the stereo display equipment is continuously changed, when the width of the crosstalk fringes is larger than or equal to the width of a screen area, namely the crosstalk fringes cover the screen area, and the raster pixel parameters and the raster focal length parameters corresponding to the pixel parameters are calculated to serve as the raster pixel correction parameters and the raster focal length correction parameters.
The grating pixel correction parameters and the grating focal length correction parameters may be calculated according to the following formulas:
wherein d isiThe information of the fixed point position when the stereoscopic display device is located at the ith fixed point position, namely the information of the distance between the stereoscopic display device and the shooting device when the stereoscopic display device is located at the ith fixed point position. Batch typeiF is a raster focal length correction parameter of a light splitting device of the stereoscopic display device, and t0 is a raster pixel correction parameter of the light splitting device of the stereoscopic display device, wherein the pixel parameter of the stereoscopic image is when the stereoscopic display device is located at the ith fixed point position and the crosstalk stripe covers the screen area.
Further, when acquiring pixel correction parameters corresponding to a stereoscopic image when the stereoscopic display device is located at a plurality of fixed point positions, calculating raster pixel correction parameters and raster pixel correction parameters of the light splitting deviceWhen the focal length correction parameter is obtained, the obtained pixel correction parameter corresponding to the stereoscopic image when the stereoscopic display device is located at the plurality of fixed point positions and the fixed point position information where the stereoscopic display device is located may all be substituted into a formula:forming a matrix, calculating the minimum error of the matrix, and taking the corresponding grating pixel parameter and the grating focal length parameter meeting the minimum error as the grating pixel correction parameter and the grating focal length correction parameter of the light splitting device.
Further, in the process of adjusting the pixel parameters, the linear relationship between the pixel parameters and the width of the crosstalk stripe is in a parabolic shape, so that when the width of the crosstalk stripe just covers the screen area, the pixel focal length parameter obtaining subunit 322 obtains two pixel parameter values, that is, the first pixel parameter and the second pixel parameter. Theoretically, when the average value of the first pixel parameter and the second pixel parameter is adjusted, the width of the crosstalk stripe reaches the maximum, so the pixel focal length parameter obtaining sub-unit 322 may calculate the average value of the first pixel parameter and the second pixel parameter, and use the calculated average value as the pixel parameter of the stereoscopic image when the width of the crosstalk stripe covers the screen area.
According to the method and the device, the stereoscopic display equipment is corrected at multiple fixed point positions, the correction parameters are obtained by utilizing the inclination angles of the crosstalk stripes, the accuracy of the calculated correction parameters is high, and the correction efficiency can be greatly improved.
After the raster pixel correction parameters and the raster focal length correction parameters are obtained, in order to further eliminate calculation errors and further improve the correction accuracy, fine adjustment can be performed on the translation amount under the condition that the stereoscopic display device is started to track.
Please refer to fig. 11, which is a block diagram of a parameter obtaining unit according to an embodiment of the present invention. This parameter acquisition unit 34 includes: a micro-translation parameter acquisition subunit 111. The micro-translation parameter obtaining subunit 111 obtains the translation amount micro-adjustment parameter of the corresponding stereo image according to the calculated image crosstalk score when the tilt angle of the crosstalk stripe calculated by the tilt angle calculating unit satisfies the preset angle range and the stereo display device starts tracking. The value interval of the fine adjustment parameter of the translation amount can be determined by setting a range on the left and the right by taking the obtained coarse correction parameter of the translation amount as a middle value. The image crosstalk score refers to an evaluation standard for the crosstalk condition of the stereo image. The following will describe a method of acquiring the translation amount fine adjustment parameter. It should be noted that the adjustment method of the rough correction parameter of the translation amount is similar to the adjustment method of the fine adjustment parameter of the translation amount, and will not be described in detail here.
Specifically, the adjustment of the translation amount is usually performed when the angle correction parameter, the raster pixel correction parameter, and the raster focal length correction parameter have been corrected, and assuming that the xoffadd parameter is the translation amount fine adjustment parameter and the crosstalk fringes are red and green fringes, the red and green fringes are translated in the horizontal direction by appropriately adjusting the xoffadd parameter, and when the images captured by the left and right cameras are translated to an appropriate value, the images captured by the left and right cameras respectively show the most vivid red and green colors. This suitable parameter is the optimum xoffadd parameter.
When the stereo display equipment adopts the best xoffadd parameter to display the stereo image, the stereo images shot by the left camera and the right camera are respectively pure red images and green images, and the red images and the green images are respectively filled in the whole image area without hanging corners, so that a viewer can experience the best 3D effect when observing the stereo image.
The correction process of the xoffadd parameter is that the minimum value of the xoffadd parameter in the detection interval is directly traversed to the maximum value, and then the xoffadd parameter with the best light splitting effect is selected from the xoffadd parameter. In order to increase the search speed, a variable step size can be used for adjustment.
For example, starting from the initial translation amount xoffadd of 0, a numerical value is added one at a time, and then the stereoscopic display device is set. After equipment is set up at every turn, snatch the stereo image through the shooting device immediately, then utilize image analysis technique analysis stereo image's colour to adjust the step length according to the colour change condition, can set for a crosstalk score here according to the colour value of pixel point on the stereo image, adjust the change step length of xoffadd parameter according to the crosstalk score condition. For example, the crosstalk score of the stereo image is very low, which means that the value is far from the optimal xoffadd parameter value, so a relatively large value needs to be added to accelerate the search speed. On the contrary, if the crosstalk score of the stereo image is higher, the optimum xoffadd parameter value is close to, so that a xoffadd parameter value with a smaller step length is set for accurate searching. When the crosstalk score of the image reaches a certain threshold, the xoffadd parameter at the moment can be stored in an array, and finally, an optimal xoffadd parameter is found out from the array.
Because the stereo image provided by the stereo display device has two images of a left view and a right view, please refer to fig. 12, fig. 12 is a schematic diagram of an optimal viewing position of the stereo image, and according to the optical imaging principle, only when the left camera and the right camera of the camera are respectively placed at the optimal viewing point, i.e. the circle position in fig. 12, the most vivid stereo image can be seen, so that according to the difference of the distances from the camera to the stereo display device, there are two schemes for selecting the optimal value from a plurality of candidate xoffadd parameter values:
first, when two cameras of the photographing device are located at the optimal positions, the translation amount calculation subunit 111 obtains a translation amount parameter corresponding to the stereo image with the highest image crosstalk score as the optimal translation amount fine adjustment parameter. In this case, when the image captured by the left camera is the most vivid image, the right image should also be the most vivid image, and therefore the left and right stereoscopic images are simultaneously the most vivid images. The optimum xoffadd parameter at this time is the value of the xoffadd parameter that can maximize the vividness of the left (or right) image. At the moment, the optimal xoffadd parameter can be judged only according to the image acquired by one camera.
Second, when both cameras of the photographing apparatus are not located at the optimal positions, specifically, when neither camera is placed at the optimal optical viewing position, either both cameras are located in front of the optimal position or both cameras are located behind the optimal viewing position, see fig. 13 and 14, fig. 13 is a schematic view of the camera being placed behind the optimal viewing position, and fig. 14 is a schematic view of the camera being placed in front of the optimal viewing position. This may occur: the left camera has captured the most vivid solid color image, but the right camera does not, or just the opposite, have detected the most vivid solid color image, while the left has not. In this case, the translation amount operator unit 111 forms a selection region based on the xoffadd parameter stored in the array, and acquires the intermediate value of the selection region as the optimum xoffadd parameter. Different schemes can be adopted for selecting the optimal xoffadd parameter from the selection area, and this embodiment provides three preferred schemes:
if the difference between the xoffadd parameters corresponding to the images captured by the left camera and the right camera is very small when the images are brightest, as shown in fig. 15, fig. 15 is a schematic diagram of a curve of a selected translation fine tuning parameter array, the abscissa in fig. 15 is the xoffadd parameter value, the ordinate is the crosstalk score value, the two curves are curves of the xoffadd parameter arrays corresponding to the left view and the right view respectively, at this time, the average value of the xoffadd parameters when the left image and the right image reach the brightest degree (i.e., the ordinate is the maximum) can be taken as the optimal xoffadd parameter, that is, the xoffadd parameter at the position of the dotted line in fig. 15 is taken as the optimal xoffadd parameter.
(II) if the difference between the xoffadd parameters corresponding to the images captured by the left camera and the right camera is large when the images are brightest, as shown in FIG. 16, the abscissa in FIG. 16 is the xoffadd parameter value, the ordinate is the crosstalk score value, the two curves with the smaller peak value are respectively curves of the xoffadd parameter arrays corresponding to the left view and the right view, at this time, the xoffadd parameter corresponding to the maximum value of the sum of the ordinate values of the xoffadd parameter curves of the left view and the right view is the optimal xoffadd parameter, that is, the ordinate of the two curves is added to form a curve with the higher peak value in FIG. 16, and then the abscissa corresponding to the maximum value of the ordinate of the curve is selected as the optimal xoffadd parameter.
Please refer to fig. 17, fig. 17 is a schematic diagram of a curve of another selected fine tuning parameter array of the translation amount, in fig. 17, the abscissa is the value of xoffadd parameter, the ordinate is the value of crosstalk score, and the two curves are curves of the xoffadd parameter array corresponding to the left view and the right view, respectively. A vertical coordinate threshold (as shown by a threshold line in fig. 17) is set, four horizontal coordinates (i.e., A, B, C, D four horizontal coordinates) are selected, and then the middle value of the horizontal coordinate B, C or the middle value of the horizontal coordinate A, D is taken as the optimal xoffadd parameter.
It is noted that, for different stereoscopic display devices, the correction parameters to be calculated may be selected according to a specific analysis of the stereoscopic image displayed by the stereoscopic display device, and need not necessarily be calculated once for each correction parameter. For example, when the stereo image has only two vertical crosstalk fringes and the width of the crosstalk fringes is already the maximum, only the translation fine adjustment parameter needs to be calculated, and the angle correction parameter and the pixel correction parameter do not need to be calculated. If the stereo image is displayed in a pure color according to the two correction parameters after the angle correction parameters and the pixel correction parameters are calculated, the translation fine adjustment parameters do not need to be calculated.
According to the method and the device, the stereoscopic display equipment is corrected at multiple fixed point positions, the correction parameters are obtained by utilizing the inclination angles of the crosstalk stripes, the accuracy of the calculated correction parameters is high, when the stereoscopic display equipment is corrected by utilizing the correction parameters, the influence caused by assembly errors can be eliminated, and the display effect of the stereoscopic display equipment is improved.
According to the method and the device, the stereoscopic display equipment is corrected at multiple fixed point positions, the correction parameters are obtained by utilizing the inclination angles of the crosstalk stripes, the accuracy of the calculated correction parameters is high, when the stereoscopic display equipment is corrected by utilizing the correction parameters, the influence caused by assembly errors can be eliminated, and the display effect of the stereoscopic display equipment is improved.
Please refer to fig. 18, which is a block diagram of another calibration parameter obtaining apparatus for a stereoscopic display device according to an embodiment of the present invention. Compared with the embodiment of fig. 3, the correction parameter acquiring device 21 of the stereoscopic display apparatus shown in fig. 18 includes, in addition to the image acquiring unit 31, the crosstalk stripe detecting unit 32, the inclination calculating unit 33, and the parameter acquiring unit 34: an image analysis unit 181.
The image analysis unit 181 is configured to analyze the stereoscopic image received by the image acquisition unit 31 to transmit its analysis result to other units in the apparatus as needed. The image analysis unit 181 may transform the stereo image into HSV space, and obtain values on three components of hue, saturation, and brightness, so as to analyze the stereo image.
Further, please refer to fig. 19, which is a structural diagram of an image analysis unit according to an embodiment of the present invention. The image analysis unit further comprises: the crosstalk score calculating subunit 191. The crosstalk score calculating subunit 191 is configured to calculate an image crosstalk score according to the color of the stereo image. The crosstalk score calculating subunit 191 may perform regional statistics on the color values of the stereo image, assign corresponding weights to different regions according to color value intervals of different regions, sum the color values of all the regions and perform weighted summation, and finally use the ratio of the sum of all the weighted color values to the sum of all the color values as an image crosstalk score.
Specifically, in many places in the present application, it is necessary to detect crosstalk of a stereoscopic image, for example, the translation amount calculating subunit 111 needs an image crosstalk score to judge whether the stereoscopic image is a pure color image, where the image crosstalk score is an evaluation criterion for the degree of crosstalk of the stereoscopic image, and if a single color occupies more area of the stereoscopic image and the color is more vivid, the image crosstalk score of the stereoscopic image is higher.
Taking red as an example, when the vividness of a red pixel is judged, the color value of the image is subjected to regional statistics, and if the color values of most of the pixels are concentrated near the color value 0, the image can be judged to belong to the vivid red. The overall vividness of an image can be determined in such a way. Specifically, when a red image needs to be judged, a regional weighted summation can be performed on the color values of pixel points on the image, the weighted summation of the color values of all the pixel points is divided by the unweighted numerical sum, and the numerical sum is used as crosstalk evaluation of a stereo image. The regional weighting means that the color value closer to the most vivid red (the most vivid red color value is 0) is given a larger weight, for example, the numerical sum in the interval of color values (0-5) is multiplied by a larger weight 64, the numerical sum in the interval of color values (5-10) is multiplied by a weight 16, the numerical sum in the interval of color values (10-15) is multiplied by a small weight 4, the numerical sum in the interval of color values (15-20) is kept unchanged, the weighted sum is divided by the unweighted sum to obtain a numerical value of 1 to 64, and the numerical value can be used to evaluate the degree of crosstalk on the image. Another method similar to this is that, for a stereoscopic display area targeting red, in addition to performing the above weighted summation on a red target value, other non-target color values of the stereoscopic display area, such as a crosstalk green color value, may also be summed and multiplied by a negative weight, and then all color value intervals and their corresponding weighted values in the stereoscopic display area are multiplied and summed, except for the sum of all unweighted color interval values, so as to obtain a value between (-64,64), and also may use this value to evaluate the image for the degree of crosstalk. The green stereoscopic image is also processed according to the method, and judgment on the green vividness degree can be obtained.
Referring to fig. 21, which is a structural diagram of a correction parameter acquiring apparatus of a stereoscopic display device according to another embodiment of the present invention, compared with the embodiment of fig. 18, the correction parameter acquiring apparatus 21 of the stereoscopic display device shown in fig. 21 includes, in addition to an image acquiring unit 31, a crosstalk stripe detecting unit 32, a calculating unit 33, a parameter acquiring unit 34, an image analyzing unit 181, and a screen area detecting unit 182, further includes: the detection section setting unit 211.
The detection section setting unit 211 is configured to set a parameter detection section and transmit the set detection section to the stereoscopic display device, so that the stereoscopic display device displays a stereoscopic image according to the set detection section, so as to facilitate calculation of a correction parameter. The set detection interval may include an interval size, a parameter adjustment step size, and the like. In the correction process, the reference value detection interval needs to be set according to the angle correction parameter, the raster pixel correction parameter, the translation amount coarse adjustment parameter, the translation amount fine adjustment correction parameter and the like. For example, when the translation amount is corrected, the detection interval setting unit 211 is used to set the detection interval of the translation amount correction parameter (including the translation amount fine adjustment parameter and the translation amount rough correction parameter) and the step length of the value in the detection interval, and send the set detection interval to the micro-translation parameter obtaining subunit 111, and then the micro-translation parameter obtaining subunit 111 obtains the optimal translation amount correction parameter (including the translation amount fine adjustment parameter and the translation amount rough correction parameter) according to the received stereo image and the corresponding parameter reference value in the detection interval.
According to the method and the device, the calculation of the correction parameters can be automatically completed, the manual operation of an operator is not needed, the correction is performed after the assembly of the stereoscopic display equipment is completed, the reliability of the correction result is high, and the stereoscopic display effect can be effectively improved.
Corresponding to the foregoing correction system of the stereoscopic display device, the present application also provides a correction method of the stereoscopic display device, please refer to fig. 22, which is a flowchart of the correction method of the stereoscopic display device according to the embodiment of the present invention, and the method includes the following steps:
s2201, acquiring a stereoscopic image displayed by the stereoscopic display device when the stereoscopic image is located at least two fixed positions.
S2202, detecting crosstalk stripes in the stereoscopic image when the stereoscopic display device is located at least two fixed point positions. The stereo image comprises at least one crosstalk stripe
S2203, calculating the stripe inclination angle of the detected crosstalk stripes.
S2204, when the calculated stripe inclination angle of the corresponding crosstalk stripe when the stereoscopic display device is located at the at least two fixed points satisfies a preset angle range, acquiring a correction parameter of the stereoscopic display device.
S2205, correcting the stereoscopic display device according to the acquired correction parameters of the stereoscopic image.
Further, the step of acquiring the stereoscopic image displayed by the stereoscopic display device (i.e. step S2202) may further include the following steps, please refer to fig. 28:
s2801, receiving a shot image picture comprising the stereoscopic display device.
S2802, determining the screen area of the stereoscopic display device in the image picture. The brightness value or the chroma value of the pixel point in the image picture can be acquired, binarization processing is carried out on the acquired brightness value of the pixel point according to a preset brightness threshold value or a preset chroma value so as to obtain a corresponding quasi-screen area, and then the corresponding quasi-screen area is merged and divided according to a preset shape so as to determine the screen area of the stereoscopic display device in the image picture.
And S2803, acquiring the stereoscopic image displayed in the screen area.
Further, the detection of the crosstalk stripe in the stereo image (i.e., step S2202) may further include the following steps, see fig. 23:
s2301, calculating color values of pixel points in the stereo image.
And S2302, acquiring crosstalk fringes in the stereo image according to the calculated color values.
Further, the step of calculating the tilt angle of the detected crosstalk stripe (i.e. step S2203) may further include the following steps, please refer to fig. 24:
s2401, calculating color values of pixel points in the stereo image.
S2402, determining a boundary between the crosstalk stripes according to the calculated color values of the pixel points. The color values of the pixel points can be fitted by methods such as a least square method, and lines obtained through fitting are used as boundaries among the crosstalk stripes.
S2403, determining whether the linear distribution of the boundary line satisfies a preset linear distribution condition. If yes, the process proceeds to step S2404, and if not, the boundary is discarded. The linear distribution condition is preferably a straight line distribution. Further, when linear distribution of the boundary is judged, the pixel point coordinate sequence of the boundary may be obtained first, then the covariance matrix of the pixel point coordinate sequence of the boundary is calculated, then the eigenvalue of the covariance matrix is calculated, and finally the linear degree of the boundary is judged according to the calculated eigenvalue.
S2404, calculating a tilt angle of the boundary as a tilt angle of the crosstalk stripe.
It should be noted that, if a plurality of crosstalk fringes and a plurality of corresponding boundary lines are determined according to the calculated color values of the pixel points, in order to improve the calculation accuracy of the tilt angle, the tilt angles of the plurality of boundary lines between the crosstalk fringes may be calculated, and an average value may be calculated to serve as the tilt angle of the boundary lines.
In step S2204, the correction parameters include an angle correction parameter, a coarse correction parameter of the amount of translation, a raster pixel correction parameter, a fine adjustment parameter of the amount of translation, and the like. It is noted that, for different stereoscopic display devices, the correction parameters to be calculated may be selected according to a specific analysis of the stereoscopic image displayed by the stereoscopic display device, and need not necessarily be calculated once for each correction parameter. For example, when the stereo image has only two vertical crosstalk fringes and the width of the crosstalk fringes is already the maximum, only the translation correction parameter needs to be calculated and the angle correction parameter does not need to be calculated. If the stereoscopic image displayed by the display device according to the two correction parameters is in a pure color after the angle correction parameters are calculated by the stereoscopic image, the translation correction parameters do not need to be calculated.
Further, when the calculated tilt angle of the crosstalk stripe satisfies the set angle, the method may further include the following steps when obtaining an angle correction parameter according to the corresponding stereo image, please refer to fig. 25:
s2501, obtaining angle correction parameter reference values corresponding to the pixel parameters according to the pixel parameters corresponding to the stereo images when the inclination angle meets a preset angle range.
S2502, calculating a linear relation between the pixel parameters and the angle correction parameter reference values according to the pixel parameters and the corresponding angle correction parameter reference values.
S2503, determining an angle correction parameter of the stereoscopic image corresponding to the tilt angle according to a linear relationship between the pixel parameter and an angle correction parameter reference value, a grating physical parameter of a light splitting device of the stereoscopic display device, a preset grating focal length parameter f1, and fixed point position information of the stereoscopic display device, so as to serve as the angle correction parameter of the stereoscopic display device.
Further, the obtaining of the rough correction parameter of the translation amount may include the following steps, please refer to fig. 26:
s2601, determining whether the center point of the crosstalk stripe is in the center area of the screen area. If the determination result is yes, the process proceeds to step S2602, and if the determination result is no, the process proceeds to step S2603.
S2602, taking a translation parameter corresponding to the central point of the crosstalk stripe in the central area of the stereoscopic image screen area as the coarse correction parameter of the translation.
S2603, adjusting the translation parameter of the stereoscopic image, so that the stereoscopic display device displays the stereoscopic image according to the adjusted translation parameter. And returns to step S2601.
Further, the acquiring the raster pixel correction parameter and the raster focal length correction parameter of the stereoscopic image corresponding to the tilt angle may further include the following steps, please refer to fig. 29:
s2901, determining whether the width of the crosstalk stripe covers the screen area. Whether the cross-talk stripe covers the screen area can be judged by judging whether the width of the cross-talk stripe is greater than or equal to that of the screen area. If yes, go to step S2902; if the determination result is negative, the process proceeds to step S2903.
S2902, regarding the grating pixel parameter corresponding to the pixel parameter of the stereoscopic image when the crosstalk stripe covers the screen area as the grating pixel correction parameter, and regarding the corresponding grating focal length parameter as the grating focal length correction parameter.
S2903, adjusting the pixel parameter of the stereoscopic image, so that the stereoscopic display device displays the stereoscopic image according to the adjusted pixel parameter; and returns to step S2901.
Specifically, when step S2902 is executed, that is, when calculating the raster pixel correction parameter and the raster focal length correction parameter of the light splitting device of the stereoscopic display device, please refer to fig. 34, which is a flowchart when calculating the raster pixel correction parameter and the raster focal length correction parameter of the light splitting device of the stereoscopic display device according to the embodiment of the present invention, and the flowchart includes the following steps:
and S3401, acquiring a linear relation between a grating pixel correction parameter and a grating focal length correction parameter of a light splitting device of the stereoscopic display equipment according to the pixel parameter corresponding to each fixed point position, the distance from each fixed point position to the stereoscopic display equipment, and a physical relation between the grating pixel parameter and the grating focal length parameter of the light splitting device of the stereoscopic display equipment.
The pixel parameters corresponding to each fixed point position refer to the pixel parameters of the stereoscopic image when the stereoscopic display device is located at each fixed point position and the crosstalk stripes of the stereoscopic image cover the screen area, and the fixed point position information of the stereoscopic display device refers to the distance information between the stereoscopic display device and the shooting device.
And S3402, calculating values of the raster pixel correction parameter and the raster focal length correction parameter of the light splitting device of the stereoscopic display equipment by utilizing the linear relation between the raster pixel correction parameter and the raster focal length correction parameter of the light splitting device of the stereoscopic display equipment.
Since the linear relationship between the pixel parameter and the width of the crosstalk stripe is parabolic, when the width of the crosstalk stripe just covers the screen area, two pixel parameter values, namely a first pixel parameter and a second pixel parameter, are obtained. To further improve the accuracy, an average value of the first pixel parameter and the second pixel parameter may be calculated, and the calculated average value may be used as the raster pixel correction parameter.
Specifically, the linear relationship between the acquired pixel correction parameter and the grating focal length correction parameter is:the following formula can therefore be followed when calculating the raster pixel correction parameters and the raster focal length correction parameters:wherein d isiFor the fixed point position information of the stereoscopic display device at the ith fixed point position, pitchiF is a raster focal length correction parameter of a light splitting device of the stereoscopic display device, and t0 is a raster pixel correction parameter of the light splitting device of the stereoscopic display device, wherein the pixel parameter of the stereoscopic image is when the stereoscopic display device is located at the ith fixed point position and the crosstalk stripe covers the screen area.
Further, when acquiring pixel parameters of a corresponding stereoscopic image when the stereoscopic display device is located at a plurality of fixed point positions, calculating the pixel parametersThe steps of the grating pixel correction parameter and the grating focal length correction parameter of the light splitting device comprise: and substituting the acquired pixel parameters of the corresponding stereo image when the stereo display equipment is positioned at a plurality of fixed point positions and the fixed point position information of the stereo display equipment into a formula:forming a matrix, calculating the minimum error of the matrix, and taking the corresponding grating pixel parameter and the grating focal length parameter meeting the minimum error as the grating pixel correction parameter and the grating focal length correction parameter of the light splitting device.
Further, the obtaining of the fine adjustment parameter of the translation amount may include the following steps, please refer to fig. 27:
s2701, a translation amount fine adjustment parameter detection section is set.
And S2702, receiving the stereo image according to the translation fine adjustment parameter detection interval.
S2703, extracting color values of the stereo image.
S2704, the color values of the stereo images are subjected to regional statistics.
S2705, corresponding weights are given to different areas according to the color value intervals of the different areas.
S2706, sums and weights the color values of all the regions.
S2707, a ratio of the sum of all weighted color values to the sum of all color values is used as an image crosstalk score.
And S2708, obtaining a translation fine adjustment parameter according to the image crosstalk score.
When the translation amount fine adjustment parameter is obtained according to the image crosstalk score, the method can be divided into two modes according to the difference of the shooting positions of the three-dimensional images: firstly, when the shooting position of the stereo image is located at the optimal observation position, the translation correction parameter corresponding to the stereo image with the highest image crosstalk score is obtained as the optimal translation fine adjustment parameter. Secondly, when the shooting position of the stereo image is not located at the optimal observation position, firstly, a translation parameter of the stereo image with a crosstalk score larger than a set threshold value is obtained to be used as a reference value, secondly, a translation fine-tuning parameter selection area is obtained according to the translation parameter reference value, and then, a middle value of the translation fine-tuning parameter selection area is obtained to be used as an optimal translation fine-tuning parameter.
According to the method and the device, the calculation of the correction parameters can be automatically completed, the manual operation of an operator is not needed, the correction is performed after the assembly of the stereoscopic display equipment is completed, the reliability of the correction result is high, and the stereoscopic display effect can be effectively improved.
Through the above description of the embodiments, it is clear to those skilled in the art that the embodiments of the present invention may be implemented by hardware, or by software plus a necessary general hardware platform. Based on such understanding, the technical solutions of the embodiments of the present invention may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.), and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the various implementation scenarios of the embodiments of the present invention.
Although the present invention has been described with reference to a preferred embodiment, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (38)
1. A correction method of a stereoscopic display device, comprising:
acquiring a stereoscopic image displayed when the stereoscopic display equipment is positioned at least two fixed points;
detecting crosstalk stripes in the stereo image acquired when the stereo display device is located at least two fixed points, wherein the stereo image comprises at least one crosstalk stripe;
calculating the stripe dip angle of the detected crosstalk stripes;
when the calculated stripe inclination angles of the corresponding crosstalk stripes when the stereoscopic display device is located at least two fixed points meet a preset angle range, acquiring correction parameters of the stereoscopic display device;
and correcting the stereoscopic display equipment according to the acquired correction parameters.
2. The correction method for a stereoscopic display device according to claim 1, wherein in the step of acquiring the stereoscopic image displayed when the display device is located at least two pointing positions, the at least two pointing positions are arranged linearly or in a cross shape.
3. The correction method for a stereoscopic display device according to claim 1, wherein the acquiring of the stereoscopic image displayed by the stereoscopic image displayed when the stereoscopic display device is located at least two pointing positions comprises:
receiving shot image pictures including images displayed when the stereoscopic display equipment is positioned at least two fixed points;
determining a screen area of the stereoscopic display device in the image picture;
and acquiring the stereo image displayed in the screen area.
4. The correction method of a stereoscopic display device according to claim 3, wherein the step of determining the screen region in the image picture comprises:
acquiring the brightness value or the chromatic value of a pixel point in the image picture;
performing binarization processing on the acquired brightness value or chromatic value of the pixel point correspondingly according to a preset brightness threshold value or a preset chromatic value to obtain a corresponding quasi-screen area;
and merging and dividing the corresponding quasi-screen area according to a preset shape to determine the screen area.
5. The correction method for a stereoscopic display device according to claim 1, wherein the step of detecting crosstalk fringes in the acquired stereoscopic image comprises:
calculating color values of pixel points in the stereo image;
and acquiring crosstalk stripes in the stereo image according to the calculated color values.
6. The correction method of a stereoscopic display device according to claim 1, wherein the step of calculating the tilt angle of the stripes of the detected crosstalk stripes comprises:
calculating color values of pixel points in the stereo image;
determining a boundary between the crosstalk stripes according to the calculated color values of the pixel points;
and calculating the inclination angle of the boundary line to be used as the stripe inclination angle of the crosstalk stripes.
7. The calibration method for a stereoscopic display device according to claim 6, wherein the step of determining a boundary between the crosstalk stripes according to the calculated color values of the pixel points comprises:
and fitting the color values of the pixel points, and taking lines obtained by fitting as boundary lines among the crosstalk stripes.
8. The method for calibrating stereoscopic display device according to claim 7, wherein after the fitting the color values of the pixels, the method further comprises:
judging whether the linear distribution of the line obtained by fitting meets a preset linear distribution condition or not;
and if the preset linear distribution condition is met, using the line obtained by fitting as a boundary line between the crosstalk stripes.
9. The calibration method for stereoscopic display apparatus according to claim 6, wherein if a plurality of boundaries between the crosstalk stripes are determined according to the calculated color values of the pixel points, the step of calculating the tilt angles of the boundaries comprises:
the tilt angles of a plurality of borderlines between the crosstalk stripes are calculated, respectively, and an average value of the tilt angles of the plurality of borderlines is calculated as the tilt angle of the borderline.
10. The correction method of a stereoscopic display device according to claim 3, wherein the correction parameters of the stereoscopic display device include an angle correction parameter;
the step of obtaining the correction parameters of the stereoscopic display device when the calculated stripe inclination angles of the corresponding crosstalk stripes when the stereoscopic display device is located at the at least two fixed points satisfy the preset angle range includes:
and acquiring angle correction parameters of the stereo image corresponding to the inclination angle when the stereo display equipment is positioned at any fixed point position, and taking the angle correction parameters as the angle correction parameters of the stereo display equipment.
11. The correction method of a stereoscopic display device according to claim 10,
the obtaining of the stereoscopic image corresponding to the tilt angle when the stereoscopic display device is located at least two fixed points includes:
respectively acquiring a plurality of corresponding stereo images of the stereo display equipment which is positioned at each fixed point position and displayed according to different pixel parameters;
the step of obtaining the correction parameter of the stereoscopic display device when the calculated tilt angle of the crosstalk stripe satisfies a preset angle range includes:
according to a plurality of pixel parameters corresponding to the plurality of stereoscopic images when the inclination angle meets a preset angle range, obtaining angle correction parameter reference values corresponding to the plurality of pixel parameters when the stereoscopic display device is located at any fixed point position; calculating a linear relation between the pixel parameters and the angle correction parameter reference values when the stereoscopic display equipment is positioned at any fixed point position according to the obtained pixel parameters and the angle correction parameter reference values corresponding to the pixel parameters; and determining the angle correction parameter reference value of the stereoscopic display equipment according to the linear relation between the pixel parameter and the angle correction parameter reference value, the grating physical parameter and the preset grating focal length parameter of the light splitting device of the stereoscopic display equipment and the fixed point position information of the stereoscopic display equipment, so as to be used as the angle correction parameter of the stereoscopic display equipment.
12. The correction method of the stereoscopic display device according to claim 10 or 11, wherein the correction parameters of the stereoscopic display device include: roughly correcting parameters of the translation amount;
the correction method of the stereoscopic display device further includes:
and when the calculated inclination angle of the crosstalk stripe meets a preset angle range, respectively acquiring a translation amount rough correction parameter of the stereo image corresponding to the inclination angle when the stereo display device is positioned at each fixed point position.
13. The method for correcting the stereoscopic display device according to claim 12, wherein the step of respectively obtaining the rough correction parameter of the translation amount of the stereoscopic image corresponding to the tilt angle when the stereoscopic display device is located at each fixed point position comprises:
judging whether the central point of the crosstalk stripe is positioned at the center of the screen area;
if so, taking the translation parameter corresponding to the crosstalk stripe as the rough translation correction parameter; or,
if the judgment result is negative, adjusting the translation parameter of the three-dimensional image so that the three-dimensional display equipment displays the three-dimensional image according to the adjusted translation parameter; and returning to judge whether the central point of the crosstalk stripe is positioned at the center of the stereo image screen area.
14. The correction method of a stereoscopic display device according to claim 12, wherein the correction parameters of the stereoscopic display device include a raster pixel correction parameter and a raster focal length correction parameter of a light splitting device;
when the calculated stripe inclination angle of the crosstalk stripe meets a preset angle range, acquiring a correction parameter of the stereoscopic display device, including:
and acquiring raster pixel correction parameters and raster focal length correction parameters of the stereoscopic display equipment.
15. The correction method of a stereoscopic display device according to claim 14, wherein the step of acquiring the raster pixel correction parameter and the raster focal length correction parameter of the stereoscopic display device comprises:
judging whether the width of crosstalk stripes of the stereo image covers the screen area when the stereo display equipment is positioned at least two fixed points;
if the judgment result is yes, acquiring pixel parameters of the stereoscopic image when the stereoscopic display device is located at least two fixed point positions and crosstalk fringes of the stereoscopic image cover the screen area, and calculating raster pixel correction parameters and raster focal length correction parameters of a light splitting device of the stereoscopic display device according to the acquired pixel parameters of the stereoscopic image and fixed point position information of the stereoscopic display device when the stereoscopic display device is located at least two fixed point positions and the crosstalk fringes of the stereoscopic image cover the screen area, wherein the fixed point position information is distance information between the stereoscopic display device and a shooting device; or
If the judgment result is negative, adjusting the pixel parameters of the three-dimensional image so that the three-dimensional display equipment displays the three-dimensional image according to the adjusted pixel parameters; and returning to the step of judging whether the width of the crosstalk stripes of the stereo image covers the screen area when the stereo display equipment is positioned at least two fixed points.
16. The correction method for a stereoscopic display device according to claim 15, wherein the calculating the raster pixel correction parameter and the raster correction focal length parameter of the light splitting device includes:
according to the formula:
wherein d isiFor the fixed point position information of the stereoscopic display device at the ith fixed point position, pitchiF is a raster focal length correction parameter of a light splitting device of the stereoscopic display device, and t0 is a raster pixel correction parameter of the light splitting device of the stereoscopic display device, wherein the pixel parameter of the stereoscopic image is when the stereoscopic display device is located at the ith fixed point position and the crosstalk stripe covers the screen area.
17. The method for correcting a stereoscopic display device according to claim 16, wherein when acquiring pixel parameters of a corresponding stereoscopic image when the stereoscopic display device is located at a plurality of fixed point positions, the step of calculating the raster pixel correction parameter and the raster focal length correction parameter of the light splitting device includes:
and substituting the acquired pixel parameters of the corresponding stereo image when the stereo display equipment is positioned at a plurality of fixed point positions and the fixed point position information of the stereo display equipment into a formula:forming a matrix, and calculating a minimum error of the matrix, corresponding light that will satisfy the minimum errorAnd taking the grating pixel parameter and the grating focal length parameter as a grating pixel correction parameter and a grating focal length correction parameter of the light splitting device.
18. The correction method of a stereoscopic display device according to claim 15,
the width of the crosstalk stripe of the stereoscopic image covering the screen area comprises: the width of the crosstalk stripe is larger than or equal to the screen area;
the method further comprises the following steps: acquiring a first pixel parameter and a second pixel parameter of the stereo image when the width of the crosstalk stripe is equal to the screen area;
and calculating the average value of the first pixel parameter and the second pixel parameter, and taking the calculated average value as the pixel parameter of the stereo image when the width of the crosstalk stripe covers the screen area.
19. The correction method of a stereoscopic display device according to claim 14, wherein the correction parameter of the stereoscopic image further comprises: fine adjustment parameters of translation amount;
the correction method of the stereoscopic display device further includes:
when the calculated stripe inclination angle of the crosstalk stripe meets a preset angle range, acquiring a correction parameter of the stereoscopic display device, including:
and acquiring the translation amount correction fine adjustment parameter of the stereoscopic display equipment under the condition that the stereoscopic display equipment is started to track.
20. The correction method of a stereoscopic display device according to claim 19, wherein the step of obtaining the translation amount fine-adjustment correction parameter of the stereoscopic display device comprises:
extracting color values of the stereoscopic images when the stereoscopic display equipment starts tracking;
calculating an image crosstalk score of the stereo image according to the color value of the stereo image;
and acquiring the fine adjustment parameter of the translation amount according to the calculated image crosstalk score.
21. The method for correcting a stereoscopic display device according to claim 20, wherein the step of calculating the image crosstalk score of the stereoscopic image according to the color value of the stereoscopic image comprises:
carrying out regional statistics on the color values of the stereo image;
according to the color value intervals of different regions, corresponding weights are given to the different regions;
summing and weighting the color values of all the regions;
the ratio of the sum of all weighted color values to the sum of all color values is taken as the image crosstalk score.
22. A correction system of a stereoscopic display device is characterized by comprising the stereoscopic display device, a shooting device and a correction parameter acquisition device of the stereoscopic display device, wherein the correction parameter acquisition device of the stereoscopic display device further comprises:
the image acquisition unit is used for acquiring a stereoscopic image displayed when the stereoscopic display equipment is positioned at least two fixed points;
a crosstalk stripe detection unit, configured to detect crosstalk stripes in the stereoscopic image acquired when the stereoscopic display device is located at least two fixed points, where the stereoscopic image includes at least one crosstalk stripe;
the inclination angle calculating unit is used for calculating the stripe inclination angle of the detected crosstalk stripe;
and a parameter obtaining unit, configured to obtain a correction parameter of the stereoscopic display device when the calculated stripe inclination angle of the crosstalk stripe corresponding to the stereoscopic display device located at the at least two fixed points meets a preset angle range, so as to correct the stereoscopic display device.
23. The system for calibrating a stereoscopic display device of claim 22, wherein the at least two fixed point positions are arranged linearly or in a cross.
24. The correction system of a stereoscopic display device according to claim 22, wherein the image acquisition unit comprises:
the receiving subunit is used for receiving the shot image picture comprising the display screen of the stereoscopic display equipment;
and the determining subunit is configured to determine a screen region of the stereoscopic display device in the image frame received by the receiving subunit, and acquire a stereoscopic image displayed in the screen region.
25. The correction system of a stereoscopic display device according to claim 24, wherein the determining subunit comprises:
the image brightness analysis subunit is used for acquiring the brightness values of the pixel points in the image picture;
a binarization processing subunit, configured to perform binarization processing on the brightness values of the pixel points on the image frame according to a preset brightness threshold, so as to obtain a corresponding quasi-screen region;
the area searching subunit is used for searching an area with a set shape in the corresponding quasi-screen area;
and the merging and dividing subunit is used for merging and dividing the searched area with the set shape and determining the screen area so as to determine the screen area of the stereoscopic display equipment in the image picture.
26. The correction system of a stereoscopic display device according to claim 22, wherein the correction parameter acquiring means of the stereoscopic display device further comprises:
the image analysis unit is used for calculating color values of pixel points in the stereo image;
and the crosstalk stripe detection unit determines crosstalk stripes in the stereo image according to the color values calculated by the image analysis unit.
27. The correction system of a stereoscopic display device according to claim 22, wherein the correction parameter acquiring means of the stereoscopic display device further comprises:
the image analysis unit is used for calculating color values of pixel points in the stereo image;
the tilt angle calculation unit further includes:
a boundary obtaining subunit, configured to determine a boundary between the crosstalk stripes according to the color values of the pixel points in the stereo image calculated by the image analysis unit;
and the calculation subunit is configured to calculate the tilt angle of the boundary determined by the boundary acquisition subunit, as the tilt angle of the crosstalk stripe.
28. The correction system for a stereoscopic display device according to claim 27, wherein the boundary acquisition subunit fits color values of the pixel points, and uses a line obtained by the fitting as a boundary between the crosstalk fringes.
29. The correction system of a stereoscopic display device according to claim 28, wherein the tilt angle calculation unit further comprises:
and the linear detection subunit is configured to determine whether linear distribution of the lines obtained by fitting the boundary acquisition subunit satisfies a preset linear distribution condition, and if the linear distribution satisfies the preset linear distribution condition, use the lines obtained by fitting as boundaries between the crosstalk stripes.
30. The system for correcting a stereoscopic display device according to claim 27, wherein if the dividing line obtaining subunit obtains a plurality of dividing lines, the calculating subunit calculates the tilt angles of the plurality of dividing lines, respectively, and calculates an average value as the tilt angle of the crosstalk fringes.
31. The correction system of a stereoscopic display device according to claim 22, wherein the correction parameters of the stereoscopic display device include an angle correction parameter;
when the inclination angles of the crosstalk stripes corresponding to the stereoscopic display device located at the at least two fixed points calculated by the inclination angle calculation unit satisfy a preset angle range, acquiring an angle correction parameter of a stereoscopic image corresponding to the inclination angle when the stereoscopic display device is located at any one fixed point, and using the angle correction parameter as an angle correction parameter of the stereoscopic display device.
32. The correction system of a stereoscopic display device according to claim 22 or 31, wherein the correction parameters of the stereoscopic display device further comprise: roughly correcting parameters of the translation amount;
when the inclination angle calculation unit calculates that the inclination angles of the crosstalk stripes corresponding to the stereoscopic display device located at the at least two fixed point positions meet a preset angle range, the parameter acquisition unit respectively acquires the translation amount rough correction parameters of the stereoscopic image corresponding to the inclination angles when the stereoscopic display device is located at each fixed point position.
33. The correction system of a stereoscopic display device according to claim 32, wherein the parameter acquisition unit further comprises:
a central point detection subunit, configured to determine whether a central point of the crosstalk stripe detected by the crosstalk stripe detection unit is located in a central area of the screen area;
and the rough translation parameter acquiring subunit is configured to, when the central point detecting subunit determines that the central point of the crosstalk stripe is located in the central area of the stereoscopic image screen area, use the corresponding translation parameter as the rough translation correction parameter.
34. The correction system of a stereoscopic display device according to claim 32, wherein the correction parameters of the stereoscopic display device include a raster pixel correction parameter and a raster focal length correction parameter of the light splitting device;
when the inclination angle calculation unit calculates that the inclination angles of the crosstalk stripes corresponding to the stereoscopic display device located at the at least two fixed points meet a preset angle range, the parameter acquisition unit acquires raster pixel correction parameters and raster focal length correction parameters of the stereoscopic image corresponding to the inclination angles.
35. The correction system of a stereoscopic display device according to claim 34, wherein the parameter acquisition unit further comprises:
a stripe width detection subunit, configured to determine whether the width of the crosstalk stripe detected by the crosstalk stripe detection unit covers the screen area when the stereoscopic display device is located at least two fixed points;
the pixel focal length parameter acquiring subunit is configured to acquire the pixel parameters of the stereoscopic image when the stereoscopic display device is located in at least two fixed point positions and the crosstalk fringes of the stereoscopic image cover the screen region, and calculate the raster pixel correction parameter and the raster focal length correction parameter of the light splitting device of the stereoscopic display device according to the acquired pixel parameters of the stereoscopic image and the fixed point position information of the stereoscopic display device when the stereoscopic display device is located in at least two fixed point positions and the crosstalk fringes of the stereoscopic image cover the screen region, where the fixed point position information is the distance information between the stereoscopic display device and the image pickup apparatus.
36. The correction system of a stereoscopic display device according to claim 35, wherein the parameter obtaining unit calculates the raster pixel correction parameter and the raster focal length correction parameter of the beam splitter of the stereoscopic display device according to the following formulas:
wherein d isiFor the fixed point position information of the stereoscopic display device at the ith fixed point position, pitchiF is a raster focal length correction parameter of a light splitting device of the stereoscopic display device, and t0 is a raster pixel correction parameter of the light splitting device of the stereoscopic display device, wherein the pixel parameter of the stereoscopic image is when the stereoscopic display device is located at the ith fixed point position and the crosstalk stripe covers the screen area.
37. The correction system of a stereoscopic display device according to claim 36, wherein when the stripe width detection subunit determines that the width of the crosstalk stripe is equal to the screen area, the pixel focal length parameter acquisition subunit acquires a corresponding first pixel parameter and a second pixel parameter, and calculates an average value of the first pixel parameter and the second pixel parameter, and takes the calculated average value as the pixel parameter of the stereoscopic image when the width of the crosstalk stripe covers the screen area.
38. The correction system of a stereoscopic display device according to claim 34, wherein the correction parameters of the stereoscopic image further include: fine adjustment parameters of translation amount; and acquiring a translation amount correction fine adjustment parameter of the stereoscopic display equipment under the condition that the inclination angle of the crosstalk stripes calculated by the inclination angle calculation unit meets a preset angle range and the stereoscopic display equipment is started to track.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510542549.8A CN106488211B (en) | 2015-08-28 | 2015-08-28 | The bearing calibration and system of stereoscopic display device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510542549.8A CN106488211B (en) | 2015-08-28 | 2015-08-28 | The bearing calibration and system of stereoscopic display device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106488211A true CN106488211A (en) | 2017-03-08 |
CN106488211B CN106488211B (en) | 2019-03-26 |
Family
ID=58236139
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510542549.8A Active CN106488211B (en) | 2015-08-28 | 2015-08-28 | The bearing calibration and system of stereoscopic display device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106488211B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115755378A (en) * | 2022-10-11 | 2023-03-07 | 江苏科技大学 | Rapid correction method for axial distance error of laminated imaging based on dichotomy |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102401631A (en) * | 2010-08-25 | 2012-04-04 | Ntl科技股份有限公司 | Mounting accuracy inspection method and inspection apparatus using the same |
CN102595182A (en) * | 2012-03-16 | 2012-07-18 | 深圳超多维光电子有限公司 | Stereo display equipment, and correction method, device and system thereof |
US20130063575A1 (en) * | 2011-09-14 | 2013-03-14 | Broadcom Corporation | System and method for viewing angle compensation for polarized three dimensional display |
KR101364883B1 (en) * | 2012-11-14 | 2014-02-27 | 서울과학기술대학교 산학협력단 | Crosstalk reduction method for 3d steroscopic image and crosstalk reduction apparatus for 3d steroscopic image |
JP2014044396A (en) * | 2012-07-31 | 2014-03-13 | Nlt Technologies Ltd | Stereoscopic image display device, image processing apparatus, and stereoscopic image processing method |
CN103686133A (en) * | 2013-12-24 | 2014-03-26 | 友达光电股份有限公司 | Image compensation device for open hole stereoscopic display and method thereof |
CN204305233U (en) * | 2014-10-11 | 2015-04-29 | 深圳超多维光电子有限公司 | 3 d display device calibration equipment |
-
2015
- 2015-08-28 CN CN201510542549.8A patent/CN106488211B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102401631A (en) * | 2010-08-25 | 2012-04-04 | Ntl科技股份有限公司 | Mounting accuracy inspection method and inspection apparatus using the same |
US20130063575A1 (en) * | 2011-09-14 | 2013-03-14 | Broadcom Corporation | System and method for viewing angle compensation for polarized three dimensional display |
CN102595182A (en) * | 2012-03-16 | 2012-07-18 | 深圳超多维光电子有限公司 | Stereo display equipment, and correction method, device and system thereof |
JP2014044396A (en) * | 2012-07-31 | 2014-03-13 | Nlt Technologies Ltd | Stereoscopic image display device, image processing apparatus, and stereoscopic image processing method |
KR101364883B1 (en) * | 2012-11-14 | 2014-02-27 | 서울과학기술대학교 산학협력단 | Crosstalk reduction method for 3d steroscopic image and crosstalk reduction apparatus for 3d steroscopic image |
CN103686133A (en) * | 2013-12-24 | 2014-03-26 | 友达光电股份有限公司 | Image compensation device for open hole stereoscopic display and method thereof |
CN204305233U (en) * | 2014-10-11 | 2015-04-29 | 深圳超多维光电子有限公司 | 3 d display device calibration equipment |
Non-Patent Citations (1)
Title |
---|
YAO JIANMIN: "自由立体显示器中锯齿状交错狭缝光栅的设计", 《光子学报》 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115755378A (en) * | 2022-10-11 | 2023-03-07 | 江苏科技大学 | Rapid correction method for axial distance error of laminated imaging based on dichotomy |
Also Published As
Publication number | Publication date |
---|---|
CN106488211B (en) | 2019-03-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106488217B (en) | The correction parameter acquisition methods and device of stereoscopic display device | |
CN106488210B (en) | The correction parameter acquisition methods and device of stereoscopic display device | |
US9311542B2 (en) | Method and apparatus for detecting continuous road partition | |
US8385595B2 (en) | Motion detection method, apparatus and system | |
US20100118122A1 (en) | Method and apparatus for combining range information with an optical image | |
KR20170063827A (en) | Systems and methods for dynamic calibration of array cameras | |
US20120230580A1 (en) | Analysis of stereoscopic images | |
CA2988360A1 (en) | Method and apparatus for determining a depth map for an image | |
CN107147906B (en) | A kind of virtual perspective synthetic video quality without reference evaluation method | |
CN108510540A (en) | Stereoscopic vision video camera and its height acquisition methods | |
CN106488214B (en) | The correction system of stereoscopic display device | |
US20110242280A1 (en) | Parallax image generating apparatus and method | |
US9746317B2 (en) | Image processing method and device | |
CN111652900A (en) | Scene flow-based passenger flow counting method, system, equipment and storage device | |
CN106488212B (en) | The bearing calibration and system of stereoscopic display device | |
CN106488211B (en) | The bearing calibration and system of stereoscopic display device | |
CN106488220B (en) | The correction system of stereoscopic display device | |
CN116778094A (en) | Building deformation monitoring method and device based on optimal viewing angle shooting | |
Zhou et al. | Reduced-reference quality assessment of DIBR-synthesized images based on multi-scale edge intensity similarity | |
CN113674361B (en) | Vehicle-mounted all-round-looking calibration implementation method and system | |
US20230419524A1 (en) | Apparatus and method for processing a depth map | |
Biswas et al. | Towards light-compensated saliency prediction for omnidirectional images | |
CN112104856A (en) | Method for converting low-complexity two-dimensional image video signal into three-dimensional image video signal | |
Kühefuß et al. | Feature based RGB-D SLAM for a plenoptic camera | |
CN114897951B (en) | Single light field image depth estimation method and system for aggregating multi-view depth information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20180730 Address after: 518054 Room 201, building A, 1 front Bay Road, Shenzhen Qianhai cooperation zone, Shenzhen, Guangdong Applicant after: Shenzhen super Technology Co., Ltd. Address before: 518000 Guangdong Shenzhen Baoan District Xixiang Street Gonghe Industrial Road West hair B District Xu Sheng research and development building 11 story 1113U Applicant before: SHENZHEN CHUANGRUISI TECHNOLOGY CO., LTD. |
|
GR01 | Patent grant | ||
GR01 | Patent grant |