CN113099203A - Display system calibration method and system - Google Patents

Display system calibration method and system Download PDF

Info

Publication number
CN113099203A
CN113099203A CN202110504684.9A CN202110504684A CN113099203A CN 113099203 A CN113099203 A CN 113099203A CN 202110504684 A CN202110504684 A CN 202110504684A CN 113099203 A CN113099203 A CN 113099203A
Authority
CN
China
Prior art keywords
display system
calibrated
camera
eyeball camera
image information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110504684.9A
Other languages
Chinese (zh)
Other versions
CN113099203B (en
Inventor
吴涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Xiaoniao Kankan Technology Co Ltd
Original Assignee
Qingdao Xiaoniao Kankan Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Xiaoniao Kankan Technology Co Ltd filed Critical Qingdao Xiaoniao Kankan Technology Co Ltd
Priority to CN202110504684.9A priority Critical patent/CN113099203B/en
Publication of CN113099203A publication Critical patent/CN113099203A/en
Application granted granted Critical
Publication of CN113099203B publication Critical patent/CN113099203B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/327Calibration thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/122Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/246Calibration of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The invention provides a display system calibration method and a system, comprising the following steps: calibrating parameters of a preset eyeball camera; adjusting the position relation between the eyeball camera and the display system to be calibrated based on the calibration parameter information of the eyeball camera, and fixing the eyeball camera on the display system to be calibrated; rendering a preset calibration pattern to a display system to be calibrated according to a preset rule virtual scene; controlling the display system to be calibrated and the eyeball camera to rotate, and shooting image information presented by the display system to be calibrated in real time according to a preset frame rate through the eyeball camera; and analyzing the characteristic information of the image information, and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis. By means of the invention, the deterministic and quantifiable calibration and evaluation of the display system can be realized by simulating an eyeball camera of a human eye.

Description

Display system calibration method and system
Technical Field
The present invention relates to the field of virtual display system technology, and more particularly, to a method and a system for calibrating a display system.
Background
Modern computing and display technologies have facilitated the development of so-called "virtual reality" or "augmented reality" experience systems, which are primarily used to present digitally generated images, or portions thereof, to a user in a way that looks, or may be considered, real in a wearable device. Virtual reality or VR scenes typically involve the presentation of digital or virtual image information without transparency to other real-world visual inputs; currently, augmented reality or AR scenes typically include a presentation of digital or virtual image information as an enhancement to the visualization of the real world around the user.
At present, indexes such as display performance, display quality and the like of a virtual reality or augmented reality display system, such as optical display distortion, displayed color saturation, displayed dispersion performance and the like of the display system, are difficult to evaluate by a relatively objective system, and the display performance of the virtual reality or augmented reality display system is evaluated by the conventional main means through experience, test and use of multiple persons. It can be known that this method is too subjective and has a difficult to have a good objective evaluation result to some extent; furthermore, since the human visual perception system is very complex, it is a challenge to produce a VR, AR or MR technique to promote a comfortable, natural feeling and to present the virtual image elements abundantly among other virtual or real-world image elements, based on current evaluation methods.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a method and a system for calibrating a display system, so as to solve the problem that the performance of the conventional display system cannot be calibrated with standard and quantitative calibration.
The display system calibration method provided by the invention comprises the steps of calibrating parameters of a preset eyeball camera; adjusting the position relation between the eyeball camera and the display system to be calibrated based on the calibration parameter information of the eyeball camera, and fixing the eyeball camera on the display system to be calibrated; rendering a preset calibration pattern to a display system to be calibrated according to a preset rule virtual scene; controlling the display system to be calibrated and the eyeball camera to rotate, and shooting image information presented by the display system to be calibrated in real time according to a preset frame rate through the eyeball camera; and analyzing the characteristic information of the image information, and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis.
In addition, an optional technical solution is that the eyeball camera includes a left-eye camera and a right-eye camera which are arranged in pair, and the display system to be calibrated includes a left-eye display screen and a right-eye display screen; the process of adjusting the position relation between the eyeball camera and the display system to be calibrated comprises the following steps: and aligning the optical axis position of the left eyeball camera with the central position of the left eye display screen, and aligning the optical axis position of the right eyeball camera with the central position of the right eye display screen.
In addition, an optional technical solution is that the calibration parameter information includes an internal parameter, an intrinsic parameter, or an extrinsic parameter; the internal parameters comprise projection transformation parameters from the coordinates of the eyeball camera to the coordinates of a two-dimensional image shot by the eyeball camera; the intrinsic parameters comprise focal length, principal point and optical distortion parameters; extrinsic parameters include the rotation matrix and translation vector between the left eye camera and the right eye camera.
In addition, an optional technical solution is that the process of controlling the display system to be calibrated and the eyeball camera to rotate and shooting the image information presented by the display system to be calibrated in real time according to the preset frame rate by the eyeball camera includes: controlling the display system to be calibrated and the eyeball camera to rotate in a preset mode; shooting first image information presented by a left eye screen in real time according to a first preset frame rate through a left eye dome camera; meanwhile, second image information presented by the right eye screen is shot in real time through the right eye camera according to the first preset frame rate.
In addition, an optional technical solution is that the process of analyzing the characteristic information of the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis includes: respectively acquiring characteristic values of the characteristics of the first image information and the second image information in upper left, upper right, lower left, lower right and middle areas; features include hue, saturation, and contrast; comparing the characteristic value of the first image information with the characteristic value of the left-eye display screen at the corresponding position to obtain a first comparison result, and comparing the characteristic value of the second image information with the characteristic value of the right-eye display screen at the corresponding position to obtain a second comparison result; judging whether the left-eye display screen meets the parameter requirements or not based on the first comparison result, and if not, adjusting the characteristics of the corresponding position of the left-eye display screen based on the characteristic value of the first image information; and circularly executing the steps; and meanwhile, judging whether the right-eye display screen meets the parameter requirement or not based on the second comparison result, if not, adjusting the characteristics of the corresponding position of the right-eye display screen based on the characteristic value of the second image information, and circularly executing the steps.
In addition, an optional technical solution is a process of analyzing the characteristic information of the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis, further including: the first image information and the second image information are analyzed for collinearity, curvature, length, width, added marks, lost marks, numbers, shape, size, spatial grouping or spatial orientation, and the optical performance of the display system to be calibrated is calibrated based on the results of the analysis.
In addition, an optional technical solution is that the range of the first preset frame rate is 30Hz to 60 Hz.
In addition, the optional technical scheme is that the resolution of the eyeball camera is not less than that of the display system to be calibrated; and, the attributes of the eye camera include simulated cornea position, simulated cornea geometry, eye position, pupil size, pupil position, gaze distance, and gaze direction.
In addition, an optional technical solution is that the process of calibrating the parameters of the preset eye camera includes: displaying a sample image with a preset size through a sample screen at a preset distance and a preset angle relative to the eyeball camera; shooting a sample image through an eyeball camera to obtain a corresponding shot image; and calibrating parameters of the eyeball camera based on the shot image and the Zhang Zhengyou calibration method.
According to another aspect of the present invention, there is provided a display system calibration system, comprising: the parameter calibration unit is used for calibrating parameters of a preset eyeball camera; the position determining unit is used for adjusting the position relation between the eyeball camera and the display system to be calibrated based on the calibration parameter information of the eyeball camera and fixing the eyeball camera on the display system to be calibrated; the calibration pattern rendering unit is used for rendering a preset calibration pattern to the display system to be calibrated according to a preset rule virtual scene; the image information shooting unit is used for controlling the display system to be calibrated and the eyeball camera to rotate and shooting image information presented by the display system to be calibrated in real time according to a preset frame rate through the eyeball camera; and the optical performance calibration unit is used for analyzing the characteristic information of the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis.
By utilizing the display system calibration method and system, the position relation between the eyeball camera and the display system to be calibrated is adjusted based on the calibration parameter information of the eyeball camera, and the eyeball camera is fixed on the display system to be calibrated; rendering a preset calibration pattern to a display system to be calibrated according to a preset rule virtual scene; controlling the display system to be calibrated and the eyeball camera to rotate, and shooting image information presented by the display system to be calibrated in real time according to a preset frame rate through the eyeball camera; the image information is subjected to characteristic information analysis, the optical performance of the display system to be calibrated is calibrated based on the result of the characteristic information analysis, the display performance of the virtual world and the real world can be calibrated and evaluated under the conditions of certainty and quantification, and the virtual world and the real world can be fused together seamlessly.
To the accomplishment of the foregoing and related ends, one or more aspects of the invention comprise the features hereinafter fully described. The following description and the annexed drawings set forth in detail certain illustrative aspects of the invention. These aspects are indicative, however, of but a few of the various ways in which the principles of the invention may be employed. Further, the present invention is intended to include all such aspects and their equivalents.
Drawings
Other objects and results of the present invention will become more apparent and more readily appreciated as the same becomes better understood by reference to the following description taken in conjunction with the accompanying drawings. In the drawings:
FIG. 1 is a flow chart of a display system calibration method according to an embodiment of the invention;
FIG. 2 is a logic block diagram of a display system calibration system according to an embodiment of the present invention.
The same reference numbers in all figures indicate similar or corresponding features or functions.
Detailed Description
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more embodiments. It may be evident, however, that such embodiment(s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing one or more embodiments.
In the description of the present invention, it is to be understood that the terms "central," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," "circumferential," and the like are used in the orientations and positional relationships indicated in the drawings for convenience in describing the invention and to simplify the description, and are not intended to indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and are therefore not to be considered limiting of the invention.
To describe the display system calibration method and system of the present invention in detail, embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
Fig. 1 shows a flow of a display system calibration method according to an embodiment of the present invention.
As shown in fig. 1, the display system calibration method according to the embodiment of the present invention includes the following steps:
s110: and calibrating parameters of the preset eyeball camera.
S120: adjusting the position relation between the eyeball camera and the display system to be calibrated based on the calibration parameter information of the eyeball camera, and fixing the eyeball camera on the display system to be calibrated.
S130: and rendering the preset calibration pattern to the display system to be calibrated according to the preset rule virtual scene.
S140: the display system to be calibrated and the eyeball camera are controlled to rotate, and image information displayed by the display system to be calibrated is shot in real time through the eyeball camera according to a preset frame rate.
S150: and analyzing the characteristic information of the image information, and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis.
Then, each of the above steps will be described in detail below.
In step S110, the preset calibration parameter information of the eye camera includes an internal parameter, an intrinsic parameter, or an external parameter; the internal parameters comprise projection transformation parameters from the coordinates of the eyeball camera to the coordinates of a two-dimensional image shot by the eyeball camera; the intrinsic parameters comprise focal length, principal point and optical distortion parameters; extrinsic parameters include the rotation matrix and translation vector between the left eye camera and the right eye camera.
Wherein the external parameters represent the conversion from a world coordinate system to an eyeball camera coordinate system, the external parameters comprise a rotation matrix and a translation vector between the left eyeball camera and the right eyeball camera, and the determination of the center position of the eyeball camera and the heading of the eyeball camera in the world coordinate system can be facilitated through the external parameters. Accordingly, parameter calibration of eye shots may be used to correct lens distortion, to measure the size of an object in three dimensions of the world, or to determine the position of an eye camera in a scene in a three-dimensional scene reconstruction.
Specifically, the process of calibrating the parameters of the preset eyeball camera comprises the following steps: displaying a sample image with a preset size through a sample screen at a preset distance and a preset angle relative to the eyeball camera; shooting the sample image through the eyeball camera to obtain a corresponding shot image; and calibrating parameters of the eyeball camera based on the shot image and the Zhang Zhengyou calibration method.
The preset eyeball camera comprises a left-eye camera and a right-eye camera which are arranged in pair, and the display system to be calibrated comprises a left-eye display screen and a right-eye display screen; the process of adjusting the position relation between the eyeball camera and the display system to be calibrated comprises the following steps: the optical axis position of the left eyeball camera is aligned with the central position of the left eye display screen, the optical axis position of the right eyeball camera is aligned with the central position of the right eye display screen, after the positions of the left eyeball camera and the right eyeball camera are determined, the eyeball camera and the display system to be monitored can be fixed through a certain fixing piece or a fixing mode, the relative positions of the left eyeball camera and the right eyeball camera in the power running process are ensured to be stable, and position deviation does not occur.
And then treat eyeball camera's position after confirming, the accessible is treated the calibration display system and is carried out the rendering display to the calibration pattern of designing in advance, and the calibration pattern can be designed to have certain position distribution, the regular pattern of color distribution, makes it carry out virtual scene according to the rule of predetermineeing and renders, then shows on treating the screen of calibration display system, and the rule of predetermineeing here can include: and setting parameters such as rendering resolution, rendering frame rate and the like for rendering. Then, the pattern information displayed on the screen is photographed by the eye camera.
It should be noted that, in the process of shooting through the eyeball camera, the display system to be calibrated and the eyeball camera can be controlled to rotate through the external device, and the image information presented by the display system to be calibrated is shot in real time according to the preset frame rate through the eyeball camera, the external device can be a mechanical arm, and the mechanical arm can enable the system in the form to be calibrated and the eyeball camera thereon to be performed according to a certain mode according to the preset motion rule. The movement rules can be set according to application scenes or calibration requirements of the display system to be calibrated, specific limitation is not performed, changes of display contents of the display screen to be calibrated in a corresponding movement mode can be displayed by setting different rotation angles and different rotation speeds, for example, whether the contrast of the display contents has certain errors or not in the movement mode is found, and therefore calibration accuracy of optical performance of the display system is ensured.
Specifically, the process of controlling the display system to be calibrated and the eyeball camera to rotate through the external device and shooting the image information presented by the display system to be calibrated in real time according to the preset frame rate through the eyeball camera comprises the following steps: controlling the display system to be calibrated and the eyeball camera to rotate in a preset mode; shooting first image information presented by a left eye screen in real time according to a first preset frame rate through a left eye dome camera; meanwhile, second image information presented by the right eye screen is shot in real time through the right eye camera according to the first preset frame rate. The preset manner, i.e. the set motion rule, is not particularly limited in the display system calibration method of the present invention.
Finally, the process of analyzing the characteristic information of the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis comprises the following steps: respectively acquiring characteristic values of the characteristics of the first image information and the second image information in upper left, upper right, lower left, lower right and middle areas; features include hue, saturation, and contrast; comparing the characteristic value of the first image information with the characteristic value of the left-eye display screen at the corresponding position to obtain a first comparison result, and comparing the characteristic value of the second image information with the characteristic value of the right-eye display screen at the corresponding position to obtain a second comparison result; judging whether the left-eye display screen meets the parameter requirements or not based on the first comparison result, and if not, adjusting the characteristics of the corresponding position of the left-eye display screen based on the characteristic value of the first image information; circularly executing the steps until the parameters of the left-eye display screen meet the set parameter requirements; and similarly, judging whether the right-eye display screen meets the parameter requirement or not based on the second comparison result, if not, adjusting the characteristics of the corresponding position of the right-eye display screen based on the characteristic value of the second image information, and executing the steps in a circulating manner until the parameters of the right-eye display screen meet the set parameter requirement.
In an embodiment of the present invention, in order to further calibrate the display system to be calibrated and improve the optical performance of the display system to be calibrated, the process of analyzing the characteristic information of the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis may further include: the method comprises the steps of analyzing key characteristic information such as colinearity, curvature, length, width, adding marks, losing marks, numbers, shapes, sizes, space grouping or space directions and the like of first image information and second image information, calibrating the optical performance of a display system to be calibrated based on the analysis result, and comparing the optical distortion rate, the optical dispersion rate and the like, so that the display performance can be adjusted and optimized, and the overall optical display quality is improved.
It should be noted that the first preset frame rate may range from 30Hz to 60 Hz.
In another embodiment of the present invention, the resolution of the eye camera is set to be not less than the resolution of the display system to be calibrated; in addition, the attributes of the eyeball camera comprise a simulated cornea position, a simulated cornea geometric shape, an eyeball position, a pupil size, a pupil position, a gaze distance, a gaze direction and the like, the display position and the direction for human eyes are simulated through the eyeball camera, in the application process, the shooting frame rates of the left eyeball camera and the right eyeball camera are strictly synchronized physically, the design of the human eyes can be simulated through the aspects of geometry, optical performance and/or motion, the cornea and the pupil geometric shape which are the same as those of the human eyes are adopted, the iris and the pupil are configured with various texture, color or diameter options, the resolution design of the eyeball camera is also included, and the perceived virtual world and real world are calibrated and evaluated by the eyeball camera according to human eye conditions such as the pupil position, the gaze point and the like.
Corresponding to the display system calibration method, the invention further provides a display system calibration system, and specifically, fig. 2 shows schematic logic of the display system calibration system according to the embodiment of the invention.
As shown in fig. 2, a display system calibration system 200 according to an embodiment of the present invention mainly includes:
a parameter calibration unit 210, configured to perform parameter calibration on a preset eyeball camera;
the position determining unit 220 is configured to adjust a position relationship between the eyeball camera and the display system to be calibrated based on calibration parameter information of the eyeball camera, and fix the eyeball camera on the display system to be calibrated;
a calibration pattern rendering unit 230, configured to render a virtual scene of a preset calibration pattern onto a display system to be calibrated according to a preset rule;
the image information shooting unit 240 is configured to control the display system to be calibrated and the eyeball camera to rotate, and shoot image information presented by the display system to be calibrated in real time according to a preset frame rate through the eyeball camera;
and an optical performance calibration unit 250, configured to perform characteristic information analysis on the image information, and calibrate the optical performance of the display system to be calibrated based on the result of the characteristic information analysis.
It should be noted that, the above embodiments of the display system calibration system may specifically refer to the description in the embodiments of the display system calibration method, and details are not repeated here.
According to the display system calibration method and system provided by the invention, quantitative parameter evaluation and calibration can be performed on the display system through the eyeball camera simulating human eyes, so that the uniformity and universality of the calibration of the display system are ensured, the display performance of the display system is further optimized, and the comfort and naturalness of VR, AR or MR technology and the experience of a user are ensured.
The display system calibration method and system according to the invention are described above by way of example with reference to fig. 1 and 2. However, it will be appreciated by those skilled in the art that various modifications may be made to the display system calibration method and system of the present invention without departing from the spirit and scope of the invention. Therefore, the scope of the present invention should be determined by the contents of the appended claims.

Claims (10)

1. A method for calibrating a display system, comprising:
calibrating parameters of a preset eyeball camera;
based on the calibration parameter information of the eyeball camera, adjusting the position relation between the eyeball camera and the display system to be calibrated, and fixing the eyeball camera on the display system to be calibrated;
rendering a preset calibration pattern to the display system to be calibrated according to a preset rule virtual scene;
controlling the display system to be calibrated and the eyeball camera to rotate, and shooting image information presented by the display system to be calibrated in real time according to a preset frame rate through the eyeball camera;
and analyzing the characteristic information of the image information, and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis.
2. The display system calibration method of claim 1,
the eyeball camera comprises a left eyeball camera and a right eyeball camera which are arranged in pairs, and the display system to be calibrated comprises a left eye display screen and a right eye display screen;
the process of adjusting the position relationship between the eyeball camera and the display system to be calibrated comprises the following steps:
and aligning the optical axis position of the left eyeball camera to the central position of the left eye display screen, and aligning the optical axis position of the right eyeball camera to the central position of the right eye display screen.
3. The display system calibration method of claim 2,
the calibration parameter information comprises internal parameters, intrinsic parameters or extrinsic parameters;
the internal parameters comprise projection transformation parameters from the coordinates of the eyeball camera to the coordinates of a two-dimensional image shot by the eyeball camera;
the intrinsic parameters comprise focal length, principal point and optical distortion parameters;
the extrinsic parameters include a rotation matrix and a translation vector between the left eye dome camera and the right eye camera.
4. The method for calibrating a display system according to claim 2, wherein the controlling the display system to be calibrated and the eye camera to rotate, and the process of capturing the image information presented by the display system to be calibrated in real time according to the preset frame rate by the eye camera comprises:
controlling the display system to be calibrated and the eyeball camera to rotate in a preset mode;
shooting first image information presented by the left eye screen in real time according to a first preset frame rate through the left eyeball camera; at the same time, the user can select the desired position,
and shooting second image information presented by the right eye screen in real time according to the first preset frame rate through the right eye camera.
5. The display system calibration method according to claim 4, wherein the process of performing the characteristic information analysis on the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis comprises:
respectively acquiring characteristic values of the characteristics of the first image information and the second image information in upper left, upper right, lower left, lower right and middle areas; the features include hue, saturation, and contrast;
comparing the characteristic value of the first image information with the characteristic value of the left-eye display screen at the corresponding position to obtain a first comparison result, and comparing the characteristic value of the second image information with the characteristic value of the right-eye display screen at the corresponding position to obtain a second comparison result;
judging whether the left-eye display screen meets parameter requirements or not based on the first comparison result, and if not, adjusting the characteristics of the corresponding position of the left-eye display screen based on the characteristic value of the first image information; and circularly executing the steps; at the same time, the user can select the desired position,
and judging whether the right-eye display screen meets the parameter requirements or not based on the second comparison result, if not, adjusting the characteristics of the corresponding position of the right-eye display screen based on the characteristic value of the second image information, and circularly executing the steps.
6. The display system calibration method according to claim 5, wherein the process of performing characteristic information analysis on the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis further comprises:
and analyzing the first image information and the second image information in terms of colinearity, curvature, length, width, adding marks, losing marks, numbers, shapes, sizes, spatial grouping or spatial directions, and calibrating the optical performance of the display system to be calibrated based on the analysis result.
7. The display system calibration method of claim 4,
the range of the first preset frame rate is 30 Hz-60 Hz.
8. The display system calibration method of claim 1,
the resolution of the eyeball camera is not less than that of the display system to be calibrated; and the number of the first and second electrodes,
the attributes of the eye camera include simulated cornea position, simulated cornea geometry, eye position, pupil size, pupil position, gaze distance, and gaze direction.
9. The method for calibrating a display system according to claim 1, wherein the process of calibrating the parameters of the preset eye camera comprises:
displaying a sample image with a preset size through a sample screen at a preset distance and a preset angle relative to the eyeball camera;
shooting the sample image through the eyeball camera to obtain a corresponding shot image;
and calibrating the parameters of the eyeball camera based on the shot images and a Zhang Zhengyou calibration method.
10. A display system calibration system, comprising:
the parameter calibration unit is used for calibrating parameters of a preset eyeball camera;
the position determining unit is used for adjusting the position relation between the eyeball camera and the display system to be calibrated based on the calibration parameter information of the eyeball camera and fixing the eyeball camera on the display system to be calibrated;
the calibration pattern rendering unit is used for rendering a preset calibration pattern to the display system to be calibrated according to a preset rule virtual scene;
the image information shooting unit is used for controlling the display system to be calibrated and the eyeball camera to rotate and shooting image information presented by the display system to be calibrated in real time according to a preset frame rate through the eyeball camera;
and the optical performance calibration unit is used for analyzing the characteristic information of the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis.
CN202110504684.9A 2021-05-10 2021-05-10 Display system calibration method and system Active CN113099203B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110504684.9A CN113099203B (en) 2021-05-10 2021-05-10 Display system calibration method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110504684.9A CN113099203B (en) 2021-05-10 2021-05-10 Display system calibration method and system

Publications (2)

Publication Number Publication Date
CN113099203A true CN113099203A (en) 2021-07-09
CN113099203B CN113099203B (en) 2023-08-22

Family

ID=76665318

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110504684.9A Active CN113099203B (en) 2021-05-10 2021-05-10 Display system calibration method and system

Country Status (1)

Country Link
CN (1) CN113099203B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06160727A (en) * 1992-11-18 1994-06-07 Koonan:Kk Eyeball microscope
WO2012100495A1 (en) * 2011-01-30 2012-08-02 中兴通讯股份有限公司 Processing method and apparatus for stereoscopic capture of dual cameras
CN104887316A (en) * 2015-04-24 2015-09-09 长春理工大学 Virtual three-dimensional endoscope displaying method based on active three-dimensional displaying technology
CN106596051A (en) * 2016-12-19 2017-04-26 中国航空工业集团公司洛阳电光设备研究所 Airborne head-up display and head-mounted display delay test apparatus and method
CN107003109A (en) * 2014-11-13 2017-08-01 奥林巴斯株式会社 Calibrating installation, calibration method, Optical devices, camera, projection arrangement, measuring system and measuring method
CN206961066U (en) * 2017-02-28 2018-02-02 深圳市未来感知科技有限公司 A kind of virtual reality interactive device
CN108124152A (en) * 2017-12-26 2018-06-05 华勤通讯技术有限公司 The distortion measurement method and system of head-mounted display apparatus
US20180173483A1 (en) * 2014-12-31 2018-06-21 Huawei Technologies Co., Ltd. Display Method for Screen of Wearable Device and Wearable Device
TWM569008U (en) * 2018-07-20 2018-10-21 威盛電子股份有限公司 Eye position calibrating system
CN110557626A (en) * 2019-07-31 2019-12-10 华为技术有限公司 image display method and electronic equipment
CN111694158A (en) * 2020-06-17 2020-09-22 Oppo广东移动通信有限公司 Calibration method, calibration equipment and calibration system for near-eye display device
CN112584113A (en) * 2020-12-02 2021-03-30 深圳市当智科技有限公司 Wide-screen projection method and system based on mapping correction and readable storage medium

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06160727A (en) * 1992-11-18 1994-06-07 Koonan:Kk Eyeball microscope
WO2012100495A1 (en) * 2011-01-30 2012-08-02 中兴通讯股份有限公司 Processing method and apparatus for stereoscopic capture of dual cameras
CN107003109A (en) * 2014-11-13 2017-08-01 奥林巴斯株式会社 Calibrating installation, calibration method, Optical devices, camera, projection arrangement, measuring system and measuring method
US20180173483A1 (en) * 2014-12-31 2018-06-21 Huawei Technologies Co., Ltd. Display Method for Screen of Wearable Device and Wearable Device
CN104887316A (en) * 2015-04-24 2015-09-09 长春理工大学 Virtual three-dimensional endoscope displaying method based on active three-dimensional displaying technology
CN106596051A (en) * 2016-12-19 2017-04-26 中国航空工业集团公司洛阳电光设备研究所 Airborne head-up display and head-mounted display delay test apparatus and method
CN206961066U (en) * 2017-02-28 2018-02-02 深圳市未来感知科技有限公司 A kind of virtual reality interactive device
CN108124152A (en) * 2017-12-26 2018-06-05 华勤通讯技术有限公司 The distortion measurement method and system of head-mounted display apparatus
TWM569008U (en) * 2018-07-20 2018-10-21 威盛電子股份有限公司 Eye position calibrating system
CN110557626A (en) * 2019-07-31 2019-12-10 华为技术有限公司 image display method and electronic equipment
CN111694158A (en) * 2020-06-17 2020-09-22 Oppo广东移动通信有限公司 Calibration method, calibration equipment and calibration system for near-eye display device
CN112584113A (en) * 2020-12-02 2021-03-30 深圳市当智科技有限公司 Wide-screen projection method and system based on mapping correction and readable storage medium

Also Published As

Publication number Publication date
CN113099203B (en) 2023-08-22

Similar Documents

Publication Publication Date Title
EP3687465B1 (en) Digital therapeutic corrective spectacles
US20230337905A1 (en) Modification profile generation for vision defects related to double vision or dynamic aberrations
JP5967597B2 (en) Image display device and image display method
CN110967166B (en) Detection method, detection device and detection system of near-eye display optical system
CN110505459A (en) Suitable for the image color correction method of endoscope, device and storage medium
KR102596880B1 (en) Head-mounted display apparatus and method thereof for generating 3d image information
EP4091013A1 (en) Compensation for deformation in head mounted display systems
CN114930443A (en) Light field device, multi-depth pixel rendering method therefor, and multi-depth vision perception system and method using same
US20180288405A1 (en) Viewing device adjustment based on eye accommodation in relation to a display
EP1158338A2 (en) Method for simulating an ocular optical system and apparatus therefor
CN110119258B (en) Method and system for testing and adjusting positions of display screen and optical system
US11039742B1 (en) Vision testing via prediction-based setting of an initial stimuli characteristic for a user interface location
US20200275087A1 (en) Computer-readable non-transitory storage medium, web server, and calibration method for interpupillary distance
EP3997867A1 (en) Eyeball camera system and methods for display system calibration
KR20210134069A (en) Determining and improving visual defects
CN108462867B (en) System and method for automatically calibrating tracking type naked eye three-dimensional display equipment
KR20180034278A (en) Visual perception training device, method and program for visual perception training using head mounted device
CN112926523B (en) Eyeball tracking method and system based on virtual reality
EP4236756A1 (en) Vision testing via prediction-based setting of initial stimuli characteristics for user interface locations
CN113099203B (en) Display system calibration method and system
JP5279153B1 (en) Pupil position measuring method and bilateral lens manufacturing method
CN107888899A (en) For image acquiring method, device and virtual reality device in virtual reality device
CN114967128B (en) Sight tracking system and method applied to VR glasses
CN105430370B (en) Stereoscopic image visual comfort evaluation method based on ranking learning
CN112362309B (en) Eccentric parallax testing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant