CN112488161A - Binocular matching method and device for near-eye display equipment and computer storage medium - Google Patents
Binocular matching method and device for near-eye display equipment and computer storage medium Download PDFInfo
- Publication number
- CN112488161A CN112488161A CN202011282557.0A CN202011282557A CN112488161A CN 112488161 A CN112488161 A CN 112488161A CN 202011282557 A CN202011282557 A CN 202011282557A CN 112488161 A CN112488161 A CN 112488161A
- Authority
- CN
- China
- Prior art keywords
- module
- data
- binocular
- optical parameter
- matrix
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000003860 storage Methods 0.000 title claims abstract description 15
- 230000003287 optical effect Effects 0.000 claims abstract description 116
- 239000011159 matrix material Substances 0.000 claims abstract description 88
- 239000002699 waste material Substances 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 17
- 238000005259 measurement Methods 0.000 description 12
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 239000000463 material Substances 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 230000008676 import Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000008439 repair process Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000012958 reprocessing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The invention discloses a binocular matching method of near-eye display equipment, which comprises the following steps: importing relevant optical parameter data of a monocular display module to be matched; the related optical parameter data comprises an image offset value or a virtual image offset value of the monocular display module; establishing a matching matrix according to the relevant optical parameter data of the monocular display module to be matched; and performing iterative computation on the matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-eye display equipment. The invention also discloses a device and a computer readable storage medium, which solve the problem of resource waste caused by an unreasonable matching method for forming a binocular complete machine by monocular display modules in the prior art.
Description
Technical Field
The invention relates to the technical field of optics, in particular to a binocular matching method and device of near-to-eye display equipment and a computer storage medium.
Background
In many fields, such as the field of virtual display, a method for accurately matching binocular module group images is urgently needed. Due to errors of materials and processes, large deviation often exists between monocular display modules which are produced in batch before forming a binocular complete machine, and meanwhile, due to the fact that parameters of the complete machine after being manufactured exceed standards due to an unreasonable matching method, human eyes cannot achieve binocular fusion. The traditional matching method often cannot achieve global optimal matching, and huge waste on manpower and material resources is caused.
Therefore, the problem of resource waste caused by an unreasonable matching method for forming a binocular complete machine by monocular display modules exists in the prior art.
Disclosure of Invention
The invention mainly aims to provide a binocular matching method and device of near-eye display equipment and a computer storage medium, and aims to solve the problem of resource waste caused by an unreasonable matching method for forming a binocular complete machine by monocular display modules in the prior art.
In order to achieve the above object, the present invention provides a binocular matching method of a near-eye display device, the binocular matching method of the near-eye display device comprising the steps of:
importing relevant optical parameter data of a monocular display module to be matched; the related optical parameter data comprises an image offset value or a virtual image offset value of the monocular display module;
establishing a matching matrix according to the relevant optical parameter data of the monocular display module to be matched;
and performing iterative computation on the matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-to-eye display equipment.
In an embodiment, the step of creating a matching matrix according to the relevant optical parameter data of the monocular display module to be matched includes:
for all monocular display modules of which the related optical parameter data do not exceed a preset first threshold, separating the related optical parameter data into left and right module data;
according to the left module data, the right module data and a preset data weighting formula, an initial matrix is created, and matrix data of the initial matrix are determined, wherein the matrix data comprise: unmatched terms and specific numerical values;
and removing rows and/or columns of which the whole rows and/or whole columns are non-matchable items in the initial matrix to obtain the matching matrix.
In an embodiment, the step of separating the related optical parameter data of all monocular display modules whose related optical parameter data does not exceed the preset threshold into left and right module data includes:
determining all monocular display modules of which the related optical parameter data do not exceed a preset first threshold;
if the monocular display module is left and right, separating the data into left and right module data according to the module number; or, if the monocular display module is not left or right distinguished, the data are equally divided into left and right module data according to the number.
In an embodiment, the step of creating an initial matrix according to the left and right module data and a preset data weighting formula, and determining matrix data of the initial matrix includes:
marking a left module as a row mark and marking a right module as a column mark, or marking the left module as a column mark and marking the right module as a row mark, and determining the row and the column of the initial matrix;
obtaining related optical parameter data of a pair of left and right modules according to the row and column labels;
making a difference between the related optical parameter data pair by pair to obtain a corresponding difference value of the related optical parameter data between the left module and the right module;
if the difference value exceeding a preset second threshold value exists in the corresponding difference values of the related optical parameter data between the pair of left and right modules, marking the matrix data of the row and the column where the pair of modules are located as an unmatchable item; and if the difference value exceeding the preset second threshold value does not exist, calculating a specific numerical value of the row and the column of the pair of modules according to the difference value of the related optical parameter data between the pair of left and right modules and a preset data weighting formula.
In an embodiment, the method further comprises:
and marking the monocular display module with the related optical parameter data exceeding a preset first threshold as a non-matching module.
In an embodiment, the relevant optical parameters further comprise:
diopter, diopter adjustable range, color coordinates, color temperature, brightness, field angle, distortion.
In an embodiment, after the step of outputting the binocular matching list of the near-eye display device, the method further comprises:
and selecting the monocular display modules matched with each other according to the binocular matching list and finishing the assembly.
In an embodiment, after the step of selecting the monocular display modules that match with each other according to the binocular matching list and completing the assembly, the method further includes:
the monocular display modules matched with each other are assembled to obtain a whole binocular module;
measuring the optical parameters of each monocular module in the whole machine binocular module to obtain a group of optical parameters of the whole machine binocular module, and calculating binocular difference values of the group of optical parameters;
and if the binocular difference value exceeds the preset second threshold value, the overall binocular module is repaired.
In order to achieve the above object, the present invention further provides an apparatus including a memory, a processor, and a binocular matching program of a near-eye display device stored in the memory and operable on the processor, the binocular matching program of the near-eye display device implementing the steps of the binocular matching method of the near-eye display device as described above when executed by the processor.
To achieve the above object, the present invention also provides a computer-readable storage medium storing a binocular matching program of a near-eye display apparatus, which when executed by a processor, implements the steps of the binocular matching method of the near-eye display apparatus as described above.
The binocular matching method, the binocular matching device and the computer storage medium lead in relevant optical parameter data of a monocular display module to be matched; the related optical parameter data comprises an image offset value and a virtual image offset value of the monocular display module; then, a matching matrix is established according to the relevant optical parameter data of the monocular display module to be matched; performing iterative computation on matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-eye display equipment; the matching list shows that the overall best matching result among all the display modules is achieved, the industrial requirements are met, and binocular matching can be completed. Therefore, the problem of resource waste caused by an unreasonable matching method for forming a binocular complete machine by monocular display modules in the prior art is solved.
Drawings
FIG. 1 is a schematic diagram of an apparatus according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a binocular matching method of a near-eye display device according to a first embodiment of the present invention;
FIG. 3 is a schematic diagram of virtual image coordinates;
FIG. 4 is a schematic diagram of spatial coordinates;
FIG. 5 is a schematic diagram of image coordinates;
FIG. 6 is a schematic view of parameters related to the measurement display module;
FIG. 7 is a flowchart illustrating the step S120 in the first embodiment of the present invention;
FIG. 8 is a flowchart illustrating step S121 according to the present invention;
FIG. 9 is a flowchart illustrating step S122 according to the first embodiment of the present invention;
fig. 10 is a schematic flowchart of a binocular matching method of a near-eye display apparatus according to a second embodiment of the present invention;
fig. 11 is a schematic flowchart of a binocular matching method of a near-eye display device according to a third embodiment of the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: importing relevant optical parameter data of a monocular display module to be matched; the related optical parameter data comprises an image offset value and a virtual image offset value of the monocular display module; then, a matching matrix is established according to the relevant optical parameter data of the monocular display module to be matched; performing iterative computation on matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-eye display equipment; the matching list shows that the overall best matching result among all the display modules is achieved, the industrial requirements are met, and binocular matching can be completed. Therefore, the problem of resource waste caused by an unreasonable matching method for forming a binocular complete machine by monocular display modules in the prior art is solved.
As an implementation manner, fig. 1 may be shown, where fig. 1 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.
It will be appreciated that memory 1200 in embodiments of the invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static random access memory (Static RAM, SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic random access memory (Synchronous DRAM, SDRAM), Double Data Rate Synchronous Dynamic random access memory (ddr Data Rate SDRAM, ddr SDRAM), Enhanced Synchronous SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The memory 1200 of the systems and methods described in connection with the embodiments of the invention is intended to comprise, without being limited to, these and any other suitable types of memory.
For a software implementation, the techniques described in this disclosure may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described in this disclosure. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.
Based on the above structure, an embodiment of the present invention is proposed.
Referring to fig. 2, fig. 2 is a first embodiment of a binocular matching method of a near-eye display device according to the present invention, the binocular matching method of the near-eye display device including the steps of:
step S110, importing relevant optical parameter data of a monocular display module to be matched; the related optical parameter data comprises an image offset value or a virtual image offset value of the monocular display module.
In this embodiment, binocular matching refers to matching of optical parameters between two monocular display modules included in the near-eye display device. Due to errors of materials and processes, huge deviation often exists between monocular display modules which are produced in batch before forming a binocular complete machine, and meanwhile due to the fact that parameters of the complete machine after being manufactured exceed standards due to an unreasonable matching method, human eyes cannot achieve binocular fusion, and therefore the binocular matching method of the near-eye display equipment is provided.
The display module refers to an optical portion of the near-eye display device. The relevant optical parameters may include: image offset value (x, y, roll), virtual image offset value (yaw, ptich, roll). The offset value may be expressed by the number of pixels of the image coordinate, i.e., the image offset value (x, y, roll), or may be expressed by the angle of the virtual image coordinate, i.e., the virtual image offset value (yaw, ptich, roll), and both may be converted to each other. Both the image offset value and the virtual image offset value may be directly measured by the device, and the image offset value and the virtual image offset value may be mutually converted. Wherein x represents the lateral pixel shift of the image, y represents the longitudinal pixel shift of the image, and roll represents the rotation amount of the image or the module. yaw represents rotation of the module about the vertical axis and ptich represents rotation of the module about the horizontal axis. Because of the magnification of the module, the displacement caused by the position change of the module will not cause the same displacement of the virtual image (even the change amount can be ignored); in this case, the virtual image coordinate offset is mostly caused by the angular offset yaw, pitch, which is substantially the x, y offset in the image coordinates; the deviation value substantially represents the deviation of the spatial coordinates of the display module, which is caused by material and process errors. Referring to fig. 3, fig. 3 is a virtual image coordinate; referring to fig. 4, fig. 4 is a spatial coordinate; referring to fig. 5, fig. 5 is an image coordinate.
It should be noted that the relevant optical parameters of the display module may further include: diopter, diopter adjustable range, color coordinates, color temperature, brightness, field angle, distortion. When the relevant optical parameters are introduced, part of the optical parameters or all the optical parameters can be introduced according to actual conditions.
Referring to fig. 6, fig. 6 is a schematic diagram of parameters related to the measurement display module. The display module is placed in a jig, and the measuring equipment is used for measuring the relevant optical parameters of the display module to obtain measured data, namely the relevant optical parameter data. The measurement data is obtained through the difference between the measurement equipment and the jig and between the measurement modules, the measurement data is imported according to the preset requirement, and the measurement data can be preferably imported into the binocular matching model according to the preset requirement; the testing conditions of each display module are kept consistent, and the measuring conditions such as the exit pupil distance and the like need to meet the industrial requirements; the preset requirement is partial import or full import, that is, only the optical parameters having a large influence on the binocular matching effect can be selected to be imported, that is, partial import, and of course, all the optical parameters can also be imported. When multi-station measurement is carried out, the relative position of each measuring device and the corresponding jig is ensured to be fixed, and the data difference among different devices is eliminated.
And step S120, creating a matching matrix according to the relevant optical parameter data of the monocular display module to be matched.
In this embodiment, a matching matrix may be created according to the related optical parameters of the monocular display module to be matched, for example, according to the imported image offset value or virtual image offset value.
And step S130, performing iterative computation on the matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-to-eye display equipment.
In the present embodiment, the preset algorithm is preferably a Munkres algorithm. The Munkres algorithm is an optimal allocation algorithm and can be regarded as a variant of the Hungarian algorithm; performing iterative computation on matrix data of the matching matrix by adopting a Munkres algorithm until a binocular matching list is output, wherein the binocular matching list represents the situation that the overall weight is minimum at the moment; the condition of the minimum overall weight is the optimal matching of the matching matrix; namely, the binocular matching list shows the result that the best matching between all the display modules is achieved.
In the technical scheme provided by the embodiment, the relevant optical parameter data of the monocular display module to be matched is imported; the related optical parameter data comprises an image offset value and a virtual image offset value of the monocular display module; then, a matching matrix is established according to the relevant optical parameter data of the monocular display module to be matched; performing iterative computation on matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-eye display equipment; the matching list shows that the overall best matching result among all the display modules is achieved, the industrial requirements are met, and binocular matching can be completed. Therefore, the problem of resource waste caused by an unreasonable matching method for forming a binocular complete machine by monocular display modules in the prior art is solved.
Referring to fig. 7, fig. 7 is a diagram illustrating a step S120 in the first embodiment of the present invention, namely, a step of creating a matching matrix according to the optical parameter data related to the monocular display module to be matched, which specifically includes:
step S121, for all monocular display modules whose related optical parameter data do not exceed the preset first threshold, the related optical parameter data are separated into left and right module data.
In this embodiment, the preset first threshold refers to a preset reference value of the related optical parameter, and is intended to eliminate the modules exceeding the reference value of the related optical parameter, so as to eliminate the display modules that may not have matching modules; the reference value of the relevant optical parameter is specifically set according to the product standard or the process requirement, and is not limited too much here. Regarding all the monocular display modules of which the related optical parameter data do not exceed the preset first threshold, the monocular display modules are considered to be display modules with matched modules, and then the related optical parameter data are separated into left module data and right module data. The purpose of separating into left and right module data is to group the relevant optical parameters of the display modules left and right for the next matching procedure.
Step S122, according to the left and right module data and a preset data weighting formula, an initial matrix is created, and matrix data of the initial matrix is determined, wherein the matrix data comprises: unmatched terms and specific numerical values;
in the present embodiment, the preset data weighting formula is set in advance. The left and right module data is actually a multi-dimensional measurement data. Setting a data weighting formula, and reducing the dimension of the imported multidimensional measurement data into one-dimensional data for processing; the weighted data can be calculated by using x, yaw, y, ptich, roll parameters, for example, the sum of yaw + pitch + roll of the row-column difference is used as a weighted value, and then the set value is required to be less than or equal to 3 ° (the value is an empirical value and is set according to the actual product dimension). The data weighting formula may be set according to a specific application, and is not limited herein. The unmatched entry is used to mark the unmatched condition between the two modules. That is, in the initial matrix, there may be a case where the entire row and/or the entire column are unmatchable items, and if there is such a case, it indicates that the display module corresponding to the row or the column is unmatchable with the other display modules, that is, the module is unmatchable and unmatchable with the other display modules.
And S123, removing rows and/or columns of which the whole rows and/or whole columns are unmatchable items in the initial matrix to obtain the matching matrix.
In this embodiment, when a certain row and/or a certain column of the matrix are not allowed to be matched, the corresponding module in the row and/or the column is an unmatchable module, and the module in the row or the column needs to be removed from the initial matrix, so as to obtain a matching matrix that needs to be subjected to iterative operation.
In the technical solution provided in this embodiment, step 120 in the first embodiment of the present invention is refined, that is, for all monocular display modules whose related optical parameter data do not exceed the preset first threshold, the related optical parameter data are separated into left and right module data; establishing an initial matrix according to the left and right module data and a preset data weighting formula; and removing rows and/or columns of which the whole rows and/or whole columns are non-matchable items in the initial matrix to obtain a matching matrix, so that some non-matchable modules can be removed before iterative operation, the matching operation amount is reduced, and the matching result is optimized.
Referring to fig. 8, fig. 8 is a specific step of separating the related optical parameter data of all monocular display modules whose related optical parameter data do not exceed the preset threshold into left and right module data in step S121 of the present invention, specifically including:
step S1211, determining all monocular display modules whose related optical parameter data do not exceed the preset first threshold.
In this embodiment, it is determined that the related optical parameter data does not exceed the preset first threshold, such as all monocular display modules determining that the image offset value or the virtual image offset value does not exceed the preset first threshold. The preset first threshold may include an image offset threshold or a virtual image offset threshold, and if the related optical parameters further include other parameters, such as diopter, color coordinate, color temperature, brightness, and angle of view, the corresponding first thresholds also include: diopter threshold, color coordinate threshold, color temperature threshold, brightness threshold, field angle threshold, and the like. When the optical parameters of the monocular display module exceed the corresponding threshold, the monocular display module is considered to be an unmatchable module.
For example, in one embodiment, the relevant optical parameters include: diopter, diopter adjustable range, color coordinate, color temperature, brightness, field angle, distortion (i.e. parameters capable of reflecting the physical state of the display module). Therefore, when the preset first threshold is set, specific setting can be performed according to the parameters, for example, when some parameters such as the field angle are too small, the corresponding module is marked as an unmatchable module, and then the unmatchable module is removed; and marking the modules with the distortion parameters exceeding 2% as unmatchable modules, and then rejecting the unmatchable modules and the like. The threshold value of the relevant optical parameter is specifically set according to product standards or process requirements, and is not limited herein.
It should be noted that, if the data distribution span of optical parameters such as diopter, brightness or color temperature is too large, which may affect the subsequent matching, the data may be divided into a plurality of threshold intervals, that is, a plurality of thresholds are set, and then the data are compared in different threshold intervals.
In this step, for the monocular display module with the determined related optical parameter data exceeding the preset first threshold, the module is directly marked as the unmatchable module, and the module data is directly removed without being included in the subsequent matrix creation and iterative computation links. And executing step S1212 or step S1213 for the monocular display module with the determined related optical parameter data not exceeding the preset first threshold.
In step S1212, if the monocular display module is left and right, the left and right module data are separated according to the module number.
Or step S1213, if the monocular display module is left and right undistinguished, dividing the data into left and right module data according to the number.
In this embodiment, for all monocular display modules whose related optical parameter data do not exceed the preset first threshold, if the monocular display modules themselves are left and right distinguished, the data are separated into left and right module data according to the module numbers. If these monocular display module self do not divide when controlling, then can equally divide into according to actual quantity with the display module and control the module data about. Before establishing initial matrix, through carrying out the primary screen to the display module assembly, can get rid of some display module assemblies that do not have the matching module at all, can reduce subsequent operand on the one hand like this, on the other hand can also promote the matching effect of follow-up matching matrix.
Referring to fig. 9, fig. 9 is a step S122 of the present invention, that is, creating an initial matrix according to the left and right module data and a preset data weighting formula, and determining matrix data of the initial matrix, where the matrix data includes: the specific steps of the unmatchable item and the specific numerical value specifically include:
step S1221, marking the left module as a row mark and marking the right module as a column mark, or marking the left module as a column mark and marking the right module as a row mark, and determining the row and the column of the initial matrix.
In this embodiment, the matrix uses the module number as the row and column label, which can be the left module as the row label and the right module as the column label; certainly, the left module can be a column label, and the right module can be a row label; thereby defining the rows and columns of the initial matrix.
Step S1222, obtaining the relative optical parameter data of the pair of left and right modules according to the row and column labels.
In this embodiment, the left and right modules are valued one by one according to the row and column marks, and then the relevant optical parameter data of the left and right modules are obtained; for example, image offset value data, virtual image offset value data, diopter data, color coordinate data, color temperature data, luminance data, angle of view data, and the like of a pair of left and right modules are obtained; the resulting data are actually two sets of multidimensional data.
And step S1223, performing corresponding difference on the related optical parameter data pair by pair to obtain corresponding difference values of the related optical parameter data between the left module and the right module.
In this embodiment, the difference is made for each pair of related optical parameter data, for example, the difference may be made for each pair of image offset values; or the virtual image deviation value is correspondingly subtracted pair by pair; of course, other relevant optical parameter data can be correspondingly subtracted one by one; and obtaining corresponding difference values of the related optical parameter data between the left module and the right module.
Step S1224, if there is a difference value exceeding a preset second threshold in the corresponding difference values of the relevant optical parameter data between the pair of left and right modules, marking the matrix data of the row and column where the pair of modules is located as an unmatchable item; and if the difference value exceeding the preset second threshold value does not exist, calculating a specific numerical value of the row and the column of the pair of modules according to the difference value of the related optical parameter data between the pair of left and right modules and a preset data weighting formula.
In this embodiment, the difference value of the preset second threshold is preset, and the difference value of the preset second threshold can be set according to the product standard and the specific application. For example, it is set that the diopter difference between two modules is not allowed to exceed 1D, and the three angle differences of yaw, ptich, and roll are not allowed to exceed 1 °, wherein if one of the entries does not match, the matrix data of the row and column where the pair of modules is located is marked as a non-matching entry. If there is a difference value exceeding a preset second threshold in the corresponding difference values of the relevant optical parameter data between the pair of left and right modules, for example, the angle difference value of yaw in the pair of modules exceeds 1 °; marking the matrix data of the row and column where the pair of modules are positioned as an unmatchable item; if the difference value exceeding the preset second threshold value does not exist, for example, the diopter difference value between the pair of modules does not exceed 1D, and the three angle difference values of yaw, ptich and roll do not exceed 1 degree, the specific numerical value of the row and column where the pair of modules are located is calculated according to the difference value of the related optical parameter data between the pair of left and right modules and the preset data weighting formula. For example, an image offset value and a virtual image offset value; using the parameters x, yaw, y, ptich, roll to perform operation, such as using the sum of yaw + pitch + roll of the row-column difference as the weighting value; the weighting value of the row and column where the pair of modules is located, i.e. the specific value of the initial matrix mentioned above, is obtained.
The embodiment has the advantages that: 1. introducing comparison between a first threshold and a second threshold, filtering out non-conforming items, and reconstructing a matrix after removing the non-conforming items; therefore, in the process of creating the initial matrix, rows and/or columns of which the whole rows and/or whole columns are non-matchable items in the initial matrix can be removed to obtain a matching matrix, so that some non-matchable modules can be removed before iterative operation, the matching operation amount is reduced, and the matching result is optimized. 2. The multidimensional data can be set with weight, the dimension is reduced to one-dimensional data to fill in the matrix, and the weight setting needs to be set according to the user. And the user can set the weights of different parameters according to different requirements. : 3. and the Munkres is applied to virtually displaying binocular matching, and the algorithm is perfectly matched with the application scene. Therefore, the output binocular matching list can ensure that the overall best matching result among all the display modules is achieved, the industrial requirements are met, binocular matching can be completed, and the problem of resource waste caused by an unreasonable matching method for forming a binocular complete machine by monocular display modules in the prior art is solved.
Referring to fig. 10, fig. 10 is a diagram illustrating a binocular matching method of a near-eye display apparatus according to a second embodiment of the present invention, including:
step S210, importing relevant optical parameter data of a monocular display module to be matched; the related optical parameter data comprises an image offset value or a virtual image offset value of the monocular display module.
Step S220, a matching matrix is established according to the relevant optical parameter data of the monocular display module to be matched.
And step S230, performing iterative computation on the matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-to-eye display equipment.
Compared with the first embodiment, the second embodiment includes step S240, and other steps are the same as the first embodiment and are not repeated.
And S240, selecting the monocular display modules matched with each other according to the binocular matching list and finishing assembly.
In this embodiment, according to the binocular matching list, two monocular display modules matched with each other are selected to complete assembly, and the monocular display modules matched with each other between two pairs are the best match; the operation can be performed manually or mechanically.
Referring to fig. 11, fig. 11 is a diagram illustrating a binocular matching method of a near-eye display apparatus according to a third embodiment of the present invention, including:
step S310, importing relevant optical parameter data of the monocular display module to be matched; the related optical parameter data comprises an image offset value or a virtual image offset value of the monocular display module.
Step S320, creating a matching matrix according to the relevant optical parameter data of the monocular display module to be matched.
And step S330, performing iterative computation on the matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-to-eye display equipment.
And step S340, selecting the monocular display modules matched with each other according to the binocular matching list and finishing assembly.
Compared with the second embodiment, the third embodiment includes step S350, step S360, and step S370, and other steps are the same as the second embodiment and are not repeated.
And step S350, assembling the matched monocular display modules to obtain the whole binocular module.
In this embodiment, the monocular display modules matched with each other are assembled to obtain the whole binocular module, that is, the assembly of all the monocular display modules is completed according to the optimal matching list.
And step S360, measuring the optical parameters of each monocular module in the whole machine binocular module to obtain a group of optical parameters of the whole machine binocular module, and calculating the binocular difference value of the group of optical parameters.
In this embodiment, preferably, the binocular measurement device is used to re-measure the optical parameter data of each monocular module in the whole binocular module, for example, the binocular measurement device is used to re-measure the parameters of the image offset value, the virtual image offset value, the diopter adjustable range, the color coordinate, the color temperature, the brightness, the field angle, the distortion, and the like of each monocular display module; obtaining a group of optical parameters of the whole binocular module, and calculating binocular difference values of the group of optical parameters; for example, the difference of the image offset value and the difference of the virtual image offset value of each pair of modules in the overall binocular module are calculated.
Step S370, if the binocular disparity value exceeds the preset second threshold, performing a repair process on the complete machine binocular module.
In this embodiment, if the binocular disparity value exceeds the preset second threshold, for example, when the difference of the related optical parameter data, such as the difference of the image offset value, the difference of the virtual image offset value, and the like of one or more pairs of modules, in the binocular complete machine module exceeds the preset second threshold, the user experience may be poor, and the product quality may be affected; need go on artificial reprocessing to surpassing the module and handle, take certain mode, for example: adding a gasket, adjusting the position of a picture, adjusting the driving voltage, adjusting the position of a lens and the like until the complete machine test is OK.
In the technical scheme provided by the embodiment, the monocular display modules matched with each other are assembled to obtain a complete machine binocular module; measuring the optical parameters of each monocular module in the whole machine binocular module to obtain a group of optical parameters of the whole machine binocular module, and calculating the binocular difference value of the group of optical parameters; and if the binocular difference value exceeds the preset second threshold value, carrying out repair processing on the whole binocular module. The problem of accurate matching binocular module group close up is further solved.
The present invention also provides an apparatus comprising a memory, a processor, and a binocular matching program stored in the memory and executable on the processor, the binocular matching program when executed by the processor implementing the steps of the binocular matching method as described above.
The present invention also provides a computer-readable storage medium storing a binocular matching program which, when executed by a processor, implements the steps of the binocular matching method as described above.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A binocular matching method of a near-eye display device, the method comprising:
importing relevant optical parameter data of a monocular display module to be matched; the related optical parameter data comprises an image offset value or a virtual image offset value of the monocular display module;
establishing a matching matrix according to the relevant optical parameter data of the monocular display module to be matched;
and performing iterative computation on the matrix data of the matching matrix by adopting a preset algorithm, and outputting a binocular matching list of the near-to-eye display equipment.
2. The binocular matching method of the near-eye display device of claim 1, wherein the step of creating a matching matrix according to the relevant optical parameter data of the monocular display module to be matched comprises:
for all monocular display modules of which the related optical parameter data do not exceed a preset first threshold, separating the related optical parameter data into left and right module data;
according to the left module data, the right module data and a preset data weighting formula, an initial matrix is created, and matrix data of the initial matrix are determined, wherein the matrix data comprise: unmatched terms and specific numerical values;
and removing rows and/or columns of which the whole rows and/or whole columns are non-matchable items in the initial matrix to obtain the matching matrix.
3. The binocular matching method of the near-eye display device of claim 2, wherein the step of separating the relevant optical parameter data of all monocular display modules whose relevant optical parameter data do not exceed a preset threshold into left and right module data comprises:
determining all monocular display modules of which the related optical parameter data do not exceed a preset first threshold;
if the monocular display module is left and right, separating the data into left and right module data according to the module number; or, if the monocular display module is not left or right distinguished, the data are equally divided into left and right module data according to the number.
4. The binocular matching method of the near-eye display device of claim 3, wherein the step of creating an initial matrix according to the left and right module data and a preset data weighting formula and determining matrix data of the initial matrix comprises:
marking a left module as a row mark and marking a right module as a column mark, or marking the left module as a column mark and marking the right module as a row mark, and determining the row and the column of the initial matrix;
obtaining related optical parameter data of a pair of left and right modules according to the row and column labels;
making a difference between the related optical parameter data pair by pair to obtain a corresponding difference value of the related optical parameter data between the left module and the right module;
if the difference value exceeding a preset second threshold value exists in the corresponding difference values of the related optical parameter data between the pair of left and right modules, marking the matrix data of the row and the column where the pair of modules are located as an unmatchable item; and if the difference value exceeding the preset second threshold value does not exist, calculating a specific numerical value of the row and the column of the pair of modules according to the difference value of the related optical parameter data between the pair of left and right modules and a preset data weighting formula.
5. The binocular matching method of a near-eye display device of claim 2, wherein the method further comprises:
and marking the monocular display module with the related optical parameter data exceeding a preset first threshold as a non-matching module.
6. The binocular matching method of claim 1, wherein the related optical parameters further include:
diopter, diopter adjustable range, color coordinates, color temperature, brightness, field angle, distortion.
7. The binocular matching method of a near-eye display device of claim 4, wherein after the step of outputting the binocular matching list of the near-eye display device, the method further comprises:
and selecting the monocular display modules matched with each other according to the binocular matching list and finishing the assembly.
8. The binocular matching method of the near-eye display device of claim 7, wherein after the steps of selecting the monocular display modules matched with each other according to the binocular matching list and completing the assembly, further comprising:
the monocular display modules matched with each other are assembled to obtain a whole binocular module;
measuring the optical parameters of each monocular module in the whole machine binocular module to obtain a group of optical parameters of the whole machine binocular module, and calculating binocular difference values of the group of optical parameters;
and if the binocular difference value exceeds the preset second threshold value, the overall binocular module is repaired.
9. An apparatus comprising a memory, a processor, and a binocular matching program for a near-eye display device stored in the memory and executable on the processor, the binocular matching program for the near-eye display device when executed by the processor implementing the steps of the binocular matching method for the near-eye display device of any one of claims 1-8.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a binocular matching program of a near-eye display apparatus, the binocular matching program implementing the respective steps of the binocular matching method of the near-eye display apparatus according to any one of claims 1 to 8 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011282557.0A CN112488161B (en) | 2020-11-16 | 2020-11-16 | Binocular matching method, device and computer storage medium of near-eye display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011282557.0A CN112488161B (en) | 2020-11-16 | 2020-11-16 | Binocular matching method, device and computer storage medium of near-eye display equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112488161A true CN112488161A (en) | 2021-03-12 |
| CN112488161B CN112488161B (en) | 2024-02-27 |
Family
ID=74931178
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011282557.0A Active CN112488161B (en) | 2020-11-16 | 2020-11-16 | Binocular matching method, device and computer storage medium of near-eye display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112488161B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000278710A (en) * | 1999-03-26 | 2000-10-06 | Ricoh Co Ltd | Device for evaluating binocular stereoscopic vision picture |
| CN105913474A (en) * | 2016-04-05 | 2016-08-31 | 清华大学深圳研究生院 | Binocular three-dimensional reconstruction device and three-dimensional reconstruction method thereof, and Android application |
| CN106133649A (en) * | 2014-03-26 | 2016-11-16 | 微软技术许可有限责任公司 | The eye gaze using binocular gaze constraint is followed the tracks of |
| CN108270952A (en) * | 2017-11-21 | 2018-07-10 | 深圳市芯舞时代科技有限公司 | A kind of bearing calibration of binocular camera image aberration and system |
| CN110658916A (en) * | 2019-09-18 | 2020-01-07 | 中国人民解放军海军航空大学 | Target tracking method and system |
-
2020
- 2020-11-16 CN CN202011282557.0A patent/CN112488161B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000278710A (en) * | 1999-03-26 | 2000-10-06 | Ricoh Co Ltd | Device for evaluating binocular stereoscopic vision picture |
| CN106133649A (en) * | 2014-03-26 | 2016-11-16 | 微软技术许可有限责任公司 | The eye gaze using binocular gaze constraint is followed the tracks of |
| CN105913474A (en) * | 2016-04-05 | 2016-08-31 | 清华大学深圳研究生院 | Binocular three-dimensional reconstruction device and three-dimensional reconstruction method thereof, and Android application |
| CN108270952A (en) * | 2017-11-21 | 2018-07-10 | 深圳市芯舞时代科技有限公司 | A kind of bearing calibration of binocular camera image aberration and system |
| CN110658916A (en) * | 2019-09-18 | 2020-01-07 | 中国人民解放军海军航空大学 | Target tracking method and system |
Non-Patent Citations (1)
| Title |
|---|
| 刘辉;王伯雄;任怀艺;李鹏程;: "ICP算法在双目结构光***点云匹配中的应用", 清华大学学报(自然科学版), no. 07 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112488161B (en) | 2024-02-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102118613B1 (en) | How to compensate for the Mura phenomenon | |
| CN111210468B (en) | Image depth information acquisition method and device | |
| CN106531050A (en) | Method, device and system for gray scale compensation of display panel | |
| EP3220099A1 (en) | Calibration device, calibration method, optical device, imaging device, projection device, measurement system, and measurement method | |
| US20160163252A1 (en) | Image display device, correction data generation method, and image correction device and method, as well as image correction system | |
| EP3899861A1 (en) | Optical correction via machine learning | |
| CN104252700A (en) | Histogram equalization method for infrared image | |
| CN112614468B (en) | Brightness compensation method and system of display panel | |
| CN111047586B (en) | Pixel equivalent measuring method based on machine vision | |
| CN112004078B (en) | Virtual reality video quality evaluation method and system based on generation countermeasure network | |
| CN111325803B (en) | Calibration method for evaluating internal and external participation time synchronization of binocular camera | |
| CN106791331B (en) | Image processing method, device and imaging system based on lens array imaging | |
| Moru et al. | Analysis of different parameters of influence in industrial cameras calibration processes | |
| US11659157B2 (en) | Systems for measuring naked-eye stereoscopic image, methods and apparatuses for processing image and display devices | |
| CN112488161B (en) | Binocular matching method, device and computer storage medium of near-eye display equipment | |
| TWI301265B (en) | ||
| CN109087253A (en) | A kind of method for correcting image and device | |
| Li et al. | Local error and its identification for microlens array in plenoptic camera | |
| CN106791498A (en) | Image position method, lens array imaging method and device | |
| CN116110049A (en) | Correction data calculation method and device for reading pen and computer readable storage medium | |
| CN114879377B (en) | Parameter determination method, device and equipment of horizontal parallax three-dimensional light field display system | |
| CN113936221B (en) | Method and system applied to highway environment monitoring in plateau area | |
| CN106713707A (en) | Lens array imaging method and device | |
| CN113936055A (en) | Train brake shoe residual thickness measuring method, system, storage medium and computer equipment | |
| DE602004001718T2 (en) | Method for real-time correction of non-functioning pixels in digital radiography |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |