CN111540060A - Display calibration method and device of augmented reality equipment and electronic equipment - Google Patents
Display calibration method and device of augmented reality equipment and electronic equipment Download PDFInfo
- Publication number
- CN111540060A CN111540060A CN202010216201.0A CN202010216201A CN111540060A CN 111540060 A CN111540060 A CN 111540060A CN 202010216201 A CN202010216201 A CN 202010216201A CN 111540060 A CN111540060 A CN 111540060A
- Authority
- CN
- China
- Prior art keywords
- calibration
- marker
- scene
- sample image
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 50
- 239000003550 marker Substances 0.000 claims abstract description 213
- 238000012545 processing Methods 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 25
- 230000000875 corresponding effect Effects 0.000 description 44
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 238000013519 translation Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Architecture (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application relates to a display calibration method and device of augmented reality equipment and electronic equipment. The method comprises the following steps: acquiring a calibration scene for displaying calibration; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker; receiving an input adjusting instruction; and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide. By adopting the method, the accuracy of AR equipment display and real scene superposition can be improved.
Description
Technical Field
The present application relates to the field of augmented reality device display technologies, and in particular, to a display calibration method and apparatus for an augmented reality device, a computer device, and a storage medium.
Background
Augmented Reality (AR) technology is a technology that increases the perception of a user to the real world through information provided by a computer system, and superimposes virtual objects, scenes or system prompt information generated by the computer into real scenes, thereby realizing 'Augmented' to Reality.
With the continuous development of AR technology, AR devices are beginning to be widely used in various fields, such as face recognition, article recognition, and the like. The AR equipment superposes the displayed information and the real scene, so that the display is more visual. However, in the existing AR display technology, display of an AR scene is realized by rendering a picture captured by a camera, and the AR device has the problem that display and a real scene are not accurately superposed.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a display calibration method and apparatus for an augmented reality device, an electronic device, and a storage medium, which can improve accuracy of superposition of display of an AR device and a real scene.
A method of display calibration of an augmented reality device, the method comprising:
acquiring a calibration scene for displaying calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjusting instruction;
performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
In one embodiment, before the acquiring a calibration scenario for displaying a calibration, the method further comprises:
receiving a calibration instruction for displaying calibration, wherein the calibration instruction carries a scene identifier;
and determining a calibration scene according to the scene identification.
In one embodiment, before the determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker, the method further comprises:
acquiring color data of the calibration scene;
performing color processing on the sample image according to the color data of the calibration scene;
and when the difference value between the color data of the sample image and the color data of the calibration scene after color processing is equal to a preset difference value, executing the step of determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene.
In one embodiment, the adjustment instruction is an image adjustment instruction, and the performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide comprises:
adjusting the sample image according to the image adjustment instructions until the first marker and the second marker coincide.
In one embodiment, the image adjustment instructions include at least one of a zoom instruction, a pan instruction, and a shear instruction.
In one embodiment, the method further comprises:
when the first marker and the second marker are detected to coincide, acquiring calibration data, device information and corresponding user information of the augmented reality device;
associating the device information and the calibration data with user information.
In one embodiment, the method further comprises:
storing the associated device information and calibration data with user information in a memory of the augmented reality device. A display calibration apparatus of an augmented reality device, the apparatus comprising:
the acquisition module is used for acquiring a calibration scene for displaying calibration;
the first determining module is used for determining a sample image to be displayed on the display screen of the augmented reality equipment according to the calibration scene;
a second determination module for determining a first marker in the sample image and a corresponding second marker of the first marker in the calibration scene;
the receiving module is used for receiving an input adjusting instruction;
and the calibration module is used for carrying out display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped.
An electronic device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
acquiring a calibration scene for displaying calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjusting instruction;
performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
acquiring a calibration scene for displaying calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjusting instruction;
performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
According to the display calibration method and device of the augmented reality equipment, the electronic equipment and the storage medium, the calibration scene for display calibration is obtained; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker; receiving an input adjusting instruction; and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide. The first marker of the sample image and the second marker of the calibration scene are adjusted and determined through the input adjusting instruction, so that the first marker of the sample image and the second marker of the calibration scene are completely overlapped, the deviation between the position of the content displayed by the AR display and the real scene is avoided, and the accuracy of superposition of display of the AR equipment and the real scene is improved.
Drawings
Fig. 1 is a schematic flowchart of a display calibration method of an augmented reality device according to an embodiment;
fig. 2a is a schematic diagram of a calibration scene in a display calibration method of an augmented reality device in an embodiment;
fig. 2b is a schematic diagram of a calibration scenario in a display calibration method of an augmented reality device in another embodiment;
fig. 3 is a schematic flowchart of a display calibration method of an augmented reality device according to another embodiment;
FIG. 4 is a diagram illustrating the effects of the augmented reality device before and after display calibration in one embodiment;
FIG. 5 is a flowchart illustrating a display calibration procedure of an augmented reality device according to an embodiment;
FIG. 6 is a block diagram of a display calibration apparatus of an augmented reality device according to an embodiment;
fig. 7 is a block diagram of a display calibration apparatus of an augmented reality device according to another embodiment;
FIG. 8 is a diagram illustrating the internal architecture of an electronic device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
In an embodiment, as shown in fig. 1, a display calibration method for an augmented reality device is provided, and this embodiment is illustrated by applying the method to a terminal, it is to be understood that the method may also be applied to a server, and may also be applied to a system including the terminal and the server, and is implemented by interaction between the terminal and the server. In this embodiment, the method includes the steps of:
The calibration scene is used for displaying calibration of the augmented reality device, the calibration scene comprises markers different from a scene background, and the calibration scene at least comprises one marker; the calibration scene may be a real scene or a printed calibration pattern. For example, as shown in fig. 2a, the calibration scene may select a wall on which a marker such as a painting or a door or window is hung as the calibration scene of the augmented reality device; as shown in fig. 2b, a printed calibration scene is shown, and the calibration scene includes 5 markers respectively distributed at four corners and a center of the calibration scene.
Specifically, after the user wears the augmented reality device, the augmented reality device enters a display calibration mode after receiving a calibration instruction, a calibration scene for display calibration is acquired, and the augmented reality device is adjusted by the user to be in a parallel state with the calibration scene. The calibration instruction can be generated by a touch button on a user operation interface or a voice instruction control.
And 104, determining a sample image to be displayed on the display screen of the augmented reality device according to the calibration scene.
The method comprises the steps that a sample image is acquired from a calibration scene through a camera, and the sample image comprises a marker corresponding to the calibration scene; the shooting visual angle of the camera and the observation visual angle of the AR equipment wearer can be the same or a fixed angle is formed between the two; the camera may be, but is not limited to, mounted on the AR device.
Specifically, after the calibration scene is determined, the AR device acquires a sample image collected by the camera from the calibration scene for displaying the calibration.
A first marker in the sample image and a second marker in the calibration scene corresponding to the first marker are determined, step 106.
Specifically, after the calibration scene and the sample image are determined, the user is prompted to determine a first marker in the sample image and a second marker of the first marker in the calibration scene. Optionally, the number of the first markers and the positions of the markers in the sample image are not limited, and the number of the markers may be 1, 2, 3, or 4, etc.; the marker may be text, an article, etc.
And step 108, receiving an input adjusting instruction.
Specifically, the AR device displays a prompt message to prompt the user to observe whether the first marker in the displayed sample image can be overlapped with the second marker in the calibration scene, and inputs a corresponding adjustment instruction according to the overlapping condition of the first marker in the sample image and the second marker in the calibration scene. The adjusting instruction can be input on a human-computer interaction interface of the AR equipment and can also be generated through voice control; the adjustment instructions include, but are not limited to, position adjustment instructions and image adjustment instructions.
And 110, performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
Specifically, according to the coincidence condition of a first marker in the sample image and a second marker in the calibration scene, a corresponding adjustment instruction is received and input, and according to the adjustment instruction, the first marker of the sample image displayed on the AR device is completely coincided with the second marker in the calibration scene. Alternatively, when the first marker in the sample image is a window on a wall, according to the adjustment instruction, until the boundary line between the window and the wall in the sample image displayed on the AR device completely coincides with the boundary line between the window and the wall in the calibration scene.
In the display calibration method of the augmented reality device, a calibration scene for display calibration is acquired; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker; receiving an input adjusting instruction; and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide. The first marker of the sample image and the second marker of the calibration scene are adjusted and determined through the input adjusting instruction, so that the first marker of the sample image and the second marker of the calibration scene are completely overlapped, the deviation between the position of the content displayed by the AR display and the real scene is avoided, and the accuracy of superposition of display of the AR equipment and the real scene is improved.
In another embodiment, as shown in fig. 3, a display calibration method for an augmented reality device is provided, which is applied to a terminal for example in this embodiment, and the method in this embodiment includes the following steps:
The scene identifier is a mark for distinguishing different scenes, and may be a character string combined by numbers, letters, or the like. The calibration instructions may be generated by touch control of user interface buttons or by voice control.
And step 304, determining a calibration scene according to the scene identification.
Specifically, when the AR device receives the display calibration instruction, the corresponding calibration scene is determined according to the scene identifier carried by the calibration instruction.
At step 308, color data of the calibration scene is obtained.
The color data may include RGB values, color brightness, etc. of the image, where R represents red (red), G represents green (green), and B represents blue (blue). The AR device can identify the calibration scene through a built-in identification algorithm to obtain the RGB value of the calibration scene.
The color processing is to process the RGB values of the image, so that the RGB values of the processed image are different from the RGB values of the image before processing. The color processing may be a reverse color processing of the sample image by which the R, G, B value of the image is inverted, and the contrast of the image with the sample image may be increased. For example, if the quantization level of the color is 256, the R, G, B value of the image after the inversion process is 255 minus the R, G, B value of the original image.
Specifically, color processing is performed on the sample image according to the RGB value of the calibration scene and a preset difference value set in advance, so that an RGB difference value exists between the RGB value of the calibration scene and the RGB value of the sample image after the color processing.
In step 312, when the difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to the preset difference value, a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene are determined.
The preset difference value is a color data difference value between preset color data of the sample image and preset color data of the calibration scene.
Specifically, color processing is performed on the sample image according to the color data of the calibration scene, and when a difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to a preset difference value, a user is prompted to determine a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene.
In one embodiment, before a first marker in a sample image and a second marker corresponding to the first marker in a calibration scene are determined, a built-in recognition algorithm is adopted to perform edge distortion correction processing on the sample image, and edge distortion caused by a camera is eliminated by performing distortion correction on the sample image, so that the accuracy of superposition of AR equipment display and a real scene is improved.
The adjusting instruction is used for adjusting the display position of the sample image on the display screen of the AR device and the display size of the sample image. The adjustment instruction may be, but is not limited to, an image adjustment instruction; the image adjusting instruction comprises a translation instruction and a zooming instruction, wherein the translation instruction can be used for translating a plurality of pixels of the image in the horizontal direction and can also be used for translating a plurality of pixels of the image in the vertical direction.
In one embodiment, the adjustment instruction is an image adjustment instruction, and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide comprises: and adjusting the sample image according to the image adjusting instruction until the first marker and the second marker coincide.
Specifically, the AR device generates prompt information for prompting a user to observe whether a first marker in a sample image on a display screen of the AR device is completely overlapped with a second marker in a calibration scene, when the fact that the second marker in the calibration scene is not overlapped with the first marker in the sample image is observed, an input image adjusting instruction is received, and the sample image is adjusted according to the image adjusting instruction until the first marker is overlapped with the second marker. The image adjustment command may be, but is not limited to, a zoom command, a pan command, and a shear command. The display size and the display position of the sample image are adjusted through the image adjusting instruction, the first marker and the second marker are enabled to be overlapped, and therefore the accuracy of AR equipment calibration is improved.
Optionally, before receiving the adjustment instruction, the AR device generates prompt information for prompting a user to observe whether all second markers in the calibration scene corresponding to the first markers in the sample image on the display screen of the AR device are displayed on the display screen of the AR device, and when the number of the second markers in the calibration scene observed on the display screen of the AR device is less than the number of the first markers in the sample image, the AR device prompts the user to adjust the position of the AR device by moving back and forth until all the second markers in the calibration scene corresponding to the first markers in the sample image on the display screen of the AR device are displayed on the display screen of the AR device; and receiving an input image adjusting instruction, and adjusting the display size and the display position of the sample image on the display screen according to the image adjusting instruction until the first marker and the second marker are overlapped. The second markers corresponding to the first markers can be completely displayed in the display screen of the AR device through the back-and-forth movement of the user, the second markers are completely displayed in the calibration scene of the AR display, the calibration precision of the AR display screen is improved, the markers between the display screen displaying the sample image and the calibration scene are adjusted through the image adjusting instruction, the second markers corresponding to the first markers can be completely overlapped, and the accuracy of superposition of display and the real scene in the AR device is improved.
And step 316, performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
Specifically, the sample image is displayed and calibrated according to the adjustment instruction until the first marker and the second marker coincide, corresponding calibration data is acquired, and the AR device superimposes information to be displayed and a real scene according to the calibration data and displays the information on a display screen of the AR device.
In one embodiment, when the first marker and the second marker are detected to coincide, calibration data and device information of the augmented reality device and corresponding user information are acquired; the device information and calibration data are associated with user information.
The calibration data comprises data such as amplification factor of a sample image, offset of the image and the like; the offset includes a horizontal offset and a vertical offset. The device information may be, but is not limited to, the model of the device. The user information is data that may include the name, gender, age, etc. of the AR device wearer.
Specifically, when the first marker and the second marker coincide, calibration data and device information of the augmented reality device and corresponding user information are acquired, and the calibration data and the device information and the corresponding user information data are associated. By associating user information, calibration data, and device information, the number of times the AR device displays the calibration may be reduced and the calibration efficiency of the AR device may be improved.
In one embodiment, the correlated device information and calibration data is stored with the user information in a memory of the augmented reality device.
Specifically, the associated device information, calibration data and user information are stored in the memory, and the corresponding calibration data and device information can be accurately acquired from the memory according to the user information, so that the display calibration times of the AR device are reduced, and the calibration efficiency of the AR device is improved. Alternatively, the memory may be, but is not limited to, a non-volatile memory.
Optionally, in the following embodiment, the augmented reality device displays a comparison graph of the effect before and after calibration, as shown in fig. 4, the AR device is worn on the user, the AR device has a position deviation between a display screen seen before the calibration is displayed and a calibration scene, a sample image of the display screen includes 5 markers, and the calibration scene includes 4 markers, and the user is prompted to move back and forth, so that the number of the markers in the calibration scene and the display screen is the same; the size and the position of the sample image in the display screen are adjusted through the translation instruction and the zooming instruction, and the first marker in the sample image can be seen to be overlapped with the second marker in the calibration scene through the display screen.
In the display calibration method of the augmented reality device, the calibration instruction of the display calibration is received, and the calibration instruction carries the scene identifier; determining a calibration scene according to the scene identification; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; acquiring color data of a calibration scene; performing color processing on the sample image according to the color data of the calibration scene; when the difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to a preset difference value, determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; and receiving an input adjusting instruction, and performing display calibration on the sample image according to the adjusting instruction until the first marker and the second marker coincide. The contrast of the sample image and the calibration scene is increased by carrying out color processing on the sample image, and the sample image is displayed and calibrated according to the input adjustment instruction until the first marker and the second marker coincide, so that the accuracy of superposition of the AR equipment and the real scene is improved.
In an embodiment, as shown in fig. 5, a display calibration step of an augmented reality device is provided, and this embodiment is exemplified by applying the method to a terminal, and in this embodiment, the step includes the following steps:
Specifically, the AR equipment receives a calibration instruction, enters a calibration mode, and acquires a calibration scene for displaying calibration; the calibration scene can be obtained from the database according to the scene identifier carried by the calibration instruction, and the user can select a proper calibration scene according to actual requirements.
Specifically, after acquiring the calibration scene, the AR device acquires a sample image for display calibration acquired by the camera from the calibration scene.
Specifically, color data of a calibration scene is acquired, color processing is performed on the sample image according to the color data of the calibration data, and when a difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to a preset difference value, a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene are determined.
Specifically, after color processing is performed on a sample image by the AR device, a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene are determined; and receiving an input adjusting instruction to perform display calibration on the sample image. The adjustment instruction may be, but is not limited to, an image adjustment instruction.
Specifically, when coincidence of the first marker and the second marker is detected, calibration data of the augmented reality device is acquired, and the calibration data is saved in a database.
In the step of calibrating display of the augmented reality device, a calibration instruction for calibrating display is received, and the calibration instruction carries a scene identifier; determining a calibration scene according to the scene identification; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; acquiring color data of a calibration scene; performing color processing on the sample image according to the color data of the calibration scene; when the difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to a preset difference value, determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; receiving an input adjusting instruction, performing display calibration on the sample image according to the adjusting instruction, acquiring calibration data of the augmented reality device until the first marker and the second marker coincide, and storing the calibration data in a database. The calibration accuracy of the AR equipment is improved, the calibration times of the AR equipment can be reduced by storing calibration data, and the operation of a user is facilitated.
It should be understood that although the steps in the flowcharts of fig. 1, 3 and 5 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1, 3 and 5 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 6, there is provided a display calibration apparatus of an augmented reality device, including: an acquisition module 602, a first determination module 604, a second determination module 606, a receiving module 608, and a calibration module 610, wherein:
an obtaining module 602, configured to obtain a calibration scenario for display calibration.
A first determining module 604, configured to determine a sample image to be displayed on a display screen of the augmented reality device according to the calibration scenario.
A second determining module 606, configured to determine the first marker in the sample image and a corresponding second marker of the first marker in the calibration scene.
The receiving module 608 is configured to receive an input adjustment instruction.
And the calibration module 610 is configured to perform display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
In the display calibration device of the augmented reality equipment, a calibration scene for display calibration is acquired; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker; receiving an input adjusting instruction; and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide. The first marker of the sample image and the second marker of the calibration scene are adjusted and determined through the input adjusting instruction, so that the first marker of the sample image and the second marker of the calibration scene are completely overlapped, the deviation between the position of the content displayed by the AR display and the real scene is avoided, and the display accuracy of the AR equipment is improved.
In another embodiment, as shown in fig. 7, a display calibration apparatus for an augmented reality device is provided, which includes a color processing module 612, an association module 614 and a storage module 616 in addition to an acquisition module 602, a first determination module 604, a second determination module 606, a receiving module 608 and a calibration module 610, wherein:
a color processing module 612, configured to obtain color data of a calibration scene; performing color processing on the sample image according to the color data of the calibration scene; and when the difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to a preset difference value, executing the step of determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene.
In one embodiment, the calibration module 610 is further configured to adjust the sample image according to the image adjustment instructions until the first marker and the second marker coincide; the image adjustment instructions include at least one of a zoom instruction, a pan instruction, and a shear instruction.
The association module 614 is configured to, when it is detected that the first marker and the second marker coincide, acquire calibration data and device information of the augmented reality device and corresponding user information; the device information and calibration data are associated with user information.
A storage module 616, configured to store the associated device information and calibration data and user information in a memory of the augmented reality device.
In one embodiment, a calibration instruction for displaying calibration is received, and the calibration instruction carries a scene identifier; determining a calibration scene according to the scene identification; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; acquiring color data of a calibration scene; performing color processing on the sample image according to the color data of the calibration scene; when the difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to a preset difference value, determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; receiving an input adjusting instruction, and performing display calibration on the sample image according to the adjusting instruction until the first marker and the second marker are overlapped; when the first marker and the second marker are detected to be coincident, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information; the device information and calibration data are associated with user information. The contrast of the sample image and the calibration scene is increased by carrying out color processing on the sample image, and the sample image is displayed and calibrated according to the input adjustment instruction until the first marker and the second marker are overlapped, so that the calibration accuracy of the AR equipment is improved. By associating and storing the calibration data, the equipment information and the user information, different users can read the calibration data corresponding to the user information from the memory according to the user information when using the calibration data, the equipment information and the user information, so that the calibration time is reduced, and the calibration efficiency and the calibration accuracy are improved.
For specific limitations of the display calibration apparatus of the augmented reality device, reference may be made to the above limitations of the display calibration method of the augmented reality device, and details are not repeated here. The modules in the display calibration device of the augmented reality device can be wholly or partially implemented by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, an electronic device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 8. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a method of display calibration for an augmented reality device. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 8 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program:
acquiring a calibration scene for displaying calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjusting instruction;
and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
receiving a calibration instruction for displaying calibration, wherein the calibration instruction carries a scene identifier;
and determining a calibration scene according to the scene identification.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
acquiring color data of a calibration scene;
performing color processing on the sample image according to the color data of the calibration scene;
and when the difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to a preset difference value, executing the step of determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
the adjustment instruction is an image adjustment instruction, and the display calibration of the sample image according to the adjustment instruction until the first marker and the second marker coincide comprises:
and adjusting the sample image according to the image adjusting instruction until the first marker and the second marker coincide.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
the image adjustment instructions include at least one of a zoom instruction, a pan instruction, and a shear instruction.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
when the first marker and the second marker are detected to coincide, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information;
associating the device information and the calibration data with user information.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
storing the associated device information and calibration data with user information in a memory of the augmented reality device.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring a calibration scene for displaying calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjusting instruction;
and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
In one embodiment, the computer program when executed by the processor further performs the steps of:
receiving a calibration instruction for displaying calibration, wherein the calibration instruction carries a scene identifier;
and determining a calibration scene according to the scene identification.
In one embodiment, the computer program when executed by the processor further performs the steps of:
acquiring color data of a calibration scene;
performing color processing on the sample image according to the color data of the calibration scene;
and when the difference value between the color data of the color-processed sample image and the color data of the calibration scene is equal to a preset difference value, executing the step of determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene.
In one embodiment, the computer program when executed by the processor further performs the steps of:
the adjustment instruction is an image adjustment instruction, and the display calibration of the sample image according to the adjustment instruction until the first marker and the second marker coincide comprises:
and adjusting the sample image according to the image adjusting instruction until the first marker and the second marker coincide.
In one embodiment, the computer program when executed by the processor further performs the steps of:
the image adjustment instructions include at least one of a zoom instruction, a pan instruction, and a shear instruction.
In one embodiment, the computer program when executed by the processor further performs the steps of:
when the first marker and the second marker are detected to be coincident, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information;
the device information and calibration data are associated with user information.
In one embodiment, the computer program when executed by the processor further performs the steps of:
the correlated device information and calibration data and user information are stored in a memory of the augmented reality device.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A display calibration method for an augmented reality device, the method comprising:
acquiring a calibration scene for displaying calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjusting instruction;
performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
2. The method of claim 1, wherein prior to said acquiring a calibration scenario for displaying a calibration, the method further comprises:
receiving a calibration instruction for displaying calibration, wherein the calibration instruction carries a scene identifier;
and determining a calibration scene according to the scene identification.
3. The method of claim 1, wherein prior to the determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker, the method further comprises:
acquiring color data of the calibration scene;
performing color processing on the sample image according to the color data of the calibration scene;
and when the difference value between the color data of the sample image and the color data of the calibration scene after color processing is equal to a preset difference value, executing the step of determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene.
4. The method of claim 1, wherein the adjustment instruction is an image adjustment instruction, and wherein performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide comprises:
adjusting the sample image according to the image adjustment instructions until the first marker and the second marker coincide.
5. The method of claim 4, wherein the image adjustment instructions include at least one of zoom instructions, pan instructions, and shear instructions.
6. The method of claim 1, further comprising:
when the first marker and the second marker are detected to coincide, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information;
associating the device information and the calibration data with user information.
7. The method of claim 6, wherein the method comprises:
storing the associated device information and calibration data with user information in a memory of the augmented reality device.
8. An apparatus for display calibration of an augmented reality device, the apparatus comprising:
the acquisition module is used for acquiring a calibration scene for displaying calibration;
the first determining module is used for determining a sample image to be displayed on the display screen of the augmented reality equipment according to the calibration scene;
a second determination module for determining a first marker in the sample image and a corresponding second marker of the first marker in the calibration scene;
the receiving module is used for receiving an adjusting instruction input by a user interface;
and the calibration module is used for carrying out display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped.
9. An electronic device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor realizes the steps of the method of any of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010216201.0A CN111540060B (en) | 2020-03-25 | 2020-03-25 | Display calibration method and device of augmented reality equipment and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010216201.0A CN111540060B (en) | 2020-03-25 | 2020-03-25 | Display calibration method and device of augmented reality equipment and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111540060A true CN111540060A (en) | 2020-08-14 |
| CN111540060B CN111540060B (en) | 2024-03-08 |
Family
ID=71978756
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010216201.0A Active CN111540060B (en) | 2020-03-25 | 2020-03-25 | Display calibration method and device of augmented reality equipment and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111540060B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113509264A (en) * | 2021-04-01 | 2021-10-19 | 上海复拓知达医疗科技有限公司 | Augmented reality system, method and computer-readable storage medium based on position correction of object in space |
| CN114564108A (en) * | 2022-03-03 | 2022-05-31 | 北京小米移动软件有限公司 | Image display method, device and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107341827A (en) * | 2017-07-27 | 2017-11-10 | 腾讯科技（深圳）有限公司 | A kind of method for processing video frequency, device and storage medium |
| CN107911621A (en) * | 2017-12-28 | 2018-04-13 | 深圳市酷开网络科技有限公司 | A kind of image pickup method of panoramic picture, terminal device and storage medium |
| CN108955723A (en) * | 2017-11-08 | 2018-12-07 | 北京市燃气集团有限责任公司 | The calibration method of augmented reality city planting ductwork |
| CN109272454A (en) * | 2018-07-27 | 2019-01-25 | 阿里巴巴集团控股有限公司 | A kind of the coordinate system calibration method and device of augmented reality equipment |
| CN110412765A (en) * | 2019-07-11 | 2019-11-05 | Oppo广东移动通信有限公司 | Augmented reality image capturing method, device, storage medium and augmented reality equipment |
| CN110807413A (en) * | 2019-10-30 | 2020-02-18 | 浙江大华技术股份有限公司 | Target display method and related device |
-
2020
- 2020-03-25 CN CN202010216201.0A patent/CN111540060B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107341827A (en) * | 2017-07-27 | 2017-11-10 | 腾讯科技（深圳）有限公司 | A kind of method for processing video frequency, device and storage medium |
| CN108955723A (en) * | 2017-11-08 | 2018-12-07 | 北京市燃气集团有限责任公司 | The calibration method of augmented reality city planting ductwork |
| CN107911621A (en) * | 2017-12-28 | 2018-04-13 | 深圳市酷开网络科技有限公司 | A kind of image pickup method of panoramic picture, terminal device and storage medium |
| CN109272454A (en) * | 2018-07-27 | 2019-01-25 | 阿里巴巴集团控股有限公司 | A kind of the coordinate system calibration method and device of augmented reality equipment |
| CN110412765A (en) * | 2019-07-11 | 2019-11-05 | Oppo广东移动通信有限公司 | Augmented reality image capturing method, device, storage medium and augmented reality equipment |
| CN110807413A (en) * | 2019-10-30 | 2020-02-18 | 浙江大华技术股份有限公司 | Target display method and related device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113509264A (en) * | 2021-04-01 | 2021-10-19 | 上海复拓知达医疗科技有限公司 | Augmented reality system, method and computer-readable storage medium based on position correction of object in space |
| CN114564108A (en) * | 2022-03-03 | 2022-05-31 | 北京小米移动软件有限公司 | Image display method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111540060B (en) | 2024-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021169307A1 (en) | Makeup try-on processing method and apparatus for face image, computer device, and storage medium | |
| CN109672830B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN110062176B (en) | Method and device for generating video, electronic equipment and computer readable storage medium | |
| KR20120118583A (en) | Apparatus and method for compositing image in a portable terminal | |
| CN112348968B (en) | Display method and device in augmented reality scene, electronic equipment and storage medium | |
| CN109472738B (en) | Image illumination correction method and device, electronic equipment and storage medium | |
| CN110084154B (en) | Method and device for rendering image, electronic equipment and computer readable storage medium | |
| CN111540060B (en) | Display calibration method and device of augmented reality equipment and electronic equipment | |
| CN114003160B (en) | Data visual display method, device, computer equipment and storage medium | |
| CN108494996A (en) | Image processing method, device, storage medium and mobile terminal | |
| KR102082766B1 (en) | Method and apparatus for distinguishing objects | |
| CN115588052A (en) | Sight direction data acquisition method, device, equipment and storage medium | |
| CN113793392A (en) | Camera parameter calibration method and device | |
| CN109934168B (en) | Face image mapping method and device | |
| CN110047126B (en) | Method, apparatus, electronic device, and computer-readable storage medium for rendering image | |
| CN113920083A (en) | Image-based size measurement method and device, electronic equipment and storage medium | |
| CN110097622B (en) | Method and device for rendering image, electronic equipment and computer readable storage medium | |
| CN113747076A (en) | Shooting method and device and electronic equipment | |
| CN112511890A (en) | Video image processing method and device and electronic equipment | |
| CN114638951B (en) | House model display method and device, electronic equipment and readable storage medium | |
| CN112468794B (en) | Image processing method and device, electronic equipment and readable storage medium | |
| CN116506732B (en) | Image snapshot anti-shake method, device and system and computer equipment | |
| CN107742275B (en) | Information processing method and electronic equipment | |
| CN110533760B (en) | Ambient light information determination method, device, electronic equipment and storage medium | |
| US20220270313A1 (en) | Image processing method, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |