WO2019205744A1 - 图像畸变校正方法及装置、显示设备、计算机可读介质、电子设备 - Google Patents
图像畸变校正方法及装置、显示设备、计算机可读介质、电子设备 Download PDFInfo
- Publication number
- WO2019205744A1 WO2019205744A1 PCT/CN2019/071091 CN2019071091W WO2019205744A1 WO 2019205744 A1 WO2019205744 A1 WO 2019205744A1 CN 2019071091 W CN2019071091 W CN 2019071091W WO 2019205744 A1 WO2019205744 A1 WO 2019205744A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- grid
- adjusted
- correction
- image distortion
- circle
- Prior art date
Links
- 238000012937 correction Methods 0.000 title claims abstract description 188
- 238000000034 method Methods 0.000 title claims abstract description 66
- 238000003384 imaging method Methods 0.000 claims abstract description 32
- 230000003287 optical effect Effects 0.000 claims description 12
- 239000003086 colorant Substances 0.000 claims description 10
- 238000006073 displacement reaction Methods 0.000 claims description 7
- 230000000007 visual effect Effects 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 16
- 238000012545 processing Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 210000001747 pupil Anatomy 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 241000226585 Antennaria plantaginifolia Species 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000006260 foam Substances 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
- G06V10/242—Aligning, centring, orientation detection or correction of the image by image rotation, e.g. by 90 degrees
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20092—Interactive image processing based on input by user
Definitions
- the present disclosure relates to the field of display, and in particular, to an image distortion correction method, an image distortion correction device, a display device, a computer readable medium, and an electronic device.
- Virtual Reality technology is a virtual reality through the computer, projected to the human eye retina through the display screen and visual system, combined with other human sensing input devices to simulate a visual, auditory, tactile and other aspects.
- Realistic virtual world The essence of virtual reality technology is to present a user's perspective as the main body, and can observe objects in the three-dimensional space in real time and without restriction, giving the user an immersive experience.
- Virtual reality technology covers tracking sensing technology, wide-angle stereo display technology, stereo, and tactile feedback. It has been widely used in entertainment, military training, medical training, product 3D virtual display and other fields.
- the present disclosure provides an image distortion correction method and apparatus, a computer readable medium, and an electronic device.
- the correction grid Forming a correction grid on the imaging screen of the display device, the correction grid comprising a plurality of grid points to be adjusted;
- the grid points to be adjusted located on the circle and outside the circle are moved to correct image distortion.
- forming a circle on the correction grid includes:
- the circle is formed by using a distance between a grid point to be adjusted and a distance between the plurality of grid points to be adjusted as a radius.
- forming a correction grid on the imaging screen of the display device includes:
- the initialization grid is imaged by a lens disposed on one side of the display screen to form the correction grid on the imaging screen.
- the display device includes a first lens and a second lens that are symmetrically disposed; forming the correction grid on the imaging screen includes:
- the initialization mesh is imaged by the first lens and the second lens to form a first correction grid and a second correction grid that are symmetric with each other on the imaging screen.
- establishing a two-dimensional coordinate system on the correction grid includes:
- the two-dimensional coordinate system is imaged on the correction grid by the lens.
- moving the to-be-adjusted grid point located on the circle and outside the circle includes:
- the grid points to be adjusted are moved in a direction parallel to the abscissa or ordinate axis of the two-dimensional coordinate system such that the grid lines of the correction grid are straight.
- the grid points to be adjusted are repeatedly adjusted multiple times using different visual parameters, and the final adjustment position is determined based on the results of the multiple adjustments.
- a plurality of sub-correction grids corresponding to different colors are obtained, and the sub-correction grids are respectively adjusted to correct distortion of different colors.
- At least one embodiment of the present disclosure provides an image distortion correcting apparatus, including:
- a correction grid generating module configured to form a correction grid on the imaging screen of the display device, the correction grid comprising a plurality of grid points to be adjusted;
- a coordinate system establishing module for forming a circle on the correction grid
- An image distortion correction module is configured to move the grid points to be adjusted on the circle and outside the circle to correct image distortion.
- the coordinate system establishing module is further configured to:
- the correction module is further configured to: move the centering at an origin of the two-dimensional coordinate system, and use the distance between the grid point to be adjusted and the origin of the plurality of to-be-adjusted network points as a radius
- At least one embodiment of the present disclosure provides a display device including the image distortion correcting device as described above.
- the grid point to be adjusted whose distance from the reference point is greater than and equal to a preset value is moved to correct image distortion.
- moving the to-be-adjusted grid point whose distance from the point is greater than and equal to the first threshold to correct the image distortion further includes:
- the grid to be adjusted whose distance from the point is less than a preset value is kept.
- the grid points to be adjusted that need to be adjusted are selected.
- moving the to-be-adjusted grid point whose distance from the reference point is greater than and equal to the preset value to correct the image distortion further includes:
- At least one embodiment of the present disclosure provides a computer readable medium having stored thereon a computer program, wherein the program is implemented by a processor to implement an image distortion correction method as described above.
- At least one embodiment of the present disclosure provides an electronic device, including:
- One or more processors are One or more processors;
- a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, causing the one or more processors to implement an image distortion correction method as described above .
- FIG. 1 is a flowchart showing an image distortion correction method in an exemplary embodiment of the present disclosure
- FIG. 2 is a schematic structural diagram of a virtual reality device in an exemplary embodiment of the present disclosure
- FIG. 3 illustrates an imaging diagram of a virtual reality device in an exemplary embodiment of the present disclosure
- FIG. 4 is a schematic structural diagram of a correction grid in an exemplary embodiment of the present disclosure.
- FIG. 5 is a schematic structural diagram of a correction grid in an exemplary embodiment of the present disclosure.
- FIG. 6 is a schematic structural view and a partial enlarged view of a correction grid in an exemplary embodiment of the present disclosure
- FIG. 7 illustrates concentric circles including grid points to be adjusted in an exemplary embodiment of the present disclosure
- FIG. 8 illustrates a schematic diagram of moving a grid point to be adjusted in an exemplary embodiment of the present disclosure
- FIG. 9 is a block diagram showing the structure of an image distortion correcting device in an exemplary embodiment of the present disclosure.
- FIG. 10 is a block diagram showing the structure of an image distortion correcting device in an exemplary embodiment of the present disclosure.
- Figure 11 is a block diagram showing the structure of a computer readable medium in an exemplary embodiment of the present disclosure
- FIG. 12 is a block diagram showing the structure of an electronic device in an exemplary embodiment of the present disclosure.
- the virtual reality device In order to give the user a realistic sense of immersion, the virtual reality device should cover the visual range of the human eye as much as possible, usually by setting a large curved spherical display in the virtual reality device or adding a lens in front of the display screen. To get a larger viewing angle, but setting up a spherical display is cumbersome and expensive, so you can add a lens in front of the rectangular display screen, but when you use a lens to project a normal image into the human eye, the observed image is surrounded by distortion distortion. There is no way for the human eye to obtain the position in the virtual space; and the distortion of the lens is inevitable. As the field of view (FOV) increases, the edge image distortion will be more obvious. Due to the presence of distortion, the effect of binocular overlap will be even worse, or even impossible to watch properly.
- FOV field of view
- the present disclosure provides an image distortion correction method, which may include:
- the grid point to be adjusted whose distance from the reference point is greater than and equal to a preset value is moved to correct image distortion.
- the step of moving the mesh point to be adjusted with the distance between the points being greater than and equal to the first threshold to correct the image distortion may further include:
- the grid to be adjusted whose distance from the point is less than a preset value is kept.
- the image distortion correction method described above may further include:
- the grid points to be adjusted that need to be adjusted are selected.
- the moving the mesh point to be adjusted with the distance between the reference point and the reference point being greater than or equal to the preset value to correct the image distortion may further include:
- FIG. 1 is a flow chart showing an image distortion correction method, as shown in FIG. 1, the specific flow is as follows:
- S130 Move the to-be-adjusted grid points on the circle and outside the circle to correct image distortion.
- forming a circle on the correction grid may mean forming a circle of a solid on the grid, or forming a virtual or imaginary circle for use. Determine the grid point to be adjusted that will be adjusted.
- a correction grid is formed on the imaging screen of the display device, the correction grid including a plurality of grid points to be adjusted.
- the display device may be a virtual reality device or an augmented reality device, or may be other large field of view optical display devices.
- a virtual reality device shows a schematic structural view of a virtual reality device 200 including a foam pad 201, a lens 202, an adjustment knob 203, a display screen 204, a circuit board 205, and a housing 206, wherein the lens 202 includes symmetry (eg, relative The first lens and the second lens are disposed symmetrically with respect to a vertical bisector of the user's binocular pupil connection line.
- 3 shows an imaging optical path diagram of a virtual reality device. As shown in FIG.
- the center of the lens 202 is located at half the height of the display screen 204 and coincides with the optical axis of the human eye.
- the display screen 204 is located at the focal length f of the lens 202.
- a virtual image is formed on the imaging screen 207 behind the display screen 204.
- the imaging screen 207 may be a component actually present in the display device, or may not be a component actually present in the display device.
- the imaging screen is only the surface on which the virtual image is located, not in the device. The actual parts that exist.
- the imaging screen may also be a simulation program of the display device or an analog display of the imaging screen in the simulation device, which is not limited in the disclosure.
- optical system parameters of the virtual reality device 200 may first be obtained through lens parameters and structural parameters in the virtual reality device 200.
- the lens parameter may be a parameter such as a focal length, a thickness, and a refractive index of the lens 202.
- the structural parameter may be a parameter of the size, object distance, exit pupil distance, lens center distance, screen spacing, etc. of the display screen 204, and the object distance of the display screen 204 is The distance from the screen 204 to the center of the lens 202 is shown, and the exit pupil distance is the distance from the eye to the center of the lens 202.
- a plurality of initialization grid points may be formed on the display screen 204 according to the relationship between the object height and the image height or the field of view angle, and the initialization grid points are connected to each other. Form an initialization grid.
- the number of initialization grid points in the present disclosure can be set according to actual needs. For example, 65 ⁇ 65 initial grid points can be formed to divide the display screen 204 into 64 ⁇ 64 copies.
- the initialization mesh may be imaged through a lens disposed on one side of the display screen of the display device to form a correction network on the imaging screen.
- FIG. 4 shows a schematic structural diagram of a correction grid.
- the correction grid includes a plurality of grid points to be adjusted, and the image distortion can be corrected by adjusting the position of the grid points to be adjusted.
- image distortion is divided into barrel distortion and pincushion distortion. Among them, barrel distortion is normal image after lens imaging, the image will be away from the center of the image, the shape looks like a wooden barrel; and the pincushion distortion is normal.
- the initialization mesh may be imaged by a first lens and a second lens in the lens 202, forming a first correction grid and a second correction grid on the imaging screen 207. Since the lens imaging causes distortion around the image, the correction grid formed by the lens 202 is distorted, especially the distortion at the edge of the image is the most serious. In order to view the normal image and improve the user experience, the motion correction can be performed. The grid points to be adjusted in the grid to correct the distortion.
- the initialization mesh is imaged on the imaging screen 207 after being imaged by the lens 202.
- the formed first correction grid and the second correction grid are mutually symmetrical.
- the correction grid on the other side can be obtained by mirroring; further, when adjusting the first correction grid
- the displacement amount of the grid point to be adjusted in the first correction grid may be synchronously adjusted to correspond to the grid point to be adjusted in the first correction grid in the second correction grid. The position of the grid point to be adjusted to correct the distortion synchronously.
- forming a circle on the correction grid may include:
- the circle is formed by using a distance between a grid point to be adjusted and a distance between the plurality of grid points to be adjusted as a radius.
- FIG. 5 shows a structural schematic diagram of a correction grid forming a two-dimensional coordinate system.
- the orthographic projection point on the display screen 204 may be centered on the lens 202.
- the origin, the X-axis is formed in the horizontal direction through the origin, and the Y-axis is formed in the vertical direction to form a two-dimensional coordinate system, and the two-dimensional coordinate system can be formed on the correction grid by the lens 202.
- forming a two-dimensional coordinate system along the X-axis and the Y-axis is only a schematic illustration of forming a two-dimensional coordinate system in the present disclosure, and of course, may also have an angle along the X-axis and the Y-axis.
- the direction of the formation forms a two-dimensional coordinate system, which is not specifically limited in the present disclosure.
- the origin of the two-dimensional coordinate system can be adjusted accordingly according to actual needs.
- the origin of the two-dimensional coordinate system may be the position corresponding to the optical center of the lens or the user. The location of the visual center.
- moving the to-be-adjusted grid point located on the circle and outside the circle to correct image distortion may include: moving at a center centered on the two-dimensional coordinate system Correcting image distortion on a circle having a radius of a distance between the plurality of grid points to be adjusted and the origin to be adjusted, and the grid point to be adjusted outside the circle .
- the origin of the two-dimensional coordinate system formed on the display screen 204 may be centered, and the distance from the initial grid point corresponding to the grid point to the origin (center) may be adjusted to be a circle.
- the circle is imaged on the imaging screen by the lens 202; then the grid points to be adjusted located on the circle and outside the circle are adjusted to make the grid lines of the correction grid straight, thereby correcting the distortion of the image.
- FIG. 6 shows a schematic structural view of a correction grid and a partial enlarged view thereof.
- the circle at the intersection of the horizontal and vertical grid lines on the correction grid is To adjust the grid point, point O is the origin of the two-dimensional coordinate system.
- the left and right sides of the correction grid are not symmetric about the Y-axis, and the correction grid corresponding to the right eye, wherein the correction grid area on the left side of the vertical axis of the two-dimensional coordinate system is smaller than the vertical axis.
- the area of the side correspondingly, the correction grid corresponding to the left eye, wherein the area of the correction grid located on the left side of the longitudinal axis of the two-dimensional coordinate system is larger than the area on the right side of the vertical axis, and when the origin is the center of the origin O, the distance from the origin
- the distance from the far-pointed grid point to the origin is the radius to form a circle, since a part of the circle may have exceeded the range of the displayed image, there may be two grid points to be adjusted falling on the circle.
- the other grid point to be adjusted is also adjusted at the same time; when the origin is the center, the distance from the grid point to be adjusted closer to the origin O is the radius to form a circle, A total of four grid points to be adjusted fall on the circle. If one of the grid points to be adjusted is adjusted, the other three grid points to be adjusted are also adjusted. Since the correction grids corresponding to the left and right eyes are symmetrical to each other, when adjusting a grid point to be adjusted, correspondingly four or eight grid points to be adjusted are simultaneously adjusted, that is, when adjusting the correction grid When a certain grid point is to be adjusted, there may be multiple grid points to be adjusted that are simultaneously adjusted.
- the correction grid is an initialization mesh formed on the imaging screen 207 by the lens 202
- grid points corresponding to the grid points to be adjusted in the correction grid can be found in the initialization grid.
- the distance of the grid point in the grid to be adjusted or its corresponding initialization grid to the origin can be calculated and recorded, and then the origin O can be used as the center to record all the waiting
- Adjust the distance from the grid point to the origin as a radius to form a set of concentric circles on the initialization grid, and adjust the points to be adjusted on each circle and outside the circle in a direction away from the center of the circle; or only according to one
- the distance from the grid point to the origin is adjusted to form a circle on the initial grid.
- the next grid point to be adjusted is selected.
- the distance from the next grid point to the origin is the radius to form another radius.
- Circle move the grid points on the circle and outside the circle to correct the distortion.
- FIG. 7 shows a schematic diagram of forming a set of concentric circles on the correction grid.
- FIG. 8 is a schematic view showing movement of a grid point to be adjusted.
- the grid point to be adjusted moves in a direction parallel to the abscissa axis of the two-dimensional coordinate system; as shown in FIGS. 8C-8D.
- the grid point to be adjusted moves in a direction parallel to the ordinate axis of the two-dimensional coordinate system.
- the disclosure adjusts the grid points to be adjusted on the circle and outside the circle in a direction parallel to the abscissa axis or the ordinate axis of the two-dimensional coordinate system, so that the mesh of the grid point to be adjusted in the correction grid is located.
- the grid is straight.
- an external device connected to the virtual reality device 200 through a keyboard, a handle, or the like, or a component disposed in the virtual reality device 200 through an embedded adjustment knob or the like, to be adjusted on a circle and an outer circle
- the grid points are adjusted, and the grid points to be adjusted can be moved in a direction parallel to the abscissa axis of the two-dimensional coordinate system under the control of the adjusting device (component), and repeatedly adjusted until the grid lines on the grid are corrected. Straight. Repeat the above steps until all the adjustments of the grid points to be adjusted are completed. After the adjustment is completed, the adjusted position of the grid points to be adjusted can be saved to avoid distortion when the virtual reality device is used subsequently.
- the adjustment grid points may be sequentially adjusted in a direction away from the origin to correct the distortion. Specifically, when moving the grid point to be adjusted, only the grid points to be adjusted on the circle and outside of the circle are moved relative to the origin under the control of the adjusting device (component), and the grid point to be adjusted whose distance is smaller than the radius of the circle The position of the grid is unchanged (already adjusted), so that during the adjustment process, the points on the grid are divided into points to be adjusted and points that have been adjusted, taking into account the position of the point to be adjusted and the position of the adjusted point. Changes can improve the correction efficiency of distortion.
- the grid points to be adjusted are moved to obtain multiple sets of adjusted grid point positions to be adjusted, and multiple sets of grid points to be adjusted are obtained according to the positions of the grid points to be adjusted and the positions of the grid points to be adjusted before adjustment.
- the displacement amount can be obtained by averaging the plurality of sets of displacements to obtain the final adjustment position of the grid point to be adjusted.
- the method of averaging may be a weighted average, an arithmetic average, or the like, which is not specifically limited in the present disclosure.
- the image distortion correction method of the present disclosure can also be used to correct distortion of different colors.
- the sub-correction grid can be formed on the images of different colors, and then the grid points to be adjusted in the sub-correction grid are adjusted so that the grid lines of the sub-correction grid are straight, thereby realizing distortion of different colors. Correction.
- the image distortion correction method corrects the image distortion on the one hand, and improves the user experience; on the other hand, only the grid points to be adjusted on the circle and the circle outside the adjustment grid point are adjusted to correct the image distortion. , improved calibration efficiency.
- FIG. 9 is a schematic structural diagram of an image distortion correcting apparatus 900.
- the image distortion correcting apparatus 900 includes a corrected mesh generating module 901 and a coordinate system establishing module 902. And an image distortion correction module 903, specifically:
- a correction grid generating module 901 configured to form a correction grid on the imaging screen of the display device, the correction grid comprising a plurality of grid points to be adjusted;
- a coordinate system establishing module 902 configured to form a circle on the correction grid
- the image distortion correction module 903 is configured to move the to-be-adjusted grid points located on the circle and outside the circle to correct image distortion.
- the coordinate system establishing module 902 is further configured to:
- the circle is formed by using a distance between a grid point to be adjusted and a distance between the plurality of grid points to be adjusted as a radius.
- the image distortion correction module 903 is further configured to: move the center point of the two-dimensional coordinate system as a center, and adjust one of the plurality of network points to be adjusted The distance from the origin is the radius of the circle and the outer grid point to be adjusted to correct image distortion.
- FIG. 10 is a schematic structural diagram of an image distortion correcting apparatus 900.
- the image distortion correcting apparatus 900 further includes a color distortion correcting module 904 for acquiring a plurality of corresponding differences.
- a sub-correction grid of colors is adjusted to correct the distortion of the different colors, respectively.
- modules or units of equipment for action execution are mentioned in the detailed description above, such division is not mandatory. Indeed, in accordance with embodiments of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one of the modules or units described above may be further divided into multiple modules or units.
- the exemplary embodiments described herein may be implemented by software or by software in combination with necessary hardware. Therefore, the technical solution according to an embodiment of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network.
- a non-volatile storage medium which may be a CD-ROM, a USB flash drive, a mobile hard disk, etc.
- a number of instructions are included to cause a computing device (which may be a personal computer, server, mobile terminal, or network device, etc.) to perform a method in accordance with an embodiment of the present disclosure.
- an electronic device capable of implementing the above method is also provided.
- FIG. 11 An electronic device 1100 according to an exemplary embodiment of the present disclosure is described below with reference to FIG. 11 is merely an example, and should not impose any limitation on the function and scope of use of the embodiments of the present disclosure.
- electronic device 1100 is embodied in the form of a general purpose computing device.
- the components of the electronic device 1100 may include, but are not limited to, the at least one processing unit 1110, the at least one storage unit 1120, and the bus 1130 that connects different system components (including the storage unit 1120 and the processing unit 1110).
- the storage unit stores program code, which can be executed by the processing unit 1110, such that the processing unit 1110 performs various exemplary embodiments according to the present disclosure described in the "Exemplary Method" section of the present specification.
- the processing unit 1110 may perform S110 as shown in FIG.
- forming a correction grid on the imaging screen of the display device the correction grid including a plurality of grid points to be adjusted
- S120 in the Establishing a two-dimensional coordinate system on the correction grid
- S130 moving is located at a center of the two-dimensional coordinate system, and between one of the plurality of grid points to be adjusted and the origin The distance is on the circle of the radius and the point of the grid to be adjusted outside the circle to correct the image distortion.
- the storage unit 1120 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 11201 and/or a cache storage unit 11202, and may further include a read only storage unit (ROM) 11203.
- RAM random access storage unit
- ROM read only storage unit
- the storage unit 1120 may also include a program/utility 11204 having a set (at least one) of the program modules 11205, such program modules 11205 including but not limited to: an operating system, one or more applications, other program modules, and program data, Implementations of the network environment may be included in each or some of these examples.
- the bus 1130 can be one or more of a number of types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local area using any of a variety of bus structures. bus.
- the electronic device 1100 can also be in communication with one or more external devices 1300 (eg, a keyboard, pointing device, Bluetooth device, etc.), and can also be in communication with one or more devices that enable a user to interact with the electronic device 1100, and/or Any device (eg, router, modem, etc.) that enables the electronic device 1100 to communicate with one or more other computing devices. This communication can take place via an input/output (I/O) interface 1150. Also, the electronic device 1100 can communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) through the network adapter 1160.
- networks eg, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet
- network adapter 1160 communicates with other modules of electronic device 1100 via bus 1130. It should be understood that although not shown in the figures, other hardware and/or software modules may be utilized in conjunction with electronic device 1100, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives. And data backup storage systems, etc.
- the technical solution according to an embodiment of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network.
- a non-volatile storage medium which may be a CD-ROM, a USB flash drive, a mobile hard disk, etc.
- a number of instructions are included to cause a computing device (which may be a personal computer, server, terminal device, or network device, etc.) to perform a method in accordance with an embodiment of the present disclosure.
- a computer readable storage medium having stored thereon a program product capable of implementing the above method of the present specification.
- various aspects of the present disclosure may also be embodied in the form of a program product comprising program code for causing said program product to run on a terminal device The terminal device performs the steps according to various exemplary embodiments of the present disclosure described in the "Exemplary Method" section of the present specification.
- a program product 1200 for implementing the above method which may employ a portable compact disk read only memory (CD-ROM) and includes program code, and may be at a terminal device, according to an embodiment of the present disclosure, is described.
- CD-ROM portable compact disk read only memory
- the program product of the present disclosure is not limited thereto, and in this document, the readable storage medium may be any tangible medium that contains or stores a program that can be used by or in connection with an instruction execution system, apparatus, or device.
- the program product can employ any combination of one or more readable media.
- the readable medium can be a readable signal medium or a readable storage medium.
- the readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (non-exhaustive lists) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
- the computer readable signal medium may include a data signal that is propagated in the baseband or as part of a carrier, carrying readable program code. Such propagated data signals can take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing.
- the readable signal medium can also be any readable medium other than a readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
- Program code embodied on a readable medium can be transmitted using any suitable medium, including but not limited to wireless, wireline, optical cable, RF, etc., or any suitable combination of the foregoing.
- Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language, such as Java, C++, etc., including conventional procedural Programming language—such as the "C" language or a similar programming language.
- the program code can execute entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the remote computing device on the user computing device, or entirely on the remote computing device or server. Execute on.
- the remote computing device can be connected to the user computing device via any kind of network, including a local area network (LAN) or wide area network (WAN), or can be connected to an external computing device (eg, provided using an Internet service) Businesses are connected via the Internet).
- LAN local area network
- WAN wide area network
- an external computing device eg, provided using an Internet service
- Businesses are connected via the Internet.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Geometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
Description
Claims (20)
- 一种图像畸变校正方法,包括:在显示装置的成像屏幕上形成一校正网格,所述校正网格包括多个待调整网格点;在所述校正网格上形成圆;移动位于所述圆上及圆外的所述待调整网格点,以校正图像畸变。
- 根据权利要求1所述的图像畸变校正方法,其中,在所述校正网格上形成圆包括:在所述校正网格上建立二维坐标系;以所述二维坐标系的原点为圆心,以所述多个待调整网格点中的一个待调整网格点与所述原点之间的距离为半径形成所述圆。
- 根据权利要求1或2所述的图像畸变校正方法,其中,在显示装置的成像屏幕上形成一校正网格包括:根据所述显示装置的光学参数在所述显示装置的显示屏幕上形成初始化网格;将所述初始化网格经设置于所述显示屏幕一侧的透镜成像,以在所述成像屏幕上形成所述校正网格。
- 根据权利要求3所述的图像畸变校正方法,其中,所述显示装置包括对称设置的第一透镜和第二透镜;在所述成像屏幕上形成所述校正网格包括:所述初始化网格经所述第一透镜和所述第二透镜成像,以在所述成像屏幕上形成相互对称的第一校正网格和第二校正网格。
- 根据权利要求3所述的图像畸变校正方法,其中,在所述校正网格上建立二维坐标系包括:以所述透镜的中心在所述显示屏幕上的正投影点为原点,沿着水平方向和竖直方向建立二维坐标系;所述二维坐标系经所述透镜成像形成在所述校正网格上。
- 根据权利要求1至5任一所述的图像畸变校正方法,还包括:根据所述校正网格中网格线是否平直,选择需要调整的所述待调整网格点,以对所述需要调整的所述待调整网格点所在圆上及所述圆外的所述待调 整网格点进行调整。
- 根据权利要求1至6任一所述的图像畸变校正方法,其中,移动位于所述圆上及所述圆外的所述待调整网格点包括:沿着与所述二维坐标系的横坐标轴或纵坐标轴平行的方向移动所述待调整网格点,以使所述校正网格的网格线平直。
- 根据权利要求7所述的图像畸变校正方法,其中,移动所述待调整网格点时,位于所述圆上和所述圆外的所有网格点同时靠近或远离所述圆心。
- 根据权利要求4所述的图像畸变校正方法,还包括:调整所述第一校正网格中的待调整网格点;根据所述第一校正网格中待调整网格点的位移量,同步调整所述第二校正网格中与所述第一校正网格中待调整网格点对应的待调整网格点的位置。
- 根据权利要求1至9任一所述的图像畸变校正方法,还包括:使用不同的视觉参数重复多次调整所述待调整网格点,并基于多次调整的结果确定最终的调整位置。
- 根据权利要求1至10任一所述的图像畸变校正方法,还包括:获取多个对应不同颜色的子校正网格,分别对所述子校正网格进行调整以校正不同颜色的畸变。
- 一种图像畸变校正装置,包括:校正网格生成模块,用于在显示装置的成像屏幕上形成一校正网格,所述校正网格包括多个待调整网格点;坐标系建立模块,用于在所述校正网格上形成圆;图像畸变校正模块,用于移动所述圆上及所述圆外的所述待调整网格点,以校正图像畸变。
- 根据权利要求12所述的图像畸变校正装置,其中,所述坐标系建立模块还用于:在所述校正网格上建立二维坐标系;以所述二维坐标系的原点为圆心,以所述多个待调整网格点中的一个待调整网格点与所述原点之间的距离为半径形成所述圆,以及所述图像畸变校正模块还用于:移动位于以所述二维坐标系的原点为圆心,以所述多个待调整网络点中的一个待调整网格点与所述原点之间的距离 为半径的所述圆上及所述圆外的所述待调整网格点,以校正图像畸变。
- 一种显示设备,包括如权利要求12或13所述的图像畸变校正装置。
- 一种图像畸变校正方法,包括:获取与初始化网格对应的校正网格,所述校正网格包括多个待调整网格点;在所述校正网格所在面上确定参考点;以及移动与所述参考点之间距离大于和等于预设值的待调整网格点,以校正图像畸变。
- 根据权利要求15所述的图像畸变校正方法,其中,移动与所述点之间距离大于和等于第一阈值的待调整网格点,以校正图像畸变还包括:保持与所述点之间距离小于预设值的待调整网格点不动。
- 根据权利要求15或16所述的图像畸变校正方法,还包括:根据所述校正网格中网格线是否平直,选择需要调整的所述待调整网格点。
- 根据权利要求15-17中任一项所述的图像畸变校正方法,其中,移动与所述参考点之间距离大于和等于预设值的待调整网格点,以校正图像畸变还包括:移动与所述参考点之间距离大于和等于预设值的待调整网格点,以使得被移动的所述待调整网格点所在的网格线平直。
- 一种计算机可读介质,其上存储有计算机程序,所述程序被处理器执行时实现如权利要求1至11和权利要求15-18中任一项所述的图像畸变校正方法。
- 一种电子设备,包括:一个或多个处理器;存储装置,用于存储一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现如权利要求1至11和权利要求15-18中任一项所述的图像畸变校正方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/473,110 US11423518B2 (en) | 2018-04-28 | 2019-01-10 | Method and device of correcting image distortion, display device, computer readable medium, electronic device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810403187.8 | 2018-04-28 | ||
CN201810403187.8A CN108596854B (zh) | 2018-04-28 | 2018-04-28 | 图像畸变校正方法及装置、计算机可读介质、电子设备 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019205744A1 true WO2019205744A1 (zh) | 2019-10-31 |
Family
ID=63620099
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/071091 WO2019205744A1 (zh) | 2018-04-28 | 2019-01-10 | 图像畸变校正方法及装置、显示设备、计算机可读介质、电子设备 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11423518B2 (zh) |
CN (1) | CN108596854B (zh) |
WO (1) | WO2019205744A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111369441A (zh) * | 2020-03-09 | 2020-07-03 | 稿定(厦门)科技有限公司 | 文字处理方法、介质、设备及装置 |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108596854B (zh) * | 2018-04-28 | 2021-02-12 | 京东方科技集团股份有限公司 | 图像畸变校正方法及装置、计算机可读介质、电子设备 |
CN109754380B (zh) * | 2019-01-02 | 2021-02-02 | 京东方科技集团股份有限公司 | 一种图像处理方法及图像处理装置、显示装置 |
CN109769112B (zh) * | 2019-01-07 | 2021-04-09 | 上海临奇智能科技有限公司 | 具有多种屏幕效果的虚拟屏幕一体机的组装设置方法 |
CN110473159B (zh) * | 2019-08-20 | 2022-06-10 | Oppo广东移动通信有限公司 | 图像处理方法和装置、电子设备、计算机可读存储介质 |
CN110475110A (zh) * | 2019-09-25 | 2019-11-19 | 上海迪东实业有限公司 | 投影图像几何校正方法、投影图像几何校正设备及投影仪 |
CN111539898B (zh) * | 2020-05-09 | 2023-08-01 | 京东方科技集团股份有限公司 | 图像处理方法及图像显示装置 |
CN111861932B (zh) * | 2020-07-28 | 2022-05-17 | RealMe重庆移动通信有限公司 | 图像的畸变校正方法、装置及移动终端 |
CN112883963B (zh) * | 2021-02-01 | 2022-02-01 | 合肥联宝信息技术有限公司 | 一种定位校正方法、设备及计算机可读存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170336641A1 (en) * | 2017-08-07 | 2017-11-23 | Maximilian Ralph Peter von und zu Liechtenstein | Apparatus und Method for Rendering a Virtual Monitor on Smart Ophthalmic Devices in Augmented Reality Environments |
CN107432750A (zh) * | 2017-07-31 | 2017-12-05 | 上海联影医疗科技有限公司 | 校正成像***的方法和*** |
CN107610044A (zh) * | 2017-08-29 | 2018-01-19 | 歌尔科技有限公司 | 图像处理方法、计算机可读存储介质及虚拟现实头戴设备 |
CN107850777A (zh) * | 2015-04-22 | 2018-03-27 | 易赛特股份有限公司 | 光学相差校正的方法和装置 |
CN108596854A (zh) * | 2018-04-28 | 2018-09-28 | 京东方科技集团股份有限公司 | 图像畸变校正方法及装置、计算机可读介质、电子设备 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08256295A (ja) * | 1994-12-21 | 1996-10-01 | Olympus Optical Co Ltd | 画像処理装置 |
US6538691B1 (en) * | 1999-01-21 | 2003-03-25 | Intel Corporation | Software correction of image distortion in digital cameras |
JP2005151317A (ja) * | 2003-11-18 | 2005-06-09 | Tamron Co Ltd | 歪曲収差変更撮影装置 |
JP2006010613A (ja) * | 2004-06-29 | 2006-01-12 | Medeikku Engineering:Kk | 画像の歪み補正方法 |
JP2006292453A (ja) * | 2005-04-07 | 2006-10-26 | Matsushita Electric Ind Co Ltd | 画像認識方法 |
US7881563B2 (en) * | 2006-02-15 | 2011-02-01 | Nokia Corporation | Distortion correction of images using hybrid interpolation technique |
CN103530852A (zh) * | 2013-10-15 | 2014-01-22 | 南京芒冠光电科技股份有限公司 | 一种镜头畸变校正方法 |
WO2019049331A1 (ja) * | 2017-09-08 | 2019-03-14 | 株式会社ソニー・インタラクティブエンタテインメント | キャリブレーション装置、キャリブレーションシステム、およびキャリブレーション方法 |
CN107942514A (zh) * | 2017-11-15 | 2018-04-20 | 青岛海信电器股份有限公司 | 一种虚拟现实设备的图像畸变校正方法及装置 |
US10477186B2 (en) * | 2018-01-17 | 2019-11-12 | Nextvr Inc. | Methods and apparatus for calibrating and/or adjusting the arrangement of cameras in a camera pair |
-
2018
- 2018-04-28 CN CN201810403187.8A patent/CN108596854B/zh active Active
-
2019
- 2019-01-10 WO PCT/CN2019/071091 patent/WO2019205744A1/zh active Application Filing
- 2019-01-10 US US16/473,110 patent/US11423518B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107850777A (zh) * | 2015-04-22 | 2018-03-27 | 易赛特股份有限公司 | 光学相差校正的方法和装置 |
CN107432750A (zh) * | 2017-07-31 | 2017-12-05 | 上海联影医疗科技有限公司 | 校正成像***的方法和*** |
US20170336641A1 (en) * | 2017-08-07 | 2017-11-23 | Maximilian Ralph Peter von und zu Liechtenstein | Apparatus und Method for Rendering a Virtual Monitor on Smart Ophthalmic Devices in Augmented Reality Environments |
CN107610044A (zh) * | 2017-08-29 | 2018-01-19 | 歌尔科技有限公司 | 图像处理方法、计算机可读存储介质及虚拟现实头戴设备 |
CN108596854A (zh) * | 2018-04-28 | 2018-09-28 | 京东方科技集团股份有限公司 | 图像畸变校正方法及装置、计算机可读介质、电子设备 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111369441A (zh) * | 2020-03-09 | 2020-07-03 | 稿定(厦门)科技有限公司 | 文字处理方法、介质、设备及装置 |
CN111369441B (zh) * | 2020-03-09 | 2022-11-15 | 稿定(厦门)科技有限公司 | 文字处理方法、介质、设备及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN108596854B (zh) | 2021-02-12 |
US11423518B2 (en) | 2022-08-23 |
US20210358093A1 (en) | 2021-11-18 |
CN108596854A (zh) | 2018-09-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019205744A1 (zh) | 图像畸变校正方法及装置、显示设备、计算机可读介质、电子设备 | |
US9544706B1 (en) | Customized head-related transfer functions | |
US11340695B2 (en) | Converting a 2D positional input into a 3D point in space | |
JP2021508426A (ja) | 双方向性拡張または仮想現実装置 | |
JP2017531222A (ja) | ホログラフィックオブジェクトのためのスマート透明度 | |
CN110447224B (zh) | 在显示器中控制虚像的方法 | |
JP2018523326A (ja) | 全球状取込方法 | |
CN110506419B (zh) | 在虚拟现实中渲染扩展视频 | |
WO2018086295A1 (zh) | 一种应用界面显示方法及装置 | |
KR101788452B1 (ko) | 시선 인식을 이용하는 콘텐츠 재생 장치 및 방법 | |
WO2018064213A1 (en) | Systems and methods for using sensing of real object position, trajectory, or attitude to enable user interaction with a virtual object | |
Peterson | Virtual Reality, Augmented Reality, and Mixed Reality Definitions | |
US10897570B1 (en) | Room acoustic matching using sensors on headset | |
WO2020255766A1 (ja) | 情報処理装置、情報処理方法、プログラム、投映装置、および情報処理システム | |
JP2024069464A (ja) | 反響利得正規化 | |
CN110286906B (zh) | 用户界面显示方法、装置、存储介质与移动终端 | |
WO2021041428A1 (en) | Method and device for sketch-based placement of virtual objects | |
CN110968248A (zh) | 生成用于视觉触摸检测的指尖的3d模型 | |
WO2019130141A1 (en) | Audio copy-paste function | |
CN112262373B (zh) | 基于视图的断点 | |
JP2023514571A (ja) | 遅延オーディオ追従 | |
US11205307B2 (en) | Rendering a message within a volumetric space | |
US11763517B1 (en) | Method and device for visualizing sensory perception | |
US11281351B2 (en) | Selecting objects within a three-dimensional point cloud environment | |
KR20210062962A (ko) | 동공 추적 기반 가상 콘텐츠 표시 장치 및 그 제어 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19793646 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19793646 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12.05.2021) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19793646 Country of ref document: EP Kind code of ref document: A1 |