WO2020119633A1 - Automatic correction method and system for projected picture - Google Patents

Automatic correction method and system for projected picture Download PDF

Info

Publication number
WO2020119633A1
WO2020119633A1 PCT/CN2019/124013 CN2019124013W WO2020119633A1 WO 2020119633 A1 WO2020119633 A1 WO 2020119633A1 CN 2019124013 W CN2019124013 W CN 2019124013W WO 2020119633 A1 WO2020119633 A1 WO 2020119633A1
Authority
WO
WIPO (PCT)
Prior art keywords
correction
angle
corrected
projection
scale parameter
Prior art date
Application number
PCT/CN2019/124013
Other languages
French (fr)
Chinese (zh)
Inventor
郭海光
程俊
高向阳
Original Assignee
中国科学院深圳先进技术研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国科学院深圳先进技术研究院 filed Critical 中国科学院深圳先进技术研究院
Publication of WO2020119633A1 publication Critical patent/WO2020119633A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor
    • H04N9/3185Geometric adjustment, e.g. keystone or convergence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • H04N9/3173Constructional details thereof wherein the projection device is specially adapted for enhanced portability

Definitions

  • the invention relates to the technical field of projection correction, in particular to a method and system for automatic correction of a projection picture.
  • the mobile projection needs to adjust the relative position of the projection machine and the projection surface each time it is used. Generally, it is necessary to ensure that the projection is centered and perpendicular to the screen to obtain the best projection effect. In some occasions, the conditions cannot be reached, so that the projected picture will be deformed, which will seriously affect the viewing effect.
  • the common adjustment methods currently on the market are mechanical and push-button.
  • the mechanical adjustment method needs to add a correction mechanical structure when designing the optical machine, which increases the design difficulty of the optical machine, and the adjustment range is generally small;
  • the user calls the control software through the buttons on the projection host or the remote control to adjust the deformation of the screen.
  • the adjustment is more difficult, requiring the user to manually adjust while observing the screen, and the operation is cumbersome.
  • the present invention provides a method and system for automatically correcting a projection picture, to solve the existing technical problem of tedious manual operation in the process of projection correction.
  • a method for automatically correcting projection images including:
  • the first angle of the current projection where the first angle includes a depression angle or an elevation angle
  • the first corrected scale parameter is the corrected upper and lower side scale parameters
  • the second corrected scale parameter is the corrected left and right side scale parameters
  • adjusting the projection image includes:
  • the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
  • the lengths of the left and right sides of the shadow picture are corrected according to the short sides of the left and right sides, including:
  • step (3) If the difference between the length of the first side and the short side is less than the first error, the length of the first side is the corrected long side, otherwise, continue to perform step (1).
  • the first angle is obtained based on sensing by the gravity sensing module
  • the lower side of the projection screen is used as a reference to correct the upper side
  • the lower side is corrected based on the upper side of the projection screen.
  • ⁇ 2 is the projection elevation angle
  • u is the upper side to be corrected
  • u1 is the corrected upper side
  • y and v are the left and right sides of the projection screen, respectively.
  • adjusting the projection image according to the first correction scale parameter and/or the second correction scale parameter also includes:
  • the corrected image is adjusted in proportion to the corrected upper or lower side as a reference.
  • An automatic correction system for projection images including:
  • the gravity sensing module obtains the first angle of the current projection, the first angle includes a depression angle or an elevation angle;
  • a first correction module performing correction on the upper side or the lower side of the projection screen based on the first angle to obtain a first correction scale parameter
  • an image capture device to capture the projected picture
  • a second correction module to obtain the length of the left and right sides of the projected picture, and correct the longer side according to the shorter left and right sides to obtain the second correction scale parameter ;
  • the arithmetic control unit adjusts the projected picture according to the first corrected scale parameter and/or the second corrected scale parameter.
  • the first corrected scale parameter is the corrected upper and lower side scale parameters
  • the second corrected scale parameter is the corrected left and right side scale parameters
  • the arithmetic control unit includes:
  • the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
  • the second correction module includes:
  • the second calculation unit obtains the coordinates of the four corner points of the projection screen, and obtains the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
  • a second sub-correction unit setting a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
  • the second determination unit if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2.
  • the second sub-correction unit if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2.
  • the gravity sensing module includes: the first angle is obtained based on sensing by the gravity sensing module;
  • the first correction unit includes: when the first angle is an elevation angle, correct the upper side based on the lower side of the projection screen; when the first angle is a depression angle, use the upper side of the projection screen Use the side as the reference and correct the lower side.
  • ⁇ 2 is the projection elevation angle
  • u is the upper side to be corrected
  • u1 is the corrected upper side
  • y and v are the left and right sides of the projection screen, respectively.
  • the arithmetic control unit includes:
  • the proportional adjustment module adjusts the corrected picture proportionally based on the corrected upper side or lower side according to the projection resolution.
  • the deformation and the pitch deformation and the rotation deformation are generated based on the projected picture
  • two types of modules are specifically designed to respectively handle the picture deformation caused by the pitch and rotation.
  • the first correction module performs pitch correction according to the pitch deformation sensed by the gravity sensor module
  • the second correction module corrects the deformation caused by the rotation, so that the user does not need to manually operate and adaptively adjust the projection screen to make the projection within a certain range Arranged randomly in the system, the system can automatically adjust the picture to keep the effective content rectangular and achieve a better display effect; and use two independent modules to deal with the deformation caused by different reasons, the system reliability is better.
  • FIG. 1 is a structural diagram of an automatic projection correction system according to Embodiment 1 of the present invention.
  • FIG. 2 is three kinds of picture deformation of the projection picture in the first embodiment of the invention.
  • FIG. 3 is a calibration flowchart corresponding to the situation C deformation of the projected picture in the first and second embodiments of the present invention
  • 4-8 are schematic diagrams of the correction process of the C deformation of the projected picture in the first and second embodiments of the present invention.
  • FIG. 1 is a structural diagram of an automatic projection correction system according to Embodiment 1 of the present invention.
  • the projection device is a device that can be connected to a computer and other devices to pass video signals selected by the user
  • the built-in photoelectric conversion unit projects.
  • the projection surface can be any flat surface.
  • projection In use, projection generally encounters three kinds of screen deformation, as shown in Figure 2.
  • the projection is vertical and centered on the projection surface, but the height before and after the projection is different, which will cause the projected picture to become a trapezoid with different widths at the top and bottom;
  • Case B projecting on one side of the projection surface will cause the projected picture to have a trapezoid shape with different widths on the left and right sides;
  • the projection position is random, which may cause deformation on all four sides of the projection screen.
  • the automatic correction system can correct these projection deformations, and obtain a rectangular area with the largest area while keeping the aspect ratio unchanged, so that the projection content can be displayed in the area without deformation.
  • An embodiment of the present invention provides an automatic projection correction system.
  • the automatic projection correction system includes:
  • the gravity sensing module senses the first angle of the current projection, the first angle includes a depression angle or an elevation angle;
  • the module is a MEMS chip with a gyroscope principle.
  • the micromechanical structure inside is a vibrating part.
  • the Coriolis acceleration generated by its rotation is measured to obtain the angular velocity.
  • the direction of gravity is judged by measuring the direction of gravity acceleration. Know the attitude of the projection in space.
  • a first correction module (not shown in the figure), performing the correction of the upper side or the lower side of the projection screen based on the first angle, to obtain a first correction scale parameter;
  • the attitude is a deformation due to the change in pitch angle.
  • the gravity sensor module is installed in the projector. When the projection is tilted up and down, the upper and lower sides (a, b) will not be the same length.
  • the gravity sensor module can obtain the angle between the current projection and the direction of gravity (angle 1 in Figure 2) . First, judge whether the current included angle is depression angle or elevation angle according to the included angle direction, the elevation angle correction side a, and the depression angle correction side b, and then calculate the compensation amount of the correction side from the triangle formula according to the included angle size.
  • the image capture device captures the projected picture
  • the second correction module (not shown in the figure)) obtains the lengths of the left and right sides of the projected picture, based on the shorter left and right sides To calibrate the longer side to obtain the second calibration scale parameter;
  • the image capture device is mainly composed of a camera.
  • the camera must be able to collect high-definition resolution images, and the acquisition frame rate is greater than 24 frames per second, and the exposure can be dynamically adjusted.
  • the angle of view of the camera is larger than the projection angle of the projection device, so that the camera can capture the complete projection picture.
  • the posture is due to the deformation caused by the rotation of the host, and the closed-loop negative feedback method is used here to compensate for the correction.
  • the posture is the deformation caused by the combination of the host’s pitch and rotation, so it can be decomposed into two steps to compensate for the correction.
  • FIG. 4 is a projection picture before correction, and it can be seen that the four sides (x, y, u, v in FIG. 4) have obvious deformation, assuming that the projection resolution is 640x480 , Then the edges x and u are 640, and y and v are 480.
  • the gravity sensing module includes: the first angle is obtained based on sensing by the gravity sensing module;
  • the first correction unit includes: when the first angle is an elevation angle, correct the upper side based on the lower side of the projection screen; when the first angle is a depression angle, use the upper side of the projection screen Use the side as the reference and correct the lower side.
  • the current pitch angle is measured by the gravity sensor module ( ⁇ 2 in Figure 2), and it is determined whether the current is the pitch angle or the elevation angle according to the direction of ⁇ 2, as shown in Figure 2 ⁇ 2 is the elevation angle, when it is the elevation angle Then, based on the side x, the side u is corrected. Find the corrected edge u1 from the trigonometric function.
  • the first corrected proportional parameter is the corrected upper and lower side proportional parameters
  • the proportional parameter can be obtained from the original side length u, which is the first corrected proportional parameter, and substituted into the projection drive control module.
  • the second correction module includes:
  • the second calculation unit obtains the coordinates of the four corner points of the projection screen, and obtains the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
  • a second sub-correction unit setting a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
  • the second determination unit if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2.
  • the second sub-correction unit if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2.
  • the second corrected proportional parameters are the corrected left and right side proportional parameters
  • the projection screen is captured by the image acquisition device. Since the projection screen is brighter than the projection surface, a control algorithm is used to extract the coordinates of the four corner points in the camera acquisition screen, and find the left and right two The length of the side (as shown in Figure 5y1, v1). Compare the two sides to determine which side is long. If the difference is less than the allowable error value ⁇ , then complete the correction. If it is larger, further correction is needed. Here, set ⁇ to 5 pixels. In Figure 5, v1 is longer than y1, and y1 is used as Baseline, correct side v1.
  • the operation control unit includes: driving the projector to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter according to the first correction scale parameter and/or the second correction scale parameter.
  • the arithmetic control unit includes:
  • the proportional adjustment module adjusts the corrected picture proportionally based on the corrected upper side or lower side according to the projection resolution.
  • the final corrected screen shown in FIG. 8 is obtained, and the display ratio of the character pattern is consistent with the source screen.
  • the above correction parameters are saved, and the system acquires the new projection host and the state of the picture through the gravity sensing module and the image acquisition device every 5 seconds. If there is any change, re-enter the calibration operation from the beginning.
  • the projection angle of the projection light machine is different from the field angle of the camera.
  • the field angle is larger than the projection angle of the light machine, so that the complete projection screen can be captured.
  • FIG. 3 is the projection screen before correction, and the obvious deformation on the four sides (x, y, u, v in FIG. 4) can be seen.
  • the projection resolution is 640x480
  • the sides x and u are 640
  • y and v are 480.
  • This embodiment provides a method for automatically correcting a projection image, including:
  • the first angle includes a depression angle or an elevation angle
  • the first corrected scale parameter is the corrected upper and lower side scale parameters
  • the second corrected scale parameter is the corrected left and right side scale parameters
  • adjusting the projection image includes:
  • the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
  • the lengths of the left and right sides of the shadow picture are corrected according to the short sides of the left and right sides, including:
  • step (3) If the difference between the length of the first side and the short side is less than the first error, the length of the first side is the corrected long side, otherwise, continue to perform step (1).
  • the first angle is obtained based on sensing by the gravity sensing module
  • the lower side of the projection screen is used as a reference to correct the upper side
  • the lower side is corrected based on the upper side of the projection screen.
  • ⁇ 2 is the projection elevation angle
  • u is the upper side to be corrected
  • u1 is the corrected upper side
  • y and v are the left and right sides of the projection screen, respectively.
  • adjusting the projection image according to the first correction scale parameter and/or the second correction scale parameter also includes:
  • the corrected image is adjusted in proportion to the corrected upper or lower side as a reference.
  • the current pitch angle (angle 2 in Figure 2) (first angle) is measured by the gravity sensing module, and the current angle of depression or elevation is determined according to the direction of angle 2, as shown in Figure 2 angle 2 is Elevation angle, when it is elevation angle, use side x as the reference, and correct side u. Find the corrected edge u1 from the trigonometric function.
  • the proportional parameter can be obtained from the original side length u, and then substituted into the projection drive control module. After the correction, the corrected figure 5 can be obtained.
  • Step two capture the projected image through the image acquisition device. Since the projected image is brighter than the projection surface, the control algorithm is used to extract the coordinates of the four corner points in the camera acquisition image and find the left and right two The length of the side (as shown in Figure 5y1, v1). Compare the two sides to determine which side is long. If the difference is less than the allowable error value ⁇ , then complete the correction. If it is larger, further correction is needed. Here, set ⁇ to 5 pixels. In Figure 5, v1 is longer than y1, and y1 is used as Baseline, correct side v1.
  • Step 3 After the length difference between the left and right sides is less than the error value, calculate the length of the four sides (x2, y1, u3, v3) in Figure 7 respectively, calculate the aspect ratio, and compare it with the original resolution (640x480) .
  • the reference side x in the above lower side is corrected to x2 as the new reference, and the other three sides are corrected:
  • Step 4 Save the above calibration parameters.
  • the system obtains the new projection host and screen status through the gravity sensor module and the image acquisition device every 5 seconds. If there is no change, no change will be made. If there is any change, re-enter the calibration operation from the first step.
  • the deformation and the pitch deformation and the rotation deformation are generated based on the projected picture
  • two types of modules are specifically designed to deal with the picture deformation caused by the pitch and rotation, respectively.
  • the first correction module performs pitch correction according to the pitch deformation sensed by the gravity sensor module
  • the second correction module corrects the deformation caused by the rotation, so that the user does not need to manually operate and adaptively adjust the projection screen to make the projection within a certain range Arranged randomly in the system, the system can automatically adjust the picture to keep the effective content rectangular and achieve a better display effect; and use two independent modules to deal with the deformation caused by different reasons, the system reliability is better.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module.
  • the above integrated modules may be implemented in the form of hardware or software function modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
  • the embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer usable program code.
  • a computer usable storage media including but not limited to disk storage and optical storage, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Projection Apparatus (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

The present invention provides an automatic correction method and system for a projected picture, belonging to the technical field of projection correction. Said method comprises: acquiring a first angle of a current projection, the first angle comprising a depression angle or an elevation angle; executing correction of an upper side or a lower side of a projected picture on the basis of the first angle, so as to obtain first corrected ratio parameters; and/or capturing a projected picture, acquiring the lengths of left and right sides of the projected picture, correcting the longer side according to the shorter side of the left and right sides, so as to obtain second corrected ratio parameters; and adjusting the projected picture according to the first corrected ratio parameters and/or the second corrected ratio parameters. The present solution adaptively adjusts a projected picture, so that the system can automatically adjust the picture when the projection is randomly placed within a certain range, keep effective content as a rectangle, and achieve a good display effect.

Description

一种投影画面自动校正方法、***Automatic correction method and system for projection picture 技术领域Technical field
本发明涉及投影校正技术领域,尤其涉及一种投影画面自动校正方法、***。The invention relates to the technical field of projection correction, in particular to a method and system for automatic correction of a projection picture.
背景技术Background technique
随着移动便携式投影的发展,近几年来投影进入了人们的普通生活中。传统固定式投影,投影与投射面的相对位置固定,且一般垂直居中,投影画面在投影安装好后即会调整好,后期无需再作调整配置。而便携式投影也正因为携带上的方便,每次使用时,由于摆放位置的不同往往需要先调整设置来校正画面,才能达到最佳显示效果。With the development of mobile portable projection, projection has entered the ordinary life of people in recent years. In the traditional fixed projection, the relative position of the projection and the projection surface is fixed, and it is generally vertically centered. The projection screen will be adjusted after the projection is installed, and no adjustment configuration is required at a later stage. The portable projection is also because of the convenience of carrying. Every time it is used, due to the different placement positions, it is often necessary to adjust the settings to correct the picture in order to achieve the best display effect.
移动式的投影在每次使用时需要调整投影机器与投影面的相对位置,一般需要确保投影与画面居中垂直,才能获得最佳投影效果。在某些场合由于条件限制无法达到,这样投影画面即会产生形变,严重观影效果。The mobile projection needs to adjust the relative position of the projection machine and the projection surface each time it is used. Generally, it is necessary to ensure that the projection is centered and perpendicular to the screen to obtain the best projection effect. In some occasions, the conditions cannot be reached, so that the projected picture will be deformed, which will seriously affect the viewing effect.
目前市面上常见的调整方法有机械式和按键式,其中,机械式调整方式,需要在设计光机时就加入校正机械结构,增加光机的设计难度,而且调整范围一般较小;而按键式调整方式,由用户通过投影主机或遥控器上的按键调用控制软件来调整画面的形变,而对于随意摆放的移动式投影,调整难度加大,需要用户一边观察画面一边手动调整,操作繁琐。The common adjustment methods currently on the market are mechanical and push-button. Among them, the mechanical adjustment method needs to add a correction mechanical structure when designing the optical machine, which increases the design difficulty of the optical machine, and the adjustment range is generally small; In the adjustment method, the user calls the control software through the buttons on the projection host or the remote control to adjust the deformation of the screen. For the mobile projection that is randomly placed, the adjustment is more difficult, requiring the user to manually adjust while observing the screen, and the operation is cumbersome.
发明内容Summary of the invention
有鉴于此,本发明提供了一种投影画面自动校正方法、***,用以解决现有的针对投影校正过程中手动操作繁琐的技术问题。In view of this, the present invention provides a method and system for automatically correcting a projection picture, to solve the existing technical problem of tedious manual operation in the process of projection correction.
本发明的技术方案如下:The technical solution of the present invention is as follows:
一种投影画面自动校正方法,包括:A method for automatically correcting projection images, including:
获取当前投影的第一角度,所述第一角度包括俯角或仰角;Obtain the first angle of the current projection, where the first angle includes a depression angle or an elevation angle;
基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;Performing an upper side or lower side correction of the projection screen based on the first angle to obtain a first correction scale parameter;
和/或,捕捉投影画面;获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;And/or, capture the projected picture; obtain the length of the left and right sides of the projected picture, correct the longer side according to the shorter left and right sides, and obtain the second correction scale parameter;
根据第一校正比例参数和/或第二校正比例参数,调整投影画面。Adjust the projection image according to the first correction scale parameter and/or the second correction scale parameter.
相应的,所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;Correspondingly, the first corrected scale parameter is the corrected upper and lower side scale parameters; the second corrected scale parameter is the corrected left and right side scale parameters;
根据第一校正比例参数和/或第二校正比例参数,调整投影画面包括:According to the first correction scale parameter and/or the second correction scale parameter, adjusting the projection image includes:
根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。According to the first correction scale parameter and/or the second correction scale parameter, the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
相应的,所述影画面的左、右侧边长度,根据左、右侧边中的短侧边来校正长侧边,包括:Correspondingly, the lengths of the left and right sides of the shadow picture are corrected according to the short sides of the left and right sides, including:
(1)获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;(1) Acquire the coordinates of the four corner points of the projection screen, and obtain the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
(2)设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;(2) Set a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
(3)若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行步骤(1)。(3) If the difference between the length of the first side and the short side is less than the first error, the length of the first side is the corrected long side, otherwise, continue to perform step (1).
相应的,所述第一角度基于重力感应模块感测获取;Correspondingly, the first angle is obtained based on sensing by the gravity sensing module;
当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;When the first angle is an elevation angle, the lower side of the projection screen is used as a reference to correct the upper side;
当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。When the first angle is a depression angle, the lower side is corrected based on the upper side of the projection screen.
相应的,当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-ysin∠2-vsin∠2校正上侧边;Correspondingly, when the first angle is an elevation angle, correcting the upper side based on the lower side of the projection screen includes: correcting the upper side based on the formula u1=u-ysin∠2-vsin∠2;
其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。Wherein, ∠2 is the projection elevation angle, u is the upper side to be corrected, u1 is the corrected upper side, and y and v are the left and right sides of the projection screen, respectively.
相应的,根据第一校正比例参数和/或第二校正比例参数,调整投影画面,还包括:Correspondingly, adjusting the projection image according to the first correction scale parameter and/or the second correction scale parameter also includes:
获得一投影分辨率;Obtain a projection resolution;
根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。According to the projection resolution, the corrected image is adjusted in proportion to the corrected upper or lower side as a reference.
一种投影画面自动校正***,包括:An automatic correction system for projection images, including:
重力感应模块,获取当前投影的第一角度,所述第一角度包括俯角或仰角;The gravity sensing module obtains the first angle of the current projection, the first angle includes a depression angle or an elevation angle;
第一校正模块,基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;A first correction module, performing correction on the upper side or the lower side of the projection screen based on the first angle to obtain a first correction scale parameter;
和/或,图像捕捉装置,捕捉投影画面;第二校正模块,获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;And/or, an image capture device to capture the projected picture; a second correction module to obtain the length of the left and right sides of the projected picture, and correct the longer side according to the shorter left and right sides to obtain the second correction scale parameter ;
运算控制单元,根据第一校正比例参数和/或第二校正比例参数,调整投影 画面。The arithmetic control unit adjusts the projected picture according to the first corrected scale parameter and/or the second corrected scale parameter.
相应的,所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;Correspondingly, the first corrected scale parameter is the corrected upper and lower side scale parameters; the second corrected scale parameter is the corrected left and right side scale parameters;
所述运算控制单元包括:The arithmetic control unit includes:
根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。According to the first correction scale parameter and/or the second correction scale parameter, the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
相应的,所述第二校正模块包括:Correspondingly, the second correction module includes:
第二计算单元,获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;The second calculation unit obtains the coordinates of the four corner points of the projection screen, and obtains the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
第二子校正单元,设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;A second sub-correction unit, setting a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
第二判定单元,若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行第二计算单元、第二子校正单元。The second determination unit, if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2. The second sub-correction unit.
相应的,所述重力感应模块,包括:所述第一角度基于重力感应模块感测获取;Correspondingly, the gravity sensing module includes: the first angle is obtained based on sensing by the gravity sensing module;
所述第一校正单元,包括:当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。The first correction unit includes: when the first angle is an elevation angle, correct the upper side based on the lower side of the projection screen; when the first angle is a depression angle, use the upper side of the projection screen Use the side as the reference and correct the lower side.
相应的,所述第一校正单元,当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-ysin∠2-vsin∠2校正上侧边;Correspondingly, the first correction unit, when the first angle is an elevation angle, corrects the upper side based on the lower side of the projection screen, including: based on the formula u1=u-ysin∠2-vsin∠2 Correct the upper side;
其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。Wherein, ∠2 is the projection elevation angle, u is the upper side to be corrected, u1 is the corrected upper side, and y and v are the left and right sides of the projection screen, respectively.
相应的,所述运算控制单元,包括:Correspondingly, the arithmetic control unit includes:
获取模块,获得一投影分辨率;Obtain a module to obtain a projection resolution;
等比例调整模块,根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。The proportional adjustment module adjusts the corrected picture proportionally based on the corrected upper side or lower side according to the projection resolution.
在本发明实施例的方案中,由于基于投影画面产生形变的俯仰形变以及旋转形变,从而针对性设计了采用两种模块分别处理俯仰和旋转导致的画面形变。其中,第一校正模块,根据重力感应模块感测的俯仰形变进行俯仰校正,而第二校 正模块针对旋转导致的形变进行校正,从而无需用户手动操作,自适应调整投影画面,使投影在一定范围内随意摆放,***都可以自动调整画面,使有效内容保持矩形,达到较好显示效果;且采用两个独立模块处理不同的原因产生的形变,***可靠性更好。In the solution of the embodiment of the present invention, since the deformation and the pitch deformation and the rotation deformation are generated based on the projected picture, two types of modules are specifically designed to respectively handle the picture deformation caused by the pitch and rotation. Among them, the first correction module performs pitch correction according to the pitch deformation sensed by the gravity sensor module, and the second correction module corrects the deformation caused by the rotation, so that the user does not need to manually operate and adaptively adjust the projection screen to make the projection within a certain range Arranged randomly in the system, the system can automatically adjust the picture to keep the effective content rectangular and achieve a better display effect; and use two independent modules to deal with the deformation caused by different reasons, the system reliability is better.
附图说明BRIEF DESCRIPTION
图1为本发明实施例一的投影自动校正***结构图;1 is a structural diagram of an automatic projection correction system according to Embodiment 1 of the present invention;
图2为本发明实施例一的投影画面三种画面形变情况;FIG. 2 is three kinds of picture deformation of the projection picture in the first embodiment of the invention;
图3为本发明实施例一、二的投影画面情形C形变所对应的校正流程图;FIG. 3 is a calibration flowchart corresponding to the situation C deformation of the projected picture in the first and second embodiments of the present invention;
图4-8为本发明实施例一、二的投影画面情形C形变校正过程示意图。4-8 are schematic diagrams of the correction process of the C deformation of the projected picture in the first and second embodiments of the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without making creative efforts fall within the protection scope of the present invention.
实施例一Example one
本发明实施例一种投影自动校正***,图1为本发明实施例一的投影自动校正***结构图,实际应用中,投影装置,是一种可以连接计算机等设备,把用户选择的视频信号通过内置的光电转换单元投射出来,本方法中投影面可以是任意的平整平面。An embodiment of the present invention provides an automatic projection correction system. FIG. 1 is a structural diagram of an automatic projection correction system according to Embodiment 1 of the present invention. In practical applications, the projection device is a device that can be connected to a computer and other devices to pass video signals selected by the user The built-in photoelectric conversion unit projects. In this method, the projection surface can be any flat surface.
投影在使用中一般会碰到三种画面形变,如图2所示。In use, projection generally encounters three kinds of screen deformation, as shown in Figure 2.
情形A,投影与投影面垂直且居中,但是投影前后高低不同,会导致投影画面成一个上下边不一样宽的梯形;In case A, the projection is vertical and centered on the projection surface, but the height before and after the projection is different, which will cause the projected picture to become a trapezoid with different widths at the top and bottom;
情形B,投影在投影面的一侧,会导致投影画面成左右侧边不一样宽的梯形;Case B, projecting on one side of the projection surface will cause the projected picture to have a trapezoid shape with different widths on the left and right sides;
情形C,投影位置随意,则可能导致投影画面四边都发生形变。自动校正***可以修正这些投影形变,在保持长宽比不变的前提下求得一个面积最大的矩形区域,使投影内容在该区域内能无形变的显示。In case C, the projection position is random, which may cause deformation on all four sides of the projection screen. The automatic correction system can correct these projection deformations, and obtain a rectangular area with the largest area while keeping the aspect ratio unchanged, so that the projection content can be displayed in the area without deformation.
从空间几何上来说,产生这些形变的主要原因就是投影机在空间上产生了旋转、平移、俯仰等,只要求取出这些参数即可通过公式得出校正方案。In terms of spatial geometry, the main reason for these deformations is that the projector produces rotation, translation, and pitch in space. Only by taking out these parameters, the correction scheme can be obtained by the formula.
本发明实施例一种投影自动校正***,所述投影自动校正***包括:An embodiment of the present invention provides an automatic projection correction system. The automatic projection correction system includes:
重力感应模块,感测当前投影的第一角度,所述第一角度包括俯角或仰角;The gravity sensing module senses the first angle of the current projection, the first angle includes a depression angle or an elevation angle;
实际应用中,该模块是一种陀螺仪原理的MEMS芯片,里面的微机械结构为振动件,测量其旋转产生的科氏加速度来获得角速度,通过测量重力加速度方向来判断重力的方向,从而得知投影在空间中的姿态。In practical applications, the module is a MEMS chip with a gyroscope principle. The micromechanical structure inside is a vibrating part. The Coriolis acceleration generated by its rotation is measured to obtain the angular velocity. The direction of gravity is judged by measuring the direction of gravity acceleration. Know the attitude of the projection in space.
第一校正模块(图中未示出),基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;A first correction module (not shown in the figure), performing the correction of the upper side or the lower side of the projection screen based on the first angle, to obtain a first correction scale parameter;
实际应用中,针对情形A,从姿态上来说是由于俯仰角度变化产生的形变。重力感应模块安装在投影机内,当投影成上下倾斜投影时,上下边(a、b)会不一样长,重力感应模块可以获得当前投影与重力方向的夹角(如图二中角1)。首先根据夹角方向判断当前夹角是俯角还是仰角,仰角修正边a,俯角修正边b,然后再根据夹角大小由三角公式计算出修正边的补偿量。In practical applications, for the situation A, the attitude is a deformation due to the change in pitch angle. The gravity sensor module is installed in the projector. When the projection is tilted up and down, the upper and lower sides (a, b) will not be the same length. The gravity sensor module can obtain the angle between the current projection and the direction of gravity (angle 1 in Figure 2) . First, judge whether the current included angle is depression angle or elevation angle according to the included angle direction, the elevation angle correction side a, and the depression angle correction side b, and then calculate the compensation amount of the correction side from the triangle formula according to the included angle size.
本实施例中,和/或,图像捕捉装置,捕捉投影画面;第二校正模块(图中未示出)),获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;In this embodiment, and/or, the image capture device captures the projected picture; the second correction module (not shown in the figure)) obtains the lengths of the left and right sides of the projected picture, based on the shorter left and right sides To calibrate the longer side to obtain the second calibration scale parameter;
实际应用中,图像捕捉装置,主要由一个摄像头组成。其中摄像头要能采集高清分辨率图像,且采集帧率大于24帧每秒,曝光可以动态调节。摄像头的视场角要大于投影装置的投射角,以便摄像头能捕捉到完整的投影画面。In practical applications, the image capture device is mainly composed of a camera. Among them, the camera must be able to collect high-definition resolution images, and the acquisition frame rate is greater than 24 frames per second, and the exposure can be dynamically adjusted. The angle of view of the camera is larger than the projection angle of the projection device, so that the camera can capture the complete projection picture.
相应的,针对情形B,从姿态上来说是由于主机旋转后产生的形变,这里采用闭环负反馈方式来补偿修正。首先使用图像采集装置抓取投影画面,提取出投影的四个角点,然后计算出两条侧边(c、d)的长度差,如果这个差值大于设定的误差值,则以短边为基础修正较长的边;之后再重复该操作,再次抓取投影画面计算两边长度差进行修正,直到两边长度差在误差范围内后停止调节。Correspondingly, for scenario B, the posture is due to the deformation caused by the rotation of the host, and the closed-loop negative feedback method is used here to compensate for the correction. First use the image acquisition device to capture the projection screen, extract the four corner points of the projection, and then calculate the length difference of the two sides (c, d), if the difference is greater than the set error value, the short side Correct the longer side as a basis; repeat this operation afterwards, grab the projection screen again to calculate the difference in the length of the two sides, and correct it until the length difference between the two sides is within the error range.
相应的,针对情形C,从姿态上来说是主机俯仰和旋转组合后产生的形变,因此可以分解为两步来补偿修正,先使用重力感应模块修正上下边的形变,然后再使用图像采集装置修正两侧边。Correspondingly, in case C, the posture is the deformation caused by the combination of the host’s pitch and rotation, so it can be decomposed into two steps to compensate for the correction. First use the gravity sensor module to correct the upper and lower deformations, and then use the image acquisition device to correct it. On both sides.
进一步,以投影画面情形C形变作为实例阐述本实施例,图4是校正前的投影画面,可以看到四边(图4中x、y、u、v)明显的形变,假设投影分辨率为640x480,则边x、u即为640,y、v为480。Further, the present embodiment will be explained by taking the deformation C of the projection picture as an example. FIG. 4 is a projection picture before correction, and it can be seen that the four sides (x, y, u, v in FIG. 4) have obvious deformation, assuming that the projection resolution is 640x480 , Then the edges x and u are 640, and y and v are 480.
本实施例,所述重力感应模块,包括:所述第一角度基于重力感应模块感测获取;In this embodiment, the gravity sensing module includes: the first angle is obtained based on sensing by the gravity sensing module;
所述第一校正单元,包括:当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;当所述第一角度为俯角时,以投影画面的上侧边为基准, 校正下侧边。The first correction unit includes: when the first angle is an elevation angle, correct the upper side based on the lower side of the projection screen; when the first angle is a depression angle, use the upper side of the projection screen Use the side as the reference and correct the lower side.
相应的,通过重力感应模块测量出当前的俯仰角(图2中的∠2),并根据∠2的方向判断出当前是俯角还是仰角,如图二中∠2即为仰角,当为仰角时则以边x为基准,修正边u。根据三角函数求出修正后的边u1。Correspondingly, the current pitch angle is measured by the gravity sensor module (∠2 in Figure 2), and it is determined whether the current is the pitch angle or the elevation angle according to the direction of ∠2, as shown in Figure 2 ∠2 is the elevation angle, when it is the elevation angle Then, based on the side x, the side u is corrected. Find the corrected edge u1 from the trigonometric function.
u1=u-ysin∠2-vsin∠2u1=u-ysin∠2-vsin∠2
本实施例,所述第一校正比例参数为校正后的上、下侧边比例参数;In this embodiment, the first corrected proportional parameter is the corrected upper and lower side proportional parameters;
上式得出修正后的u1后即可与原边长u求取比例参数,即为第一校正比例参数,代入投影驱动控制模块。After the corrected u1 is obtained by the above formula, the proportional parameter can be obtained from the original side length u, which is the first corrected proportional parameter, and substituted into the projection drive control module.
本实施例,所述第二校正模块包括:In this embodiment, the second correction module includes:
第二计算单元,获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;The second calculation unit obtains the coordinates of the four corner points of the projection screen, and obtains the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
第二子校正单元,设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;A second sub-correction unit, setting a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
第二判定单元,若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行第二计算单元、第二子校正单元。The second determination unit, if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2. The second sub-correction unit.
本实施例,所述第二校正比例参数为校正后的左、右侧边比例参数;In this embodiment, the second corrected proportional parameters are the corrected left and right side proportional parameters;
具体地,如图5所示,通过图像采集装置抓取投影画面,由于投影画面比投影面更亮,采用控制算法提取出四个角点在摄像头采集画面中的坐标,并求出左右两条侧边(如图5y1、v1)长度。比较两边判断出哪条边长,如果差值小于允许的误差值Δ则完成修正,如大于则还需要进一步修正,这里设Δ为5个像素,图5中v1比y1长,则以y1为基准,修正边v1。假设我们采用的修正最小单位为5个像素,则在v1基础上减去5个像素得到v2,然后求取与v1的比例参数,即为第二校正比例参数,代入投影驱动控制模块,得到新的修正画面,如图6所示。Specifically, as shown in FIG. 5, the projection screen is captured by the image acquisition device. Since the projection screen is brighter than the projection surface, a control algorithm is used to extract the coordinates of the four corner points in the camera acquisition screen, and find the left and right two The length of the side (as shown in Figure 5y1, v1). Compare the two sides to determine which side is long. If the difference is less than the allowable error value Δ, then complete the correction. If it is larger, further correction is needed. Here, set Δ to 5 pixels. In Figure 5, v1 is longer than y1, and y1 is used as Baseline, correct side v1. Assuming that the minimum unit of correction we adopt is 5 pixels, then subtract 5 pixels from v1 to get v2, and then calculate the proportional parameter with v1, which is the second corrected proportional parameter, and substitute it into the projection drive control module to get the new The correction screen is shown in Figure 6.
然后,再通过采集装置抓取投影画面,使用上述方法调整边v2。直到左右长短边差值小于误差值Δ即得到图7。Then, grab the projection screen through the collection device, and adjust the side v2 using the above method. Figure 7 is obtained until the difference between the left and right long and short sides is smaller than the error value Δ.
本实施例,所述运算控制单元包括:根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。In this embodiment, the operation control unit includes: driving the projector to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter according to the first correction scale parameter and/or the second correction scale parameter.
本实施例,所述运算控制单元,包括:In this embodiment, the arithmetic control unit includes:
获取模块,获得一投影分辨率;Obtain a module to obtain a projection resolution;
等比例调整模块,根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。The proportional adjustment module adjusts the corrected picture proportionally based on the corrected upper side or lower side according to the projection resolution.
相应的,左右边长差值小于误差值后,分别再次计算图七中四边(x2、y1、u3、v3)长度,计算一下长宽比,与原图分辨率(640x480)所得长宽比比较。以上下边中的基准边x修正后的x2为新基准,修正另外三边:Correspondingly, after the length difference between the left and right sides is less than the error value, calculate the length of the four sides (x2, y1, u3, v3) in Figure 7 respectively, calculate the aspect ratio, and compare it with the original resolution (640x480) . The reference side x in the above lower side is corrected to x2 as the new reference, and the other three sides are corrected:
u4=x2u4=x2
y2=x2×480÷640y2=x2×480÷640
v4=y2v4=y2
得到图8所示最终校正后的画面,使字符图案显示的比例与信号源画面一致。The final corrected screen shown in FIG. 8 is obtained, and the display ratio of the character pattern is consistent with the source screen.
相应的,保存上述校正参数,***每隔5秒通过重力感应模块与图像采集装置获取新的投影主机与画面状态,如无变化则不做变化。如有变化则从重新开始重新进入校正操作。Correspondingly, the above correction parameters are saved, and the system acquires the new projection host and the state of the picture through the gravity sensing module and the image acquisition device every 5 seconds. If there is any change, re-enter the calibration operation from the beginning.
关于进行投影画面图像捕捉的图像捕捉装置,需要满足一个条件。投影光机的投射角和摄像头的视场角大小不一样,选择摄像头时需要视场角大于光机的投射角,这样才可以捕捉到完整的投影画面。Regarding the image capturing device that performs image capturing of the projection screen, one condition needs to be satisfied. The projection angle of the projection light machine is different from the field angle of the camera. When selecting the camera, the field angle is larger than the projection angle of the light machine, so that the complete projection screen can be captured.
实施例二Example 2
本实施例,如图3所示,以投影画面情形C形变作为实例阐述具体实施方案,图4是校正前的投影画面,可以看到四边(图四x、y、u、v)明显的形变,假设投影分辨率为640x480,则边x、u即为640,y、v为480。In this embodiment, as shown in FIG. 3, the specific implementation is described by taking the deformation C of the projection screen as an example. FIG. 4 is the projection screen before correction, and the obvious deformation on the four sides (x, y, u, v in FIG. 4) can be seen. Assuming that the projection resolution is 640x480, the sides x and u are 640, and y and v are 480.
本实施例提供一种投影画面自动校正方法,包括:This embodiment provides a method for automatically correcting a projection image, including:
感测当前投影的第一角度,所述第一角度包括俯角或仰角;Sensing the first angle of the current projection, the first angle includes a depression angle or an elevation angle;
基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;Performing an upper side or lower side correction of the projection screen based on the first angle to obtain a first correction scale parameter;
和/或,捕捉投影画面;获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;And/or, capture the projected picture; obtain the length of the left and right sides of the projected picture, correct the longer side according to the shorter left and right sides, and obtain the second correction scale parameter;
根据第一校正比例参数和/或第二校正比例参数,调整投影画面。Adjust the projection image according to the first correction scale parameter and/or the second correction scale parameter.
相应的,所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;Correspondingly, the first corrected scale parameter is the corrected upper and lower side scale parameters; the second corrected scale parameter is the corrected left and right side scale parameters;
根据第一校正比例参数和/或第二校正比例参数,调整投影画面包括:According to the first correction scale parameter and/or the second correction scale parameter, adjusting the projection image includes:
根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第 一校正比例参数和/或第二校正比例参数的投影画面。Based on the first correction scale parameter and/or the second correction scale parameter, the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
相应的,所述影画面的左、右侧边长度,根据左、右侧边中的短侧边来校正长侧边,包括:Correspondingly, the lengths of the left and right sides of the shadow picture are corrected according to the short sides of the left and right sides, including:
(1)获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;(1) Acquire the coordinates of the four corner points of the projection screen, and obtain the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
(2)设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;(2) Set a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
(3)若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行步骤(1)。(3) If the difference between the length of the first side and the short side is less than the first error, the length of the first side is the corrected long side, otherwise, continue to perform step (1).
相应的,所述第一角度基于重力感应模块感测获取;Correspondingly, the first angle is obtained based on sensing by the gravity sensing module;
当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;When the first angle is an elevation angle, the lower side of the projection screen is used as a reference to correct the upper side;
当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。When the first angle is a depression angle, the lower side is corrected based on the upper side of the projection screen.
相应的,当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-ysin∠2-vsin∠2校正上侧边;Correspondingly, when the first angle is an elevation angle, correcting the upper side based on the lower side of the projection screen includes: correcting the upper side based on the formula u1=u-ysin∠2-vsin∠2;
其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。Wherein, ∠2 is the projection elevation angle, u is the upper side to be corrected, u1 is the corrected upper side, and y and v are the left and right sides of the projection screen, respectively.
相应的,根据第一校正比例参数和/或第二校正比例参数,调整投影画面,还包括:Correspondingly, adjusting the projection image according to the first correction scale parameter and/or the second correction scale parameter also includes:
获得一投影分辨率;Obtain a projection resolution;
根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。According to the projection resolution, the corrected image is adjusted in proportion to the corrected upper or lower side as a reference.
具体的,步骤一,通过重力感应模块测量出当前的俯仰角(图二角2)(第一角度),并根据角2的方向判断出当前是俯角还是仰角,如图二中角2即为仰角,当为仰角时则以边x为基准,修正边u。根据三角函数求出修正后的边u1。Specifically, in step one, the current pitch angle (angle 2 in Figure 2) (first angle) is measured by the gravity sensing module, and the current angle of depression or elevation is determined according to the direction of angle 2, as shown in Figure 2 angle 2 is Elevation angle, when it is elevation angle, use side x as the reference, and correct side u. Find the corrected edge u1 from the trigonometric function.
u1=u-ysin∠2-vsin∠2u1=u-ysin∠2-vsin∠2
上式得出修正后的u1后即可与原边长u求取比例参数后,代入投影驱动控制模块。修正后即可得到修正后的图5。After the modified u1 is obtained by the above formula, the proportional parameter can be obtained from the original side length u, and then substituted into the projection drive control module. After the correction, the corrected figure 5 can be obtained.
步骤二,如图5所示,通过图像采集装置抓取投影画面,由于投影画面比投影面更亮,采用控制算法提取出四个角点在摄像头采集画面中的坐标,并求出左右两条侧边(如图5y1、v1)长度。比较两边判断出哪条边长,如果差值小于允 许的误差值Δ则完成修正,如大于则还需要进一步修正,这里设Δ为5个像素,图5中v1比y1长,则以y1为基准,修正边v1。假设我们采用的修正最小单位为5个像素,则在v1基础上减去5个像素得到v2,然后求取与v1的比例参数,即为第二校正比例参数,代入投影驱动控制模块,得到新的修正画面,如图6所示。Step two, as shown in Figure 5, capture the projected image through the image acquisition device. Since the projected image is brighter than the projection surface, the control algorithm is used to extract the coordinates of the four corner points in the camera acquisition image and find the left and right two The length of the side (as shown in Figure 5y1, v1). Compare the two sides to determine which side is long. If the difference is less than the allowable error value Δ, then complete the correction. If it is larger, further correction is needed. Here, set Δ to 5 pixels. In Figure 5, v1 is longer than y1, and y1 is used as Baseline, correct side v1. Assuming that the minimum unit of correction we adopt is 5 pixels, then subtract 5 pixels from v1 to get v2, and then calculate the proportional parameter with v1, which is the second corrected proportional parameter, and substitute it into the projection drive control module to get the new The correction screen is shown in Figure 6.
然后,再通过采集装置抓取投影画面,使用上述方法调整边v2。直到左右长短边差值小于误差值Δ即得到图7。Then, grab the projection screen through the collection device, and adjust the side v2 using the above method. Figure 7 is obtained until the difference between the left and right long and short sides is smaller than the error value Δ.
步骤三,左右边长差值小于误差值后,分别再次计算图七中四边(x2、y1、u3、v3)长度,计算一下长宽比,与原图分辨率(640x480)所得长宽比比较。以上下边中的基准边x修正后的x2为新基准,修正另外三边:Step 3: After the length difference between the left and right sides is less than the error value, calculate the length of the four sides (x2, y1, u3, v3) in Figure 7 respectively, calculate the aspect ratio, and compare it with the original resolution (640x480) . The reference side x in the above lower side is corrected to x2 as the new reference, and the other three sides are corrected:
u4=x2u4=x2
y2=x2×480÷640y2=x2×480÷640
v4=y2v4=y2
得到图8所示最终校正后的画面。The final corrected picture shown in Fig. 8 is obtained.
步骤四,保存上述校正参数,***每隔5秒通过重力感应模块与图像采集装置获取新的投影主机与画面状态,如无变化则不做变化。如有变化则从步骤一开始重新进入校正操作。Step 4: Save the above calibration parameters. The system obtains the new projection host and screen status through the gravity sensor module and the image acquisition device every 5 seconds. If there is no change, no change will be made. If there is any change, re-enter the calibration operation from the first step.
在本发明上述实施例的方案中,由于基于投影画面产生形变的俯仰形变以及旋转形变,从而针对性设计了采用两种模块分别处理俯仰和旋转导致的画面形变。其中,第一校正模块,根据重力感应模块感测的俯仰形变进行俯仰校正,而第二校正模块针对旋转导致的形变进行校正,从而无需用户手动操作,自适应调整投影画面,使投影在一定范围内随意摆放,***都可以自动调整画面,使有效内容保持矩形,达到较好显示效果;且采用两个独立模块处理不同的原因产生的形变,***可靠性更好。In the solution of the above embodiment of the present invention, since the deformation and the pitch deformation and the rotation deformation are generated based on the projected picture, two types of modules are specifically designed to deal with the picture deformation caused by the pitch and rotation, respectively. Among them, the first correction module performs pitch correction according to the pitch deformation sensed by the gravity sensor module, and the second correction module corrects the deformation caused by the rotation, so that the user does not need to manually operate and adaptively adjust the projection screen to make the projection within a certain range Arranged randomly in the system, the system can automatically adjust the picture to keep the effective content rectangular and achieve a better display effect; and use two independent modules to deal with the deformation caused by different reasons, the system reliability is better.
本领域普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。A person of ordinary skill in the art may understand that all or part of the steps carried in the method of the above embodiments may be completed by instructing relevant hardware through a program, and the program may be stored in a computer-readable storage medium. When the program is executed , Including one of the steps of the method embodiment or a combination thereof.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使 用时,也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module. The above integrated modules may be implemented in the form of hardware or software function modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
本领域内的技术人员应明白,本发明的实施例可提供为方法、***、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer usable program code.
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various modifications and variations to the present invention without departing from the spirit and scope of the present invention. In this way, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and equivalent technologies thereof, the present invention is also intended to include these modifications and variations.

Claims (12)

  1. 一种投影画面自动校正方法,其特征在于,包括:A method for automatically correcting projected pictures, characterized in that it includes:
    获取当前投影的第一角度,所述第一角度包括俯角或仰角;Obtain the first angle of the current projection, where the first angle includes a depression angle or an elevation angle;
    基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;Performing an upper side or lower side correction of the projection screen based on the first angle to obtain a first correction scale parameter;
    和/或,捕捉投影画面,获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;And/or, capture the projected picture, obtain the lengths of the left and right sides of the projected picture, correct the longer side according to the shorter left and right sides, and obtain the second correction scale parameter;
    根据第一校正比例参数和/或第二校正比例参数,调整投影画面。Adjust the projection image according to the first correction scale parameter and/or the second correction scale parameter.
  2. 根据权利要求1所述的投影画面自动校正方法,其特征在于,所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;The automatic projection screen correction method according to claim 1, wherein the first correction scale parameter is a corrected upper and lower side scale parameter; the second correction scale parameter is a corrected left and right Side scale parameter;
    根据第一校正比例参数和/或第二校正比例参数,调整投影画面包括:According to the first correction scale parameter and/or the second correction scale parameter, adjusting the projection image includes:
    根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。According to the first correction scale parameter and/or the second correction scale parameter, the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
  3. 根据权利要求1所述的投影画面自动校正方法,其特征在于,所述影画面的左、右侧边长度,根据左、右侧边中的短侧边来校正长侧边,包括:The method for automatically correcting a projected picture according to claim 1, wherein the lengths of the left and right sides of the picture picture, correcting the long sides according to the short sides of the left and right sides, include:
    (1)获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;(1) Acquire the coordinates of the four corner points of the projection screen, and obtain the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
    (2)设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;(2) Set a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
    (3)若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行步骤(1)。(3) If the difference between the length of the first side and the short side is less than the first error, the length of the first side is the corrected long side, otherwise, continue to perform step (1).
  4. 根据权利要求1所述的投影画面自动校正方法,其特征在于,The automatic correction method of the projected picture according to claim 1, wherein:
    所述第一角度基于重力感应模块感测获取;The first angle is obtained based on sensing by the gravity sensing module;
    当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;When the first angle is an elevation angle, the lower side of the projection screen is used as a reference to correct the upper side;
    当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。When the first angle is a depression angle, the lower side is corrected based on the upper side of the projection screen.
  5. 根据权利要求4所述的投影画面自动校正方法,其特征在于,当所述第 一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-y sin∠2-v sin∠2校正上侧边;The automatic projection screen correction method according to claim 4, wherein when the first angle is an elevation angle, the upper side is corrected based on the lower side of the projection screen, including: based on the formula u1=uysin ∠2-v sin ∠ 2 correct upper side;
    其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。Wherein, ∠2 is the projection elevation angle, u is the upper side to be corrected, u1 is the corrected upper side, and y and v are the left and right sides of the projection screen, respectively.
  6. 根据权利要求1所述的投影画面自动校正方法,其特征在于,根据第一校正比例参数和/或第二校正比例参数,调整投影画面,还包括:The automatic projection screen correction method according to claim 1, wherein adjusting the projection screen according to the first correction scale parameter and/or the second correction scale parameter further comprises:
    获得一投影分辨率;Obtain a projection resolution;
    根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。According to the projection resolution, the corrected image is adjusted in proportion to the corrected upper or lower side as a reference.
  7. 一种投影画面自动校正***,其特征在于,包括:An automatic projection picture correction system, which is characterized by comprising:
    重力感应模块,获取当前投影的第一角度,所述第一角度包括俯角或仰角;The gravity sensing module obtains the first angle of the current projection, the first angle includes a depression angle or an elevation angle;
    第一校正模块,基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;A first correction module, performing correction on the upper side or the lower side of the projection screen based on the first angle to obtain a first correction scale parameter;
    和/或,图像捕捉装置,捕捉投影画面;And/or, an image capture device to capture the projected picture;
    第二校正模块,获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;The second correction module obtains the lengths of the left and right sides of the projected picture, corrects the longer side according to the shorter left and right sides, and obtains the second correction scale parameter;
    运算控制单元,根据第一校正比例参数和/或第二校正比例参数,调整投影画面。The arithmetic control unit adjusts the projected picture according to the first corrected scale parameter and/or the second corrected scale parameter.
  8. 根据权利要求7所述的投影画面自动校正方法,其特征在于,The automatic correction method of the projected picture according to claim 7, characterized in that
    所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;The first corrected scale parameter is a corrected upper and lower side scale parameter; the second corrected scale parameter is a corrected left and right side scale parameter;
    所述运算控制单元包括:The arithmetic control unit includes:
    根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。According to the first correction scale parameter and/or the second correction scale parameter, the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
  9. 根据权利要求7所述的投影画面自动校正方法,其特征在于,所述第二校正模块包括:The automatic correction method of the projected picture according to claim 7, wherein the second correction module comprises:
    第二计算单元,获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;The second calculation unit obtains the coordinates of the four corner points of the projection screen, and obtains the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
    第二子校正单元,设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;A second sub-correction unit, setting a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
    第二判定单元,若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行第二计算单元、第二子校正单元。The second determination unit, if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2. The second sub-correction unit.
  10. 根据权利要求7所述的投影画面自动校正方法,其特征在于,The automatic correction method of the projected picture according to claim 7, characterized in that
    所述重力感应模块,包括:所述第一角度基于重力感应模块感测获取;The gravity sensing module includes: the first angle is obtained based on sensing by the gravity sensing module;
    所述第一校正单元,包括:当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。The first correction unit includes: when the first angle is an elevation angle, correct the upper side based on the lower side of the projection screen; when the first angle is a depression angle, use the upper side of the projection screen Use the side as the reference and correct the lower side.
  11. 根据权利要求10所述的投影画面自动校正方法,其特征在于,所述第一校正单元,当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-y sin∠2-v sin∠2校正上侧边;The automatic projection screen correction method according to claim 10, wherein the first correction unit, when the first angle is an elevation angle, uses the lower side of the projection screen as a reference to correct the upper side, including : Based on the formula u1=uy sin ∠2-v sin ∠2 to correct the upper side;
    其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。Wherein, ∠2 is the projection elevation angle, u is the upper side to be corrected, u1 is the corrected upper side, and y and v are the left and right sides of the projection screen, respectively.
  12. 根据权利要求7所述的投影画面自动校正方法,其特征在于,所述运算控制单元,包括:The method for automatically correcting a projected picture according to claim 7, wherein the arithmetic control unit includes:
    获取模块,获得一投影分辨率;Obtain a module to obtain a projection resolution;
    等比例调整模块,根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。The proportional adjustment module adjusts the corrected picture proportionally based on the corrected upper side or lower side according to the projection resolution.
PCT/CN2019/124013 2018-12-12 2019-12-09 Automatic correction method and system for projected picture WO2020119633A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811516823.4 2018-12-12
CN201811516823.4A CN109688390B (en) 2018-12-12 2018-12-12 Automatic correction method and system for projection picture

Publications (1)

Publication Number Publication Date
WO2020119633A1 true WO2020119633A1 (en) 2020-06-18

Family

ID=66186552

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/124013 WO2020119633A1 (en) 2018-12-12 2019-12-09 Automatic correction method and system for projected picture

Country Status (2)

Country Link
CN (1) CN109688390B (en)
WO (1) WO2020119633A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109688390B (en) * 2018-12-12 2020-11-17 中国科学院深圳先进技术研究院 Automatic correction method and system for projection picture
CN116033131B (en) * 2022-12-29 2024-05-17 深圳创维数字技术有限公司 Image correction method, device, electronic equipment and readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1584729A (en) * 2003-08-22 2005-02-23 日本电气株式会社 Image projection method and device
JP2010050542A (en) * 2008-08-19 2010-03-04 Seiko Epson Corp Projection display apparatus, and display method
CN102271237A (en) * 2011-02-25 2011-12-07 鸿富锦精密工业(深圳)有限公司 Projection device and method thereof for correcting trapezoidal distortion
CN103529624A (en) * 2012-07-04 2014-01-22 昆盈企业股份有限公司 Projector capable of automatically correcting trapezoidal image and trapezoidal image automatic correction method of projector
CN104460197A (en) * 2014-11-25 2015-03-25 深圳先进技术研究院 Projector capable of automatically correcting geometric distortion and correcting method thereof
CN109688390A (en) * 2018-12-12 2019-04-26 中国科学院深圳先进技术研究院 A kind of projected picture auto-correction method, system

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002158946A (en) * 2000-11-20 2002-05-31 Seiko Epson Corp Projector and method for correcting image distortion
JP2005223393A (en) * 2004-02-03 2005-08-18 Casio Comput Co Ltd Projector, projecting method, and projection program
CN102316295A (en) * 2010-07-08 2012-01-11 鸿富锦精密工业(深圳)有限公司 Projector, and correction device and correction method thereof
CN204302650U (en) * 2014-11-25 2015-04-29 深圳先进技术研究院 A kind of projector of automatically calibrating geometric distortion
CN104935850A (en) * 2015-06-25 2015-09-23 苏州市英富美欣科技有限公司 Self-adaptive projector based on image analysis
CN104935852A (en) * 2015-06-25 2015-09-23 苏州市英富美欣科技有限公司 Projection angle regulating method based on image analysis
CN106899837A (en) * 2015-12-17 2017-06-27 西安中兴新软件有限责任公司 The method and system and terminal of a kind of projection modification
CN106550226A (en) * 2016-11-07 2017-03-29 北京小米移动软件有限公司 Projected picture correcting method and device
CN108121232A (en) * 2016-11-28 2018-06-05 英业达科技有限公司 Projection arrangement and projecting method
CN107835399A (en) * 2017-10-31 2018-03-23 潍坊歌尔电子有限公司 The method, apparatus and projector equipment of a kind of projection correction
CN108289208B (en) * 2018-01-24 2020-11-27 歌尔股份有限公司 Automatic correction method and device for projection picture

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1584729A (en) * 2003-08-22 2005-02-23 日本电气株式会社 Image projection method and device
JP2010050542A (en) * 2008-08-19 2010-03-04 Seiko Epson Corp Projection display apparatus, and display method
CN102271237A (en) * 2011-02-25 2011-12-07 鸿富锦精密工业(深圳)有限公司 Projection device and method thereof for correcting trapezoidal distortion
CN103529624A (en) * 2012-07-04 2014-01-22 昆盈企业股份有限公司 Projector capable of automatically correcting trapezoidal image and trapezoidal image automatic correction method of projector
CN104460197A (en) * 2014-11-25 2015-03-25 深圳先进技术研究院 Projector capable of automatically correcting geometric distortion and correcting method thereof
CN109688390A (en) * 2018-12-12 2019-04-26 中国科学院深圳先进技术研究院 A kind of projected picture auto-correction method, system

Also Published As

Publication number Publication date
CN109688390A (en) 2019-04-26
CN109688390B (en) 2020-11-17

Similar Documents

Publication Publication Date Title
CN110099266B (en) Projector picture correction method and device and projector
US8534845B2 (en) Projector and control method
JP5327468B2 (en) Projector, program, information storage medium, and trapezoidal distortion correction method
CN111935465B (en) Projection system, projection device and correction method of display image thereof
JP3731663B2 (en) Image processing system, projector, and image processing method
JP5428600B2 (en) Projector, image projection system, and image projection method
TWI244335B (en) Projector and compensation method for the tilt of projector
KR101428064B1 (en) Image distortion compensation apparatus and method
JP5652596B2 (en) Projector, program, information storage medium, and image projection method
JP2004222153A (en) Image processing system, projector, program, information storage medium and image processing method
WO2020119633A1 (en) Automatic correction method and system for projected picture
JP2004274283A (en) Projection system, projector, image supplying device, and program
JP2005318652A5 (en)
CN106454294A (en) Projector screen correction method and projector
JP2020178248A (en) Projection control device, projection control method, projection system, program, and storage medium
JP6749402B2 (en) Projection-type image display device and method for adjusting projection image
JP4702050B2 (en) Image projection apparatus, projection image correction method and program for image projection apparatus
JP2012199772A (en) Projector and projector installation method
TWI503579B (en) Three-dimensional image apparatus, three-dimensional scanning base thereof, and operation methods thereof
CN112689133B (en) Image correction system and method
JP5664725B2 (en) Projector, image projection system, and image projection method
EP2701387A1 (en) Method for correction of defects in image projection for a handheld projector
TWI745992B (en) Projection apparatus and method for virtual touch control
WO2023071256A1 (en) Laser projection device, and correction method for projected image
JP2012054899A (en) Imaging apparatus and posture detection method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19896988

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03.11.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19896988

Country of ref document: EP

Kind code of ref document: A1