CN113141492A

CN113141492A - Wide-screen projection method and system based on camera and readable storage medium

Info

Publication number: CN113141492A
Application number: CN202110337678.9A
Authority: CN
Inventors: 李志�; 金凌琳; 林绵发
Original assignee: Shenzhen Dangzhi Technology Co ltd
Current assignee: Shenzhen Dangzhi Technology Co ltd
Priority date: 2020-11-27
Filing date: 2020-11-27
Publication date: 2021-07-20
Anticipated expiration: 2040-11-27
Also published as: CN112203069A; CN112203069B; CN113141492B

Abstract

The application discloses a wide-screen projection method, a wide-screen projection system and a computer readable storage medium based on a camera, wherein the method comprises the steps of detecting whether connecting lines of two optical machines are parallel to a projection plane in the shooting direction of the camera or not when the optical machines are detected to be electrified; if the connecting line is parallel to the projection plane, controlling the two optical machines to project and splice the calibration images to the projection plane in the shooting direction of the camera; shooting an acquired image of the spliced calibration image based on the camera, and determining the position relationship of the two spliced calibration images; adjusting the projection angles of the two optical machines based on the position relation of the spliced calibration images dynamically acquired by the camera until the two spliced calibration images are adjacent and the two opposite longitudinal boundaries are overlapped; and performing trapezoidal correction on the two optical machines, and controlling the two optical machines to project images to be displayed respectively to the projection surface. The problem that the upper and lower black borders of projection are large and the projection area of the actual display image is small is avoided, and the integral effect of an effective projection picture of the wide-screen projection system is improved.

Description

Wide-screen projection method and system based on camera and readable storage medium

Technical Field

The present application relates to the field of projection display technologies, and in particular, to a wide-screen projection method and system based on a camera, and a computer-readable storage medium.

Background

With the development of science and technology, projection equipment is increasingly popularized in offices, multifunctional meeting rooms and home theaters, at present, projection equipment or a projection system generally uses a single optical machine to output a single optical path for projection, and in the projection direction, the projection area is limited by the projection distance, the physical imaging characteristics of the optical machine, trapezoidal correction of images and the like.

When the projection apparatus or the projection system is in side projection, the actually displayed projection image is scaled down and corrected due to the effect of the image trapezoidal correction factor, so that the appearance is impaired, and the larger the side projection angle is, the smaller the projection area of the actually displayed image is. Particularly, when the projection displays a large-width image, the actual display projection picture can only be scaled down under the condition of keeping a high width and a high proportion, which is reflected in that the upper black edge and the lower black edge of the projection are very large, the projection area of the actual display image is small, and the overall effect of the effective projection picture is poor.

The above is only for the purpose of assisting understanding of the technical solutions of the present application, and does not represent an admission that the above is prior art.

Disclosure of Invention

The embodiment of the application mainly aims to provide a wide-screen projection method and system based on a camera and a computer readable storage medium, and aims to solve the technical problems that the actual display image projection area of conventional projection equipment or systems is small, and the overall effect of effective projection pictures is poor.

In order to achieve the above object, the present application provides a camera-based wide-screen projection method, which is applied to a wide-screen projection system, the wide-screen projection system includes two optical machines and a camera,

the wide-screen projection method based on the camera comprises the following steps:

when the optical machines are detected to be electrified, whether a connecting line of the two optical machines is parallel to a projection plane in the shooting direction of the camera is detected;

if the connecting line is parallel to the projection plane, controlling the two optical machines to project and splice the calibration images to the projection plane in the shooting direction of the camera;

shooting an acquired image of the spliced calibration image based on the camera, and determining the position relationship of the two spliced calibration images;

adjusting the projection angles of the two optical machines based on the position relation of the splicing calibration images dynamically acquired by the camera until the two splicing calibration images are overlapped relative to the two longitudinal boundaries;

and performing trapezoidal correction on the two optical machines, and controlling the two optical machines to project images to be displayed respectively to the projection surface.

Optionally, after the step of detecting whether the connection line of the two optical machines is parallel to the projection plane in the shooting direction of the camera, the method further includes:

if the connecting line is not parallel to the projection plane, judging that the projection plane is inclined, and guiding a user to adjust the position of the projection plane or adjust the position of the projector through an interface;

if the user selects to adjust the position of the projection surface, the step of detecting whether the connecting line of the two optical machines is parallel to the projection surface in the shooting direction of the camera is executed after the user finishes the adjustment;

if the user selects the projector to adjust by itself, the horizontal rotating shaft bearing the two optical machines below the base is controlled to rotate and adjust in the left-right direction until the connecting line of the two optical machines is parallel to the projection plane.

Optionally, install a distance sensor between two ray apparatus lines, use distance sensor to detect the ray apparatus and the distance between a plurality of different points of plane of projection, the step of detecting whether the plane of projection on line and the camera shooting direction of two ray apparatus is parallel includes:

selecting four points with equal distances from the center of the distance sensor to the projection point of the projection plane as distance measurement points;

based on the distance sensor, acquiring a first distance, a second distance, a third distance and a fourth distance from the distance sensor to each distance measurement point of the projection plane;

if the four distances are equal, the connecting line of the two optical machines is judged to be parallel to the projection plane; if the four distances are unequal, the connecting line of the two optical machines is not parallel to the projection plane.

Optionally, the step of adjusting the projection angles of the two optical machines based on the positional relationship of the stitching calibration images dynamically acquired by the camera until the two stitching calibration images coincide with the two longitudinal boundaries includes:

carrying out characteristic analysis on collected images of spliced calibration images shot by a camera, and detecting whether an overlapping area exists between the two spliced calibration images;

if the two spliced calibration images have an overlapping area, the position relation is intersection; if the two spliced calibration images do not have an overlapping area, the position relation is a phase separation;

if the position relations are separated, the included angle of the light emitting directions of the two optical machines is reduced; if the position relations are intersected, the included angle of the light emitting directions of the two optical machines is increased;

in the process of adjusting the included angle, whether the two longitudinal boundaries of the spliced calibration image are overlapped or not is judged based on an edge recognition algorithm; and if the two longitudinal boundaries are overlapped, judging that the two spliced calibration images are spliced seamlessly, and stopping the rotation of the two optical machines.

Optionally, the wide-screen projection system further comprises a focusing motor, the focusing motor is disposed at the lens of the optical engine,

before the step of controlling the projection surfaces of the two optical machines to project and splice the calibration images to the camera shooting direction respectively, the method further comprises the following steps:

controlling the two optical machines to project a focal length calibration image to the projection surface;

and controlling a focusing motor to adjust the focal lengths of the two optical machines based on the definition of a focal length calibration image dynamically acquired by the camera until the definition reaches a preset definition threshold value.

Optionally, the camera-based widescreen projection method further includes: after the splicing calibration images are detected to be overlapped relative to the two longitudinal boundaries, the camera collects the two spliced calibration images after being combined again, and then the number of transverse pixels and the number of longitudinal pixels of the overall image after the two spliced calibration images are seamlessly spliced are detected;

calculating and acquiring the approximate resolution of the overall image relative to the actual resolution according to the number of the transverse pixels and the number of the longitudinal pixels;

comparing the approximate resolution with a preset resolution of the two optical machine projection images;

if the difference between the approximate resolution and the preset resolution is within a threshold value, outputting a complete prompt of the wide-screen projection;

if the difference between the approximate resolution and the preset resolution exceeds a threshold value, prompting a user to adjust the position of the projector or the position of the projection surface through a voice or projection interface and then carrying out splicing calibration again until the difference between the approximate resolution and the preset resolution is within the threshold value.

Optionally, the camera-based widescreen projection method further includes:

when the optical machine is detected to be powered on, if a wide-screen projection cancelling instruction is detected, detecting the current projection brightness requirement of the wide-screen projection system;

if the current projection brightness requirement is larger than or equal to a preset brightness threshold value, controlling the two optical machines to project splicing calibration images to the area, perpendicular to the projection surface, in the shooting direction of the camera until the two splicing calibration images are completely overlapped;

and performing trapezoidal correction on the two optical machines, and controlling the two optical machines to project the image to be displayed on the projection surface.

Optionally, the camera-based widescreen projection method further includes:

after detecting that the optical machine projects the images to be displayed on the projection surface, detecting the similarity between the images to be displayed projected by the optical machine, and counting the duration of the similarity which is greater than or equal to a preset similarity threshold;

if the duration is longer than the preset unit duration, outputting a prompt of whether to shut down by the wide-screen projection system, and if the preset waiting duration after outputting the prompt of whether to shut down is not responded by the user, automatically shutting down the optical machine;

if a shutdown instruction determined by a user or a shutdown instruction determined not to be performed is received, executing according to the user instruction;

and if the similarity is smaller than the preset similarity threshold, clearing the duration of which the current statistical similarity is greater than or equal to the preset similarity threshold so as to carry out statistics again.

In order to achieve the above object, the present application further provides a wide-screen projection system, where the wide-screen projection system includes two optical machines, a camera, a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where distance sensors are respectively disposed at installation positions of the optical machines and the camera, and the computer program is executed by the processor to implement the steps of the camera-based wide-screen projection method.

To achieve the above object, the present application further provides a readable storage medium, which stores a computer program, and the computer program, when executed by a processor, implements the steps of the above-mentioned camera-based widescreen projection method.

In the embodiment of the application, wide-screen projection is realized by arranging two optical machines, a distance sensor is used for detecting and judging that two optical machine connecting lines are parallel to a projection plane, the shooting direction of a camera is vertical to the projection plane, the camera is positioned at the midpoint of the two optical machine connecting lines, the two optical machines are controlled to respectively project splicing calibration images to the projection plane, and the splicing calibration images are dynamically collected based on the position relation of the splicing calibration images collected by the camera, at the moment, the camera is vertical to the projection plane and positioned at the midpoint between the two optical machines, the splicing calibration images collected by the camera have smaller distortion or offset degree, and then the projection angles of the optical machines are adjusted according to the position relation until the two splicing calibration images are spliced seamlessly; and finally, trapezoidal correction is carried out on the two optical machines, the two optical machines are controlled to project the image to be displayed on the projection surface, so that the two optical machines jointly output the projection picture output by the single optical machine in the conventional scheme, the widths of the projection pictures output by the two optical machines are shortened, even if the projection picture with the shortened single width is reduced through trapezoidal correction under the condition that the optical machines are in side projection, or in wide-screen display, in order to keep the equal-ratio reduction of the high-width proportion, the two reduction processes share the influence of the equal-ratio reduction by the projection pictures of the two optical machines, so that the amplitude of the equal-ratio reduction of the actual projection picture is greatly reduced, the problems that the upper and lower black edges of the projection are large and the projection area of the actual display image is small are solved, and the integral effect of the effective projection picture of the wide-screen projection system is improved.

Drawings

FIG. 1 is a schematic view of a wide-screen projection system according to the present application;

FIG. 2 is a schematic view of another embodiment of a wide screen projection system according to the present invention;

FIG. 3 is a schematic view of the orientation and reference line layout of an embodiment of a projection screen in a widescreen projection system according to the present application;

fig. 4 is a schematic flowchart of an embodiment of a wide-screen projection method based on a camera according to the present application;

FIG. 5 is a schematic view of a distance measurement scene between a projection plane and a distance sensor according to the present application;

FIG. 6 is a schematic view of a scene of longitudinal alignment in the size correction of the stitching calibration image according to the present application;

fig. 7 is a schematic view of a scene of lateral alignment in the size correction of the stitching calibration image in the present application.

The reference numbers illustrate:

the implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that all the directional indications (such as up, down, left, right, front, and rear … …) in the embodiment of the present application are only used to explain the relative position relationship between the components, the movement situation, and the like in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indication is changed accordingly.

In this application, unless expressly stated or limited otherwise, the terms "connected," "secured," and the like are to be construed broadly, and for example, "secured" may be a fixed connection, a removable connection, or an integral part; can be mechanically or electrically connected; they may be directly connected or indirectly connected through intervening media, or they may be connected internally or in any other suitable relationship, unless expressly stated otherwise. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.

In addition, descriptions in this application as to "first", "second", etc. are for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicit to the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present application.

In an embodiment of the present application, referring to fig. 1 and 2, a wide-screen projection system includes: the optical machine comprises two optical machines 1, a camera 2, a circuit board 3 and a base 4, wherein the optical machines 1 are arranged on the base 4 at intervals, a driving assembly for driving the optical machines 1 to rotate is arranged on the base 4, the camera 2 is arranged on the base 4 between the two optical machines 1, the arrangement positions of the camera 2 are arranged on the middle point of the connecting line of the arrangement positions of the two optical machines 1, the camera 2 is used for collecting various calibration images output by the optical machines 1, and the calibration images comprise splicing calibration images and focal length calibration images; the models of the two optical machines 1 are generally the same, that is, the projection optical parameters of the two optical machines 1 are basically the same, the base 4 mainly plays a role in installation and support, the optical machines 1 are movably installed on the base 4 at intervals, the optical machines 1 are driven by the driving assembly to rotate on the plane where the base 4 is located, the light emitting direction of the optical machines 1 is adjusted, and therefore the projection area position of the optical machines 1 on the projection screen 8 is adjusted. The camera 2 is mainly used for collecting image content projected to the projection screen 8 by the optical machine 1, the image content may be a calibration image for projection calibration of the optical machine 1, or a projection picture generated by cutting a to-be-displayed image projected by the optical machine 1, generally speaking, in order to facilitate the camera 2 to accurately collect the image content, the camera 2 is arranged on the base 4 between the two optical machines 1 and is positioned at a midpoint between the two optical machines 1, thereby reducing horizontal deviation of the image content projected by the optical machine 1 as much as possible, improving accuracy of the image content collected by the camera 2, and further improving accuracy of data analysis of the image processing chip 5 and the optical machine driving chip 6.

Referring to fig. 2, a processor is arranged on the circuit board 3, and the processor comprises an image processing chip 5 and an optical drive chip 6 which are in communication connection with each other; the image processing chip 5 is in communication connection with the optical machine 1, and controls the optical machine 1 to output splicing calibration images respectively by receiving image data and logic control signals of the image processing chip 5; the image processing chip 5 is respectively in communication connection with the optical machine driving chip 6, the driving assembly and the camera, so that the driving assembly is controlled to adjust an included angle P formed by the light emitting directions of the two optical machines 1 based on the splicing calibration images acquired by the camera 2, and the adjacent boundaries of the two splicing calibration images are connected; after the two splicing calibration images are connected, the optical-mechanical driving chip 6 informs the image processing chip 5 to control the optical-mechanical 1 to output respective projection images, wherein the projection images are obtained by proportionally splitting the images to be displayed by the image processing chip 5 according to the width proportion of the splicing calibration images.

The circuit board 3 is generally disposed on the base 4 and spaced from the optical machine 1, that is, the circuit board 3 is disposed above one side of the base 4 where the optical machine 1 is mounted, a bracket can be disposed between the circuit board 3 and the base 4, the circuit board 3 is fixedly connected with the bracket, and the height of the bracket is greater than that of the optical machine 1, so that the circuit board 3 and the optical machine 1 are disposed at intervals. Optionally, because ray apparatus 1 power is great, and the heat production is more, and the heat dissipation problem is outstanding, can set up the fin in circuit board 3 towards ray apparatus 1 one side, and the radiating fin one end is connected circuit board 3, one end and is connected ray apparatus 1 radiating piece or neighbouring ray apparatus 1 louvre to effectively utilize the region between circuit board 3 and the ray apparatus 1, increase heat radiating area improves the radiating efficiency of ray apparatus 1.

The image processing chip 5 and the optical engine driving chip 6 are both solid chips installed on the circuit board 3, and the image processing chip 5 is mainly used for controlling the optical engine 1 to output images, splitting the images to be displayed and controlling the optical engine 1 to respectively display the split images. The optical machine driving chip 6 is mainly used for adjusting the light emitting direction of the optical machine 1, the inclination angle of the plane where the optical machine 1 is located and the focal length of the optical machine 1, and the optical machine driving chip 6 is in communication connection with the first motor 71, the second motor 91 and the focusing motor 10.

In this embodiment, referring to fig. 2 and 3, the image processing chip 5 controls the optical machines 1 to output the splicing calibration images to project onto the projection screen 8, the camera 2 continuously collects the projected splicing calibration images, the optical machine driving chip 6 analyzes the splicing calibration images collected by the camera 2, the driving module is controlled to adjust the included angle P formed by the light emitting directions of the two optical machines 1, the adjacent boundaries (two longitudinal boundaries perpendicular to and opposite to the transverse direction of the projection screen 8) of the two splicing calibration images, when the distance between the adjacent boundaries of the two splicing calibration images is too large, the driving module is controlled to decrease the included angle P formed by the light emitting directions of the two optical machines 1, when the distance between the adjacent boundaries of the two splicing calibration images is too small, the driving module is controlled to increase the included angle P formed by the light emitting directions of the two optical machines 1 until the adjacent boundaries of the two splicing calibration images are connected, at this time, the image processing chip 5 judges the relative positions of the two mosaic calibration images based on the two mosaic calibration images acquired by the camera 2 (if trapezoidal correction is completed before the mosaic calibration, the transverse width ratio obtained by analysis is 1:1, for example, the width ratio of the mosaic calibration images output by the two optical machines 1 is 1:1, namely, the two optical machines 1 output images with equal size, if the trapezoidal correction is performed after the mosaic calibration, the left and right projection screens project single-tone pictures with different whole screens, and the mosaic calibration is performed by detecting the colors of the adjacent areas of the two projection pictures), then the image processing chip 5 controls the optical machines 1 to output the projection pictures obtained by dividing and cutting the images to be displayed according to the width ratio, so that the two optical machines 1 output the projection pictures output by a single optical machine 1 in the conventional scheme together, and the amplitude of equal-scale reduction of actual projection pictures when a single optical machine system displays wide-screen images is reduced, the problems that the upper black edge and the lower black edge are large and the actual projection area of the displayed image is small during full-screen projection are solved, and the overall effect of an effective projection picture of the wide-screen projection system is improved.

Further, in another embodiment of the wide screen projection system, the driving assembly includes a first motor 71, a first mounting stage 72 and a second mounting stage 73, the first motor 71 is in communication connection with the opto-mechanical driving chip 6, the first mounting stage 72 and the second mounting stage 73 are circular gears, the first mounting stage 72 and the second mounting stage 73 are axially and rotatably connected to the base 4 with the direction perpendicular to the base 4, two vertical rotating shafts are penetratingly arranged in the middle of the first mounting stage 72 and the second mounting stage 73, the first mounting stage 72 and the second mounting stage 73 rotate around the vertical rotating shafts, the two opto-mechanical devices 1 are respectively mounted on the sides of the first mounting stage 72 and the second mounting stage 73 away from the base 4, the opto-mechanical devices 1 can synchronously rotate along with the rotation of the first mounting stage 72 and the second mounting stage 73, the lateral outer edges of the first mounting stage 72 and the second mounting stage 73 are provided with interlocking gear teeth, that is, the first mounting stage 72 and the second mounting stage 73 are themselves circular gears, the first mounting table 72 and the second mounting table 73 are engaged with the driving gear 711 of the first motor 71, and when the light emitting direction of the optical machine 1 needs to be adjusted, the first motor 71 controls the driving gear 711 to drive the first mounting table 72 and the second mounting table 73 to rotate, so that the light emitting directions of the two optical machines 1 are adjusted, and adjacent boundaries of two spliced calibration images output by the optical machines 1 are controlled to be connected.

Preferably, the first mounting table 72 and the second mounting table 73 are gear members having the same size and are engaged with each other, and the driving gear 711 of the first motor 71 is engaged with the first mounting table 72 or the second mounting table 73. Namely, the gear teeth of the first mounting table 72 and the second mounting table 73 are meshed and linked, the driving gear 711 of the first motor 71 only needs to be meshed with any one of the first mounting table 72 or the second mounting table 73, so that the first motor 71 drives the first mounting table 72 and the second mounting table 73 to synchronously rotate, the rotating directions of the light emitting directions of the two optical machines 1 are opposite, and the rotating amplitudes of the two optical machines will be consistent, the problem that a single splicing calibration image moves too fast and too much is not easy to occur in the splicing calibration image splicing process, the width ratio of the two splicing calibration images is effectively kept unchanged, the method is particularly suitable for the splicing high-precision adjustment situation that the width ratio of the splicing calibration image of the two optical machines 1 is 1:1, and the splicing efficiency and the splicing precision of adjacent boundaries of the splicing calibration image are improved. Certainly, the number of the first motors 71 can be two according to needs, the two first motors 71 respectively and independently drive the first mounting table 72 and the second mounting table 73 (at this time, the two mounting tables are separated), that is, the projection angles of the two optical machines can be independently adjusted, for some high-precision projection scenes with special requirements, a user needs to independently adjust the projection angles of the two optical machines 1, and the multi-scene projection requirements of the wide-screen projection system are met.

Optionally, the camera 2 is disposed on an angular bisector of an included angle P formed between the light emitting directions of the two optical machines 1, that is, the camera 2 is disposed at a midpoint position of a connecting line between the two optical machines 1, the wide-screen projection system further includes a projection screen 8 (i.e., a projection plane) located in the light emitting directions of the two optical machines 1, and the light emitting direction of the camera 2 is perpendicular to the projection screen 8. Camera 2 sets up on the angular bisector, camera 2's daylighting direction can be parallel with the angular bisector or coincide, and wide screen projection system's projection screen 8 sets up the dead ahead at camera 2, does not shelter from between camera 2 and the projection screen 8, thereby camera 2's light-emitting direction is perpendicular with projection screen 8, the lateral deviation can reduce as far as possible to the projected image on camera 2 gathers projection screen 8, improve camera 2 and gather the precision of concatenation calibration image, further promote the concatenation efficiency and the concatenation precision on the adjacent border of concatenation calibration image. In addition, under the structure that the projection angles of the two optical machines 1 are independently adjusted, the camera 2 is disposed at the midpoint between the two optical machines 1.

Further, in another embodiment of the wide-screen projection system, the wide-screen projection system further includes a physical horizontal angle calibration, which includes a second motor 91 and a horizontal rotating shaft 92, the second motor 91 is in communication connection with the optical engine driving chip 6, the horizontal rotating shaft 92 is fixedly connected with the horizontal adjusting surface 11 of the base 4, the second motor 91 drives the horizontal rotating shaft 92 to rotate so as to drive the horizontal adjusting surface 11 of the base 4 to rotate along with the horizontal rotating shaft 92, a fixedly connected portion of the horizontal rotating shaft 92 and the base 4 is the horizontal adjusting surface 11 of the plate-shaped member, the horizontal adjusting surface 11 can be fixedly connected with a side of the base 4 away from the optical engine 1, because there is no rotating space between the base 4 and the horizontal adjusting surface 11, the horizontal adjusting surface 11 and the base 4 do not move relatively, so that the second motor 91 drives the horizontal rotating shaft 92 to drive the base 4 to rotate more accurately, and the base 4 is placed on the inclined supporting surface on the base 4 where the optical engine 1 is located, Or the base 4 itself is not horizontal, or the base 4 is placed irregularly, resulting in the inclination of the base 4, and further resulting in the inclination of the light emitting direction of the optical machine 1 rather than the horizontal. Specifically, as shown in fig. 2, the base 4 includes a vertical horizontal adjustment base 12 and a horizontal adjustment surface 11, and the horizontal adjustment surface 11 is disposed on the vertical horizontal adjustment base 12. Therefore, after the adjacent boundaries of the calibration picture are connected, the second motor 91 drives the horizontal rotating shaft 92 to rotate so as to drive the base 4 to rotate, the image processing chip 5 controls the optical machine to output horizontal calibration images respectively, the optical machine driving chip 6 analyzes the horizontal calibration images acquired by the camera 2 synchronously, when the horizontal calibration image level is judged, namely, the plane included angle P of the planes where the two optical machines 1 are located is adjusted to be 0 degree, the planes where the two optical machines 1 are located are in a horizontal state, the second motor 91 is controlled to stop rotating, and therefore the projection of the optical machine 1 is ensured to meet the horizontal requirement. In addition, wide screen projection system still includes the gyroscope sensor that sets up on base 4, and ray apparatus drive chip 6 controls horizontal pivot 92 to rotate based on the data acquisition of gyroscope sensor to adjust two ray apparatus 1 place planes to the horizontality.

Optionally, horizontal rotating shaft 92 sets up in the one side that base 4 deviates from ray apparatus 1, the axial of horizontal rotating shaft 92 is parallel with the daylighting direction of camera 2, because the axial of horizontal rotating shaft 92 is unanimous in the daylighting direction of camera 2, then the axial perpendicular to projection screen 8 of horizontal rotating shaft 92, in the rotation process of horizontal rotating shaft 92, ensure that the turned angle of two ray apparatus 1 is unanimous, ensure that the light-emitting direction contained angle P of two ray apparatus 1 is unchangeable, when promoting wide-screen projection system's effective projection picture wholeness effect, avoid effective projection picture to appear the side to move. In addition, the preferred level of flattening of installation face of first mount table 72 and second mount table 73 is, and two ray apparatus 1 are in same horizontal plane to when horizontal rotating shaft 92 drove base 4 and rotates, two ray apparatus 1 are unanimous along with pivoted turned angle, have reduced the adjustment degree of difficulty that ray apparatus 1 adjusted to the horizontal plane, have further promoted the debugging efficiency before carrying out effective projection.

Further, referring to fig. 2 and 3, a reference mark is arranged on the side of the projection screen 8 facing the camera 2, the reference mark comprises a horizontal reference line, a vertical reference line and a splicing boundary reference line, the horizontal width extending direction of the horizontal calibration image should be parallel to the horizontal reference line, the longitudinal width extending direction of each type of calibration image (horizontal, splicing and focus calibration images) should be parallel to the vertical reference line, the splicing line when the adjacent boundaries of the two splicing calibration images are connected should coincide with the splicing boundary reference line, therefore, the reference mark can assist the optical-mechanical drive chip 6 in judging whether splicing of the spliced calibration images is completed or not and whether the plane where the optical-mechanical 1 is located (namely the horizontal calibration image) is located at the horizontal plane or not, and compared with the optical-mechanical drive chip 6 which is only analyzed according to the acquired image data of the camera 2, the calculation amount is less and the calculation efficiency is higher.

Optionally, the wide-screen projection system further includes a focusing motor 10, the focusing motor is in communication connection with the optical engine driving chip 6, and the focusing motor 10 is disposed at the lens of the optical engine 1 to adjust the focal length of the optical engine 1. Therefore, after the splicing calibration image is spliced and the plane of the optical machine 1 is horizontally calibrated (the horizontal calibration image is horizontal), the image processing chip 5 can control the optical machine 1 to respectively project two focal length calibration images, and control the respective focusing motors 10 of the two optical machines 1 to respectively adjust the focal lengths of the two optical machines 1, so that a clear projection effect is obtained. Finally, the image processing chip 5 cuts the image to be displayed in proportion according to the width proportion of the two projection areas after the trapezoidal correction, and then sends the image to the respective optical machines 1 for projection display.

The application also provides a camera-based wide-screen projection method, which is applied to a wide-screen projection system, wherein the wide-screen projection system comprises two optical machines and a camera, specifically, the two optical machines and the camera can be arranged on the same plane, the camera is positioned on a perpendicular bisector of a connecting line of the two optical machines, preferably, the camera is arranged at a midpoint position of the connecting line between the two optical machines, a distance sensor is arranged between the two optical machine connecting lines, and the distance sensor is used for detecting distances between the optical machines and a plurality of different points of a projection surface;

referring to fig. 4, the wide screen projection method based on a camera includes:

step S10, selecting four points with equal distances from the projection points of the center of the distance sensor on the projection plane as distance measurement points; based on the distance sensor, acquiring a first distance, a second distance, a third distance and a fourth distance from the distance sensor to each distance measurement point of the projection plane; if the four distances are equal, the connecting line of the two optical machines is judged to be parallel to the projection plane; if the four distances are unequal, the connection line of the two optical machines is judged to be not parallel to the projection plane;

the wide-screen projection system can comprise two optical machines, a camera, a distance sensor, a circuit board and a base, wherein the two optical machines and the camera are arranged on the base and are positioned on the same plane, the two optical machines are arranged on the base at intervals, a driving assembly for driving the optical machines to rotate to adjust the projection angle is arranged on the base, and the camera is arranged on the base between the two optical machines to collect various calibration images output by the optical machines. The circuit board is provided with a processor, and the processor comprises an image processing chip and an optical machine driving chip which are in communication connection with each other. The camera is arranged at the middle point of the connecting line between the two optical machines, the projection image distances from the orthographic projection position of the camera shooting direction to the projection plane to the two optical machines are basically equal, and the orthographic projection positions of the two optical machines relative to the camera are symmetrical, so that the adjustment of the projection angles of the optical machines has a symmetrical relation, and the adjustment difficulty of the projection angles of the optical machines can be further simplified.

After the optical machine is detected to be electrified, whether the connecting line of the setting positions of the two optical machines is parallel to the projection surface or not needs to be detected, the distance between the optical machine and the projection surface can be judged through detection and comparison, and a distance sensor can be arranged between the connecting lines of the two optical machines so as to respectively measure the distances between the optical machine and a plurality of points on the projection surface. The distance sensor of the present embodiment generally measures the distance based on the "flying time method", and calculates the distance to the object by measuring the time interval by emitting a light pulse that is extremely short and measuring the time from the emission to the reflection of the light pulse by the object. The distance sensor can be divided into an optical distance sensor, an infrared distance sensor, an ultrasonic distance sensor and the like according to the difference of the working principle of the distance sensor, so that the distance from the optical machine to a plurality of points on the projection surface can be detected and acquired based on the distance sensor arranged at the optical machine and the camera.

Specifically, a distance sensor is installed between two optical machine connecting lines, the distance sensor is used for detecting the distance between a plurality of different points of the optical machine and the projection plane, and the step S10 of detecting whether the connecting lines of the two optical machines and the projection plane in the shooting direction of the camera are parallel or not includes the steps of:

selecting four points with equal distances from the center of the distance sensor to the projection point of the projection plane as distance measurement points; based on the distance sensor, acquiring a first distance, a second distance, a third distance and a fourth distance from the distance sensor to each distance measurement point of the projection plane; if the four distances are equal, the connecting line of the two optical machines is judged to be parallel to the projection plane; if the four distances are unequal, the connecting line of the two optical machines is not parallel to the projection plane.

In the process of detecting whether the connecting line of the two optical machines and the projection plane are parallel or not, distance measuring points of the distance sensor are selected firstly, the projection plane is assumed to be a plane, and four points with equal distances to the projection points of the center of the sensor on the projection plane are selected as the distance measuring points. Specifically, referring to fig. 5, a plane where the projection plane is located is taken as a bottom plane a, and is equal to a sensor center point C, a projection point D of the center point C on the bottom plane a is at least 2 arbitrary points B on the bottom plane a, and distances from the arbitrary points B to the projection point D of the sensor center point C on the bottom plane a are equal, and distances from the points B to the sensor center point C are equal according to a geometric relationship.

After determining distance measurement points (i.e., points B in fig. 5) on the projection plane, acquiring a first distance, a second distance, a third distance and a fourth distance from the distance sensor to each distance measurement point on the projection plane based on the distance sensor; if the distances of the four points are equal, the connection line of the two optical machines is judged to be parallel to the projection plane; if the four distances are unequal, the connecting line of the two optical machines is not parallel to the projection plane.

When the distances of the four distance measuring points are detected to be equal, the distances between the distance sensor and each point of the projection surface are indicated to be equal, so that the connection line of the two optical machines is pushed out to be parallel to the projection surface, and the shooting direction of the camera (namely the light incidence direction of the camera) is vertical to the projection surface; when the distances of the four distance measuring points are different, the fact that the projection plane is inclined relative to the connecting line of the two optical machines is shown, and at the moment, the connecting line of the optical machines and the camera is not parallel to the projection plane, so that the distance measurement of the distance sensor and the setting of the positions of the optical machines and the camera are used, the judgment of whether the projection plane is parallel to the connecting line is simply and accurately realized, and complicated analysis of the size, the inclination angle and the like of the projection image of the optical machines is not needed.

Step S20, if the connecting line is parallel to the projection plane, controlling the two optical machines to project and splice the calibration images to the projection plane in the shooting direction of the camera; shooting an acquired image of the spliced calibration image based on the camera, and determining the position relationship of the two spliced calibration images; adjusting the projection angles of the two optical machines based on the position relation of the splicing calibration images dynamically acquired by the camera until the two splicing calibration images are overlapped relative to the two longitudinal boundaries;

when the line of camera and ray apparatus is parallel with the plane of projection, the plane of projection is perpendicular with the camera direction of shooting, and wherein the camera direction of shooting can be the income light direction of camera, and the camera just is to the plane of projection, avoids because the camera deflects and leads to gathering the image deformation on the plane of projection, need not to carry out the recalibration to the image that the camera was gathered, and then improves the collection efficiency and the collection precision that the camera gathered the image on the plane of projection.

The calibration image can comprise a splicing calibration image and a focal length calibration image, the splicing calibration image is specially used for adjusting the included angle of the light emitting directions of the two optical machines and the projection angle of the two optical machines, and the focal length calibration image is specially used for adjusting the focal length of the optical machines.

When the wide-screen projection system is powered on and started or reset, the optical machine driving chip can firstly control the light emitting directions of the two optical machines to be restored to the preset initial direction, the image processing chip controls the two optical machines to respectively shoot the projection surfaces in the direction towards the camera, the spliced calibration images are projected, the color difference of the spliced calibration images relative to two longitudinal boundaries is large (the Euclidean distance is larger than the preset difference value), for example, the two spliced calibration images are respectively red and green, and boundary identification is facilitated.

The camera dynamically collects splicing calibration images projected by the optical machine in real time, the image processing chip carries out boundary identification and distance analysis on the splicing calibration images which are dynamically collected in real time, two opposite longitudinal boundaries of the two splicing calibration images can be identified firstly, the longitudinal direction is the longitudinal direction in the figure 3, then the distance between the two longitudinal boundaries is analyzed and estimated, wherein the distance between the two longitudinal boundaries is larger than 0, and the backgrounds of the two splicing calibration images are not overlapped, so that the two splicing calibration images do not have an overlapping area; the distance between the two longitudinal boundaries is less than 0 and the backgrounds of the two stitched calibration images coincide, indicating that there is an overlapping region between the two stitched calibration images. One point of a longitudinal edge of a projection plane can be used as a zero point of a transverse coordinate axis, the distance between two longitudinal boundaries is equal to the difference between the abscissas of the two longitudinal boundaries on the transverse coordinate axis, specifically, the difference is equal to the difference between the abscissa of the longitudinal boundary far away from the zero point (hereinafter referred to as far coordinate) and the abscissa of the longitudinal boundary near to the spliced calibration image (hereinafter referred to as near coordinate), wherein the distance is a negative value, which indicates that the far coordinate is closer to the zero point of the transverse coordinate axis relative to the near coordinate, and then the existence of an overlapping region in the two spliced calibration images is judged.

The position relation of the two spliced calibration images generally comprises intersection and separation, the position relation is associated with the two optical machines, the projection angles of the two optical machines are adjusted according to the position relation, and the position relation of the two spliced calibration images is synchronously detected until the two spliced calibration images are overlapped relative to the two longitudinal boundaries.

Specifically, based on the position relation of the spliced calibration images dynamically acquired by the camera, the projection angles of the two optical machines are adjusted until the two spliced calibration images coincide with the two longitudinal boundaries, and the step of adjusting the projection angles of the two optical machines comprises the following steps:

step S41, carrying out characteristic analysis on the collected images of the spliced calibration images shot by the camera, and detecting whether the two spliced calibration images have an overlapping area; if the two spliced calibration images have an overlapping area, the position relationship is intersected; if the two spliced calibration images do not have an overlapping area, the position relation is a phase separation;

the analysis mode that the distance between the two longitudinal boundaries in the section of the exercise where the step S40 is performed on the spliced calibration images is equal to the difference value between the abscissa of the two longitudinal boundaries and the abscissa of the transverse coordinate axis can be used for conveniently judging whether the two spliced calibration images have an overlapping region, so that the two spliced calibration images have the overlapping region, the position relationship is judged to be intersected, the overlapping region does not exist in the two spliced calibration images, and the position relationship is judged to be separated.

Step S42, if the position relationship is the same, the included angle of the light-emitting directions of the two optical engines is reduced; if the position relation is intersection, the included angle of the light emitting directions of the two optical machines is increased; in the process of adjusting the included angle, whether two longitudinal boundaries of the spliced calibration image are overlapped or not is judged based on an edge recognition algorithm; and if the two longitudinal boundaries are overlapped, judging that the two spliced calibration images are spliced seamlessly, and stopping the rotation of the two optical machines.

Generally speaking, two stitching calibration images are mostly in a separated state, even if the two stitching calibration images are in an intersecting state, the intersecting state of the two stitching calibration images can be quickly judged through image analysis, generally, the colors of the two stitching calibration images are different, for example, one red color is different from the other blue color, when a fourth color except for red, blue and projection plane colors (such as white) is detected, the two stitching calibration images are judged to be in the intersecting state, an included angle of light emitting directions of the two optical machines is increased, projection angles of the two optical machines are adjusted until the fourth color is eliminated, two longitudinal boundaries are overlapped, and the two stitching calibration images are seamlessly stitched.

Therefore, when the two spliced calibration images are in a phase separation state, the larger the distance between the two spliced calibration images and two longitudinal boundaries is, the larger the included angle formed by the light emitting directions of the two optical machines is, the included angle needs to be reduced, and then when the judgment position relation is the phase separation, the included angle formed by the light emitting directions of the two optical machines is reduced, so that the projection angle of at least one optical machine is adjusted, wherein the distance is positively correlated with the adjustment speed of the projection angle of the optical machines, namely, when the distance is larger, the included angle formed by the light emitting directions of the two optical machines is larger, and the projection angle of the optical machines is adjusted at a larger rotation speed. In the process of continuously adjusting the projection angle of the optical machine, based on an edge recognition algorithm, the processor continuously detects the distance between the two relative longitudinal boundaries of the two spliced calibration images based on the camera, when the distance is 0, the two relative longitudinal boundaries of the two spliced calibration images are overlapped, and the optical machine stops rotating after the adjustment of the projection angle of the optical machine is finished. The edge identification algorithm is used for identifying a pixel point set with brightness, gray scale and/or color difference changing sharply (the variation of adjacent pixel points is larger than a preset variation threshold) in an image, and the continuous distribution area of the pixel point set is a longitudinal boundary.

Step S30, firstly, trapezoidal correction is carried out on the optical machine A with a smaller projected picture frame to obtain a smaller trapezoidal correction image, the longitudinal boundary of the smaller trapezoidal correction image close to the other optical machine B side is taken as a symmetry axis to obtain a symmetric mapping area of the smaller trapezoidal correction image mapped by the symmetry axis, trapezoidal correction is carried out on the larger picture frame projected by the optical machine B according to the rectangular vertex coordinates of the symmetric mapping area to obtain another trapezoidal correction image with the same size as the smaller trapezoidal correction image, and the two trapezoidal correction images are seamlessly spliced;

step S40, longitudinally aligning two rectangular splicing calibration images, and dividing the two rectangular splicing calibration images into two transverse areas by taking a perpendicular bisector of a projection splicing line of the two splicing calibration images as a dividing line; determining a transverse boundary which is closer to a perpendicular bisector in two transverse regions based on a camera, and taking the closer transverse boundary in the two transverse regions as a reference to enable a farther transverse boundary in the two transverse regions to be close to a closer transverse boundary until the two transverse boundaries of the two spliced calibration images are aligned and parallel;

transversely aligning the two rectangular splicing calibration images, and dividing the two rectangular splicing calibration images into two longitudinal areas by taking the projection splicing lines of the two splicing calibration images as central lines; determining a longitudinal boundary which is closer to the center line and not coincident with the center line in the two longitudinal areas based on the camera, and taking the closer longitudinal boundary in the two longitudinal areas as a reference to make the farther longitudinal boundary in the two longitudinal areas closer to the center line until the distance between the two longitudinal boundaries of the two spliced calibration images and the center line is equal;

and step S50, controlling the two light machines to project images to be displayed respectively to the projection surface.

After determining that the relative longitudinal boundaries of the spliced calibration images projected by the two optical machines are overlapped, the optical machine driving chip can control the two optical machines to output at least one frame of picture frame of the image to be displayed to the projection surface, and trapezoidal correction is respectively carried out on the two optical machines. Optionally, before the optical machine performs trapezoidal correction, the image processing chip performs trapezoidal correction on the optical machine a with a smaller projected picture frame to obtain a smaller trapezoidal correction image, a longitudinal boundary of the smaller trapezoidal correction image close to the other optical machine side is taken as a symmetry axis, a symmetric mapping region of the smaller trapezoidal correction image mapped by the symmetry axis is obtained, and according to a rectangular vertex coordinate of the symmetric mapping region, the larger picture frame projected by the optical machine B is subjected to trapezoidal correction to obtain another trapezoidal correction image with the same size as the smaller trapezoidal correction image. The image to be displayed is formal content projected by a wide-screen projection system required by a user, such as PPT, a movie, a television program and the like required by the user.

In this embodiment, the wide-screen projection is realized by setting two optical machines, when it is detected that a connection line between the optical machines and the camera is parallel to the projection plane, the shooting direction of the camera is perpendicular to the projection plane, the camera is located at the midpoint of the connection line between the two optical machines, the two optical machines are controlled to respectively project splicing calibration images to the projection plane, and based on the position relationship of the splicing calibration images dynamically acquired by the camera, the camera is perpendicular to the projection plane and located at the midpoint between the two optical machines, the splicing calibration images acquired by the camera have smaller distortion or offset degree, and then the projection angles of the optical machines are adjusted according to the position relationship until the two splicing calibration images are seamlessly spliced; and finally, trapezoidal correction is carried out on the two optical machines, the two optical machines are controlled to project the image to be displayed on the projection surface, so that the two optical machines jointly output the projection picture output by the single optical machine in the conventional scheme, the widths of the projection pictures output by the two optical machines are shortened, even if the projection picture with the shortened single width is reduced through trapezoidal correction under the condition that the optical machines are in side projection, or in wide-screen display, in order to keep the equal-ratio reduction of the high-width proportion, the two reduction processes share the influence of the equal-ratio reduction by the projection pictures of the two optical machines, so that the amplitude of the equal-ratio reduction of the actual projection picture is greatly reduced, the problems that the upper and lower black edges of the projection are large and the projection area of the actual display image is small are solved, and the integral effect of the effective projection picture of the wide-screen projection system is improved.

Further, in another embodiment of the camera-based widescreen projection method according to the present application, after the step of detecting whether the connection line of the two optical machines is parallel to the projection plane in the shooting direction of the camera, the method further includes:

step A1, if the connecting line is not parallel to the projection plane, determining that the projection plane is inclined, and guiding a user to adjust the position of the projection plane or adjust the horizontal position of the whole projector through an interface;

step A2, if the user selects to adjust the position of the projection surface, the step of detecting whether the connection line of the two optical machines is parallel to the projection surface in the shooting direction of the camera is executed after the user finishes the adjustment;

step A3, if the user selects the projector to adjust itself, the horizontal rotating shaft under the two optical machine bases is controlled to rotate and adjust left and right until the connection line of the two optical machines is parallel to the projection plane

When the connecting line is not parallel to the projection surface, the arrangement position of the optical machine is not adjusted, the projection surface is judged to incline, the wide-screen projection system guides a user to adjust the projection surface through voice or a projection interface, and after the user adjusts the projection surface, the wide-screen projection system is instructed to perform parallel detection again. If the projection surface is a curtain, the user only needs to adjust the projection in the horizontal direction back and forth. If the projection surface is not adjusted, the wide-screen projection system controls the horizontal rotating shaft under the two optical machine bases to carry out left-right direction rotation adjustment of the shooting direction of the camera, when the distance between the wide-screen projection system and one side of the projection surface is larger based on the existing distance sensor of the camera head, the bases are controlled to rotate towards the other side direction until the distance difference between the distance sensor and the two sides of the projection surface is within a threshold value, and then the two optical machines are judged to be parallel to the projection surface.

When the rotating base is judged to be incapable of adjusting the connection line of the two optical machines and the projection plane in parallel, the wide-screen projection system reminds that the automatic adjustment cannot be carried out through voice or a projection interface, the adjustment is carried out after the projector needs to be aligned again, and the horizontal rotating shaft under the two optical machine bases is controlled to carry out left-right direction rotation adjustment until the connection line of the two optical machines and the projection plane are parallel.

In this embodiment, when detecting two ray apparatus lines and plane of projection nonparallel, adjust the great plane of projection of the probability of taking place slope earlier to smooth just, if line and plane of projection still are nonparallel this moment, the horizontal rotating shaft carries out left right direction rotation under the adjustment setting ray apparatus base again, until the line and the plane of projection of ray apparatus and camera are parallel, thereby avoid before not adjusting the plane of projection, carry out unnecessary adjustment to the base repeatedly, realize the line of ray apparatus and camera and the parallel adjustment scheme of plane of projection with a high efficiency, accurately mode.

Optionally, the wide-screen projection system further includes a focusing motor, the focusing motor is disposed at a lens of the optical engine, and before the step of controlling the projection surfaces of the two optical engines in the shooting direction of the camera in step S20 to project the spliced calibration images respectively, the method further includes:

b, controlling the two optical machines to project focal length calibration images to the projection plane; based on the definition of the focus calibration image dynamically acquired by the camera, the focus motor is controlled to adjust the focus of the two optical machines until the definition reaches a preset definition threshold value.

Before the ray apparatus carries out the concatenation calibration, set up ray apparatus focus calibration flow, two ray apparatus of image processing chip control this moment are to projection plane projection focus calibration image, and the focus of two ray apparatus of control focusing motor adjustment, and carry out the comparison to the definition and the budget definition threshold of the focus calibration image of gathering in real time through the camera, the definition when focus calibration image reaches preset definition threshold, show that the focus adjustment of two ray apparatus finishes, the ray apparatus can project clear projection picture this moment, guarantee the definition of the concatenation calibration image of the follow-up projection of ray apparatus, be favorable to the camera to gather the calibration image of high definition, be favorable to the accurate analysis of concatenation calibration image, the accuracy and the efficiency of image calibration have been improved.

Further, in another embodiment of the camera-based wide-screen projection method according to the present application, after detecting that two spliced calibration images are seamlessly spliced and subjected to respective keystone correction, and before controlling two optical machines to project respective images to be displayed onto a projection surface, the camera-based wide-screen projection method further includes:

step C1, longitudinally aligning the two rectangular splicing calibration images, and adjusting the longitudinal width of the two rectangular splicing calibration images until the two transverse boundaries of the two rectangular splicing calibration images are aligned and parallel;

the longitudinal alignment process mainly comprises the following steps: and dividing the projection plane into two transverse areas by using the projection splicing line vertical bisector of the two spliced calibration images, wherein the splicing calibration image point far away from the vertical bisector in each transverse area moves to the plane where the splicing calibration image transverse boundary is located on the same side close to the vertical bisector until the transverse boundary end points of the two spliced calibration images in each transverse area are overlapped.

And step C2, transversely aligning the two rectangular splicing calibration images, and adjusting the transverse lengths of the two rectangular splicing calibration images until the distance between the two longitudinal boundaries of the two splicing calibration images and the projection splicing line is equal, wherein the projection splicing line is the splicing line formed by the seamless splicing of the two splicing calibration images.

The transverse alignment process mainly comprises the following steps: and taking the projection splicing lines of the two spliced calibration images as a central line, wherein the two spliced calibration images respectively have a correction longitudinal edge which is parallel to the central line but not overlapped with the central line, and the correction longitudinal edge which is far away from the central line translates towards the direction close to the central line until the distances from the two correction longitudinal edges to the central line are equal.

That is to say, after it is detected that two splicing calibration images are overlapped with respect to two longitudinal boundaries and the two optical machines complete trapezoidal correction, projection size correction can be performed on the rectangular splicing calibration images after seamless splicing, and a longitudinal alignment process and a transverse alignment process are not performed successively.

In this embodiment, longitudinal alignment and transverse alignment are performed successively or simultaneously on two rectangular spliced calibration images after trapezoidal correction, the longitudinal alignment and the transverse alignment do not differ in order, and the longitudinal alignment aligns and parallels two transverse boundaries of the two spliced calibration images, that is, the longitudinal widths of the two spliced calibration images are equal; adjusting the distance between the longitudinal boundaries of the two spliced calibration images and the projection splicing line to be equal by transverse alignment, namely the transverse lengths of the two spliced calibration images are equal; thereby accomplish the size correction of two concatenation calibration images, two concatenation calibration image sizes after the size correction equal to two ray apparatus of wide screen projection system are to the effective image picture that seamless concatenation, rectangle and size equal of projection surface projection, promote wide screen projection system's effective projection picture wholeness effect, have improved wide screen projection system's sight shadow effect.

In particular, in a preferred embodiment of the camera-based widescreen projection method of the present application,

step C1 includes: dividing the two rectangular spliced calibration images into two transverse areas by taking the perpendicular bisector of the projection splicing line of the two spliced calibration images as a dividing line; determining a transverse boundary which is closer to the perpendicular bisector in the two transverse regions based on the camera, and taking the closer transverse boundary in the two transverse regions as a reference to enable a farther transverse boundary in the two transverse regions to be close to a closer transverse boundary until the two transverse boundaries of the two spliced calibration images are aligned and parallel.

In the longitudinal alignment process, the projection plane is divided into two transverse areas by the vertical bisector of the projection splicing line of the two spliced calibration images, and the point of the spliced calibration image farther from the vertical bisector in each transverse area moves to the plane where the transverse boundary of the spliced calibration image closer to the vertical bisector on the same side is located, so that the farther transverse boundary in the two transverse areas is closer to the closer transverse boundary until the transverse boundary endpoints of the two spliced calibration images in each transverse area are overlapped.

Specifically, in the process of longitudinal alignment, a point far away from a perpendicular bisector moves to another point on the same side by taking the perpendicular bisector of the projection splicing lines of the two spliced calibration images as a reference until the two projected splicing lines are overlapped. As shown in fig. 6, since L1 is larger than L2, the top side (i.e., the top transverse boundary) of the stitched calibration image projected to the left needs to be translated downward until L1 equals L2; since L3 is smaller than L4, the lower edge (lower lateral boundary) of the stitched calibration image projected to the right needs to be translated upwards until L4 equals L3.

Step C2 includes: dividing the two rectangular spliced calibration images into two longitudinal areas by taking the projection splicing lines of the two spliced calibration images as central lines; and determining longitudinal boundaries which are close to the central line and not overlapped with the central line in the two longitudinal areas based on the camera, and taking the close longitudinal boundaries in the two longitudinal areas as a reference, and enabling the far longitudinal boundaries in the two longitudinal areas to be close to the central line until the distance between the two longitudinal boundaries of the two spliced calibration images and the central line is equal.

In the transverse alignment process, the projection splicing line (i.e. the splicing boundary reference line in fig. 3) of the two splicing calibration images is taken as a central line, the two splicing calibration images respectively have a correction longitudinal edge (i.e. a longitudinal boundary) which is parallel to the central line but not overlapped with the central line, and the correction longitudinal edge which is farther away from the central line is translated towards the direction close to the central line until the distances from the two correction longitudinal edges to the central line are equal.

Specifically, in the transverse alignment process, the projection splicing lines of the two spliced calibration images are taken as central lines, and the two projection surfaces respectively have a correction longitudinal edge which is parallel to the central lines but not overlapped with the central lines. The longitudinal edge far away from the central line needs to translate towards the direction of the central line until the distance of the longitudinal edge is equal to the distance of the other longitudinal edge; as shown in fig. 7 in lateral alignment, since L5 is larger than L6, the longitudinal left edge of the left projected stitched calibration image needs to be translated to the right until L5 equals L6.

In addition, the two stitched calibration images can only be adjusted to a smaller size during the lateral or longitudinal alignment. That is, in the longitudinal alignment process (step C1), in the same transverse region, the transverse boundary farther from the perpendicular bisector of the projected splice line is closer to the closer transverse boundary, and the closer transverse boundary does not move; during the lateral alignment (step C2), the longitudinal boundaries farther from the centerline translate toward the centerline, and the longitudinal boundaries closer to the centerline remain in place; thereby the size of two concatenation calibration images is no longer the grow to can not influence the trapezoidal correction effect of concatenation calibration image, concatenation calibration image can not become trapezoidal again this moment, ensures trapezoidal validity of rectifying. In the process of trapezoidal calibration and size correction, the change of the shape of the spliced calibration image is generally the adjustment of the position and the size of a non-black effective projection area and a black dark stretching area in a projection area of the optical machine, and is generally not the adjustment of the physical and optical display of the optical machine.

Optionally, in another embodiment of the camera-based wide-screen projection method according to the present application, the camera-based wide-screen projection method further includes:

step D1, when detecting that the optical machine is electrified, if detecting that the wide screen projection instruction is cancelled, detecting the current projection brightness requirement of the wide screen projection system;

when a wide-screen projection canceling instruction input by a user is detected, which indicates that the user does not need wide-screen projection currently, the current projection brightness requirement of the wide-screen projection system is further detected.

Step D2, if the current projection brightness requirement is larger than or equal to the preset brightness threshold, controlling the two optical machines to project the spliced calibration images to the area of the vertical projection plane in the shooting direction of the camera until the two spliced calibration images are completely overlapped;

if the current projection brightness requirement is larger than or equal to the preset brightness threshold value, it is indicated that the current ambient light of the user is bright, and brightness display needs to be enhanced, the two optical machines are controlled to project the spliced calibration images to the area where the shooting direction of the camera is perpendicular to the projection surface until the two spliced calibration images are completely overlapped, and the brightness of the projection images of the two optical machines is mutually enhanced to highlight the image to be displayed.

In addition, if the current projection brightness requirement is smaller than the preset brightness threshold, one optical machine is closed, and only one optical machine is used for projection, so that the brightness requirement of a user for projecting an image to be displayed is met, and the electric energy consumed by one optical machine is saved.

And D3, performing trapezoidal correction on the two optical machines, and controlling the two optical machines to project the same image to be displayed to the projection surface.

In the case that the two ray machine projection pictures are overlapped and the same, the process of the keystone correction is the same as the keystone correction in S50.

In addition, the wide-screen projection method based on the camera further comprises the following steps: after detecting that the optical machine projects the images to be displayed on the projection surface, detecting the similarity between the images to be displayed projected by the optical machine, and counting the duration of the similarity which is greater than or equal to a preset similarity threshold; if the duration is longer than the preset unit duration, outputting a prompt of whether to shut down by the wide-screen projection system, and if the preset waiting duration after outputting the prompt of whether to shut down is not responded by the user, automatically shutting down the optical machine; if a shutdown instruction determined by a user or a shutdown instruction determined not to be performed is received, executing according to the user instruction; and if the similarity is smaller than the preset similarity threshold, clearing the duration of which the current statistical similarity is greater than or equal to the preset similarity threshold so as to carry out statistics again. Therefore, when the optical machine projects the images which are basically the same for a long time, the duration of projecting the images which are basically the same starts to be counted, when the duration is longer than the duration of the preset unit, the fact that the user possibly sleeps in the projection process of the optical machine or the user is busy in other affairs indicates that the user possibly watches the optical machine, at the moment, in order to save electric energy and prolong the service life of the optical machine, at the moment, the wide-screen projection system outputs a prompt of whether to shut down, and a shutdown instruction or automatic shutdown can be further executed.

In addition, the wide-screen projection method based on the camera further comprises the following steps: after the splicing calibration images are detected to be overlapped relative to the two longitudinal boundaries, the camera collects the two spliced calibration images after being combined again, and then the number of transverse pixels and the number of longitudinal pixels of the overall image after the two spliced calibration images are seamlessly spliced are detected;

if the difference between the approximate resolution and the preset resolution exceeds a threshold value, prompting a user to adjust the position of the projector or the position of the projection surface through a voice or projection interface, and then performing splicing calibration again until the difference between the approximate resolution and the preset resolution is within the threshold value.

In this embodiment, the distribution condition of the total image projected to the projection surface is obtained through comparative analysis of the total image relative to the actual approximate resolution and the preset division ratio, and then based on the distribution condition, the user is prompted to adjust the position of the projector or the position of the projection surface corresponding to the voice or the projection interface, and then splicing calibration is performed again, so that it is ensured that the wide-screen projection system projects all the images to be displayed on the projection surface curtain.

In order to achieve the above object, the present application further provides a wide-screen projection system, where the wide-screen projection system includes two optical machines and a camera, a memory, a processor, and a computer program stored in the memory and capable of running on the processor, the optical machines and the camera are respectively provided with a distance sensor, a projection plane is arranged in a shooting direction of the camera, and the computer program is executed by the processor to implement the steps of the wide-screen projection method based on the camera. Optionally, the two optical machines and the camera may be disposed on the same plane, and the camera is located on a perpendicular bisector of a connecting line of the two optical machines.

In order to achieve the above object, the present application further provides a readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the above-mentioned camera-based widescreen projection method.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the recitation of an element by the phrase "comprising an … …" does not exclude the presence of additional like elements in the process, method, article, or apparatus that comprises the element, and further, where similarly-named elements, features, or elements in different embodiments of the disclosure may have the same meaning, or may have different meanings, that particular meaning should be determined by their interpretation in the embodiment or further by context with the embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or at least partially with respect to other steps or sub-steps of other steps.

It should be noted that step numbers such as S10 and S20 are used herein for the purpose of more clearly and briefly describing the corresponding content, and do not constitute a substantial limitation on the sequence, and those skilled in the art may perform S20 first and then S10 in specific implementation, which should be within the scope of the present application.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A wide screen projection method based on a camera is characterized in that the wide screen projection method based on the camera is applied to a wide screen projection system, the wide screen projection system comprises two optical machines and a camera, the two optical machines and the camera are arranged on the same plane, the camera is positioned on a perpendicular bisector of a connecting line of the two optical machines, the camera is arranged at the midpoint position of the connecting line between the two optical machines, a distance sensor is arranged between the connecting lines of the two optical machines, and the distance sensor is used for detecting the distance between the optical machines and a plurality of different points of a projection surface;

whether the step that detects the projection plane on the line of two ray apparatus and the camera shooting direction is parallel includes:

selecting four points with equal distances from the center of the distance sensor to the projection point of the projection plane as distance measurement points; based on the distance sensor, acquiring a first distance, a second distance, a third distance and a fourth distance from the distance sensor to each distance measurement point of the projection plane; if the four distances are equal, the connecting line of the two optical machines is judged to be parallel to the projection plane; if the four distances are unequal, the connection line of the two optical machines is judged to be not parallel to the projection plane;

performing trapezoidal correction on the two optical machines, and controlling the two optical machines to project images to be displayed to the projection surface respectively;

the step of performing trapezoid correction on the two light machines comprises:

firstly, trapezoidal correction is carried out on the optical machine A with a smaller projected picture frame to obtain a smaller trapezoidal correction image, a longitudinal boundary of the smaller trapezoidal correction image close to the other optical machine B side is taken as a symmetry axis, a symmetric mapping area of the smaller trapezoidal correction image mapped by the symmetry axis is obtained, trapezoidal correction is carried out on the larger picture frame projected by the optical machine B according to a rectangular vertex coordinate of the symmetric mapping area, so that another trapezoidal correction image with the same size as the smaller trapezoidal correction image is obtained, and the two trapezoidal correction images are spliced seamlessly;

after detecting that two spliced calibration images are spliced seamlessly and trapezoidal correction is carried out on the two optical machines, and before controlling the two optical machines to project images to be displayed respectively to a projection surface, the wide-screen projection method based on the camera further comprises the following steps:

longitudinally aligning the two rectangular splicing calibration images, and dividing the two rectangular splicing calibration images into two transverse areas by taking a perpendicular bisector of a projection splicing line of the two splicing calibration images as a dividing line; determining a transverse boundary which is closer to a perpendicular bisector in two transverse regions based on a camera, and taking the closer transverse boundary in the two transverse regions as a reference to enable a farther transverse boundary in the two transverse regions to be close to a closer transverse boundary until the two transverse boundaries of the two spliced calibration images are aligned and parallel;

transversely aligning the two rectangular splicing calibration images, and dividing the two rectangular splicing calibration images into two longitudinal areas by taking the projection splicing lines of the two splicing calibration images as central lines; and determining longitudinal boundaries which are close to the central line and not overlapped with the central line in the two longitudinal areas based on the camera, and taking the close longitudinal boundaries in the two longitudinal areas as a reference, and enabling the far longitudinal boundaries in the two longitudinal areas to be close to the central line until the distance between the two longitudinal boundaries of the two spliced calibration images and the central line is equal.

2. The camera-based widescreen projection method of claim 1, wherein after the step of detecting whether the connecting line of the two optical machines is parallel to the projection plane in the shooting direction of the camera, the method further comprises:

3. The camera-based widescreen projection method of claim 2, wherein the step of adjusting the projection angles of the two optical machines based on the positional relationship of the stitched calibration images dynamically acquired by the camera until the two stitched calibration images coincide with respect to the two longitudinal boundaries comprises:

4. The camera-based wide-screen projection method of claim 3, wherein the wide-screen projection system further comprises a focus motor disposed at a lens of the optical engine,

5. The camera-based widescreen projection method of claim 4, wherein the camera-based widescreen projection method further comprises: after the splicing calibration images are detected to be overlapped relative to the two longitudinal boundaries, the camera collects the two spliced calibration images after being combined again, and then the number of transverse pixels and the number of longitudinal pixels of the overall image after the two spliced calibration images are seamlessly spliced are detected;

6. The camera-based widescreen projection method of claim 5, wherein the camera-based widescreen projection method further comprises:

7. The camera-based widescreen projection method of any one of claims 1 to 6, wherein the camera-based widescreen projection method further comprises:

8. A wide-screen projection system, comprising two optical machines and a camera, a memory, a processor and a computer program stored in the memory and executable on the processor, wherein distance sensors are respectively disposed at the installation positions of the optical machines and the camera, and the computer program, when executed by the processor, implements the steps of the camera-based wide-screen projection method according to any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of the camera-based widescreen projection method according to any one of claims 1 to 7.