CN112203157B

CN112203157B - Video processing method and device based on 720 capsule type screen and related products

Info

Publication number: CN112203157B
Application number: CN202011421121.5A
Authority: CN
Inventors: 吴姜澔; 吴晓斌
Original assignee: Shouwang Experience Technology Culture Co ltd
Current assignee: Shouwang Experience Technology Culture Co ltd
Priority date: 2020-12-08
Filing date: 2020-12-08
Publication date: 2021-04-06
Anticipated expiration: 2040-12-08
Also published as: CN112203157A

Abstract

The embodiment of the application provides a video processing method and device based on a 720 capsule type screen and a related product, wherein the method comprises the following steps: converting a video to be played into a video frame sequence arranged according to a time sequence, wherein the ratio range of the aspect ratio of video frame images is 16:9 to 1: 1.5; determining a corresponding UV conversion relation according to the aspect ratio of the video frame image; performing UV conversion on the video frame image according to the determined UV conversion relation to obtain a video frame UV map; from the video frame UV map, a video file is generated for presentation on the inner surface of the capsule-type screen at 720. By the scheme, the traditional square film (the ratio range of the aspect ratio is 16:9 to 1:1.5) can be viewed in a panoramic mode on the 720 capsule type screen, correct viewing in the 720 capsule type screen is guaranteed, distortion is avoided, and a user can obtain good panoramic immersive video viewing experience when watching the traditional square film on the basis of the 720 capsule type screen.

Description

Video processing method and device based on 720 capsule type screen and related products

Technical Field

The embodiment of the application relates to the technical field of display, in particular to a video processing method and device based on a 720 capsule type screen and a related product.

Background

The display screen is divided according to the shape of the screen and can be divided into a plane screen, a circular screen and a spherical screen. Wherein plane curtain and the unable spectator of parcel of circular screen, the dome screen can be with spectator parcel wherein, and when spectator watched the image that the dome screen demonstrates, the border of dome screen can not appear in spectator's normal visual range to make spectator's sense of immersion stronger. However, in practical application, because the seats of the audience are arranged in rows, when the audience is far away from the center of the spherical screen, the included angle between the sight line of the audience watching the spherical screen and the horizontal plane is larger, which is not in line with the angle of normal watching, so that the comfort of the audience watching the video through the spherical screen is poorer.

In order to improve the comfort of the viewers watching the video, the images can be displayed by the 720 capsule-type screen, wherein the 720 capsule-type screen can provide continuous images with 180 to 360 degrees of visual angles in the horizontal direction, the inclination of the line of sight of the same row of the viewers watching the 720 capsule-type screen is more consistent, and the comfort of the viewers watching the images through the 720 capsule-type screen is better.

Due to the high production cost of three-dimensional video and the immature technology of early three-dimensional video production, most of the current videos are non-three-dimensional videos, especially some early classical movies or television series and the like, and the aspect ratio of most of the pictures is close to 1:1, for example, in the aspect ratio range of 16:9 to 1:1.5, which may also be referred to as 2D video. Because the structure of the 720 capsule-type screen is different from that of the flat screen, when such a video is displayed on the 720 capsule-type screen, objects in the displayed image are distorted, so that a user cannot normally watch the video through the 720 capsule-type screen, and the user experience is poor.

Disclosure of Invention

In view of the above, an object of the present invention is to provide a method, an apparatus and a related product for video processing based on 720 capsule-type screen, so as to overcome the drawbacks of the prior art.

In a first aspect, an embodiment of the present application provides a video processing method based on a 720-capsule type screen, an inner surface of the 720-capsule type screen being for providing continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720-capsule type screen including a cylindrical part and at least one end part, the method including: converting a video to be played into a video frame sequence arranged according to a time sequence, wherein the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5; determining a corresponding UV conversion relation according to the aspect ratio of the video frame image; according to the determined UV conversion relation, performing UV conversion on each video frame image in the video frame sequence to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a barrel-shaped part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the intersection line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of the circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; and generating a video file for displaying on the inner surface of the 720 capsule-type screen according to the video frame UV maps corresponding to the video frame images in the video frame sequence based on the positions of the video frame images in the video frame sequence.

In a second aspect, an embodiment of the present application provides a video processing device based on a 720-capsule type screen, an inner surface of the 720-capsule type screen being for providing continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720-capsule type screen including a cylindrical part and at least one end part, the device comprising: the video frame image acquisition module is used for converting a video to be played into a video frame sequence arranged according to a time sequence, and the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5; the conversion relation determining module is used for determining a corresponding UV conversion relation according to the aspect ratio of the video frame image; the UV conversion module is used for carrying out UV conversion on each video frame image in the video frame sequence according to the determined UV conversion relation to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; a generating module, configured to generate a video file for displaying on an inner surface of the 720 capsule-type screen according to a video frame UV map corresponding to each video frame image in the sequence of video frames based on positions of the video frame images in the sequence of video frames.

In a third aspect, an embodiment of the present application provides an electronic device, including: at least one processor, a memory, a communication interface, and a communication bus; the processor is connected with the memory and the communication interface through the communication bus, the memory is used for storing computer execution instructions, and the processor executes the computer execution instructions stored by the memory to execute the video processing method.

In a fourth aspect, embodiments of the present application provide a computer storage medium including computer-executable instructions for a processor to perform a video processing method as described above.

In a fifth aspect, an embodiment of the present application provides a video processing chip applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being used for providing continuous images with a viewing angle of 180 degrees to 360 degrees in a horizontal direction, the 720 capsule-type screen including a barrel and at least one end, the video processing chip calling a stored program to implement the following method: converting a video to be played into a video frame sequence arranged according to a time sequence, wherein the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5; determining a corresponding UV conversion relation according to the aspect ratio of the video frame image; according to the determined UV conversion relation, performing UV conversion on each video frame image in the video frame sequence to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a barrel-shaped part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the intersection line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of the circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; and generating a video file for displaying on the inner surface of the 720 capsule-type screen according to the video frame UV maps corresponding to the video frame images in the video frame sequence based on the positions of the video frame images in the video frame sequence.

The embodiment of the application provides a video processing scheme, and when the video frame UV map is displayed on the inner surface of the 720 capsule-type screen, objects in the images displayed on the inner surface of the barrel and the inner surface of the end part are not distorted, so that the traditional two-dimensional video can be processed into a video file which can be watched in real time through the 720 capsule-type screen based on the video frame UV map obtained through conversion, a user can directly watch the traditional two-dimensional video based on the 720 capsule-type screen, and a good panoramic immersive video watching experience can be obtained.

Drawings

Some specific embodiments of the present application will be described in detail hereinafter by way of illustration and not limitation with reference to the accompanying drawings. The same reference numbers in the drawings identify the same or similar elements or components. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the drawings:

FIGS. 1-37 are schematic block diagrams of various 720 capsule screens provided by an embodiment of the present application;

fig. 38 is a schematic flow chart of a video processing method according to an embodiment of the present application;

39-68 are schematic diagrams of various video frame UV maps provided by embodiments of the present application;

fig. 69a, 69b and 69c are schematic structural diagrams of a capsule-type screen according to an embodiment of the present disclosure;

FIG. 70 is a schematic view of another video frame UV map provided by an embodiment of the present application;

FIG. 71 is a schematic diagram illustrating a UV map of a video frame according to an embodiment of the present application;

fig. 72 is a schematic flow chart of a video processing method according to an embodiment of the present application;

fig. 73 is a schematic flow chart of a video processing method according to an embodiment of the present application;

fig. 74 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application;

fig. 75 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order to improve the comfort of the viewer watching the video, the image may be presented through a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being used to provide a continuous image of a viewing angle of 180 to 360 degrees in a horizontal direction, the 720 capsule-type screen including a cylindrical part and at least one end part. For example, the side wall of the cylindrical portion may be smoothly curved or straight in axial cross section, and the end portion and the cylindrical portion may be connected in a smooth transition manner.

Illustratively, fig. 1 is a schematic block diagram of a 720-capsule screen provided in an embodiment of the present application, in which, as shown in fig. 1, a cylinder 101 of the 720-capsule screen 100 is a cylinder, sidewalls of the cylinder 101 are linearly arranged in an axial cross-section, and the 720-capsule screen 100 includes an end 102, and the end 102 is located at one end of the cylinder 101. The viewer 103 is positioned in the tubular part 101, and the viewer 103 views 720 the image displayed on the capsule-type screen 100 facing the end 102. Since the cylindrical portion 101 of the 720-capsule-type screen 100 is an extension of the end portion 102, when the end portion 102 and the cylindrical portion 101 both display images, the immersion feeling of the viewers is strong, and since the inclination of the line of sight of the same row of viewers watching the 720-capsule-type screen 100 is uniform, the comfort of the viewers watching the video through the 720-capsule-type screen 100 is good.

Illustratively, referring to fig. 2, fig. 2(a) is a front view of a 720 capsule-type screen (diagonal lines indicate the ground, the same applies hereinafter), fig. 2(b) is a top view of the 720 capsule-type screen, fig. 2(c) is a left (or right) view of the 720 capsule-type screen, and fig. 2(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four drawings of fig. 2, the cylindrical part of the 720 capsule type screen has a circular cross section, both end parts have a semi-spherical shape, and the entire casing structure is similar to a capsule shape. The invention does not limit the specific value of the circular radius, and the person skilled in the art can design the circular radius according to the actual situation.

Illustratively, referring to fig. 3, fig. 3(a) is a front view of a 720 capsule-type screen, fig. 3(b) is a top view of the 720 capsule-type screen, fig. 3(c) is a left (or right) view of the 720 capsule-type screen, and fig. 3(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four drawings of fig. 3, the cross-section of the cylindrical part of the 720 capsule-type screen is elliptical. The invention does not limit the specific values of the major axis and the minor axis of the ellipse, nor the proportion of the major axis and the minor axis, and the person skilled in the art can design the ellipse according to the actual situation.

Illustratively, referring to fig. 4, fig. 4(a) is a front view of a 720 capsule-type screen, fig. 4(b) is a top view of the 720 capsule-type screen, fig. 4(c) is a left (or right) view of the 720 capsule-type screen, and fig. 4(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four drawings of fig. 4, the cross-section of the cylindrical part of the 720 capsule-type screen is square with rounded corners. Of course, in practical applications, the cross section of the cylindrical part may be a rectangle or other quadrangle with rounded corners. Wherein the purpose of the rounding is to enable a smooth transition with the two ends. The invention does not limit the specific numerical value of the side length of the quadrangle and the specific numerical value of the radius r of the fillet, and the person skilled in the art can design the quadrangle according to the actual situation.

Illustratively, referring to fig. 5, fig. 5(a) is a front view of a 720 capsule-type screen, fig. 5(b) is a top view of the 720 capsule-type screen, fig. 5(c) is a left (or right) view of the 720 capsule-type screen, and fig. 5(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four diagrams of fig. 5, the cross-section of the cylindrical part of the 720 capsule-type screen is an asymmetrical circle in the top and bottom. Of course, in practical applications, the cross section of the cylindrical portion may be a circle with left and right asymmetry. The invention does not limit the specific parameters of the asymmetric circle, and the person skilled in the art can design the asymmetric circle according to the actual situation.

Fig. 2 to 5 illustrate embodiments in which the side wall of the cylindrical portion is linearly arranged on the axial section, it should be understood that the above embodiments do not limit the present invention, and any embodiments satisfying that the side wall of the cylindrical portion is linearly arranged on the axial section are within the scope of the present invention.

Next, each embodiment in which the side wall of the cylindrical portion is arranged in an arc line in the axial section when the capsule-type screen is totally enclosed 720 will be described.

Illustratively, referring to fig. 6, fig. 6(a) is a front view of a 720 capsule-type screen, fig. 6(b) is a top view of the 720 capsule-type screen, fig. 6(c) is a left (or right) view of the 720 capsule-type screen, and fig. 6(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four drawings of fig. 6, the entire casing structure of the 720 capsule-type screen is an ellipsoid, and the cross-section of the ellipsoid is a circle. The invention does not limit the specific parameters of the ellipsoid shown in fig. 6, and a person skilled in the art can design the ellipsoid according to actual conditions.

Illustratively, referring to fig. 7, fig. 7(a) is a front view of a 720 capsule-type screen, fig. 7(b) is a top view of the 720 capsule-type screen, fig. 7(c) is a left (or right) view of the 720 capsule-type screen, and fig. 7(d) is a perspective view of the 720 capsule-type screen. The same as the 720-capsule type screen of fig. 6 is that the entire casing structure of the 720-capsule type screen of fig. 7 is also an ellipsoid, but it is different that the cross section of the ellipsoid is an ellipse. The invention does not limit the specific parameters of the ellipsoid shown in fig. 7, and a person skilled in the art can design the ellipsoid according to actual conditions.

Of course, it will be understood that the two embodiments of fig. 6 and 7 are the special case of the cylindrical portion side wall being arranged in an arc in the axial section, and when the cylindrical portion side wall is arranged in an arc in the axial section, the cross section of the cylindrical portion may also be an asymmetric circle, a quadrangle with rounded corners, etc. It should be noted that the sidewall of the cylindrical portion is disposed in an arc line or a straight line on the axial section does not necessarily mean that all the sidewalls of the cylindrical portion satisfy a certain line on the axial section, and may be disposed in a straight line on a part of the sidewalls, and disposed in an arc line, for example, the sidewall of the 720 capsule-type screen facing the viewer is disposed in a straight line, and the sidewall of the 720 capsule-type screen at the top of the viewer is disposed in an arc line.

The above embodiment describes a 720 capsule type screen with a fully enclosed shell structure, and the fully enclosed 720 capsule type screen has the advantages that the viewer can watch the display screen in 360 degrees and all directions, and the viewer has a very high non-boundary experience, but the cost is high. In order to save cost, the 720 capsule-type screen can adopt a partially-enclosed casing structure in practical application, and various embodiments of the partially-enclosed casing structure 720 capsule-type screen will be described one by one. In practical applications, the bottom of the 720 capsule-type screen can be "cut off" because viewers tend not to see the display image toward the bottom of the seat.

Illustratively, referring to fig. 8, the fig. 8 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 2, wherein fig. 8(a) is a front view of the 720-capsule type screen, fig. 8(b) is a top view of the 720-capsule type screen, fig. 8(c) is a left (or right) view of the 720-capsule type screen, and fig. 8(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 9, the fig. 9 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 3, wherein fig. 9(a) is a front view of the 720-capsule type screen, fig. 9(b) is a top view of the 720-capsule type screen, fig. 9(c) is a left (or right) view of the 720-capsule type screen, and fig. 9(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 10, the fig. 10 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 4, wherein fig. 10(a) is a front view of the 720-capsule type screen, fig. 10(b) is a top view of the 720-capsule type screen, fig. 10(c) is a left (or right) view of the 720-capsule type screen, and fig. 10(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 11, the fig. 11 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 5, wherein fig. 11(a) is a front view of the 720-capsule type screen, fig. 11(b) is a top view of the 720-capsule type screen, fig. 11(c) is a left (or right) view of the 720-capsule type screen, and fig. 11(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 12, the fig. 12 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 6, wherein fig. 12(a) is a front view of the 720-capsule type screen, fig. 12(b) is a top view of the 720-capsule type screen, fig. 12(c) is a left (or right) view of the 720-capsule type screen, and fig. 12(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 13, the fig. 13 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 7, wherein fig. 13(a) is a front view of the 720-capsule type screen, fig. 13(b) is a top view of the 720-capsule type screen, fig. 13(c) is a left (or right) view of the 720-capsule type screen, and fig. 13(d) is a perspective view of the 720-capsule type screen.

The invention does not specifically limit how much 720 capsule type screens are cut off, namely the degree of opening of the shell structure, in practical application, the invention can be determined according to the size and the position of a seat platform of a spectator, the size of the 720 capsule type screens and the like, and the principle of the invention is that the normal watching and the borderless feeling of the spectator in the vertical direction are not influenced. Preferably, at least the lowermost part of the first row of viewers in front of the screen is ensured to see 720 the capsule screen, and the lower boundary of the vertical field of vision of the human eyes is generally 70 degrees below the horizon.

In practical applications, the rear portion of the 720 capsule-type screen can be "cut away" because viewers tend not to view the display image toward the rear of the seat.

Exemplarily, referring to fig. 14, the fig. 14 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 2, wherein fig. 14(a) is a front view of the 720-capsule type screen, fig. 14(b) is a top view of the 720-capsule type screen, fig. 14(c) is a left (or right) view of the 720-capsule type screen, and fig. 14(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 15, the fig. 15 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 3, wherein fig. 15(a) is a front view of the 720-capsule type screen, fig. 15(b) is a top view of the 720-capsule type screen, fig. 15(c) is a left (or right) view of the 720-capsule type screen, and fig. 15(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 16, the fig. 16 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 4, wherein fig. 16(a) is a front view of the 720-capsule type screen, fig. 16(b) is a top view of the 720-capsule type screen, fig. 16(c) is a left (or right) view of the 720-capsule type screen, and fig. 16(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 17, the fig. 17 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 5, wherein fig. 17(a) is a front view of the 720-capsule type screen, fig. 17(b) is a top view of the 720-capsule type screen, fig. 17(c) is a left (or right) view of the 720-capsule type screen, and fig. 17(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 18, the fig. 18 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 6, wherein fig. 18(a) is a front view of the 720-capsule type screen, fig. 18(b) is a top view of the 720-capsule type screen, fig. 18(c) is a left (or right) view of the 720-capsule type screen, and fig. 18(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 19, the fig. 19 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 7, wherein fig. 19(a) is a front view of the 720-capsule type screen, fig. 19(b) is a top view of the 720-capsule type screen, fig. 19(c) is a left (or right) view of the 720-capsule type screen, and fig. 19(d) is a perspective view of the 720-capsule type screen. The invention does not specially limit how much of the 720 capsule type screen is cut off, namely the degree of the opening of the shell structure, in practical application, the invention can be determined according to the size and the position of the seat of the audience and the size of the 720 capsule type screen, and the principle is that the normal watching and the borderless feeling of the audience are not influenced. Preferably, at least 720 capsule-type screens are ensured to be visible at the top of the line of sight when the first row of viewers is looking straight ahead, and the upper boundary of the vertical field of vision of the human eyes is generally 50 degrees or more above the horizon.

In practical applications, the bottom and rear portions of the 720 capsule-type screen can also be "cut out" together for further cost savings.

Exemplarily, referring to fig. 20, the fig. 20 is a 720-capsule type screen after "cutting off" both a bottom and a rear portion of the 720-capsule type screen of the fig. 2, wherein fig. 20(a) is a front view of the 720-capsule type screen, fig. 20(b) is a top view of the 720-capsule type screen, fig. 20(c) is a left (or right) view of the 720-capsule type screen, and fig. 20(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 21, the fig. 21 is a 720-capsule type screen after "cutting off" both a bottom and a rear portion of the 720-capsule type screen of the fig. 3, wherein fig. 21(a) is a front view of the 720-capsule type screen, fig. 21(b) is a top view of the 720-capsule type screen, fig. 21(c) is a left (or right) view of the 720-capsule type screen, and fig. 21(d) is a perspective view of the 720-capsule type screen.

Illustratively, referring to fig. 22, the 720-capsule-type screen of fig. 4 is "cut off" at the bottom and rear portions thereof, wherein fig. 22(a) is a front view of the 720-capsule-type screen, fig. 22(b) is a top view of the 720-capsule-type screen, fig. 22(c) is a left (or right) view of the 720-capsule-type screen, and fig. 22(d) is a perspective view of the 720-capsule-type screen.

Illustratively, referring to fig. 23, the 720-capsule type screen of fig. 5 is "cut off" at the bottom and rear portions thereof, wherein fig. 23(a) is a front view of the 720-capsule type screen, fig. 23(b) is a top view of the 720-capsule type screen, fig. 23(c) is a left (or right) view of the 720-capsule type screen, and fig. 23(d) is a perspective view of the 720-capsule type screen.

Illustratively, referring to fig. 24, the fig. 24 is a 720-capsule type screen after "cutting off" both a bottom and a rear portion of the 720-capsule type screen of the fig. 6, wherein fig. 24(a) is a front view of the 720-capsule type screen, fig. 24(b) is a top view of the 720-capsule type screen, fig. 24(c) is a left (or right) view of the 720-capsule type screen, and fig. 24(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 25, the fig. 25 is a 720-capsule type screen after "cutting off" both a bottom and a rear portion of the 720-capsule type screen of the fig. 7, wherein fig. 25(a) is a front view of the 720-capsule type screen, fig. 25(b) is a top view of the 720-capsule type screen, fig. 25(c) is a left (or right) view of the 720-capsule type screen, and fig. 25(d) is a perspective view of the 720-capsule type screen.

The invention does not specially limit how much bottom and the rear 720 capsule type screen are cut off, and in practical application, the invention can be determined according to the size and the position of the seat platform of the audience, the size of the 720 capsule type screen and the like, and the principle of the invention is that the normal watching and the borderless feeling of the audience are not influenced. Preferably, at least the uppermost and lowermost parts of the line of sight of the first row of viewers in front view are ensured to see 720 the capsule-type screen, and in general, the upper boundary of the vertical field of vision of human eyes is 50 degrees above the horizon and the lower boundary is 70 degrees below the horizon.

The embodiments of fig. 1 to 25 are all symmetrical in the horizontal direction, but in practical applications, there may be asymmetrical structures, for example, where the housing structure has only one end.

Exemplarily, referring to fig. 26, the fig. 26 is a 720 capsule-type screen in which one end portion of the 720 capsule-type screen of fig. 2 is "cut off". Among them, fig. 26(a) is a front view of the 720 capsule-type screen, fig. 26(b) is a top view of the 720 capsule-type screen, fig. 26(c) is a left (or right) view of the 720 capsule-type screen, and fig. 26(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 27, the fig. 27 is a 720-capsule type screen in which one end portion of the 720-capsule type screen of fig. 3 is "cut off", in which fig. 27(a) is a front view of the 720-capsule type screen, fig. 27(b) is a top view of the 720-capsule type screen, fig. 27(c) is a left (or right) view of the 720-capsule type screen, and fig. 27(d) is a perspective view of the 720-capsule type screen.

Illustratively, referring to fig. 28, the fig. 28 is a 720-capsule type screen in which one end of the 720-capsule type screen of fig. 4 is "cut off", wherein fig. 28(a) is a front view of the 720-capsule type screen, fig. 28(b) is a top view of the 720-capsule type screen, fig. 28(c) is a left (or right) view of the 720-capsule type screen, and fig. 28(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 29, fig. 29 is a 720-capsule type screen in which one end portion of the 720-capsule type screen of fig. 5 is "cut off", in which fig. 29(a) is a front view of the 720-capsule type screen, fig. 29(b) is a top view of the 720-capsule type screen, fig. 29(c) is a left (or right) view of the 720-capsule type screen, and fig. 29(d) is a perspective view of the 720-capsule type screen.

Illustratively, referring to fig. 30, the fig. 30 is a 720-capsule type screen in which one end portion of the 720-capsule type screen of fig. 6 is "cut off", wherein fig. 30(a) is a front view of the 720-capsule type screen, fig. 30(b) is a top view of the 720-capsule type screen, fig. 30(c) is a left (or right) view of the 720-capsule type screen, and fig. 30(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 31, the fig. 31 is a 720-capsule type screen in which one end of the 720-capsule type screen of the fig. 7 is "cut off", wherein fig. 31(a) is a front view of the 720-capsule type screen, fig. 31(b) is a top view of the 720-capsule type screen, fig. 31(c) is a left (or right) view of the 720-capsule type screen, and fig. 31(d) is a perspective view of the 720-capsule type screen.

Each of fig. 26-31 is an embodiment in which the housing structure has only one end, and in order to further save costs, the bottom of the housing structure may be "cut away" on the premise that the housing structure has only one end.

Exemplarily, referring to fig. 32, the fig. 32 is a 720-capsule type screen of fig. 2 in which one end and bottom are "cut off". Among them, fig. 32(a) is a front view of the 720 capsule-type screen, fig. 32(b) is a top view of the 720 capsule-type screen, fig. 32(c) is a left (or right) view of the 720 capsule-type screen, and fig. 32(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 33, the fig. 33 is a 720-capsule type screen of fig. 3 in which one end and bottom are "cut off". Among them, fig. 33(a) is a front view of the 720 capsule-type screen, fig. 33(b) is a top view of the 720 capsule-type screen, fig. 33(c) is a left (or right) view of the 720 capsule-type screen, and fig. 33(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 34, the fig. 34 is a 720 capsule-type screen in which one end and bottom of the 720 capsule-type screen of fig. 4 are "cut off". Among them, fig. 34(a) is a front view of the 720 capsule-type screen, fig. 34(b) is a top view of the 720 capsule-type screen, fig. 34(c) is a left (or right) view of the 720 capsule-type screen, and fig. 34(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 35, the fig. 35 is a 720-capsule type screen of which one end and bottom are "cut off" of the 720-capsule type screen of fig. 5. Among them, fig. 35(a) is a front view of the 720 capsule-type screen, fig. 35(b) is a top view of the 720 capsule-type screen, fig. 35(c) is a left (or right) view of the 720 capsule-type screen, and fig. 35(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 36, the fig. 36 is a 720 capsule-type screen in which one end and bottom of the 720 capsule-type screen of fig. 6 are "cut off". Fig. 36(a) is a front view of the 720 capsule-type screen, fig. 36(b) is a top view of the 720 capsule-type screen, fig. 36(c) is a left (or right) view of the 720 capsule-type screen, and fig. 36(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 37, the fig. 37 is a 720 capsule-type screen in which one end and bottom of the 720 capsule-type screen of fig. 7 are "cut off". Fig. 37(a) is a front view of the 720 capsule-type screen, fig. 37(b) is a top view of the 720 capsule-type screen, fig. 37(c) is a left (or right) view of the 720 capsule-type screen, and fig. 37(d) is a perspective view of the 720 capsule-type screen. The invention does not specifically limit the specific cutting-off of the bottom on the premise that the 720 capsule-type screen only has one end, and in practical application, the cutting-off of the bottom can be determined according to the size and the position of a seat platform of a spectator, the size of the 720 capsule-type screen and the like, and the principle of the cutting-off of the bottom is that the normal watching and the borderless feeling of the spectator are not influenced. Preferably, at least the lowermost part of the first row of viewers in front of the screen is ensured to see 720 the capsule screen, and the lower boundary of the vertical field of vision of the human eyes is generally 70 degrees below the horizon.

In addition, the 720 capsule screen of the present invention may be a self-luminous 720 capsule screen, such as a LED (Light-Emitting Diode) dot-matrix screen or an OLED (Organic Light-Emitting Diode) dot-matrix screen, or may be a projection 720 capsule screen or other screens, and the present invention is not limited in particular.

In addition, due to the high cost of three-dimensional video production and the inexhaustibility of early three-dimensional video production technologies, most of the current videos are non-three-dimensional videos, especially some early classic movies or television series, and most of the videos are videos with a picture width close to a picture height, for example, videos with an aspect ratio ranging from 16:9 to 1:1.5, and such videos may also be referred to as 2D video. Because the structure of the 720 capsule-type screen is different from that of the flat screen, when such a video is displayed on the 720 capsule-type screen, objects in the displayed image are distorted, so that a user cannot normally watch the video through the 720 capsule-type screen, and the user experience is poor.

An embodiment of the present application provides a video processing method applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being for providing continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720 capsule-type screen including a cylindrical part and at least one end part, the video processing method by: converting a video to be played into a video frame sequence arranged according to a time sequence, wherein the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5; determining a corresponding UV conversion relation according to the aspect ratio of the video frame image; according to the determined UV conversion relation, performing UV conversion on each video frame image in the video frame sequence to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a barrel-shaped part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the intersection line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of the circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; and generating a video file for displaying on the inner surface of the 720 capsule-type screen according to the video frame UV maps corresponding to the video frame images in the video frame sequence based on the positions of the video frame images in the video frame sequence. When the 720 capsule-type screen is displayed on the inner surface, the image displayed on the inner surface of the cylindrical part and the image displayed on the inner surface of the end part are not distorted, so that the user can normally watch the video to be played through the 720 capsule-type screen, and the user experience is better.

The following further describes a specific implementation of the embodiment of the present invention with reference to the drawings of the embodiment of the present invention.

The embodiment of the present application provides a video processing method applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being used to provide continuous images of 180 to 360 degrees of viewing angle in a horizontal direction, the 720 capsule-type screen including a cylindrical portion and at least one end portion.

Illustratively, as shown in fig. 1, the cylinder 101 of the 720-capsule-type screen 100 is a cylinder, and the 720-capsule-type screen 100 includes one end 102, the end 102 being located at one end of the cylinder 101. The viewer 103 is positioned in the tubular part 101, and the viewer 103 views 720 the image displayed on the capsule-type screen 100 facing the end 102.

Of course, in other implementations, the sidewall of the cylindrical portion may be smoothly curved in axial cross-section, and the end portion and the cylindrical portion may be connected in a smooth transition manner. The shape of the axial interface of the cylindrical portion may include a circle, an ellipse, a quadrangle with rounded corners, or the like; 720 the capsule-type screen 100 may further include two ends positioned at both ends of the cylindrical part, which is not limited in the embodiment of the present application.

Fig. 38 is a schematic flowchart of a video processing method according to an embodiment of the present application, and as shown in fig. 38, the video processing method includes the following steps:

201. and converting the video to be played into a video frame sequence arranged according to the time sequence.

Wherein the aspect ratio of the video frame images in the video frame sequence ranges from 16:9 to 1: 1.5.

Specifically, the video to be played is converted into a sequence of video frames arranged according to a time sequence, which may be a sequence of video frames to which a part of the video to be played in a specified playing time interval is converted, or a sequence of video frames to which all of the video to be played is converted.

Optionally, in an embodiment of the present application, the initial ratio includes at least one of: 5:4, 1:1, 4: 3.

Specifically, the advanced extended Graphics Array (SXGA) standard is one of the standards supported by commercial computers, and the SXGA standard has a resolution of 1280 × 1024, which has an aspect ratio of 5:4, and is commonly used for 17-inch screens and 19-inch screens.

From the end of the 19 th century through the 50 th of the 20 th century, almost all movie pictures have an aspect ratio of 4:3, that is, a width of 4 units and a height of 3 units. This ratio is sometimes expressed as 1.33:1, that is, the width of the picture is 1.33 times the height. Due to such a convention, the screen ratio of the liquid crystal display is also dominated by 4: 3. Although wide-screen movies, wide-screen televisions, and wide-screen displays have started to rise in recent years, the aspect ratio of the screen resolution is 4:3 for the vast majority of cases before wide-screen display has started. For example, the Video Graphics Array (VGA) standard is a standard commonly supported by many pc manufacturers, and a pc must support the VGA standard before loading its own unique driver. The boot-up screen of microsoft Windows series still uses VGA display mode, which also indicates its importance and compatibility in the display standard, and the VGA standard supports 640 × 480 resolution, corresponding to 4:3 aspect ratio.

202. And determining a corresponding UV conversion relation according to the aspect ratio of the video frame image.

Specifically, the aspect ratio of the sample video frame UV maps obtained after conversion through the plurality of UV conversion relationships may be predetermined, then the aspect ratio of the video frame image and the aspect ratios of the plurality of sample video frame UV maps may be compared, the sample video frame UV map closest to the aspect ratio of the video frame image is determined, and the UV conversion relationship corresponding to the sample video frame UV map is determined as the UV conversion relationship corresponding to the video frame image.

203. And performing UV conversion on each video frame image in the video frame sequence according to the determined UV conversion relation to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a barrel-shaped part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the intersection line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of the circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments.

Specifically, UV conversion may be performed in accordance with a tube UV conversion relationship with respect to a video region for presentation in a tube in the video frame image; and performing UV conversion on a video area used for showing at the end in the video frame image according to the end UV conversion relation to obtain a video frame UV map comprising a first area and a second area. The tube-shaped UV conversion relationship and the end UV conversion relationship may be obtained in advance.

Exemplarily, the two-dimensional coordinates of each pixel point in the video frame image in the video area for displaying in the tubular part can be converted into UV coordinates according to the tubular UV conversion relationship, and rendering is performed according to the UV coordinates of each pixel point in the area, the color value of each pixel point in the first area, and the like; and converting the two-dimensional coordinates of each pixel point in the video area used for displaying at the end part in the frequency frame image into UV coordinates according to the UV conversion relation of the end part, and rendering according to the UV coordinates of each pixel point in the area, the color value of each pixel point in the second area and the like. The UV coordinate is U, V for short, and comprises a U coordinate and a V coordinate, and the value ranges of the coordinate values of the U coordinate and the V coordinate are both (0, 1).

The boundary line of the first area and the second area comprises a plurality of arc line segments, and the circle center of a circle where the arc line segments are located and the center of the video frame UV map are located on two sides of the arc line segments.

For example, fig. 39 is a schematic diagram of a video frame UV map provided in the embodiment of the present application, as shown in fig. 39, the video frame UV map is composed of a first area 301 and a second area 302, wherein an intersection line of the first area 301 and the second area 302 includes an arc segment 3001, an arc segment 3002, and an arc segment 3003. The center 3111 of the circle in which the arc segment 3001 is located and the center of the video frame UV map are located on the same side of the arc segment 3001, the center 3112 of the circle in which the arc segment 3002 is located and the center of the video frame UV map are located on the same side of the arc segment 3002, and the center 3113 of the circle in which the arc segment 3003 is located and the center of the video frame UV map are located on the same side of the arc segment 3003.

In addition, in any embodiment of the present application, the outer boundary of the UV map of the video frame may also include an arc segment.

Exemplarily, fig. 40 is a schematic view of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 40, left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc line segment, and a center of a circle where the arc line segment is located and a center of the video frame UV map are located at two sides of the arc line segment respectively.

Exemplarily, fig. 41 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, as shown in fig. 41, left and right boundaries of the video frame UV map are arc segments, and a center of a circle where the arc segment of the left or right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively.

Exemplarily, fig. 42 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a left and right boundary between the two protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are respectively located at two sides of the arc segment; the lower edge of the video frame UV map comprises a lower edge arc line segment, the circle center of a circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment, therefore, under the condition that the top of the video frame UV map is a straight line segment, the effective height in the middle of the video frame UV map obtained after conversion can be smaller than the effective heights on two sides through the lower edge arc line segment, and further, when the video frame UV map is displayed, an object in the center of the video frame UV map moves upwards, and the effective height can be the distance between the upper edge and the lower edge of the video frame UV map in the vertical direction. Specifically, the lower edge arc segment is symmetrical about the vertical center line of the video frame UV map.

For example, fig. 43 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 42, the aspect ratio of the video frame UV map shown in fig. 43 is closer to 1:1. fig. 42 may be a video frame UV map after image conversion of a video frame with an aspect ratio of 16:9, with an aspect ratio closer to 1: fig. 43 of fig. 1 may be a video frame UV map after image conversion of a video frame having an aspect ratio of 4: 3.

For example, fig. 44 is a schematic view of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are located on two sides of the arc segment respectively. In contrast to fig. 41, fig. 44 shows the boundary of the projection as an arc line segment.

For example, fig. 45 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 44, the aspect ratio of the video frame UV map shown in fig. 45 is closer to 1:1.

for example, fig. 46 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 46, the shape of the video frame UV map is a sector.

For example, fig. 47 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 46, the aspect ratio of the video frame UV map shown in fig. 47 is closer to 1:1.

for example, fig. 48 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 48, the left and right side boundaries of the video frame UV map are straight line segments, the upper and lower boundaries are arc line segments, and the center of a circle where the arc line segments are located is located below the arc line segments, so that when the video frame UV map is displayed, an object at the center of the video frame UV map moves upwards.

For example, fig. 49 is a schematic diagram of a video frame UV map provided by an embodiment of the present application, and compared with fig. 48, in a direction from top to bottom, a distance between straight line segments shown in fig. 49 as boundaries on left and right sides of the video frame UV map gradually decreases.

Exemplarily, fig. 50 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right boundaries of the video frame UV map are arc segments, and a circle center of a circle where the arc segment of the left or right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively; the upper and lower boundaries of the video frame also comprise arc line segments which are an upper edge arc line segment and a lower edge arc line segment respectively, and the circle center of a circle where the upper edge arc line segment is located and the center of the video frame UV map are located on the same side of the arc line segments; the circle center of the circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment. Therefore, when the video frame UV map is displayed, the object in the center of the video frame UV map moves upwards. Because in general video, the content that the user is expected to focus on is generally in the central part of the video frame; by moving the object in the center of the UV map of the video frame upwards, the displayed content is more in line with the viewing habit of the user, and the user experience is improved.

For example, fig. 51 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 50, the aspect ratio of the video frame UV map shown in fig. 51 is closer to 1:1.

exemplarily, fig. 52 is a schematic diagram of a video frame UV map provided by an embodiment of the present application, and compared with fig. 50, the top of the video frame UV map shown in fig. 52 includes a first sub-area for being displayed at the top of the barrel of the 720 capsule-type screen, and when the inner surface of the 720 capsule-type screen is displayed, the upper edge of the first sub-area meets a point at the top of the 720 capsule-type screen.

For example, fig. 53 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 52, the aspect ratio of the video frame UV map shown in fig. 53 is closer to 1:1.

exemplarily, fig. 54 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 54, boundaries of left and right sides and an upper side of the video frame UV map are arc segments, and a center of a circle where each arc segment is located and a center of the video frame UV map are located on the same side of the arc segment.

Exemplarily, fig. 55 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 55, boundaries of left and right sides, upper and lower sides, and a circle center of a circle where each arc line is located and a center of the video frame UV map are located on a same side of the arc line.

Exemplarily, fig. 56 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 56, boundaries of left and right sides, upper and lower sides, and both sides of the video frame UV map are arc segments, and a circle center of a circle where the arc segments on the upper and lower sides are located and a center of the video frame UV map are located at a same side of the arc segments; the circle center of the circle where the arc line sections on the left side and the right side are located and the center of the video frame UV map are located on the two sides of the arc line section.

For example, fig. 57 is a schematic view of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 57, boundaries on left and right sides of the video frame UV map are straight line segments, upper and lower boundaries are arc line segments, and centers of circles where the arc line segments are located below the arc line segments.

For example, fig. 58 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 57, in a direction from top to bottom, distances between straight line segments shown in fig. 58 as boundaries on left and right sides of the video frame UV map are gradually decreased.

Exemplarily, fig. 59 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 59, left and right boundaries of the video frame UV map are arc segments, and a center of a circle where the arc segment of the left or right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively.

Exemplarily, fig. 60 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 60, left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc line segment, and a center of a circle where the arc line segment is located and a center of the video frame UV map are located at two sides of the arc line segment respectively.

Exemplarily, fig. 61 is a schematic view of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a boundary between the two protruding portions includes a plurality of arc segments, and a center of a circle where the arc segments are located and a center of the video frame UV map are respectively located at two sides of the arc segments.

For example, fig. 62 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 61, the aspect ratio of the video frame UV map shown in fig. 62 is closer to 1:1.

exemplarily, fig. 63 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map include protruding portions, a left boundary of the left protruding portion and a right boundary of the right protruding portion are arc segments, a boundary below the protruding portion is also an arc segment, and a circle center of a circle where the arc segment corresponding to the boundary below the protruding portion is located and a center of the video frame UV map are located on two sides of the arc segment respectively; the lower edge of the video frame UV map comprises a lower edge arc line segment, and the circle center of the circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment, so that the height in the middle of the video frame UV map obtained after conversion can be reduced through the lower edge arc line segment under the condition that the tops of the video frame UV maps are the same, and further, when the video frame UV map is displayed, an object in the center of the video frame UV map moves upwards. Specifically, the lower edge arc segment is symmetrical about the vertical center line of the video frame UV map.

For example, fig. 64 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 63, the aspect ratio of the video frame UV map shown in fig. 64 is closer to 1:1.

exemplarily, fig. 65 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a boundary between the two protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are respectively located at two sides of the arc segment; the boundary of the projection is also an arc segment.

For example, fig. 66 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 65, the aspect ratio of the video frame UV map shown in fig. 66 is closer to 1:1.

for example, fig. 67 is a schematic view of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 67, boundaries on left and right sides of the video frame UV map respectively include a plurality of arc segments.

For example, fig. 68 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 67, the aspect ratio of the video frame UV map shown in fig. 68 is closer to 1:1.

204. and generating a video file for displaying on the inner surface of the 720 capsule-type screen according to the video frame UV maps corresponding to the video frame images in the video frame sequence based on the positions of the video frame images in the video frame sequence.

Specifically, the video frame UV map is displayed on the inner surface of the capsule-type screen 720, and the video frame UV map may be projected on the inner surface of the capsule-type screen 720 by a projector or displayed on a flexible display screen disposed on the inner surface of the capsule-type screen 720. Of course, the above description is merely illustrative and not restrictive of the present application.

Additionally, a projection system may be included in the 720 capsule-type screen, the projection system including at least two sets of projectors mounted inside the 720 capsule-type screen. Illustratively, at least two groups of projectors installed inside the 720 capsule-type screen may be arranged in layers in a central axis direction of the 720 capsule-type screen, each group of projectors projecting a portion on an inner surface of the 720 capsule-type screen, respectively, such that an optical path of the at least two groups of projectors avoids a viewer, wherein the central axis of the 720 capsule-type screen is an axis passing through a center of the 720 capsule-type screen and having left and right symmetry.

Correspondingly, the process of presenting the video file may include:

dividing the UV mapping of the video frame according to the number and the positions of at least two groups of projectors in the projection system to obtain a plurality of sub UV mappings used for being projected by the projectors; and controlling a projector in the projection system to project a plurality of sub UV maps on the inner surface of the 720 capsule type screen so as to show the video file on the 720 capsule type screen.

Specifically, in order to make the displayed adjacent sub-UV maps appear as one body without a splicing trace when displayed, the adjacent sub-UV maps may have fused edges, and the fused edges of the adjacent sub-UV maps overlap each other when the adjacent sub-UV maps are projected 720 on the inner surface of the capsule-type screen, so that the viewer may consider the displayed adjacent sub-UV maps as a continuous map.

In an embodiment of the present application, a projection system including at least two sets of projectors installed inside a 720 capsule-type screen can display a video file on the 720 capsule-type screen by dividing a video frame UV map according to the number and positions of at least two sets of projectors in the projection system, obtaining a plurality of sub-UV maps for projection by the projectors, and controlling the projectors in the projection system to project the plurality of sub-UV maps on the inner surface of the 720 capsule-type screen.

The embodiment of the application provides a video processing method, which comprises the steps of converting a video to be played into a video frame sequence arranged according to a time sequence, wherein the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5; determining a corresponding UV conversion relation according to the aspect ratio of the video frame image; according to the determined UV conversion relation, performing UV conversion on each video frame image in the video frame sequence to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a barrel-shaped part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the intersection line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of the circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; and generating a video file for displaying on the inner surface of the 720 capsule-type screen according to the video frame UV maps corresponding to the video frame images in the video frame sequence based on the positions of the video frame images in the video frame sequence. When the video frame UV map is displayed on the inner surface of the 720 capsule-type screen, the image displayed on the inner surface of the tube and the image displayed on the inner surface of the end portion are not distorted, so that the user can normally watch the video to be played through the inner surface of the 720 capsule-type screen, and the user experience is good.

The third embodiment of the application provides a video processing method. In the present embodiment, the cylindrical part 101 is divided in the circumferential direction into a first sub-cylindrical part 1011, a second sub-cylindrical part 1012, and a third sub-cylindrical part 1013, wherein the first sub-cylindrical part 1011 is located at the top of the capsule-type screen 100 at 720, and a boundary between the second sub-cylindrical part 1012 and the first sub-cylindrical part 1011 and a boundary between the third sub-cylindrical part 1013 and the first sub-cylindrical part 1011 are symmetrical about a vertical plane 1041 passing through the cylindrical part axis 104. As shown in fig. 69a, 69b, 69 c.

Correspondingly, as shown in fig. 70, fig. 70 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where the first region 301 includes a first sub-region 3011 for being displayed in the first sub-cylinder 1011, a second sub-region 3012 for being displayed in the second sub-cylinder 1012, and a third sub-region 3013 for being displayed in the third sub-cylinder 1013, the first sub-region 3011 is located above the second region 302, the second sub-region 3012 and the third sub-region 3013 are respectively located on two sides of the second region 302 and are communicated through the first sub-region 3011, and the second sub-region 3012 and the third sub-region 3013 are symmetrical with respect to a central line of the first sub-region 3011 in a width direction of a video frame image of the two-dimensional video.

In the embodiment of the present application, for convenience of viewing, the top surface of the tubular portion is used for displaying the upper half portion of the video frame image, and the side surfaces of the tubular portion are used for displaying the left and right portions of the video frame image, so that when the UV conversion is directly performed on the first area according to the tubular UV conversion relationship, the calculation difficulty for obtaining the first area is high.

Therefore, in the embodiment of the application, when the cylindrical part is divided into the first sub-cylindrical part, the second sub-cylindrical part and the third sub-cylindrical part along the circumferential direction, the first region includes the first sub-region for being displayed on the first sub-cylindrical part, the second sub-region for being displayed on the second sub-cylindrical part and the third sub-region for being displayed on the third sub-cylindrical part, and the UV conversion relation corresponding to the first sub-region in the cylindrical UV conversion relation is performed to obtain the first sub-UV map corresponding to the first sub-region. And obtaining the first area according to the first sub UV map, the second sub UV map and the third sub UV map, thereby reducing the calculation difficulty for obtaining the first area.

Optionally, in this embodiment, the first area includes a first sub-area 3011 for being displayed at the top of the barrel of the 720 capsule-type screen, and when the inner surface of the 720 capsule-type screen is displayed, an upper edge of the first sub-area 3011 meets a point at the top of the 720 capsule-type screen. Specifically, it may meet at the midpoint B' at the top of the 720 capsule-type screen.

For example, as shown in fig. 71, when the 720 capsule-type screen is shown on the inner surface, the left and right edges of the first sub-area overlap at the top of the capsule type, i.e., C, D points of the left and right edges overlap at C ' to form an overlap line B ' -C ', which may be an extension of the center line a ' -B ' of the first sub-area in the width direction of the video frame UV map.

The method of the present embodiment may be performed by any suitable electronic device having data processing capabilities, including but not limited to: servers, mobile terminals (such as tablet computers, mobile phones and the like), PCs and the like.

The embodiment of the application provides a video processing method. Fig. 72 is a schematic flowchart of a video processing method provided in the embodiment of the present application, and as shown in fig. 72, on the basis of the video processing method provided in the first embodiment, in this embodiment, step 201 can be specifically implemented by steps 2011 to step 2012:

2011. the method comprises the steps of obtaining a plurality of video frame images included in a video to be played, and determining the maximum inscribed rectangle of each video frame image.

Wherein the ratio of the aspect ratio of the maximum inscribed rectangle ranges from 16:9 to 1: 1.5.

Specifically, a rectangle having an aspect ratio of a preset ratio (ratio range of 16:9 to 1:1.5) may be formed within the boundary of the video frame image. The long side of the rectangle is parallel to the long side of the boundary of the video frame image, and the short side of the rectangle is parallel to the short side of the boundary of the video frame image. The size of the rectangle is continuously increased until two opposite sides of the four sides of the rectangle are coincident with the boundary of the video frame image (the two opposite sides of the rectangle can be a pair of long sides of the rectangle and can also be a pair of short sides of the rectangle), and at this time, the rectangle is the largest inscribed rectangle of the video frame image.

2012. And cutting the video frame images according to the maximum inscribed rectangle to obtain the video frame images with the aspect ratio ranging from 16:9 to 1:1.5, and arranging a plurality of cut video frame images according to a time sequence to form a video frame sequence.

A video frame image to be processed adapted to the 720 capsule type screen, i.e., a video frame image having an aspect ratio ranging from 16:9 to 1: 1.5.

Specifically, the image in the largest inscribed rectangle may be clipped from the video frame image as the video frame image to be processed.

In the embodiment of the application, the aspect ratio of the maximum inscribed rectangle of the video frame image is determined to be a preset proportion, and the video frame image is cut according to the maximum inscribed rectangle to obtain the video frame image to be processed which is adapted to the 720 capsule-type screen, so that the aspect ratio of objects in the video frame image to be processed and the aspect ratio of objects in the video frame image to be processed can be kept consistent on the premise of not losing the image content in the video frame image as much as possible, and the distortion of the objects in the video frame image to be processed is avoided.

The embodiment of the application provides a video processing method. Fig. 73 is a schematic flowchart of a video processing method provided in the embodiment of the present application, and as shown in fig. 73, on the basis of the video processing method provided in the first embodiment, in this embodiment, step 201 may specifically be implemented by step 2013 to step 2014:

2013. the method comprises the steps of obtaining a plurality of video frame images included in a video to be played, and determining the minimum circumscribed rectangular area of each video frame image.

Wherein the ratio of the aspect ratio of the minimum circumscribed rectangle is in the range of 16:9 to 1: 1.5.

Specifically, a rectangle having an aspect ratio of a preset ratio (ratio range of 16:9 to 1:1.5) may be formed outside the video frame image. The long side of the rectangle is parallel to the long side of the boundary of the video frame image, and the short side of the rectangle is parallel to the short side of the boundary of the video frame image. The size of the rectangle is continuously reduced until two opposite sides of the four sides of the rectangle are all overlapped with the boundary of the video frame image (the two opposite sides of the rectangle can be a pair of long sides of the rectangle, and can also be a pair of short sides of the rectangle), and at this moment, the rectangle is the minimum circumscribed rectangle of the video frame image.

2014. Filling the areas except the video frame images in the minimum circumscribed rectangular area to obtain the video frame images to be processed which are adaptive to the 720 capsule type screen, and arranging the filled video frame images according to the time sequence to form a video frame sequence.

Specifically, the area other than the video frame image in the minimum bounding rectangle area may be filled with the preset image content. Illustratively, the areas except for the video frame image in the minimum circumscribed rectangular area can be filled with pure black image content, so as to avoid adding content which may interfere with the user viewing experience to the video frame image to be processed.

In the embodiment of the application, the aspect ratio of the minimum circumscribed rectangle is determined to be a preset ratio, and the areas except the video frame image in the minimum circumscribed rectangle area are filled to obtain the video frame image to be processed which is adapted to the 720 capsule-type screen, so that the aspect ratio of objects in the video frame image to be processed is consistent with the aspect ratio of objects in the video frame image on the premise that image content which does not exist in the video frame image is not added into the video frame image to be processed as far as possible, and the content which possibly causes interference to the user watching experience exists in the video frame image to be processed is avoided.

Fig. 74 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application, and as shown in fig. 74, the video processing apparatus 400 includes: a video frame image acquisition module 401, a conversion relation determination module 402, a UV conversion module 403, and a generation module 404.

The video frame image obtaining module 401 is configured to convert a video to be played into a sequence of video frames arranged according to a time sequence, where a ratio range of an aspect ratio of video frame images in the sequence of video frames is 16:9 to 1: 1.5;

a conversion relation determining module 402, configured to determine a corresponding UV conversion relation according to an aspect ratio of the video frame image;

a UV conversion module 403, configured to perform UV conversion on each video frame image in the sequence of video frames according to a determined UV conversion relationship, to obtain a video frame UV map, where the video frame UV map includes a first area for displaying in a cylindrical portion of the 720 capsule-type screen and a second area for displaying at an end of the 720 capsule-type screen, where a boundary line between the first area and the second area includes a plurality of boundary arc segments, and a center of a circle where the boundary arc segments are located and a center of the video frame UV map are located on the same side of the arc segments;

a generating module 404 for generating a video file for presentation on an inner surface of the 720 capsule-type screen according to the video frame UV map.

An embodiment of the present application provides a video processing apparatus applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being for providing a continuous image of a viewing angle of 180 degrees to 360 degrees in a horizontal direction, the 720 capsule-type screen including a cylindrical portion and at least one end portion, the processing apparatus including: the video frame image acquisition module is used for converting a video to be played into a video frame sequence arranged according to a time sequence, and the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5; the conversion relation determining module is used for determining a corresponding UV conversion relation according to the aspect ratio of the video frame image; the UV conversion module is used for carrying out UV conversion on each video frame image in the video frame sequence according to the determined UV conversion relation to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; a generating module, configured to generate a video file for displaying on an inner surface of the 720 capsule-type screen according to a video frame UV map corresponding to each video frame image in the sequence of video frames based on positions of the video frame images in the sequence of video frames.

Based on the video processing method described in the foregoing embodiments, an embodiment of the present application provides an electronic device, configured to execute the video processing method described in any one of the foregoing embodiments, and fig. 75 is a schematic structural diagram of the electronic device provided in the embodiment of the present application, as shown in fig. 75, where the electronic device 50 includes: at least one processor (processor)502, memory 504, bus 506, and communication Interface 508.

Wherein:

the processor 502, communication interface 508, and memory 504 communicate with each other via a communication bus 506.

A communication interface 508 for communicating with other devices.

The processor 502 is configured to execute the program 510, and may specifically execute the relevant steps in the method described in the foregoing embodiment.

In particular, program 510 may include program code that includes computer operating instructions.

The processor 502 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement an embodiment of the present invention. The electronic device comprises one or more processors, which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

The memory 504 is used for storing the program 510. Memory 504 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

The embodiment of the application provides a video processing chip, which is applied to a 720 capsule type screen, wherein the inner surface of the 720 capsule type screen is used for providing continuous images with 180-360-degree visual angles in the horizontal direction, the 720 capsule type screen comprises a barrel part and at least one end part, and the video processing chip calls a stored program to realize the following method: converting a video to be played into a video frame sequence arranged according to a time sequence, wherein the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5; determining a corresponding UV conversion relation according to the aspect ratio of the video frame image; according to the determined UV conversion relation, performing UV conversion on each video frame image in the video frame sequence to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a barrel-shaped part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the intersection line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of the circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; and generating a video file for displaying on the inner surface of the 720 capsule-type screen according to the video frame UV maps corresponding to the video frame images in the video frame sequence based on the positions of the video frame images in the video frame sequence.

The calibration device of the embodiments of the present application exists in a variety of forms, including but not limited to:

(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include: smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.

(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.

(3) A portable entertainment device: such devices can display and play multimedia content. This type of device comprises: audio, video players (e.g., ipods), handheld game consoles, electronic books, and smart toys and portable car navigation devices.

(4) And other electronic equipment with data interaction function.

Thus, particular embodiments of the present subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may be advantageous.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular transactions or implement particular abstract data types. The application may also be practiced in distributed computing environments where transactions are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A 720-capsule-type-screen-based video processing method, wherein an inner surface of the 720-capsule-type screen is used to provide continuous images of a 180-360 degree viewing angle in a horizontal direction, the 720-capsule-type screen including a cylindrical part and at least one end part, the method comprising:

converting a video to be played into a video frame sequence arranged according to a time sequence, wherein the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5;

determining a corresponding UV conversion relation according to the aspect ratio of the video frame image;

according to the determined UV conversion relation, for each video frame image in the video frame sequence, carrying out UV conversion on a video area used for displaying in a tubular part in the video frame image according to the tubular UV conversion relation; carrying out UV conversion on a video area used for being displayed at the end in the video frame image according to an end UV conversion relation to obtain a video frame UV map comprising a first area and a second area, wherein a boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments;

and generating a video file for displaying on the inner surface of the 720 capsule-type screen according to the video frame UV maps corresponding to the video frame images in the video frame sequence based on the positions of the video frame images in the video frame sequence.

2. The video processing method according to claim 1, wherein said converting the video to be played into a sequence of video frames arranged in time sequence comprises:

acquiring a plurality of video frame images included in a video to be played, and determining a maximum inscribed rectangle of each video frame image, wherein the ratio range of the aspect ratio of the maximum inscribed rectangle is 16:9 to 1: 1.5;

and cutting the video frame images according to the maximum inscribed rectangle to obtain the video frame images with the aspect ratio ranging from 16:9 to 1:1.5, and arranging a plurality of cut video frame images according to a time sequence to form a video frame sequence.

3. The video processing method according to claim 1, wherein said converting the video to be played into a sequence of video frames arranged in time sequence comprises:

acquiring a plurality of video frame images included in a video to be played, and determining a minimum circumscribed rectangle area of each video frame image, wherein the ratio range of the aspect ratio of the minimum circumscribed rectangle is 16:9 to 1: 1.5;

filling the areas except the video frame images in the minimum circumscribed rectangular area to obtain the video frame images to be processed which are adaptive to the 720 capsule type screen, and arranging a plurality of filled video frame images according to the time sequence to form a video frame sequence.

4. The video processing method of claim 1, wherein the aspect ratio of the video frame image comprises at least one of: 5:4, 1:1, 4: 3.

5. The video processing method according to claim 1, wherein the lower edge of the video frame UV map comprises a lower edge arc segment, and the center of the circle where the lower edge arc segment is located and the center of the video frame UV map are located on both sides of the arc segment.

6. The video processing method of claim 5, wherein the lower edge arc segment is symmetric about a vertical center line of the video frame UV map.

7. The video processing method of claim 1, wherein the aspect ratio of the UV map for the video frame is in the range of 1:1 to 2: 1.

8. The video processing method as claimed in claim 1, wherein the first area includes a first sub-area for presentation at the top of the barrel of the 720 capsule-type screen, and an upper edge of the first sub-area meets a point at the top of the 720 capsule-type screen at the time of presentation of the inner surface of the 720 capsule-type screen.

9. The video processing method of claim 8, wherein when the 720 capsule type screen is shown on its inner surface, the left and right edges of the first sub-area overlap at the top of the capsule type forming an overlap line.

10. A 720-capsule-type-screen-based video processing device, wherein an inner surface of the 720-capsule-type screen is used to provide continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720-capsule-type screen including a cylindrical part and at least one end part, the device comprising:

the video frame image acquisition module is used for converting a video to be played into a video frame sequence arranged according to a time sequence, and the ratio range of the aspect ratio of video frame images in the video frame sequence is 16:9 to 1: 1.5;

the conversion relation determining module is used for determining a corresponding UV conversion relation according to the aspect ratio of the video frame image;

the UV conversion module is used for carrying out UV conversion on a video area which is used for being shown in the tubular part in the video frame image according to a tubular UV conversion relation; aiming at a video area used for being displayed at an end part in a video frame image, carrying out UV conversion according to an end part UV conversion relation to obtain a video frame UV map comprising a first area and a second area, wherein a boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments;

a generating module, configured to generate a video file for displaying on an inner surface of the 720 capsule-type screen according to a video frame UV map corresponding to each video frame image in the sequence of video frames based on positions of the video frame images in the sequence of video frames.

11. An electronic device, comprising: at least one processor, a memory, a communication interface, and a communication bus;

the processor is connected to the memory and the communication interface through the communication bus, the memory is used for storing computer execution instructions, and the processor executes the computer execution instructions stored by the memory to execute the video processing method according to any one of claims 1-9.

12. A computer storage medium, characterized in that the computer storage medium comprises computer executable instructions for a processor to perform the video processing method according to any of claims 1-9.