CN116614648B - Free view video display method and system based on view angle compensation system - Google Patents
Free view video display method and system based on view angle compensation system Download PDFInfo
- Publication number
- CN116614648B CN116614648B CN202310414704.2A CN202310414704A CN116614648B CN 116614648 B CN116614648 B CN 116614648B CN 202310414704 A CN202310414704 A CN 202310414704A CN 116614648 B CN116614648 B CN 116614648B
- Authority
- CN
- China
- Prior art keywords
- picture
- video stream
- angle
- virtual point
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 230000000007 visual effect Effects 0.000 claims abstract description 9
- 230000001186 cumulative effect Effects 0.000 claims description 4
- 230000006855 networking Effects 0.000 abstract description 5
- 230000002452 interceptive effect Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to a free view video display method and a free view video display system. The virtual point positioning module establishes a virtual point based on a main vision center point of a current camera video stream in a shooting system, when a threshold judging module judges that the accumulated rotation visual angle of a user under the current camera video stream exceeds an optimal picture display threshold, the video stream control module requests a content distribution network to switch to a new video stream corresponding to a next camera in the shooting system, the field angle fitting module calculates coordinates of the rotated virtual point in the new video stream, coordinate fitting is carried out, a picture rotation angle is obtained, picture interpolation compensation is carried out, and a picture after compensation is provided for a player for display by the picture display module. According to the invention, only eight panoramic cameras are needed, continuous and smooth switching of panoramic video streams can be realized with lower video shooting cost, and the method can be widely applied to various application scenes needing high-definition multi-dimensional interactive display of video content in the field of video networking.
Description
Technical Field
The invention relates to the field of video display of a video networking terminal, in particular to a free view video display method and a free view video display system based on a view angle compensation system.
Background
In application scenes such as sports events, singing concerts and remote monitoring, which need to display video content in high definition, effects such as virtual-real combination, immersion interaction, multidimensional display and the like are often realized by shooting free view video.
At present, shooting of free view video content typically requires cameras to be set at 36 to 60 positions. For example, as shown in fig. 1, taking a photographing point as a center, taking a proper distance as a radius, and placing ordinary cameras at intervals of 10 ° to photograph free view angle contents, cameras 1 to 36 photograph together, and photographing costs are high. Accordingly, the bandwidth and terminal performance requirements of the content delivery network CDN are also high when video content is played. Further, when the content is played, the user switches to the video stream of the next camera when clicking the remote controller button, and because of time delay in switching, the time delay in switching is obvious under the condition that the number of shooting cameras is large, and the phenomenon of blocking and the like can also occur, so that the watching experience of the user is influenced.
Therefore, there is a need for a free view interactive video display method and system that can ensure smoothness and viewing effect of view switching and reduce requirements on bandwidth and terminal performance at the same time with smaller video shooting cost, so as to be used for high definition display of video free view in the field of video networking, and realize real-time interaction and virtual-real combination.
Disclosure of Invention
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter; nor is it intended to be used to determine or limit the scope of the claimed subject matter.
According to the free view video display method based on the view angle compensation system, only eight panoramic cameras are used in combination with the view angle switching compensation system, so that the switching of panoramic video streams can be controlled, the continuous smoothness of pictures after switching is ensured, and the free view video display method based on the view angle compensation system can be widely applied to various application scenes requiring high-definition video content display in the field of view networking.
The free view video display method according to the invention comprises the following steps: establishing a virtual point P of a view angle center picture of a video stream of a current camera S 1, and determining the coordinates of the virtual point P; judging whether the accumulated rotation angle exceeds an optimal picture display threshold according to a user rotation angle instruction, and requesting a new video stream of the next camera S 2 under the condition that the rotation angle exceeds the optimal picture display threshold; calculating coordinates of a rotated virtual point P' in the new video stream; coordinate fitting is carried out, and a picture rotation angle delta is obtained; and performing picture interpolation compensation, and displaying the compensated picture.
A freeview video display system according to the present invention includes: the shooting system consists of eight panoramic cameras which are arranged at 45-degree angles respectively with shooting points as centers and with fixed radiuses; a CDN content delivery network communicatively connected to the shooting system; a view angle switching compensation system communicatively connected to the CDN content delivery network; and a player communicatively connected to the angle of view switching compensation system.
Wherein the viewing angle switching compensation system according to the present invention comprises: the virtual point positioning module is used for establishing a virtual point P based on a main vision center point of a current camera video stream and acquiring coordinates of the virtual point P; the threshold judging module is used for judging whether the accumulated rotation visual angle of the user under the current camera video stream exceeds an optimal picture display threshold; the video stream control module is used for requesting to switch to a new video stream corresponding to the next camera to the content delivery network CDN under the condition that the accumulated rotation visual angle exceeds the optimal picture display threshold; the view angle fitting module is used for calculating the coordinates of the rotated virtual point P' in the new video stream, carrying out coordinate fitting, obtaining a picture rotation angle and carrying out picture interpolation compensation; and a picture display module for displaying the compensated picture.
These and other features and advantages will become apparent upon reading the following detailed description and upon reference to the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are explanatory only and are not restrictive of aspects as claimed.
Drawings
The invention will be described in more detail hereinafter with reference to specific embodiments shown in the drawings.
FIG. 1 is an example of a prior art camera placement scheme for free-view video capture;
FIG. 2 illustrates a camera placement scheme in a freeview video display system based on a field angle compensation system of the present invention;
FIG. 3 is a schematic block diagram of a freeview video display system based on the field angle compensation system of the present invention;
FIG. 4 is a schematic block diagram of the angle-of-view switching compensation system of the present invention;
fig. 5 is a flow chart of a freeview video display method of the present invention.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods according to embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s).
Detailed Description
The application will be described in more detail hereinafter with reference to specific embodiments shown in the drawings. Various advantages and benefits of this application will become apparent to those of ordinary skill in the art upon reading the following detailed description of the specific embodiments. It should be understood, however, that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. The following embodiments are provided to enable a more thorough understanding of the present application. Unless otherwise defined, technical or scientific terms used herein should be given the ordinary meaning as understood by one of ordinary skill in the art to which this application belongs.
Fig. 2 shows a camera placement scheme in a freeview video display system of the present invention. As shown in fig. 2, during shooting, one panoramic camera is placed every 45 ° with a shooting point as a center and a proper distance as a radius, and 8 panoramic cameras are used. The optimal view angle of the display picture of the panoramic camera shooting content is about 45 degrees, the picture within the range of 45 degrees is free from distortion, and for a shooting center, when the user rotation view angle exceeds +/-22.5 degrees, a shot object reaches the left and right frames of a main picture, and the picture stretching distortion is serious; the rotation angle continues to increase, and the shooting center cannot display the side surface because of the limitation of the shooting angle, and the video stream needs to be switched.
In the content playing process, when a user rotates the visual angle, a spatial position virtual point P is established, if the P is within the optimal display angle threshold of the current camera, the virtual point P is displayed in the video stream of the current camera, and the video stream of the next camera is switched to until the rotation angle exceeds the optimal display angle threshold of the current camera (namely exceeds the range of +/-22.5 degrees of the center). When switching video streams, the field angle switching compensation system of the invention performs virtual point repositioning P' and picture fitting compensation. Specifically, plane equation coefficients are obtained according to three-point coordinates of the virtual point P, the camera No. 1S 1 and the camera No. 2S 2, the position P' of the repositioning virtual point P in a new video stream coordinate system is calculated according to the difference value of the rotation angle and the optimal display angle of a user to fit, the main vision angle of a switched picture is determined, the display main vision of the next video stream is ensured to be connected with the picture of the main vision of the previous video stream, the main vision picture rotates smoothly and smoothly, no obvious stepping picture pauses are caused, and better main vision picture switching sensory experience is provided for the user.
The overall free view video display system of the present invention is described in detail with reference to fig. 3, and the view angle switching compensation system is described in detail with reference to fig. 4.
The free view video display system of the invention comprises a shooting system 310 composed of 8 cameras, a CDN content delivery network 320, a view angle switching compensation system 330 and a player 340.
The player 340 receives the rotation angle instruction from the user and transmits the instruction to the angle of view switching compensation system 330, the angle of view switching compensation system 330 determines whether the rotation angle exceeds the current camera optimal display angle threshold (i.e. whether the camera needs to be switched), if the camera does not need to be switched, the player that controls the picture rotation of the current camera video stream and transmits the rotated video stream is controlled, if the camera needs to be switched, the video stream switching request is sent to the CDN content delivery network 320, the CDN content delivery network 320 returns the new video stream of the next camera after the switching in the shooting system 310 to the angle of view switching compensation system 330, and the angle of view switching compensation system 330 fits the new video stream and transmits the new video stream to the player 340 for display.
Fig. 4 is a detailed schematic block diagram of the modules in the angle-of-view switching compensation system 330 in fig. 3, and the angle-of-view switching compensation system 330 includes a virtual point location module 331, a threshold determination module 332, a video stream control module 333, an angle-of-view fitting module 334, and a picture display module 335. Wherein:
The virtual point positioning module 331 is configured to receive a user rotation angle instruction from the player when the user rotates the angle of view each time, establish a virtual point P based on the current camera video stream dominant visual center point, and store coordinates (x 0,y0,z0) of the virtual point P in the present coordinate system.
The threshold value judging module 332 is configured to receive the virtual point P position coordinate information (x 0,y0,z0) from the virtual point positioning module 331, and judge whether the cumulative rotation angle of view of the user under the current camera video stream exceeds the optimal screen display threshold value; if not, the control information is directly transmitted to the picture control module 335 to control the picture rotation of the current camera video stream, and if yes, the rotation angle size information is transmitted to the video stream control module 333. Because the optimal view angle in the display picture of the shot content of the panoramic camera is about 45 degrees, the judging mode of whether the optimal picture display threshold value is exceeded is as follows: and when the user rotates within 22.5 degrees from the default main view angle, displaying a picture after the current panoramic video stream rotates, and if the rotation angle is larger than 22.5 degrees, requesting the video stream of the next camera.
The video stream control module 333 is configured to receive the rotation angle information from the threshold value judging module 332, and request the content delivery network CDN to switch to a new video stream corresponding to the next camera according to the rotation angle information.
The view angle fitting module 334 further includes a virtual point repositioning module and a picture fitting module, where the virtual point repositioning module is configured to receive, from the content delivery network CDN, a new video stream corresponding to the switched next camera, perform repositioning calculation in the new video stream according to the virtual point location coordinates, and the picture fitting module fits a main view picture of the new video stream according to the calculation result of the virtual point repositioning module, and transmits the main view picture to the picture display module 335.
The screen display module 335: the processed video is provided to the player by displaying the picture based on information from the threshold determination module 332 or information from the view angle fitting module 334.
Fig. 5 is a flow chart of a freeview video display method of the present invention.
In step S510, the user issues a rotation angle instruction;
In step S520, the image frame displayed by the current camera video stream is analyzed, a virtual point P of the current field angle center picture is established, and the coordinates (x 0,y0,z0) thereof are determined;
in step S530, it is determined whether the rotation angle accumulated by the instruction exceeds the optimal screen display threshold, i.e. 22.5 °;
if not, go to step S540, after rotating the current camera video stream, directly forward
Proceeding to step S590 to perform screen display;
If yes, go to step S550, request the new video stream content of the next camera, and then go to step S560;
In step S560, after a new video stream is acquired, the undetermined coefficient A, B, C of the plane equation may be obtained by substituting the spatial coordinates P(x0,y0,z0)、S1(x1,y1,z1)、S2(x2,y2,z2) of the three points of the virtual point P, the camera No. 1S 1, and the camera No. 2S 2 into the plane equation, and then the coordinates (x ', y', z ') of the rotated virtual point P' may be obtained according to the obtained plane equation coefficient A, B, C and the coordinates of the virtual point P, where the formula is as follows:
Ax+By+Cz+D＝0；
Wherein A, B, C is the undetermined coefficient of the plane equation, D is a constant, T is the cumulative rotation angle of the user rotation angle instruction, P '(x', y ', z') is the virtual point coordinates, tpef is the optimal picture threshold rotation angle, and the sum is only 22.5 °.
For example, P, S 1、S2, three-point coordinates are P (6,10,8), S 1(0,0,0),S2 (12,10,0), and the substitution of the plane equation ax+by+cz+d=0 is:
Solving to obtain the undetermined coefficient of the plane equation: a=4c/3, b= -8c/5, d=0, substituting ax+by+cz+d=0 gives the equation 4x/3-8y/5+z =0.
Substituting a/c=4/3, B/c= -8/5, t=31.5° into
Let x '=16/5, y' = -32/5, z=8, i.e. the P 'point coordinates are P' (16/5, -32/5, 8).
In step S570, coordinate fitting is performed, that is, a space straight line PS 1 equation is calculated according to the coordinates of the virtual point P and the camera S 1, a space straight line P 'S 2 equation is calculated according to the coordinates of the rotated virtual point P' and the camera S 2, and an included angle γ between the two straight lines is calculated, so that an absolute value δ of (45 ° - γ) is the rotation angle of the first frame.
δ＝|45°-γ|
Wherein A1, A2, B1 and B2 are A, B values of two space straight lines respectively.
In step S580, the picture interpolation compensation is performed, that is, the first frame picture under the new video stream is obtained by rotating δ under the default angle of the new video stream content of the next camera.
In step 590, a screen display is performed.
According to the free view video display method and system, only 8 panoramic cameras are needed to shoot, the number of cameras needed can be greatly reduced, shooting, content production and CDN cost can be greatly saved, meanwhile, through virtual point repositioning and picture fitting, the picture connection effect after video stream switching can be guaranteed to achieve the switching effect of the conventional free view 36-channel common video stream, and the free view video display method and system have wide application potential in the fields of high-definition display, real-time interaction, virtual-real combination and the like of interactive videos in the field of video networking.
The above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application, and are intended to be included within the scope of the appended claims and description.
Claims (5)
1. A freeview video display method, comprising:
Establishing a virtual point P of a view angle center picture of a video stream of a current camera S 1, and determining the coordinates of the virtual point P;
Judging whether the accumulated rotation angle exceeds an optimal picture display threshold according to a user rotation angle instruction, and requesting a new video stream of the next camera S 2 under the condition that the rotation angle exceeds the optimal picture display threshold;
calculating coordinates of the rotated virtual point P' in the new video stream, including:
The spatial coordinates P(x0,y0,z0)、S1(x1,y1,z1)、S2(x2,y2,z2)Ax+By+Cz+D＝0 of the virtual point P, the camera S 1 and the camera S 2 are substituted into a plane equation to obtain the undetermined coefficient A, B, C, and then the coordinates (x ', y', z ') of the rotated virtual point P' are obtained according to the following equation:
Tpef is the optimal picture display threshold, and T is the cumulative rotation angle of the user rotation angle instruction;
Coordinate fitting is performed to obtain a picture rotation angle delta, which comprises the following steps:
Solving the following space straight line PS 1 equation according to the coordinates of the virtual point P and the camera S 1, solving the following space straight line P 'S 2 equation according to the coordinates of the rotated virtual point P' and the camera S 2, and calculating the two straight line included angle gamma to obtain the picture rotation angle delta:
δ＝|45°-γ|
Wherein A1, A2, B1 and B2 are A, B values of two space straight lines respectively; and
Performing picture interpolation compensation and displaying a compensated picture, wherein the picture interpolation compensation comprises: rotating an angle delta under a default angle of new video stream content of the next camera to obtain a first frame picture under the new video stream;
A total of eight panoramic cameras which are centered on a shooting point, have fixed radii and are respectively arranged at 45-degree intervals are used, and the optimal picture display threshold value is 22.5 degrees.
2. The method of claim 1, further comprising controlling the video stream picture of the current camera S 1 to be rotated and displayed in case it is determined that the rotation angle accumulated by the user rotation angle instruction does not exceed the optimal picture display threshold.
3. A viewing angle switching compensation system communicatively connected to a total of eight panoramic cameras centered on a photographing point, each of which is placed at 45 ° angles apart, the viewing angle switching compensation system comprising:
the virtual point positioning module is used for establishing a virtual point P based on a main vision center point of a current camera video stream and acquiring coordinates of the virtual point P;
The threshold judging module is used for judging whether the accumulated rotation visual angle of the user under the current camera video stream exceeds an optimal picture display threshold value by 22.5 degrees;
The video stream control module is used for requesting to switch to a new video stream corresponding to the next camera to the content delivery network CDN under the condition that the accumulated rotation visual angle exceeds the optimal picture display threshold;
The view angle fitting module is used for calculating the coordinates of the rotated virtual point P' in the new video stream, carrying out coordinate fitting, obtaining a picture rotation angle delta, and carrying out picture interpolation compensation; and
The picture display module is used for displaying the compensated picture, wherein:
The calculating coordinates of the rotated virtual point P' in the new video stream includes:
The spatial coordinates P (x 0,y0,z0) of each of the virtual point P, the camera S 1 and the camera S 2,
S1(x1,y1,z1)、S 2(x2,y2,z2) are substituted into the plane equation to find the undetermined coefficients A, B, C therein, and then the coordinates (x ', y', z ') of the rotated virtual point P' are found according to the following equation:
Tpef is the optimal picture display threshold, and T is the cumulative rotation angle of the user rotation angle instruction;
the coordinate fitting is performed, and obtaining the picture rotation angle delta includes:
The following spatial line PS 1 equation is found from the coordinates of the virtual point P and the camera S 1,
Solving the following space straight line P 'S 2 equation according to the coordinates of the rotated virtual point P' and the camera S 2, and calculating the included angle gamma of the two straight lines to obtain the picture rotation angle delta:
δ＝|45°-γ|
wherein A1, A2, B1 and B2 are A, B values of two space straight lines respectively;
The picture interpolation compensation includes: and rotating the angle delta under the default angle of the new video stream content of the next camera to obtain a first frame picture under the new video stream.
4. The view angle switching compensation system of claim 3, wherein the view angle fitting module further comprises a virtual point repositioning module and a picture fitting module, wherein:
The virtual point relocation module is configured to receive a new video stream of a next camera after switching from the content delivery network CDN, perform relocation calculation in the new video stream according to the virtual point position coordinates, and
And the picture fitting module fits a main view picture of the new video stream according to the calculation result of the virtual point repositioning module and transmits the main view picture to the picture display module.
5. A freeview video display system, comprising:
The shooting system consists of eight panoramic cameras which are arranged at 45-degree angles respectively with shooting points as centers and with fixed radiuses;
a CDN content delivery network communicatively connected to the shooting system;
The angle of view switching compensation system of claim 3 or 4 communicatively connected to the CDN content delivery network; and
A player communicatively coupled to the angle of view switching compensation system,
The player receives a user rotation visual angle instruction, the visual angle switching compensation system judges whether the rotation angle of the instruction exceeds the optimal display angle threshold of the current camera, and sends a video stream switching request to the CDN content distribution network under the condition that the rotation angle exceeds the optimal display angle threshold, and requests to switch a new video stream of the next camera to perform virtual point coordinate fitting and picture interpolation compensation, and the compensated video stream is provided for the player for display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310414704.2A CN116614648B (en) | 2023-04-18 | 2023-04-18 | Free view video display method and system based on view angle compensation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310414704.2A CN116614648B (en) | 2023-04-18 | 2023-04-18 | Free view video display method and system based on view angle compensation system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116614648A CN116614648A (en) | 2023-08-18 |
| CN116614648B true CN116614648B (en) | 2024-06-07 |
Family
ID=87680796
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310414704.2A Active CN116614648B (en) | 2023-04-18 | 2023-04-18 | Free view video display method and system based on view angle compensation system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116614648B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009010915A (en) * | 2007-05-31 | 2009-01-15 | Takeshi Yanagisawa | Video display method and video system |
| CN104516103A (en) * | 2013-09-30 | 2015-04-15 | 微太科技股份有限公司 | Lens view switching device and method |
| CN105939481A (en) * | 2016-05-12 | 2016-09-14 | 深圳市望尘科技有限公司 | Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method |
| CN108322730A (en) * | 2018-03-09 | 2018-07-24 | 嘀拍信息科技南通有限公司 | A kind of panorama depth camera system acquiring 360 degree of scene structures |
| CN108600771A (en) * | 2018-05-15 | 2018-09-28 | 东北农业大学 | Recorded broadcast workstation system and operating method |
| CN109889914A (en) * | 2019-03-08 | 2019-06-14 | 腾讯科技（深圳）有限公司 | Video pictures method for pushing, device, computer equipment and storage medium |
| CN209725683U (en) * | 2019-02-01 | 2019-12-03 | 杭州视熵科技有限公司 | A kind of adjustable platform towards polyphaser panoramic mosaic |
| CN111408132A (en) * | 2020-02-17 | 2020-07-14 | 网易（杭州）网络有限公司 | Game picture display method, device, equipment and storage medium |
| CN111901616A (en) * | 2020-07-15 | 2020-11-06 | 天翼视讯传媒有限公司 | H5/WebGL-based method for improving multi-view live broadcast rendering |
| WO2021179783A1 (en) * | 2020-03-11 | 2021-09-16 | 叠境数字科技（上海）有限公司 | Free viewpoint-based video live broadcast processing method, device, system, chip and medium |
| CN114666565A (en) * | 2020-12-22 | 2022-06-24 | 中国电信股份有限公司 | Multi-view video playing method and device and storage medium |
| CN115174942A (en) * | 2022-07-08 | 2022-10-11 | 叠境数字科技（上海）有限公司 | Free visual angle switching method and interactive free visual angle playing system |
| CN115242969A (en) * | 2022-06-22 | 2022-10-25 | 天翼数字生活科技有限公司 | Method and system for controlling rotation of network camera |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180342043A1 (en) * | 2017-05-23 | 2018-11-29 | Nokia Technologies Oy | Auto Scene Adjustments For Multi Camera Virtual Reality Streaming |
-
2023
- 2023-04-18 CN CN202310414704.2A patent/CN116614648B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009010915A (en) * | 2007-05-31 | 2009-01-15 | Takeshi Yanagisawa | Video display method and video system |
| CN104516103A (en) * | 2013-09-30 | 2015-04-15 | 微太科技股份有限公司 | Lens view switching device and method |
| CN105939481A (en) * | 2016-05-12 | 2016-09-14 | 深圳市望尘科技有限公司 | Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method |
| CN108322730A (en) * | 2018-03-09 | 2018-07-24 | 嘀拍信息科技南通有限公司 | A kind of panorama depth camera system acquiring 360 degree of scene structures |
| CN108600771A (en) * | 2018-05-15 | 2018-09-28 | 东北农业大学 | Recorded broadcast workstation system and operating method |
| CN209725683U (en) * | 2019-02-01 | 2019-12-03 | 杭州视熵科技有限公司 | A kind of adjustable platform towards polyphaser panoramic mosaic |
| CN109889914A (en) * | 2019-03-08 | 2019-06-14 | 腾讯科技（深圳）有限公司 | Video pictures method for pushing, device, computer equipment and storage medium |
| CN111408132A (en) * | 2020-02-17 | 2020-07-14 | 网易（杭州）网络有限公司 | Game picture display method, device, equipment and storage medium |
| WO2021179783A1 (en) * | 2020-03-11 | 2021-09-16 | 叠境数字科技（上海）有限公司 | Free viewpoint-based video live broadcast processing method, device, system, chip and medium |
| CN111901616A (en) * | 2020-07-15 | 2020-11-06 | 天翼视讯传媒有限公司 | H5/WebGL-based method for improving multi-view live broadcast rendering |
| CN114666565A (en) * | 2020-12-22 | 2022-06-24 | 中国电信股份有限公司 | Multi-view video playing method and device and storage medium |
| CN115242969A (en) * | 2022-06-22 | 2022-10-25 | 天翼数字生活科技有限公司 | Method and system for controlling rotation of network camera |
| CN115174942A (en) * | 2022-07-08 | 2022-10-11 | 叠境数字科技（上海）有限公司 | Free visual angle switching method and interactive free visual angle playing system |
Non-Patent Citations (1)
| Title |
|---|
| 虚拟现实中的实景视频切换技术研究;邵刚;屈保平;曹鹏;刘明智;;微处理机;20131015(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116614648A (en) | 2023-08-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3870124B2 (en) | Image processing apparatus and method, computer program, and computer-readable storage medium | |
| JP3792901B2 (en) | Camera control system and control method thereof | |
| US7675539B2 (en) | Camera control apparatus, camera system, electronic conference system, and camera control method | |
| EP3065049A2 (en) | Interactive video display method, device, and system | |
| CN111263177A (en) | Video interactive live broadcast method and system | |
| US9013561B2 (en) | Stereoscopic video processing apparatus, method, and program | |
| US20060192847A1 (en) | Display apparatus, and display control method for the display apparatus | |
| WO2021237616A1 (en) | Image transmission method, mobile platform, and computer readable storage medium | |
| JP2004266317A (en) | Monitoring apparatus | |
| CN112468806B (en) | Panoramic video transmission optimization method for cloud VR platform | |
| WO2018036112A1 (en) | Method and system for encoding/decoding panoramic video | |
| CN111818304A (en) | Image fusion method and device | |
| US20100123790A1 (en) | Autofocus system | |
| US9030525B2 (en) | Method and apparatus for optimal motion reproduction in stereoscopic digital cinema | |
| CN109618093A (en) | A kind of panoramic video live broadcasting method and system | |
| JP2020042665A (en) | Information processing apparatus, control method thereof, and program | |
| CN111083368A (en) | Simulation physics cloud platform panoramic video display system based on high in clouds | |
| WO2021200184A1 (en) | Information processing device, information processing method, and program | |
| CN116614648B (en) | Free view video display method and system based on view angle compensation system | |
| JP2005175970A (en) | Imaging system | |
| JP2000341574A (en) | Camera device and camera control system | |
| CN112601044A (en) | Conference scene picture self-adaption method | |
| WO2023036218A1 (en) | Method and apparatus for determining width of viewpoint | |
| JPH10294890A (en) | Automatic/manual photographic camera system | |
| WO2014097465A1 (en) | Video processor and video p rocessing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |