CN101916163B - Method for keeping interactive playing of cooperative and gradually-variational panoramic video under space-time transformation - Google Patents
Method for keeping interactive playing of cooperative and gradually-variational panoramic video under space-time transformation Download PDFInfo
- Publication number
- CN101916163B CN101916163B CN2010102457812A CN201010245781A CN101916163B CN 101916163 B CN101916163 B CN 101916163B CN 2010102457812 A CN2010102457812 A CN 2010102457812A CN 201010245781 A CN201010245781 A CN 201010245781A CN 101916163 B CN101916163 B CN 101916163B
- Authority
- CN
- China
- Prior art keywords
- panoramic video
- player
- panoramic
- register
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention relates to a method for keeping the interactive playing of a cooperative and gradually-variational panoramic video under space-time transformation. Two synchronous threads, namely a space transformation thread and a video stream playing thread, as well as the current visual field register shared by the two threads are arranged in a panoramic video player. The register stores parameters of a visual field range in real time and data is shared by the space transformation thread and the video playing thread, so that a panoramic picture within the visual field range can be displayed at the same time. The authority of the register can be read and written in by the space transformation thread but can only be read by the video stream playing thread, so that a communication and synchronization mechanism of the space transformation thread and the video stream playing thread can be realized by taking the current visual field register as a bond. The method has the advantages that: a visual angle can be changed when the panoramic video is played, so that the panorama of a variational picture can be watched; the sense of continuity of visual perception to picture change is kept by synchronous change of a cooperative space and time; and the method has higher interactivity, fluency and stability.
Description
Technical field
The invention belongs to field of computer technology, relate in particular to a kind of interactive method of playing of panoramic video that under space-time transformation, keeps collaborative gradual change.
Background technology
The Internet video technology is an important directions of Information Technology Development, and communication means such as video conference have begun for people various rich media service to be provided.Video acquisition means commonly used at present are to be accomplished by single camera.Yet single camera field range is limited, can not let different visitors watch the own interested scene of different angles simultaneously, promptly can't personalized requirements.On the other hand, in the past 10 years, (Image-Based Rendering IBR) has developed into a kind of drafting model in the drafting of basic picture.Panorama sketch (panoramic images) based on image rendering is exactly to adopt these discrete image informations the method for image rendering on piece image, intactly to show.The appearance of panorama sketch has overcome the restriction of the passive observation fixed viewpoint of spectators.Yet what panoramic picture was expressed is a kind of scene of static state, and the loaded information amount is limited.
Meanwhile, the development of stream media technology and hardware based figure speed technology provide a kind of new approach to us: panoramic video (panoramic video) system.Panoramic video is meant the panorama sketch sequence of gathering constantly in difference; Its loaded information amount is very abundant; The scene change of the space and time continuous of interactively performance in real time; The advantage that has Internet video and panoramic picture simultaneously can be applied in multiple occasions such as remote teaching that interactive and information content are had higher requirements and panorama relay.
At present, domestic research and development about panoramic video technology mainly concentrate on video acquisition and panorama and the media production technical elements such as synthesize, and also the interactive play-back technology of panoramic video are not done clear and definite elaboration.And in the interactive play-back technology field of panoramic video; How to provide space and time continuous interactive, how to make broadcasting pictures rotate at user perspective all the time to keep smoothness in the process of constantly upgrading with video flowing and the continuous visual effect becomes central issue along with the time.Address this problem, key will provide a kind of method that makes that picture keeps collaborative gradual change under spatiotemporal while conversion exactly.A kind of interactive method of playing of panoramic video of collaborative gradual change that under space-time transformation, keeps that the present invention proposes just can be good at addressing this problem.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of panoramic video that can let broadcasting pictures under the dual conversion of space-time, keep collaborative gradual change interactive player method to above-mentioned prior art deficiency, satisfies the user and when rotating the visual angle, keeps the continuity of video flowing picture and the needs of fluency.Considering under the simplification principle of ubiquity that the present invention only discusses the situation that one dimension rotates.
The present invention solves the problems of the technologies described above the technical scheme that is adopted: a kind of interactive method of playing of panoramic video that under space-time transformation, keeps collaborative gradual change, and this method comprises following operation steps;
Step 1: the panoramic video player is from receiving data stream from the network periodically;
Step 2: the panoramic video player changes into the panoramic image frame compatible with network player to the panoramic image frame in the data stream; And panoramic image frame is put in the formation buffer memory that pre-sets; The frame of remembering current broadcast is the frame panoramic picture in the formation buffer pointers buffer memory pointed; When the data volume in the buffer memory less than regulation during critical value, repeating step 1;
Step 3: the panoramic video player is provided with and starts timer T1, and the clock period of timer T1 is 1/n second, and according to the global definition of panoramic video stream, the video of each second is made up of the n frame;
Step 4: the panoramic video player is obtained current pointer panoramic image frame pointed according to the frequency period property ground of timer T1 from the formation buffer memory, simultaneously the pointed next frame;
Step 5: (x w) stores among the register M panoramic video player, and initialization register M, x are the center in the visual field in the ban, and w is the width of current viewable pictures the parameter of visual range in the current default panoramic image frame;
Step 6: the panoramic video player redraws the player picture according to the rgb value that register M takes out each pixel of viewable pictures in this picture frame;
Step 7: the panoramic video player in the process of playing panoramic video stream, perception user's mouse event at any time;
Step 8: the panoramic video player is in original state S1 at initial time; When mouse triggers left button and presses incident, the panoramic video player S2 that gets the hang of, the current horizontal ordinate position of record player state and mouse is in status register, and starts the mouse displacement state and judge timer T2; When mouse triggers the left button incident of upspringing, the panoramic video player S1 that gets the hang of, the record player state stops the mouse displacement state and judges timer T2;
Step 9: when the panoramic video player is on state S2; The current horizontal ordinate position of record player state and mouse; Calculate the visual range of the current image frame of formation buffer pointers indication, and upgrade register M, redraw the player picture according to the visual range among the M then.
The measure of being taked also comprises:
Above-mentioned step 6 comprises following step at least;
Step 61: from queue memory, take out panoramic image frame by queue sequence;
Step 62: according to the value of register M (x, w), we can obtain current field range is that length of interval is [x, x+w], and width is the rectangular frame of w;
Step 63: the panoramic video player is described the rgb value of each pixel in this rectangle in current player plays painting canvas; When this panoramic video has just begun to play the value of register M we adopt predefined current picture (x
0, w) as default value.
Above-mentioned step 9 comprises following step at least:
Step 91: when the panoramic video player is on state S2, mouse state decision event m time that starts T2 in each T1 cycle is set; The cycle that is about to T2 is set to 1/nm;
Step 92: when the cycle of T2 triggered, the current horizontal ordinate position of record player state and mouse was if the lateral attitude of current mouse is x
c, then calculate mouse displacement Δ x=x
c-x;
Step 93: when Δ x＜σ (wherein σ sets out to change the threshold value in the horizontal space visual field), keep the data among the register M also to remain unchanged;
Step 94: when Δ x >=σ, become the Data Update among the original register M that (x+ Δ x, w), the panoramic video player redraws the player picture according to the rgb value that register M takes out each pixel of viewable pictures in the current image frame then.
Compared with prior art, the present invention is provided with spatial alternation thread and video flowing and plays two synchronizing threads of thread in the panoramic video player, and be provided with by this two thread share when the forward view register.This register has been preserved the parameter of field range in real time, and these data are shared to be used to show panorama within the vision simultaneously by spatial alternation thread and video playback thread.Aspect the authority of register; This register can be read and write by the spatial alternation thread; Read but can only play thread, so the communication that spatial alternation thread and video flowing are play thread can realize as tie by working as the forward view register with synchronization mechanism by video flowing.
For the sense of continuity that keeps the user on visual sensory, picture to be changed; The present invention adopts the variation of a special timer period property detection user perspective in the panoramic video player; And improved the frequency of timer; In order to each the discernmible space of step naked eyes visual angle change of timely detection, thereby in time adjust current field range.
The present invention has following advantage:
One, the user can be in playing panoramic video can the conversion visual angle, thereby watch the panorama that changes picture.
Two, collaborative spatiotemporal variation simultaneously, the sense of continuity that keeps the user on visual sensory, picture to be changed.
Three, improve interactive, the fluency and the stability of panoramic video player.
Description of drawings
Fig. 1 is the synoptic diagram of the visual range parameter in the forward view register in the embodiment of the invention;
Fig. 2 interrupts synoptic diagram the time of timer T2 in the embodiment of the invention;
Fig. 3 is the constitutional diagram of panoramic video player in the step 8 in the embodiment of the invention;
Fig. 4 is the logical flow chart that network data receives in step 1 and the step 2 in the embodiment of the invention;
Fig. 5 is the logical flow chart of following new video stream image time sequence in the embodiment of the invention among the step 3-6;
Fig. 6 is the logical flow chart that the response user perspective rotates among the step 8-9 in the embodiment of the invention.
Embodiment
Embodiment describes in further detail the present invention below in conjunction with accompanying drawing.Extremely shown in Figure 6 like Fig. 1.
A kind of based on global buffer keep the method for high connectivity with data source, a kind of method that under space-time transformation, keeps the interactive broadcast of panoramic video of collaborative gradual change, this method comprises following operation steps;
Step 1: the panoramic video player is from receiving data stream from the network periodically;
Step 2: the panoramic video player is changing into the panoramic image frame in the data stream panoramic image frame compatible with network player; And panoramic image frame is put in the formation buffer memory that pre-sets; The frame of remembering current broadcast is the frame panoramic picture in the formation buffer pointers buffer memory pointed; When the data volume in the buffer memory less than regulation during critical value, repeating step 1;
Step 3: the panoramic video player is provided with and starts timer T1, and the clock period of timer T1 is 1/n second, and according to the global definition of panoramic video stream, the video of each second is made up of the n frame;
Step 4: the panoramic video player is obtained current pointer panoramic image frame pointed according to the frequency period property ground of timer T1 from the formation buffer memory, simultaneously the pointed next frame;
Step 5: (x w) stores among the register M panoramic video player, and initialization register M, x are the center in the visual field in the ban, and w is the width of current viewable pictures the parameter of visual range in the current default panoramic image frame;
Step 6: the panoramic video player redraws the player picture according to the rgb value that register M takes out each pixel of viewable pictures in this picture frame;
Step 7: the panoramic video player in the process of playing panoramic video stream, perception user's mouse event at any time;
Step 8: the panoramic video player is in original state S1 at initial time; When mouse triggers left button and presses incident, the panoramic video player S2 that gets the hang of, the current horizontal ordinate position of record player state and mouse is in status register, and starts the mouse displacement state and judge timer T2; When mouse triggers the left button incident of upspringing, the panoramic video player S1 that gets the hang of, the record player state stops the mouse displacement state and judges timer T2;
Step 9: when the panoramic video player is on state S2; The current horizontal ordinate position of record player state and mouse; Calculate the visual range of the current image frame of formation buffer pointers indication, and upgrade register M, redraw the player picture according to the visual range among the M then.
The measure of being taked also comprises:
Above-mentioned step 6 comprises following step at least;
Step 61: from queue memory, take out panoramic image frame by queue sequence;
Step 62: according to the value of register M (x, w), we can obtain current field range is that length of interval is [x, x+w], and width is the rectangular frame of w;
Step 63: the panoramic video player is described the rgb value of each pixel in this rectangle in current player plays painting canvas; When this panoramic video has just begun to play the value of register M we adopt predefined current picture (x
0, w) as default value.
Above-mentioned step 9 comprises following step at least:
Step 91: when the panoramic video player is on state S2, mouse state decision event m time that starts T2 in each T1 cycle is set; The cycle that is about to T2 is set to 1/nm;
Step 92: when the cycle of T2 triggered, the current horizontal ordinate position of record player state and mouse was if the lateral attitude of current mouse is x
c, then calculate mouse displacement Δ x=x
c-x;
Step 93: when Δ x＜σ (wherein σ sets out to change the threshold value in the horizontal space visual field), keep the data among the register M also to remain unchanged;
Step 94: when Δ x >=σ, become the Data Update among the original register M that (x+ Δ x, w), the panoramic video player redraws the player picture according to the rgb value that register M takes out each pixel of viewable pictures in the current image frame then.
A kind of interactive method of playing of panoramic video that under space-time transformation, keeps collaborative gradual change of the present invention, at first the panoramic video player is provided with periodically receiving data stream from the network of a thread, and panoramic image frame is put in the formation buffer memory that pre-sets.Then, the panoramic video player is provided with another broadcast thread and periodically from the formation buffer memory, obtains current index panoramic image frame pointed, simultaneously the index next frame.Play thread the visual range parameter in the current default panoramic image frame in storing register M into, periodically constantly take out the visual range parameter then, and redraw broadcasting pictures according to range parameter.Meanwhile, the panoramic video player in the process of playing panoramic video stream, perception user's mouse event at any time.The panoramic video player is in original state S1 at initial time; When mouse triggers left button and presses incident, the panoramic video player S2 that gets the hang of, the current horizontal ordinate position of record player state and mouse is in status register, and starts the mouse displacement state and judge timer T2.When mouse triggers the left button incident of upspringing, the panoramic video player S1 that gets the hang of, the record player state stops the mouse displacement state and judges timer T2.When the panoramic video player is on state S2; The current horizontal ordinate position of record player state and mouse; Calculate the visual range of the current image frame of formation cache pointer Index indication, and upgrade register M, redraw the player picture according to the visual range among the M then.
Though the present invention is through illustrating and describe with reference to preferred embodiment,, those skilled in the art should understand, and in the scope of claims, can do the various variation on form and the details.
Claims (3)
1. interactive method of playing of panoramic video that under space-time transformation, keeps collaborative gradual change is characterized in that: comprise following operation steps:
Step 1:The panoramic video player is from receiving data stream from the network periodically;
Step 2:The panoramic video player changes into the panoramic image frame compatible with the panoramic video player to the panoramic image frame in the data stream; And panoramic image frame is put in the formation buffer memory that pre-sets; The frame of remembering current broadcast is the frame panoramic picture in the formation buffer pointers buffer memory pointed; When the data volume in the buffer memory less than regulation during critical value, repeating step 1;
Step 3:The panoramic video player is provided with and starts timer T1, and the clock period of timer T1 is 1/n second, and according to the global definition of panoramic video stream, the video of each second is made up of the n frame;
Step 4:The panoramic video player is obtained current pointer panoramic image frame pointed according to the frequency period property ground of timer T1 from the formation buffer memory, simultaneously the pointed next frame;
Step 5:(x w) stores among the register M panoramic video player, and initialization register M, x are for when the center of forward view, and w is the width of current viewable pictures the parameter of visual range in the current default panoramic image frame;
Step 6:The panoramic video player redraws the player picture according to the rgb value that register M takes out each pixel of viewable pictures in this picture frame;
Step 7:The panoramic video player in the process of playing panoramic video stream, perception user's mouse event at any time;
Step 8:The panoramic video player is in original state S1 at initial time; When mouse triggers left button and presses incident, the panoramic video player S2 that gets the hang of, the current horizontal ordinate position of record player state and mouse is in status register, and starts the mouse displacement state and judge timer T2; When mouse triggers the left button incident of upspringing, the panoramic video player S1 that gets the hang of, the record player state stops the mouse displacement state and judges timer T2;
Step 9:When the panoramic video player is on state S2; The current horizontal ordinate position of record player state and mouse; Calculate the visual range of the current image frame of formation buffer pointers indication, and upgrade register M, redraw the player picture according to the visual range among the M then.
2. a kind of interactive method of playing of panoramic video that under space-time transformation, keeps collaborative gradual change according to claim 1, it is characterized in that: described step 6 comprises the steps at least;
Step 61:From queue memory, take out panoramic image frame by queue sequence;
Step 62:According to the value of register M (x, w), we can obtain current field range is that length of interval is [x, x+w], and width is the rectangular frame of w;
Step 63:The panoramic video player is described the rgb value of each pixel in this rectangle in current player plays painting canvas; When this panoramic video has just begun to play the value of register M we adopt predefined current picture
As default value.
3. a kind of interactive method of playing of panoramic video that under space-time transformation, keeps collaborative gradual change according to claim 1 and 2, it is characterized in that: described step 9 comprises the steps: at least
Step 91:When the panoramic video player is on state S2, mouse state decision event m time that starts T2 in each T1 cycle is set; The cycle that is about to T2 is set to 1/nm;
Step 92:When the cycle of T2 triggered, the current horizontal ordinate position of record player state and mouse was if the lateral attitude of current mouse does
, then calculate mouse displacement
Step 93:When
The time, the data among the save register M remain unchanged, wherein
Be to set out to change the threshold value in the horizontal space visual field;
Step 94:When
The time, become the Data Update among the original register M
, the panoramic video player redraws the player picture according to the rgb value that register M takes out each pixel of viewable pictures in the current image frame then.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102457812A CN101916163B (en) | 2010-08-02 | 2010-08-02 | Method for keeping interactive playing of cooperative and gradually-variational panoramic video under space-time transformation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010102457812A CN101916163B (en) | 2010-08-02 | 2010-08-02 | Method for keeping interactive playing of cooperative and gradually-variational panoramic video under space-time transformation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101916163A CN101916163A (en) | 2010-12-15 |
| CN101916163B true CN101916163B (en) | 2012-02-08 |
Family
ID=43323684
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010102457812A Expired - Fee Related CN101916163B (en) | 2010-08-02 | 2010-08-02 | Method for keeping interactive playing of cooperative and gradually-variational panoramic video under space-time transformation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101916163B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102999246A (en) * | 2012-03-23 | 2013-03-27 | 广州市凡拓数码科技有限公司 | Realization method, realization system and manufacturing method for electronic project sand table |
| CN107203360A (en) * | 2016-03-17 | 2017-09-26 | 丰唐物联技术（深圳）有限公司 | A kind of display methods and virtual implementing helmet based on virtual implementing helmet |
| CN105791882B (en) * | 2016-03-22 | 2018-09-18 | 腾讯科技（深圳）有限公司 | Method for video coding and device |
| CN105933343B (en) * | 2016-06-29 | 2019-01-08 | 深圳市优象计算技术有限公司 | A kind of code stream caching method for 720 degree of panoramic video netcasts |
| CN106358036B (en) * | 2016-08-31 | 2018-05-08 | 杭州当虹科技有限公司 | A kind of method that virtual reality video is watched with default visual angle |
| CN106210549A (en) * | 2016-09-07 | 2016-12-07 | 传线网络科技（上海）有限公司 | The player method of panoramic video and device |
| CN107027041B (en) * | 2017-04-18 | 2019-12-27 | 深圳市智能现实科技有限公司 | Scene display method and device |
| CN110324641B (en) * | 2019-07-12 | 2021-09-03 | 青岛一舍科技有限公司 | Method and device for keeping interest target moment display in panoramic video |
| CN111913343B (en) * | 2020-07-27 | 2022-05-20 | 微幻科技(北京)有限公司 | Panoramic image display method and device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6559846B1 (en) * | 2000-07-07 | 2003-05-06 | Microsoft Corporation | System and process for viewing panoramic video |
| CN1917652A (en) * | 2006-09-07 | 2007-02-21 | 四川长虹电器股份有限公司 | Method for playing back audio/video of network stream media synchronously |
| CN101465957B (en) * | 2008-12-30 | 2011-01-26 | 应旭峰 | System for implementing remote control interaction in virtual three-dimensional scene |
| CN101561988B (en) * | 2009-05-20 | 2012-06-27 | 北京水晶石数字科技股份有限公司 | Method for exhibiting panoramagram |
-
2010
- 2010-08-02 CN CN2010102457812A patent/CN101916163B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN101916163A (en) | 2010-12-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101916163B (en) | Method for keeping interactive playing of cooperative and gradually-variational panoramic video under space-time transformation | |
| US20210368148A1 (en) | Virtual reality panoramic video stream projection method and device | |
| CN105765990B (en) | Method, system and computer medium for distributing video content over a distributed network | |
| US20090327893A1 (en) | Coordinated video presentation methods and apparatus | |
| CN101587431B (en) | Method for realizing multi-screen playing video | |
| CN103338340B (en) | Realize picture-in-picture module and the method for the multiple video strems self-defined combination of frame picture | |
| US9083915B2 (en) | 3D electronic program guide | |
| Wasson | The networked screen: Moving images, materiality, and the aesthetics of size | |
| CN201887901U (en) | Three-dimensional video playing system | |
| CN108604438B (en) | Display control method and program for making the computer-implemented display control method | |
| US8842113B1 (en) | Real-time view synchronization across multiple networked devices | |
| US20200234499A1 (en) | Method for transmitting/receiving media data and device therefor | |
| CN102945563A (en) | Showing and interacting system and method for panoramic videos | |
| BR112014002827B1 (en) | METHOD AND SYSTEM FOR SELECTIVE CAPTURE AND PRESENTATION OF PORTIONS OF NATIVE DIFFUSION IMAGES IN A MULTIPLE DIFFUSION CAMERA SYSTEM; AND METHOD AND SYSTEM FOR SELECTIVE CAPTURE AND DISPLAY PORTIONS OF NATIVE IMAGE DIFFUSION IN A MULTIPLE DIFFUSION CAMERA SYSTEM | |
| CN106713942A (en) | Video processing method and video processing device | |
| CN102780892B (en) | 3d image processing method and portable 3d display apparatus implementing the same | |
| Pintaric et al. | Immersive panoramic video | |
| CN202455444U (en) | 360-degree framing camera device | |
| CN106658030A (en) | Method and device for playing composite video comprising single-path audio and multipath videos | |
| CN106569760A (en) | Large-scale GIS display system based on synchronous control, and display method of large-scale GIS display system | |
| CN102547313A (en) | Three-dimensional video play system and method thereof | |
| US11990159B2 (en) | Interface for framing videos | |
| JP4189900B2 (en) | Event related information insertion method and apparatus | |
| CN102402414A (en) | Image synchronization refreshing system and method for acquisition card buffer suitable for a big screen | |
| CN102696222B (en) | A kind of video picture display device and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120208 Termination date: 20140802 |
|
| EXPY | Termination of patent right or utility model |