TW201822536A - Viewing angle control system and method for playing panoramic image through set-top box capable of dynamically presenting a predictive picture that rotates according to the rotating speed of the viewing angle - Google Patents
Viewing angle control system and method for playing panoramic image through set-top box capable of dynamically presenting a predictive picture that rotates according to the rotating speed of the viewing angle Download PDFInfo
- Publication number
- TW201822536A TW201822536A TW105141322A TW105141322A TW201822536A TW 201822536 A TW201822536 A TW 201822536A TW 105141322 A TW105141322 A TW 105141322A TW 105141322 A TW105141322 A TW 105141322A TW 201822536 A TW201822536 A TW 201822536A
- Authority
- TW
- Taiwan
- Prior art keywords
- viewing angle
- angle
- top box
- rotation
- rotating
- Prior art date
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
本發明有關於一種視角控制系統及方法,尤為一種透過機上盒播放環景影像之動態視角控制系統及方法。 The present invention relates to a viewing angle control system and method, and more particularly to a dynamic viewing angle control system and method for playing a surrounding scene image through a set-top box.
三百六十度環景影像播放近幾年成為一種關注度很高的技術,許多廠商將環景影像播放實施在智慧型手機、平板電腦、個人電腦等裝置,再透過陀螺儀、觸控或滑鼠等來控制視角,然而,在透過機上盒實施環景影像於電視時,勢必得要透過搖控器來進行視角的控制,然而,一般遙控器並未經過特殊設計,其發送至機上盒的訊號係為離散訊號,而機上盒若每收到一次方向鍵的離散訊號就轉動一次固定的視角角度,因每次移動視角間會有時間間隔,無可避免地會產生畫面抖動的現象,此種畫面抖動的現象會相當程度地降低使用者觀看環景影像的體驗。 360 degree surround view video playback has become a technology of great concern in recent years. Many manufacturers have implemented surround view video playback on smart phones, tablets, personal computers and other devices, and then use gyroscopes, touch or Use a mouse, etc. to control the angle of view. However, when the surround view image is implemented on the TV through the set-top box, the angle of view must be controlled by the remote control. However, the general remote control is not specially designed and sent to the machine. The signal of the upper box is a discrete signal, and the set-top box rotates a fixed angle of view every time it receives a discrete signal of the arrow keys. Because there is a time interval between each movement of the angle of view, it will inevitably produce screen jitter. This phenomenon of screen jitter will considerably reduce the user's experience of watching surrounding images.
而在先前技術中,針對環景影像播放,有著若干種優化的系統或方法,例如接收了播放全景的指令後,即獲取使用者當下的視角,再從串流中擷取當下視角對應的段落以進行播放,來實現一種環景影像的分段播放,然而,透過這種技術,仍無法解決機上盒因遙控器的離散訊號造成的畫面抖動現象。 In the prior art, there are several optimized systems or methods for the playback of surrounding scenes. For example, after receiving the instruction to play the panorama, the user's current perspective is obtained, and the corresponding paragraph of the current perspective is retrieved from the stream. The playback is used to realize a segmented playback of the surrounding scene image. However, with this technology, the picture jitter caused by the discrete signal of the remote control of the set-top box cannot be solved.
有鑑於上述問題,提出一種能夠對應機上盒特殊需求的環景影像視角控制技術,對本領域中的技術人員而言,是有其必要性的。 In view of the above problems, it is necessary for a person skilled in the art to provide a surround view image angle control technology that can respond to the special needs of a set-top box.
為了解決先前技術中的問題,本發明提供一種透過機上盒播放環景影像之視角控制系統,其係在一機上盒內設置至少包含一視訊解碼模組以及一轉動視角模組。 In order to solve the problems in the prior art, the present invention provides an angle of view control system for playing surround view images through a set-top box. The system is provided with at least one video decoding module and a rotating view angle module in the set-top box.
其中,該視訊解碼模組係與該機上盒內原有的網路模組連結,當網路模組接收環景影像的視訊串流時,用以對視訊串流進行視訊解碼,以獲得解碼後之影像畫面以及對應影像畫面的移動向量,而該機上盒內原有的顯示模組即可解碼後之影像畫面呈現給使用者。 The video decoding module is connected to the original network module in the set-top box. When the network module receives the video stream of the surrounding scene image, it is used to perform video decoding on the video stream to obtain The decoded image frame and the motion vector corresponding to the image frame, and the original display module in the set-top box can present the decoded image frame to the user.
另外,該轉動視角模組係用以判斷由使用者操控遙控器傳送至該機上盒的訊號是否為轉動視角事件,若訊號為轉動視角事件,則根據轉動視角之後的預測畫面中所對應的移動向量來動態地計算,並產生一轉動視角速率,使顯示模組依據該轉動視角速率呈現對應視角的預測畫面,並對預測畫面進行環景影像必要的變形化調整後傳送到電視機供使用者觀看;其中,該轉動視角模組係根據遙控器傳送方向鍵訊號的間隔時間是否小於一門檻值來判定是否為轉動視角事件,亦即當使用者再小於該門檻值時間內連續按壓方向鍵或按住方向鍵不放以傳送訊號時,即判斷為轉動視角事件;而若該門檻值時間內無新的遙控器方向鍵事件,則可以結束轉動視角事件,即可固定在一視角輸出影像畫面。 In addition, the rotation angle module is used to determine whether the signal transmitted by the user to control the remote control to the set-top box is a rotation angle event. If the signal is a rotation angle event, then according to the corresponding prediction screen after the rotation angle The motion vector is dynamically calculated, and a rotation angle of view rate is generated, so that the display module presents the predicted picture of the corresponding angle of view according to the rotation angle of view rate, and the necessary deformation of the surrounding scene image is adjusted and transmitted to the television for use. The viewing angle module is based on whether the interval time of the direction key signal transmitted by the remote control is less than a threshold value to determine whether it is a rotating angle event, that is, when the user continuously presses the direction key within the threshold value again. Or press and hold the arrow keys to transmit a signal, it is judged as a rotation angle event; if there is no new remote control arrow key event within the threshold time, you can end the rotation angle event and output the image at a fixed angle. Screen.
另外,在本發明中,若轉動視角後預測畫面中的 該移動向量較原影像畫面為高,則該轉動視角模組產生較高的該轉動視角速率,方能使轉動視角事件能較快地轉動視角經過環景影像中動態程度低之影像畫面;相反地,若轉動視角後預測畫面中的該移動向量較原影像畫面為低,則該轉動視角模組產生較低的該轉動視角速率,使轉動視角事件能較慢地轉動視角經過環景影像中動態程度高之影像畫面。 In addition, in the present invention, if the motion vector in the prediction frame after the rotation angle is higher than the original image frame, the rotation angle module generates a higher rotation angle rate, so that the rotation angle event can be made faster. The rotating perspective passes through the low dynamic image frame in the surrounding image. On the contrary, if the motion vector in the predicted frame is lower than the original image frame after the rotating perspective, the rotating perspective module generates a lower rate of the rotating perspective. The rotation angle of view event enables the angle of rotation to pass through the high dynamic image frame in the surrounding scene image slowly.
對應本發明之系統,本發明亦提供一種透過機上盒播放環景影像之視角控制方法,其步驟包含:1.該機上盒中的該視訊解碼模組在該機上盒內的網路模組接收視訊串流時,對視訊串流進行視訊解碼,以獲得解碼後之影像畫面以及對應影像畫面的移動向量;2.該機上盒中的該轉動視角模組判斷遙控器傳送至該機上盒的訊號是否為轉動視角事件;若為轉動視角事件,則根據目前影像畫面經轉動視角事件轉動視角後的預測畫面中的移動向量,來動態地計算產生該轉動視角速率;3.該轉動視角模組透過該機上盒內的顯示模組依據該轉動視角速率呈現對應視角的預測畫面。 Corresponding to the system of the present invention, the present invention also provides a method for controlling the viewing angle of the surrounding scene image through a set-top box, the steps include: 1. the network of the video decoding module in the set-top box in the set-top box When the module receives the video stream, it performs video decoding on the video stream to obtain the decoded video frame and the motion vector corresponding to the video frame; 2. The rotating perspective module in the set-top box determines that the remote control transmits to the remote control Whether the signal of the set-top box is a rotation angle event; if it is a rotation angle event, dynamically calculate the rate of rotation angle according to the motion vector in the predicted picture after the rotation angle event is rotated in the current image frame; 3. the The rotating viewing angle module presents the predicted picture of the corresponding viewing angle according to the rotating viewing angle rate through the display module in the set-top box.
透過本發明的透過機上盒播放環景影像之視角控制系統及方法,即可克服先前技術中之缺點,使機上盒裝置得以平順地展示環景影像供使用者觀看。 By using the angle of view control system and method for playing a surround view image through a set-top box of the present invention, the shortcomings in the prior art can be overcome, and the set-top box device can smoothly display the surround view image for the user to watch.
100‧‧‧視訊伺服器 100‧‧‧video server
200‧‧‧機上盒 200‧‧‧ Set-top box
210‧‧‧網路模組 210‧‧‧ Network Module
220‧‧‧視訊解碼模組 220‧‧‧Video Decoding Module
230‧‧‧轉動視角模組 230‧‧‧Rotating view module
231‧‧‧轉動視角事件判斷模組 231‧‧‧Rotating perspective event judgment module
232‧‧‧轉動視角速率計算模組 232‧‧‧Rotating angle rate calculation module
240‧‧‧顯示模組 240‧‧‧Display Module
300‧‧‧電視 300‧‧‧ TV
400‧‧‧遙控器 400‧‧‧Remote control
圖1為本發明之系統架構圖;圖2為一環景影像範例圖; 圖3為以本發明控制環景影像視角的第一範例圖;圖4為以本發明控制環景影像視角的第二範例圖;圖5為以本發明控制環景影像視角的第三範例圖。 Fig. 1 is a system architecture diagram of the present invention; Fig. 2 is an exemplary diagram of a surrounding scene image; Fig. 3 is a first exemplary diagram of controlling the scene scene angle of the present invention; and Fig. 4 is a second diagram of controlling the scene scene angle of the present invention Exemplary diagram; FIG. 5 is a third exemplary diagram of controlling the viewing angle of the surrounding scene image according to the present invention.
以下將以實施例結合圖式對本發明進行進一步說明,首先請參照圖1,係為本發明之透過機上盒播放環景影像之視角控制系統之系統架構圖,其中,由視訊伺服器100傳送環景影像中一視角影像畫面的視訊串流至機上盒200,由機上盒200中的網路模組210接收,而機上盒200中的視訊解碼模組220即自視訊串流中解碼出目前視角的影像畫面和對應影像畫面的移動向量,其中,移動向量A mv 透過將影像畫面中所有影格的移動量總和值除以畫面的長乘寬之值來計算,視訊解碼模組220將目前視角的影像畫面傳送至機上盒200中的顯示模組240,顯示模組240即進行環景影像必要的變形化調整,再將調整後的影像畫面傳送至電視300,使用者即可在電視300上觀看目前視角的影像畫面。 The following will further explain the present invention with embodiments and drawings. First, please refer to FIG. 1, which is a system architecture diagram of a viewing angle control system for playing a surrounding scene image through a set-top box according to the present invention, which is transmitted by the video server 100. The video stream from a perspective image in the surround view image is transmitted to the set-top box 200 and received by the network module 210 in the set-top box 200, and the video decoding module 220 in the set-top box 200 is from the video stream Decode the image frame of the current view and the motion vector of the corresponding image frame. The motion vector A mv is calculated by dividing the sum of the movement of all frames in the image frame by the value of the length and width of the frame. The video decoding module 220 The video image of the current perspective is transmitted to the display module 240 in the set-top box 200. The display module 240 performs the necessary deformation adjustment of the surrounding scene image, and then transmits the adjusted video image to the TV 300, and the user can View the video image of the current viewing angle on the TV 300.
而在使用者觀看環景影像的過程中,機上盒200中的轉動視角模組230則持續接收視訊解碼模組220自視訊串流中解碼出目前視角的的移動向量;而當使用者需要切換至環景影像中的其他視角時,使用者會透過遙控器400傳送訊號至機上盒200,轉動視角模組230中的轉動視角事件判斷模組231會根據一門檻值判斷遙控器400傳送來的訊號是否為轉動視角事件,若判斷為轉動視角事件,則通知轉動視角模組230中的另一轉動視角速率計算模組232進行轉動視角速率的計算,此時,可以先嘗試以基本轉動速率為R base 來轉動, 而視訊解碼模組220則會持續解碼使用者欲轉動至的預測畫面中的移動向量,此時,轉動視角速率計算模組232得到預測畫面中的移動向量後,即調整轉動視角速率R為R base 除以預測畫面動態向量A mv 之值,再透過顯示模組240呈現轉動視角速率R的預測畫面至電視300,如此,轉動視角模組230即可透過持續獲取預測畫面中的動態向量以動態地調整轉動視角速率,方能以較適合使用者觀看的速率提供環景影像中的視角畫面給使用者。 While the user is watching the surrounding image, the rotating perspective module 230 in the set-top box 200 continuously receives the video decoding module 220 to decode the motion vector of the current perspective from the video stream; and when the user needs When switching to other perspectives in the surround view image, the user will send a signal to the set-top box 200 through the remote control 400, and the rotation perspective event determination module 231 in the rotation perspective module 230 will judge the remote control 400 to transmit based on a threshold value. Whether the incoming signal is a rotation angle event, if it is determined to be a rotation angle event, notify another rotation angle rate calculation module 232 in the rotation angle angle module 230 to calculate the rotation angle rate. At this time, you can first try to use the basic rotation The rate is R base to rotate, and the video decoding module 220 will continue to decode the motion vector in the prediction picture to which the user wants to rotate. At this time, after rotating the viewing angle rate calculation module 232 to obtain the motion vector in the prediction picture, that is, Adjust the rotation angle of view rate R to be the value of R base divided by the predicted picture motion vector A mv , and then present the predicted picture of rotation of the angle of view rate R to the power through the display module 240. Vision 300. In this way, the rotation angle of view module 230 can dynamically adjust the rotation angle of view by continuously acquiring the motion vector in the predicted picture, so as to provide the angle of view in the surrounding scene image to the user at a rate more suitable for the user to watch. .
再請參照圖2,其係為一環景影像範例圖,呈現了以攝影鏡頭環景拍攝街頭的一範例即時動態影像;在本實施例中,使用者正透過本發明之系統的機上盒於電視上觀看此範例中的第一視角,即環景影像中的中間位置,如圖3的視角範例圖所示,與圖2相較之下,其中,本發明使用者的視角僅可觀看到圖中正常亮度的框架內之影像畫面,環景影像中其餘部分透過深色遮罩處理,為使閱者方便了解本發明使用者所能真正觀看之部分,而圖3、4的表現方式亦同。 Please refer to FIG. 2 again, which is an example of a surrounding scene image, showing an example real-time dynamic image of shooting streets with a photography lens surrounding scene. In this embodiment, a user is using a set-top box of the system of the present invention to The first angle of view in this example, that is, the middle position in the surrounding image, is shown on the television, as shown in the perspective view of FIG. 3, compared with FIG. 2, where the perspective of the user of the present invention can only be viewed The image in the frame of the normal brightness in the picture, the rest of the surrounding image is processed by dark masks, in order to make it easier for the reader to understand the parts that the user of the present invention can actually watch, and the expressions in Figures 3 and 4 are also with.
當使用者透過遙控器發送訊號至機上盒欲自第一視角調整視角向右至第二視角時(第二視角如圖4的視角範例圖所示),本發明的視訊解碼模組即嘗試取得使用者欲向右調整的預測畫面(即圖中正常亮度的框架內之影像畫面),此預測畫面中大部分面積係為建築物或地磚,這些物件非屬於移動之物件,顯然地,第二視角的預測畫面的移動向量相對於原視角影像畫面應較低,此時,轉動視角速率計算模組計算轉動視角速率時(R為R base 除以預測畫面動態向量A mv 之值),會以較高的轉動視角速率讓顯示模組轉動至預測畫面,令使用者可以較快的速度掠過環景畫面中的背景部分。 When the user sends a signal to the set-top box via the remote control to adjust the viewing angle from the first viewing angle to the right to the second viewing angle (the second viewing angle is shown in the example viewing angle of FIG. 4), the video decoding module of the present invention attempts Obtain the prediction picture that the user wants to adjust to the right (that is, the image picture in the frame of normal brightness in the figure). Most of the area in this prediction picture is a building or a floor tile. These objects are not moving objects. Obviously, the The motion vector of the two-view prediction picture should be lower than the original view image picture. At this time, when the rotation view rate calculation module calculates the rotation view rate ( R is the value of R base divided by the prediction picture dynamic vector A mv ), The display module is rotated to the prediction screen at a higher rotation angle of view, so that the user can quickly pass through the background portion of the surrounding scene.
而當使用者透過遙控器發送訊號至機上盒欲自第一視角調整視角向左至第三視角時(第三視角如圖5的視角範例圖所示),本發明的視訊解碼模組則嘗試取得使用者欲向左調整的預測畫面(即圖中正常亮度的框架內之影像畫面),此預測畫面中包含有較多的行人,這些物件屬於會持續移動之物件,故可知,第三視角的預測畫面的移動向量相對於原視角影像畫面應較高,此時,轉動視角速率計算模組計算轉動視角速率時(R為R base 除以預測畫面動態向量A mv 之值),會以較低的轉動視角速率讓顯示模組轉動至預測畫面,令使用者可以較低的速度仔細觀看環景畫面中會移動的部分。 When the user sends a signal to the set-top box through the remote control to adjust the viewing angle from the first viewing angle to the left to the third viewing angle (the third viewing angle is shown in the viewing angle example of FIG. 5), the video decoding module of the present invention Try to obtain the prediction picture that the user wants to adjust to the left (that is, the image picture in the frame of normal brightness in the figure). This prediction picture contains more pedestrians. These objects are objects that will continue to move. Therefore, we know that the third The motion vector of the predicted picture of the viewing angle should be higher than that of the original picture. At this time, when the rotating view rate calculation module calculates the rotating view rate ( R is the value of R base divided by the predicted picture dynamic vector A mv ), The lower rotation angle of view allows the display module to rotate to the prediction screen, so that the user can carefully watch the moving part of the surrounding scene at a lower speed.
應當瞭解,上列詳細說明係為針對本發明的可行實施例之具體說明,惟各該實施例並非用以限制本發明之專利範圍,凡未脫離本發明技藝精神所為之等效實施或變更,均應包含於本案之專利範圍中。 It should be understood that the detailed descriptions above are specific descriptions of the feasible embodiments of the present invention, but each of the embodiments is not intended to limit the patent scope of the present invention, and any equivalent implementation or change without departing from the technical spirit of the present invention, All should be included in the patent scope of this case.
本發明於技術思想上實屬創新,也具備先前技術不及的多種功效,已充分符合新穎性及進步性之法定發明專利要件,爰依法提出專利申請,懇請 貴局核准本件發明專利申請案以勵發明,至感德便。 The invention is technically innovative and possesses multiple effects that are inferior to the previous technology. It has fully met the requirements for statutory invention patents of novelty and progress. It has filed a patent application in accordance with the law. Your office is requested to approve this invention patent application for encouragement. Invented to the utmost.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW105141322A TWI634779B (en) | 2016-12-14 | 2016-12-14 | Viewing angle control system and method for playing surround image through set-top box |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW105141322A TWI634779B (en) | 2016-12-14 | 2016-12-14 | Viewing angle control system and method for playing surround image through set-top box |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201822536A true TW201822536A (en) | 2018-06-16 |
TWI634779B TWI634779B (en) | 2018-09-01 |
Family
ID=63258279
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW105141322A TWI634779B (en) | 2016-12-14 | 2016-12-14 | Viewing angle control system and method for playing surround image through set-top box |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI634779B (en) |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100338647C (en) * | 2004-08-06 | 2007-09-19 | 马堃 | Dynamic display method for static image and browser |
CN102111672A (en) * | 2009-12-29 | 2011-06-29 | 康佳集团股份有限公司 | Method, system and terminal for viewing panoramic images on digital television |
US9232257B2 (en) * | 2010-09-22 | 2016-01-05 | Thomson Licensing | Method for navigation in a panoramic scene |
-
2016
- 2016-12-14 TW TW105141322A patent/TWI634779B/en active
Also Published As
Publication number | Publication date |
---|---|
TWI634779B (en) | 2018-09-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11303881B2 (en) | Method and client for playing back panoramic video | |
JP7029562B2 (en) | Equipment and methods for providing and displaying content | |
US9270941B1 (en) | Smart video conferencing system | |
KR102545195B1 (en) | Method and apparatus for delivering and playbacking content in virtual reality system | |
US10499066B2 (en) | Method and apparatus for improving efficiency of content delivery based on consumption data relative to spatial data | |
US9167289B2 (en) | Perspective display systems and methods | |
US20180310010A1 (en) | Method and apparatus for delivery of streamed panoramic images | |
EP3391639B1 (en) | Generating output video from video streams | |
JP2017528947A (en) | System and method for use in playback of panoramic video content | |
KR20170095030A (en) | Scheme for supporting virtual reality content display in communication system | |
TWI572203B (en) | Media streaming system, control method and non-transitory computer readable storage medium | |
EP2893706A2 (en) | Augmented reality for video system | |
US10601889B1 (en) | Broadcasting panoramic videos from one server to multiple endpoints | |
KR20130024357A (en) | Real-time panorama streaming system for high resolution panorama videos and/or images | |
CN102801963A (en) | Electronic PTZ method and device based on high-definition digital camera monitoring | |
WO2018036112A1 (en) | Method and system for encoding/decoding panoramic video | |
JP6224516B2 (en) | Encoding method and encoding program | |
US20220172440A1 (en) | Extended field of view generation for split-rendering for virtual reality streaming | |
US10887653B2 (en) | Systems and methods for performing distributed playback of 360-degree video in a plurality of viewing windows | |
JP2021182737A (en) | Controlling pan-tilt zoom camera | |
TWI634779B (en) | Viewing angle control system and method for playing surround image through set-top box | |
CN202818497U (en) | Electronic PTZ device capable of monitoring based on high-definition digital camera | |
Lee et al. | A real-time face tracking system based on a single PTZ camera | |
US10708631B2 (en) | Method and terminal for tile selection amongst a set of tiles | |
JP2021078114A (en) | Photographing device, distribution system, distribution method, and recording medium |