TW201201573A - Control device, camera system and program - Google Patents
Control device, camera system and program Download PDFInfo
- Publication number
- TW201201573A TW201201573A TW100107926A TW100107926A TW201201573A TW 201201573 A TW201201573 A TW 201201573A TW 100107926 A TW100107926 A TW 100107926A TW 100107926 A TW100107926 A TW 100107926A TW 201201573 A TW201201573 A TW 201201573A
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- preset
- camera
- entire image
- display
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Accessories Of Cameras (AREA)
- Stereoscopic And Panoramic Photography (AREA)
- Indication In Cameras, And Counting Of Exposures (AREA)
Abstract
Description
201201573 六、發明說明: 【發明所屬之技術領域】 本發明係相關於控制裝置,相機系統及程式° 【先前技術】 已知相機控制系統,其中可由相機擷取之範圍顯示作 整個影像,及由在整個影像上的操作來控制相機的成像方 向。例如在日本專利申請案號碼JP-A-2005-3 54748說明此 相機控制系統。另外,已知相機控制系統’其中對應於預 設區之區段被顯示作縮圖,及當選擇想要的一縮圖時’相 機的成像方向被控制到對應的預設區(例如參考曰本專利 申請公開號碼JP-A-2008-22260 )。 【發明內容】 然而,在日本專利申請案號碼JP-A-2005-3 54748和在 日本專利申請公開號碼JP-A-2008-22260所說明之上述相機 控制系統的任一個中,在可由相機所擷取之範圍中(整個 影像)無法容易確定位置對應於預設區。此外,在JP-A-2005-354748和JP-A-2008-22260所說明之技術中,在整個 影像上無法決定預設位置。因此,無法藉由在整個影像上 的操作來控制成像方向朝預設區。結果,無法直覺式控制 成像方向到想要的預設方向,及需要許多嘗試和錯誤。 按照上述,希望設置控制裝置、相機系統、及程式, 它們是創新及改良的,並且能夠直覺式控制成像方向到設 -5- 201201573 定在整個影像中之預設區。 根據本發明的實施例,設置有控制裝置’包括:顯示 控制部,其執行控制,使得顯示由相機所擷取的整個影像 之整個影像顯示區,及放大對應於整個影像上所指定的位 置之區域及顯示放大影像的放大影像顯示區被顯示;以及 控制部,其執行控制,使得對應於整個影像上所指定的位 置之區域被改變。區域包括至少一預設區1及顯币控制部 顯示對應於預設區之區段在整個影像上。 在此組態中,控制部執行控制,使得由相機擷取對應 於整個影像上所指定的位置之區域。 在此組態中,當在整個影像上選擇對應於預設區之區 段時,控制部控制相機的成像方向,使得選定的預設區被 擷取。 在此組態中,依據基於預設區所設定的視角尺寸,顯 示控制部顯示對應於預設區之區段在整個影像上。 在此組態中,當預設區未定位在整個影像的中心時, 使用當預設區位在整個影像的中心時之框的尺寸做爲參考 ,顯示控制部以基於預設區所設定之成像放大倍數來校正 框的尺寸,及執行顯示。 在此組態中,根據由使用者所執行之拖曳操作,顯示 控制部改變預設區的位置,及執行顯示。 在此組態中,當在整個影像上指定複數個預設區時, 控制部控制相機的成像方向,使得複數個預設區被連續擷 取;並且顯示控制部控制影像顯示,使得複數個預設區被201201573 VI. Description of the Invention: [Technical Field] The present invention relates to a control device, a camera system, and a program. [Prior Art] A camera control system is known in which a range that can be captured by a camera is displayed as an entire image, and The operation on the entire image controls the imaging direction of the camera. This camera control system is described, for example, in Japanese Patent Application No. JP-A-2005-3 54748. In addition, the camera control system is known in which the section corresponding to the preset area is displayed as a thumbnail, and when the desired thumbnail is selected, the imaging direction of the camera is controlled to the corresponding preset area (for example, reference 曰This patent application publication number is JP-A-2008-22260). SUMMARY OF THE INVENTION However, in any of the above camera control systems described in Japanese Patent Application No. JP-A-2005-3 54748 and Japanese Patent Application Laid-Open No. JP-A-2008-22260, In the range of capture (the entire image), it is not easy to determine that the position corresponds to the preset area. Further, in the technique described in JP-A-2005-354748 and JP-A-2008-22260, the preset position cannot be determined over the entire image. Therefore, it is impossible to control the imaging direction toward the preset area by the operation on the entire image. As a result, it is impossible to intuitively control the imaging direction to the desired preset direction, and many trials and errors are required. In accordance with the above, it is desirable to provide control devices, camera systems, and programs that are innovative and improved, and that can intuitively control the imaging direction to a preset area that is set in the entire image. According to an embodiment of the present invention, the control device is provided' including: a display control portion that performs control such that the entire image display area of the entire image captured by the camera is displayed, and the enlargement corresponds to the designated position on the entire image. The area and the enlarged image display area displaying the enlarged image are displayed; and the control section performs control such that the area corresponding to the designated position on the entire image is changed. The area includes at least one preset area 1 and a coin control unit. The section corresponding to the preset area is displayed on the entire image. In this configuration, the control unit performs control so that the camera captures an area corresponding to the position specified on the entire image. In this configuration, when a section corresponding to the preset area is selected on the entire image, the control section controls the imaging direction of the camera so that the selected preset area is captured. In this configuration, depending on the angle of view set based on the preset area, the display control section displays the section corresponding to the preset area on the entire image. In this configuration, when the preset area is not positioned at the center of the entire image, the size of the frame when the preset position is at the center of the entire image is used as a reference, and the display control unit sets the imaging based on the preset area. Magnification to correct the size of the frame and perform display. In this configuration, the display control unit changes the position of the preset area and performs display in accordance with the drag operation performed by the user. In this configuration, when a plurality of preset areas are specified on the entire image, the control unit controls the imaging direction of the camera such that a plurality of preset areas are continuously captured; and the display control unit controls the image display so that the plurality of presets are Set up
S -6 - 201201573 顯示作爲列表。 在此組態中,當在整個影像上指定複數個預設區時’ 控制部控制相機的該成像方向,使得複數個該預設區被連 續擷取;並且顯示控制部交替顯示複數個預設區。 根據本發明的另一實施例,設置有相機系統’包括: 相機,其擷取影像;以及控制裝置’其控制相機。控制裝 置包括:顯示控制部,其執行控制,使得顯示由相機所擷 取的整個影像之整個影像顯示區,及放大對應於整個影像 上所指定的位置之區域及顯示放大影像的放大影像顯示區 被顯示;以及控制部,其執行控制,使得對應於整個影像 上所指定的位置之區域被改變。區域包括至少—預設區’ 及顯示控制部顯示對應於預設區之區段在整個影像上。 在此組態中,控制部執行控制,使得由相機擷取對應 於整個影像上所指定的位置之區域。 在此組態中,當在整個影像上選擇對應於預設區之區 段時,控制部控制相機的成像方向,使得選定的預設區被 擷取。 在此組態中,依據基於預設區所設定的視角尺寸,顯 示控制部顯示對應於預設區之區段在整個影像上。 在此組態中,當預設區未定位在整個影像的中心時, 使用當預設區位在整個影像的中心時之框的尺寸做爲參考 ,顯示控制部以基於預設區所設定之成像放大倍數來校正 框的尺寸,及執行顯示。 在此組態中,根據由使用者所執行之拖曳操作,顯示 201201573 控制部改變預設區的位置,及執行顯示° 在此組態中,當在整個影像上指定複數個預設區時’ 控制部控制相機的成像方向,使得複數個預設區被連續擷 取;並且顯示控制部控制影像顯示,使得複數個預設區被 顯示作爲列表。 在此組態中,當在整個影像上指定複數個預設區時, 控制部控制相機的成像方向,使得複數個預設區被連續擷 取;並且顯示控制部交替顯示複數個預設區。 根據本發明的另一實施例,提供有程式,其包含命令 電腦操作如下之指令:顯示控制單元,其執行控制,使得 顯示由相機所擷取的整個影像之整個影像顯示區,及放大 整個影像上所指定的至少一預設區及顯示放大影像的放大 影像顯示區被顯示,並且其顯示對應於預設區之區段在整 個影像上:以及控制單元,其執行控制,使得對應於整個 影像上所指定的位置之區域被改變。 根據上述本發明,能夠提供控制裝置、相機系統、及 程式,它們能夠直覺式控制成像方向到設定在整個影像中 之預設區。 【實施方式】 下面’將參考附圖詳細說明本發明的較佳實施例。需 注意的是’在此說明書和附圖中,具有實質上相同功能和 結構之構成元件以相同參考號碼表示,及省略這些構成元 件的重複說明。S -6 - 201201573 is displayed as a list. In this configuration, when a plurality of preset areas are specified on the entire image, the control unit controls the imaging direction of the camera such that a plurality of the preset areas are continuously captured; and the display control unit alternately displays a plurality of presets Area. According to another embodiment of the present invention, a camera system is provided that includes: a camera that captures an image; and a control device that controls the camera. The control device includes: a display control unit that performs control such that the entire image display area of the entire image captured by the camera is displayed, and an area corresponding to the designated position on the entire image and an enlarged image display area for displaying the enlarged image are enlarged And being displayed; and a control unit that performs control such that an area corresponding to a position specified on the entire image is changed. The area includes at least a preset area and a display control unit displays the section corresponding to the preset area on the entire image. In this configuration, the control unit performs control so that the camera captures an area corresponding to the position specified on the entire image. In this configuration, when a section corresponding to the preset area is selected on the entire image, the control section controls the imaging direction of the camera so that the selected preset area is captured. In this configuration, depending on the angle of view set based on the preset area, the display control section displays the section corresponding to the preset area on the entire image. In this configuration, when the preset area is not positioned at the center of the entire image, the size of the frame when the preset position is at the center of the entire image is used as a reference, and the display control unit sets the imaging based on the preset area. Magnification to correct the size of the frame and perform display. In this configuration, according to the drag operation performed by the user, the display 201201573 control changes the position of the preset area and performs display. In this configuration, when multiple preset areas are specified on the entire image' The control unit controls the imaging direction of the camera such that a plurality of preset areas are continuously captured; and the display control unit controls the image display such that a plurality of preset areas are displayed as a list. In this configuration, when a plurality of preset areas are designated on the entire image, the control section controls the imaging direction of the camera such that a plurality of preset areas are continuously captured; and the display control section alternately displays a plurality of preset areas. According to another embodiment of the present invention, there is provided a program comprising instructions for instructing a computer to operate: a display control unit that performs control such that an entire image display area of the entire image captured by the camera is displayed, and the entire image is enlarged The at least one preset area specified above and the enlarged image display area displaying the enlarged image are displayed, and the section corresponding to the preset area is displayed on the entire image: and the control unit performs control so as to correspond to the entire image The area of the position specified above is changed. According to the present invention as described above, it is possible to provide a control device, a camera system, and a program which can intuitively control the imaging direction to a preset area set in the entire image. [Embodiment] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It is to be noted that, in the specification and the drawings, the structural elements that have substantially the same functions and structures are denoted by the same reference numerals, and the repeated description of these constituent elements is omitted.
S -8- 201201573 需注意的是,以下面順序進行說明。 1·第一實施例(包括相機終端裝置和伺服器之成像系 統的例子) (1 )成像系統之組態例子 (2 )相機終端裝置和中央伺服器之組態例子 (3 )第一全景影像和第二全景影像之顯示操作 (4)產生第一全景影像之處理 (5 )圖形使用介面(GUI ) (6)第一全景影像上的成像方向之指定 (7 )使用預設位置之控制 1 ·第一實施例 (1 )成像系統之組態例子 圖1爲根據本發明的實施例之成像系統1 00的總組態之 槪要圖。成像系統100包括相機終端裝置(IP(網際網路協 定)相機)200、中央伺服器3 00、及用戶400。複數個相機 終端裝置200、中央伺服器3 00、及用戶400透過網路500來 連接。代理伺服器600連接到網路500,及複數個相機終端 裝置200連接到代理伺服器600。另外,監視器320連接到 中央伺服器3 00。在本實施例中,相機終端裝置200例如是 位在室內或室外之監視相機。可藉由在中央伺服器300的 監視器320上顯示相機終端裝置200的每一個所取得之影像 來監視設置相機終端裝置200的每一個之區域。透過網路 5〇〇將用戶400連接到相機終端裝置200、中央伺服器300、 201201573 或代理伺服器600。用戶400可具有中央伺服器3 00的功能 和監視器320的功能,稍後將說明。透過網路500將由相機 終端裝置200所擷取的影像傳送到用戶400,及第一全景影 像和第二全景影像與稍後將說明之現場直播影像一起顯示 在用戶400的每一個之顯示螢幕上。需注意的是,雖然IP 相機被圖示作爲相機終端裝置200的例子,但是相機終端 裝置200並不侷限於IP相機,及它們可以是類比相機。 全景影像(全視影像、整個影像)指示由相機終端裝 置2 00的每一個可擷取之範圍。具有各種全景影像的形狀 ,其例子包括圓形全景影像和矩形全景影像,諸如圖4所 示者等,及如同投射到圓柱形表面上之環型全景影像。下 面,在本實施例中,分別說明圓形全景影像和矩形全景影 像作爲第一全景影像和第二全景影像的例子。 子端 例終 態機 組相 之的 器中 服統 伺系 央像 中成 和之 置示 裝所 端1 終圖 機爲 目2 丰圖 置 裝 中 和 央伺服器300之詳細組態槪要圖。圖2所示之相機終端裝置 200和中央伺服器3 00的各自構成元件係可由硬體(電路等 ),或者藉由諸如CPU等算術處理電路,及使算術處理電 路能夠運作之軟體(程式)來形成。相機終端裝置200的 相機部201包括成像光學系統。相機部201依據供應自稍後 將說明之終端控制部2 1 0的成像控制訊號CTa來執行成像操 作,及產生視頻訊號Dcam。另外,相機部201透過匯流排 220將所產生的視頻訊號Dcam供應到訊號處理部202。需注S -8- 201201573 It should be noted that the explanation is given in the following order. 1. First Embodiment (Example of an imaging system including a camera terminal device and a server) (1) Configuration example of an imaging system (2) Configuration example of a camera terminal device and a central server (3) First panoramic image Display operation of the second panoramic image (4) processing of generating the first panoramic image (5) graphic use interface (GUI) (6) designation of the imaging direction on the first panoramic image (7) control using the preset position 1 First Embodiment (1) Configuration Example of Imaging System FIG. 1 is a schematic diagram of a general configuration of an imaging system 100 according to an embodiment of the present invention. The imaging system 100 includes a camera terminal device (IP (Internet Protocol) camera) 200, a central server 300, and a user 400. A plurality of camera terminal devices 200, a central server 300, and a user 400 are connected via a network 500. The proxy server 600 is connected to the network 500, and a plurality of camera terminal devices 200 are connected to the proxy server 600. In addition, the monitor 320 is connected to the central server 3 00. In the present embodiment, the camera terminal device 200 is, for example, a surveillance camera located indoors or outdoors. The area in which each of the camera terminal devices 200 is set can be monitored by displaying the image acquired by each of the camera terminal devices 200 on the monitor 320 of the center server 300. The user 400 is connected to the camera terminal device 200, the central server 300, the 201201573, or the proxy server 600 via the network. The user 400 can have the functions of the central server 300 and the functions of the monitor 320, which will be described later. The image captured by the camera terminal device 200 is transmitted to the user 400 through the network 500, and the first panoramic image and the second panoramic image are displayed on the display screen of each of the users 400 together with the live broadcast image to be described later. . It is to be noted that although the IP camera is illustrated as an example of the camera terminal device 200, the camera terminal device 200 is not limited to an IP camera, and they may be analog cameras. The panoramic image (Full view image, entire image) indicates the range that can be captured by each of the camera terminal devices 200. Shapes having various panoramic images, examples of which include circular panoramic images and rectangular panoramic images, such as those shown in Fig. 4, and ring-shaped panoramic images as projected onto a cylindrical surface. In the following, in the present embodiment, a circular panoramic image and a rectangular panoramic image are respectively described as examples of the first panoramic image and the second panoramic image. The sub-terminal example of the end-machine unit is in the middle of the unit. The unit is set to the end. The final picture is the detailed configuration of the central server 300. The respective constituent elements of the camera terminal device 200 and the central server 300 shown in FIG. 2 may be hardware (circuits or the like), or an arithmetic processing circuit such as a CPU, and a software (program) that enables the arithmetic processing circuit to operate. To form. The camera section 201 of the camera terminal device 200 includes an imaging optical system. The camera section 201 performs an imaging operation based on the imaging control signal CTa supplied from the terminal control section 2 10 to be described later, and generates a video signal Dcam. Further, the camera unit 201 supplies the generated video signal Dcam to the signal processing unit 202 via the bus bar 220. Need to note
S 10- 201201573 意的是,記憶體部203、成像方向控制部204、網路界面部 206、全景影像儲存部207、及終端控制部210亦連接到匯 流排220 » 訊號處理部202執行視頻訊號Dcam的壓縮處理,及將 所獲得的視頻編碼訊號DV儲存在記憶體部203中。另外, 訊號處理部202使用藉由連續移動相機部201的成像方向所 獲得之視頻訊號Dcam,來產生第一全景影像的視頻訊號 DF (下面亦稱此訊號爲第一全景影像訊號DF)及第二全 景影像的視頻訊號DP (下面亦稱此訊號爲第二全景影像訊 號DP )。然後,訊號處理部202將所產生的第一全景影像 訊號DF及第二全景影像訊號DP儲存在全景影像儲存部207 。需注意的是,視頻訊號Dcam的壓縮處理和第一全景影像 訊號DF及第二全景影像訊號DP之產生係基於供應自稍後 將說明的終端控制部210之訊號處理控制訊號CTb來執行。 爲了將相機部201的成像方向移動至供應自稍後將說 明之終端控制部210的方向控制訊號CTc所指示之方向,成 像方向控制部204計算當移動成像方向時之速度和加速度 。另外,成像方向控制部204基於計算結果而產生執行全 景拍攝操作之驅動訊號MDp和執行上下搖攝操作之驅動訊 號MDt,以及供應所產生的驅動訊號MDp及MDt到成像方 向調整部205。另外,成像方向控制部204產生指示哪一方 向爲相機部201的成像方向之相機位置資訊訊號PM,及供 應所產生的相機位置資訊訊號PM到終端控制部2 1 0。 成像方向調整部205包括使相機部201能夠在左右方向 -11 - 201201573 移動之全景拍攝操作馬達,及使相機部20 1能夠在上下方 向移動之上下搖攝操作馬達。成像方向調整部2 05使用驅 動訊號MDp來驅動全景拍攝操作馬達,及使用驅動訊號 MDt來驅動上下搖攝操作馬達。如此,成像方向調整部205 將相機部20 1之成像方向調整到由方向控制訊號CTc所指示 的方向。需注意的是,假設成像方向調整部205執行連續 全景拍攝操作,但並不限制其移動範圍。 圖3爲相機終端裝置200的全景拍攝操作和上下搖攝拍 攝操作的槪要圖,及圖示相機終端裝置200裝附在天花板 等等之例子。圖3B圖示根據本實施例之相機終端裝置200 的全景拍攝/上下搖攝操作。另一方面,圖3A圖示一般相 機終端裝置的全景拍攝/上下搖攝操作以作比較。如圖3A 所示,在一般相機終端裝置中,執行連續360度全景拍攝 操作,及從垂直方向到水平方向的90度範圍執行上下搖攝 操作。相反地,在根據本實施例之相機終端裝置200中, 執行連續3 60度全景拍攝操作,及在集中於垂直方向的220 度範圍中執行上下搖攝操作。因此,可使用稍後將說明之 技術產生第一全景影像的視頻訊號DF,並且儲存在全景影 像儲存部207中。稍後將說明之第一全景影像爲圓形全景 影像。當成像方向***作橫越圓心的附近時,根據本實施 例之相機終端裝置200亦可以最短的距離而機械式移動到 目標成像方向。相反地,在一般相機終端裝置中,無法機 械式移動相機成像方向橫越圓心。 網路介面部206爲透過網路5 00執行相機終端裝置200S 10-201201573 means that the memory unit 203, the imaging direction control unit 204, the network interface unit 206, the panoramic image storage unit 207, and the terminal control unit 210 are also connected to the bus bar 220. The signal processing unit 202 performs video signals. The compression processing of the Dcam and the obtained video encoded signal DV are stored in the memory unit 203. In addition, the signal processing unit 202 generates a video signal DF of the first panoramic image (hereinafter referred to as the first panoramic video signal DF) and the video signal Dcam obtained by continuously moving the imaging direction of the camera unit 201. The video signal DP of the second panoramic image (hereinafter also referred to as the second panoramic video signal DP). Then, the signal processing unit 202 stores the generated first panoramic video signal DF and second panoramic video signal DP in the panoramic image storage unit 207. It is to be noted that the compression processing of the video signal Dcam and the generation of the first panoramic video signal DF and the second panoramic video signal DP are performed based on the signal processing control signal CTb supplied from the terminal control unit 210 which will be described later. In order to move the imaging direction of the camera section 201 to the direction indicated by the direction control signal CTc supplied from the terminal control section 210 which will be described later, the imaging direction control section 204 calculates the velocity and acceleration when the imaging direction is moved. Further, the imaging direction control unit 204 generates a driving signal MDp for performing the panoramic shooting operation and a driving signal MDt for performing the vertical panning operation based on the calculation result, and supplies the generated driving signals MDp and MDt to the imaging direction adjusting portion 205. Further, the imaging direction control unit 204 generates a camera position information signal PM indicating which direction is the imaging direction of the camera unit 201, and a camera position information signal PM generated by the supply to the terminal control unit 2 1 0. The imaging direction adjustment unit 205 includes a panoramic imaging operation motor that enables the camera unit 201 to move in the left-right direction -11 - 201201573, and a camera unit 20 1 that can move up and down to pan the operation motor. The imaging direction adjusting section 2 05 drives the panoramic shooting operation motor using the driving signal MDp, and drives the up-and-down panning operation motor using the driving signal MDt. In this manner, the imaging direction adjustment unit 205 adjusts the imaging direction of the camera unit 20 1 to the direction indicated by the direction control signal CTc. It is to be noted that it is assumed that the imaging direction adjustment section 205 performs a continuous panoramic photographing operation, but does not limit its moving range. Fig. 3 is a schematic diagram of a panoramic photographing operation and an up-and-down panning operation of the camera terminal device 200, and an example in which the camera terminal device 200 is attached to a ceiling or the like. FIG. 3B illustrates a panoramic shooting/up and down panning operation of the camera terminal device 200 according to the present embodiment. On the other hand, Fig. 3A illustrates a panoramic shooting/up and down panning operation of a general camera terminal device for comparison. As shown in Fig. 3A, in the general camera terminal device, a continuous 360-degree panoramic shooting operation is performed, and a vertical panning operation is performed from a vertical direction to a horizontal direction of 90 degrees. In contrast, in the camera terminal device 200 according to the present embodiment, the continuous 360-degree panoramic shooting operation is performed, and the up-and-down panning operation is performed in the 220-degree range concentrated in the vertical direction. Therefore, the video signal DF of the first panoramic image can be generated using the technique to be described later, and stored in the panoramic image storage section 207. The first panoramic image to be described later is a circular panoramic image. When the imaging direction is operated to traverse the center of the circle, the camera terminal device 200 according to the present embodiment can also mechanically move to the target imaging direction with the shortest distance. Conversely, in a general camera terminal device, it is not possible to mechanically move the camera imaging direction across the center of the circle. The network interface unit 206 executes the camera terminal device 200 through the network 5 00.
S -12- 201201573 和中央伺服器300之間的通訊之介面。 終端控制部2 1 0使用成像控制訊號CTa來控制相機部 201,使用訊號處理控制訊號CTb來控制訊號處理部202, 及使用方向控制訊號CTc來控制成像方向控制部204。如此 ,終端控制部2 1 0在連續移動成像方向的同時執行影像擷 取。然後,基於所獲得的視頻訊號Dcam,終端控制部2 1 0 產生第一全景影像訊號DF和第二全景影像訊號DP,及將 它們儲存在全景影像儲存部207。 根據本實施例之成像系統100可將基於視頻訊號Dcam 所產生現場直播影像連同基於第一全景影像訊號DF所產生 的第一全景影像或基於第二全景影像訊號DF所產生的第二 全景影像一起從相機終端裝置200傳送到中央伺服器300, 及可將它們顯示在監視器320上。需注意的是,在此說明 書中,具有第一全景影像或第二全景影像被稱作整個影像 之例子。圖4爲第二全景影像和第一全景影像的顯示狀態 之槪要圖。中央伺服器300可根據使用者選擇將第一全景 影像及第二全景影像的其中之一連同現場直播影像一起顯 示在監視器3 20上。另外,中央伺服器3 00可被建構,使得 其連同現場直播影像一起顯示第一全景影像和第二全景影 像二者。需注意的是,中心附近的影像不見之圖4的右側 上之圓形全景影像被圖示作第一全景影像。然而,第一全 景影像並不侷限於此例,及可使用中心附近的影像未不見 之圓形全景影像作爲第一全景影像。 相機終端裝置200置放在天花板等等,及從相機終端 -13- 201201573 裝置200以朝下方向顯示影像。因此,如圖4所示,集中於 從相機終端裝置200朝下延伸的垂直線,取得全景拍攝360 度和上下搖攝200度的範圍之第一全景影像,及第一全景 影像的輪廓爲圓形。 另外,成像方向調整部205被建構,使得其能夠如上 述連續執行全景拍攝操作。因此,假設儲存在全景影像儲 存部207之第二全景影像被形成,使得影像未如圖4所示一 般重疊。例如,假設第二全景影像的一端距參考方向具有 “+18 0度”的角度差,而第二全景影像的另一端距參考方向 具有180度”的角度差。另外,因爲全景拍攝操作的操作 範圍並無限制,所以例如與限制操作範圍的例子比較,無 法取得操作範圍的中心位置做爲參考方向。因此,事先設 定參考方向,及第二全景影像訊號DP被產生,使得此參考 方向對應於第二全景影像的中心位置。成像方向控制部 2 04產生指示例如相對於事先設定的參考方向之成像方向 的角度差之訊號作爲相機位置資訊訊號PM。 若以此方式事先設定參考方向,則無須決定使用哪一 方向作爲產生第二全景影像之成像操作時的參考方向。另 外,若由相機位置資訊訊號PM指示相對於參考方向之成 像方向的角度差,則容易在第二全景影像上決定基於相機 位置資訊訊號PM之成像方向的位置。 再者,在上下搖攝操作中,假設事先設定參考方向及 由相機位置資訊訊號PM所指示之相對於參考方向的成像 方向之角度差。如此,在第一全景影像和第二全景影像二Interface between S -12- 201201573 and central server 300. The terminal control unit 211 controls the camera unit 201 using the imaging control signal CTa, controls the signal processing unit 202 using the signal processing control signal CTb, and controls the imaging direction control unit 204 using the direction control signal CTc. Thus, the terminal control section 210 performs image capture while continuously moving the imaging direction. Then, based on the obtained video signal Dcam, the terminal control unit 2 1 0 generates the first panoramic video signal DF and the second panoramic video signal DP, and stores them in the panoramic image storage unit 207. The imaging system 100 according to the embodiment can generate a live broadcast image generated based on the video signal Dcam together with the first panoramic image generated based on the first panoramic image signal DF or the second panoramic image generated based on the second panoramic image signal DF. They are transmitted from the camera terminal device 200 to the central server 300, and they can be displayed on the monitor 320. It should be noted that in this specification, having the first panoramic image or the second panoramic image is referred to as an example of the entire image. Fig. 4 is a schematic diagram showing the display states of the second panoramic image and the first panoramic image. The central server 300 can display one of the first panoramic image and the second panoramic image along with the live broadcast image on the monitor 3 20 according to the user's selection. Additionally, the central server 300 can be constructed such that it displays both the first panoramic image and the second panoramic image along with the live broadcast image. It should be noted that the circular panoramic image on the right side of Fig. 4, which is not visible near the center, is illustrated as the first panoramic image. However, the first panoramic image is not limited to this example, and a circular panoramic image that is not seen in the vicinity of the center can be used as the first panoramic image. The camera terminal device 200 is placed on a ceiling or the like, and the image is displayed in a downward direction from the camera terminal -13 - 201201573. Therefore, as shown in FIG. 4, focusing on the vertical line extending downward from the camera terminal device 200, the first panoramic image in the range of 360 degrees of panoramic shooting and 200 degrees of vertical panning is obtained, and the outline of the first panoramic image is round. shape. Further, the imaging direction adjustment section 205 is constructed such that it can continuously perform the panoramic photographing operation as described above. Therefore, it is assumed that the second panoramic image stored in the panoramic image storage unit 207 is formed such that the images do not generally overlap as shown in FIG. For example, assume that one end of the second panoramic image has an angular difference of "+18 0 degrees" from the reference direction, and the other end of the second panoramic image has an angular difference of 180 degrees from the reference direction. In addition, because of the operation of the panoramic shooting operation The range is not limited, so for example, compared with the example of limiting the operating range, the center position of the operating range cannot be obtained as the reference direction. Therefore, the reference direction is set in advance, and the second panoramic image signal DP is generated such that the reference direction corresponds to The central position of the second panoramic image. The imaging direction control unit 204 generates a signal indicating an angular difference with respect to the imaging direction of the reference direction set in advance as the camera position information signal PM. If the reference direction is set in advance in this manner, it is not necessary Determining which direction to use as the reference direction when the imaging operation of the second panoramic image is generated. In addition, if the angle difference of the imaging direction with respect to the reference direction is indicated by the camera position information signal PM, it is easy to decide based on the second panoramic image based on the angle difference. The position of the imaging position of the camera position information signal PM. In the up and down panning operation, it is assumed that the reference direction and the angle of the imaging direction with respect to the reference direction indicated by the camera position information signal PM are set in advance. Thus, in the first panoramic image and the second panoramic image
-14- 201201573 者上,能夠容易決定基於相機位置資訊訊號PM的成像方 向之位置。需注意的是,在上下搖攝操作中,當相機終端 裝置200置放在天花板上時,可採用垂直方向做爲參考方 向。 終端控制部210分析透過網路介面部206供應自中央伺 服器300之命令訊號CM,及產生成像控制訊號CTa、訊號 處理控制訊號CTb、及方向控制訊號CTc。另外,終端控 制部2 1 0執行處理,以傳送儲存在記憶體部2 03之視頻編碼 訊號DV、儲存在全景影像儲存部207之第一全景影像訊號 DF和第二全景影像訊號DP、及供應自成像方向控制部204 之相機位置資訊訊號PM到中央伺服器3 00。 中央伺服器300的網路介面部301爲透過網路5 00執行 相機終端裝置200和中央伺服器300之間的通訊之介面。網 路介面部301將供應自相機終端裝置200的視頻編碼訊號 DV供應到延伸處理部302。另外,網路介面部301供應相 機位置資訊訊號PM到位置決定處理部303,及供應第一全 景影像訊號DF和第二全景影像訊號DP到影像處理部304。 延伸處理部3 02執行視頻編碼訊號DV的延伸處理,及 供應所獲得的視頻訊號D c am到顯示處理部3 0 5。 位置決定處理部303決定第一全景影像或第二全景影 像中的哪一位置對應於由相機位置資訊訊號PM所指示之 成像方向,及供應位置決定結果KP到影像處理部3 04。此 處’若假設相機位置資訊訊號PM產生第一全景影像訊號 DF或第二全景影像訊號DP’使得如上述事先設定之參考 -15- 201201573 方向爲全景拍攝操作和上下搖攝操作的中心位置, 相機位置資訊訊號PM指示參考方向和目前成像方 的角度差,基於相機位置決定訊號PM,容易決定 影像中(即、第一全景影像)中或者第二全景影像 個位置對應於目前成像方向。 影像處理部304基於位置決定結果KP來執行影 ,及產生第一全景影像的第一全景影像訊號DFC以 全景影像的第二全景影像訊號DPC。關於第二全景 號DPC,能夠產生由位置決定結果KP所決定的位置 作爲中心位置之第二全景影像訊號DPC。在此例中 處理部3 04決定所決定位置和第二全景影像的中心 間的差異量。然後,基於所決定的差異量,第二全 被處理,使得所決定的位置變成影像之中心位置。 ,以所決定的位置爲中心位置,設定“±180度”的“ 景影像之顯示影像框,及對應於偏離第二全景影像 影像框的差異量之區域的第二全景影像傳遞到沒有 區域。如此,產生所決定的位置被設定作中心位置 全景影像的第二全景影像訊號CPC。再者在第一全 訊號DFC中,當在稍後將說明之“用以轉動第一全景 模式”中,以類似於第二全景影像訊號DPC之方式, 一全景影像的全景拍攝方向中之所決定的位置和參 之間的差異量,及基於所決定的差異量,第一全景 處理,使得所決定的位置位在影像上。需注意的是 位置決定結果KP所決定之位置並未設定作爲中心位 及使得 向之間 鳥瞰圖 中哪一 像處理 及第二 影像訊 被設定 ,影像 位置之 景影像 尤其是 第二全 之顯示 影像之 之第二 景影像 影像的 決定第 考位置 影像被 ,在由 置的例 -16- 201201573 子中,在未改變中心位置之下’分別基於第一全景影像訊 號DF和第二全景影像訊號DP,影像處理部3〇4產生第一全 景影像的第一全景影像訊號DFC ’及第二全景影像的第二 全景影像訊號DPC。另外,影像處理部304顯示第一全景 影像訊號DFC和第二全景影像訊號DPC的每一個中之基於 位置決定結果KP的位置(即、相機部201的成像光學系統 之光軸所指向的位置)。另外,影像處理部304供應藉由 執行影像處理已產生之第一全景影像訊號DFC和第二全景 影像訊號DPC到顯示處理部3 05。 顯示處理部305使用供應自延伸處理部3 02的視頻訊號 Dcam以及供應自影像處理部304之第一全景影像訊號DFC 和第二全景影像訊號DPC來產生顯示驅動訊號HD,及供應 所產生的顯示驅動訊號HD到監視器320。另外,顯示處理 部305使用基於供應自稍後將說明之控制部310的GUI顯示 控制訊號CTg所產生之GUI視頻訊號來產生顯示驅動訊號 HD,及供應所產生的顯示驅動訊號HD到監視器3'20。顯示 處理部3 05可執行控制,使得傳送自複數個相機終端裝置 200之現場直播影像和全景影像被顯示作爲監視器3 20上的 列表。 監視器320基於顯示驅動訊號HD來驅動顯示元件(例 如,液晶顯示元件或電漿顯示元件)、陰極射線管等等, 藉以將成像方向被設定成中心位置之第一全景影像、第二 全景影像’由相機部201所擷取之影像(現場直播影像) ,GUI影像等等顯示在螢幕上。 -17- 201201573 GUI被用於使用者介面部315,及使用者介面部315使 用監視器320呈現資訊給使用者。當基於所呈現的資訊, 使用諸如定位裝置、鍵盤等等操作輸入裝置來執行使用者 操作時,使用者介面部315根據使用者操作來供應操作訊 號US到控制部3 1 0,及使想要的操作能夠被執行。 基於操作訊號US和監視器3 20的顯示狀態,控制部310 決定使用者已選擇哪一處理和使用者已請求哪一處理。然 後,控制部3 1 0基於決定結果來產生控制訊號CTm,及供 應所產生的控制訊號CTm到各部,藉以控制中央伺服器 3 00的操作。另外,控制部310基於決定結果來產生命令訊 號CM,及透過網路介面部301供應所產生的命令訊號CM到 相機終端裝置200,藉以控制相機終端裝置200的操作。另 外,控制部310產生GUI顯示控制訊號CTg,及將其供應到 顯示處理部3 05。 在上述例子中,相機終端裝置200從視頻訊號Dcam產 生第一全景影像的視頻訊號DF和第二全景影像的視頻訊號 DP。然而,中央伺服器300或用戶400可產生第一全景影像 的視頻訊號DF和第二全景影像的視頻訊號DP。在此例中 ,相機終端裝置200的網路介面部206傳送輸出自相機部 201之視頻訊號Dcam到中央伺服器300或用戶400。若中央 伺服器300或用戶400被設置有類似於相機終端裝置200的 訊號處理部之訊號處理部,則中央伺服器3 00或用戶400可 產生第一全景影像的視頻訊號DF和第二全景影像的視頻訊 號DP。第一全景影像的視頻訊號DF和第二全景影像的視In the case of -14-201201573, the position of the imaging direction based on the camera position information signal PM can be easily determined. It should be noted that in the up and down panning operation, when the camera terminal device 200 is placed on the ceiling, the vertical direction can be used as a reference direction. The terminal control unit 210 analyzes the command signal CM supplied from the central server 300 through the network interface 206, and generates an imaging control signal CTa, a signal processing control signal CTb, and a direction control signal CTc. In addition, the terminal control unit 2 1 0 performs processing for transmitting the video encoded signal DV stored in the memory unit 203, the first panoramic video signal DF and the second panoramic video signal DP stored in the panoramic image storage unit 207, and the supply. The camera position information signal PM from the imaging direction control unit 204 is sent to the central server 300. The network interface 301 of the central server 300 is an interface for performing communication between the camera terminal device 200 and the central server 300 via the network 500. The network interface portion 301 supplies the video encoded signal DV supplied from the camera terminal device 200 to the extension processing portion 302. Further, the network interface 301 supplies the camera position information signal PM to the position determination processing unit 303, and supplies the first panoramic image signal DF and the second panoramic image signal DP to the image processing unit 304. The extension processing unit 308 performs the extension processing of the video encoded signal DV, and supplies the obtained video signal D c am to the display processing unit 305. The position determination processing unit 303 determines which of the first panoramic image or the second panoramic image corresponds to the imaging direction indicated by the camera position information signal PM, and supplies the position determination result KP to the image processing unit 304. Here, if it is assumed that the camera position information signal PM generates the first panoramic image signal DF or the second panoramic image signal DP', the reference position -15-201201573 as previously set is the center position of the panoramic shooting operation and the up and down panning operation, The camera position information signal PM indicates the difference between the reference direction and the current imaging side. Based on the camera position determination signal PM, it is easy to determine whether the position in the image (ie, the first panoramic image) or the second panoramic image corresponds to the current imaging direction. The image processing unit 304 performs a shadow based on the position determination result KP, and generates a first panoramic image signal DFC of the first panoramic image as the second panoramic image signal DPC of the panoramic image. Regarding the second panoramic image DPC, it is possible to generate a second panoramic video signal DPC having a position determined by the position determining result KP as a center position. In this example, the processing unit 306 determines the amount of difference between the determined position and the center of the second panoramic image. Then, based on the determined amount of difference, the second is all processed so that the determined position becomes the center position of the image. With the determined position as the center position, the "±180 degree" display image frame of the scene image and the second panoramic image corresponding to the area deviating from the difference amount of the second panoramic image frame are transmitted to the no area. In this way, the second panoramic video signal CPC whose position is determined as the central position panoramic image is generated. In the first full signal DFC, when "the first panoramic mode is rotated", which will be described later, In a manner similar to the second panoramic image signal DPC, the determined position in the panoramic shooting direction of the panoramic image and the amount of difference between the parameters, and based on the determined amount of difference, the first panoramic processing makes the determined The position is on the image. It should be noted that the position determined by the position determination result KP is not set as the center position and the image processing and the second image information are set in the bird's-eye view. It is the second position image of the second full display image. The first position image is determined. In the example of the set-16-201201573, it has not been changed. The image processing unit 3〇4 generates a first panoramic image signal DFC′ of the first panoramic image and a second panoramic image of the second panoramic image, respectively, based on the first panoramic image signal DF and the second panoramic image signal DP, respectively. In addition, the image processing unit 304 displays the position based on the position determination result KP in each of the first panoramic image signal DFC and the second panoramic image signal DPC (ie, the optical axis of the imaging optical system of the camera unit 201 is pointed In addition, the image processing unit 304 supplies the first panoramic video signal DFC and the second panoramic video signal DPC that have been generated by performing image processing to the display processing unit 305. The display processing unit 305 uses the self-extension processing unit 3 The video signal Dcam of the 02 and the first panoramic video signal DFC and the second panoramic video signal DPC supplied from the image processing unit 304 generate the display driving signal HD, and supply the generated display driving signal HD to the monitor 320. In addition, the display The processing unit 305 uses a GUI video signal generated based on a GUI display control signal CTg supplied from the control unit 310 which will be described later. The display drive signal HD is displayed, and the generated display drive signal HD is supplied to the monitor 3' 20. The display processing unit 305 can perform control such that the live broadcast image and the panoramic image transmitted from the plurality of camera terminal devices 200 are displayed as A list on the monitor 3 20. The monitor 320 drives a display element (for example, a liquid crystal display element or a plasma display element), a cathode ray tube, or the like based on the display driving signal HD, thereby setting the imaging direction to the center position. A panoramic image, a second panoramic image 'image captured by the camera unit 201 (live broadcast image), GUI image, etc. are displayed on the screen. -17- 201201573 GUI is used for the user interface 315, and the user The interface 315 uses the monitor 320 to present information to the user. When the user input operation is performed using an operation input device such as a pointing device, a keyboard, or the like based on the presented information, the user interface portion 315 supplies the operation signal US to the control portion 3 10 according to the user operation, and makes the desired The operation can be performed. Based on the display states of the operation signal US and the monitor 3 20, the control section 310 determines which process the user has selected and which process the user has requested. Then, the control unit 301 generates a control signal CTm based on the result of the determination, and supplies the generated control signal CTm to each unit to control the operation of the central server 300. Further, the control unit 310 generates the command signal CM based on the determination result, and supplies the generated command signal CM to the camera terminal device 200 via the network interface 301, thereby controlling the operation of the camera terminal device 200. Further, the control unit 310 generates a GUI display control signal CTg and supplies it to the display processing unit 305. In the above example, the camera terminal device 200 generates the video signal DF of the first panoramic image and the video signal DP of the second panoramic image from the video signal Dcam. However, the central server 300 or the user 400 can generate the video signal DF of the first panoramic image and the video signal DP of the second panoramic image. In this example, the network interface portion 206 of the camera terminal device 200 transmits the video signal Dcam output from the camera unit 201 to the central server 300 or the user 400. If the central server 300 or the user 400 is provided with a signal processing unit similar to the signal processing unit of the camera terminal device 200, the central server 300 or the user 400 can generate the video signal DF and the second panoramic image of the first panoramic image. Video signal DP. The video signal DF of the first panoramic image and the second panoramic image
S •18- 201201573 頻訊號DP儲存在設置於中央伺服器300或用戶400之諸如硬 碟等記憶體中。 (3)第一全景影像和第二全景影像之顯示操作 接著,將說明第一全景影像和第二全景影像之顯示操 作》當操作開始時,控制部3 1 0將請求傳輸第一全景影像 訊號DF、第二全景影像訊號DP、相機位置資訊訊號PM、 和視頻編碼訊號DV之命令訊號CM傳送到相機終端裝置200 的每一個。當第一全景影像訊號DF和第二全景影像訊號 DP儲存在全景影像儲存部207時,相機終端裝置200讀出第 一全景影像訊號DF和第二全景影像訊號DP,及將它們傳 送到中央伺服器300。另一方面,當第一全景影像訊號DF 或第二全景影像訊號DP未儲存在全景影像儲存部207時, 相機終端裝置200控制相機部201、訊號處理部202、及成 像方向控制部204,及在移動成像方向的同時執行成像操 作。如此,相機終端裝置200產生第一全景影像訊號DF和 第二全景影像訊號DP,及將它們傳送到中央伺服器300。 需注意的是,相機終端裝置200將所產生的第一全景影像 訊號DF和第二全景影像訊號DP儲存在全景影像儲存部2 07 〇 相機終端裝置200供應在成像方向控制部204所產生之 相機位置資訊訊號PM到中央伺服器300。另外,相機終端 裝置200開始相機部201的成像操作,在訊號處理部202中 壓縮所獲得的視頻訊號Dcam,及將視頻編碼訊號DV儲存 -19- 201201573 在記憶體部203中。另外,相機終端裝置200供應儲存在記 憶體部203中之視頻編碼訊號DV到中央伺服器300 »需注 意的是,當如圖1所示透過代理伺服器600連接相機終端裝 置200和網路500時,透過代理伺服器600在相機終端裝置 200的每一個和中央伺服器3 00之間傳送和接收資訊。 中央伺服器3 00之位置決定處理部303決定第一全景影 像或第二全景影像中的哪一位置對應於由相機位置資訊訊 號PM所指示之成像方向,及供應位置決定結果KP到影像 處理部304。若採用第二全景影像作爲例子,當例如由相 機位置資訊訊號PM所指示之角度差爲“0度”時,因爲成像 方向被設定成參考方向,所以成像方向的位置爲第二全景 影像的中心位置。 影像處理部3 04基於位置決定結果KP來執行影像處理 。當位置決定結果KP指示成像方向的位置爲第二全景影像 之中心位置時,成像方向上的影像對應於第二全景影像之 中心位置。因此,未執行第二全景影像的影像處理,及第 二全景影像訊號DP係供應到顯示處理部3 05,作爲第二全 景影像訊號DPC。另一方面,當成像方向的位置非第二全 景影像的中心位置時,所決定的成像方向之位置和第二全 景影像的中心位置之間的差異量被決定。然後,基於所決 定的差異量,第二全景影像被處理,使得所決定的位置對 應於影像的中心位置,及產生第二全景影像訊號DPC。 因此,在第二全景影像中,當例如由相機位置資訊訊 號PM所指示的角度差爲“〇度”時,由相機部20 1所擷取的影 -20- 201201573 像、參考方向對應於中心位置之第二全景影像、及有關 GUI的影像被顯示在由供應自顯示處理部3 〇5之顯示驅動訊 號HD所驅動的監視器302之螢幕上。 在第一全景影像之例子中,當在稍後將說明之“用以 轉動第一全景影像的模式”中,以類似於第二全景影像訊 號DPC之方式,決定第一全景影像的全景拍攝方向中之所 決定的位置和參考位置之間的差異量。然後,基於所決定 的差異量,第一全景影像被處理,使得所決定的位置位在 影像下方(在稍後說明的中心線L上),及產生第一全景 影像訊號DFC。影像處理部304顯示基於位置決定結果KP 之成像方向的位置(即、相機部20 1的成像光學系統之光 軸所指向的位置)在第一全景影像訊號DFC和第二全景影 像訊號DPC的每一個中。 在第一全景影像和第二全景影像的任一個中,事先設 定的參考位置可被固定及顯示作中心位置。在此例中,由 位置決定結果KP所決定之位置和事先設定的參考位置之間 的差異量被決定,及基於所決定的差異量,指示相機的成 像方向(包括在相機部201中之光學系統的光軸之方向) 被指向從中心位置移動差異量的位置之游標、框等等顯示 在第一或第二全景影像中。 延伸處理部3 02延伸視頻編碼訊號DV,及供應所獲得 的視頻訊號Dcam到顯示處理部3 05。控制部310供應用以執 行GUI顯示之GUI顯示控制訊號CTg到顯示處理部305。 -21 - 201201573 (4)產生第一全景影像之處理 接著,將參考圖5至圖8說明產生第一全景影像訊號DF 之處理。當產生第一全景影像訊號DF時,爲第一全景影像 的每一區取得影像。首先,如圖5所示,相機終端裝置200 的變焦被固定,及以指定間隔執行全景拍攝/上下搖攝操 作及取得靜止影像。圖5所示之號碼指示影像取得的順序 〇 接著,藉由下面程序[1]至[3]執行靜止影像座標系統 的座標轉換。此處,如圖6所示,靜止影像的各點被轉換 成如從相機終端裝置200的轉動中心所觀看一般之相對位 置(X, y, z) ° [1] 具有thh [度]的水平視角和寬高比a之相機的觀看點 設定在原點及指向a-z方向。若物像面(X,y,-L )被認爲 在距離L的位置中,則可見的範圍爲矩形2Lxx2Ly。此處, 建立下面關係:Lx = L.tan(thh/2),Ly = Lx/a。 [2] 相機的姿勢最初爲(x,y,z,p,q,r)。然而,考 慮觀看點的位置固定在原點,獲得等式x = y = z = 0。因此, 此處’只有(p,q,r)被考慮(p:全景拍攝(y軸轉動),q :上下搖攝(X軸轉動),r:滾動(z軸轉動))。 [3] 當使用矩形(2Lx)x(2Ly)中的點(j,〇時,建立下 面等式》S • 18- 201201573 The frequency signal DP is stored in a memory such as a hard disk set in the central server 300 or the user 400. (3) Display Operation of First Panoramic Image and Second Panoramic Image Next, the display operation of the first panoramic image and the second panoramic image will be described. When the operation is started, the control unit 310 will request to transmit the first panoramic image signal. The command signals CM of the DF, the second panoramic video signal DP, the camera position information signal PM, and the video encoded signal DV are transmitted to each of the camera terminal devices 200. When the first panoramic video signal DF and the second panoramic video signal DP are stored in the panoramic image storage unit 207, the camera terminal device 200 reads out the first panoramic video signal DF and the second panoramic video signal DP, and transmits them to the central servo. Device 300. On the other hand, when the first panoramic video signal DF or the second panoramic video signal DP is not stored in the panoramic image storage unit 207, the camera terminal device 200 controls the camera unit 201, the signal processing unit 202, and the imaging direction control unit 204, and The imaging operation is performed while moving the imaging direction. Thus, the camera terminal device 200 generates the first panoramic video signal DF and the second panoramic video signal DP, and transmits them to the central server 300. It should be noted that the camera terminal device 200 stores the generated first panoramic video signal DF and second panoramic video signal DP in the panoramic image storage unit 207. The camera terminal device 200 supplies the camera generated by the imaging direction control unit 204. The location information signal PM is sent to the central server 300. Further, the camera terminal device 200 starts the imaging operation of the camera unit 201, compresses the obtained video signal Dcam in the signal processing unit 202, and stores the video encoded signal DV in the memory portion 203. Further, the camera terminal device 200 supplies the video encoded signal DV stored in the memory unit 203 to the central server 300. It is to be noted that when the camera terminal device 200 and the network 500 are connected through the proxy server 600 as shown in FIG. At this time, information is transmitted and received between each of the camera terminal devices 200 and the central server 300 through the proxy server 600. The position determining processing unit 303 of the central server 300 determines which of the first panoramic image or the second panoramic image corresponds to the imaging direction indicated by the camera position information signal PM, and supplies the position determination result KP to the image processing unit. 304. If the second panoramic image is taken as an example, when the angular difference indicated by the camera position information signal PM is “0 degree”, for example, the imaging direction is set to the reference direction, and the position of the imaging direction is the center of the second panoramic image. position. The image processing unit 304 performs image processing based on the position determination result KP. When the position determination result KP indicates that the position of the imaging direction is the center position of the second panoramic image, the image in the imaging direction corresponds to the center position of the second panoramic image. Therefore, the image processing of the second panoramic image is not performed, and the second panoramic video signal DP is supplied to the display processing unit 305 as the second panoramic video signal DPC. On the other hand, when the position of the imaging direction is not the center position of the second panoramic image, the amount of difference between the determined position of the imaging direction and the center position of the second panoramic image is determined. Then, based on the determined amount of difference, the second panoramic image is processed such that the determined position corresponds to the center position of the image and the second panoramic image signal DPC is generated. Therefore, in the second panoramic image, when the angle difference indicated by, for example, the camera position information signal PM is "twist", the image -20-201201573 image captured by the camera portion 20 1 corresponds to the center. The second panoramic image of the position and the image related to the GUI are displayed on the screen of the monitor 302 driven by the display driving signal HD supplied from the display processing unit 3 to 5. In the example of the first panoramic image, when the mode for rotating the first panoramic image will be described later, the panoramic shooting direction of the first panoramic image is determined in a manner similar to the second panoramic image signal DPC. The amount of difference between the position determined by the reference point and the reference position. Then, based on the determined amount of difference, the first panoramic image is processed such that the determined position is below the image (on the center line L to be described later), and the first panoramic image signal DFC is generated. The image processing unit 304 displays the position based on the imaging direction of the position determination result KP (that is, the position pointed by the optical axis of the imaging optical system of the camera unit 20 1 ) at each of the first panoramic image signal DFC and the second panoramic image signal DPC. One in the middle. In any of the first panoramic image and the second panoramic image, the previously set reference position can be fixed and displayed as a center position. In this example, the amount of difference between the position determined by the position determining result KP and the previously set reference position is determined, and based on the determined amount of difference, the imaging direction of the camera (including the optical in the camera section 201) is indicated. The direction of the optical axis of the system) is displayed in the first or second panoramic image by a cursor, a frame, or the like pointing to a position where the difference amount is moved from the center position. The extension processing unit 322 extends the video coded signal DV and supplies the obtained video signal Dcam to the display processing unit 305. The control unit 310 supplies a GUI display control signal CTg for performing GUI display to the display processing unit 305. -21 - 201201573 (4) Process of generating first panoramic image Next, a process of generating the first panoramic image signal DF will be described with reference to Figs. When the first panoramic video signal DF is generated, an image is acquired for each of the first panoramic images. First, as shown in Fig. 5, the zoom of the camera terminal device 200 is fixed, and the panoramic shooting/up and down panning operations and the acquisition of still images are performed at specified intervals. The number shown in Fig. 5 indicates the order in which images are acquired. 〇 Next, the coordinate conversion of the still image coordinate system is performed by the following procedures [1] to [3]. Here, as shown in FIG. 6, each point of the still image is converted into a relative position (X, y, z) ° as viewed from the center of rotation of the camera terminal device 200 [1] having a level of thh [degree] The viewing point of the camera with angle of view and aspect ratio a is set at the origin and in the direction of the az. If the object image plane (X, y, -L) is considered to be in the position of the distance L, the visible range is the rectangle 2Lxx2Ly. Here, the following relationship is established: Lx = L.tan(thh/2), Ly = Lx/a. [2] The pose of the camera is initially (x, y, z, p, q, r). However, consider that the position of the viewing point is fixed at the origin, and obtain the equation x = y = z = 0. Therefore, here only 'p, q, r' is considered (p: panoramic shooting (y-axis rotation), q: up and down panning (X-axis rotation), r: rolling (z-axis rotation)). [3] When using a point in a rectangle (2Lx)x(2Ly) (j, 建立, establish the following equation)
X = Lx X (j - Lx) / Lx y = Ly x (i - Ly) / Ly z = -LX = Lx X (j - Lx) / Lx y = Ly x (i - Ly) / Ly z = -L
[4] 使用(X,y,Z)應用滾動換算、上下搖攝換算、及 -22- 201201573 全景拍攝換算的下面等式。 式子1 滾動換算 •ΛΤΓ cosr -sinr 0 • w X yi = sinr cosr 0 • y zl 0 0 1 z _ · 上下搖攝換算 x2 1 0 0 xl = 0 COS ^ 一 sin 孕 • yi z2 0 sin 9 cos 9 zl 全景拍攝換算 ~x3 cosp 0 -sin p 'x2 y3 - 0 1 0 • y2 z3 sin p 0 cosp •Zl 此處所獲得之點(X 3,y 3,z 3 )的値對應於當從相機之 轉動中心觀看靜止影像中的點(x,y,Z )之座標系統所表 示之値。 接著’將相對位置轉換成橫向和縱向。此處,如圖7 所示’上述所獲得的點(X3,y3,z3 )被轉換成橫向和縱向 。點(x3,y3,z3 )之方向和相對於-z方向的水平方向之間 的角度爲縱向,而點(x3,y3,z3 )之方向和x-z面之間的 角度爲橫向,及橫向和縱向係可藉由下面等式來獲得。 •橫向(La )[4] Use (X, y, Z) to apply the following equations for scroll conversion, up and down panning, and -22- 201201573 panorama shooting. Equation 1 Rolling conversion • ΛΤΓ cosr -sinr 0 • w X yi = sinr cosr 0 • y zl 0 0 1 z _ · Up and down panning conversion x2 1 0 0 xl = 0 COS ^ a sin pregnancy • yi z2 0 sin 9 Cos 9 zl panoramic shot conversion ~x3 cosp 0 -sin p 'x2 y3 - 0 1 0 • y2 z3 sin p 0 cosp •Zl The point obtained here (X 3,y 3,z 3 ) corresponds to when The center of rotation of the camera views the point represented by the coordinate system of the point (x, y, Z) in the still image. Then the relative position is converted into landscape and portrait. Here, as shown in Fig. 7, the points (X3, y3, z3) obtained as described above are converted into horizontal and vertical directions. The angle between the direction of the point (x3, y3, z3) and the horizontal direction with respect to the -z direction is the longitudinal direction, and the angle between the direction of the point (x3, y3, z3) and the xz plane is the lateral direction, and the lateral sum The longitudinal system can be obtained by the following equation. • Horizontal (La)
La = tan-1 (y3 / ::sqrt (x3 * x3 + z3 * z3)) 縱向(Lo ) 當 0.0 < z 3 時, -23- 201201573 若 0.0<x3,貝(]L〇 = 90.0 + La 若 0.0 2 x3,則 Lo = -90.0-La 當 0.0 g z 3 時,La = tan-1 (y3 / ::sqrt (x3 * x3 + z3 * z3)) Longitudinal (Lo ) When 0.0 < z 3 , -23- 201201573 If 0.0<x3, Bay (]L〇= 90.0 + La If 0.0 2 x3, then Lo = -90.0-La When 0.0 gz 3,
Lo = tan*1(x3/z3)/RAD 其中,RAD = 7r/180(7T爲圓周率) 接著,執行到第一全景影像的轉換。此處,如圖8所 示,所獲得的橫向和縱向(La,Lo)被表示,使得由放射 狀軸指示橫向,及由周圍座標系統指示縱向。 以上述方式,可產生第一全景影像訊號DF。 (5)圖形使用者介面(GUI) 接著,將說明GUI。圖9爲監視器320的顯示螢幕之槪 要圖。圖9圖示一般螢幕顯示和全螢幕顯示二者。在任一 例中,操作面板(控制面板)顯示在螢幕的左側上,而現 場直播影像顯示在螢幕的右側上。當操作面板的“螢幕模 式”被設定成“Full (全螢幕)”時,圖示全螢幕顯示。 圖10爲操作面板上之操作的槪要圖。操作面板包括用 於個功能之面板,及面板的每一個可被折疊和儲存。可以 下列方式分類面板。 •景象 有關顯示的設定 •相機控制 有關相機操作的設定 •全景Lo = tan*1(x3/z3)/RAD where RAD = 7r/180 (7T is the pi) Next, the conversion to the first panoramic image is performed. Here, as shown in Fig. 8, the obtained lateral and longitudinal directions (La, Lo) are indicated such that the lateral direction is indicated by the radial axis and the longitudinal direction is indicated by the surrounding coordinate system. In the above manner, the first panoramic video signal DF can be generated. (5) Graphical User Interface (GUI) Next, the GUI will be explained. Figure 9 is a schematic diagram of the display screen of the monitor 320. Figure 9 illustrates both a general screen display and a full screen display. In either case, the operator panel (control panel) is displayed on the left side of the screen, and the live broadcast image is displayed on the right side of the screen. When the “Screen Mode” of the operation panel is set to “Full (Full Screen)”, the full screen display is shown. Figure 10 is a schematic view of the operation on the operation panel. The operation panel includes panels for functions, and each of the panels can be folded and stored. Panels can be categorized in the following ways. • Scene Settings related to the display • Camera control Settings for camera operation • Panorama
-24- 201201573 全景顯不 •預設位置 有關預設的設定 *觸發 有關觸發的設定 •其他 其他設定 當點選面板的每一個時’打開所點選的面板。圖10A 圖示點選面板“景象”的狀態,及功能表被顯示在“景象”欄 下方。另一方面,圖1 0B指示點選面板“相機控制”的狀態 ,及功能被顯示在“相機控制”行下方。圖10C指示拖曳面 板“相機控制”的狀態,及可藉由拖曳它而將面板“相機控 制”改變成浮動視窗。 圖1 1圖示當點選面板“景象”時,顯示諸如“螢幕模式” 、“景象尺寸”、“影像編碼解”、及“框率”等功能表的狀態 。利用“螢幕模式”功能表,可將顯示模式改變成一般模式 和全螢幕模式。利用“景象尺寸”功能表,可指定1/4、1/2 、與影像相同的尺寸,及最適模式。在最適模式中,根據 目前顯示區域的尺寸來顯示影像。利用“影像編碼解碼”功 能表,可執行編碼解碼變化。利用“框率”功能表,可改變 JPEG框率。移動影像記錄按鈕被用於記錄移動影像,及靜 止影像記錄按鈕被用於記錄靜止影像。除了這些按鈕之外 ,還可設置麥克風音量滑動器、麥克風靜音開/關按鈕、 -25- 201201573 音訊音量滑動器、音訊靜音開/關按紐等等。 圖12圖示當點選面板“相機”時所顯示之功能表。利用 “操作模式”功能表,可在影像上執行操作模式切換。以它 們上面的箭頭來操作全景拍攝/上下搖攝控制按鈕’可指 定全景拍攝/上下搖攝方向。位在全景拍攝/上下搖攝控制 按鈕的中心之按鈕爲原來位置按鈕。變焦按鈕爲指定相機 終端裝置200的變焦之按鈕,及其被形成使得可看見光學 變焦和數位變焦之間的邊界。若連續按壓變焦按鈕的“W” 或“T”,則連續執行變焦操作。焦距按鈕被用於將焦點設 定成“長距離”或“短距離”。除了這些按鈕之外,還可設置 各種按鈕,諸如一推入自動聚焦按鈕及獨佔控制的控制權 取得按鈕等。 圖1 3圖示當點選“預設位置”、“觸發器”、“其他”、及“ 資訊”所顯示之各自功能表。面板“預設位置”顯示略圖影 像在事先決定之複數個成像方向中。藉由點選和選擇略圖 影像的其中之一,能夠將相機終端裝置2 0 0指向所選定的 略圖影像。 (6)第一全景影像上之成像方向的指定 接著’將參考圖14至圖18說明第一全景影像的顯示。 圖14爲藉由點選操作面板的“預設位置”顯示第—全景景象 之狀態的槪要圖。需注意的是’現場直播影像顯示在操作 面板的右側上。如上述,藉由拖曳和移動“預設位置”欄, 顯示第一全景影像之子面板可排列在操作面板的外面,如 -26- 201201573 圖15所示。另外,可在顯示螢幕內移動顯示第一全景影像 之子面板。 圖16爲顯示第一全景影像之子面板的詳細槪要圖。在 第一全景影像中,以十字(+)圖示右側上之現場直播影 像所顯示的影像之方向(相機終端裝置200之成像光學系 統的光軸之方向)。另外,如圖1 6所示,藉由點選排列在 第一全景影像的上右側上之全景切換按鈕,可將第一全景 影像切換成第二全景影像。 圖17圖示使用第一全景影像來改變現場直播影像的方 向之操作。當改變相機終端裝置200的全景拍攝/上下搖攝 方向時,上述全景拍攝/上下搖攝控制按鈕可被用於變化 。然而,亦可藉由指定第一全景影像中的指定點來改變相 機終端裝置200的全景拍攝/上下搖攝方向。在圖17所示之 狀態中,將相機終端裝置200的成像光學系統之光軸指向 十字(+)的方向,及顯示在那方向上之現場直播影像。 在此狀態中,若點選第一全景影像所示之黑圏(·),則 根據使用者操作之操作訊號US被傳送到控制部310。基於 操作訊號US,相機終端裝置200的成像方向控制部204被控 制,及將相機終端裝置200的成像光學系統之光軸指向黑 圏(·)的方向。因此,顯示在操作面板的右側上之現場 直播影像被切換成黑圈(·)的方向上之影像。 如此,使用者可藉由指定第一全景影像中的指定點來 指定相機終端裝置200之全景拍攝/上下搖攝方向》第一全 景影像包括可由相機終端裝置200擷取之全景拍攝/上下搖 -27- 201201573 攝方向上的所有影像。因此,可藉由在第一全景影像上指 定相機終端裝置200的方向,使用者以想要的方向顯示現 場直播影像。需注意的是,藉由使用圍繞預定範圍的框來 指定區域來取代使用指示點選位置的十字(+ ) ’可控制 光軸的方向。 當在第一全景影像上指定相機終端裝置200的方向時 ,具有兩模式,即、未改變第一全景影像的顯示狀態而只 切換現場直播影像之模式,以及第一全景影像轉動之模式 。在轉動第一全景影像之模式中,如圖18所示,第一全景 影像的角度位置被設定,使得目前顯示現場直播影像之位 置(由十字(+)指示)定位在從第一全景影像的中心朝 上延伸之直線L上。接著,當在第一全景影像上點選黑圈 (·)時,操作面板的右側上所顯示之現場直播影像被切 換成黑圈(·)的方向上之影像。同時,第一全景影像轉 動,使得黑圈(·)的位置定位在第一全景影像中之直線L 上。因此,當使用者看著第一全景影像時,使用者可馬上 辨識出現場直播影像的方向在第一全景影像之直線L上。 以類似方式,在第二全景影像中也一樣,使用者可藉 由指定第二全景影像中的指定點來指定相機終端裝置2〇〇 之全景拍攝方向。基於此,使用者可切換現場直播影像的 方向。 (7 )使用預設位置的控制 接著,將說明使用本實施例之系統中的預設位置之控-24- 201201573 Panorama display • Preset position Settings related to the preset *Trigger Settings for triggering • Others Other settings When you click each of the panels, 'Open the selected panel. Fig. 10A illustrates the state of the "view" of the pointing panel, and the function table is displayed below the "view" column. On the other hand, Figure 10B indicates the status of the "Camera Control" panel, and the function is displayed below the "Camera Control" line. Fig. 10C indicates the state of the "camera control" of the tow panel, and the panel "camera control" can be changed to a floating window by dragging it. Fig. 11 illustrates the states of the function tables such as "screen mode", "view size", "image coding solution", and "frame rate" when the panel "view" is clicked. Use the “Screen Mode” menu to change the display mode to normal mode and full screen mode. Use the “Scene Size” menu to specify 1/4, 1/2, the same size as the image, and the optimal mode. In the optimum mode, the image is displayed according to the size of the currently displayed area. The codec change can be performed using the "Image Codec" function table. Use the Frame Rate menu to change the JPEG frame rate. The moving image recording button is used to record moving images, and the still image recording button is used to record still images. In addition to these buttons, you can also set the microphone volume slider, microphone mute on/off button, -25- 201201573 audio volume slider, audio mute on/off button, and more. Fig. 12 illustrates a function table displayed when the panel "camera" is clicked. The operating mode switch can be performed on the image using the “Operation Mode” menu. Use the arrows above them to operate the panorama/up and down pan control buttons to specify the panorama/up and down pan directions. The button located at the center of the panorama shooting/up and down pan control buttons is the original position button. The zoom button is a button that specifies the zoom of the camera terminal device 200, and is formed such that the boundary between the optical zoom and the digital zoom can be seen. If the “W” or “T” of the zoom button is pressed continuously, the zoom operation is continuously performed. The focus button is used to set the focus to “long distance” or “short distance”. In addition to these buttons, various buttons such as a push-in auto focus button and exclusive control control acquisition buttons can be provided. Figure 13 shows the respective function tables displayed when clicking on "Preset Position", "Trigger", "Other", and "Information". The panel “Preset Position” displays the thumbnail image in a number of imaging directions determined in advance. By clicking and selecting one of the thumbnail images, the camera terminal device 200 can be pointed to the selected thumbnail image. (6) Designation of imaging direction on the first panoramic image Next, the display of the first panoramic image will be described with reference to Figs. 14 to 18 . Fig. 14 is a schematic view showing the state of the first panoramic view by clicking the "preset position" of the operation panel. It should be noted that the live video is displayed on the right side of the operation panel. As described above, by dragging and moving the "preset position" column, the sub-panels displaying the first panoramic image can be arranged outside the operation panel, as shown in Fig. 15 of -26-201201573. In addition, a sub-panel that displays the first panoramic image can be moved within the display screen. Figure 16 is a detailed schematic view showing a sub-panel of the first panoramic image. In the first panoramic image, the direction of the image displayed by the live broadcast image on the right side of the cross (+) is shown (the direction of the optical axis of the imaging optical system of the camera terminal device 200). In addition, as shown in Fig. 16, the first panoramic image can be switched to the second panoramic image by clicking the panoramic switching button arranged on the upper right side of the first panoramic image. Figure 17 illustrates the operation of using the first panoramic image to change the direction of the live broadcast image. When the panoramic shooting/up and down panning directions of the camera terminal device 200 are changed, the above-described panoramic shooting/up and down panning control buttons can be used for the change. However, it is also possible to change the panoramic shooting/up and down panning direction of the camera terminal device 200 by specifying a designated point in the first panoramic image. In the state shown in Fig. 17, the optical axis of the imaging optical system of the camera terminal device 200 is directed in the direction of the cross (+), and the live broadcast image displayed in that direction. In this state, if the black box (·) indicated by the first panoramic image is clicked, the operation signal US according to the user operation is transmitted to the control unit 310. Based on the operation signal US, the imaging direction control section 204 of the camera terminal device 200 is controlled, and the optical axis of the imaging optical system of the camera terminal device 200 is directed to the direction of the black mark (·). Therefore, the live broadcast image displayed on the right side of the operation panel is switched to the image in the direction of the black circle (·). In this way, the user can specify the panoramic shooting/up and down panning direction of the camera terminal device 200 by specifying a specified point in the first panoramic image. The first panoramic image includes a panoramic shooting/up and down shaking that can be captured by the camera terminal device 200. 27- 201201573 All images in the direction of the camera. Therefore, by specifying the direction of the camera terminal device 200 on the first panoramic image, the user can display the live broadcast image in a desired direction. It is to be noted that the direction of the optical axis can be controlled by using a cross (+)' indicating the selected position instead of using a frame around a predetermined range. When the direction of the camera terminal device 200 is specified on the first panoramic image, there are two modes, that is, the display state of the first panoramic image is not changed, and only the mode of the live broadcast image and the mode of the first panoramic image rotation are switched. In the mode of rotating the first panoramic image, as shown in FIG. 18, the angular position of the first panoramic image is set such that the position of the live broadcast image currently displayed (indicated by the cross (+)) is positioned from the first panoramic image. The line extends upward on the line L. Then, when the black circle (·) is clicked on the first panoramic image, the live broadcast image displayed on the right side of the operation panel is switched to the image in the direction of the black circle (·). At the same time, the first panoramic image is rotated such that the position of the black circle (·) is positioned on the straight line L in the first panoramic image. Therefore, when the user looks at the first panoramic image, the user can immediately recognize that the direction in which the live video is present is on the straight line L of the first panoramic image. In a similar manner, also in the second panoramic image, the user can specify the panoramic shooting direction of the camera terminal device 2 by specifying a designated point in the second panoramic image. Based on this, the user can switch the direction of the live broadcast image. (7) Control using preset position Next, the control of the preset position in the system using the present embodiment will be explained.
-28- 201201573 制。如上述,在本實施例的系統中,藉由在第一全景影像 或第二全景影像中指定想要的區域,相機終端裝置2 〇〇的 成像方向可指向指定方向。另一方面,當事先設定一或複 數個預設位置時,藉由選擇預設位置(預設位置的其中之 —),相機終端裝置200的成像方向可指向選定位置。 圖19圖示根據本實施例之相機終端裝置2 00設置在會 議室中之情形作爲例子。在圖19所示之例子中,爲由相機 終端裝置200所擷取的影像設定四個預設位置。在四個預 設位置的每一個中,擷取“白板”、“投影螢幕”、“會議室 的相對寬範圍”、及“會議室的特性”。另外,在螢幕的下 部中,顯示整個影像作爲第二全景影像。 使用框A至D,將對應於各自預設位置之範圍顯示在 第二全景影像中。此處,框A對應於“白板”,框B對應於“ 會議室的相對寬範圍”,框C對應於“投影螢幕”,及框D對 應於“會議室的相對窄範圍”。 因爲以此方式顯示對應於各自預設位置之成像範圍的 框,所以使用者可看得見和直接決定全景影像中的哪一範 圍對應於預設位置的每一個。 藉由使用者使用稍後將說明之方法來事先設定預設位 置。預設位置的資料儲存在相機終端裝置200的全景影像 儲存部207中,或者設置在中央伺服器300的記億體,設置 在用戶400的記憶體等等。 接著,將說明用以從全景影像顯示如上述所設定之預 設位置的每一個之現場直播影像的方法。圖20至圖23各爲 -29- 201201573 藉由在圖19所示之整個影像中選擇框A至D的其中之一’ 而從四個預設位置中指定現場直播影像的狀態之槪要圖。 圖20圖示從圖19所示之狀態選擇整個影像中的框A之 狀態。可藉由在顯示螢幕上移動游標到整個影像中的框A 之位置並且點選框A來執行框A的選擇。如圖20所示’當 點選整個影像中的框A時’在整個影像上以大尺寸顯示對 應於框A之現場直播影像“白板”。 以類似方式,圖21圖示點選整個影像中的框B之狀態 。圖22圖示點選整個影像中的框C之狀態。圖23圖示點選 整個影像中的框D之狀態。如圖21至圖23所示,當點選框B 、框C、及框D時,顯示各自對應於框B、框C、及框D之現 場直播影像。因此,藉由在看著整個影像的同時選擇框A 、框B、框C、及框D的其中之一,使用者可切換和顯示現 場直播影像中想要的其中之一。 在此例中,當使用者點選框A至D的其中之一時,從 使用者介面部315傳送根據使用者操作之操作訊號US到控 制部310。操作訊號US包括框A至D的選定者之資訊(即、 預設位置的選定者)。控制部310透過網路介面部206傳送 基於操作訊號US所產生之命令訊號CM到相機終端裝置200 的終端控制部2 1 0。終端控制部2 1 0分析命令訊號CM,及 使用儲存在全景影像儲存部207中之預設位置的資訊來產 生方向控制訊號CTc。如此,藉由成像方向控制部204和成 像方向調整部205將相機部201的成像方向調整到由方向控 制訊號C T c所指示之方向。-28- 201201573 system. As described above, in the system of the present embodiment, by specifying a desired area in the first panoramic image or the second panoramic image, the imaging direction of the camera terminal device 2 can be directed to the designated direction. On the other hand, when one or a plurality of preset positions are set in advance, by selecting the preset position (where the preset position is -), the imaging direction of the camera terminal device 200 can be directed to the selected position. Fig. 19 illustrates a case where the camera terminal device 200 is set in the conference room according to the present embodiment as an example. In the example shown in Fig. 19, four preset positions are set for the image captured by the camera terminal device 200. In each of the four preset positions, the "whiteboard", "projection screen", "relative wide range of conference rooms", and "features of the conference room" are captured. In addition, in the lower part of the screen, the entire image is displayed as the second panoramic image. Using the frames A to D, the range corresponding to the respective preset positions is displayed in the second panoramic image. Here, the frame A corresponds to "whiteboard", the frame B corresponds to "relatively wide range of conference rooms", the frame C corresponds to "projection screen", and the frame D corresponds to "relatively narrow range of conference rooms". Since the frames corresponding to the imaging ranges of the respective preset positions are displayed in this manner, the user can see and directly determine which of the panoramic images corresponds to each of the preset positions. The preset position is set in advance by the user using a method which will be described later. The data of the preset position is stored in the panoramic image storage unit 207 of the camera terminal device 200, or in the memory of the central server 300, in the memory of the user 400, and the like. Next, a method for displaying a live broadcast image of each of the preset positions set as described above from the panoramic image will be explained. 20 to 23 are each a schematic diagram of the state of specifying a live broadcast image from four preset positions by selecting one of the frames A to D in the entire image shown in FIG. . Fig. 20 illustrates a state in which the frame A in the entire image is selected from the state shown in Fig. 19. The selection of block A can be performed by moving the cursor over the display screen to the position of frame A in the entire image and clicking on box A. As shown in Fig. 20, when the frame A in the entire image is clicked, the live broadcast image "whiteboard" corresponding to the frame A is displayed in a large size on the entire image. In a similar manner, Figure 21 illustrates the state of box B in the entire image. Figure 22 illustrates the state of the frame C in the entire image. Figure 23 illustrates the state of the frame D in the entire image. As shown in FIG. 21 to FIG. 23, when the frame B, the frame C, and the frame D are clicked, the live broadcast images corresponding to the frame B, the frame C, and the frame D are displayed. Therefore, by selecting one of the frame A, the frame B, the frame C, and the frame D while looking at the entire image, the user can switch and display one of the desired ones in the live broadcast image. In this example, when the user clicks one of the frames A to D, the operation unit US according to the user operation is transmitted from the user interface 315 to the control unit 310. The operation signal US includes information of the selected persons of the frames A to D (ie, the selected one of the preset positions). The control unit 310 transmits the command signal CM generated based on the operation signal US to the terminal control unit 2 1 0 of the camera terminal device 200 via the network interface unit 206. The terminal control unit 2 10 analyzes the command signal CM and generates information of the direction control signal CTc using the information stored in the preset position in the panoramic image storage unit 207. In this manner, the imaging direction control unit 204 and the imaging direction adjustment unit 205 adjust the imaging direction of the camera unit 201 to the direction indicated by the direction control signal C T c .
S -30- 201201573 需注意的是,當預設位置的資訊儲存在設置於中央伺 服器300的記憶體中時,資訊包括在命令訊號CM中,及被 傳送到相機終端裝置200。然後,終端控制部2 1 0分析命令 訊號CM,及使用傳送自中央伺服器3 00之預設位置的資訊 來產生方向控制訊號CTc。 圖24及圖25爲用以改變預設位置之方法的槪要圖。尤 其是,圖24及圖25圖示藉由移動全景影像中之框B的位置 來改變預設位置之方法。尤其是,若使用者在圖24所示之 狀態中拖曳框B,及當框B移動至圖25所示之位置時結束拖 曳操作,則使用者可將對應於框B之預設位置改變成圖25 所示的位置。在圖25所示之狀態中,由於使用者所執行之 拖曳操作,所以框B的位置被移動至對應於“白板”和“投影 螢幕”之位置,及顯示對應於所移動的框B之“白板”和“投 影螢幕”的現場直播影像。如此,對應於框B之預設位置被 設定成對應於“白板”和“投影螢幕”的位置。 在此例中,當使用者拖曳框B及移動它時,根據使用 者操作的操作訊號US從使用者介面部3 1 5傳送到控制部3 1 0 。操作訊號US包括由拖曳操作所移動之框B的資訊(對應 於框B之預設位置)。控制部310透過網路介面部2 06傳送 基於操作訊號US所產生之命令訊號CM到相機終端裝置200 的終端控制部2 1 0。終端控制部2 1 0分析命令訊號CM,及 改變儲存在全景影像儲存部2 07中之預設位置的資訊。同 時,終端控制部2 1 0基於所改變的預設位置來產生方向控 制訊號CTc。如此,所改變的預設位置被儲存在全景影像 -31 - 201201573 儲存部207中,及相機部201的成像方向被調整到由方向控 制訊號CTc所指示之方向。 需注意的是,當預設位置的資訊儲存在設置於中央伺 服器3 00的記憶體中時,控制部3 10依據基於操作訊號US所 產生之命令訊號CM來改變儲存在記憶體中的預設位置。 然後,控制部310透過網路介面部206傳送包括所改變的預 設位置之命令訊號CM到相機終端裝置200的終端控制部 2 1 0。終端控制部2 1 0分析命令訊號CM,及基於所改變的 預設位置來產生方向控制訊號CTc。如此,相機部201的成 像方向被調整到由方向控制訊號CTc所指示之方向。 以此方式,藉由拖曳和移動顯示在全景影像中之框的 每一個,能夠自由改變預設位置。在此例中,由相機終端 裝置200所擷取之所有範圍顯示在全景影像上。因此,使 用者可從可由相機終端裝置2 00所擷取之所有範圍中看得 見地設定預設位置的想要者。 接著,將說明顯示設定在全景影像中之複數個現場直 播影像的例子。圖26圖示藉由使用者所執行的拖曳操作來 選擇兩框(即、框B及框D )之狀態。在此例中,以預定時 間間隔交替顯示對應於框B之“會議室的相當寬範圍”的影 像以及對應於框D之“會議室的相當窄範圍”的影像作爲現 場直播影像。 圖27圖示當藉由使用者所執行的拖曳操作來選擇兩框 (即、框B及框D)時,對應於框B之“會議室的相當寬範 圍”的影像以及對應於框D之“會議室的相當窄範圍”的影像S -30- 201201573 It should be noted that when the information of the preset position is stored in the memory set in the central server 300, the information is included in the command signal CM and transmitted to the camera terminal device 200. Then, the terminal control unit 2 1 0 analyzes the command signal CM, and uses the information transmitted from the preset position of the central server 300 to generate the direction control signal CTc. 24 and 25 are schematic views of a method for changing a preset position. In particular, Figs. 24 and 25 illustrate a method of changing a preset position by moving the position of the frame B in the panoramic image. In particular, if the user drags the frame B in the state shown in FIG. 24 and ends the drag operation when the frame B moves to the position shown in FIG. 25, the user can change the preset position corresponding to the frame B to Figure 25 shows the position. In the state shown in FIG. 25, the position of the frame B is moved to a position corresponding to the "whiteboard" and the "projection screen", and the display corresponds to the moved frame B due to the drag operation performed by the user. Live video of the Whiteboard and Projection Screen. Thus, the preset position corresponding to the frame B is set to correspond to the positions of the "whiteboard" and the "projection screen". In this example, when the user drags the frame B and moves it, the operation signal US according to the user's operation is transmitted from the user interface 3 1 5 to the control unit 3 1 0 . The operation signal US includes information of the frame B moved by the drag operation (corresponding to the preset position of the frame B). The control unit 310 transmits the command signal CM generated based on the operation signal US to the terminal control unit 2 1 0 of the camera terminal device 200 via the network interface unit 06. The terminal control unit 2 10 analyzes the command signal CM and changes the information stored in the preset position in the panoramic image storage unit 207. At the same time, the terminal control section 210 generates the direction control signal CTc based on the changed preset position. Thus, the changed preset position is stored in the panoramic image -31 - 201201573 storage portion 207, and the imaging direction of the camera portion 201 is adjusted to the direction indicated by the direction control signal CTc. It should be noted that when the information of the preset position is stored in the memory set in the central server 300, the control unit 3 10 changes the pre-stored memory in accordance with the command signal CM generated based on the operation signal US. Set the location. Then, the control unit 310 transmits the command signal CM including the changed preset position to the terminal control unit 210 of the camera terminal device 200 through the network interface unit 206. The terminal control unit 2 10 analyzes the command signal CM and generates a direction control signal CTc based on the changed preset position. Thus, the imaging direction of the camera unit 201 is adjusted to the direction indicated by the direction control signal CTc. In this way, the preset position can be freely changed by dragging and moving each of the frames displayed in the panoramic image. In this example, all ranges captured by the camera terminal device 200 are displayed on the panoramic image. Therefore, the user can visually set the desired position of the preset position from all ranges that can be captured by the camera terminal device 200. Next, an example of displaying a plurality of live broadcast images set in the panoramic image will be explained. Fig. 26 illustrates the state of selecting two frames (i.e., frame B and frame D) by a drag operation performed by the user. In this example, the image corresponding to the "a wide range of the conference room" of the frame B and the image of the "a fairly narrow range of the conference room" corresponding to the frame D are alternately displayed as the live broadcast image at predetermined time intervals. FIG. 27 illustrates an image corresponding to the "a wide range of the conference room" of the frame B and corresponding to the frame D when the two frames (ie, the frame B and the frame D) are selected by the drag operation performed by the user. Image of "a fairly narrow range of meeting rooms"
S -32- 201201573 二者都被顯示之例子。在此例中,因爲無法同時顯示兩現 場直播影像,所以兩影像被交替更新成最新現場直播影像 。另一選擇是,兩影像的其中之一可被顯示作爲現場直播 影像,及然後顯示之前所取得之另一影像的過去影像。 在圖26及圖27之例子中,當使用者藉由拖曳操作指定 框B及框D二者時,根據拖曳操作的操作訊號US從使用者 介面部315傳送到控制部310。操作訊號US包括選定的框B 及D之資訊。控制部310透過網路介面部206傳送基於操作 訊號US所產生之命令訊號CM到相機終端裝置200的終端控 制部210。終端控制部210分析命令訊號CM,及基於指示 選擇兩框B及D之資訊和儲存在全景影像儲存部20 7中之框 B及D的預設位置之資訊來產生方向控制訊號CTc。如此, 藉由成像方向控制部204和成像方向調整部205將相機部 20 1的成像方向調整到由方向控制訊號CTc所指示之方向》 圖28爲設定預設位置之設定螢幕的詳細例子之槪要圖 。當點選圖10所示之“預設位置”按鈕時出現圖28所示之預 設螢幕。在圖28所示之設定螢幕的例子中,全景影像被顯 示到螢幕的中心之右邊,及預設位置的影像(現場直播影 像)被顯示到螢幕的中心之左邊。 使用者可藉由在全景影像中執行拖曳操作來執行預設 位置的預設。在此例中,例如,藉由在全景影像上拖曳矩 形框的對角線之兩端點作爲起始點和結束點來執行框A至 D的每一個之預設。結果,已藉由預設來設定之框A至D顯 示在全景影像上。之後,在藉由使用圖24及圖25所示之方 -33- 201201573 法來執行拖曳操作而使用者已設定框A至D在想要的位置 之狀態中,當使用者爲預設位置的每一個設定預設數目和 名稱並且點選“Set (設定)”按鈕時,完成對應於框A至D 的每一個之預設。另外,可藉由點選“Call (呼叫)”按鈕 來呼叫預設。需注意的是,藉由輸入預設位置的座標來進 行設定。在本實施例中,圖示四個預設位置作爲例子。然 而,並未特別限制預設位置的數目》 在指定圖28所示之“群組預設位置”中,預設位置可被 分類成一些群組。群組被表示作樹狀結構。在“原來設定 位置”功能表中,顯示相機原來位置。 當建立新的群組資料夾時,新群組資料夾的屬性被圖 示在“新群組”欄中。“重新命名”按鈕爲當改變群組名稱時 點選之按鈕。“清除”按鈕爲當刪除群.組時點選之按鈕。 “OK (同意)”按鈕爲當此頁的設定儲存在相機中時所點選 之按鈕。“取消”按鈕爲取消此頁的設定變化時所點選之按 鈕。 當使用者設定預設位置時,根據使用者操作之操作訊 號US從使用者介面部315傳送到控制部310。控制部310透 過網路介面部206傳送基於操作訊號US所產生之命令訊號 CM到相機終端裝置200之終端控制部210。終端控制部210 分析命令訊號CM,及將包括在命令訊號CM之預設位置儲 存在全景影像儲存部2〇7中。另外,當預設位置的資訊儲 存在設置於中央伺服器300的記憶體時,控制部310依據基 於操作訊號US所產生之命令訊號CM,將預設位置儲存在 -34- 201201573 記億體中。 如上述,在圖28所示之螢幕顯示在連接到中央伺服器 300的監視器3 20上或者在用戶400的顯示部上之狀態中’ 使用者可使用諸如滑鼠、鍵盤等等定位裝置來設定、改變 、及刪除預設位置。 接著,將說明在全景影像上指示預設位置的框之位置 和尺寸的設定。當使用者使用拖曳操作等等指定全景影像 中的框之位置和尺寸時,設定框的中心位置作爲預設位置 。然後,在全景影像儲存部207中或者在中央伺服器300的 記憶體中,框的中心位置被儲存作爲預設位置。 框的參考尺寸被設定成定位在全景影像的中心之框的 尺寸,因爲影像曲率出現在全景影像的周邊。然後,參考 框被放大或縮小至具有對應於成像放大倍數之尺寸,及決 定框的最後尺寸。 例如,以下面方式設定相機終端裝置200的相機部201 之框尺寸和變焦量之間的關係。如圖28所示,假設全景影 像的尺寸高度爲90像素而寬度爲320像素。在圖28所示之 例子中,全景影像爲由3 60度全景拍攝操作所擷取之影像 (第二全景影像)。因此,水平方向上的視角對應於360 作爲例子,假設相機部2 0 1的透鏡之水平視角爲5 8度 (寬端)及2度(遠端),及相機部210的最大解析度爲 640x4 80 (像素)。在此例中,當相機部201的透鏡被設定 在寬端時的矩形之尺寸(Xw,Yw)(其中XW及YW的單位 -35- 201201573 爲像素(像素的數目))以下面關係來表示。 360 (度):50 (度)=320 : Xw 因此,水平方向中的矩形尺寸爲Xw = 52(像素)。 垂直方向中的矩形尺寸Yw以下面關係來表示。 640 : 480 = 52 : Yw 因此,獲得等式Yx = 39 (像素)。因此,當相機部201 的透鏡被設定在寬端時之矩形框的尺寸爲(52,39)像素 〇 當相機終端裝置200被大部分變焦並且透鏡在遠端時 ,以下面關係來表示矩形(Xt, Yt)(像素)的尺寸。 360 (度):2 (度)=320 : Xw 因此,水平方向中之矩形的尺寸爲Xw= 1.8像素。 另外,垂直方向中之矩形的尺寸Yw由下面關係來表 示。 640 : 480= 1.7 : Yw 因此,獲得等式Yw= 1.4 (像素)。 因此,如上述,獲得相機部201的框尺寸和變焦量之 間的關係。控制部3 1 0基於由使用者所指定之框的位置及 變焦量來產生命令訊號CM,及透過網路介面部206傳送命 令訊號CM到相機終端裝置200的終端控制部210。終端控 制部210分析命令訊號CM,及基於包括在命令訊號CM中之 變焦量來計算預設位置中之框的尺寸。然後,終端控制部 2 1 0將所計算的框尺寸連同預設位置的中心位置一起儲存 在全景影像儲存部2 07中。當預設位置儲存在中央伺服器 3 -36- 201201573 3 00或用戶400的記憶體中時,控制部310基於包括在命令 訊號CM中之變焦位置來設定框的尺寸。另外,基於包括 在命令訊號CM中之框的中心位置,控制部3 1 0儲存預設位 置在記憶體中。需注意的是,可藉由鍵盤輸入等等來指定 變焦量,以取代基於框的尺寸來指定變焦量。 如上述,根據本實施例,預設位置顯示在整個影像上 (全景影像),及因此能夠容易確定整個影像中的預設位 置。另外,因爲可藉由在整個影像上指定它來指定預設, 所以能夠明顯提高可使用性。另外,因爲可基於成像的視 角來顯示預設位置的尺寸(框的尺寸),所以亦能夠確定 已預設的視角之相對尺寸。而且,甚至在以失真方式將整 個影像和實際擷取的影像彼此對應之情形中,仍能夠相當 確定視角的尺寸。 需注意的是,在上述說明中,說明複數個使用者控制 相機終端裝置200的每一個之成像方向的例子。然而,本 發明亦可應用到固定相機終端裝置200的每一個之成像方 向,及只有對應於來自使用者的區域從整個影像切出並且 顯示之系統(數位化執行全景拍攝/上下搖攝控制之系統 )。此系統被達成,使得例如中央伺服器300的控制部310 根據使用者的成像方向之操作輸入來指定從整個影像的切 出範圍,及使用顯示處理部3 05來執行顯示控制。再者在 此例中,藉由使用預設位置來執行上述控制,能夠數位化 控制現場直播影像的成像範圍。如上述,本實施例的系統 不僅可應用到機械式控制成像方向之系統,而且亦可應用 -37- 201201573 到數位化控制成像方向之系統。 上面參考附圖詳細說明本發明的例示實施例。然而, 本發明並不侷限於上述例子。精於本技藝之人士應明白, 只要在附錄的申請專利範圍及其同等物的範疇內,可依據 設計要求和其他因素而出現各種修改、組合、子組合、及 變化。 本申請案包含有關日本專利局於2010、3、26所發表 之日本優先權專利申請案JP 20 1 0-073232所揭示的主題, 藉以倂入其全文做爲參考。 【圖式簡單說明】 圖1爲根據本發明的實施例之成像系統的總組態之槪 要圖; 圖2爲圖1所示之成像系統中的相機終端裝置和中央伺 服器之詳細組態槪要圖; 圖3爲相機終端裝置200之全景拍攝操作和上下搖攝操 作的槪要圖; 圖4爲全景影像和鳥瞰圖影像之顯示狀態的槪要圖; 圖5爲產生鳥瞰圖影像訊號DF之處理的槪要圖; 圖6爲產生鳥瞰圖影像訊號DF之處理的槪要圖; 圖7爲產生鳥瞰圖影像訊號DF之處理的槪要圖; 圖8爲產生鳥瞰圖影像訊號DF之處理的槪要圖; 圖9爲監視器的顯示螢幕之槪要圖; 圖10爲操作面板上的操作之槪要圖;S -32- 201201573 Both are shown examples. In this example, because two live broadcast images cannot be displayed at the same time, the two images are alternately updated to the latest live broadcast image. Alternatively, one of the two images can be displayed as a live broadcast image, and then a past image of another previously acquired image can be displayed. In the example of Figs. 26 and 27, when the user designates both the frame B and the frame D by the drag operation, the operation signal US according to the drag operation is transmitted from the user interface 315 to the control unit 310. The operation signal US includes information of the selected boxes B and D. The control unit 310 transmits the command signal CM generated based on the operation signal US to the terminal control unit 210 of the camera terminal device 200 via the network interface unit 206. The terminal control unit 210 analyzes the command signal CM, and generates the direction control signal CTc based on the information indicating the selection of the two frames B and D and the information of the preset positions of the frames B and D stored in the panoramic image storage unit 207. In this manner, the imaging direction of the camera unit 20 1 is adjusted to the direction indicated by the direction control signal CTc by the imaging direction control unit 204 and the imaging direction adjustment unit 205. FIG. 28 is a detailed example of the setting screen for setting the preset position. To map. The preset screen shown in Fig. 28 appears when the "preset position" button shown in Fig. 10 is clicked. In the example of the setting screen shown in Fig. 28, the panoramic image is displayed to the right of the center of the screen, and the image of the preset position (live video) is displayed to the left of the center of the screen. The user can perform the preset of the preset position by performing a drag operation in the panoramic image. In this example, for example, the preset of each of the frames A to D is performed by dragging the two end points of the diagonal of the rectangular frame as the start point and the end point on the panoramic image. As a result, the frames A to D which have been set by the preset are displayed on the panoramic image. Thereafter, the drag operation is performed by using the square-33-201201573 method shown in FIGS. 24 and 25, and the user has set the frames A to D in the state of the desired position, when the user is at the preset position. Each time a preset number and name are set and the "Set" button is clicked, the preset corresponding to each of the frames A to D is completed. Alternatively, you can call the preset by clicking the “Call” button. It should be noted that the setting is made by inputting the coordinates of the preset position. In the present embodiment, four preset positions are illustrated as an example. However, the number of preset positions is not particularly limited. In the "group preset position" shown in Fig. 28, the preset positions can be classified into some groups. Groups are represented as a tree structure. In the “Original setting position” menu, the original camera position is displayed. When a new group folder is created, the properties of the new group folder are shown in the "New Group" column. The “Rename” button is the button to click when changing the group name. The "Clear" button is the button to click when deleting the group. The “OK” button is the button that is clicked when the settings on this page are stored in the camera. The “Cancel” button is the button that was clicked when the setting of this page was canceled. When the user sets the preset position, the operation signal US according to the user operation is transmitted from the user interface 315 to the control unit 310. The control unit 310 transmits the command signal CM generated based on the operation signal US to the terminal control unit 210 of the camera terminal device 200 via the network interface unit 206. The terminal control unit 210 analyzes the command signal CM and stores the preset position included in the command signal CM in the panoramic image storage unit 2〇7. In addition, when the information of the preset position is stored in the memory set in the central server 300, the control unit 310 stores the preset position in the -34-201201573 according to the command signal CM generated based on the operation signal US. . As described above, in the state shown in FIG. 28 on the monitor 3 20 connected to the central server 300 or on the display portion of the user 400, the user can use a pointing device such as a mouse, a keyboard, or the like. Set, change, and delete preset positions. Next, the setting of the position and size of the frame indicating the preset position on the panoramic image will be explained. When the user specifies the position and size of the frame in the panoramic image using a drag operation or the like, the center position of the setting frame is set as the preset position. Then, in the panoramic image storage unit 207 or in the memory of the central server 300, the center position of the frame is stored as a preset position. The reference size of the frame is set to the size of the frame positioned at the center of the panoramic image because the curvature of the image appears around the panoramic image. Then, the reference frame is enlarged or reduced to have a size corresponding to the magnification of the image, and the final size of the frame is determined. For example, the relationship between the frame size and the zoom amount of the camera portion 201 of the camera terminal device 200 is set in the following manner. As shown in Fig. 28, it is assumed that the panoramic image has a height of 90 pixels and a width of 320 pixels. In the example shown in Fig. 28, the panoramic image is an image captured by a 3 60-degree panoramic shooting operation (second panoramic image). Therefore, the angle of view in the horizontal direction corresponds to 360 as an example, assuming that the horizontal angle of view of the lens of the camera unit 201 is 58 degrees (wide end) and 2 degrees (distal end), and the maximum resolution of the camera unit 210 is 640x4. 80 (pixels). In this example, the size (Xw, Yw) of the rectangle when the lens of the camera portion 201 is set at the wide end (wherein the unit of XW and YW - 35 - 201201573 is the number of pixels (the number of pixels)) is represented by the following relationship . 360 (degrees): 50 (degrees) = 320 : Xw Therefore, the size of the rectangle in the horizontal direction is Xw = 52 (pixels). The rectangular size Yw in the vertical direction is expressed by the following relationship. 640 : 480 = 52 : Yw Therefore, obtain the equation Yx = 39 (pixels). Therefore, when the lens of the camera portion 201 is set at the wide end, the size of the rectangular frame is (52, 39) pixels. When the camera terminal device 200 is mostly zoomed and the lens is at the far end, the rectangle is represented by the following relationship ( Xt, Yt) (pixel) size. 360 (degrees): 2 (degrees) = 320 : Xw Therefore, the size of the rectangle in the horizontal direction is Xw = 1.8 pixels. Further, the size Yw of the rectangle in the vertical direction is represented by the following relationship. 640 : 480 = 1.7 : Yw Therefore, obtain the equation Yw = 1.4 (pixels). Therefore, as described above, the relationship between the frame size of the camera portion 201 and the amount of zoom is obtained. The control unit 301 generates a command signal CM based on the position and the amount of zoom of the frame designated by the user, and transmits the command signal CM to the terminal control unit 210 of the camera terminal device 200 via the network interface 206. The terminal control unit 210 analyzes the command signal CM, and calculates the size of the frame in the preset position based on the amount of zoom included in the command signal CM. Then, the terminal control section 210 stores the calculated frame size together with the center position of the preset position in the panoramic image storage section 2 07. When the preset position is stored in the memory of the central server 3 - 36 - 201201573 3 00 or the user 400, the control section 310 sets the size of the frame based on the zoom position included in the command signal CM. Further, based on the center position of the frame included in the command signal CM, the control unit 310 saves the preset position in the memory. It should be noted that the zoom amount can be specified by keyboard input or the like instead of the frame-based size to specify the zoom amount. As described above, according to the present embodiment, the preset position is displayed on the entire image (panoramic image), and thus the preset position in the entire image can be easily determined. In addition, since the preset can be specified by specifying it on the entire image, the usability can be remarkably improved. In addition, since the size of the preset position (the size of the frame) can be displayed based on the angle of view of the image, the relative size of the preset angle of view can also be determined. Moreover, even in the case where the entire image and the actually captured image are corresponding to each other in a distorted manner, the size of the viewing angle can be quite determined. It is to be noted that, in the above description, an example in which a plurality of users control the imaging direction of each of the camera terminal devices 200 will be described. However, the present invention is also applicable to the imaging direction of each of the fixed camera terminal devices 200, and only the system corresponding to the region from the user cut out and displayed from the entire image (digitally performing panoramic shooting/up and down panning control) system). This system is realized such that, for example, the control unit 310 of the center server 300 specifies the cut-out range from the entire image based on the operation input of the user's imaging direction, and performs display control using the display processing unit 305. Further, in this example, by performing the above control using the preset position, it is possible to digitally control the imaging range of the live broadcast image. As described above, the system of the present embodiment can be applied not only to a system for mechanically controlling the imaging direction but also to a system for digitally controlling the imaging direction from -37 to 201201573. The exemplary embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the present invention is not limited to the above examples. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and changes may be made in accordance with the design requirements and other factors in the scope of the patent application and its equivalents. The present application contains subject matter disclosed in Japanese Priority Patent Application No. JP-A No. No. No. No. H. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram of a general configuration of an imaging system according to an embodiment of the present invention; FIG. 2 is a detailed configuration of a camera terminal device and a central server in the imaging system shown in FIG. FIG. 3 is a schematic diagram of a panoramic shooting operation and a vertical panning operation of the camera terminal device 200; FIG. 4 is a schematic view showing a display state of the panoramic image and the bird's-eye view image; FIG. Figure 6 is a schematic diagram of the process of generating a bird's-eye view image signal DF; Figure 7 is a schematic view of the process of generating a bird's-eye view image signal DF; Figure 8 is a schematic view of generating a bird's-eye view image signal DF A schematic diagram of the processing; FIG. 9 is a schematic diagram of the display screen of the monitor; FIG. 10 is a schematic diagram of the operation on the operation panel;
S -38- 201201573 圖11爲當點選面板“景象”時,顯示諸如“螢幕模式”、 “景象尺寸” '“影像編碼解”、及“框率”等功能表的狀態之 槪要圖;圖1 2爲當點選面板“相機”時所顯示之功能表的槪要圖 選 點 當 爲 3 01顯 圖ΓΙ 'm 訊 自 各 之 示 器 發 觸 ·’ ‘ 圖 ”、要 置槪 位的 設表 預能 ‘功 資 及 、 , 1.J 其 之 示 顯 的 像 影 圖 瞰 鳥 爲 4 IX 圖 之 示 顯 的 像 影 圖 瞰 鳥 爲 5 圖 圖圖 要要 槪 0 圖 圖圖圖 要要 槪 槪 之之 示示 顯顯 的的 像.像 影影 圖圖 瞰瞰 鳥鳥 爲爲 影實 圖本 瞰據 鳥根 爲爲 要 槪 之 示 顯 的 像 圖 圖 圖 室 議 會 在 置 設 係 置 裝 端 終 機 相 之 例 施 圖 要 槪 的 子 例 之 中 在 由 藉 爲 ο 2 圖 的 D 至 A 框 擇 選 中 像 影 個 整 之 示 所 個 四 從 而 1 之 中 其 之 態 狀 的 像 影 摧 直 場 現 定 指 中 置 位 C- 1 定 圖預 圖圖之 要 中 槪 其 A 框 擇 選 中 像 影 個 整 之 示 所 9 11 圖 在 由 藉 爲 像 影 摺 直 場 現 定 指 中 置 位 定 預 個 四 從 而 的之 D態 至狀 的 的之 D 態 至狀 的 像 影 摧 直 場—現 個定 整旨 f 之中 示置 所位 9 ί 1 定 圖預 在個 由四 藉從 爲而 •’22一 圖圖之 要 中 槪 其 A 框 擇 選 中 像 影 的 D 至 A 框 擇 選 中 像 影 個 整 之 示 所 9 —1 圖 在 由 藉 爲 3 •’ 2 圖 圖 要 槪 -39- 201201573 其中之一而從四個預定位置中指定現場直播影像的狀態之 槪要圖; 圖2 4爲改變預設位置之方法的槪要圖: 圖25爲改變預設位置之方法的槪要圖; 圖26爲藉由使用者所執行的拖曳操作選擇兩框(即' 框B及框D)之狀態的槪要圖; 圖27爲當藉由使用者所執行的拖曳操作選擇兩框(即 '框B及框D)時顯示對應於框B之影像和對應於框D之影 像的例子之槪要圖:及 圖28爲設定螢幕在設定預設位置之詳細例子的槪要圖 【主要元件符號說明】 100 :成像系統 200 :相機終端裝置 201 :相機部 202 :訊號處理部 203 :記億體部 2〇4 :成像方向控制部 205 :成像方向調整部 2〇6 :網路介面部 2〇7:全景影像儲存部 2 1 〇 :終端控制部 220 :匯流排S -38- 201201573 Figure 11 is a schematic diagram showing the status of a function table such as "Screen Mode", "View Size" ""Image Coding Solution", and "Frame Rate" when clicking the "View" panel; Figure 1 2 is the main point of the function chart displayed when clicking the "camera" panel. It is 3 01 display ΓΙ 'm message from each indicator · ' '图', to be placed Set the table pre-capacity 'power and , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , It is necessary to show the obvious image. The shadow map is like a bird's-eye view. It is a bird's-eye view of the bird's eye. In the sub-examples of the terminal-end phase diagram, in the D to A frame of the borrowing of the ο 2 graph, the image of the image is displayed. The smashing field is now determined to be in the middle of the C-1 fixed map槪 A A A A A A 选中 选中 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 9 The shadow is destroyed by the shadow field - now a set of the whole set f is the position of the 9 ί 1 fixed map in advance by a four borrowed from the • '22 a map to the middle of the A frame selected image The D to A frame of the shadow selects the image of the whole scene. The picture shows the live broadcast image from the four predetermined positions by borrowing 3 • ' 2 maps to 槪 -39- 201201573 Figure 2 is a schematic diagram of a method of changing the preset position: Figure 25 is a schematic diagram of a method of changing a preset position; Figure 26 is a selection of two by a drag operation performed by a user A schematic view of the state of the frame (ie, 'B and B'); FIG. 27 is an image corresponding to the frame B when two frames (ie, 'B and B') are selected by a drag operation performed by the user. And an example of an example corresponding to the image of the frame D: and FIG. 28 is setting the screen at the preset position. Outline of the detailed example [Description of main component symbols] 100: Imaging system 200: Camera terminal device 201: Camera unit 202: Signal processing unit 203: Billion body unit 2〇4: Imaging direction control unit 205: Imaging direction adjustment unit 2〇6: Network interface face 2〇7: Panoramic image storage unit 2 1 〇: Terminal control unit 220: Bus bar
S -40- 201201573 3 00 :中央伺服器 3 〇 1 :網路介面部 3 〇 2 :延伸處理部 · 3 03 :位置決定處理部 3 04 :影像處理部 305:顯示處理部 3 1 0 :控制部 3 1 5 :使用者介面部 3 2 0 :監視器 400 :用戶 500 :網路 600 :代理伺服器 CTa :成像控制訊號 CTb :訊號處理控制訊號 CTc:方向控制訊號 CTg :圖形使用者介面顯示控制訊號 CTm :控制訊號 D c a m :視頻訊號 D V :視頻編碼訊號 DF :第一全景影像訊號 DP :第二全景影像訊號 DFC :第一全景影像訊號 DPC :第二全景影像訊號 M D p :驅動訊號 -41 - 201201573 M D t :驅動訊號 PM:相機位置資訊訊號 CM :命令訊號 KP :位置決定結果 HD:顯示驅動訊號 U S :操作訊號 L :中心線S -40- 201201573 3 00 : Central server 3 〇1 : Network interface 3 〇 2 : Extension processing unit · 3 03 : Position determination processing unit 3 04 : Video processing unit 305 : Display processing unit 3 1 0 : Control Part 3 1 5 : User Interface 3 2 0 : Monitor 400 : User 500 : Network 600 : Proxy Server CTa : Imaging Control Signal CTb : Signal Processing Control Signal CTc : Direction Control Signal CTg : Graphic User Interface Display Control signal CTm: control signal D cam: video signal DV: video coded signal DF: first panoramic video signal DP: second panoramic video signal DFC: first panoramic video signal DPC: second panoramic video signal MD p: drive signal - 41 - 201201573 MD t : Drive signal PM: Camera position information signal CM: Command signal KP: Position determination result HD: Display drive signal US: Operation signal L: Center line
S -42-S -42-
Claims (1)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010073232A JP2011205573A (en) | 2010-03-26 | 2010-03-26 | Control device, camera system, and program |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201201573A true TW201201573A (en) | 2012-01-01 |
TWI461057B TWI461057B (en) | 2014-11-11 |
Family
ID=44656006
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW100107926A TWI461057B (en) | 2010-03-26 | 2011-03-09 | Control device, camera system and program |
Country Status (5)
Country | Link |
---|---|
US (3) | US9380196B2 (en) |
JP (1) | JP2011205573A (en) |
KR (1) | KR20110108265A (en) |
CN (2) | CN105450934B (en) |
TW (1) | TWI461057B (en) |
Families Citing this family (42)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5965596B2 (en) * | 2011-07-27 | 2016-08-10 | オリンパス株式会社 | Image processing system, information processing apparatus, and program |
JP2013051519A (en) * | 2011-08-30 | 2013-03-14 | Sony Corp | Information processing apparatus, information processing method, program, and information processing system |
JP6074896B2 (en) * | 2012-03-16 | 2017-02-08 | 株式会社リコー | Imaging apparatus and imaging processing method |
JP2015156523A (en) * | 2012-06-06 | 2015-08-27 | ソニー株式会社 | Image processing device, image processing method, and program |
JP5975101B2 (en) | 2012-06-11 | 2016-08-23 | ソニー株式会社 | Control device, control method, and recording medium |
WO2014051010A1 (en) * | 2012-09-28 | 2014-04-03 | 株式会社Jvcケンウッド | Diagnosis assistance device and diagnosis assistance method |
JP6139872B2 (en) * | 2012-12-10 | 2017-05-31 | キヤノン株式会社 | Information processing apparatus and control method therefor, program, storage medium, and video processing system |
JP6044328B2 (en) * | 2012-12-26 | 2016-12-14 | 株式会社リコー | Image processing system, image processing method, and program |
KR102090624B1 (en) * | 2013-02-26 | 2020-03-18 | 삼성전자 주식회사 | Apparatus and method for processing a image in device |
CN105144229B (en) * | 2013-04-30 | 2019-07-05 | 索尼公司 | Image processing apparatus, image processing method and program |
US10674075B2 (en) | 2013-04-30 | 2020-06-02 | Sony Corporation | Image processing device, image processing method, and program |
US9865033B1 (en) * | 2014-01-17 | 2018-01-09 | Amazon Technologies, Inc. | Motion-based image views |
CN109040600B (en) * | 2014-03-21 | 2021-03-30 | 北京小米移动软件有限公司 | Mobile device, system and method for shooting and browsing panoramic scene |
JP6401480B2 (en) * | 2014-04-02 | 2018-10-10 | キヤノン株式会社 | Information processing apparatus, information processing method, and program |
USD781317S1 (en) | 2014-04-22 | 2017-03-14 | Google Inc. | Display screen with graphical user interface or portion thereof |
USD780777S1 (en) | 2014-04-22 | 2017-03-07 | Google Inc. | Display screen with graphical user interface or portion thereof |
US9972121B2 (en) | 2014-04-22 | 2018-05-15 | Google Llc | Selecting time-distributed panoramic images for display |
US9934222B2 (en) | 2014-04-22 | 2018-04-03 | Google Llc | Providing a thumbnail image that follows a main image |
USD781318S1 (en) | 2014-04-22 | 2017-03-14 | Google Inc. | Display screen with graphical user interface or portion thereof |
US9883101B1 (en) * | 2014-07-23 | 2018-01-30 | Hoyos Integrity Corporation | Providing a real-time via a wireless communication channel associated with a panoramic video capture device |
JP6504793B2 (en) * | 2014-11-14 | 2019-04-24 | キヤノン株式会社 | IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND PROGRAM |
US9667848B2 (en) * | 2015-04-22 | 2017-05-30 | Qualcomm Incorporated | Tiltable camera module |
JP6511539B2 (en) * | 2015-05-27 | 2019-05-15 | グーグル エルエルシー | Capturing and Rendering Panoramic Virtual Reality Content |
US9877016B2 (en) | 2015-05-27 | 2018-01-23 | Google Llc | Omnistereo capture and render of panoramic virtual reality content |
JP6558088B2 (en) * | 2015-06-12 | 2019-08-14 | リコーイメージング株式会社 | Imaging apparatus, imaging control apparatus, and imaging control method |
TWI547177B (en) * | 2015-08-11 | 2016-08-21 | 晶睿通訊股份有限公司 | Viewing Angle Switching Method and Camera Therefor |
KR20170124814A (en) * | 2016-05-03 | 2017-11-13 | 삼성전자주식회사 | Image display apparatus and operating method for the same |
CN106055247A (en) * | 2016-05-25 | 2016-10-26 | 努比亚技术有限公司 | Picture display device, method and mobile terminal |
CN105933707B (en) * | 2016-06-30 | 2019-02-22 | 北京奇艺世纪科技有限公司 | A kind of compression method and device of panoramic video |
DE102016213493A1 (en) * | 2016-07-22 | 2018-01-25 | Conti Temic Microelectronic Gmbh | Camera device for recording a surrounding area of an own vehicle and method for providing a driver assistance function |
JP6953221B2 (en) * | 2017-07-31 | 2021-10-27 | グリー株式会社 | Image display system, image display program, image display method and server |
JP6887130B2 (en) * | 2017-09-29 | 2021-06-16 | パナソニックIpマネジメント株式会社 | Surveillance camera system and surveillance method |
CN108224288B (en) * | 2018-02-08 | 2024-04-05 | 浙江天平光电科技有限公司 | LED down lamp capable of automatically adjusting focal length |
US10643386B2 (en) | 2018-04-11 | 2020-05-05 | Zillow Group, Inc. | Presenting image transition sequences between viewing locations |
JP7313869B2 (en) * | 2018-05-11 | 2023-07-25 | キヤノン株式会社 | IMAGING DEVICE, CONTROL DEVICE, CONTROL METHOD AND PROGRAM |
CN109525674B (en) * | 2018-11-27 | 2021-09-03 | 上海简家信息技术有限公司 | System and method for making house panorama |
CN110427153B (en) * | 2019-07-30 | 2022-02-11 | 广州视源电子科技股份有限公司 | Writing content display method, device, equipment and medium |
CN110544312A (en) * | 2019-08-22 | 2019-12-06 | 上海晋泷科技有限公司 | Video display method and device in virtual scene, electronic equipment and storage device |
CN110602447A (en) * | 2019-08-28 | 2019-12-20 | 恒大智慧科技有限公司 | Emergency display method, device and storage medium |
CN112533021B (en) | 2019-09-19 | 2023-04-11 | Vidaa(荷兰)国际控股有限公司 | Display method and display equipment |
JP2021052325A (en) * | 2019-09-25 | 2021-04-01 | キヤノン株式会社 | Image capture device, system, method for controlling image capture device, and program |
CN111935456B (en) * | 2020-08-06 | 2022-05-17 | 厦门安科科技有限公司 | Intelligent safety supervision device for construction site |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2959220B2 (en) | 1991-07-24 | 1999-10-06 | 日本電気株式会社 | Electronic scanning antenna |
US6476868B1 (en) * | 1994-04-11 | 2002-11-05 | Canon Kabushiki Kaisha | Image pickup apparatus provided with enlargement process means for enlarging image signals output from an image pickup device |
US5850352A (en) * | 1995-03-31 | 1998-12-15 | The Regents Of The University Of California | Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images |
JPH09327008A (en) * | 1996-06-05 | 1997-12-16 | Ricoh Co Ltd | Camera preset position display method for communication conference terminal equipment, camera position control method and camera preset position registration method |
JP2005354748A (en) | 1997-04-21 | 2005-12-22 | Sony Corp | Apparatus and method for controlling imaging means |
JP4332231B2 (en) * | 1997-04-21 | 2009-09-16 | ソニー株式会社 | Imaging device controller and imaging system |
KR200200316Y1 (en) * | 2000-04-17 | 2000-10-16 | 주식회사유레카네트웍스 | A panorama type camera |
JP2001346031A (en) * | 2000-06-05 | 2001-12-14 | Fuji Photo Film Co Ltd | Method and device for compositing image |
US6816626B1 (en) * | 2001-04-27 | 2004-11-09 | Cisco Technology, Inc. | Bandwidth conserving near-end picture-in-picture videotelephony |
JP2003108412A (en) * | 2001-10-02 | 2003-04-11 | Hitachi Ltd | Storage control system |
US20090040238A1 (en) * | 2004-10-25 | 2009-02-12 | Mitsue Ito | Image display program and storage medium containing same |
JP2006191408A (en) * | 2005-01-07 | 2006-07-20 | Hitachi Kokusai Electric Inc | Image display program |
AU2005200888B2 (en) * | 2005-02-28 | 2009-01-08 | Canon Kabushiki Kaisha | Visualising camera position in recorded video |
JP4926416B2 (en) * | 2005-06-15 | 2012-05-09 | キヤノン株式会社 | Image display method, program, recording medium, and image display apparatus |
JP4244973B2 (en) * | 2005-08-03 | 2009-03-25 | ソニー株式会社 | Imaging system, camera control device, panoramic image display method and program |
US7813526B1 (en) * | 2006-01-26 | 2010-10-12 | Adobe Systems Incorporated | Normalizing detected objects |
JP2008022260A (en) | 2006-07-12 | 2008-01-31 | Hitachi Kokusai Electric Inc | Monitoring system |
WO2008044605A1 (en) * | 2006-10-04 | 2008-04-17 | Nikon Corporation | Electronic apparatus and electronic camera |
JP2008211413A (en) | 2007-02-26 | 2008-09-11 | Sanyo Electric Co Ltd | Video camera device |
JP4565220B2 (en) * | 2008-07-30 | 2010-10-20 | 株式会社モリタ製作所 | Medical training device |
US20100245584A1 (en) * | 2009-03-31 | 2010-09-30 | Pelco, Inc. | Method and apparatus for creating a zone of interest in a video display |
US8724908B2 (en) * | 2010-09-03 | 2014-05-13 | Adobe Systems Incorporated | System and method for labeling a collection of images |
-
2010
- 2010-03-26 JP JP2010073232A patent/JP2011205573A/en active Pending
-
2011
- 2011-03-09 TW TW100107926A patent/TWI461057B/en active
- 2011-03-10 US US12/932,945 patent/US9380196B2/en active Active
- 2011-03-18 KR KR1020110024260A patent/KR20110108265A/en not_active Application Discontinuation
- 2011-03-21 CN CN201610006383.2A patent/CN105450934B/en active Active
- 2011-03-21 CN CN201110067427.XA patent/CN102202168B/en active Active
-
2016
- 2016-06-01 US US15/170,578 patent/US20160277653A1/en not_active Abandoned
-
2019
- 2019-08-07 US US16/534,472 patent/US11146726B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN105450934B (en) | 2019-06-07 |
JP2011205573A (en) | 2011-10-13 |
KR20110108265A (en) | 2011-10-05 |
CN105450934A (en) | 2016-03-30 |
TWI461057B (en) | 2014-11-11 |
US20200014833A1 (en) | 2020-01-09 |
US11146726B2 (en) | 2021-10-12 |
US20160277653A1 (en) | 2016-09-22 |
US20110234832A1 (en) | 2011-09-29 |
CN102202168A (en) | 2011-09-28 |
US9380196B2 (en) | 2016-06-28 |
CN102202168B (en) | 2016-01-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI461057B (en) | Control device, camera system and program | |
US11477375B2 (en) | Control device, camera system, and program | |
JP6633862B2 (en) | Information processing apparatus and control method thereof | |
JP7150456B2 (en) | IMAGING SYSTEM, INFORMATION PROCESSING DEVICE, CONTROL METHOD OF INFORMATION PROCESSING DEVICE, AND PROGRAM | |
JP6826481B2 (en) | Video display device, control method and program of video display device | |
KR20170055455A (en) | Camera system for compensating distortion of lens using super wide angle camera and Transport Video Interface Apparatus used in it | |
JP5464290B2 (en) | Control device, control method, and camera system | |
JP2011205574A (en) | Control device, camera system, and program | |
JP6128966B2 (en) | Image processing apparatus, image processing method, and program | |
JP2001268556A (en) | Remote monitoring system and control terminal equipment | |
JP2002077880A (en) | Remote-monitoring system | |
JP2023086483A (en) | Image processing device, image processing method, and program | |
JP2019140599A (en) | Information processing apparatus, information processing method, and program | |
JP2013240004A (en) | Image management device, image processing apparatus, image management system, image processing system, image management method, and image processing method | |
JP2019140566A (en) | Information processing apparatus, information processing method, and program | |
JPH0937135A (en) | Image pickup system |