TW201904276A - Interphone system, intercom slave, display terminal, control device and program capable of reducing the difficulty of viewing each image while displaying multiple types of images - Google Patents

Interphone system, intercom slave, display terminal, control device and program capable of reducing the difficulty of viewing each image while displaying multiple types of images Download PDF

Info

Publication number
TW201904276A
TW201904276A TW107117508A TW107117508A TW201904276A TW 201904276 A TW201904276 A TW 201904276A TW 107117508 A TW107117508 A TW 107117508A TW 107117508 A TW107117508 A TW 107117508A TW 201904276 A TW201904276 A TW 201904276A
Authority
TW
Taiwan
Prior art keywords
image
display
unit
terminal
screen
Prior art date
Application number
TW107117508A
Other languages
Chinese (zh)
Other versions
TWI687103B (en
Inventor
中村譲
池田光治
竹之內利春
山中睦裕
橋本尚典
Original Assignee
日商松下知識產權經營股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日商松下知識產權經營股份有限公司 filed Critical 日商松下知識產權經營股份有限公司
Publication of TW201904276A publication Critical patent/TW201904276A/en
Application granted granted Critical
Publication of TWI687103B publication Critical patent/TWI687103B/en

Links

Landscapes

  • Telephone Function (AREA)
  • Interconnected Communication Systems, Intercoms, And Interphones (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The present invention provides an interphone system, intercom slave, display terminal, control device and program, which may reduce the difficulty of viewing each image while displaying multiple types of images. The interphone system (1) comprises an image processing portion (103) for processing the images to be displayed on the display portion (33) of the display terminal (30) comprising the display portion (33). The image processing portion (103) may enable the display portion (33) to display, on the master screen, the current images captured by the imaging terminal (40) of the visitor and processed by the image processing portion (103), the image processing portion (103) causes the display portion (33) to display at least one of the past image and the input image. The image processing portion (103) provides the clipping function for clipping the images that should be displayed on the sub screen.

Description

對講機系統、對講機子機、顯示終端、控制裝置及程式Walkie-talkie system, walkie-talkie handset, display terminal, control device and program

本發明係關於一種對講機系統、對講機子機、顯示終端、控制裝置及程式,更詳細而言,係關於一種顯示來訪者之對講機系統、對講機子機、顯示終端、控制裝置及程式。The present invention relates to a walkie-talkie system, a walkie-talkie handset, a display terminal, a control device and a program, and more particularly to a walkie-talkie system, a walkie-talkie handset, a display terminal, a control device and a program for displaying a visitor.

先前,存在設置有攝像裝置(攝像終端)之對講機系統(參照文獻1「日本專利公開編號2015-111935」)。於文獻1中,主要於來訪者所使用之對講機子機設置有攝像裝置。當來訪者用對講機子機進行呼叫操作時,開始藉由攝像裝置進行拍攝。攝像裝置所拍攝之影像被顯示於設置於住戶內之對講機母機(顯示終端)。藉此,使用者(居住者)可確認來訪者。In the past, there has been a walkie-talkie system in which an image pickup device (image pickup terminal) is installed (see Japanese Patent Laid-Open No. 2015-111935). In Document 1, an interim camera is mainly provided for a walkie-talkie machine used by a visitor. When the visitor makes a call operation using the intercom machine, shooting is started by the camera. The image captured by the imaging device is displayed on the walkie-talkie main unit (display terminal) installed in the household. Thereby, the user (occupant) can confirm the visitor.

業界期望於對講機系統中以顯示終端顯示影像時,可一次將複數種影像顯示於1個顯示畫面。於該情形時,必須根據要以顯示畫面顯示之影像之種類分割顯示畫面。複數種影像分別顯示於被分割之複數個畫面。此時,與以顯示畫面顯示1種影像之情形相比,各影像變小,因此存在難以觀看各影像之問題。The industry expects to display a plurality of types of images on one display screen at a time when displaying images on the display terminal in the walkie-talkie system. In this case, it is necessary to divide the display screen according to the type of image to be displayed on the display screen. A plurality of types of images are respectively displayed on the plurality of divided screens. At this time, since each image is smaller than the case where one type of image is displayed on the display screen, there is a problem that it is difficult to view each image.

於是,本發明係鑒於上述情況而完成,目的在於提供一種即便於顯示複數種影像之情形時,亦可降低各影像之觀看難度的對講機系統、對講機子機、顯示終端、控制裝置及程式。Accordingly, the present invention has been made in view of the above circumstances, and an object thereof is to provide a walkie-talkie system, a walkie-talkie handset, a display terminal, a control device, and a program that can reduce the difficulty of viewing each image even when displaying a plurality of types of images.

本發明之一態樣之對講機系統包含影像處理部,該影像處理部對於應藉由包含顯示部之顯示終端之上述顯示部顯示之影像實施處理。上述影像處理部使上述顯示部以主畫面顯示由拍攝來訪者之攝像終端所拍攝、且由上述影像處理部處理後之即時影像作為第1影像。上述影像處理部使上述顯示部以副畫面顯示由上述攝像終端所拍攝、且與上述第1影像之拍攝時刻不同之拍攝時刻之影像、及由與上述攝像終端不同之1個以上之外部終端分別拍攝之影像中至少1種影像作為第2影像。上述影像處理部具有對於應藉由上述副畫面顯示之上述第2影像進行修剪之修剪功能。An interphone system according to an aspect of the present invention includes an image processing unit that performs processing on an image to be displayed by the display unit including a display terminal of the display unit. The image processing unit causes the display unit to display, as the first image, an instant image captured by the imaging terminal of the visitor and processed by the image processing unit on the main screen. The image processing unit causes the display unit to display, by the sub-screen, a video captured by the imaging terminal and at an imaging time different from the imaging time of the first video, and one or more external terminals different from the imaging terminal At least one of the images in the captured image is used as the second image. The image processing unit has a cropping function for cropping the second image to be displayed by the sub-screen.

本發明之一態樣之上述對講機系統所包含之對講機子機包含上述影像處理部、受理由上述攝像終端拍攝到之影像之受理部、及受理來自上述來訪者之用以進行呼叫之操作的呼叫部。A walkie-talkie handset included in the walkie-talkie system according to an aspect of the present invention includes the image processing unit, a receiving unit that receives an image captured by the image capturing terminal, and a call for accepting an operation from the visitor for making a call. unit.

本發明之一態樣之上述對講機系統所包含之顯示終端包含上述影像處理部、及受理由上述攝像終端拍攝到之影像的影像受理部。A display terminal included in the walkie-talkie system according to an aspect of the present invention includes the image processing unit and a video accepting unit that accepts an image captured by the imaging terminal.

本發明之一態樣之上述對講機系統所包含之控制裝置包含上述影像處理部、受理由上述攝像終端所拍攝之影像之受理部、及將由上述影像處理部實施過處理之影像發送至上述顯示終端的通信部。A control device included in the walkie-talkie system according to an aspect of the present invention includes the image processing unit, a receiving unit that receives an image captured by the image capturing terminal, and an image that has been processed by the image processing unit is transmitted to the display terminal Communication department.

本發明之一態樣之程式係使電腦作為上述對講機系統所包含之上述影像處理部而發揮功能。One aspect of the present invention is to cause a computer to function as the image processing unit included in the walkie-talkie system.

以下說明之各實施形態及變化例僅為本發明之一例,本發明並不限定於實施形態及變化例。該實施形態及變化例以外,只要為不脫離本發明之技術思想之範圍,則可根據設計等進行各種變更。The embodiments and variations described below are merely examples of the invention, and the invention is not limited to the embodiments and modifications. Other than the embodiment and the modifications, various modifications can be made depending on the design and the like without departing from the scope of the technical idea of the present invention.

(實施形態1) 對本實施形態之對講機系統、對講機子機、顯示終端、控制裝置及程式進行說明。(Embodiment 1) A walkie-talkie system, a walkie-talkie handset, a display terminal, a control device, and a program of this embodiment will be described.

(1)構成 如圖1所示,本實施形態之對講機系統1包含作為對講機子機之大廳對講機10、控制裝置20、作為對講機母機之顯示終端30、攝像終端40及外部終端50。於本實施形態中,以對講機系統1為集體住宅用對講機系統之情形為例進行說明。(1) Configuration As shown in Fig. 1, the intercom system 1 of the present embodiment includes a hall intercom 10 as a walkie-talkie handset, a control device 20, a display terminal 30 as a walkie-talkie master, an imaging terminal 40, and an external terminal 50. In the present embodiment, a case where the walkie-talkie system 1 is a walkie-talkie system for a collective house will be described as an example.

大廳對講機10係設置於集體住宅之共同玄關。顯示終端30為設置於集體住宅之住戶內(室內)之對講機母機。大廳對講機10與顯示終端30構成為可經由控制裝置20而相互通信。Hall walkie-talkie 10 is set in the common entrance of collective housing. The display terminal 30 is a walkie-talkie machine installed in a household (indoor) of a collective house. The hall walkie-talkie 10 and the display terminal 30 are configured to be communicable with each other via the control device 20.

攝像終端40係具有CCD(Charge Coupled Devices,電荷耦合元件)影像感測器、或CMOS(Complementary Metal-Oxide Semiconductor,互補金屬氧化物半導體)影像感測器等二維影像感測器等攝像元件而用以拍攝被攝體(來訪者等)之相機。於本實施形態中,將攝像終端40之攝像區域(視野)設置為大廳對講機10之前方,以便當來訪者操作大廳對講機10時至少可拍攝來訪者之面部。又,於本實施形態中,攝像終端40為可拍攝動態圖像之相機,但亦可為拍攝靜止圖像之相機。進而,於本實施形態中,攝像終端40為拍攝彩色圖像之相機,但亦可為拍攝黑白圖像之相機。The imaging terminal 40 includes an imaging element such as a CCD (Charge Coupled Devices) image sensor or a two-dimensional image sensor such as a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. A camera for taking pictures of a subject (visitor, etc.). In the present embodiment, the imaging area (field of view) of the imaging terminal 40 is set to be in front of the hall intercom 10 so that at least the face of the visitor can be photographed when the visitor operates the hall intercom 10. Further, in the present embodiment, the imaging terminal 40 is a camera that can capture a moving image, but may be a camera that captures a still image. Further, in the present embodiment, the imaging terminal 40 is a camera that captures a color image, but may be a camera that captures a black and white image.

外部終端50與攝像終端40同樣為具有攝像元件而用以拍攝被攝體(來訪者等)之相機。外部終端50係設置於共同玄關內與設置攝像終端40之場所不同的場所,以與攝像終端40不同之位置、角度拍攝來訪者。Similarly to the imaging terminal 40, the external terminal 50 is a camera having an imaging element for capturing a subject (visitor or the like). The external terminal 50 is installed in a place different from the place where the imaging terminal 40 is installed in the common entrance, and photographs the visitor at a different position and angle from the imaging terminal 40.

於本實施形態之對講機系統1中,可將攝像終端40所拍攝之被攝體(來訪者等)之影像及外部終端50所拍攝之影像分別顯示於顯示終端30。In the walkie-talkie system 1 of the present embodiment, the image of the subject (visitor or the like) captured by the imaging terminal 40 and the image captured by the external terminal 50 can be displayed on the display terminal 30, respectively.

大廳對講機10具有裁切應以攝像終端40及外部終端50拍攝之影像之一部分之功能(修剪功能)。如圖1所示,大廳對講機10包含第1受理部101、第2受理部102、影像處理部103、第1記憶部104、第2記憶部105、呼叫部106及通信部107。The hall walkie-talkie 10 has a function of cutting a part of an image to be captured by the camera terminal 40 and the external terminal 50 (trimming function). As shown in FIG. 1, the hall intercom 10 includes a first receiving unit 101, a second receiving unit 102, a video processing unit 103, a first storage unit 104, a second storage unit 105, a calling unit 106, and a communication unit 107.

第1記憶部104及第2記憶部105由選自ROM(Read Only Memory,唯讀記憶體)、RAM(Random Access Memory,隨機存取記憶體)、或EEPROM(Electrically Erasable Programmable Read Only Memory,電子可擦可程式化唯讀記憶體)等之器件構成。The first memory unit 104 and the second memory unit 105 are selected from a ROM (Read Only Memory), a RAM (Random Access Memory), or an EEPROM (Electrically Erasable Programmable Read Only Memory). Device composition such as erasable and programmable read-only memory).

第1記憶部104以時間序列記憶攝像終端40所拍攝之影像。第2記憶部105預先記憶有與分別顯示攝像終端40所拍攝之被攝體(來訪者等)之影像及外部終端50所拍攝之影像時的各影像之配置相關之配置資訊。配置資訊包含以顯示終端30顯示之影像之合計數量、影像之種類、及表示成為顯示對象之各影像於一個畫面上配置之位置(例如座標位置)及尺寸的顯示相關資訊。此處,影像之種類包含所拍攝之終端、拍攝時刻等。The first storage unit 104 memorizes the image captured by the imaging terminal 40 in time series. The second storage unit 105 stores in advance the arrangement information relating to the arrangement of the respective images when the image of the subject (visitor or the like) captured by the imaging terminal 40 and the image captured by the external terminal 50 are displayed. The configuration information includes display-related information indicating the total number of images displayed by the terminal 30, the type of the image, and the position (for example, the coordinate position) and the size of the image to be displayed on one screen. Here, the type of image includes the terminal to be photographed, the shooting time, and the like.

第2記憶部105將作為對於對象之影像應用修剪功能時所需之資訊的顯示規定資訊與顯示應顯示之影像之畫面之大小建立對應而記憶。顯示規定資訊包含裁切位置、裁切尺寸(裁切之縱橫之長度)、及將藉由修剪功能所裁切之影像以收入顯示終端30所顯示之畫面中之方式縮小的縮小率。The second storage unit 105 stores the display specification information as information necessary for applying the cropping function to the target image and the size of the screen on which the image to be displayed is displayed. The display specification information includes the cropping position, the cropping size (the length of the cropped aspect), and the reduction ratio in which the image cropped by the trimming function is reduced in the screen displayed on the display terminal 30.

第1受理部101受理攝像終端40所拍攝之影像,將所受理之影像輸出至影像處理部103及第1記憶部104。藉此,於影像處理部103中,可對攝像終端40所拍攝之即時影像進行處理。又,於第1記憶部104中,可記憶攝像終端40所拍攝之影像。The first receiving unit 101 receives the image captured by the imaging terminal 40 and outputs the received image to the video processing unit 103 and the first storage unit 104. Thereby, the video processing unit 103 can process the live video captured by the imaging terminal 40. Further, in the first storage unit 104, the image captured by the imaging terminal 40 can be stored.

第2受理部102受理外部終端50所拍攝之影像,將所受理之影像輸出至影像處理部103。藉此,於影像處理部103中,可對外部終端50所拍攝之影像進行處理。The second receiving unit 102 receives the image captured by the external terminal 50 and outputs the received image to the image processing unit 103. Thereby, the video processing unit 103 can process the image captured by the external terminal 50.

呼叫部106係以受理來自來訪者之用以進行呼叫之操作之方式構成。當對呼叫部106進行特定操作(例如按下操作)時,大廳對講機10經由通信部107及控制裝置20而對顯示終端30發送用以呼叫住戶內之居住者之控制信號。The calling unit 106 is configured to accept an operation from a visitor for making a call. When a specific operation (for example, a pressing operation) is performed on the calling unit 106, the hall intercom 10 transmits a control signal for calling the resident of the resident to the display terminal 30 via the communication unit 107 and the control device 20.

影像處理部103對以顯示終端30顯示之影像實施處理。具體而言,對攝像終端40所拍攝之影像及外部終端50所拍攝之影像實施處理。又,影像處理部103具有跟蹤功能,藉由顯示終端30之使用者(居住者)之操作而切換跟蹤功能之有效、無效。此處,跟蹤功能係指如下功能:於以顯示終端30顯示之影像中,以使顯示部33顯示之來訪者之至少面部之部分收入畫面中之方式,調整該影像之拍攝範圍、拍攝位置及顯示範圍中至少1者。The video processing unit 103 performs processing on the video displayed on the display terminal 30. Specifically, processing is performed on the image captured by the imaging terminal 40 and the image captured by the external terminal 50. Further, the video processing unit 103 has a tracking function for switching the tracking function to be effective or invalid by the operation of the user (occupant) of the display terminal 30. Here, the tracking function refers to a function of adjusting the shooting range and shooting position of the image in such a manner that at least part of the face of the visitor displayed on the display unit 33 is received in the image displayed on the display terminal 30. At least one of the display ranges.

影像處理部103以包含處理器及記憶體之微電腦(電腦)為主構成。微電腦藉由以處理器執行記憶體所記憶之程式,而作為影像處理部103發揮功能。程式可預先寫入記憶體,亦可通過電信線路提供,或記錄於記憶卡等記憶媒體中提供。如圖1所示,影像處理部103包含第1面部檢測部111、第2面部檢測部112、人檢測部113、提取部114及合成部115。The video processing unit 103 is mainly composed of a microcomputer (computer) including a processor and a memory. The microcomputer functions as the image processing unit 103 by executing a program stored in the memory by the processor. The program can be written to the memory in advance, or it can be provided via a telecommunication line or recorded on a memory card such as a memory card. As shown in FIG. 1, the video processing unit 103 includes a first face detecting unit 111, a second face detecting unit 112, a person detecting unit 113, an extracting unit 114, and a synthesizing unit 115.

第1面部檢測部111經由第1受理部101而自攝像終端40接收攝像終端40所拍攝之即時影像(當前影像)。第1面部檢測部111於跟蹤功能為有效之情形時,對當前影像進行面部感測。第1面部檢測部111將當前影像及由面部感測而得之感測結果輸出至提取部114。於感測結果中,包含人面部之有無,且於人面部存在於當前影像之情形時包含其位置資訊(第1位置資訊)。第1位置資訊為例如表示面部之區域之資訊。第1面部檢測部111於跟蹤功能無效之情形時,不進行面部感測,而將當前影像輸出至提取部114。The first face detecting unit 111 receives the live image (current image) captured by the imaging terminal 40 from the imaging terminal 40 via the first receiving unit 101. When the tracking function is enabled, the first face detecting unit 111 performs face sensing on the current image. The first face detecting unit 111 outputs the current image and the sensing result obtained by the face sensing to the extracting unit 114. The sensing result includes the presence or absence of a human face, and includes the position information (first position information) when the human face exists in the current image. The first position information is, for example, information indicating an area of the face. When the tracking function is disabled, the first face detecting unit 111 outputs the current image to the extracting unit 114 without performing face sensing.

第2面部檢測部112自第1記憶部104讀出記憶於第1記憶部104中且自當前時點向前回溯特定時間之影像(例如較當前時點3秒前之影像)。即,過去影像係拍攝時刻與當前影像之拍攝時刻不同之影像。第2面部檢測部112於跟蹤功能有效之情形時,對自第1記憶部104讀出之影像(過去影像)進行面部感測。第2面部檢測部112將過去影像、及由面部感測而得之感測結果輸出至提取部114。於感測結果中,包含人面部之有無,且於過去影像中存在人面部之情形時包含其位置資訊(第2位置資訊)。第2位置資訊例如係表示面部之區域之資訊。第2面部檢測部112於跟蹤功能無效之情形時,不進行面部感測,而將過去影像輸出至提取部114。The second face detecting unit 112 reads out from the first storage unit 104 the image stored in the first storage unit 104 and backtracking from the current time point to a predetermined time (for example, an image 3 seconds before the current time point). That is, in the past, the image was taken at a different time from the current image capture time. When the tracking function is enabled, the second face detecting unit 112 performs face sensing on the image (past image) read from the first storage unit 104. The second face detecting unit 112 outputs the past image and the sensing result obtained by the face sensing to the extracting unit 114. In the sensing result, the presence or absence of a human face is included, and the position information (second position information) is included in the case where a human face exists in the past image. The second position information is, for example, information indicating an area of the face. When the tracking function is disabled, the second face detecting unit 112 outputs the past video to the extracting unit 114 without performing face sensing.

人檢測部113經由第2受理部102而自外部終端50接收外部終端50所拍攝之即時影像(輸入影像)。人檢測部113於跟蹤功能有效之情形時,對輸入影像進行人感測。人檢測部113將輸入影像、及由人感測而得之感測結果輸出至提取部114。於感測結果中包含人之有無、及人存在於輸入影像之情形時之該人之位置資訊(第3位置資訊)。第3位置資訊例如係表示人之區域之資訊。人檢測部113於跟蹤功能無效之情形時,不進行人感測,而將輸入影像輸出至提取部114。The human detecting unit 113 receives the live video (input video) captured by the external terminal 50 from the external terminal 50 via the second receiving unit 102. The human detecting unit 113 performs human sensing on the input image when the tracking function is valid. The human detecting unit 113 outputs the input image and the sensing result sensed by the person to the extracting unit 114. The sensing result includes the presence or absence of the person and the position information of the person (the third position information) when the person exists in the input image. The third location information is, for example, information indicating a region of a person. When the tracking function is disabled, the human detecting unit 113 outputs the input image to the extracting unit 114 without performing human sensing.

提取部114係以對影像實施修剪,裁切該影像之一部分之方式構成。The extracting unit 114 is configured to trim the image and cut one of the images.

提取部114於跟蹤功能無效之情形時,基於與當前影像、過去影像及輸入影像之各者對應之顯示規定資訊,對當前影像、過去影像及輸入影像進行成為顯示對象之區域之裁切,且視需要進行縮小。When the tracking function is disabled, the extraction unit 114 performs cropping of the region to be displayed on the current image, the past image, and the input image based on the display predetermined information corresponding to each of the current image, the past image, and the input image, and Zoom out as needed.

提取部114於跟蹤功能有效之情形時,基於與當前影像、過去影像及輸入影像之各者對應之位置資訊(第1~第3位置資訊之任一者)實施修剪,對於當前影像、過去影像及輸入影像,裁切成為顯示對象之區域。具體而言,提取部114以位置資訊所示之人或面部之區域為中心,基於對應之顯示規定資訊所包含之裁切尺寸而進行修剪。提取部114視需要以顯示規定資訊所包含之縮小率將修剪後之影像縮小。When the tracking function is enabled, the extraction unit 114 performs cropping based on the position information (any of the first to third position information) corresponding to each of the current image, the past image, and the input image, and the current image and the past image. And input the image, and cut into the area to be displayed. Specifically, the extraction unit 114 performs cropping based on the crop size included in the corresponding display specification information centering on the area of the person or face indicated by the position information. The extraction unit 114 reduces the cropped image by the reduction ratio included in the display predetermined information as needed.

合成部115以於顯示終端30顯示經過修剪且依需要縮小之各影像之方式,根據成為顯示對象之影像之合計張數及影像之種類中至少一者,且基於配置資訊而決定畫面分割及畫面佈局。具體而言,合成部115根據合計張數及影像之種類中至少一者求出畫面之分割數(除下述按鈕顯示畫面以外之分割數),決定與分割數相應之畫面佈局。合成部115依照所求出之畫面佈局,將各影像合成(排列),產生1個合成影像。例如,合成部115於使用合計張數之情形時,合計張數成為分割數。又,合成部115於使用種類之情形時,根據所拍攝之終端及拍攝時刻而判別成為顯示對象之影像之種類,特定出顯示對象之影像,根據所特定出之影像之種類數而求出分割數。The synthesizing unit 115 determines at least one of the total number of images to be displayed and the type of the video, and determines the screen division and the screen based on the arrangement information, so that the display terminal 30 displays the respective images that have been trimmed and reduced as needed. layout. Specifically, the composition unit 115 determines the number of divisions of the screen (the number of divisions other than the button display screen described below) based on at least one of the total number of sheets and the type of the image, and determines the screen layout corresponding to the number of divisions. The synthesizing unit 115 synthesizes (arranges) the respective images in accordance with the obtained screen layout to generate one synthesized video. For example, when the combining unit 115 uses the total number of sheets, the total number of sheets becomes the number of divisions. Further, when the type of use is used, the synthesizing unit 115 determines the type of the image to be displayed based on the photographed terminal and the photographing time, specifies the image to be displayed, and obtains the segmentation based on the number of types of the specified image. number.

合成部115經由通信部107及控制裝置20而將所產生之合成影像發送至與作為自呼叫部106發送之控制信號之輸出目標的顯示終端30相同之顯示終端30。合成部115於發送合成影像時,對合成影像進行編碼(encode),發送經編碼之合成影像。再者,經編碼之合成影像係作為影像信號發送。The synthesizing unit 115 transmits the generated synthesized video to the display terminal 30 which is the same as the display terminal 30 which is the output destination of the control signal transmitted from the calling unit 106 via the communication unit 107 and the control device 20. The synthesizing unit 115 encodes the synthesized video when transmitting the synthesized video, and transmits the encoded synthesized video. Furthermore, the encoded synthetic image is transmitted as a video signal.

再者,提取部114亦可以基於位置資訊,裁切包含所感測到之人或面部之最小之區域之方式進行修剪。於該情形時,提取部114對修剪後之影像(裁切之影像)之尺寸與顯示修剪後之影像之畫面之尺寸進行比較。提取部114根據比較結果而進行修剪後之影像之縮小。提取部114於根據比較結果,修剪後之影像之尺寸與畫面之尺寸相同之情形時,不進行縮小,設為原本之尺寸(等倍)。Furthermore, the extracting unit 114 may perform cropping in such a manner that the smallest area including the sensed person or face is cut based on the position information. In this case, the extracting unit 114 compares the size of the trimmed image (the cropped image) with the size of the screen displaying the trimmed image. The extraction unit 114 performs the reduction of the image after the cropping based on the comparison result. When the size of the image after trimming is the same as the size of the screen based on the comparison result, the extraction unit 114 does not perform the reduction and sets the original size (equal magnification).

通信部107包含用以經由控制裝置20與顯示終端30進行通信之通信介面。於本實施形態中,通信部107以可於大廳對講機10與顯示終端30之間雙向傳送聲音信號及控制信號之方式,構成為可與顯示終端30之間雙向通信。通信部107係以將自影像處理部103輸出之合成影像發送至顯示終端30之方式構成。The communication unit 107 includes a communication interface for communicating with the display terminal 30 via the control device 20. In the present embodiment, the communication unit 107 is configured to be capable of bidirectional communication with the display terminal 30 so that the audio signal and the control signal can be transmitted bidirectionally between the hall intercom 10 and the display terminal 30. The communication unit 107 is configured to transmit the synthesized video output from the image processing unit 103 to the display terminal 30.

其次,對控制裝置20進行說明。如圖1所示,控制裝置20包含通信部21。通信部21係用以與大廳對講機10及顯示終端30進行通信之通信介面。通信部21當自大廳對講機10接收到控制信號或合成影像時,將所接收之控制信號或合成影像發送至顯示終端30。Next, the control device 20 will be described. As shown in FIG. 1, the control device 20 includes a communication unit 21. The communication unit 21 is a communication interface for communicating with the hall interphone 10 and the display terminal 30. When receiving the control signal or the composite image from the hall interphone 10, the communication unit 21 transmits the received control signal or composite image to the display terminal 30.

其次,對顯示終端30進行說明。如圖1所示,顯示終端30包含通信部31、影像受理部32、顯示部33、操作部34及控制部35。Next, the display terminal 30 will be described. As shown in FIG. 1, the display terminal 30 includes a communication unit 31, a video receiving unit 32, a display unit 33, an operation unit 34, and a control unit 35.

通信部31係用以經由控制裝置20與大廳對講機10進行通信之通信介面。通信部31係以接收自大廳對講機10之通信部107發送之合成影像之方式構成。於本實施形態中,通信部31係以可於大廳對講機10與顯示終端30之間雙向傳送聲音信號及控制信號之方式,構成為可與大廳對講機10之間雙向通信。The communication unit 31 is a communication interface for communicating with the hall walkie-talkie 10 via the control device 20. The communication unit 31 is configured to receive the synthesized video transmitted from the communication unit 107 of the hall interphone 10. In the present embodiment, the communication unit 31 is configured to be capable of bidirectional communication with the hall intercom 10 so that the audio signal and the control signal can be transmitted bidirectionally between the hall intercom 10 and the display terminal 30.

影像受理部32係以當受理自大廳對講機10發送之影像(經編碼之合成影像)時,使顯示部33顯示影像之方式構成。影像受理部32對經編碼之合成影像實施解碼,將合成影像解碼。影像受理部32使顯示部33顯示解碼後之合成影像。再者,影像受理部32亦可根據顯示部33之畫面尺寸將解碼後之合成影像放大或縮小。The image receiving unit 32 is configured to cause the display unit 33 to display an image when the image (coded composite image) transmitted from the hall intercom 10 is received. The video accepting unit 32 decodes the encoded synthesized video and decodes the synthesized video. The image receiving unit 32 causes the display unit 33 to display the decoded synthesized image. Furthermore, the image receiving unit 32 may enlarge or reduce the decoded synthesized image according to the screen size of the display unit 33.

顯示部33係以顯示經影像受理部32處理之合成影像之方式構成。顯示部33例如為液晶顯示器。此處,於顯示終端30包含觸控面板顯示器之情形時,觸控面板顯示器兼作顯示部33與操作部34。The display unit 33 is configured to display a synthesized image processed by the image receiving unit 32. The display unit 33 is, for example, a liquid crystal display. Here, when the display terminal 30 includes a touch panel display, the touch panel display doubles as the display unit 33 and the operation unit 34.

操作部34係以受理使用者(此處為住戶內之居住者)之操作之方式構成。當於通信部31接收到用以呼叫居住者之控制信號之狀態下,操作部34被進行特定操作(例如按下操作)時,成為大廳對講機10與顯示終端30之間可進行聲音通話之狀態。The operation unit 34 is configured to accept the operation of the user (here, the occupant in the household). When the communication unit 31 receives a control signal for calling the occupant, the operation unit 34 performs a specific operation (for example, a pressing operation), and becomes a state in which a voice call can be made between the hall intercom 10 and the display terminal 30. .

控制部35係以控制顯示終端30之各部之方式構成。控制部35以包含處理器及記憶體之微電腦(電腦)為主構成。微電腦藉由以處理器執行記憶體所記憶之程式,而作為控制部35發揮功能。程式可預先寫入記憶體,亦可通過電信線路提供,或記錄於記憶卡等記憶媒體中提供。The control unit 35 is configured to control the respective units of the display terminal 30. The control unit 35 is mainly composed of a microcomputer (computer) including a processor and a memory. The microcomputer functions as the control unit 35 by executing a program stored in the memory by the processor. The program can be written to the memory in advance, or it can be provided via a telecommunication line or recorded on a memory card such as a memory card.

此處,對以顯示終端30顯示之影像之畫面佈局進行說明。於本實施形態之對講機系統1中,顯示終端30以圖2所示之顯示畫面G10之畫面佈局顯示當前影像、過去影像及輸入影像之3種影像。Here, the screen layout of the image displayed on the display terminal 30 will be described. In the walkie-talkie system 1 of the present embodiment, the display terminal 30 displays three types of images of the current image, the past image, and the input image in the screen layout of the display screen G10 shown in FIG.

顯示畫面G10包含主畫面G11、2個副畫面(第1副畫面G12、第2副畫面G13)及按鈕顯示畫面G14。The display screen G10 includes a main screen G11, two sub-screens (a first sub-screen G12, a second sub-screen G13), and a button display screen G14.

主畫面G11係用以顯示當前影像之畫面。第1副畫面G12係用以顯示過去影像之畫面。第1副畫面G12之尺寸小於主畫面G11之尺寸。第2副畫面G13係用以顯示輸入影像之畫面。第2副畫面G13之尺寸小於主畫面G11之尺寸,與第1副畫面G12之尺寸大致相同。The main screen G11 is used to display the current image. The first sub-screen G12 is a screen for displaying past images. The size of the first sub-picture G12 is smaller than the size of the main screen G11. The second sub-picture G13 is a screen for displaying an input image. The size of the second sub-screen G13 is smaller than the size of the main screen G11, and is substantially the same as the size of the first sub-screen G12.

按鈕顯示畫面G14於顯示終端30包含觸控面板顯示器之情形時,顯示操作按鈕等。於按鈕顯示畫面G14中,顯示例如操作選單按鈕、畫面切換按鈕等。當按下操作選單按鈕時,顯示部33顯示1個以上之可於顯示終端30進行操作之操作名稱及與其對應之按鈕之組。當按下畫面切換按鈕時,例如切換以主畫面G11與第1副畫面G12顯示之影像。具體而言,當按下畫面切換按鈕時,分別於主畫面G11中顯示過去影像,於第1副畫面G12中顯示當前影像。再者,成為切換之對象之畫面可為主畫面G11與第2副畫面G13,亦可為第1副畫面G12與第2副畫面G13。又,於存在複數台外部終端50之情形時,當按下畫面切換按鈕時,亦可將以第2副畫面G13顯示之影像自複數個外部終端50中之一個外部終端50所拍攝之影像切換為另一個外部終端50所拍攝之影像。The button display screen G14 displays an operation button or the like when the display terminal 30 includes a touch panel display. In the button display screen G14, for example, an operation menu button, a screen switching button, and the like are displayed. When the operation menu button is pressed, the display unit 33 displays one or more sets of operation names that can be operated by the display terminal 30 and buttons corresponding thereto. When the screen switching button is pressed, for example, the image displayed on the main screen G11 and the first sub-screen G12 is switched. Specifically, when the screen switching button is pressed, the past video is displayed on the main screen G11, and the current video is displayed on the first sub-screen G12. Further, the screen to be switched may be the main screen G11 and the second sub-screen G13, or may be the first sub-screen G12 and the second sub-screen G13. Moreover, when there is a plurality of external terminals 50, when the screen switching button is pressed, the image displayed by the second sub-screen G13 can be switched from the image captured by one of the plurality of external terminals 50. An image taken for another external terminal 50.

(2)動作 以下,對本實施形態之對講機系統1之動作進行說明。以下,對來訪者對大廳對講機10之呼叫部106進行特定操作之情形進行說明。(2) Operation Hereinafter, the operation of the walkie-talkie system 1 of the present embodiment will be described. Hereinafter, a case where the visitor performs a specific operation on the calling unit 106 of the hall walkie-talkie 10 will be described.

首先,當大廳對講機10之呼叫部106受理特定操作時,大廳對講機10使攝像終端40開始攝像動作。攝像終端40將所拍攝之影像輸出至大廳對講機10。First, when the calling unit 106 of the hall intercom 10 accepts a specific operation, the hall intercom 10 causes the imaging terminal 40 to start an imaging operation. The imaging terminal 40 outputs the captured image to the hall walkie-talkie 10.

大廳對講機10之第1受理部101將攝像終端40所拍攝之影像寫入第1記憶部104,且作為當前影像輸出至影像處理部103。The first receiving unit 101 of the hall intercom 10 writes the image captured by the imaging terminal 40 to the first storage unit 104, and outputs it as the current video to the video processing unit 103.

第1面部檢測部111於跟蹤功能有效之情形時,對當前影像進行面部感測。具體而言,第1面部檢測部111對攝像終端40所拍攝之每一影像圖框進行面部感測。第1面部檢測部111將當前影像、及由面部感測而得之感測結果輸出至提取部114。第1面部檢測部111於跟蹤功能無效之情形時,不進行面部感測,而將當前影像輸出至提取部114。The first face detecting unit 111 performs face sensing on the current image when the tracking function is enabled. Specifically, the first face detecting unit 111 performs face sensing on each of the image frames captured by the imaging terminal 40. The first face detecting unit 111 outputs the current image and the sensing result sensed by the face to the extracting unit 114. When the tracking function is disabled, the first face detecting unit 111 outputs the current image to the extracting unit 114 without performing face sensing.

第2面部檢測部112自第1記憶部104沿時間序列讀出自當前時點向前回溯特定時間之過去影像(例如較當前時點早3秒之影像)。第2面部檢測部112於跟蹤功能有效之情形時,對自第1記憶部104讀出之過去影像進行面部感測。具體而言,第2面部檢測部112對沿時間序列讀出之過去影像之每一影像圖框進行面部檢測。第2面部檢測部112將過去影像及由面部感測而得之感測結果輸出至提取部114。第2面部檢測部112於跟蹤功能無效之情形時,不進行面部感測,而將過去影像輸出至提取部114。The second face detecting unit 112 reads out from the first memory unit 104 in the time series the past image of the past time from the current time point (for example, an image 3 seconds earlier than the current time point). When the tracking function is enabled, the second face detecting unit 112 performs face sensing on the past image read from the first storage unit 104. Specifically, the second face detecting unit 112 performs face detection on each of the image frames of the past images read in time series. The second face detecting unit 112 outputs the past image and the sensing result obtained by the face sensing to the extracting unit 114. When the tracking function is disabled, the second face detecting unit 112 outputs the past video to the extracting unit 114 without performing face sensing.

人檢測部113經由第2受理部102而自外部終端50接收外部終端50所拍攝之即時之輸入影像。人檢測部113於跟蹤功能有效之情形時,對輸入影像進行人感測。人檢測部113將輸入影像、及由人感測而得之感測結果輸出至提取部114。人檢測部113於跟蹤功能無效之情形時,不進行人感測,而將輸入影像輸出至提取部114。The human detecting unit 113 receives an instant input image captured by the external terminal 50 from the external terminal 50 via the second receiving unit 102. The human detecting unit 113 performs human sensing on the input image when the tracking function is valid. The human detecting unit 113 outputs the input image and the sensing result sensed by the person to the extracting unit 114. When the tracking function is disabled, the human detecting unit 113 outputs the input image to the extracting unit 114 without performing human sensing.

提取部114於跟蹤功能無效之情形時,基於與當前影像、過去影像及輸入影像各者對應之顯示規定資訊,對當前影像、過去影像及輸入影像裁切成為顯示對象之區域。具體而言,於針對當前影像之顯示規定資訊中,包含規定裁切位置之第1座標(a1,b1)、及橫向之長度L1、縱向之長度H1。於針對過去影像之顯示規定資訊中,包含規定裁切位置之第2座標(c1,d1)、及橫向之長度L2、縱向之長度H2。於針對輸入影像之顯示規定資訊中,包含規定裁切位置之第3座標(e1,f1)、及橫向之長度L3、縱向之長度H3。如圖3A所示,提取部114對於當前影像G20,裁切以第1座標(a1,b1)為起點、且以橫向之長度L1及縱向之長度H1所規定之區域作為顯示範圍G25。如圖3B所示,提取部114對於過去影像G21,裁切以第2座標(c1,d1)為起點、且以橫向之長度L2及縱向之長度H2所規定之區域作為顯示範圍G26。如圖3C所示,提取部114對於輸入影像G22,裁切以第3座標(e1,f1)為起點、且以橫向之長度L3及縱向之長度H3所規定之區域作為顯示範圍G27。提取部114視需要依照對應之顯示規定資訊之縮小率,對經裁切之顯示範圍G25~G27(經修剪之當前影像、過去影像及輸入影像)進行縮小。再者,於本實施形態中,不進行縮小而設為等倍。When the tracking function is disabled, the extraction unit 114 crops the current image, the past image, and the input image into an area to be displayed based on the display predetermined information corresponding to each of the current image, the past image, and the input image. Specifically, the display specification information for the current image includes the first coordinate (a1, b1) defining the cutting position, the length L1 in the lateral direction, and the length H1 in the vertical direction. The display specification information for the past image includes the second coordinate (c1, d1) specifying the cutting position, the length L2 in the lateral direction, and the length H2 in the vertical direction. The display information for the input image includes the third coordinate (e1, f1) of the specified cutting position, the horizontal length L3, and the longitudinal length H3. As shown in FIG. 3A, the extraction unit 114 cuts a region defined by the first coordinate (a1, b1) from the current image G20 and defined by the horizontal length L1 and the longitudinal length H1 as the display range G25. As shown in FIG. 3B, the extraction unit 114 cuts a region defined by the second coordinate (c1, d1) as a starting point and a length L2 in the lateral direction and a length H2 in the vertical direction as the display range G26. As shown in FIG. 3C, the extraction unit 114 cuts the region defined by the third coordinate (e1, f1) as the starting point and the length L3 in the lateral direction and the length H3 in the vertical direction as the display range G27. The extracting unit 114 reduces the cropped display ranges G25 to G27 (the cropped current image, the past image, and the input image) as needed in accordance with the reduction ratio of the corresponding display predetermined information. Furthermore, in the present embodiment, the magnification is set to be equal to no reduction.

提取部114於跟蹤功能有效之情形時,基於與當前影像、過去影像及輸入影像各者對應之位置資訊(第1~第3位置資訊之任一者)實施修剪,對當前影像、過去影像及輸入影像裁切成為顯示對象之區域。具體而言,如圖4A所示,提取部114對於當前影像G20,基於第1位置資訊而求出當前影像所包含之面部之區域G30,裁切以區域G30為中心、且以橫向之長度L1及縱向之長度H1所規定之區域作為顯示範圍G35。如圖4B所示,提取部114對於過去影像G21,基於第2位置資訊而求出過去影像所包含之面部之區域G31,裁切以區域G31為中心、且以橫向之長度L2及縱向之長度H2所規定之區域作為顯示範圍G36。如圖4C所示,提取部114對於輸入影像G22,基於第3位置資訊而求出輸入影像所包含之人之區域G32,裁切以區域G32為中心、且以橫向之長度L3及縱向之長度H3所規定之區域作為顯示範圍G37。When the tracking function is enabled, the extraction unit 114 performs cropping based on the position information (any of the first to third position information) corresponding to each of the current image, the past image, and the input image, and the current image and the past image and The input image is cropped to become the area of the display object. Specifically, as shown in FIG. 4A, the extraction unit 114 obtains the region G30 of the face included in the current image based on the first position information for the current image G20, and cuts the length L1 centered on the region G30. The area defined by the length H1 of the longitudinal direction is defined as the display range G35. As shown in FIG. 4B, the extraction unit 114 obtains the region G31 of the face included in the past image based on the second position information with respect to the past image G21, and cuts the length L2 and the length of the vertical direction centering on the region G31. The area specified by H2 is used as the display range G36. As shown in FIG. 4C, the extraction unit 114 obtains the region G32 of the person included in the input image based on the third position information on the input image G22, and cuts the length L3 and the length of the vertical direction centering on the region G32. The area specified by H3 is used as the display range G37.

提取部114於跟蹤功能有效之情形時,若根據第1面部檢測部111之感測結果,當前影像中之面部之位置自區域G30移動至區域G40,則裁切以移動後之面部之區域G40為中心、且以橫向之長度L1及縱向之長度H1所規定之區域作為顯示範圍G35(參照圖4D)。提取部114於跟蹤功能有效之情形時,若根據第2面部檢測部112之感測結果,過去影像中之面部之位置自區域G31移動至區域G41,則裁切以移動後之面部之區域G41為中心、且以橫向之長度L2及縱向之長度H2所規定之區域作為顯示範圍G36(參照圖4E)。提取部114於跟蹤功能有效之情形時,若根據人檢測部113之感測結果,輸入影像中之人之位置自區域G32移動至區域G42,則裁切以移動後之人之區域G42為中心、且以橫向之長度L3及縱向之長度H3所規定之區域作為顯示範圍G37(參照圖4F)。When the tracking function is enabled, the extraction unit 114 changes the position of the face in the current image from the region G30 to the region G40 according to the sensing result of the first face detecting unit 111, and then crops the region G40 of the moved face. A region defined by the length L1 in the lateral direction and the length H1 in the longitudinal direction is defined as the display range G35 (see FIG. 4D). When the tracking function is enabled, the extraction unit 114 shifts the position of the face in the past image from the region G31 to the region G41 based on the sensing result of the second face detecting unit 112, and cuts the region G41 of the face after the movement. A region defined by the length L2 in the lateral direction and the length H2 in the longitudinal direction is the display range G36 (see FIG. 4E). When the tracking function is enabled, the extraction unit 114 moves the position of the person in the input image from the area G32 to the area G42 according to the sensing result of the human detecting unit 113, and then cuts the area G42 of the moved person as the center. The area defined by the lateral length L3 and the longitudinal length H3 is defined as the display range G37 (see FIG. 4F).

提取部114視需要依照對應之顯示規定資訊之縮小率,對所裁切之顯示範圍G35~G37(經修剪之當前影像、過去影像及輸入影像)進行縮小。再者,於本實施形態中,不進行縮小而設為等倍。The extraction unit 114 reduces the cropped display ranges G35 to G37 (the cropped current image, the past image, and the input image) in accordance with the reduction ratio of the corresponding display predetermined information. Furthermore, in the present embodiment, the magnification is set to be equal to no reduction.

合成部115根據合計張數及影像之種類中至少一者而求出畫面之分割數,從而決定與分割數相應之畫面佈局。此處,除按鈕顯示畫面以外之分割數為3,求出顯示畫面G10作為與其對應之畫面佈局。The synthesizing unit 115 obtains the number of divisions of the screen based on at least one of the total number of sheets and the type of the image, and determines the screen layout corresponding to the number of divisions. Here, the number of divisions other than the button display screen is three, and the display screen G10 is obtained as the screen layout corresponding thereto.

合成部115基於配置資訊而將經修剪且視需要縮小之各影像合成(排列),產生1個合成影像。具體而言,合成部115以將各影像顯示於顯示畫面G10中所對應之畫面(主畫面G11、第1副畫面G12及第2副畫面G13之任一畫面)之方式,由各影像產生1個合成影像。例如,於跟蹤功能無效之情形時,合成部115由視需要縮小之顯示範圍G25~G27產生1個合成影像(參照圖3D)。再者,於本實施形態中,如上所述,顯示範圍G25~G27未進行縮小。合成部115將產生之合成影像發送至顯示終端30。The synthesizing unit 115 synthesizes (arranges) the respective images that have been cropped and reduced as needed based on the arrangement information, thereby generating one synthesized image. Specifically, the synthesizing unit 115 generates 1 for each video so that each video is displayed on the screen corresponding to the display screen G10 (the main screen G11, the first sub-screen G12, and the second sub-screen G13). A composite image. For example, when the tracking function is invalid, the synthesizing unit 115 generates one synthesized image from the display ranges G25 to G27 that are reduced as needed (see FIG. 3D). Furthermore, in the present embodiment, as described above, the display ranges G25 to G27 are not reduced. The synthesizing unit 115 transmits the generated synthesized image to the display terminal 30.

顯示終端30藉由於顯示部33顯示合成影像,而可將1個畫面分割,顯示3種影像。The display terminal 30 can divide one screen and display three types of images by displaying the synthesized image on the display unit 33.

(3)實施形態1之變化例 於上述實施形態中,於大廳對講機10中跟蹤功能無效之情形時,顯示部33亦可將指示變更裁切位置之滾動按鈕與合成影像共同顯示。具體而言,於分別顯示各影像(當前影像、過去影像及輸入影像)之畫面中,顯示滾動按鈕(參照圖5A)。於主畫面G11中,分別顯示將裁切位置向左變更之第1滾動按鈕SC1、及向右變更之第2滾動按鈕SC2。於第1副畫面G12中,分別顯示將裁切位置向上變更之第3滾動按鈕SC3、及向左變更之第4滾動按鈕SC4、將裁切位置向右變更之第5滾動按鈕SC5、及向下變更之第6滾動按鈕SC6。於第2副畫面G13中,分別顯示將裁切位置向上變更之第7滾動按鈕SC7、及左向變更之第8滾動按鈕SC8、將裁切位置向右變更之第9滾動按鈕SC9、及向下變更之第10滾動按鈕SC10。(3) Modification of the first embodiment In the above embodiment, when the tracking function in the hall intercom 10 is invalid, the display unit 33 may display the scroll button indicating the change of the cutting position together with the composite image. Specifically, a scroll button is displayed on a screen in which each image (current image, past image, and input image) is displayed (see FIG. 5A). On the main screen G11, the first scroll button SC1 that changes the cutting position to the left and the second scroll button SC2 that changes to the right are respectively displayed. In the first sub-screen G12, a third scroll button SC3 that changes the cutting position upward, a fourth scroll button SC4 that changes to the left, a fifth scroll button SC5 that changes the cutting position to the right, and a direction are respectively displayed. The sixth scroll button SC6 is changed. In the second sub-screen G13, the seventh scroll button SC7 that changes the cutting position upward, the eighth scroll button SC8 that changes leftward, the nineth scroll button SC9 that changes the cutting position to the right, and the direction are respectively displayed. The 10th scroll button SC10 is changed.

例如,當第5滾動按鈕SC5被按下時,提取部114根據按下之時間或按下之次數,將成為裁切顯示範圍之基準之第2座標(c1,d1)變更為座標(c2,d1)。此處,c2為大於c1之值。提取部114裁切以座標(c2,d1)為起點、且以橫向之長度L2及縱向之長度H2所規定之區域作為顯示範圍G26(參照圖5B)。For example, when the fifth scroll button SC5 is pressed, the extraction unit 114 changes the second coordinate (c1, d1) which is the reference of the cropping display range to the coordinate (c2, based on the time of pressing or the number of times of pressing). D1). Here, c2 is a value larger than c1. The extraction unit 114 cuts a region defined by the coordinates (c2, d1) as the starting point and the length L2 in the lateral direction and the length H2 in the vertical direction as the display range G26 (see FIG. 5B).

又,於大廳對講機10中跟蹤功能無效之情形時,顯示部33亦可將對攝像終端40及外部終端50之至少1個終端指示變更拍攝範圍及拍攝位置之至少1者之變更指示按鈕與合成影像共同顯示。例如,當對攝像終端40指示拍攝位置之變更時,影像處理部103變更攝像終端40之鏡頭之朝向。藉此,可變更攝像終端40之拍攝範圍。影像處理部103自變更了拍攝範圍後之攝像終端40所拍攝之影像裁切顯示範圍G25或顯示範圍G26。又,當對外部終端50指示拍攝位置之變更時,影像處理部103變更外部終端50之鏡頭之朝向。藉此,可變更外部終端50之拍攝範圍。影像處理部103自變更了拍攝範圍後之外部終端50所拍攝之影像裁切顯示範圍G27。Further, when the tracking function is disabled in the hall intercom 10, the display unit 33 may instruct at least one of the imaging terminal 40 and the external terminal 50 to change the indication button and the combination of at least one of the imaging range and the imaging position. The images are displayed together. For example, when the imaging terminal 40 is instructed to change the imaging position, the video processing unit 103 changes the orientation of the lens of the imaging terminal 40. Thereby, the imaging range of the imaging terminal 40 can be changed. The image processing unit 103 cuts the display range G25 or the display range G26 from the image captured by the imaging terminal 40 after the imaging range is changed. Further, when the external terminal 50 is instructed to change the imaging position, the video processing unit 103 changes the orientation of the lens of the external terminal 50. Thereby, the shooting range of the external terminal 50 can be changed. The image processing unit 103 cuts the display range G27 from the image captured by the external terminal 50 after changing the imaging range.

又,跟蹤功能係設為於攝像終端40及外部終端50所拍攝之各影像之範圍內跟蹤被攝體之功能。跟蹤功能亦可以如下方式控制該終端:於被攝體成為影像之範圍外之情形時,對於拍攝該影像之攝像終端40或外部終端50,變更拍攝範圍及拍攝位置之至少1者。或,亦可設置對該終端以變更拍攝範圍及拍攝位置之至少1者之方式進行指示的按鈕。Further, the tracking function is a function of tracking the subject within the range of each image captured by the imaging terminal 40 and the external terminal 50. The tracking function may also control the terminal in such a manner that when the subject is out of the range of the image, at least one of the imaging range and the imaging position is changed for the imaging terminal 40 or the external terminal 50 that has captured the image. Alternatively, a button for instructing the terminal to change at least one of the shooting range and the shooting position may be provided.

如以上說明,可謂影像處理部103根據使用者之指示,對於當前影像、過去影像及輸入影像之至少1種影像,調整拍攝範圍、拍攝位置及顯示範圍中至少1者。As described above, the image processing unit 103 adjusts at least one of the imaging range, the imaging position, and the display range for at least one of the current image, the past image, and the input image in accordance with an instruction from the user.

於上述實施形態中,構成為於跟蹤功能無效之情形時,將藉由提取部114所裁切之各影像視需要縮小,但並不限定於該構成。亦可於跟蹤功能無效之情形時,將藉由提取部114所裁切之各影像視需要放大。例如,將要裁切之範圍設為小於所對應之畫面(主畫面G11、第1副畫面G12及第2副畫面G13)之尺寸之範圍。此時,顯示規定資訊包含將藉由修剪功能所裁切之影像以收入由顯示終端30所顯示之畫面中之方式放大的放大率。提取部114於所裁切之影像之尺寸與所對應之畫面之尺寸相比可放大之情形時,以對應之顯示規定資訊所包含之放大率將將所裁切之影像放大。或,提取部114亦可具有將影像縮小之功能與放大之功能之兩者。In the above embodiment, when the tracking function is invalid, the images cut by the extraction unit 114 are reduced as needed, but the configuration is not limited thereto. Alternatively, when the tracking function is disabled, each image cut by the extraction unit 114 may be enlarged as needed. For example, the range to be cropped is set to be smaller than the size of the corresponding screen (main screen G11, first sub-screen G12, and second sub-screen G13). At this time, the display specification information includes an enlargement ratio of the image cut by the trimming function to be enlarged in a manner displayed by the display terminal 30. When the size of the cropped image is larger than the size of the corresponding screen, the extracting unit 114 enlarges the cropped image by the magnification included in the corresponding display predetermined information. Alternatively, the extraction unit 114 may have both a function of reducing the image and a function of amplifying.

於上述實施形態中,攝像終端40構成為不包含於大廳對講機10中,但並不限定於該構成。大廳對講機10亦可為包含攝像終端40之構成。同樣地,大廳對講機10亦可為包含外部終端50之構成。In the above embodiment, the imaging terminal 40 is not included in the hall intercom 10, but is not limited to this configuration. The hall intercom 10 may also be configured to include the camera terminal 40. Similarly, the hall intercom 10 may be configured to include the external terminal 50.

於上述實施形態中,構成為大廳對講機10包含影像處理部103,但並不限定於該構成。可為控制裝置20包含影像處理部103之構成,亦可為顯示終端30包含影像處理部103之構成。例如,於控制裝置20包含影像處理部103之情形時,控制裝置20除包含影像處理部103以外,還包含自大廳對講機10受理攝像終端40所拍攝之影像之受理部(相當於第1受理部101)、及通信部21。In the above embodiment, the hall intercom 10 includes the video processing unit 103, but the configuration is not limited thereto. The control device 20 may include a video processing unit 103, or the display terminal 30 may include a video processing unit 103. For example, when the control device 20 includes the video processing unit 103, the control device 20 includes, in addition to the video processing unit 103, an accepting unit that receives an image captured by the imaging terminal 40 from the hall interphone 10 (corresponding to the first receiving unit). 101) and the communication unit 21.

又,影像處理部103並非必須由大廳對講機10、控制裝置20及顯示終端30之任一個終端(裝置)構成。影像處理部103之功能亦可分散於複數個終端(裝置)。例如,影像處理部103之功能亦可分散設置於大廳對講機10、控制裝置20及顯示終端30。Further, the video processing unit 103 does not have to be constituted by any one of the hall interphone 10, the control device 20, and the display terminal 30 (device). The function of the image processing unit 103 can also be distributed among a plurality of terminals (devices). For example, the functions of the image processing unit 103 may be distributed to the hall interphone 10, the control device 20, and the display terminal 30.

於上述實施形態中,構成為對各影像(當前影像、過去影像及輸入影像)具有跟蹤功能,但並不限定於該構成。只要對當前影像、過去影像及輸入影像中至少1種影像具有跟蹤功能即可。In the above embodiment, the image has a tracking function for each image (current image, past image, and input image), but the configuration is not limited thereto. As long as at least one of the current image, the past image, and the input image has a tracking function.

(4)效果 如以上說明,於本實施形態及變化例之對講機系統中,對當前影像、過去影像及輸入影像實施修剪。因此,即便於將該等影像一次顯示於顯示畫面G10之情形時,與未實施修剪之情形相比,各影像更加容易觀看。(4) Effects As described above, in the walkie-talkie system of the present embodiment and the modified example, the current image, the past image, and the input image are trimmed. Therefore, even when the images are displayed on the display screen G10 at a time, each image is more easily viewed than in the case where the trimming is not performed.

(實施形態2) 於本實施形態中,與實施形態1之不同之處在於:由顯示終端(對講機母機)進行與影像相關之處理。以下,以與實施形態1之不同之處為中心對本實施形態之對講機系統1A進行說明。再者,對與實施形態1相同之構成要素標註相同符號並適當省略說明。(Embodiment 2) In the present embodiment, the difference from the first embodiment is that the display terminal (the walkie-talkie master) performs processing related to the video. Hereinafter, the walkie-talkie system 1A of the present embodiment will be described focusing on differences from the first embodiment. The same components as those in the first embodiment are denoted by the same reference numerals, and their description will be omitted as appropriate.

如圖6所示,本實施形態之對講機系統1A包含顯示終端30A、及作為對講機子機之玄關子機60。於本實施形態中,以對講機系統1A為集體住宅用對講機系統之情形為例進行說明。As shown in Fig. 6, the walkie-talkie system 1A of the present embodiment includes a display terminal 30A and a console 60 as a walkie-talkie handset. In the present embodiment, a case where the walkie-talkie system 1A is a collective house walkie-talkie system will be described as an example.

顯示終端30A與實施形態1同樣為設置於集體住宅之住戶內(室內)之對講機母機。玄關子機60設置於住戶之玄關。顯示終端30A與玄關子機60構成為可相互通信。Similarly to the first embodiment, the display terminal 30A is a walkie-talkie machine installed in a household (indoor) of a collective house. The entrance sub-machine 60 is set at the entrance of the household. The display terminal 30A and the entrance sub-machine 60 are configured to be communicable with each other.

玄關子機60包含攝像終端40。The entrance sub-machine 60 includes an imaging terminal 40.

於本實施形態中,將攝像終端40之攝像區域(視野)設置為玄關子機60之前方,以便於來訪者操作玄關子機60時至少可拍攝來訪者之面部。又,於本實施形態中,攝像終端40係可拍攝動態圖像之相機,但亦可為拍攝靜止圖像之相機。進而,於本實施形態中,攝像終端40係拍攝彩色圖像之相機,但亦可為拍攝黑白圖像之相機。In the present embodiment, the imaging area (field of view) of the imaging terminal 40 is set to be in front of the entrance sub-machine 60 so that the visitor can at least photograph the face of the visitor when operating the entrance sub-machine 60. Further, in the present embodiment, the imaging terminal 40 is a camera that can capture a moving image, but may be a camera that captures a still image. Further, in the present embodiment, the imaging terminal 40 is a camera that captures a color image, but may be a camera that captures a black and white image.

於本實施形態之對講機系統1A中,將攝像終端40所拍攝之被攝體(來訪者等)之影像(當前影像及過去影像)顯示於顯示終端30A。In the walkie-talkie system 1A of the present embodiment, the image (current image and past image) of the subject (visitor or the like) captured by the imaging terminal 40 is displayed on the display terminal 30A.

如圖6所示,玄關子機60除包含攝像終端40以外,還包含受理部61、通信部62、呼叫部63及控制部64。As shown in FIG. 6, the entrance sub-machine 60 includes an accepting unit 61, a communication unit 62, a calling unit 63, and a control unit 64 in addition to the imaging terminal 40.

受理部61經由通信部62而將攝像終端40所拍攝之影像輸出至顯示終端30A。此時,攝像終端40所拍攝之影像係作為影像信號被輸出至顯示終端30A。The receiving unit 61 outputs the image captured by the imaging terminal 40 to the display terminal 30A via the communication unit 62. At this time, the image captured by the imaging terminal 40 is output as a video signal to the display terminal 30A.

通信部62包含用以與顯示終端30A進行通信之通信介面。於本實施形態中,通信部62以可於玄關子機60與顯示終端30A之間雙向傳送聲音信號及控制信號之方式,構成為可與顯示終端30A之間雙向地進行通信。The communication unit 62 includes a communication interface for communicating with the display terminal 30A. In the present embodiment, the communication unit 62 is configured to be capable of bidirectional communication with the display terminal 30A so that the audio signal and the control signal can be bidirectionally transmitted between the entrance sub-machine 60 and the display terminal 30A.

呼叫部63係以受理來自來訪者之用以進行呼叫之操作的方式構成。當對呼叫部63進行特定操作(例如按下操作)時,玄關子機60將用以呼叫住戶內之居住者之控制信號經由通信部62而發送至顯示終端30A。The calling unit 63 is configured to accept an operation from a visitor for making a call. When a specific operation (for example, a pressing operation) is performed on the calling unit 63, the gateway 60 transmits a control signal for calling the occupant in the household to the display terminal 30A via the communication unit 62.

控制部64係以控制玄關子機60之各部之方式構成。控制部64以包含處理器及記憶體之微電腦(電腦)為主構成。微電腦藉由使處理器執行記憶體中所記憶之程式,而作為控制部64發揮功能。程式可預先寫入記憶體,亦可通過電信線路提供,或記錄於記憶卡等記憶媒體中提供。The control unit 64 is configured to control the respective units of the entrance sub-machine 60. The control unit 64 is mainly composed of a microcomputer (computer) including a processor and a memory. The microcomputer functions as the control unit 64 by causing the processor to execute a program stored in the memory. The program can be written to the memory in advance, or it can be provided via a telecommunication line or recorded on a memory card such as a memory card.

本實施形態之顯示終端30A具有裁切攝像終端40所拍攝之影像之一部分之功能(修剪功能)。如圖6所示,本實施形態之顯示終端30A包含通信部31A、影像受理部32A、顯示部33A、操作部34A、控制部35A、第1記憶部36A及第2記憶部37A。The display terminal 30A of the present embodiment has a function of cutting a part of an image captured by the imaging terminal 40 (trimming function). As shown in FIG. 6, the display terminal 30A of the present embodiment includes a communication unit 31A, a video receiving unit 32A, a display unit 33A, an operation unit 34A, a control unit 35A, a first storage unit 36A, and a second storage unit 37A.

通信部31A係用以與玄關子機60進行通信之通信介面。通信部31A係以接收自玄關子機60之通信部62發送之合成影像之方式構成。於本實施形態中,通信部31A係以可於玄關子機60與顯示終端30A之間雙向傳送聲音信號及控制信號之方式,構成為可與玄關子機60之間雙向通信。The communication unit 31A is a communication interface for communicating with the gateway 60. The communication unit 31A is configured to receive the synthesized video transmitted from the communication unit 62 of the entrance sub-machine 60. In the present embodiment, the communication unit 31A is configured to be capable of bidirectional communication with the entry sub-machine 60 so that the audio signal and the control signal can be transmitted bidirectionally between the entrance sub-machine 60 and the display terminal 30A.

第1記憶部36A及第2記憶部37A係由選自ROM、RAM、或EEPROM等之器件構成。The first memory unit 36A and the second memory unit 37A are configured by devices selected from the group consisting of a ROM, a RAM, and an EEPROM.

第1記憶部36A以時間序列記憶攝像終端40所拍攝之影像。第2記憶部37A預先記憶與顯示攝像終端40所拍攝之被攝體(來訪者等)之影像時的各影像之配置相關之配置資訊。配置資訊包含顯示終端30A所顯示之影像之合計數量、影像之種類、以及表示成為顯示對象之各影像於一個畫面上配置之位置(例如座標位置)及尺寸的顯示相關資訊。此處,影像之種類與實施形態1同樣地包含所拍攝之終端、拍攝時刻等。第2記憶部37A與實施形態1同樣地記憶顯示規定資訊。The first storage unit 36A stores the images captured by the imaging terminal 40 in time series. The second storage unit 37A stores in advance the arrangement information relating to the arrangement of the respective images when the image of the subject (visitor or the like) captured by the imaging terminal 40 is displayed. The configuration information includes the total amount of images displayed on the display terminal 30A, the type of the image, and display related information indicating the position (for example, the coordinate position) and the size of each image to be displayed on one screen. Here, the type of the image includes the terminal to be photographed, the photographing time, and the like in the same manner as in the first embodiment. The second storage unit 37A memorizes and displays the predetermined information in the same manner as in the first embodiment.

影像受理部32A經由玄關子機60而受理攝像終端40所拍攝之影像,將所受理之影像輸出至控制部35A及第1記憶部36A。藉此,於控制部35A中可對攝像終端40所拍攝之即時影像進行處理。又,於第1記憶部36A中,可記憶攝像終端40所拍攝之影像。The image receiving unit 32A receives the image captured by the imaging terminal 40 via the pointing sub-machine 60, and outputs the received image to the control unit 35A and the first storage unit 36A. Thereby, the real-time image captured by the imaging terminal 40 can be processed by the control unit 35A. Further, in the first storage unit 36A, the image captured by the imaging terminal 40 can be stored.

控制部35A係以控制顯示終端30A之各部之方式構成。控制部35A以包含處理器及記憶體之微電腦(電腦)為主構成。微電腦藉由使處理器執行記憶體中所記憶之程式,而作為控制部35A發揮功能。程式可預先寫入記憶體,亦可通過電信線路提供,或記錄於記憶卡等記憶媒體中提供。The control unit 35A is configured to control the respective units of the display terminal 30A. The control unit 35A is mainly composed of a microcomputer (computer) including a processor and a memory. The microcomputer functions as the control unit 35A by causing the processor to execute a program stored in the memory. The program can be written to the memory in advance, or it can be provided via a telecommunication line or recorded on a memory card such as a memory card.

又,控制部35A具有對顯示終端30A所顯示之影像實施處理之影像處理部300。具體而言,對攝像終端40所拍攝之影像實施處理。又,影像處理部300具有對顯示終端30A所顯示之影像跟蹤該影像所包含之被攝體之跟蹤功能,藉由顯示終端30A之使用者(居住者)之操作而切換跟蹤功能之有效、無效。Further, the control unit 35A includes an image processing unit 300 that performs processing on the image displayed on the display terminal 30A. Specifically, processing is performed on the image captured by the imaging terminal 40. Further, the image processing unit 300 has a tracking function for tracking the image included in the image on the image displayed on the display terminal 30A, and switching the tracking function to be effective or invalid by the operation of the user (occupant) of the display terminal 30A. .

如圖6所示,影像處理部300包含第1面部檢測部301、第2面部檢測部302、提取部303及合成部304。As shown in FIG. 6, the video processing unit 300 includes a first face detecting unit 301, a second face detecting unit 302, an extracting unit 303, and a synthesizing unit 304.

第1面部檢測部301經由影像受理部32A而自玄關子機60接收攝像終端40所拍攝之即時影像(當前影像)。第1面部檢測部301於跟蹤功能有效之情形時,對當前影像進行面部感測。具體而言,第1面部檢測部301對攝像終端40所拍攝之每一影像圖框進行面部感測。第1面部檢測部301將當前影像、及由面部感測而得之感測結果輸出至提取部303。於感測結果中,包含人面部之有無,且於人面部存在於當前影像中之情形時包含第1位置資訊。第1面部檢測部301於跟蹤功能無效之情形時,不進行面部感測而將當前影像輸出至提取部303。The first face detecting unit 301 receives the live image (current image) captured by the imaging terminal 40 from the pointing device 60 via the image receiving unit 32A. When the tracking function is enabled, the first face detecting unit 301 performs face sensing on the current image. Specifically, the first face detecting unit 301 performs face sensing on each of the image frames captured by the imaging terminal 40. The first face detecting unit 301 outputs the current image and the sensing result obtained by the face sensing to the extracting unit 303. The sensing result includes the presence or absence of a human face, and includes the first position information when the human face exists in the current image. When the tracking function is disabled, the first face detecting unit 301 outputs the current video to the extracting unit 303 without performing face sensing.

第2面部檢測部302自第1記憶部36A沿時間序列讀出記憶於第1記憶部36A中且自當前時點向前回溯特定時間之影像(例如較當前時點3秒前之影像)。第2面部檢測部302於跟蹤功能有效之情形時,對自第1記憶部36A讀出之影像(過去影像)進行面部感測。具體而言,第2面部檢測部302對沿時間序列讀出之過去影像之每一影像圖框進行面部檢測。第2面部檢測部302將過去影像、及由面部感測而得之感測結果輸出至提取部303。於感測結果中,包含人面部之有無,且於人面部存在於過去影像中之情形時包含第2位置資訊。第2面部檢測部302於跟蹤功能無效之情形時,不進行面部感測,將過去影像輸出至提取部303。The second face detecting unit 302 reads out, from the first storage unit 36A, the image stored in the first storage unit 36A in the time series and backtracking from the current time point to a certain time (for example, an image 3 seconds before the current time). When the tracking function is enabled, the second face detecting unit 302 performs face sensing on the image (past image) read from the first storage unit 36A. Specifically, the second face detecting unit 302 performs face detection on each image frame of the past image read out in time series. The second face detecting unit 302 outputs the past image and the sensing result obtained by the face sensing to the extracting unit 303. The sensing result includes the presence or absence of a human face, and includes the second position information when the human face exists in the past image. When the tracking function is disabled, the second face detecting unit 302 does not perform face sensing, and outputs the past video to the extracting unit 303.

提取部303係以對影像實施修剪,裁切該影像之一部分之方式構成。The extraction unit 303 is configured to trim the image and cut one of the images.

提取部303於跟蹤功能無效之情形時,基於與當前影像及過去影像之各者對應之顯示規定資訊,對當前影像及過去影像進行成為顯示對象之區域之裁切及縮小。When the tracking function is disabled, the extraction unit 303 performs cropping and reduction of the region to be displayed on the current image and the past image based on the display specifying information corresponding to each of the current image and the past image.

提取部303於跟蹤功能有效之情形時,基於與當前影像及過去影像之各者對應之位置資訊(第1~第2位置資訊之任一者)而實施修剪,並對當前影像及過去影像裁切成為顯示對象之區域。具體而言,提取部303以位置資訊所示之面部之區域為中心,基於對應之顯示規定資訊所包含之裁切尺寸而進行修剪。提取部303以顯示規定資訊所包含之縮小率縮小修剪後之影像。When the tracking function is enabled, the extraction unit 303 performs cropping based on the position information (any of the first to second position information) corresponding to each of the current image and the past image, and cuts the current image and the past image. Cut into the area of the display object. Specifically, the extraction unit 303 performs cropping based on the crop size included in the corresponding display specification information centering on the area of the face indicated by the position information. The extraction unit 303 reduces the cropped image by displaying the reduction ratio included in the predetermined information.

合成部304以將經修剪且縮小之各影像顯示於顯示終端30A之方式,根據成為顯示對象之影像之合計張數及影像之種類中至少一者,基於配置資訊而進行畫面分割及畫面構成。合成部304將所產生之合成影像輸出至顯示部33A。The synthesizing unit 304 performs screen division and screen configuration based on the arrangement information based on at least one of the total number of images to be displayed and the type of the image, so that each of the clipped and reduced images is displayed on the display terminal 30A. The synthesizing unit 304 outputs the generated synthesized image to the display unit 33A.

再者,提取部303亦可以基於位置資訊而裁切包含感測到之面部之最小區域的方式進行修剪。於該情形時,提取部303對修剪後之影像(裁切出之影像)之尺寸與要顯示修剪後之影像之畫面之尺寸進行比較。提取部303根據比較結果而進行修剪後之影像之縮小。提取部303根據比較結果,於修剪後之影像之尺寸與畫面之尺寸相同之情形時,不進行縮小,而設為原尺寸(等倍)。Furthermore, the extraction unit 303 may perform cropping so that the smallest area including the sensed face is cropped based on the position information. In this case, the extracting unit 303 compares the size of the trimmed image (the cropped image) with the size of the screen on which the trimmed image is to be displayed. The extraction unit 303 performs the reduction of the image after the cropping based on the comparison result. Based on the comparison result, the extraction unit 303 sets the size of the image after the cropping to the same size as the screen size, and sets the original size (equal magnification).

顯示部33A係以顯示由合成部304處理後之合成影像之方式構成。顯示部33A例如為液晶顯示器。此處,於顯示終端30A具備觸控面板顯示器之情形時,觸控面板顯示器兼作顯示部33A與操作部34A。The display unit 33A is configured to display a synthesized image processed by the synthesizing unit 304. The display unit 33A is, for example, a liquid crystal display. Here, when the display terminal 30A is provided with a touch panel display, the touch panel display also serves as the display unit 33A and the operation unit 34A.

操作部34A係以受理使用者(此處為住戶內之居住者)之操作之方式構成。於通信部31A接收到用以呼叫居住者之控制信號之狀態下,對操作部34A進行特定操作(例如按下操作)時,成為可於玄關子機60與顯示終端30A之間進行聲音通話之狀態。The operation unit 34A is configured to accept the operation of the user (here, the occupant in the household). When the communication unit 31A receives a control signal for calling the occupant, and performs a specific operation (for example, a pressing operation) on the operation unit 34A, the communication unit 31A can make a voice call between the entrance sub-machine 60 and the display terminal 30A. status.

此處,對顯示終端30A顯示之影像之畫面佈局進行說明。於本實施形態中,於對講機系統1A中,顯示終端30A以圖7A所示之顯示畫面G10之畫面構成,顯示當前影像及過去影像之2種影像。再者,畫面佈局並不限定於圖7A所示之構成。例如畫面佈局亦可為圖7B所示之構成。Here, the screen layout of the image displayed on the display terminal 30A will be described. In the present embodiment, in the walkie-talkie system 1A, the display terminal 30A is configured by the screen of the display screen G10 shown in FIG. 7A, and displays two kinds of images of the current image and the past image. Furthermore, the screen layout is not limited to the configuration shown in FIG. 7A. For example, the screen layout may also be as shown in FIG. 7B.

顯示畫面G100包含主畫面G101、副畫面G102及按鈕顯示畫面G103。The display screen G100 includes a main screen G101, a sub screen G102, and a button display screen G103.

主畫面G101係用以顯示當前影像之畫面。副畫面G102係用以顯示過去影像之畫面。副畫面G102之尺寸小於主畫面G101之顯示尺寸。按鈕顯示畫面G103於顯示終端30A具備觸控面板顯示器之情形時,顯示操作按鈕等。於按鈕顯示畫面G103中,例如顯示操作選單按鈕、畫面切換按鈕等。當按下操作選單按鈕時,顯示部33A顯示1個以上之可於顯示終端30A進行操作之操作名稱及與其對應之按鈕之組。當按下畫面切換按鈕時,切換例如主畫面G101與副畫面G102所顯示之影像。The main screen G101 is a screen for displaying the current image. The sub-picture G102 is a screen for displaying past images. The size of the sub-picture G102 is smaller than the display size of the main screen G101. The button display screen G103 displays an operation button or the like when the display terminal 30A includes the touch panel display. In the button display screen G103, for example, an operation menu button, a screen switching button, and the like are displayed. When the operation menu button is pressed, the display unit 33A displays one or more groups of operation names that can be operated by the display terminal 30A and buttons corresponding thereto. When the screen switching button is pressed, for example, the images displayed on the main screen G101 and the sub screen G102 are switched.

以下,對本實施形態之對講機系統1A之動作進行說明。以下,對來訪者對於玄關子機60之呼叫部63進行特定操作之情形進行說明。Hereinafter, the operation of the walkie-talkie system 1A of the present embodiment will be described. Hereinafter, a case where the visitor performs a specific operation on the calling unit 63 of the entrance sub-machine 60 will be described.

首先,當玄關子機60之呼叫部63受理特定操作時,玄關子機60使攝像終端40開始攝像動作。攝像終端40將所拍攝之影像輸出至玄關子機60。First, when the calling unit 63 of the entrance sub-machine 60 accepts a specific operation, the entrance sub-machine 60 causes the imaging terminal 40 to start the imaging operation. The imaging terminal 40 outputs the captured image to the entrance sub-machine 60.

玄關子機60之受理部61將攝像終端40所拍攝之影像經由通信部62輸出至顯示終端30A。The reception unit 61 of the entrance sub-machine 60 outputs the video captured by the imaging terminal 40 to the display terminal 30A via the communication unit 62.

顯示終端30A之影像受理部32A將自玄關子機60接收到之影像寫入第1記憶部36A,且作為當前影像輸出至影像處理部300。The image receiving unit 32A of the display terminal 30A writes the image received from the entrance sub-machine 60 into the first storage unit 36A, and outputs it as the current video to the video processing unit 300.

第1面部檢測部301於跟蹤功能有效之情形時,對當前影像進行面部感測。第1面部檢測部301將當前影像及由面部感測而得之感測結果輸出至提取部303。第1面部檢測部301於跟蹤功能無效之情形時,不進行面部感測,而將當前影像輸出至提取部303。When the tracking function is enabled, the first face detecting unit 301 performs face sensing on the current image. The first face detecting unit 301 outputs the current image and the sensing result obtained by the face sensing to the extracting unit 303. When the tracking function is disabled, the first face detecting unit 301 outputs the current video to the extracting unit 303 without performing face sensing.

第2面部檢測部302自第1記憶部36A沿時間序列讀出自當前時點向前回溯特定時間之過去影像(例如較當前時點3秒前之影像)。第2面部檢測部302於跟蹤功能有效之情形時,對自第1記憶部36A讀出之過去影像進行面部感測。第2面部檢測部302將過去影像及由面部感測而得之感測結果輸出至提取部303。第2面部檢測部302於跟蹤功能無效之情形時,不進行面部感測,而將過去影像輸出至提取部303。The second face detecting unit 302 reads out from the first memory unit 36A the past image from the current time point back to the specific time (for example, an image 3 seconds before the current time point). When the tracking function is enabled, the second face detecting unit 302 performs face sensing on the past image read from the first storage unit 36A. The second face detecting unit 302 outputs the past image and the sensing result obtained by the face sensing to the extracting unit 303. When the tracking function is disabled, the second face detecting unit 302 outputs the past video to the extracting unit 303 without performing face sensing.

提取部303於跟蹤功能無效之情形時,基於與當前影像及過去影像之各者對應之顯示規定資訊,對當前影像及過去影像裁切成為顯示對象之區域。具體而言,於關於當前影像之顯示規定資訊中,與實施形態1同樣地包含規定裁切位置之第1座標(a1,b1)、及橫向之長度L1、縱向之長度H1。於關於過去影像之顯示規定資訊中,包含規定裁切位置之第2座標(x1,y1)、及橫向之長度L4、縱向之長度H4。如圖8A所示,提取部303對於當前影像G200,裁切以第1座標(a1,b1)為起點且以橫向之長度L1及縱向之長度H1所規定之區域作為顯示範圍G250。如圖8B所示,提取部303對於過去影像G201,裁切以第2座標(x1,y1)為起點且以橫向之長度L4及縱向之長度H4所規定之區域作為顯示範圍G260。提取部303視需要對於所裁切之顯示範圍G250、G260(經修剪之當前影像、過去影像),依照對應之顯示規定資訊之縮小率進行縮小。When the tracking function is invalid, the extraction unit 303 cuts the current image and the past image into the display target region based on the display predetermined information corresponding to each of the current image and the past image. Specifically, in the display specification information on the current image, the first coordinate (a1, b1) defining the cutting position, the length L1 in the lateral direction, and the length H1 in the vertical direction are included in the same manner as in the first embodiment. The information on the display of the past image includes the second coordinate (x1, y1) defining the cutting position, the length L4 in the lateral direction, and the length H4 in the vertical direction. As shown in FIG. 8A, the extraction unit 303 cuts a region defined by the first coordinate (a1, b1) as the starting point and the length L1 in the lateral direction and the length H1 in the vertical direction as the display range G250. As shown in FIG. 8B, the extraction unit 303 cuts a region defined by the second coordinate (x1, y1) from the past coordinate G201 with the horizontal length L4 and the vertical length H4 as the display range G260. The extraction unit 303 reduces the display range G250 and G260 (the current image that has been cropped and the past image) as needed according to the reduction ratio of the corresponding display predetermined information.

提取部303於跟蹤功能有效之情形時,基於與當前影像及過去影像之各者對應之位置資訊(第1~第2位置資訊之任一者)實施修剪,對於當前影像及過去影像裁切成為顯示對象之區域。具體而言,提取部303對於當前影像,基於第1位置資訊而求出當前影像所包含之面部之區域(第1區域),裁切以第1區域為中心且以橫向之長度L1及縱向之長度H1所規定之區域作為第1顯示範圍。提取部303對於過去影像,基於第2位置資訊而求出過去影像所包含之面部之區域(第2區域),裁切以第2區域為中心且以橫向之長度L4及縱向之長度H4所規定之區域作為第2顯示範圍。When the tracking function is enabled, the extraction unit 303 performs cropping based on the position information (any of the first to second position information) corresponding to each of the current image and the past image, and crops the current image and the past image. Displays the area of the object. Specifically, the extraction unit 303 obtains a region (first region) of the face included in the current video based on the first position information for the current image, and cuts the length L1 and the vertical direction centering on the first region. The area defined by the length H1 serves as the first display range. The extraction unit 303 obtains a region (second region) of the face included in the past image based on the second position information for the past video, and the cutting is defined by the length L4 and the length H4 of the vertical direction centering on the second region. The area is the second display range.

提取部303於跟蹤功能有效之情形時,若以攝像終端40拍攝影像中,當前影像所包含之面部之位置移動,則根據面部感測之結果,基於移動後之第1位置資訊而再次求出當前影像所包含之面部之區域。提取部303裁切以再次求出之面部之區域為中心且以橫向之長度L1及縱向之長度H1所規定之區域作為第1顯示範圍。提取部303於跟蹤功能有效之情形時,若自第1記憶部36A所接收之過去影像所包含之面部之位置移動,則根據面部感測之結果,基於移動後之第2位置資訊而再次求出過去影像所包含之面部之區域。提取部303裁切以再次求出之面部之區域為中心且以橫向之長度L4及縱向之長度H4所規定之區域作為第2顯示範圍。When the tracking function is enabled, the extraction unit 303 re-determines the position of the face included in the current image when the image is captured by the imaging terminal 40, based on the result of the face sensing, based on the first position information after the movement. The area of the face contained in the current image. The extraction unit 303 cuts a region defined by the region of the face that is obtained again and has a length L1 in the lateral direction and a length H1 in the longitudinal direction as the first display range. When the tracking function is enabled, the extraction unit 303 moves again based on the result of the face sensing based on the second position information after the movement, if the position of the face included in the past video received by the first storage unit 36A is moved. The area of the face contained in the past image. The extraction unit 303 cuts a region defined by the region of the face that is obtained again and has a length L4 and a length H4 in the vertical direction as the second display range.

提取部303視需要對所裁切之第1及第2顯示範圍(經修剪之當前影像及過去影像),依照對應之顯示規定資訊之縮小率進行縮小。The extraction unit 303 reduces the first and second display ranges (the cropped current image and the past image) that are cropped as needed in accordance with the reduction ratio of the corresponding display predetermined information.

合成部304根據合計張數及影像之種類中至少一者而求出畫面之分割數,從而求出與分割數相應之畫面構成。此處,除按鈕顯示畫面以外之分割數為2,求出顯示畫面G100作為與其對應之畫面佈局。The synthesizing unit 304 obtains the number of divisions of the screen based on at least one of the total number of sheets and the type of the image, and obtains a screen configuration corresponding to the number of divisions. Here, the number of divisions other than the button display screen is 2, and the display screen G100 is obtained as the screen layout corresponding thereto.

合成部304基於配置資訊而對經修剪且視需要縮小之各影像進行合成(排列),產生1個合成影像。具體而言,合成部304以將各影像顯示於顯示畫面G100中所對應之畫面(主畫面G101及副畫面G102之任一畫面)之方式,由各影像產生1個合成影像。例如於跟蹤功能無效之情形時,合成部304由依照對應之顯示規定資訊之縮小率而縮小之顯示範圍G250、G260,產生1個合成影像(參照圖8C)。合成部304將所產生之合成影像輸出至顯示部33A。The synthesizing unit 304 synthesizes (arranges) each of the trimmed and reduced images as needed based on the arrangement information, and generates one synthesized video. Specifically, the synthesizing unit 304 generates one synthesized video from each video so that each video is displayed on a screen (either one of the main screen G101 and the sub-screen G102) corresponding to the display screen G100. For example, when the tracking function is invalid, the synthesizing unit 304 generates one synthesized image by the display ranges G250 and G260 which are reduced in accordance with the reduction ratio of the corresponding display predetermined information (see FIG. 8C). The synthesizing unit 304 outputs the generated synthesized image to the display unit 33A.

顯示終端30A藉由將合成影像顯示於顯示部33A,而可分割1個畫面來顯示2種影像。The display terminal 30A can display two types of images by dividing one screen by displaying the synthesized image on the display unit 33A.

其次,對實施形態2之變化例進行說明。Next, a modification of the second embodiment will be described.

於上述實施形態中,於影像處理部300中跟蹤功能無效之情形時,顯示部33A亦可與實施形態1之變化例同樣地將指示變更裁切位置之滾動按鈕與合成影像共同顯示。In the above-described embodiment, when the tracking function is disabled in the image processing unit 300, the display unit 33A can display the scroll button instructing the change of the cutting position together with the synthesized image in the same manner as the modification of the first embodiment.

又,於影像處理部300中跟蹤功能無效之情形時,顯示部33A亦可與實施形態1之變化例同樣地,將對於攝像終端40指示變更拍攝範圍及拍攝位置之至少1者之變更指示按鈕與合成影像共同顯示。When the tracking function is disabled in the video processing unit 300, the display unit 33A can instruct the imaging terminal 40 to change the instruction button for changing at least one of the imaging range and the imaging position, similarly to the modification of the first embodiment. Displayed together with the composite image.

如以上說明,可謂影像處理部300根據使用者之指示,對於當前影像及過去影像之至少1個影像,調整拍攝範圍、拍攝位置及顯示範圍中至少1者。As described above, the image processing unit 300 adjusts at least one of the imaging range, the imaging position, and the display range for at least one of the current image and the past image based on the user's instruction.

於上述實施形態中,構成為於跟蹤功能無效之情形時,將提取部303所裁切之各影像以對應之縮小率縮小,但並不限定於該構成。於跟蹤功能無效之情形時,亦可將提取部303所裁切之各影像放大。例如,將所裁切之範圍設為較對應之畫面(主畫面G101及副畫面G102)之尺寸更小之範圍。提取部303於所裁切之影像之尺寸與對應之畫面之尺寸相比可放大之情形時,將所裁切之影像放大。或,提取部303亦可具有將影像縮小之功能與放大之功能之兩者。In the above-described embodiment, when the tracking function is invalid, the respective images cut by the extraction unit 303 are reduced by the corresponding reduction ratio, but the configuration is not limited thereto. When the tracking function is invalid, each image cut by the extraction unit 303 may be enlarged. For example, the cropped range is set to be smaller than the size of the corresponding screen (main screen G101 and sub-screen G102). The extracting unit 303 enlarges the cropped image when the size of the cropped image is larger than the size of the corresponding screen. Alternatively, the extraction unit 303 may have both a function of reducing the image and a function of amplifying the image.

於上述實施形態中,構成為攝像終端40包含於玄關子機60,但並不限定於該構成。亦可為攝像終端40不包含於玄關子機60之構成。In the above embodiment, the imaging terminal 40 is included in the entrance sub-machine 60, but the configuration is not limited thereto. It is also possible that the imaging terminal 40 is not included in the configuration of the entrance sub-machine 60.

又,本實施形態之對講機系統1A亦可構成為進而包含外部終端50。此時,當顯示終端30A自外部終端50直接接收到輸入影像,或經由玄關子機60而自外部終端50接收到輸入影像時,影像處理部300與實施形態1之影像處理部103同樣地進行動作,使顯示部33A顯示3種影像。Further, the walkie-talkie system 1A of the present embodiment may be configured to further include an external terminal 50. At this time, when the display terminal 30A directly receives the input image from the external terminal 50 or receives the input image from the external terminal 50 via the entrance sub-machine 60, the image processing unit 300 performs the same process as the video processing unit 103 of the first embodiment. The operation causes the display unit 33A to display three types of images.

或,於本實施形態之對講機系統1A為包含外部終端50之構成之情形時,亦可並非為上述顯示3種影像之構成,而為顯示3種中之2種影像之構成。例如,亦可構成為於主畫面G101中顯示當前影像,於副畫面G102中顯示過去影像及輸入影像之一種影像。此時,亦可構成為於副畫面G102中,藉由按下畫面切換按鈕而自一種影像切換為另一種影像。Alternatively, when the walkie-talkie system 1A of the present embodiment is configured to include the external terminal 50, the configuration may be such that three types of images are displayed instead of the three types of images. For example, the current image may be displayed on the main screen G101, and one image of the past image and the input image may be displayed on the sub-screen G102. In this case, the sub-screen G102 may be configured to switch from one type of image to another by pressing the screen switching button.

於上述實施形態中,設為主畫面G101與副畫面G102橫向排列之畫面佈局(參照圖7A、7B),但並不限定於該畫面佈局。亦可為主畫面G101與副畫面G102縱向排列之畫面佈局(參照圖9A)。In the above embodiment, the screen layout in which the main screen G101 and the sub screen G102 are arranged side by side (see FIGS. 7A and 7B) is not limited to the screen layout. A screen layout in which the main screen G101 and the sub-screen G102 are vertically arranged may be referred to (see FIG. 9A).

於上述實施形態中,構成為顯示終端30A包含影像處理部300,但並不限定於該構成。亦可為玄關子機60包含影像處理部300之構成。In the above embodiment, the display terminal 30A includes the video processing unit 300, but the configuration is not limited thereto. The configuration of the image processing unit 300 may be included in the entrance sub-machine 60.

又,影像處理部300並非必須由顯示終端30A及玄關子機60中之任1個終端(裝置)構成。影像處理部300之功能亦可分散於複數個終端(裝置)。例如,影像處理部300之功能亦可分散設置於顯示終端30A及玄關子機60。Further, the video processing unit 300 does not need to be constituted by any one of the display terminal 30A and the entrance sub-machine 60 (device). The functions of the image processing unit 300 may be distributed over a plurality of terminals (devices). For example, the functions of the image processing unit 300 may be distributed to the display terminal 30A and the entrance sub-machine 60.

於上述實施形態中,構成為對於各影像(當前影像及過去影像)具有跟蹤功能,但並不限定於該構成。只要對當前影像及過去影像中至少1種影像具有跟蹤功能即可。In the above embodiment, the tracking function is provided for each image (current image and past image), but the configuration is not limited thereto. As long as at least one of the current image and the past image has a tracking function.

如以上說明,於本實施形態及變化例之對講機系統中,對當前影像及過去影像實施修剪。因此,即便於將該等影像一次顯示於顯示畫面G100之情形時,與未實施修剪之情形時相比,各影像更加容易觀看。As described above, in the walkie-talkie system of the embodiment and the modification, the current image and the past image are trimmed. Therefore, even when the images are displayed on the display screen G100 at a time, each image is easier to view than when the cropping is not performed.

(其他變化例) 以下,列舉變化例。再者,以下說明之變化例可與上述各實施形態適當組合應用。(Other Variations) Hereinafter, a variation will be described. Further, the modifications described below can be applied in appropriate combination with the above embodiments.

於上述實施形態1中,構成為對講機系統1將當前影像、過去影像及輸入影像之3種影像全部顯示於顯示終端30,但並不限定於該構成。亦可為對講機系統1將當前影像、過去影像及輸入影像中之2種影像顯示於顯示終端30的構成。該情形時之畫面佈局可藉由應用實施形態2中所述之畫面佈局實現。In the first embodiment, the walkie-talkie system 1 displays all of the three types of images of the current image, the past image, and the input image on the display terminal 30. However, the present invention is not limited to this configuration. The walkie-talkie system 1 may also display two types of current images, past images, and input images on the display terminal 30. The screen layout in this case can be realized by applying the screen layout described in Embodiment 2.

又,於實施形態1中,構成為分別顯示3種影像,於實施形態2中,構成為分別顯示2種影像,但並不限定於該構成。亦可顯示4種以上之影像。例如,於實施形態1中,可應用於對講機系統1包含2個以上之外部終端50之情形。Further, in the first embodiment, three kinds of images are displayed, and in the second embodiment, two types of images are separately displayed, but the configuration is not limited thereto. More than 4 types of images can also be displayed. For example, in the first embodiment, it is applicable to the case where the walkie-talkie system 1 includes two or more external terminals 50.

將該情形時之畫面佈局之一例表示於圖9B、9C。圖9B為顯示6種影像之情形時之畫面佈局,對於對講機系統1包含4個外部終端50之情形有效。畫面G300包含主畫面G301、5個副畫面G302~G306。於主畫面G301中,顯示當前影像。於副畫面G302中顯示過去圖像,於副畫面G303~G306中,分別顯示對應之外部終端50各自所拍攝之輸入影像。圖9C為顯示5種影像之情形時之畫面佈局,對於對講機系統1包含3個外部終端50之情形時有效。畫面G400包含主畫面G401、4個副畫面G402~G405。於主畫面G401中,顯示當前影像。於副畫面G402中,顯示過去圖像,於副畫面G403~G405中,分別顯示對應之外部終端50各自所拍攝之輸入影像。再者,於圖9B、9C中,省略按鈕顯示畫面。An example of the screen layout in this case is shown in FIGS. 9B and 9C. Fig. 9B is a screen layout in the case of displaying six kinds of images, and is effective for the case where the interphone system 1 includes four external terminals 50. The screen G300 includes a main screen G301 and five sub-screens G302 to G306. In the main screen G301, the current image is displayed. The past image is displayed on the sub-screen G302, and the input images captured by the corresponding external terminals 50 are displayed on the sub-screens G303 to G306. Fig. 9C is a screen layout in the case of displaying five kinds of images, and is effective when the walkie-talkie system 1 includes three external terminals 50. The screen G400 includes a main screen G401 and four sub-screens G402 to G405. In the main screen G401, the current image is displayed. In the sub-screen G402, the past image is displayed, and the input images captured by the corresponding external terminals 50 are respectively displayed on the sub-screens G403 to G405. In addition, in FIGS. 9B and 9C, the button display screen is omitted.

(總結) 如以上說明,第1態樣之對講機系統(1、1A)包含影像處理部(103、300),該影像處理部(103、300)對於應以包含顯示部(33、33A)之顯示終端(30、30A)之顯示部(33、33A)顯示之影像實施處理。影像處理部(103、300)使顯示部(33、33A)以主畫面(G11、G101)顯示由拍攝來訪者之攝像終端(40)所拍攝且由影像處理部(103、300)處理後之即時影像作為第1影像(當前影像)。影像處理部(103、300)使顯示部(33、33A)以副畫面(第1副畫面G12、第2副畫面G13、副畫面G102)顯示由攝像終端(40)拍攝且與第1影像之拍攝時刻不同之拍攝時刻之影像、及分別以與攝像終端(40)不同之1個以上之外部終端(50)所拍攝之影像中至少1種影像作為第2影像(過去影像、輸入影像)。影像處理部(103、300)具有對於應以副畫面顯示之第2影像實施修剪之修剪功能。(Summary) As described above, the walkie-talkie system (1, 1A) of the first aspect includes the image processing unit (103, 300), and the image processing unit (103, 300) includes the display unit (33, 33A). The image display processing displayed on the display portions (33, 33A) of the display terminals (30, 30A). The video processing unit (103, 300) displays the display unit (33, 33A) on the main screen (G11, G101) by the imaging terminal (40) that photographs the visitor and is processed by the video processing unit (103, 300). The live image is used as the first image (current image). The video processing unit (103, 300) causes the display unit (33, 33A) to display the sub-picture (the first sub-picture G12, the second sub-picture G13, and the sub-picture G102) by the imaging terminal (40) and the first video. At least one of the images captured by the external terminal (50) different from the imaging terminal (40) is used as the second image (past image, input image). The video processing unit (103, 300) has a trimming function for performing cropping on the second image to be displayed on the sub-screen.

根據該構成,由於影像處理部(103、300)對第2影像實施修剪,因而以副畫面顯示之第2影像與未實施修剪之情形相比容易觀看。因此,對講機系統(1、1A)即便於以1個畫面顯示複數種影像之情形時亦可降低各影像之觀看難度。According to this configuration, since the video processing unit (103, 300) trims the second video, the second video displayed on the sub-screen is easier to view than the case where the cropping is not performed. Therefore, the walkie-talkie system (1, 1A) can reduce the viewing difficulty of each image even when a plurality of types of images are displayed on one screen.

第2態樣之對講機系統(1、1A)係於第1態樣中,影像處理部(103、300)根據副畫面(第1副畫面G12、第2副畫面G13、副畫面G102)之大小,預先設定對第2影像進行修剪之區域。根據該構成,由於預先設定對第2影像實施修剪之區域,因此可對使用者顯示所需之影像(例如包含被攝體之區域)。The walkie-talkie system (1, 1A) of the second aspect is in the first aspect, and the video processing unit (103, 300) is based on the size of the sub-picture (the first sub-picture G12, the second sub-picture G13, and the sub-picture G102). , the area where the second image is trimmed is set in advance. According to this configuration, since the region where the second image is trimmed is set in advance, the desired image (for example, the region including the subject) can be displayed to the user.

第3態樣之對講機系統(1、1A)係於第1或第2態樣中,影像處理部(103、300)以根據第1影像與第2影像之合計數量及影像之種類中至少一者,基於表示各影像之配置的預先設定之配置資訊而分別顯示第1影像及第2影像的方式,決定畫面分割與畫面佈局。根據該構成,可使畫面容易觀看且有效率地利用畫面。例如於畫面為寬畫面之情形時,可使第1影像之顯示範圍變大,從而可提高確認來訪者之安全性。The walkie-talkie system (1, 1A) of the third aspect is in the first or second aspect, and the image processing unit (103, 300) is based on at least one of the combined count of the first image and the second image and the type of the image. The method of displaying the first image and the second image based on the preset configuration information indicating the arrangement of the respective images determines the screen division and the screen layout. According to this configuration, the screen can be easily viewed and the screen can be utilized efficiently. For example, when the screen is a wide screen, the display range of the first video can be increased, and the security of the visitor can be improved.

第4態樣之對講機系統(1、1A)係於第1~第3之任一態樣中,影像處理部(103、300)將第1影像及第2影像中至少1種影像放大或縮小。根據該構成,使用者可容易地進行來訪者之識別。In the fourth aspect, the image processing unit (103, 300) enlarges or reduces at least one of the first image and the second image. . According to this configuration, the user can easily recognize the visitor.

第5態樣之對講機系統(1、1A)係於第1~第4之任一態樣中,影像處理部(103、300)對於第1影像及第2影像中至少一者,根據使用者之指示而調整拍攝範圍、拍攝位置及顯示範圍中至少1者。根據該構成,於來訪者未包含於所顯示之影像中之情形時,藉由調整拍攝範圍、拍攝位置及顯示範圍中至少1者,而可使顯示之影像中包含來訪者。The walkie-talkie system (1, 1A) of the fifth aspect is in any one of the first to fourth aspects, and the image processing unit (103, 300) is based on at least one of the first image and the second image. At least one of the shooting range, shooting position, and display range is adjusted by the instruction. According to this configuration, when the visitor is not included in the displayed image, the visitor can be included in the displayed image by adjusting at least one of the shooting range, the shooting position, and the display range.

第6態樣之對講機系統(1、1A)係於第1~第5之任一態樣中,影像處理部(103、300)具有跟蹤功能。跟蹤功能係如下功能:於第1影像及第2影像中至少一種影像中,以使藉由顯示部(33、33A)所顯示之來訪者收入顯示為該影像之畫面中之方式,調整影像之拍攝範圍、拍攝位置及顯示範圍中至少1者。根據該構成,可降低因來訪者移動而導致其不包含於所顯示之影像中的可能性。The walkie-talkie system (1, 1A) of the sixth aspect is in any of the first to fifth aspects, and the image processing unit (103, 300) has a tracking function. The tracking function is a function of adjusting the image by displaying the revenue of the visitor displayed by the display unit (33, 33A) as the image of the image in at least one of the first image and the second image. At least one of the shooting range, shooting position, and display range. According to this configuration, it is possible to reduce the possibility that the visitor does not include the displayed image due to the movement of the visitor.

第7態樣之對講機系統(1、1A)係於第6態樣中,於以顯示終端(30、30A)顯示第1影像及第2影像期間,繼續藉由跟蹤功能對影像之拍攝範圍、拍攝位置及顯示範圍中至少1者進行調整。根據該構成,可降低以顯示終端顯示影像期間因來訪者移動而導致其不包含於所顯示之影像中的可能性。The walkie-talkie system (1, 1A) of the seventh aspect is in the sixth aspect, and continues to capture the range of the image by the tracking function during the display of the first image and the second image by the display terminal (30, 30A). Adjust at least one of the shooting position and display range. According to this configuration, it is possible to reduce the possibility that the display terminal does not include the displayed image due to the movement of the visitor during the display of the video.

第8態樣之對講機子機(大廳對講機10、玄關子機60)包含於第1~第7之任一態樣之對講機系統(1、1A)。對講機子機包含影像處理部(103)、受理部(第1受理部101、受理部61)、及呼叫部(106、63)。受理部受理攝像終端(40)所拍攝之影像。呼叫部受理來自來訪者之用以進行呼叫之操作。根據該構成,即便於以1個畫面顯示複數種影像之情形時,亦可降低各影像之觀看難度。The intercom system (the hall interphone 10 and the entrance sub-machine 60) of the eighth aspect is included in the walkie-talkie system (1, 1A) of any of the first to seventh aspects. The interphone includes a video processing unit (103), a receiving unit (the first receiving unit 101, the receiving unit 61), and a calling unit (106, 63). The receiving unit receives the image captured by the imaging terminal (40). The calling department accepts an operation from a visitor to make a call. According to this configuration, even when a plurality of types of images are displayed on one screen, the viewing difficulty of each image can be reduced.

第9態樣之顯示終端(30A)包含於第1~第7之任一態樣之對講機系統(1A)。顯示終端(30A)包含影像處理部(300)、及受理攝像終端(40)所拍攝之影像之影像受理部(32A)。根據該構成,即便於以1個畫面顯示複數種影像之情形時,亦可降低各影像之觀看難度。The display terminal (30A) of the ninth aspect is included in the walkie-talkie system (1A) of any of the first to seventh aspects. The display terminal (30A) includes an image processing unit (300) and an image receiving unit (32A) that receives an image captured by the imaging terminal (40). According to this configuration, even when a plurality of types of images are displayed on one screen, the viewing difficulty of each image can be reduced.

第10態樣之控制裝置(20)包含於第1~第7之任一態樣之對講機系統(1)。控制裝置(20)包含影像處理部(103)、受理部(第1受理部101)、及通信部(21)。受理部受理攝像終端(40)所拍攝之影像。通信部(21)將以影像處理部(103)實施過處理之影像發送至顯示終端(30)。根據該構成,即便於以1個畫面顯示複數種影像之情形時,亦可降低各影像之觀看難度。The control device (20) of the tenth aspect is included in the walkie-talkie system (1) of any of the first to seventh aspects. The control device (20) includes a video processing unit (103), a receiving unit (first receiving unit 101), and a communication unit (21). The receiving unit receives the image captured by the imaging terminal (40). The communication unit (21) transmits the image processed by the image processing unit (103) to the display terminal (30). According to this configuration, even when a plurality of types of images are displayed on one screen, the viewing difficulty of each image can be reduced.

第11態樣之程式使電腦作為第1~第7之任一態樣之對講機系統(1、1A)所包含之影像處理部(103、300)而發揮功能。根據該程式,即便於以1個畫面顯示複數種影像之情形時,亦可降低各影像之觀看難度。The eleventh aspect of the program causes the computer to function as the image processing unit (103, 300) included in the walkie-talkie system (1, 1A) of any of the first to seventh aspects. According to this program, even when a plurality of types of images are displayed on one screen, the viewing difficulty of each image can be reduced.

1‧‧‧對講機系統1‧‧‧Intercom system

1A‧‧‧對講機系統1A‧‧‧Intercom system

10‧‧‧大廳對講機(對講機子機)10‧‧‧ hall walkie-talkie (intercom machine)

20‧‧‧控制裝置20‧‧‧Control device

21‧‧‧通信部21‧‧‧Communication Department

30‧‧‧顯示終端30‧‧‧Display terminal

30A‧‧‧顯示終端30A‧‧‧Display terminal

31‧‧‧通信部31‧‧‧Communication Department

32‧‧‧影像受理部32‧‧‧Image Reception Department

32A‧‧‧影像受理部32A‧‧‧Image Reception Department

33‧‧‧影像受理部33‧‧‧Image Reception Department

33A‧‧‧顯示部33A‧‧‧Display Department

33A‧‧‧顯示部33A‧‧‧Display Department

34‧‧‧操作部34‧‧‧Operation Department

34A‧‧‧操作部34A‧‧‧Operation Department

35‧‧‧控制部35‧‧‧Control Department

35A‧‧‧控制部35A‧‧‧Control Department

36A‧‧‧第1記憶部36A‧‧‧First Memory Department

37A‧‧‧第2記憶部37A‧‧‧2nd Memory Department

40‧‧‧攝像終端40‧‧‧ camera terminal

50‧‧‧外部終端50‧‧‧External terminal

60‧‧‧玄關子機(對講機子機)60‧‧‧Xuanguan machine (intercom machine)

61‧‧‧受理部61‧‧‧ Reception Department

62‧‧‧通信部62‧‧‧Communication Department

63‧‧‧呼叫部63‧‧‧Call Department

64‧‧‧控制部64‧‧‧Control Department

101‧‧‧第1受理部(受理部)101‧‧‧1st reception department (acceptance department)

102‧‧‧第2受理部102‧‧‧2nd Reception Department

103‧‧‧影像處理部103‧‧‧Image Processing Department

104‧‧‧第1記憶部104‧‧‧First Memory Department

105‧‧‧第2記憶部105‧‧‧The 2nd Memory Department

106‧‧‧呼叫部106‧‧ ‧Call Department

107‧‧‧通信部107‧‧‧Communication Department

111‧‧‧第1面部檢測部111‧‧‧1st face detection department

112‧‧‧第2面部檢測部112‧‧‧2nd face detection department

113‧‧‧人檢測部113‧‧‧ Person Detection Department

114‧‧‧提取部114‧‧‧Extraction Department

115‧‧‧合成部115‧‧‧Combination Department

300‧‧‧影像處理部300‧‧‧Image Processing Department

300‧‧‧影像處理部300‧‧‧Image Processing Department

301‧‧‧第1面部檢測部301‧‧‧1st face detection department

302‧‧‧第2面部檢測部302‧‧‧2nd Face Detection Department

303‧‧‧提取部303‧‧‧Extraction Department

304‧‧‧合成部304‧‧‧Combination Department

G10‧‧‧顯示畫面G10‧‧‧ display screen

G11‧‧‧主畫面G11‧‧‧ main screen

G12‧‧‧第1副畫面G12‧‧‧1st screen

G13‧‧‧第2副畫面G13‧‧‧2nd sub-picture

G14‧‧‧按鈕顯示畫面G14‧‧‧ button display screen

G20‧‧‧當前影像G20‧‧‧ current image

G22‧‧‧輸入影像G22‧‧‧ Input image

G21‧‧‧過去影像G21‧‧‧ Past imagery

G25‧‧‧顯示範圍G25‧‧‧Display range

G26‧‧‧顯示範圍G26‧‧‧Display range

G27‧‧‧顯示範圍G27‧‧‧Display range

G30‧‧‧區域G30‧‧‧ area

G31‧‧‧區域G31‧‧‧ area

G32‧‧‧區域G32‧‧‧ area

G35‧‧‧顯示範圍G35‧‧‧Display range

G36‧‧‧顯示範圍G36‧‧‧Display range

G37‧‧‧顯示範圍G37‧‧‧Display range

G40‧‧‧區域G40‧‧‧ area

G41‧‧‧區域G41‧‧‧ area

G42‧‧‧區域G42‧‧‧ area

G100‧‧‧畫面G100‧‧‧ screen

G101‧‧‧主畫面G101‧‧‧ main screen

G102‧‧‧副畫面G102‧‧‧Sub screen

G103‧‧‧按鈕顯示畫面G103‧‧‧ button display screen

G200‧‧‧當前影像G200‧‧‧ current image

G201‧‧‧過去影像G201‧‧‧ Past imagery

G250‧‧‧顯示範圍G250‧‧‧Display range

G260‧‧‧顯示範圍G260‧‧‧Display range

G300‧‧‧畫面G300‧‧‧ screen

G301‧‧‧主畫面G301‧‧‧ main screen

G302‧‧‧副畫面G302‧‧‧Sub screen

G303‧‧‧副畫面G303‧‧‧Sub screen

G304‧‧‧副畫面G304‧‧‧Sub screen

G305‧‧‧副畫面G305‧‧‧Sub screen

G306‧‧‧副畫面G306‧‧‧Sub screen

G400‧‧‧畫面G400‧‧‧ screen

G40‧‧‧主畫面G40‧‧‧ main screen

G402‧‧‧副畫面G402‧‧‧Sub screen

G403‧‧‧副畫面G403‧‧‧Sub screen

G404‧‧‧副畫面G404‧‧‧Sub screen

G405‧‧‧副畫面G405‧‧‧Sub screen

H1‧‧‧縱向之長度H1‧‧‧Longitudinal length

H2‧‧‧縱向之長度H2‧‧‧Longitudinal length

H3‧‧‧縱向之長度H3‧‧‧Longitudinal length

H4‧‧‧縱向之長度H4‧‧‧Longitudinal length

L1‧‧‧橫向之長度L1‧‧‧ horizontal length

L2‧‧‧橫向之長度L2‧‧‧ horizontal length

L3‧‧‧橫向之長度L3‧‧‧Length length

L4‧‧‧橫向之長度L4‧‧‧ horizontal length

SC1‧‧‧第1滾動按鈕SC1‧‧‧1st scroll button

SC2‧‧‧第2滾動按鈕SC2‧‧‧2nd scroll button

SC3‧‧‧第3滾動按鈕SC3‧‧‧3rd scroll button

SC4‧‧‧第4滾動按鈕SC4‧‧‧4th scroll button

SC5‧‧‧第5滾動按鈕SC5‧‧‧5th scroll button

SC6‧‧‧第6滾動按鈕SC6‧‧‧6th scroll button

SC7‧‧‧第7滾動按鈕SC7‧‧‧7th scroll button

SC8‧‧‧第8滾動按鈕SC8‧‧‧8th scroll button

SC9‧‧‧第9滾動按鈕SC9‧‧‧9th scroll button

SC10‧‧‧第10滾動按鈕SC10‧‧‧10th scroll button

圖1係表示本發明之實施形態1之對講機系統之方塊圖。 圖2係表示該對講機系統中之畫面構成之一例之圖。 圖3A~圖3C係對在該對講機系統中當跟蹤功能無效時自各影像之顯示範圍裁切進行說明之圖。圖3D係對在該對講機系統中所裁切之各顯示範圍之合成進行說明之圖。 圖4A~圖4C係對在該對講機系統中當跟蹤功能為有效時自各影像裁切顯示範圍進行說明之圖。圖4D~圖4F係對在該對講機系統中於跟蹤功能為有效之情形時當被攝體移動時自各影像裁切顯示範圍進行說明的圖。 圖5A係表示於該對講機系統中追加滾動按鈕之畫面構成之一例的圖。圖5B係對滾動按鈕被按下之情形時顯示範圍之變更進行說明的圖。 圖6係表示本發明之實施形態2之對講機系統之方塊圖。 圖7A及圖7B係表示該對講機系統中之畫面構成之一例的圖。 圖8A及圖8B係對在該對講機系統中跟蹤功能為無效時自各影像裁切顯示範圍進行說明的圖。圖8C係對在該對講機系統中所裁切之各顯示範圍之合成進行說明的圖。 圖9A~圖9C係對畫面構成之變化例進行說明之圖。Fig. 1 is a block diagram showing a walkie-talkie system according to a first embodiment of the present invention. Fig. 2 is a view showing an example of a screen configuration in the walkie-talkie system. 3A to 3C are diagrams for explaining the cutting of the display range of each image when the tracking function is disabled in the walkie-talkie system. Fig. 3D is a diagram for explaining the synthesis of the respective display ranges cut in the walkie-talkie system. 4A to 4C are diagrams for explaining the cropping display range from each image when the tracking function is enabled in the walkie-talkie system. 4D to 4F are diagrams for explaining the cutting of the display range from each image when the subject moves when the tracking function is enabled in the walkie-talkie system. Fig. 5A is a view showing an example of a screen configuration in which a scroll button is added to the walkie-talkie system. Fig. 5B is a view for explaining a change of the display range when the scroll button is pressed. Fig. 6 is a block diagram showing a walkie-talkie system according to a second embodiment of the present invention. 7A and 7B are views showing an example of a screen configuration in the walkie-talkie system. 8A and 8B are diagrams for explaining the cropping display range from each image when the tracking function is disabled in the walkie-talkie system. Fig. 8C is a view for explaining the synthesis of the respective display ranges cut in the walkie-talkie system. 9A to 9C are diagrams for explaining a modification of the screen configuration.

Claims (11)

一種對講機系統,其特徵在於: 包含影像處理部,上述影像處理部係對於應由包含顯示部之顯示終端之上述顯示部顯示之影像實施處理,且 上述影像處理部係 使上述顯示部以主畫面顯示由拍攝來訪者之攝像終端所拍攝、且由上述影像處理部處理後的即時影像作為第1影像, 使上述顯示部以副畫面顯示由上述攝像終端拍攝且與上述第1影像之拍攝時刻不同之拍攝時刻之影像、及由與上述攝像終端不同之1個以上之外部終端分別拍攝之影像中至少1種影像作為第2影像,且 上述影像處理部具有對於應由上述副畫面顯示之上述第2影像進行修剪之修剪功能。A walkie-talkie system includes: a video processing unit that performs processing on a video to be displayed by the display unit including a display terminal including a display unit, and the video processing unit causes the display unit to display a main screen Displaying, by the imaging terminal that photographs the visitor, the real-time image processed by the image processing unit as the first video, and causing the display unit to display the sub-screen by the imaging terminal and different from the imaging time of the first image At least one of the images captured by the image and the one or more external terminals different from the camera terminal as the second image, and the image processing unit has the first image to be displayed by the sub-screen 2 Image trimming function. 如請求項1之對講機系統,其中 上述影像處理部係根據副畫面之大小,預先設定對上述第2影像進行修剪之區域。In the interphone system of claim 1, the video processing unit sets an area for cropping the second video in advance according to the size of the sub-picture. 如請求項1或2之對講機系統,其中 上述影像處理部係以根據上述第1影像與上述第2影像之合計數量、及影像之種類中至少一者,基於表示各影像之配置之預先設定之配置資訊而分別顯示上述第1影像及上述第2影像的方式,決定畫面分割與畫面佈局。The intercom system of claim 1 or 2, wherein the image processing unit pre-sets the arrangement of the respective images based on at least one of a combined count amount of the first image and the second image and a type of the image. The information is displayed and the first image and the second image are displayed separately, and the screen division and the screen layout are determined. 如請求項1或2之對講機系統,其中 上述影像處理部係 將上述第1影像及上述第2影像中至少1種影像放大或縮小。The interphone system of claim 1 or 2, wherein the image processing unit enlarges or reduces at least one of the first image and the second image. 如請求項1或2之對講機系統,其中 上述影像處理部係 根據使用者之指示,對於上述第1影像及上述第2影像中至少一者,調整拍攝範圍、拍攝位置及顯示範圍中至少1者。The intercom system of claim 1 or 2, wherein the image processing unit adjusts at least one of an imaging range, a shooting position, and a display range for at least one of the first image and the second image according to an instruction of a user. . 如請求項1或2之對講機系統,其中 上述影像處理部具有跟蹤功能, 該跟蹤功能係於上述第1影像及上述第2影像中至少一個影像中,以將由上述顯示部顯示之上述來訪者收入顯示為該影像之畫面中之方式,調整上述影像之拍攝範圍、拍攝位置及顯示範圍中至少1者。The interphone system of claim 1 or 2, wherein the image processing unit has a tracking function, wherein the tracking function is in at least one of the first image and the second image, and the visitor displayed by the display unit is included in the revenue At least one of the shooting range, the shooting position, and the display range of the image is adjusted as shown in the image of the image. 如請求項6之對講機系統,其中 於藉由上述顯示終端顯示上述第1影像及上述第2影像之期間,持續藉由上述跟蹤功能而調整上述影像之拍攝範圍、拍攝位置及顯示範圍中至少1者。The intercom system of claim 6, wherein during the display of the first image and the second image by the display terminal, at least one of an imaging range, a shooting position, and a display range of the image is continuously adjusted by the tracking function. By. 一種對講機子機,其特徵在於,其係如請求項1至7中任一項之對講機系統所包含之對講機子機,且包含: 上述影像處理部; 受理部,其受理由上述攝像終端拍攝到之影像;及 呼叫部,其受理來自上述來訪者之用於進行呼叫之操作。A walkie-talkie handset, wherein the walkie-talkie handset included in the walkie-talkie system of any one of claims 1 to 7 includes: the image processing unit; and an accepting unit that receives the image captured by the camera terminal And an instruction unit that accepts an operation for making a call from the above-mentioned visitor. 一種顯示終端,其特徵在於: 其係如請求項1至7中任一項之對講機系統所包含之顯示終端,且包含: 上述影像處理部;及 影像受理部,其受理由上述攝像終端拍攝到之影像。A display terminal, comprising: the display terminal included in the walkie-talkie system according to any one of claims 1 to 7, comprising: the image processing unit; and a video receiving unit that receives the image captured by the camera terminal Image. 一種控制裝置,其特徵在於: 其係如請求項1至7中任一項之對講機系統所包含之控制裝置,且包含: 上述影像處理部; 受理部,其受理由上述攝像終端拍攝到之影像;及 通信部,其將由上述影像處理部實施處理後之影像發送至上述顯示終端。A control device according to any one of claims 1 to 7, comprising: the image processing unit; and an accepting unit that accepts an image captured by the camera terminal And a communication unit that transmits the image processed by the image processing unit to the display terminal. 一種程式,其用以使電腦作為如請求項1至7中任一項之對講機系統所包含之上述影像處理部而發揮功能。A program for causing a computer to function as the image processing unit included in the walkie-talkie system of any one of claims 1 to 7.
TW107117508A 2017-06-08 2018-05-23 Interphone system, intercom slave, display terminal, control device and program TWI687103B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-113825 2017-06-08
JP2017113825A JP6883757B2 (en) 2017-06-08 2017-06-08 Intercom system, intercom slave unit, display terminal, control device and program

Publications (2)

Publication Number Publication Date
TW201904276A true TW201904276A (en) 2019-01-16
TWI687103B TWI687103B (en) 2020-03-01

Family

ID=64958461

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107117508A TWI687103B (en) 2017-06-08 2018-05-23 Interphone system, intercom slave, display terminal, control device and program

Country Status (2)

Country Link
JP (1) JP6883757B2 (en)
TW (1) TWI687103B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI754255B (en) * 2019-04-09 2022-02-01 日商松下知識產權經營股份有限公司 Image processing system, image processing method and program

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100248955B1 (en) * 1994-07-18 2000-03-15 유무성 Automatic surveillance device
JP2006066958A (en) * 2004-08-24 2006-03-09 Mitsubishi Electric Corp Intercom with camera
JP2006222888A (en) * 2005-02-14 2006-08-24 Matsushita Electric Works Ltd Video monitoring system for multiple dwelling house
CN101420592A (en) * 2007-10-25 2009-04-29 株式会社Commax Four image splitting intercom system having security function
WO2009098763A1 (en) * 2008-02-06 2009-08-13 Fujitsu Limited Video processor, video processing method and video processing program
JP2011035644A (en) * 2009-07-31 2011-02-17 Panasonic Electric Works Co Ltd Intercom system
JP2011055103A (en) * 2009-08-31 2011-03-17 Aiphone Co Ltd Condominium intercom system
JP5750590B2 (en) * 2010-12-20 2015-07-22 パナソニックIpマネジメント株式会社 Imaging device, intercom device, intercom system
JP6006945B2 (en) * 2012-02-27 2016-10-12 アイホン株式会社 Intercom system
US20170013237A1 (en) * 2014-03-28 2017-01-12 Hitachi Kokusai Electric Inc. Monitoring system and monitoring method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI754255B (en) * 2019-04-09 2022-02-01 日商松下知識產權經營股份有限公司 Image processing system, image processing method and program

Also Published As

Publication number Publication date
TWI687103B (en) 2020-03-01
JP2018207411A (en) 2018-12-27
JP6883757B2 (en) 2021-06-09

Similar Documents

Publication Publication Date Title
JP4677245B2 (en) Image display method, program, image display apparatus, and image display system
JP7185434B2 (en) Electronic device for capturing images using multiple cameras and image processing method using the same
EP1379063A1 (en) Mobile device for capturing, generating and displaying three-dimensional images using a single camera
JP4995059B2 (en) Digital camera
JP2011044863A (en) Image pickup terminal, display terminal, display method and image pickup system
WO2007077614A1 (en) Apparatus for switching picked-up image processings of tv telephone function
US9609302B2 (en) Image processing device, imaging device, image processing method, and recording medium
JP2012249175A (en) Imaging apparatus, display method, and program
JP5874192B2 (en) Image processing apparatus, image processing method, and program
JP3971240B2 (en) Camera with advice function
JP2009071478A (en) Information communication terminal and information communication system
US8345145B2 (en) Mobile communication terminal and focusing method using the same
DE102022118817A1 (en) Image pickup device used as an action camera, control method for the same, and storage medium storing a control program for the same
JP2010161655A (en) Imaging apparatus, and imaging method
JP2012015661A (en) Imaging device and imaging method
TW201904276A (en) Interphone system, intercom slave, display terminal, control device and program capable of reducing the difficulty of viewing each image while displaying multiple types of images
KR20120054746A (en) Method and apparatus for generating three dimensional image in portable communication system
KR101824506B1 (en) Apparatus and method for processing a continuous shooting using a multi-preset data in camera device
JP2009147811A (en) Digital camera
JP7128347B2 (en) Image processing device, image processing method and program, imaging device
JP5212521B2 (en) Image display device
KR100698129B1 (en) Apparatus and Method for full-screen image processing of camera in mobile terminal
JP2021100238A (en) Image processing device, imaging apparatus, and image processing method
TWI754255B (en) Image processing system, image processing method and program
JP2020010111A (en) Display device, imaging device, and control method, program, and imaging system for the devices