TWI687753B - Panoramic camera and panoramic photography system - Google Patents

Panoramic camera and panoramic photography system Download PDF

Info

Publication number
TWI687753B
TWI687753B TW107143877A TW107143877A TWI687753B TW I687753 B TWI687753 B TW I687753B TW 107143877 A TW107143877 A TW 107143877A TW 107143877 A TW107143877 A TW 107143877A TW I687753 B TWI687753 B TW I687753B
Authority
TW
Taiwan
Prior art keywords
audio
panoramic
output
portable device
source direction
Prior art date
Application number
TW107143877A
Other languages
Chinese (zh)
Other versions
TW202022473A (en
Inventor
蔡宗軒
Original Assignee
宏碁股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宏碁股份有限公司 filed Critical 宏碁股份有限公司
Priority to TW107143877A priority Critical patent/TWI687753B/en
Application granted granted Critical
Publication of TWI687753B publication Critical patent/TWI687753B/en
Publication of TW202022473A publication Critical patent/TW202022473A/en

Links

Images

Landscapes

  • Studio Devices (AREA)

Abstract

A panoramic camera and a panoramic photography system are provided. The panoramic camera includes a panoramic image capturing component, an array microphone, a communication component and a processor. The panoramic image capturing component is configured to capture a panoramic film. The array microphone is configured to obtain at least one first audio signal. The communication component is configured to receive a second audio signal from an external device. The processor is configured to calculate a first audio source direction of each first audio signal, calculate a second audio source direction according to the at least one first audio signal, the first audio source direction of each first audio signal and the second audio signal, and select a default perspective according to the second audio source direction in order to output the panoramic film.

Description

全景攝影機與全景攝影系統Panoramic camera and panoramic photography system

本發明是有關於一種全景攝影機，且特別是有關於一種會選擇預設視角來輸出全景影片的全景攝影機與全景攝影系統。The invention relates to a panoramic camera, and in particular to a panoramic camera and a panoramic photography system that select a preset angle of view to output a panoramic movie.

由於虛擬實境（Virtual Reality，VR）的普及，對於全景攝影（panoramic photography）的需求也日漸提升。全景攝影的概念源自於電腦利用電腦播放軟體，如QuickTime播放器等，讓使用者能依本身的需求（例如，視角的改變等）來旋轉影像，產生一種有如身臨其境的視覺效果。Due to the popularity of Virtual Reality (VR), the demand for panoramic photography is also increasing. The concept of panoramic photography originates from the computer's use of computer playback software, such as QuickTime player, to allow users to rotate the image according to their own needs (for example, changing the angle of view, etc.) to produce an immersive visual effect.

近年來發展出各式各樣的全景攝影機，部分的全景攝影機除了能夠拍攝全景影像之外，為了使虛擬實境的體驗更加逼真，全景攝影機還時常會搭載陣列式麥克風，來在拍攝全景影片的過程中取得全景攝影機周圍的聲音，並且能夠定位出各個聲音相對於全景攝影機的位置。如此一來，所輸出的全景影片也有虛擬實境的環繞音效體驗。In recent years, a variety of panoramic cameras have been developed. In addition to being able to shoot panoramic images, some panoramic cameras are often equipped with array microphones in order to make the virtual reality experience more realistic. In the process, the sound around the panoramic camera is obtained, and the position of each sound relative to the panoramic camera can be located. As a result, the panoramic video output also has a virtual reality surround sound experience.

然而，目前全景攝影機所輸出的全景影片通常是以其中一個鏡頭（例如，主前鏡頭）的視角作為預設視角來輸出全景影片，因此使用者必須自行旋轉影像調整視野來尋找影片主角。However, the current panoramic video output by the panoramic camera usually outputs the panoramic video with the angle of view of one of the lenses (for example, the main front lens) as the default angle of view, so the user must rotate the image to adjust the field of view to find the protagonist of the video.

有鑑於此，本發明實施例提供一種全景攝影機與全景攝影系統，能夠選擇預設視角來輸出全景影片，提高便利性。In view of this, embodiments of the present invention provide a panoramic camera and a panoramic photography system, which can select a preset angle of view to output a panoramic video, improving convenience.

本發明實施例的全景攝影機包括全景影像擷取元件、陣列式麥克風、通訊元件以及處理器。全景影像擷取元件用以拍攝全景影片。陣列式麥克風用以取得至少一個第一音訊。通訊元件用以從外部裝置接收第二音訊。處理器耦接於全景影像擷取元件、通訊元件以及陣列式麥克風，並且用以計算每一個第一音訊的第一音源方向，根據所述至少一個第一音訊、各個第一音訊的第一音源方向以及第二音訊，計算第二音源方向，並且根據第二音源方向選擇預設視角來輸出全景影片。The panoramic camera of the embodiment of the present invention includes a panoramic image capturing element, an array microphone, a communication element, and a processor. The panoramic image capturing component is used to shoot a panoramic video. The array microphone is used to obtain at least one first audio. The communication element is used to receive the second audio from the external device. The processor is coupled to the panoramic image capturing element, the communication element and the array microphone, and is used to calculate the direction of the first audio source of each first audio, according to the at least one first audio and the first audio source of each first audio Direction and second audio, calculate the direction of the second audio source, and select a preset angle of view according to the direction of the second audio source to output a panoramic movie.

在本發明的一實施例中，上述的處理器根據所述至少一個第一音訊、各個第一音訊的第一音源方向以及第二音訊，計算第二音源方向時，用以比對所述至少一個第一音訊以及第二音訊，以判定相同於第二音訊的第一音訊，以及以相同於第二音訊的第一音訊的第一音源方向作為第二音源方向。In an embodiment of the invention, the processor described above is used to compare the at least one first audio, the first audio source direction of each first audio, and the second audio when calculating the second audio source direction. A first audio and a second audio to determine the first audio that is the same as the second audio and the first audio source direction that is the same as the first audio of the second audio as the second audio source direction.

在本發明的一實施例中，上述的處理器根據第二音源方向選擇預設視角以輸出全景影片時，用以根據第二音源方向，調整各個第一音訊的音量權重值，以及輸出全景影片以及調整後的至少一個第一音訊。In an embodiment of the present invention, when the aforementioned processor selects a preset angle of view according to the direction of the second audio source to output the panoramic video, it is used to adjust the volume weight value of each first audio according to the direction of the second audio source and output the panoramic video And at least one adjusted first audio message.

在本發明的一實施例中，上述的通訊元件更用以從外部裝置接收控制訊號，並且全景影像擷取元件根據控制訊號拍攝全景影片。In an embodiment of the invention, the above-mentioned communication element is further used to receive a control signal from an external device, and the panoramic image capturing element shoots a panoramic video according to the control signal.

在本發明的一實施例中，上述的全景攝影機更包括方向感測器，用以取得全景攝影機的朝向。In an embodiment of the invention, the aforementioned panoramic camera further includes a direction sensor for obtaining the orientation of the panoramic camera.

本發明實施例的全景攝影系統包括可攜式裝置以及全景攝影機。全景攝影機耦接於可攜式裝置，並且用以拍攝全景影片，以及根據可攜式裝置的所在位置選擇預設視角以輸出全景影片。The panoramic photography system of the embodiment of the present invention includes a portable device and a panoramic camera. The panoramic camera is coupled to the portable device, and is used to shoot a panoramic video, and select a preset angle of view according to the location of the portable device to output the panoramic video.

在本發明的一實施例中，上述的全景攝影機包括陣列式麥克風並且用以藉由陣列式麥克風取得至少一個第一音訊以及至少一個第一音訊的至少一個第一音源方向，其中可攜式裝置包括麥克風，用以取得第二音訊。In an embodiment of the invention, the aforementioned panoramic camera includes an array microphone and is used to obtain at least one first audio and at least one first sound source direction of the at least one first audio by the array microphone, wherein the portable device It includes a microphone to obtain the second audio.

在本發明的一實施例中，上述的全景攝影機根據可攜式裝置的所在位置選擇預設視角以輸出全景影片時，用以根據所述至少一個第一音訊、各個第一音訊的第一音源方向以及第二音訊，計算第二音源方向，以及根據第二音源方向選擇預設視角以輸出全景影片。In an embodiment of the present invention, when the above panoramic camera selects a preset angle of view according to the location of the portable device to output a panoramic video, it is used to generate a first audio source according to the at least one first audio and each first audio Direction and second audio, calculate the direction of the second audio source, and select a preset angle of view according to the direction of the second audio source to output a panoramic video.

在本發明的一實施例中，上述的可攜式裝置包括訊號發射器，用以發出控制訊號，其中全景攝影機更用以接收控制訊號，並且根據控制訊號拍攝全景影片。In an embodiment of the present invention, the above-mentioned portable device includes a signal transmitter to send out a control signal, wherein the panoramic camera is further used to receive the control signal and shoot a panoramic video according to the control signal.

在本發明的一實施例中，上述的全景攝影機根據可攜式裝置的所在位置選擇預設視角以輸出全景影片時，用以根據可攜式裝置的所在位置，調整各個第一音訊的音量權重值，以及輸出全景影片以及調整後的至少一個第一音訊。In an embodiment of the present invention, when the above panoramic camera selects a preset angle of view according to the location of the portable device to output a panoramic video, it is used to adjust the volume weight of each first audio according to the location of the portable device Value, and output the panoramic video and the adjusted at least one first audio.

基於上述，本發明實施例所提出的全景攝影機與全景攝影系統，藉由設置有陣列式麥克風的全景攝影機搭配設置有麥克風的可攜式裝置，全景攝影機能夠計算出可攜式裝置的所在位置並且據以選擇預設視角來輸出全景影片。據此，可以減少影片後製的時間，提高便利性並且提升使用者體驗。Based on the above, the panoramic camera and the panoramic photography system provided by the embodiments of the present invention can calculate the location of the portable device by using the panoramic camera with the array microphone and the portable device with the microphone According to the selection of a preset angle of view to output panoramic video. According to this, the time for post-production of the film can be reduced, the convenience and the user experience can be improved.

為讓本發明的上述特徵和優點能更明顯易懂，下文特舉實施例，並配合所附圖式作詳細說明如下。In order to make the above-mentioned features and advantages of the present invention more obvious and understandable, the embodiments are specifically described below in conjunction with the accompanying drawings for detailed description as follows.

圖1繪示本發明一實施例的全景攝影系統的概要方塊圖。請參照圖1，全景攝影系統10包括全景攝影機100以及可攜式裝置200。全景攝影機100是用以拍攝全景影片，並且全景攝影機會根據可攜式裝置200的所在位置來選擇預設視角以輸出全景影片。舉例來說，當全景攝影機100拍攝全景影片時，全景影片的主角手持或攜帶著可攜式裝置200，則全景攝影機100可以選擇可攜式裝置200的所在位置，也就是全景影片的主角的位置來作為預設視角以輸出全景影片。據此，全景攝影機100所輸出的全景影片將會一直對準全景影片的主角。FIG. 1 is a schematic block diagram of a panoramic photography system according to an embodiment of the invention. Referring to FIG. 1, the panoramic camera system 10 includes a panoramic camera 100 and a portable device 200. The panoramic camera 100 is used to shoot a panoramic video, and the panoramic camera will select a preset angle of view according to the location of the portable device 200 to output a panoramic video. For example, when the panoramic camera 100 shoots a panoramic video, and the protagonist of the panoramic video holds or carries the portable device 200, the panoramic camera 100 can select the location of the portable device 200, that is, the position of the protagonist of the panoramic video Comes as a preset perspective to output a panoramic movie. Accordingly, the panoramic movie output by the panoramic camera 100 will always be aligned with the protagonist of the panoramic movie.

全景攝影機100包括處理器110、全景影像擷取元件120、陣列式麥克風130以及通訊元件140，並且全景影像擷取元件120、陣列式麥克風130以及通訊元件140皆耦接於處理器。The panoramic camera 100 includes a processor 110, a panoramic image capturing element 120, an array microphone 130, and a communication element 140, and the panoramic image capturing element 120, the array microphone 130, and the communication element 140 are all coupled to the processor.

處理器110用以控制全景攝影機100的整體運作。在一些實施例中，處理器110例如是雙核心、四核心或八核心等各類型的中央處理器（central processing unit，CPU）、系統晶片（system-on-chip，SOC）、應用處理器（application processor）、媒體處理器（media processor）、微處理器（microprocessor）、數位信號處理器（digital signal processor）可程式化控制器、特殊應用積體電路（application specific integrated circuits, ASIC）、可程式化邏輯裝置（programmable logic device, PLD）或其他類似裝置或這些裝置的組合，本發明不在此限。The processor 110 is used to control the overall operation of the panoramic camera 100. In some embodiments, the processor 110 is, for example, a dual-core, quad-core, or eight-core central processing unit (CPU), system-on-chip (SOC), application processor ( application processor, media processor, microprocessor, digital signal processor programmable controller, application specific integrated circuits (ASIC), programmable A programmable logic device (programmable logic device, PLD) or other similar device or a combination of these devices is not limited in this invention.

全景影像擷取元件120用以拍攝全景影片。在一些實施例中，全景影像擷取元件120例如包括多個分列排布、正四面體排布、水平排布、對稱排布或錯位排布的非魚眼鏡頭或魚眼鏡頭，本發明不在此限。所屬領域具備通常知識者當可依其能力或需求來實作具備拍攝全景影片能力的全景影像擷取元件120。The panoramic image capturing element 120 is used to shoot a panoramic video. In some embodiments, the panoramic image capturing element 120 includes, for example, a plurality of non-fisheye lenses or fisheye lenses arranged in a row, regular tetrahedron, horizontal, symmetrical or misaligned arrangement. Not limited to this. Those with ordinary knowledge in the field can implement the panoramic image capturing element 120 with the ability to shoot panoramic videos according to their capabilities or needs.

陣列式麥克風130用以取得全景攝影機周圍的至少一個第一音訊S1，而處理器110會根據陣列式麥克風130所取得的至少一個第一音訊S1計算每一個第一音訊S1相對於全景攝影機100的第一音源方向，也就是第一音訊S1的來源方向。舉例來說，相對於全景攝影機100的方向可以是以全景攝影機100的其中一個鏡頭（例如，主前鏡頭）的視線方向為基準來計算的一維角度（例如，方位角）或二維角度（例如，方位角與極矩角），本發明不在此限。在一些實施例中，陣列式麥克風130例如包括陣列式排列的四個、八個、十六個、二十四個或是其他數量的麥克風，本發明不在此限。所屬領域具備通常知識者應當可以理解處理器110藉由陣列式麥克風130取得至少一個第一音訊S1以及每一個第一音訊S1的第一音源方向的方式，故在此不再贅述。The array microphone 130 is used to obtain at least one first audio S1 around the panoramic camera, and the processor 110 calculates each first audio S1 relative to the panoramic camera 100 according to the at least one first audio S1 obtained by the array microphone 130 The first audio source direction is also the source direction of the first audio S1. For example, the direction relative to the panoramic camera 100 may be a one-dimensional angle (eg, azimuth angle) or a two-dimensional angle (based on the direction of the line of sight of one of the lenses of the panoramic camera 100 (eg, the main front lens)). For example, azimuth angle and polar moment angle), the invention is not limited to this. In some embodiments, the array microphone 130 includes, for example, four, eight, sixteen, twenty-four, or other numbers of microphones arranged in an array, and the invention is not limited thereto. Those of ordinary skill in the art should understand the manner in which the processor 110 obtains at least one first audio signal S1 and the first audio source direction of each first audio signal S1 through the array microphone 130, so it will not be repeated here.

通訊元件140用以從外部裝置（例如，可攜式裝置200）接收第二音訊S2。在一些實施例中，通訊元件140例如是無線網路模組、紅外線或藍芽模組等能夠從外部裝置（例如，可攜式裝置200）接收訊號的元件。然而，本發明並不限於此。在一些實施例中，通訊元件140還用以從外部裝置（例如，可攜式裝置200）接收控制訊號，而處理器110會根據控制訊號來控制全景影像擷取元件120拍攝全景影片。The communication element 140 is used to receive the second audio S2 from an external device (for example, the portable device 200). In some embodiments, the communication component 140 is, for example, a wireless network module, an infrared ray, or a Bluetooth module, which can receive signals from an external device (for example, the portable device 200). However, the present invention is not limited to this. In some embodiments, the communication element 140 is also used to receive control signals from an external device (for example, the portable device 200), and the processor 110 controls the panoramic image capturing element 120 to shoot a panoramic video according to the control signals.

在一些實施例中，全景攝影機100還包括方向感測器150。方向感測器150耦接於處理器110，並且用以取得全景攝影機100的朝向（orientation）。藉由方向感測器150的輔助，全景攝影機100所輸出的全景影片也能夠包含絕對方向（例如，東方、西方、南方或北方）等資訊。In some embodiments, the panoramic camera 100 further includes a direction sensor 150. The direction sensor 150 is coupled to the processor 110 and used to obtain the orientation of the panoramic camera 100. With the assistance of the direction sensor 150, the panoramic video output by the panoramic camera 100 can also contain information such as absolute directions (eg, east, west, south, or north).

可攜式裝置200包括麥克風210以及耦接於麥克風210的訊號發射器220。麥克風210是用以取得第二音訊S2，並且訊號發射器220用以將麥克風210所取得的第二音訊S2傳遞至全景攝影機100的通訊元件140。The portable device 200 includes a microphone 210 and a signal transmitter 220 coupled to the microphone 210. The microphone 210 is used to obtain the second audio S2, and the signal transmitter 220 is used to transmit the second audio S2 obtained by the microphone 210 to the communication element 140 of the panoramic camera 100.

在一些實施例中，訊號發射器220更用以發出控制訊號至全景攝影機110，以使全景攝影機110能夠根據控制訊號來拍攝全景影片。舉例來說，可攜式裝置200可以實作為全景攝影機100的遙控器，以遠端地控制全景攝影機100拍攝全景影片。In some embodiments, the signal transmitter 220 is further used to send a control signal to the panoramic camera 110, so that the panoramic camera 110 can shoot a panoramic video according to the control signal. For example, the portable device 200 can be implemented as a remote controller of the panoramic camera 100 to remotely control the panoramic camera 100 to shoot a panoramic video.

圖2繪示本發明一實施例的可攜式裝置的示意圖。請參照圖2，在一些實施例中，可攜式裝置200除了麥克風210以及訊號發射器220之外，更例如可以設置有至少一個按鍵BTN，使用者可以透過按壓按鍵BTN來發射控制訊號以對全景攝影機100進行控制。必須說明的是，圖2僅示範性的舉例說明可攜式裝置200的一種實施態樣，但本發明並不限於此。2 is a schematic diagram of a portable device according to an embodiment of the invention. Please refer to FIG. 2. In some embodiments, in addition to the microphone 210 and the signal transmitter 220, the portable device 200 may further be provided with at least one button BTN. The user can transmit a control signal by pressing the button BTN to The panoramic camera 100 controls. It must be noted that FIG. 2 only exemplarily illustrates an embodiment of the portable device 200, but the present invention is not limited thereto.

以下將搭配圖3至圖5來對本發明實施例的全景攝影機與全景攝影系統的運作方式以及使用情境進行舉例說明。The operation modes and usage scenarios of the panoramic camera and panoramic photography system according to embodiments of the present invention will be described below with reference to FIGS. 3 to 5.

圖3繪示本發明一實施例的全景攝影系統的使用情境的示意圖。請參照圖3，全景攝影機100在拍攝全景影片時周圍包括人物P1至P5，其中人物P2持有可攜式裝置200，且人物P3是位於全景攝影機100的前鏡頭F正前方。FIG. 3 is a schematic diagram illustrating a usage situation of a panoramic photography system according to an embodiment of the invention. Referring to FIG. 3, the panoramic camera 100 includes characters P1 to P5 when shooting a panoramic video, wherein the character P2 holds the portable device 200, and the character P3 is located directly in front of the front lens F of the panoramic camera 100.

全景攝影機100在全景影像擷取元件120拍攝全景影片時，會藉由陣列式麥克風130取得至少一個第一音訊S1，而處理器110會根據陣列式麥克風130取得的至少一個第一音訊S1來計算出每一個第一音訊S1的第一音源方向。The panoramic camera 100 obtains at least one first audio S1 through the array microphone 130 when the panoramic image capturing element 120 shoots a panoramic video, and the processor 110 calculates based on the at least one first audio S1 obtained from the array microphone 130 The first sound source direction of each first audio S1 is output.

以圖3為例，陣列式麥克風130取得分別來自使用者P1、P2、P3、P4、P5的第一音訊S 11、S 12、S 13、S 14、S 15，而處理器110例如會據以計算出第一音訊S 11的第一音源方向D 11（以虛線向量繪示）、第一音訊S 12的第一音源方向D 12、第一音訊S 13的第一音源方向D 13、第一音訊S 14的第一音源方向D 14以及第一音訊S 15的第一音源方向D 15。 Taking FIG. 3 as an example, the array microphone 130 obtains the first audio signals S 11 , S 12 , S 13 , S 14 , and S 15 from the users P1, P2, P3, P4, and P5, respectively. to calculate a first audio sound direction 11 of a first S D 11 (shown in phantom vector), a first audio sound direction a first S 12 D 12, a first audio sound source 13 in the direction S of the first D 13, of A first audio source direction D 14 of an audio S 14 and a first audio source direction D 15 of the first audio S 15 .

可攜式裝置200取得第二音訊S2並且會將第二音訊S2傳遞給全景攝影機100。The portable device 200 obtains the second audio S2 and transmits the second audio S2 to the panoramic camera 100.

以圖3為例，由於可攜式裝置200與人物P2的距離最接近，因此麥克風210會錄製到主要包括人物P2的聲音的第二音訊S2。隨後，可攜式裝置200會透過訊號發射器220來將其所取得的第二音訊S2傳遞給全景攝影機100。Taking FIG. 3 as an example, since the distance between the portable device 200 and the person P2 is the closest, the microphone 210 records the second audio S2 mainly including the sound of the person P2. Then, the portable device 200 transmits the acquired second audio S2 to the panoramic camera 100 through the signal transmitter 220.

全景攝影機100會根據陣列式麥克風130所取得的至少一個第一音訊S1、每一個第一音訊S1的第一音源方向以及第二音訊S2，來計算第二音源方向。在一些實施例中，處理器110會比對陣列式麥克風130所取得的至少一個第一音訊S1以及通訊元件140所接收的第二音訊S2，以找出相同於第二音訊S2的第一音訊S1，並且以相同於第二音訊S2的第一音訊S1的第一音源方向作為第二音源方向，如此一來，第二音源方向例如會對應於可攜式裝置200的所在位置。The panoramic camera 100 calculates the second audio source direction according to the at least one first audio signal S1 obtained by the array microphone 130 and the first audio source direction of each first audio signal S1 and the second audio signal S2. In some embodiments, the processor 110 compares the at least one first audio S1 obtained by the array microphone 130 and the second audio S2 received by the communication element 140 to find the first audio identical to the second audio S2 S1, and the first audio source direction of the first audio S1 that is the same as the second audio S2 is used as the second audio source direction. In this way, the second audio source direction corresponds to the location of the portable device 200, for example.

以圖3為例，處理器110例如會根據第一音訊S 11、S 12、S 13、S 14、S 15及其第一音源方向D 11、D 12、D 13、D 14、D 15以及第二音訊S2，來計算第二音源方向D2（以實線向量繪示）。在一些實施例中，由於陣列式麥克風130與麥克風210都會錄製到來自可攜式裝置200所在位置的聲音（例如，人物P2發出的聲音），因此處理器110例如可以比對第一音訊S 11、S 12、S 13、S 14、S 15與第二音源S2（例如，比對音訊波形），便能夠找出與第二音訊S2對應於相同來源（例如，人物P2發出的聲音）的第一音訊S 12。因此，處理器110會將第一音訊S­ 12的第一音源方向D 12作為第二音源方向D2。在圖3實施例中，第一音源方向D 13（例如，相同於前鏡頭F的方向）與第一音源方向D 12之間的夾角例如為θ，因此第一音源方向D 13與第二音源方向D2之間的夾角也是θ。 Taking FIG. 3 as an example, the processor 110 may, for example, according to the first audio signals S 11 , S 12 , S 13 , S 14 , S 15 and its first sound source directions D 11 , D 12 , D 13 , D 14 , D 15 and The second audio signal S2 is used to calculate the second audio source direction D2 (shown by a solid line vector). In some embodiments, since the microphone array 130 and the microphone 210 are recorded to the sound from the position where the portable device 200 (e.g., the sound emitted by the characters P2), the processor 110 may, for example, the first audio than 11 S , S 12 , S 13 , S 14 , S 15 and the second audio source S2 (for example, comparing the audio waveform), you can find the second source corresponding to the same source of the second audio S2 (for example, the sound of the character P2) One audio S 12 . Thus, a first audio processor 110 will first sound direction S 12 D 12 as a second sound source direction D2. In the embodiment of FIG. 3, the angle between the first sound source direction D 13 (for example, the same direction as the front lens F) and the first sound source direction D 12 is, for example, θ, so the first sound source direction D 13 and the second sound source The angle between the directions D2 is also θ.

全景攝影機100在輸出其所拍攝的全景影片時，會根據第二音源方向來選擇預設視角以輸出全景影片。具體來說，預設視角例如是輸出全景影片時影片中心。When the panoramic camera 100 outputs the panoramic video it shoots, it will select a preset angle of view according to the direction of the second audio source to output the panoramic video. Specifically, the preset angle of view is, for example, the center of the movie when the panoramic movie is output.

圖4繪示習知以前鏡頭的視角作為預設視角來輸出全景影像的示意圖。請同時參照圖3與圖4，習知的全景攝影機在輸出全景影片VD0時，會以前鏡頭F的視角作為預設視角來輸出全景影片VD0，因此會輸出以人物P3為中心的影片。舉例來說，若全景影片VD0是輸出至顯示器（未繪示）時，在使用者沒有旋轉影像前，顯示器將顯示如圖4所示的視野範圍FOV內的影像，其中視野範圍FOV是對應於顯示器的規格。FIG. 4 shows a schematic diagram of outputting a panoramic image using the angle of view of the previous lens as a preset angle of view. Please refer to FIG. 3 and FIG. 4 at the same time, when the conventional panoramic camera outputs the panoramic video VD0, the perspective of the previous lens F is used as the preset perspective to output the panoramic video VD0, so the video centered on the character P3 is output. For example, if the panoramic video VD0 is output to the display (not shown), before the user rotates the image, the display will display the image within the field of view FOV shown in FIG. 4, where the field of view FOV corresponds to The specifications of the monitor.

圖5繪示本發明一實施例中根據第二音源方向選擇預設視角來輸出全景影像的示意圖。請同時參照圖3與圖5，在本發明的一些實施例中，全景攝影機100在輸出全景影片VD1時，會根據第二音源方向D2選擇預設視角來輸出全景影片VD1，例如以第二音源方向D2作為預設視角來輸出全景影片VD1。由於第二音源方向D2與人物P3所在的第一音源方向D 13之間的夾角為θ，因此全景攝影機100會輸出以人物P2為中心的影片。舉例來說，若全景影片VD1是輸出至顯示器（未繪示）時，在使用者沒有旋轉影像前，顯示器將顯示如圖5所示的視野範圍FOV內的影像，其中視野範圍FOV是對應於顯示器的規格。 FIG. 5 is a schematic diagram of selecting a preset angle of view to output a panoramic image according to the direction of the second sound source in an embodiment of the present invention. Please refer to FIGS. 3 and 5 at the same time. In some embodiments of the present invention, when the panoramic camera 100 outputs the panoramic video VD1, it will output a panoramic video VD1 by selecting a preset angle of view according to the second audio source direction D2, for example The direction D2 is used as the preset angle of view to output the panoramic video VD1. Since the angle between the second sound source direction D2 and the first sound source direction D 13 where the character P3 is located is θ, the panoramic camera 100 outputs a video centered on the character P2. For example, if the panoramic video VD1 is output to a display (not shown), before the user rotates the image, the display will display the image within the field of view FOV shown in FIG. 5, where the field of view FOV corresponds to The specifications of the monitor.

據此，全景攝影機100可以直接根據可攜式裝置200的所在位置來選擇預設視角，以輸出全景影片，節省了使用者後製的時間。According to this, the panoramic camera 100 can directly select a preset angle of view according to the location of the portable device 200 to output a panoramic video, which saves the user post-production time.

在一些實施例中，除了根據可攜式裝置200的所在位置選擇預設視角來輸出全景影片之外，還會根據可攜式裝置200的所在位置來調整各個第一音訊S1的音量權重值，以輸出調整後的第一音訊S1。舉例來說，處理器110可以根據各個第一音源方向與第二音源方向之間的夾角，來調整每一個第一音訊S1的音量權重值，使得第一音源方向與第二音源方向之間夾角越大的第一音訊S1具有越小的音量。In some embodiments, in addition to selecting a preset angle of view to output a panoramic video according to the location of the portable device 200, the volume weight value of each first audio S1 is adjusted according to the location of the portable device 200, To output the adjusted first audio S1. For example, the processor 110 may adjust the volume weight value of each first audio S1 according to the angle between each first sound source direction and the second sound source direction, so that the angle between the first sound source direction and the second sound source direction The larger the first audio S1 has the smaller volume.

以圖     3為例，處理器110會根據第二音源方向D2來調整第一音訊S 11、S 12、S 13、S 14、S 15的音量權重值，以在根據第二音源方向D2選擇預設視角以輸出全景影片時，輸出調整後的第一音訊S 11、S 12、S 13、S 14、S 15。舉例來說，由於第一音源方向D 12與第二音源方向D2的夾角最小，因此第一音訊S 12具有最高的音量權重值，而第一音源方向D 15與第二音源方向D2的夾角最大，因此第一音訊S 15具有最低的音量權重值，以此類推。 Taking FIG. 3 as an example, the processor 110 adjusts the volume weight values of the first audio S 11 , S 12 , S 13 , S 14 , and S 15 according to the second audio source direction D2 to select the pre When setting the angle of view to output a panoramic video, the adjusted first audio S 11 , S 12 , S 13 , S 14 , S 15 is output. For example, since the angle between the first sound source direction D 12 and the second sound source direction D2 is the smallest, the first audio S 12 has the highest volume weight value, and the first sound source direction D 15 and the second sound source direction D2 have the largest angle Therefore, the first audio S 15 has the lowest volume weight value, and so on.

綜上所述，本發明實施例所提出的全景攝影機與全景攝影系統，藉由設置有陣列式麥克風的全景攝影機搭配設置有麥克風的可攜式裝置，全景攝影機能夠計算出可攜式裝置的所在位置並且據以選擇預設視角來輸出全景影片。據此，可以減少影片後製的時間，提高便利性並且提升使用者體驗。在一些實施例中，全景攝影機與全景攝影系統更相應與所選擇的預設視角來調整所輸出的音量，使得所輸出的全景影片更加逼真。In summary, the panoramic camera and the panoramic photography system provided by the embodiments of the present invention can calculate the location of the portable device by using the panoramic camera with the array microphone and the portable device with the microphone Location and select a preset perspective to output a panoramic movie. According to this, the time for post-production of the film can be reduced, the convenience and the user experience can be improved. In some embodiments, the panoramic camera and the panoramic photography system adjust the output volume corresponding to the selected preset angle of view, so that the panoramic video output is more realistic.

雖然本發明已以實施例揭露如上，然其並非用以限定本發明，任何所屬技術領域中具有通常知識者，在不脫離本發明的精神和範圍內，當可作些許的更動與潤飾，故本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed as above with examples, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention shall be subject to the scope defined in the appended patent application.

10:全景攝影系統10: panoramic photography system

100:全景攝影機100: panoramic camera

110:處理器110: processor

120:全景影像擷取元件120: Panoramic image capture component

130:陣列式麥克風130: Array microphone

140:通訊元件140: communication components

150:方向感測器150: direction sensor

200:可攜式裝置200: portable device

210:麥克風210: microphone

220:訊號發射器220: signal transmitter

BTN:按鍵BTN: Button

D 11、D 12、D 13、D 14、D 15:第一音源方向D 11 , D 12 , D 13 , D 14 , D 15 : the direction of the first sound source

D2:第二音源方向D2: direction of the second sound source

F:前鏡頭F: front lens

FOV:視野範圍FOV: field of view

P1、P2、P3、P4、P5:人物P1, P2, P3, P4, P5: characters

S1:S 11、S 12、S 13、S 14、S 15:第一音訊 S1: S 11, S 12, S 13, S 14, S 15: a first audio

S2:第二音訊S2: Second audio

VD0、VD1:全景影片 VD0, VD1: panoramic video

圖1繪示本發明一實施例的全景攝影系統的概要方塊圖。 圖2繪示本發明一實施例的可攜式裝置的示意圖。 圖3繪示本發明一實施例的全景攝影系統的使用情境的示意圖。 圖4繪示習知以前鏡頭的視角作為預設視角來輸出全景影像的示意圖。 圖5繪示本發明一實施例中根據第二音源方向選擇預設視角來輸出全景影像的示意圖。FIG. 1 is a schematic block diagram of a panoramic photography system according to an embodiment of the invention. 2 is a schematic diagram of a portable device according to an embodiment of the invention. FIG. 3 is a schematic diagram illustrating a usage situation of a panoramic photography system according to an embodiment of the invention. FIG. 4 shows a schematic diagram of outputting a panoramic image using the angle of view of the previous lens as a preset angle of view. FIG. 5 is a schematic diagram of selecting a preset angle of view to output a panoramic image according to the direction of the second sound source in an embodiment of the present invention.

10:全景攝影系統 10: panoramic photography system

100:全景攝影機 100: panoramic camera

110:處理器 110: processor

120:全景影像擷取元件 120: Panoramic image capture component

130:陣列式麥克風 130: Array microphone

140:通訊元件 140: communication components

150:方向感測器 150: direction sensor

200:可攜式裝置 200: portable device

210:麥克風 210: microphone

220:訊號發射器 220: signal transmitter

S1:第一音訊 S1: First audio

S2:第二音訊 S2: Second audio

Claims (9)

一種全景攝影機，包括：一全景影像擷取元件，用以拍攝一全景影片；一陣列式麥克風，用以取得至少一第一音訊；一通訊元件，用以從一外部裝置接收一第二音訊；以及一處理器，耦接於該全景影像擷取元件、該通訊元件以及該陣列式麥克風，用以：計算該至少一第一音訊的至少一第一音源方向；根據該至少一第一音訊、該至少一第一音源方向以及該第二音訊，計算一第二音源方向；以及根據該第二音源方向選擇一預設視角以輸出該全景影片，其中該處理器根據該至少一第一音訊、該至少一第一音源方向以及該第二音訊，計算該第二音源方向時，用以：比對該至少一第一音訊以及該第二音訊，以判定相同於該第二音訊的該第一音訊；以及以相同於該第二音訊的該第一音訊的該第一音源方向作為該第二音源方向。 A panoramic camera includes: a panoramic image capturing element for shooting a panoramic video; an array microphone for obtaining at least a first audio; a communication element for receiving a second audio from an external device; And a processor, coupled to the panoramic image capturing element, the communication element and the array microphone, for: calculating at least a first sound source direction of the at least a first audio; according to the at least a first audio, Calculating a second audio source direction by the at least one first audio source direction and the second audio; and selecting a preset angle of view to output the panoramic video according to the second audio source direction, wherein the processor is based on the at least one first audio, The at least one first audio source direction and the second audio, when calculating the second audio source direction, are used to: compare the at least one first audio and the second audio to determine the first that is the same as the second audio Audio; and using the first audio source direction of the first audio that is the same as the second audio as the second audio source direction. 如申請專利範圍第1項所述的全景攝影機，其中該處理器根據該第二音源方向選擇該預設視角以輸出該全景影片時，用以：根據該第二音源方向，調整各該第一音訊的一音量權重值； 以及輸出該全景影片以及該至少一第一音訊。 The panoramic camera as described in item 1 of the patent application scope, wherein the processor selects the preset angle of view according to the direction of the second sound source to output the panoramic film, for: adjusting each of the first according to the direction of the second sound source A volume weight value of audio; And output the panoramic video and the at least one first audio. 如申請專利範圍第1項至第2項中任一項所述的全景攝影機，其中該通訊元件更用以從該外部裝置接收一控制訊號，並且該全景影像擷取元件根據該控制訊號拍攝該全景影片。 The panoramic camera as described in any one of claims 1 to 2, wherein the communication component is further used to receive a control signal from the external device, and the panoramic image capture component captures the control signal according to the control signal Panoramic video. 如申請專利範圍第1項至第2項中任一項所述的全景攝影機，更包括：一方向感測器，用以取得該全景攝影機的一朝向。 The panoramic camera as described in any one of claims 1 to 2 further includes: a direction sensor for obtaining an orientation of the panoramic camera. 一種全景攝影系統，包括：一可攜式裝置；以及一全景攝影機，耦接於該可攜式裝置，用以：拍攝一全景影片；以及根據該可攜式裝置的一所在位置選擇一預設視角以輸出該全景影片，其中該全景攝影機包括一陣列式麥克風並且用以藉由該陣列式麥克風取得至少一第一音訊以及該至少一第一音訊的至少一第一音源方向，其中該可攜式裝置包括一麥克風，用以取得一第二音訊，其中該全景攝影機根據該可攜式裝置的該所在位置選擇該預設視角以輸出該全景影片時，用以：根據該可攜式裝置的該所在位置，調整各該第一音訊的一音量權重值；以及 輸出該全景影片以及該至少一第一音訊。。 A panoramic photography system includes: a portable device; and a panoramic camera, coupled to the portable device, for: shooting a panoramic video; and selecting a preset according to a location of the portable device The angle of view to output the panoramic video, wherein the panoramic camera includes an array microphone and is used to obtain at least a first audio and at least a first audio source direction of the at least a first audio through the array microphone, wherein the portable The portable device includes a microphone for obtaining a second audio, wherein when the panoramic camera selects the preset angle of view according to the location of the portable device to output the panoramic video, it is used to: according to the portable device’s At that location, adjust a volume weight value for each of the first audio; and Output the panoramic video and the at least one first audio. . 如申請專利範圍第5項所述的全景攝影系統，其中該全景攝影機根據該可攜式裝置的該所在位置選擇該預設視角以輸出該全景影片時，用以：根據該至少一第一音訊、該至少一第一音源方向以及該第二音訊，計算一第二音源方向；以及根據該第二音源方向選擇該預設視角以輸出該全景影片。 The panoramic photography system as described in item 5 of the patent application scope, wherein the panoramic camera selects the preset angle of view to output the panoramic video according to the location of the portable device, for: according to the at least one first audio , The at least one first audio source direction and the second audio, calculate a second audio source direction; and select the preset angle of view according to the second audio source direction to output the panoramic video. 如申請專利範圍第5項所述的全景攝影系統，其中該可攜式裝置包括一訊號發射器，用以發出一控制訊號，其中該全景攝影機更用以接收該控制訊號，並且根據該控制訊號拍攝該全景影片。 The panoramic photography system as described in item 5 of the patent application, wherein the portable device includes a signal transmitter for sending out a control signal, wherein the panoramic camera is further used for receiving the control signal, and according to the control signal Take this panoramic video. 一種全景攝影機，包括：一全景影像擷取元件，用以拍攝一全景影片；一陣列式麥克風，用以取得至少一第一音訊；一通訊元件，用以從一外部裝置接收一第二音訊；以及一處理器，耦接於該全景影像擷取元件、該通訊元件以及該陣列式麥克風，用以：計算該至少一第一音訊的至少一第一音源方向；根據該至少一第一音訊、該至少一第一音源方向以及該第二音訊，計算一第二音源方向；以及根據該第二音源方向選擇一預設視角以輸出該全景影片， 其中該處理器根據該第二音源方向選擇該預設視角以輸出該全景影片時，用以：根據該第二音源方向，調整各該第一音訊的一音量權重值；以及輸出該全景影片以及該至少一第一音訊。 A panoramic camera includes: a panoramic image capturing element for shooting a panoramic video; an array microphone for obtaining at least a first audio; a communication element for receiving a second audio from an external device; And a processor, coupled to the panoramic image capturing element, the communication element and the array microphone, for: calculating at least a first sound source direction of the at least a first audio; according to the at least a first audio, Calculating the second audio source direction by the at least one first audio source direction and the second audio; and selecting a preset angle of view according to the second audio source direction to output the panoramic video, When the processor selects the preset angle of view according to the direction of the second audio source to output the panoramic video, it is used to: adjust a volume weight value of each of the first audio according to the direction of the second audio source; and output the panoramic video and The at least one first message. 一種全景攝影系統，包括：一可攜式裝置；以及一全景攝影機，耦接於該可攜式裝置，用以：拍攝一全景影片；以及根據該可攜式裝置的一所在位置選擇一預設視角以輸出該全景影片，其中該可攜式裝置包括一訊號發射器，用以發出一控制訊號，其中該全景攝影機更用以接收該控制訊號，並且根據該控制訊號拍攝該全景影片，其中該全景攝影機根據該可攜式裝置的該所在位置選擇該預設視角以輸出該全景影片時，用以：根據該可攜式裝置的該所在位置，調整各該第一音訊的一音量權重值；以及輸出該全景影片以及該至少一第一音訊。 A panoramic photography system includes: a portable device; and a panoramic camera, coupled to the portable device, for: shooting a panoramic video; and selecting a preset according to a location of the portable device Viewing angles to output the panoramic video, wherein the portable device includes a signal transmitter to send out a control signal, wherein the panoramic camera is further used to receive the control signal, and shoot the panoramic video according to the control signal, wherein the When the panoramic camera selects the preset angle of view to output the panoramic video according to the location of the portable device, it is used to: adjust a volume weight value of each of the first audio according to the location of the portable device; And output the panoramic video and the at least one first audio.
TW107143877A 2018-12-06 2018-12-06 Panoramic camera and panoramic photography system TWI687753B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107143877A TWI687753B (en) 2018-12-06 2018-12-06 Panoramic camera and panoramic photography system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107143877A TWI687753B (en) 2018-12-06 2018-12-06 Panoramic camera and panoramic photography system

Publications (2)

Publication Number Publication Date
TWI687753B true TWI687753B (en) 2020-03-11
TW202022473A TW202022473A (en) 2020-06-16

Family

ID=70767217

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107143877A TWI687753B (en) 2018-12-06 2018-12-06 Panoramic camera and panoramic photography system

Country Status (1)

Country Link
TW (1) TWI687753B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200401943A (en) * 2002-06-27 2004-02-01 Microsoft Corp Integrated design for omni-directional camera and microphone array
CN101501564A (en) * 2006-08-03 2009-08-05 国际商业机器公司 Video surveillance system and method with combined video and audio recognition
TWM523125U (en) * 2015-10-01 2016-06-01 Chia-Jung Lee Image capturing module and system thereof
US20170324900A1 (en) * 2016-05-09 2017-11-09 Heroic Power Co., Ltd. Instruction input apparatus with panoramic photography function

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200401943A (en) * 2002-06-27 2004-02-01 Microsoft Corp Integrated design for omni-directional camera and microphone array
CN101501564A (en) * 2006-08-03 2009-08-05 国际商业机器公司 Video surveillance system and method with combined video and audio recognition
TWM523125U (en) * 2015-10-01 2016-06-01 Chia-Jung Lee Image capturing module and system thereof
US20170324900A1 (en) * 2016-05-09 2017-11-09 Heroic Power Co., Ltd. Instruction input apparatus with panoramic photography function

Also Published As

Publication number Publication date
TW202022473A (en) 2020-06-16

Similar Documents

Publication Publication Date Title
US20190180783A1 (en) Camera array including camera modules
JP2023129649A (en) Communication management system, communication system, communication management method and program
WO2018051815A1 (en) Information processing apparatus and method and program
US11523101B2 (en) System and method for capturing omni-stereo videos using multi-sensors
JP5828038B2 (en) Image capturing apparatus and image capturing method
US10681276B2 (en) Virtual reality video processing to compensate for movement of a camera during capture
CN103562791A (en) Apparatus and method for panoramic video imaging with mobile computing devices
TW201734948A (en) A method, system and device for generating associated audio and visual signals in a wide angle image system
US20170195565A1 (en) Two-lens optical arrangement
US20200162671A1 (en) Image capturing system, terminal and computer readable medium which correct images
JP2016140078A (en) Image generation device and image generation method
JP7031280B2 (en) Image processing equipment, image processing systems and programs
KR101814714B1 (en) Method and system for remote control of camera in smart phone
JP2018033107A (en) Video distribution device and distribution method
WO2013186805A1 (en) Image pickup device and image pickup method
JP6950793B2 (en) Electronics and programs
JP7487464B2 (en) IMAGE PROCESSING APPARATUS, IMAGING APPARATUS, VIDEO PLAYBACK SYSTEM, METHOD, AND PROGRAM
TWI687753B (en) Panoramic camera and panoramic photography system
JP2021117924A (en) Image processing apparatus, image processing system, imaging apparatus, image processing method, and program
JP2020204874A (en) Image processing system, imaging system, image processing apparatus, imaging apparatus and program
TWI644233B (en) Instruction input apparatus with panoramic photography function
JP6487512B2 (en) Head mounted display and image generation method
CN114143460A (en) Video display method and device and electronic equipment
CN217445411U (en) System for generating successive images from independent image sources
JPWO2019038885A1 (en) Information processing apparatus and image output method