TWM604409U

TWM604409U - Camera with tracking function

Info

Publication number: TWM604409U
Application number: TW109209504U
Authority: TW
Inventors: 楊長運
Original assignee: 正崴精密工業股份有限公司
Priority date: 2020-07-24
Filing date: 2020-07-24
Publication date: 2020-11-21

Abstract

本創作公開一種具有追蹤功能的攝像機，包括有：一影像擷取裝置，設有至少一鏡頭及至少一影像感測器，所述鏡頭與所述影像感測器相連接；一中央處理模組，設有後段晶片、微控制器，所述後段晶片與所述影像感測器相連接，所述微控制器具有臉部動作辨識單元；一音訊擷取裝置，設有複數麥克風，所述麥克風與所述後段晶片相連接；至少一步進馬達，所述步進馬達與所述微控制器相連接。本創作具有追蹤功能的攝像機能於使用者在進行視訊時，藉由鎖定追蹤的功能，當發言者移動時，能維持發言者在鏡頭中的位置、保持發言者說話的聲音品質，能順暢地保持視訊進行。The present invention discloses a camera with tracking function, including: an image capturing device provided with at least one lens and at least one image sensor, the lens is connected with the image sensor; a central processing module , A back-end chip and a microcontroller are provided, the back-end chip is connected to the image sensor, the microcontroller has a facial motion recognition unit; an audio capture device is provided with a plurality of microphones, the microphones Connected with the back-stage wafer; at least one stepper motor, and the stepper motor is connected with the microcontroller. The camera with tracking function of this creation can maintain the position of the speaker in the lens and maintain the sound quality of the speaker's speech by locking the tracking function when the user is performing video. Keep the video going.

Description

具有追蹤功能的攝像機Camera with tracking function

本創作涉及一種攝像機，尤其是涉及一種具有追蹤功能的攝像機。This creation relates to a camera, especially to a camera with tracking function.

當多位人員在同一攝像機前進行視訊通話或視訊會議時，通常是使用可攜式筆記型電腦或平板電腦，然而，由於目前的結構都是採用靜態且預先嵌入式的攝像機模組。當多位人員之中有人發言時，該發言者不一定會在鏡頭的畫面之中，因此攝像機模組無法擷取到該發言者的畫面，使得設備必須要不斷調整位置去對準發言人，造成使用上的不便。When multiple people conduct a video call or video conference in front of the same camera, they usually use a portable notebook computer or a tablet computer. However, the current structure uses a static and pre-embedded camera module. When someone among multiple people speaks, the speaker may not be in the frame of the lens, so the camera module cannot capture the frame of the speaker, so the device must constantly adjust the position to aim at the speaker. Cause inconvenience in use.

因此，有必要提供一種攝像機，能自動追蹤當前發言者的位置，以保持當前發言者在攝像機所截取的畫面之中，保持視訊通話能暢通地進行。Therefore, it is necessary to provide a camera that can automatically track the position of the current speaker, so as to keep the current speaker in the screen captured by the camera and keep the video call can be conducted smoothly.

本創作之目的提供一種攝像機，該攝像機能在發言者移動時，維持發言者在視訊畫面中的位置。The purpose of this creation is to provide a camera that can maintain the position of the speaker in the video screen when the speaker moves.

為了實現以上目的，本創作公開一種具有追蹤功能的攝像機，包括有：一影像擷取裝置，設有至少一鏡頭及至少一影像感測器，所述鏡頭與所述影像感測器相連接；一中央處理模組，設有後段晶片、微控制器，所述後段晶片與所述影像感測器相連接，所述微控制器具有臉部動作辨識單元；一音訊擷取裝置，設有複數一麥克風，所述麥克風與所述後段晶片相連接；至少一步進馬達，所述步進馬達與所述微控制器相連接。In order to achieve the above objectives, this creation discloses a camera with tracking function, including: an image capture device provided with at least one lens and at least one image sensor, the lens is connected to the image sensor; A central processing module is provided with a back-end chip and a microcontroller, the back-end chip is connected to the image sensor, and the microcontroller has a facial movement recognition unit; an audio capture device is provided with a complex Count one microphone, the microphone is connected to the back-stage chip; at least one stepping motor, the stepping motor is connected to the microcontroller.

承上所述，當有多位人員在同一本創作具有追蹤功能的攝像機前進行視訊時，藉由複數麥克風感測環境中的發言者音源位置以及微控制器中的臉部動作辨識單元進行鎖定及追蹤發言者的功能，當其中有人發言時，能自動將鏡頭轉向並鎖定住發言者，如此維持發言者在鏡頭中的位置、保持發言者說話的聲音品質，能順暢地保持視訊進行。同時具有可插拔性，在維修或替換上更為便利。As mentioned above, when multiple people are in front of the camera with the tracking function of the same book, the speaker's sound source position in the environment is sensed by multiple microphones and the facial motion recognition unit in the microcontroller is used to lock And the function of tracking the speaker. When someone is speaking, it can automatically turn the lens to lock the speaker, so as to maintain the position of the speaker in the lens, maintain the voice quality of the speaker, and keep the video going smoothly. At the same time, it is pluggable, which is more convenient for maintenance or replacement.

為詳細說明本創作之技術內容、構造特徵、所達成的目的及功效，以下茲例舉實施例並配合圖式詳予說明。In order to explain in detail the technical content, structural features, achieved objectives and effects of this creation, the following examples are given with examples and detailed descriptions with drawings.

請參閱第一圖，本創作公開一種具有追蹤功能的攝像機100，該具有追蹤功能的攝像機100由一本體1及一連接部2組成。Please refer to the first figure. This creation discloses a camera 100 with a tracking function. The camera 100 with a tracking function is composed of a body 1 and a connecting portion 2.

請參閱第二圖，本體1中設置有一中央處理模組11、一影像擷取裝置12、一音訊擷取裝置13即至少一步進馬達14。中央處理模組11中設有後段晶片111(backend IC)、微控制器112，微控制器112中具有臉部動作辨識單元。影像擷取裝置12中設有至少一鏡頭121及至少一影像感測器122。音訊擷取裝置13中設有複數麥克風131，複數麥克風131以陣列排列設置。Please refer to the second figure. The main body 1 is provided with a central processing module 11, an image capturing device 12, and an audio capturing device 13, that is, at least one stepping motor 14. The central processing module 11 is provided with a backend IC 111 and a microcontroller 112, and the microcontroller 112 has a facial motion recognition unit. At least one lens 121 and at least one image sensor 122 are provided in the image capturing device 12. The audio capturing device 13 is provided with a plurality of microphones 131, and the plurality of microphones 131 are arranged in an array.

鏡頭121與影像感測器122相連接。後段晶片111與影像感測器122、至少一麥克風131相連接。微控制器112與步進馬達17連接。The lens 121 is connected to the image sensor 122. The back-end chip 111 is connected to the image sensor 122 and at least one microphone 131. The microcontroller 112 is connected to the stepping motor 17.

中央處理模組11用以驅動各模組作動，並能與外部設備200進行資訊連結。影像擷取裝置12用於在一開放空間之中，藉由鏡頭121接收影像的光訊號，並經由影像感測器122將光訊號轉換為數位訊號，如此進行影像擷取。再將影像的數位訊號經過後段晶片111進入微控制器112中，利用設置在微控制器112中的臉部動作辨識單元來偵測發言者的臉部，以使鏡頭121能鎖定追蹤發言者。音訊擷取裝置13用於感測環境中的發言者音源位置，具體地，是透過陣列複數麥克風131對環境收音，透過感測出環境中聲音較大的位置，判斷該方向為發言者所在位置。The central processing module 11 is used to drive each module to act, and can communicate with the external device 200. The image capturing device 12 is used in an open space to receive the optical signal of the image through the lens 121, and convert the optical signal into a digital signal through the image sensor 122, thus performing image capture. Then, the digital signal of the image enters the microcontroller 112 through the back chip 111, and the facial motion recognition unit provided in the microcontroller 112 is used to detect the face of the speaker, so that the lens 121 can lock and track the speaker. The audio capture device 13 is used to sense the speaker's sound source position in the environment, specifically, the environment is picked up by the array of plural microphones 131, and by sensing the louder sound position in the environment, it is determined that the direction is the speaker's location .

當有多位人員在同一本創作具有追蹤功能的攝像機100前進行視訊時，本創作具有追蹤功能的攝像機100藉由呈陣列設置的複數麥克風131感測環境中的發言者音源位置，從而驅動步進馬達14進行上、下、左、右或斜方向的位移，使得鏡頭121朝向發言者的位置移動。當發言者進入鏡頭121的範圍內時，透過微控制器112中的臉部動作辨識單元使得鏡頭121能繼續移動以鎖定住發言者的臉部，如此達到追蹤並鎖定發言者的功效。When multiple people are performing video in front of the camera 100 with tracking function of the same creation, the camera 100 with tracking function of this creation uses a plurality of microphones 131 arranged in an array to sense the position of the speaker's sound source in the environment, thereby driving the steps. The advance motor 14 performs up, down, left, right or diagonal displacement, so that the lens 121 moves toward the speaker's position. When the speaker enters the range of the lens 121, the facial motion recognition unit in the microcontroller 112 enables the lens 121 to continue to move to lock the speaker's face, thus achieving the effect of tracking and locking the speaker.

當設有一個步進馬達14時，能使本創作具有追蹤功能的攝像機100進行水平或垂直旋轉。當設有兩個步進馬達14時，能使本創作具有追蹤功能的攝像機100同時進行水平及垂直旋轉。故為了滿足鏡頭121能進行上、下、左、右或斜方向的位移，本實施例中設置有兩步進馬達14。但不限定設置兩個步進馬達14，可以根據不同的使用需求，自由調整步進馬達14的數目。When a stepping motor 14 is provided, the camera 100 with tracking function of the present creation can be rotated horizontally or vertically. When two stepping motors 14 are provided, the camera 100 with the tracking function of the present creation can simultaneously rotate horizontally and vertically. Therefore, in order to satisfy that the lens 121 can move up, down, left, right or oblique directions, two stepping motors 14 are provided in this embodiment. However, two stepping motors 14 are not limited, and the number of stepping motors 14 can be freely adjusted according to different usage requirements.

具體地，本創作具有追蹤功能的攝像機100是經由呈陣列設置的複數麥克風131感測環境中的發言者音源位置，將聲音資料經由後段晶片111進入微控制器111中，以判斷發言者在環境中的位置，從而驅動步進馬達4將本創作具有追蹤功能的攝像機100進行上、下、左、右或斜方向的位移，如此鏡頭11能朝向發言者的方向移動，使得發言者能進入鏡頭11的影像擷取範圍中。鏡頭11接收到發言者的影像後，藉由影像感測器122進行影像擷取，將所擷取的影像經過後段晶片111至微控制器112中的臉部動作辨識單元中進行資訊比對及演算，以偵測發言者的樣貌，同時，微控制器111能計算並發出命令給步進馬達4，以驅動步進馬達4將本創作具有追蹤功能的攝像機100朝向發言者的臉部位置進行上、下、左、右或斜方向的位移，如此將鏡頭121鎖定在發言者的臉部位置，以達到人臉追蹤的功效。同時，由於本創作具有追蹤功能的攝像機100的鏡頭121能鎖定並追蹤發言者的位置，具有收音功效的陣列麥克風131能隨著該鎖定追蹤功能，將麥克風131的收音方向對準發言人，如此能保持發言人在影像中的位置，也能保持發言者說話的聲音品質。Specifically, the camera 100 with tracking function of the present creation senses the speaker's sound source position in the environment through a plurality of microphones 131 arranged in an array, and enters the sound data into the microcontroller 111 via the back chip 111 to determine whether the speaker is in the environment. In this way, the stepping motor 4 is driven to move the camera 100 with tracking function up, down, left, right or oblique direction, so that the lens 11 can move toward the speaker, so that the speaker can enter the lens 11 in the image capture range. After the lens 11 receives the image of the speaker, it uses the image sensor 122 to capture the image, and the captured image passes through the back chip 111 to the facial motion recognition unit in the microcontroller 112 for information comparison and Calculation to detect the appearance of the speaker. At the same time, the microcontroller 111 can calculate and issue a command to the stepping motor 4 to drive the stepping motor 4 to move the camera 100 with tracking function of the present invention towards the face of the speaker Displacement in up, down, left, right or oblique directions, so that the lens 121 is locked at the position of the speaker's face to achieve the effect of face tracking. At the same time, since the lens 121 of the camera 100 with tracking function of the present creation can lock and track the position of the speaker, the array microphone 131 with radio function can follow the locking and tracking function to direct the sound of the microphone 131 to the speaker. It can maintain the position of the speaker in the image and the sound quality of the speaker.

請參閱第三圖，連接部2凸伸出本體1，該連接部2為一種插頭連接器，當組裝固定在外部設備200上時，後段晶片111能經由連接部2與外部設備200進行連線。具體地，是組裝固定在具有顯示螢幕及通訊傳輸功能的電子設備上，如外接顯示器、筆記型電腦、智慧型手機等。藉由與上述外部設備200連線，能方便使用者在進行視訊。Please refer to the third figure, the connecting portion 2 protrudes from the body 1. The connecting portion 2 is a plug connector. When assembled and fixed on the external device 200, the rear chip 111 can be connected to the external device 200 via the connecting portion 2 . Specifically, it is assembled and fixed on an electronic device with a display screen and communication transmission function, such as an external display, a notebook computer, a smart phone, etc. By connecting with the above-mentioned external device 200, it is convenient for the user to perform video.

由於本創作具有追蹤功能的攝像機100是使用連接部2來進行連接並固定在外部設備200上，故其具有可插拔性，如此能靈活的設置在外部設備200上，當本創作具有追蹤功能的攝像機100由於使用時間或發生意外導致故障時，使用者能直接將本創作具有追蹤功能的攝像機100從外部設備200上拔出，單獨進行更換或維修，外部設備200能不受影響地持續正常使用。Since the camera 100 with the tracking function of this creation is connected and fixed to the external device 200 using the connection part 2, it is pluggable and can be flexibly set on the external device 200. When this creation has the tracking function When the camera 100 malfunctions due to time of use or an accident, the user can directly unplug the camera 100 with tracking function of this creation from the external device 200 and replace or repair it separately. The external device 200 can continue to be normal without being affected use.

請參閱第四圖，本創作具有追蹤功能的攝像機100使用時，是透過以下步驟：步驟S301：開始。步驟S302：將本創作具有追蹤功能的攝像機100***外部設備200上。步驟S303：判斷是否有正確連接接通訊號。若沒有正確連接，則回到步驟S302確認本創作具有追蹤功能的攝像機100是否有正確***外部設備200上。步驟S304：開啟視訊通訊軟體。此步驟為在外部設備200中，開啟視訊通訊軟體。步驟S305：取得攝像機影像。此步驟為透過本創作具有追蹤功能的攝像機100的鏡頭121及影像感測器122所擷取到的影像，顯示在外部設備200的螢幕上。若是沒有取得本創作具有追蹤功能的攝像機100的影像，則回到步驟S303重新連線。步驟S306：進行臉部追蹤。此步驟為藉由設置在本創作具有追蹤功能的呈陣列設置的複數麥克風131感測環境中的發言者音源位置，從而驅動步進馬達14進行上、下、左、右或斜方向的位移，使得鏡頭121朝向發言者的位置移動。當發言者進入鏡頭121的範圍內時，再透過微控制器112中的臉部動作辨識單元使得鏡頭121能繼續移動以鎖定並特寫發言者的臉部，如此達到追蹤並鎖定發言者的功效。Please refer to the fourth figure. When the camera 100 with tracking function is used in this creation, the following steps are used: Step S301: Start. Step S302: Insert the camera 100 with the tracking function of the original creation into the external device 200. Step S303: Determine whether there is a correct connection communication number. If it is not properly connected, return to step S302 to confirm whether the camera 100 with the tracking function of the present creation is correctly inserted into the external device 200. Step S304: Open the video communication software. This step is to start the video communication software in the external device 200. Step S305: Obtain camera images. In this step, the image captured by the lens 121 and the image sensor 122 of the camera 100 with tracking function of this creation is displayed on the screen of the external device 200. If the image of the camera 100 with the tracking function of the creation is not obtained, return to step S303 to reconnect. Step S306: Perform face tracking. In this step, a plurality of microphones 131 arranged in an array with tracking function are set in the present creation to sense the speaker's sound source position in the environment, thereby driving the stepping motor 14 to move up, down, left, right or oblique directions. The lens 121 is moved toward the position of the speaker. When the speaker enters the range of the lens 121, the facial motion recognition unit in the microcontroller 112 enables the lens 121 to continue to move to lock and close up the speaker's face, thus achieving the effect of tracking and locking the speaker.

承上所述，當有多位人員在同一本創作具有追蹤功能的攝像機100前進行視訊時，藉由陣列設置的複數麥克風131感測環境中的發言者音源位置以及微控制器112中的臉部動作辨識單元進行鎖定及追蹤發言者的功能，當其中有人發言時，能自動將鏡頭121轉向並鎖定住發言者，如此維持發言者在鏡頭中的位置、保持發言者說話的聲音品質，能順暢地保持視訊進行。同時具有可插拔性，在維修或替換上更為便利。As mentioned above, when multiple people are performing video in front of the camera 100 with tracking function of the same book, the multiple microphones 131 arranged in the array sense the speaker's sound source position in the environment and the face in the microcontroller 112. The action recognition unit performs the function of locking and tracking the speaker. When someone is speaking, it can automatically turn the lens 121 to lock the speaker, so as to maintain the speaker’s position in the lens and maintain the speaker’s voice quality. Keep the video going smoothly. At the same time, it is pluggable, which is more convenient for maintenance or replacement.

100:具有追蹤功能的攝像機 1:本體 11:中央處理模組 111:後段晶片 112:微控制器 12:影像擷取裝置 121:鏡頭 122:影像感測器 13:音訊擷取裝置 131:麥克風 14:步進馬達 2:連接部 200:外部設備 S301~S305:步驟 100: Camera with tracking function 1: body 11: Central processing module 111: Rear chip 112: Microcontroller 12: Image capture device 121: lens 122: image sensor 13: Audio capture device 131: Microphone 14: Stepping motor 2: connecting part 200: external equipment S301~S305: steps

［第一圖］係本創作具有追蹤功能的攝像機之立體圖。［第二圖］係本創作具有追蹤功能的攝像機的系統方塊圖。［第三圖］係本創作具有追蹤功能的攝像機及外部設備的立體圖。［第四圖］係本創作具有追蹤功能的攝像機與外部設備使用時的流程圖。 [The first picture] is a three-dimensional picture of the camera with tracking function of this creation. [Second Picture] is the system block diagram of the camera with tracking function of this creation. [The third picture] is a three-dimensional view of the camera and external equipment with tracking function of this creation. [Fourth picture] is the flow chart of this creation when the camera with tracking function and external equipment are used.

100:具有追蹤功能的攝像機 100: Camera with tracking function

1:本體 1: body

2:連接部 2: connecting part

121:鏡頭 121: lens

Claims

一種具有追蹤功能的攝像機，包括有：一影像擷取裝置，設有至少一鏡頭及至少一影像感測器，所述鏡頭與所述影像感測器相連接；一中央處理模組，設有後段晶片、微控制器，所述後段晶片與所述影像感測器相連接，所述微控制器中具有臉部動作辨識單元；一音訊擷取裝置，設有複數麥克風，所述麥克風與所述後段晶片相連接；至少一步進馬達，所述步進馬達與所述微控制器相連接。A camera with tracking function includes: an image capturing device provided with at least one lens and at least one image sensor; the lens is connected with the image sensor; and a central processing module provided with The back-end chip, a microcontroller, the back-end chip is connected to the image sensor, the microcontroller has a facial motion recognition unit; an audio capture device is provided with a plurality of microphones, the microphone and the The latter stage chip is connected; at least one stepping motor, and the stepping motor is connected to the microcontroller.

如請求項1所述之具有追蹤功能的攝像機，其中，複數所述麥克風以陣列排列設置。The camera with tracking function according to claim 1, wherein a plurality of the microphones are arranged in an array.

如請求項1所述之具有追蹤功能的攝像機，其中，設有兩個所述步進馬達，能使所述具有追蹤功能的攝像機同時進行水平及垂直旋轉，能使所述鏡頭進行上、下、左、右或斜方向的位移。The camera with tracking function according to claim 1, wherein two stepping motors are provided so that the camera with tracking function can rotate horizontally and vertically at the same time, and the lens can be moved up and down. , Left, right or diagonal displacement.

如請求項1所述之具有追蹤功能的攝像機，其中，還具有一連接部，所述連接部凸伸出所述具有追蹤功能的攝像機。The camera with tracking function according to claim 1, wherein the camera further has a connecting portion, and the connecting portion protrudes from the camera with tracking function.

如請求項4所述之具有追蹤功能的攝像機，其中，所述連接部為一種插頭連接器，能插接於一外部設備上，並與外部設備進行連線。According to claim 4, the camera with tracking function, wherein the connecting part is a plug connector that can be plugged into and connected with an external device.