TWI641858B - Motion capture system - Google Patents
Motion capture system Download PDFInfo
- Publication number
- TWI641858B TWI641858B TW107101412A TW107101412A TWI641858B TW I641858 B TWI641858 B TW I641858B TW 107101412 A TW107101412 A TW 107101412A TW 107101412 A TW107101412 A TW 107101412A TW I641858 B TWI641858 B TW I641858B
- Authority
- TW
- Taiwan
- Prior art keywords
- wavelength
- group
- pixel
- spectral range
- tracking system
- Prior art date
Links
Landscapes
- Length Measuring Devices By Optical Means (AREA)
- Studio Devices (AREA)
Abstract
動態追蹤系統包含一第一標記群、一第二標記群,以及一取像裝置。第一標記群包含複數個第一標記元件,用來提供具第一波長之光源。第二標記群包含複數個第二標記元件,用來提供具一第二波長之光源,第二波長相異於第一波長。取像裝置包含用來偵測第一頻譜範圍內光線之一第一像素,以及用來偵測一第二頻譜範圍內光線之一第二像素。在第一波長和第二波長中,只有第一波長落在第一頻譜範圍內,且只有第二波長落在第二頻譜範圍內。The dynamic tracking system includes a first marker group, a second marker group, and an imaging device. The first marker group includes a plurality of first marker elements for providing a light source having a first wavelength. The second marker group includes a plurality of second marker elements for providing a light source having a second wavelength that is different from the first wavelength. The image capture device includes a first pixel for detecting light in a first spectral range and a second pixel for detecting light in a second spectral range. Among the first wavelength and the second wavelength, only the first wavelength falls within the first spectral range, and only the second wavelength falls within the second spectral range.
Description
本發明相關於一種動態追蹤系統,尤指一種具高辨識準確度和即時性之動態追蹤系統。The invention relates to a dynamic tracking system, in particular to a dynamic tracking system with high recognition accuracy and immediacy.
動態追蹤(motion capture)系統能將人體的動作轉換成數位資料,以供進一步的分析,主要應用在遊戲和動畫製作。現有動態追蹤系統多半使用發光二極體(light emitting diode, LED)來作為追蹤標記點(marker),在面臨需要用到大量追蹤標記點的物體或是在物體較小的狀況下,常會有定位失真導致系統描述物體外型錯置或變形的問題。較早的動態追蹤系統會使用後製的方式進行修正,將相鄰的兩個標記點按需求在系統上將其修改描繪出來,形成由直線與標記點組合成的物體外型。但是這不僅會耗費大量的時間,並且在後製完成後的物體在經過較複雜的動作下系統還是會有辨識錯誤的可能,必須再經過一連串重複的動作校正才能達到理想的定位追蹤結果。因此,需要一種具高辨識準確度之動態追蹤系統。The motion capture system converts human motion into digital data for further analysis, primarily in games and animation. Most of the existing dynamic tracking systems use light emitting diodes (LEDs) as tracking markers. In the case of objects that need to use a large number of tracking points or when the objects are small, positioning is often performed. Distortion causes the system to describe the problem of misplacement or deformation of the object. The earlier dynamic tracking system will use the post-production method to correct the two marking points on the system as needed to form the shape of the object combined by the straight line and the marking points. However, this not only consumes a lot of time, but also the object after the completion of the post-production system may have a recognition error after a relatively complicated operation, and a series of repeated motion corrections must be performed to achieve the desired positioning and tracking result. A dynamic tracking system with high recognition accuracy is needed.
本發明提供一種動態追蹤系統,其包含一第一標記群、一第二標記群,以及一取像裝置。該第一標記群包含N個第一標記元件,用來提供具一第一波長之光源。該第二標記群包含N個第二標記元件,用來提供具一第二波長之光源。該取像裝置包含一第一像素,用來偵測一第一頻譜範圍內之光線;以及一第二像素,用來偵測一第二頻譜範圍內之光線。N為大於1之整數,該第一波長相異於該第二波長,該第一波長和該第二波長中只有該第一波長落在該第一頻譜範圍內,且該第一波長和該第二波長中只有該第二波長落在該第二頻譜範圍內。The invention provides a dynamic tracking system comprising a first marking group, a second marking group, and an image capturing device. The first marker group includes N first marker elements for providing a light source having a first wavelength. The second marker group includes N second marker elements for providing a light source having a second wavelength. The image capturing device includes a first pixel for detecting light in a first spectral range, and a second pixel for detecting light in a second spectral range. N is an integer greater than 1, the first wavelength is different from the second wavelength, and only the first wavelength of the first wavelength and the second wavelength falls within the first frequency range, and the first wavelength and the Only the second wavelength of the second wavelength falls within the second spectral range.
第1圖為本發明實施例中一種動態追蹤系統100之示意圖。動態追蹤系統100包含M組標記群GROUP 1~GROUP M和一取像裝置20。每一組標記群各包含N個標記元件(例如N個發光二極體),可提供頻譜相異之光源,其中M和N為大於1之整數。為了說明目的,第1圖顯示了M=4和N=3時之實施例,亦即動態追蹤系統100包含4組標記群GROUP 1~GROUP 4,第一標記群GROUP 1包含3個第一發光二極體LED1,第二標記群GROUP 2包含3個第二發光二極體LED2,第三標記群GROUP 3包含3個第三發光二極體LED3,而第四標記群GROUP 4包含3個第四發光二極體LED4。然而,M和N之值並不限定本發明之範疇。 1 is a schematic diagram of a dynamic tracking system 100 in accordance with an embodiment of the present invention. Dynamic tracking system 100 comprises. 1 group M ~ the GROUP tag group M and the GROUP an image capturing device 20. Each set of marker groups each contains N marker elements (eg, N light-emitting diodes) that provide a source of spectrally distinct light, where M and N are integers greater than one. For illustrative purposes, Figure 1 shows an embodiment where M=4 and N=3, that is, the dynamic tracking system 100 includes four sets of marker groups GROUP 1 ~GROUP 4 , and the first marker group GROUP 1 contains three first illuminations. The diode LED 1, the second mark group GROUP 2 includes three second light-emitting diode LEDs 2, the third mark group GROUP 3 includes three third light-emitting diode LEDs 3, and the fourth mark group GROUP 4 includes three Four light-emitting diode LED4. However, the values of M and N do not limit the scope of the invention.
本發明利用發光二極體之頻譜來辨識每一標記群,亦即第一標記群GROUP 1之第一發光二極體LED1可提供第一波長之光源,第二標記群GROUP 2之第二發光二極體LED2可提供第二波長之光源,第三標記群GROUP 3之第三發光二極體LED3可提供第三波長之光源,第四標記群GROUP 4之第四發光二極體LED4可提供第四波長之光源,且第一波長、第二波長、第三波長和第四波長彼此相異。 The present invention utilizes the spectrum of the light-emitting diode to identify each of the mark groups, that is, the first light-emitting diode LED1 of the first mark group GROUP 1 can provide the light source of the first wavelength, and the second light of the second mark group GROUP 2 The diode LED 2 can provide a light source of a second wavelength, the third LED LED 3 of the third mark group GROUP 3 can provide a light source of a third wavelength, and the fourth LED LED 4 of the fourth mark group GROUP 4 can provide A light source of a fourth wavelength, and the first wavelength, the second wavelength, the third wavelength, and the fourth wavelength are different from each other.
第2A~2D圖為本發明實施例中取像裝置20之示意圖。取像裝置20包含陣列式排列之複數種類型的像素PX1~PXM, 每一種類型之像素只偵測單一波長。針對上述M=4時之實施例,像素PX1可偵測一第一頻譜範圍內之光線、像素PX2可偵測一第二頻譜範圍內之光線、像素PX3可偵測一第三頻譜範圍內之光線,而像素PX4可偵測一第四頻譜範圍內之光線。其中,第一波長至第四波長中只有第一波長落在第一頻譜範圍內,第一波長至第四波長中只有第二波長落在第二頻譜範圍內,第一波長至第四波長中只有第三波長落在第三頻譜範圍內,且第一波長至第四波長中只有第四波長落在第四頻譜範圍內。值得注意的是,第2A~2D圖所顯示之陣列式排列方式僅為說明目的,每一種類型像素的數量和排列方式並不限定本發明之範疇。2A-2D are schematic views of the image capturing apparatus 20 in the embodiment of the present invention. The image capturing device 20 includes a plurality of types of pixels PX1 to PXM arranged in an array, and each type of pixel detects only a single wavelength. For the above embodiment of M=4, the pixel PX1 can detect light in a first spectrum range, the pixel PX2 can detect light in a second spectrum range, and the pixel PX3 can detect a third spectrum range. Light, while pixel PX4 detects light in a fourth spectral range. Wherein only the first wavelength of the first wavelength to the fourth wavelength falls within the first frequency range, and only the second wavelength of the first wavelength to the fourth wavelength falls within the second frequency range, and the first wavelength to the fourth wavelength Only the third wavelength falls within the third spectral range, and only the fourth wavelength of the first to fourth wavelengths falls within the fourth spectral range. It should be noted that the array arrangement shown in Figures 2A to 2D is for illustrative purposes only, and the number and arrangement of pixels of each type do not limit the scope of the present invention.
在本發明一實施例中,為避免環境光的干擾,以及考量較長波長光源的能量較弱,所以可採用近紅外光範圍(波長810nm~900nm)之設計。舉例來說,第一標記群GROUP1中的第一發光二極體LED1可提供波長為830nm之光源,而相對應之像素PX1可偵測波長為830nm之光線;第二標記群GROUP2中的第二發光二極體LED2可提供波長為850nm之光源,而相對應之像素PX2可偵測波長為850nm之光線;第三標記群GROUP3中的第三發光二極體LED3可提供波長為870nm之光源,而相對應之像素PX3可偵測波長為870nm之光線;第四標記群GROUP4中的第四發光二極體LED4可提供波長為890nm之光源,而相對應之像素PX4可偵測波長為890nm之光線。然而,每一標記群之頻譜範圍和每一像素之偵測範圍並不限定本發明之範疇。In an embodiment of the invention, in order to avoid interference of ambient light and to consider the energy of the longer wavelength source, the near-infrared range (wavelength 810 nm to 900 nm) can be used. For example, the first LED diode 1 in the first marker group GROUP1 can provide a light source with a wavelength of 830 nm, and the corresponding pixel PX1 can detect the light with a wavelength of 830 nm; the second of the second marker group GROUP2 The LED 2 can provide a light source with a wavelength of 850 nm, and the corresponding pixel PX2 can detect light with a wavelength of 850 nm. The third LED of the third mark group GROUP3 can provide a light source with a wavelength of 870 nm. The corresponding pixel PX3 can detect light with a wavelength of 870 nm; the fourth LED of the fourth mark group GROUP4 can provide a light source with a wavelength of 890 nm, and the corresponding pixel PX4 can detect a wavelength of 890 nm. Light. However, the spectral range of each marker group and the detection range of each pixel do not limit the scope of the present invention.
第3A~3H圖為本發明實施例中動態追蹤系統100運作時之示意圖。發光二極體在通電時會在明狀態(1),而在未通電時會在暗狀態(0),因此每一標記群可提供2 N位元的識別編號(ID),透過不同時間間隔的輸入電壓在二進制序列即可編碼每一標記群。針對M=4和N=3時之實施例,第一標記群GROUP 1之辨識編號包含8個位元A1~A8,第二標記群GROUP 2之辨識編號包含8個位元B1~B8,第三標記群GROUP 3之辨識編號包含8個位元C1~C8,而第四標記群GROUP 4之辨識編號包含8個位元D1~D8。取像裝置20在一圖框(frame)內會同時讀取第一標記群GROUP 1至第四標記群GROUP 4中各自一特定位元,再使用陣列式排列之像素PX1~PX4來辨識不同標記群之波長,以分辨所讀取到共4個特定位元是屬於哪一組標記群。因此,本發明動態追蹤系統100僅需要8個圖框就能辨認出所有標記群之辨識編號,依序由第3A~3H圖所示。 3A-3H are schematic diagrams showing the operation of the dynamic tracking system 100 in the embodiment of the present invention. The light-emitting diode will be in the bright state (1) when it is energized and in the dark state (0) when it is not energized, so each tag group can provide 2 N- bit identification number (ID) through different time intervals. The input voltage is encoded in a binary sequence to encode each tag group. For the embodiment where M=4 and N=3, the identification number of the first mark group GROUP 1 includes 8 bits A1~A8, and the identification number of the second mark group GROUP 2 includes 8 bits B1~B8, The identification number of the three marker group GROUP 3 includes 8 bits C1 to C8, and the identification number of the fourth marker group GROUP 4 includes 8 bits D1 to D8. The image capturing device 20 simultaneously reads a specific bit in each of the first mark group GROUP 1 to the fourth mark group GROUP 4 in a frame, and then uses the array pixels PX1 to PX4 to identify different marks. The wavelength of the group to distinguish which group of tag groups it belongs to by reading a total of 4 specific bits. Therefore, the dynamic tracking system 100 of the present invention can recognize the identification numbers of all the marker groups by only eight frames, which are sequentially shown in FIGS. 3A-3H.
綜上所述,本發明將複數個發光二極體分為不同標記群,使用輸入電壓在二進制序列作為編碼提供每一標記點的辨認編號,並配合取像裝置20分時取像來增加定位精準度。同時,每一標記群具相異頻譜範圍,搭配包含陣列式排列像素之取像裝置20可同時對不同標記群做信號擷取,因此不會影響系統的更新時間。因此,本發明能提供一種高辨識準確度和即時性之動態追蹤系統。 以上所述僅為本發明之較佳實施例,凡依本發明申請專利範圍所做之均等變化與修飾,皆應屬本發明之涵蓋範圍。In summary, the present invention divides a plurality of light-emitting diodes into different mark groups, uses an input voltage to provide an identification number of each mark point in a binary sequence as a code, and cooperates with the image taking device 20 to take images at a time to increase positioning. Accuracy. At the same time, each marker group has a different spectral range, and the image capturing device 20 including the array of pixels can simultaneously extract signals from different marker groups, thus not affecting the update time of the system. Therefore, the present invention can provide a dynamic tracking system with high recognition accuracy and immediacy. The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.
20‧‧‧取像裝置20‧‧‧Image capture device
100‧‧‧動態追蹤系統100‧‧‧Dynamic tracking system
GROUP1~GROUP4‧‧‧標記群GROUP 1 ~GROUP 4 ‧‧‧Mark group
LED1~LED4‧‧‧發光二極體LED1~LED4‧‧‧Light Emitting Diode
PX1~PX4‧‧‧像素PX1~PX4‧‧‧ pixels
A1~A8、B1~B8、C1~C8、D1~D8‧‧‧位元A1~A8, B1~B8, C1~C8, D1~D8‧‧‧ bits
第1圖為本發明實施例中一種動態追蹤系統之示意圖。 第2A~2D圖為本發明實施例中取像裝置之示意圖。 第3A~3H圖為本發明實施例中動態追蹤系統運作時之示意圖。FIG. 1 is a schematic diagram of a dynamic tracking system according to an embodiment of the present invention. 2A-2D are schematic views of the image taking device in the embodiment of the present invention. 3A-3H are schematic diagrams showing the operation of the dynamic tracking system in the embodiment of the present invention.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107101412A TWI641858B (en) | 2018-01-15 | 2018-01-15 | Motion capture system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107101412A TWI641858B (en) | 2018-01-15 | 2018-01-15 | Motion capture system |
Publications (2)
Publication Number | Publication Date |
---|---|
TWI641858B true TWI641858B (en) | 2018-11-21 |
TW201932870A TW201932870A (en) | 2019-08-16 |
Family
ID=65034567
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107101412A TWI641858B (en) | 2018-01-15 | 2018-01-15 | Motion capture system |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI641858B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021173008A1 (en) * | 2020-02-28 | 2021-09-02 | Weta Digital Limited | Active marker detection for performance capture |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI258704B (en) * | 2004-01-16 | 2006-07-21 | Avago Tech Ecbu Ip Sg Pte Ltd | Method and system for optically tracking a target using an interferometric technique |
CN101572804B (en) * | 2009-03-30 | 2012-03-21 | 浙江大学 | Multi-camera intelligent control method and device |
TWI510098B (en) * | 2010-04-23 | 2015-11-21 | Hon Hai Prec Ind Co Ltd | Image capturing device and method for dynamic tracing a specified object using image capturing devices |
-
2018
- 2018-01-15 TW TW107101412A patent/TWI641858B/en active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI258704B (en) * | 2004-01-16 | 2006-07-21 | Avago Tech Ecbu Ip Sg Pte Ltd | Method and system for optically tracking a target using an interferometric technique |
CN101572804B (en) * | 2009-03-30 | 2012-03-21 | 浙江大学 | Multi-camera intelligent control method and device |
TWI510098B (en) * | 2010-04-23 | 2015-11-21 | Hon Hai Prec Ind Co Ltd | Image capturing device and method for dynamic tracing a specified object using image capturing devices |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021173008A1 (en) * | 2020-02-28 | 2021-09-02 | Weta Digital Limited | Active marker detection for performance capture |
US11403883B2 (en) | 2020-02-28 | 2022-08-02 | Unity Technologies Sf | Strobing of active marker groups in performance capture |
Also Published As
Publication number | Publication date |
---|---|
TW201932870A (en) | 2019-08-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10013765B2 (en) | Method and system for image registrations | |
US20200234464A1 (en) | System for counting quantity of game tokens | |
KR101461233B1 (en) | Image processing device, image processing method and recording medium | |
KR20150093254A (en) | Unique identification information from marked features | |
WO2018115804A1 (en) | Quantum random number generator | |
CN106372701B (en) | A kind of coding of optical label and recognition methods | |
JP6590335B2 (en) | Two-dimensional code and method for reading the two-dimensional code | |
CN104881665A (en) | Chip character identification and verification method and apparatus | |
TW200639735A (en) | Method for dynamically recognizing objects in an image based on diversities of object characteristics and system for using the same | |
US10599943B2 (en) | Circuit board text recognition | |
KR20090035529A (en) | Optical symbol, article to which the optical symbol is attached, method for attaching optical symbol to article, and optical recognition code recognizing method | |
TWI641858B (en) | Motion capture system | |
US9704082B2 (en) | Marker generation apparatus, marker recognition apparatus, marker generation method, marker recognition method, and program | |
KR102406570B1 (en) | Apparatus and method for transmitting and receiving visible light data | |
CA3140186A1 (en) | System and method for object recognition using three dimensional mapping tools in a computer vision application | |
CN104166839A (en) | Method and system for calligraphy and painting authentication | |
JP2017091140A (en) | Code transmission/reception system, code receiver, code transmitter, code reception method, code transmission method, and program | |
US10121040B2 (en) | Recognition apparatus, recognition method, storage medium, management system, and conveyance system | |
CN108734158B (en) | Real-time train number identification method and device | |
US10142643B2 (en) | Marker generating method, marker decoding method, and marker reading device | |
US8374385B2 (en) | Method of embedding information in input image, method of extracting information from input image, and related apparatus | |
JP2014090410A (en) | Method for white balance adjustment | |
Dilna et al. | A novel method for bleeding detection in Wireless Capsule Endoscopic images | |
TW509796B (en) | Detection method and system for multi-stage display module of LED | |
TW202113673A (en) | Method and device for detecting a fluid by a computer vision application |