CN1741572A - Auxiliary camera light graphic relay tracking method in virtual studio system - Google Patents

Auxiliary camera light graphic relay tracking method in virtual studio system Download PDF

Info

Publication number
CN1741572A
CN1741572A CN 200410073025 CN200410073025A CN1741572A CN 1741572 A CN1741572 A CN 1741572A CN 200410073025 CN200410073025 CN 200410073025 CN 200410073025 A CN200410073025 A CN 200410073025A CN 1741572 A CN1741572 A CN 1741572A
Authority
CN
China
Prior art keywords
camera
auxiliary camera
virtual studio
image
auxiliary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200410073025
Other languages
Chinese (zh)
Other versions
CN100399799C (en
Inventor
黄民主
刘林运
阴建林
肖仲坤
陈粤
温晓晴
雷粉霞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hongyuan Video Communicatino Equipment Co Ltd Xian
Original Assignee
Hongyuan Video Communicatino Equipment Co Ltd Xian
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hongyuan Video Communicatino Equipment Co Ltd Xian filed Critical Hongyuan Video Communicatino Equipment Co Ltd Xian
Priority to CNB2004100730250A priority Critical patent/CN100399799C/en
Publication of CN1741572A publication Critical patent/CN1741572A/en
Application granted granted Critical
Publication of CN100399799C publication Critical patent/CN100399799C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Studio Devices (AREA)
  • Image Analysis (AREA)

Abstract

A method for relay - tracking light image of auxiliary video camera in virtual studio system includes setting auxiliary video camera on rotary table, tripod, swinging arm or other accessory of foreground video camera , adding light image with different color or different lightness above or around foreground video camera to let image shot by auxiliary video camera have inconsistence color or brightness at each pixel on image , obtaining movement parameter of auxiliary video camera by calculating shot image with tracking server and then obtaining foreground video camera movement parameter according to auxiliary video camera movement parameter and location relation of two video cameras .

Description

Auxiliary camera light graphic relay tracking method in the Virtual Studio System
Technical field
The present invention relates to camera motion and measure and tracking, particularly relate to and adopt auxiliary camera that touchless light graphic relay tracking method is carried out in the locus of moving target object in the confined space and the field frequency speed of attitude in a kind of Virtual Studio System.
Background technology
Virtual Studio Technology has obtained great advance through the development in nearly ten years, progresses into the application stage at present.But, camera motion as one of key technology in the Virtual Studio System is measured and tracking technique, although lot of domestic and foreign manufacturer has proposed multiple solution, but more or less all there are some major defects, restricted the practical application effect of Virtual Studio System, now be summarized as follows:
1, mechanical type is followed the tracks of: its basic principle is carried out machine rebuilding for The Cloud Terrace, tripod and the rocking arm to video camera, add mechanical sensing devices such as cogged, measure the kinematic parameter such as translation, rotation of video camera then by photoelectric sensors such as grating rotating encoders.Its advantage is that system safety is reliable, the certainty of measurement height of partial parameters; Shortcoming is very obvious: belong to the contact tracking system, need carry out different transformations at different The Cloud Terraces, rocking arm, tracking accuracy is relevant with the characteristics such as brachium of The Cloud Terrace, rocking arm, easily produces shake when rocking arm is longer, can not use.
2, guide tracked tracking: its basic principle is measured the translational motion parameter of video camera for to install guide rail additional below the The Cloud Terrace tripod by transducer and contacting of guide rail.This method also can be used in the low side occasion.Its shortcoming is to belong to the contact tracking system, and accuracy value is influenced by sliding friction, uses inconveniently, and stability is low, and the height change of video camera can't measure, and can't use on rocking arm.
3, infrared recognition and tracking system: its basic principle is for installing the infrared radiation source of certain angle additional on foreground camera, install the thermal camera of some additional at the superjacent air space of video camera, system calculates the kinematic parameter of foreground camera by the change in location of infrared photography machine testing infrared radiation source.Its advantage is to belong to non-contact type to follow the tracks of, and is easy to use; Shortcoming is because any object can both be launched the infrared ray of different-waveband under any temperature, and along with the different ultrared equivalents of temperature are also different with wave band.Therefore this system is subjected to the influence of surround lighting and thermal light source very big, and system's shakiness, precision also can be influenced.
4, grid recognition and tracking: its basic principle is for sticking the blue grid of different color saturations on the blue case background of studio, foreground camera is taken the back by chroma key technique identification grid image, and goes out the kinematic parameter of video camera according to the change calculations of grid image.Its advantage is to belong to the non-contact type tracking system, and it is convenient to use.But shortcoming is a lot: precision is not high; Many or the local feature of video camera of current scenery body and making can't be used when grid is blocked by prospect, causes system's instability; To cause prospect smudgy or on the grid in order focusing on, to make accuracy of identification descend in order to make the clear grid that causes of prospect fuzzy; Make the chroma key quality of system descend for the blue signal of discerning different color saturations; This method generally can not independently be used.
Because present various trackings all exist huge defective, Virtual Studio System is subjected to serious restriction in actual applications, has influenced the performance and the marketing of Virtual Studio System function.
Summary of the invention
The purpose of this invention is to provide and adopt auxiliary camera that touchless light graphic relay tracking method is carried out in the locus of moving target object in the confined space and the field frequency speed of attitude in a kind of Virtual Studio System.This method has not only overcome whole shortcomings of existing various tracking schemes, and every indexs such as the precision of tracking system, Dynamic response, minimum resolution, antijamming capability, stability have been mentioned unprecedented height, thoroughly solved the video camera tracking technique in the Virtual Studio System.
The object of the present invention is achieved like this: this method may further comprise the steps:
-on The Cloud Terrace 2, tripod 3, rocking arm or its adjunct of foreground camera 1, install auxiliary camera 4 additional, above foreground camera 1 or selectively add the light figure 5 of different color or brightness all around, thereby make that the color or the brightness of each pixel is not quite identical in the image that auxiliary camera 4 photographs;
Video capture card 7 in the-tracking server 6 is pressed field frequency and is gathered the video image that auxiliary camera 4 is taken, and copies in tracking server 6 internal memories, obtains the kinematic parameter of auxiliary camera 4 after the image that collects calculates through tracking server 6;
-tracking server 6 concerns the 3 d rendering engine that can calculate the kinematic parameter of foreground camera 1 and be sent to virtual studio according to the kinematic parameter of auxiliary camera 4 and the position of auxiliary camera 4 and foreground camera 1.
The computational methods of tracking server 6 are to be abscissa and ordinate with the level of image and vertical direction, will form crest in the three-dimension curved surface coordinate of being opened as ordinate with the color-values of pixel or brightness value, trough, contour, series of features point sets such as singular point, and these feature point sets have relative stability with respect to the variation of surround lighting, according to the characteristics of feature point set itself---and the size of the figure that for example contour surrounded, area, relativeness between shape etc. and the feature point set---curved surface medium wave peak for example, trough, relative altitude between the singular point, information such as relative position between the figure that the variation of relative distance and contour surround just can point-devicely calculate the kinematic parameter of auxiliary camera 4.
The light figure 5 that is added does not have the requirement of shape, size, brightness or color, but the color contrast or the big more effect of luminance contrast of itself and adjacent objects are good more.
Described auxiliary camera 4 is common colour TV camera, B or thermal camera.
Described video capture card 7 is the common image pick-up card that can gather by frame rate.
Advantage of the present invention is: with respect to other tracking, the effective information that the present invention can use is very abundant, so technical indicators such as tracking accuracy, minimum resolution are greatly improved with respect to other tracking technique.The invention belongs to non-contact type and follow the tracks of, easy to use, tracking has high accuracy, high frequency sound, stable strong characteristics, and antijamming capability is strong, is subjected to ambient light effects little, not influenced by temperature, sound wave etc.; It is very convenient that auxiliary camera is installed on The Cloud Terrace, tripod or rocking arm, has device independence, do not need to transform rocking arm, tracking effect and rocking arm length, foreground object and chroma key effect etc. are all irrelevant, can measure the parameter information such as translation, height of video camera.
Description of drawings
Fig. 1 is the structural representation of equipment required for the present invention.
Embodiment
As shown in Figure 1, above The Cloud Terrace 2, tripod 3, rocking arm or its adjunct of foreground camera 1, install auxiliary camera 4 additional, with keeing relative stability property of scenery, do not influence other operation and color contrast arranged relatively significantly or luminance contrast is a principle, select the angle of auxiliary camera 4, can elect perpendicular or parallel ground as, so that and the movement conversion of foreground camera 1.
If its color contrast of image or luminance contrast that auxiliary camera 4 is taken are too even, then need selectively add the light figure 5 of different color or brightness, thereby make that the color or the brightness of each pixel is not quite identical in the image that auxiliary camera 4 photographs in the studio.The light figure 5 that is added does not have the requirement of shape, size, brightness or color, but the color contrast or the big more effect of luminance contrast of itself and adjacent objects are good more.
Auxiliary camera 4 is common colour TV camera or thermal camera, also can adopt B if do pixel with brightness.
Video capture card 7 is common image pick-up card, can get final product by the frame rate collection.The kinematic parameter of auxiliary camera 4 can be obtained after the image that collects calculates through tracking server 6, the kinematic parameter of foreground camera 1 can be calculated by the position relation of auxiliary camera 4 and foreground camera 1.
Tracking server 6 desired configurations can be selected the PC computer of standard for use, and dominant frequency requires more than 2.4G, in exist more than the 256M.
Software workflow: after tracking server 6 starts, automatically starting trace daemon or by virtual studio master control platform remote activation, video capture card 7 every frames are all gathered new image then, images acquired and form conversion are after tracking server 6 calculates, can draw the kinematic parameter of auxiliary camera 4, tracking server 6 concerns the 3 d rendering engine that can calculate the kinematic parameter of foreground camera 1 and be sent to virtual studio according to the kinematic parameter of auxiliary camera 4 and the position of auxiliary camera 4 and foreground camera 1.
The computational methods of tracking server 6 are to be abscissa and ordinate with the level of image and vertical direction, will form crest in the three-dimension curved surface coordinate of being opened as ordinate with the color-values of pixel or brightness value, trough, contour, series of features point sets such as singular point, and these feature point sets have relative stability with respect to the variation of surround lighting, according to the characteristics of feature point set itself---and the size of the figure that for example contour surrounded, area, relativeness between shape etc. and the feature point set---curved surface medium wave peak for example, trough, relative altitude between the singular point, information such as relative position between the figure that the variation of relative distance and contour surround just can point-devicely calculate the kinematic parameter of auxiliary camera 4.
In sum, with respect to other tracking, the effective information that the present invention can use is very abundant, so technical indicators such as tracking accuracy, minimum resolution are greatly improved with respect to other tracking technique.The present invention's advantage originally is as follows: the invention belongs to non-contact type and follows the tracks of, and easy to use; Follow the tracks of high accuracy, high frequency sound, stability by force; Antijamming capability is strong, is subjected to ambient light effects little, not influenced by temperature, sound wave etc.; On The Cloud Terrace 2, tripod 3 or rocking arm, be convenient to install auxiliary camera 4, have device independence, do not need to transform rocking arm; Tracking effect and rocking arm length, foreground object, chroma key effect etc. are all irrelevant; Can measure the translation of foreground camera 1, highly wait parameter information.
Every The Cloud Terrace 2 at foreground camera 1; tripod 3; use auxiliary camera 4 to take on rocking arm and the adjunct thereof; the characteristics (for example: the features of shape of light figure; area size etc.) of the feature point set (for example: crest; trough; singular point; the light figure of arbitrary shape etc.) that constitutes with photographic images color or luminance pixel itself and the kinematic parameter calculating that the characteristics between the feature point set (for example: crest; trough; singular point; the relative brightness relation between the light figure; relative position relation etc.) are carried out foreground camera 1 all belongs to the protection range of this patent.

Claims (5)

1, auxiliary camera light graphic relay tracking method in a kind of Virtual Studio System is characterized in that this method may further comprise the steps:
-on The Cloud Terrace, tripod, rocking arm or its adjunct of foreground camera, install auxiliary camera additional, above foreground camera or selectively add the light figure of different color or brightness all around, thereby make that the color or the brightness of each pixel is not quite identical in the image that auxiliary camera photographs;
Video capture card in the-tracking server is pressed field frequency and is gathered the video image that auxiliary camera is taken, and copies in the tracking server internal memory, obtains the kinematic parameter of auxiliary camera after the image that collects calculates through tracking server;
-tracking server concerns the 3 d rendering engine that can calculate the kinematic parameter of foreground camera and be sent to virtual studio according to the kinematic parameter of auxiliary camera and the position of auxiliary camera and foreground camera.
2, according to auxiliary camera light graphic relay tracking method in claims 1 described Virtual Studio System, it is characterized in that: the computational methods of tracking server are to be abscissa and ordinate with the level of image and vertical direction, will form crest in the three-dimension curved surface coordinate of being opened as ordinate with the color-values of pixel or brightness value, trough, contour, series of features point sets such as singular point, and these feature point sets have relative stability with respect to the variation of surround lighting, according to the characteristics of feature point set itself---and the size of the figure that for example contour surrounded, area, relativeness between shape etc. and the feature point set---curved surface medium wave peak for example, trough, relative altitude between the singular point, information such as relative position between the figure that the variation of relative distance and contour surround just can point-devicely calculate the kinematic parameter of auxiliary camera.
3, according to auxiliary camera light graphic relay tracking method in claims 1 described Virtual Studio System, it is characterized in that: the light figure that is added does not have the requirement of shape, size, brightness or color, but the color contrast or the big more effect of luminance contrast of itself and adjacent objects are good more.
4, according to auxiliary camera light graphic relay tracking method in claims 1 or the 2 described Virtual Studio Systems, it is characterized in that: described auxiliary camera is common colour TV camera, B or thermal camera.
5, according to auxiliary camera light graphic relay tracking method in claims 1 or the 2 described Virtual Studio Systems, it is characterized in that: described video capture card is the common image pick-up card that can gather by frame rate.
CNB2004100730250A 2004-08-24 2004-08-24 Auxiliary camera light graphic relay tracking method in virtual studio system Expired - Fee Related CN100399799C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2004100730250A CN100399799C (en) 2004-08-24 2004-08-24 Auxiliary camera light graphic relay tracking method in virtual studio system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2004100730250A CN100399799C (en) 2004-08-24 2004-08-24 Auxiliary camera light graphic relay tracking method in virtual studio system

Publications (2)

Publication Number Publication Date
CN1741572A true CN1741572A (en) 2006-03-01
CN100399799C CN100399799C (en) 2008-07-02

Family

ID=36093777

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2004100730250A Expired - Fee Related CN100399799C (en) 2004-08-24 2004-08-24 Auxiliary camera light graphic relay tracking method in virtual studio system

Country Status (1)

Country Link
CN (1) CN100399799C (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102243064A (en) * 2011-04-22 2011-11-16 深圳迪乐普数码科技有限公司 Determination system and method for position and posture of video camera in virtual studio
CN105072314A (en) * 2015-08-13 2015-11-18 黄喜荣 Virtual studio implementation method capable of automatically tracking objects
CN109040528A (en) * 2018-09-30 2018-12-18 深圳市励得数码科技有限公司 The motion state of video camera determines method, apparatus and studio system in studio
CN115631350A (en) * 2022-11-17 2023-01-20 博奥生物集团有限公司 Method and device for identifying colors of canned image

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2325807B (en) * 1997-05-30 2002-03-20 British Broadcasting Corp Position determination
GB2329292A (en) * 1997-09-12 1999-03-17 Orad Hi Tec Systems Ltd Camera position sensing system
CN1275022A (en) * 2000-06-23 2000-11-29 成都索贝数码科技股份有限公司 Detection method and system for inner and outer video camera parameters of virtual studio
GB2386489B (en) * 2002-03-15 2006-10-04 British Broadcasting Corp Virtual studio system
CN1477856A (en) * 2002-08-21 2004-02-25 北京新奥特集团 True three-dimensional virtual studio system and its implement method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102243064A (en) * 2011-04-22 2011-11-16 深圳迪乐普数码科技有限公司 Determination system and method for position and posture of video camera in virtual studio
CN105072314A (en) * 2015-08-13 2015-11-18 黄喜荣 Virtual studio implementation method capable of automatically tracking objects
CN109040528A (en) * 2018-09-30 2018-12-18 深圳市励得数码科技有限公司 The motion state of video camera determines method, apparatus and studio system in studio
CN109040528B (en) * 2018-09-30 2021-07-23 深圳市励得数码科技有限公司 Method and device for determining motion state of camera in studio and studio system
CN115631350A (en) * 2022-11-17 2023-01-20 博奥生物集团有限公司 Method and device for identifying colors of canned image
WO2024103892A1 (en) * 2022-11-17 2024-05-23 博奥生物集团有限公司 Color recognition method and apparatus for cupping mark image

Also Published As

Publication number Publication date
CN100399799C (en) 2008-07-02

Similar Documents

Publication Publication Date Title
US5870220A (en) Portable 3-D scanning system and method for rapid shape digitizing and adaptive mesh generation
CN105675610A (en) Online detection system for object surface texture characteristics and working principle
Thomas et al. A versatile camera position measurement system for virtual reality TV production
CN1712891A (en) Method for associating stereo image and three-dimensional data preparation system
CN110400315A (en) A kind of defect inspection method, apparatus and system
CN109816702A (en) A kind of multiple target tracking device and method
CN101033950A (en) Measurement method of three-dimensional surface shape of rock
CN113223050A (en) Robot motion track real-time acquisition method based on Aruco code
CN107071347A (en) The method of adjustment and headend equipment of a kind of wireless localization apparatus
CN113971682A (en) Real-time variable green curtain generation method based on depth information and image matting method
Nurit et al. HD-RTI: An adaptive multi-light imaging approach for the quality assessment of manufactured surfaces
CN1741572A (en) Auxiliary camera light graphic relay tracking method in virtual studio system
CN113438469B (en) Automatic testing method and system for security camera
JP2014530356A (en) Motion analysis by shape correction and warping
CN1731832A (en) Foreground depth of field recognition device and method in virtual studio system
CN112433641B (en) Implementation method for automatic calibration of desktop prop interaction system of multiple RGBD depth sensors
CN113743286A (en) Target monitoring system and method for multi-source signal fusion
CN112525326A (en) Computer vision measurement method for three-dimensional vibration of unmarked structure
CN102243064A (en) Determination system and method for position and posture of video camera in virtual studio
CN2738495Y (en) Auxiliary camera optical pattern relay tracking system in virtual television studio system
Zhang et al. High-speed vision extraction based on the CamShift algorithm
CN115824170A (en) Method for measuring ocean waves by combining photogrammetry and laser radar
CN110166653A (en) The tracking system and method for camera position and posture
CN114441450B (en) Multi-metal nodule typical characteristic simulation analysis device and method
CN114782803A (en) Method for monitoring transmission line galloping based on compression sampling and image recognition

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20080702

Termination date: 20140824

EXPY Termination of patent right or utility model