CN100557384C - A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging - Google Patents

A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging Download PDF

Info

Publication number
CN100557384C
CN100557384C CNB2003101133002A CN200310113300A CN100557384C CN 100557384 C CN100557384 C CN 100557384C CN B2003101133002 A CNB2003101133002 A CN B2003101133002A CN 200310113300 A CN200310113300 A CN 200310113300A CN 100557384 C CN100557384 C CN 100557384C
Authority
CN
China
Prior art keywords
target
information
storage area
subsystem
visual processes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB2003101133002A
Other languages
Chinese (zh)
Other versions
CN1616920A (en
Inventor
黄强
郝群
别海罡
丁凌
张伟民
权晓蕾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CNB2003101133002A priority Critical patent/CN100557384C/en
Publication of CN1616920A publication Critical patent/CN1616920A/en
Application granted granted Critical
Publication of CN100557384C publication Critical patent/CN100557384C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

The present invention relates to a kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging, by the visual processes subsystem, control subsystem and mechanical mechanism three parts are formed.Camera obtains target image under the image acquisition card control, transferring to the visual processes computing machine handles, the two-dimensional position information of acquisition in image coordinate, send to common storage area, control computer at first obtains positional information through coordinate conversion and planning in real time from common storage area, output to the driver drives motor and accurately shine target by shaft-position encoder backfeed loop control laser instrument simultaneously by the D/A plate again, feed back to vision computer and draw the Three-dimension Target positional information thereby at last stadimeter is obtained depth information.This system have distance precision height, initiative good, real-time, advantage such as cost is low, technology is simple.

Description

A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging
Affiliated technical field:
The present invention obtains system for a kind of active real-time three-dimensional positional information based on binocular vision and laser ranging, belongs to Flame Image Process and automatic field, is used for quick and precisely obtaining the three dimensional local information of object.
Background technology:
At present, using binocular stereo vision is the main means that obtain the target three dimensional local information.Method commonly used is right by two camera synchronization gain stereo-pictures, according to the principle of stereoscopic vision, calculate the depth information of every bit in the public visual field of image again, generate depth map, extract the depth information of target correspondence again, determine the Three-dimension Target positional information.But all there is following problem in these equipment:
1. distance precision is low: in the past the binocular of research and multi-eye stereo vision when measuring close-in target (in 5 meters) had than higher precision (more than 1 millimeter), and be very poor even can't measure in remote (beyond 5 meters) precision.
2. initiative is poor: when the space three-dimensional scene when video camera is projected as two dimensional image, the image of same scenery under difference has a great difference, and all multifactor in the scene, as illumination condition, scene geometry and physical characteristics etc. are all by comprehensively in single gradation of image value.Obviously, in the image that has comprised so many unfavorable factors, be difficult to try to achieve exactly high accuracy depth information.And in application, also be not need each point is asked depth information under most of situation.Therefore, many calculating there is no need, and also lack the initiatively ability of select target.
3. operand is big, and real-time is poor: stereoscopic vision requires to find the solution each corresponding point in the stereoscopic image, and the abundant information that image comprised makes that the speed of the corresponding coupling of pointwise is very slow, and easily produces " morbid state " computational problem.Though be head it off, under the regularization framework, added certain constraint, problem is converted into ask the optimum solution of many conditional functions, but difficulty in computation and calculated amount have been increased greatly, make visual processes speed be difficult to improve, can't requirement of real time, limited application.
In order to improve the initiative of vision subsystem to the target three-dimensional localization, reduce 3 D visual image calculated amount of handling and the real-time that improves system, initiatively obtain the positional information of target fast, the present invention proposes a kind of method of the three dimensional local information that newly sets the goal really and use the cover positioning system that this method realizes.
Summary of the invention:
Total system is by the visual processes subsystem, and control subsystem and mechanical mechanism three parts are formed.
The visual processes subsystem is made up of visual processes computing machine (built-in image pick-up card, memo-link main card), video camera, laser range finder.Built-in image pick-up card of the present invention is installed in the PCI slot, and with the shooting function compatibility that is adopted.Memo-link is a kind of equipment that is used for two intercomputer high-speed communications, and this equipment is made up of main card and two of subcards, and with the interconnection of RS485 interface, memo-link is regarded as the common storage area of this system in the present invention.
Control subsystem comprises control computer (built-in D/A plate, memo-link subcard), driver, motor (integrated shaft-position encoder).
Mechanical mechanism by bearing and the fixed support that is used to install motor, camera and laser range finder form, have two-dimensional freedom, main rising installed and supporting role.Concrete framework is: two video cameras with the image pick-up card compatibility are fixed on the interior rectangular support frame of mechanical mechanism, the radiating portion of laser range finder in the midpoint security protection of two video cameras is semiconductor laser just, and the receiving unit that laser range finder is installed directly over laser instrument i.e. a line array CCD that has 8 centimetres of amasthenic lens of 4 centimetres of focal lengths of diameter.Horizontal positioned one 15 watts brshless DC motor at the support bracket fastened rear of rectangular parallelepiped, and motor diameter is that 4 centimeter length are 10 centimetres of built-in shaft-position encoders, is used for drive system and rotates (Y direction) up and down to specified angle.Thereunder be a wound packages support, external diameter is 6 centimetres, and internal diameter is 4 centimetres, and one 15 watts brushless diameter motor has been installed in the inside, and this motor and horizontal positioned motor are identical, is used for drive system left-right rotation (X-direction) to specified angle.
Its main technical schemes is:
Obtain the image of the place ahead target by video camera after, import image pick-up card into, is digital signal by image pick-up card with the image transitions that video camera obtains target, and obtains target position information, and it is stored in the common storage area that is installed on memo-link main card in the vision computer PCI slot.Control computer by the memo-link subcard from common storage area obtain two-dimensional position information and with visual coordinate system down the positional information of target to be converted into the generating laser be positional information under the coordinate system of initial point, calculate the controlled quentity controlled variable of target offset initial point, again the driver that respectively controlled quentity controlled variable outputed to motor of the D/A converter by 12 come drive motor to rotate and simultaneously the backfeed loop that constitutes of the shaft-position encoder by electric machine built-in control the angle that motor turns to requirement accurately----and be about to condenser lens that target is located in the laser range finder receiving end reflected signal of target is converged on the line array CCD, calculate the range information (depth information just) of target according to the output of line array CCD with triangulation, last detected depth information and two-dimensional position information feedback have just demonstrated the Three-dimension Target positional information to vision computer.
The invention has the beneficial effects as follows:
1. precision height.Laser range finder has very high precision, except realizing the precision of stereoscopic vision in the distance of closely (in 5 meters), especially when measuring the target of remote (>5 meters), incomparable precision of stereoscopic vision and stability is arranged.
2. has initiative.In application, can ask the range information----degree of depth just to interested point, and needn't the entire image pointwise be found the solution, reduce unnecessary calculating according to request for utilization.
3. cost is low.The present invention has used the structure of two CPU, and this CPU also can be with replacements such as DSP or MCU, and is lower than similar products price.
4. real-time.The depth information of target is recorded by laser ranging among the present invention, can reach the above test frequency of 100Hz.And carry out corresponding point matching without stereoscopic image, so speed is fast, real-time is very good.
5. technology is simple.Mechanical part only has motor and the fixing camera of realizing two degree of freedom, and the mounting bracket of laser range finder is formed, processing, easy for installation.
And the present invention also has the little lightweight characteristics of volume, can be easy to be integrated in the other system, exists as a kind of functional unit.
Description of drawings:
Below in conjunction with drawings and Examples use is further specified.
Fig. 1 is a system schematic of the present invention
Fig. 2 is the front elevation of mechanical mechanism
Fig. 3 is the vertical view of mechanical mechanism
Fig. 4 is a visual processes subsystem work process flow diagram
Fig. 5 is the control subsystem workflow diagram
Fig. 6 is the control subsystem block diagram
Fig. 1 is in 2,3: 1. target, 2. video camera, 3. the radiating portion of laser range finder semiconductor laser just, 4. the receiving unit of laser range finder is a line array CCD, 5.Y spindle motor (realization moves up and down), 6.X spindle motor (realization side-to-side movement), 7. rectangular parallelepiped support, 8. visual processes computing machine (built-in image pick-up card), 9. common storage area, 10. control computer (built-in D/A plate, driver).
Embodiment:
This system realizes that the concrete steps of three-dimensional localization are as follows:
The first step: binocular camera 2 is delivered to the image pick-up card in the visual processes computing machine 8 with the image of the target in the visual field 1
Second step: image pick-up card converts picture signal to digital signal, transfers to visual processes computing machine 8 (Fig. 3) and handles, and calculates target and also this information is sent to 9 li of common storage areas at the two-dimensional position of visual plane.
The 3rd step: control computer 10 reads the position data in the common storage area 9, carries out coordinate conversion and real time kinematics planning by control program (Fig. 4) according to the installation site of video camera 2 and semiconductor laser transmitter 3.
The 4th step: control program is sent to drive signal the built-in D/A plate of control computer 10.The D/A plate transfers the X that gives the driver drives correspondence after the simulating signal to, and y-axis motor 5,6 makes semiconductor laser 3 accurately shine (Fig. 5) on the target 1.
The 5th step: according to the receiving unit of the reflected light that obtains from target 1 by laser range finder is the three-dimensional information that obtains target 1 after line array CCD 4 outputs can obtain the depth information of target 1 and send 8 overall treatments of visual processes computing machine to triangulation.

Claims (1)

1. active real-time three-dimensional positioning system based on binocular vision and laser ranging, comprise the visual processes subsystem, control subsystem and mechanical mechanism three parts, wherein the visual processes subsystem is by the visual processes computing machine, camera, laser range finder is formed, described visual processes built-in computer image pick-up card, common storage area, control subsystem has comprised the control computer of D/A plate built-in, the integrated motor and the driver of shaft-position encoder, it is characterized in that: obtain the image of the place ahead target by video camera after, be converted into digital signal by image pick-up card, the acquisition target position information also is stored in the common storage area, control computer obtains two-dimensional position information from common storage area, and two-dimensional position information is converted into the generating laser down from visual coordinate system is under the coordinate system of initial point, calculate the controlled quentity controlled variable of target offset initial point, the driver that respectively controlled quentity controlled variable is outputed to motor by D/A converter comes drive motor to rotate again, the backfeed loop that constitutes of shaft-position encoder by electric machine built-in is controlled motor rotational alignment target to be measured accurately simultaneously, converge on the line array CCD by the reflected signal of laser range finder receiving end target, calculate the range information of target according to triangulation, depth information just, detect depth information and two-dimensional position information feedback at last to vision computer, just comprehensively go out the Three-dimension Target positional information.
CNB2003101133002A 2003-11-14 2003-11-14 A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging Expired - Fee Related CN100557384C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2003101133002A CN100557384C (en) 2003-11-14 2003-11-14 A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2003101133002A CN100557384C (en) 2003-11-14 2003-11-14 A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging

Publications (2)

Publication Number Publication Date
CN1616920A CN1616920A (en) 2005-05-18
CN100557384C true CN100557384C (en) 2009-11-04

Family

ID=34759884

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2003101133002A Expired - Fee Related CN100557384C (en) 2003-11-14 2003-11-14 A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging

Country Status (1)

Country Link
CN (1) CN100557384C (en)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1321340C (en) * 2005-09-01 2007-06-13 上海交通大学 Synchronous scanning binocular vision three-dimensional imaging method based on area array projection
CN101318263B (en) * 2007-06-08 2011-12-07 深圳富泰宏精密工业有限公司 Laser engraving system and laser engraving method employing the same
CN101587082B (en) * 2009-06-24 2011-08-03 天津工业大学 Quick three-dimensional reconstructing method applied for detecting fabric defect
CN101699219B (en) * 2009-10-30 2011-01-26 北京理工大学 Method and sensor for binocular vision 3D measurement
CN101858743B (en) * 2010-06-04 2012-02-29 西安天和防务技术股份有限公司 Distance measuring device and method based on large-field shooting and image processing
JP2012118698A (en) * 2010-11-30 2012-06-21 Fuji Heavy Ind Ltd Image processing system
CN102510512B (en) * 2011-11-17 2014-03-05 杭州电子科技大学 Binocular-vision-node based self-positioning method for dynamic three-dimensional multimedia sensor network
CN103159136A (en) * 2011-12-14 2013-06-19 中铝国际技术发展有限公司 An active vision control-based precise positioning system for crown blocks
CN102914262B (en) * 2012-09-29 2015-02-11 北京控制工程研究所 Non-cooperative target abutting measurement method based on additional sighting distance
CN104079868B (en) * 2013-03-29 2017-06-30 中原工学院 The laser assisted range unit and method of a kind of single-view video monitoring
CN103557796B (en) * 2013-11-19 2016-06-08 天津工业大学 3 D positioning system and localization method based on laser ranging and computer vision
CN104061876B (en) * 2014-07-17 2017-01-18 宏峰集团(福建)有限公司 Building formwork construction monitoring system based on image measurement principle
CN104197926B (en) * 2014-08-06 2017-08-11 北京信息科技大学 A kind of robot navigation device of use active vision mode
CN104346614B (en) * 2014-09-04 2018-06-01 四川农业大学 Watermelon image procossing and localization method under a kind of outdoor scene
US10028102B2 (en) * 2014-12-26 2018-07-17 Here Global B.V. Localization of a device using multilateration
CN105108344A (en) * 2015-08-31 2015-12-02 鞍山英程利远科技有限公司 Intelligent control system of robot fiber laser marking machine
CN105783880B (en) * 2016-03-22 2018-05-22 天津大学 A kind of monocular laser assisted bay section docking calculation
EP3416370B1 (en) * 2016-03-23 2023-07-26 Huawei Technologies Co., Ltd. Photography focusing method, device, and apparatus for terminal
CN106323242A (en) * 2016-08-03 2017-01-11 北京奇虎科技有限公司 Space structure detection method and device for unmanned aerial vehicle
CN106382918A (en) * 2016-08-31 2017-02-08 胡钊政 Three-dimensional visual sensor
CN106645066B (en) * 2016-12-13 2019-02-01 天津大学 Liquid film axial direction flow parameter double vision angle measuring method
CN106595647B (en) * 2016-12-14 2020-05-05 北京理工大学珠海学院 Behavior state monitoring method, device and system
CN107152295B (en) * 2017-06-28 2018-12-28 中船重型装备有限公司 A kind of shield pipe sheet assembling machine automatically grabs method and system with vision platform
CN107747910A (en) * 2017-09-19 2018-03-02 浙江大学 The tunnel mark point coordinates laser measurement system and method for a kind of vision guide
CN108318887B (en) * 2018-01-18 2024-07-16 西安工业大学 Laser-assisted binocular range finding system
JP6719494B2 (en) * 2018-02-07 2020-07-08 直之 村上 A method of calculating the three-dimensional drive numerical value of the control device of the three-dimensional numerical drive by the drive measurement of the tracking laser distance measuring device.
CN108489392B (en) * 2018-04-11 2019-10-08 上海交通大学 Mechanical arm tail end repetitive positioning accuracy measuring device and method
CN109495692A (en) * 2019-01-09 2019-03-19 湖南农业大学 A kind of laser auto focusing percussion device based on three-dimensional machine vision
CN111098035A (en) * 2019-12-24 2020-05-05 武汉嘉铭激光股份有限公司 Laser three-dimensional etching system and etching method
CN117716201A (en) * 2021-06-28 2024-03-15 元素光电智能科技(苏州)有限公司 Measuring and positioning system based on machine vision and laser triangulation ranging
CN114018158A (en) * 2021-11-02 2022-02-08 中国大唐集团科技工程有限公司 Non-contact three-dimensional thermal displacement detection system and application thereof

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
双目立体视觉技术在三维测量中的应用研究. 张长命.电子科技大学学位论文. 2001 *
基于立体视觉的三维曲面测量关键技术研究. 张爱武,李明哲,胡少兴.***工程与电子技术,第23卷第10期. 2001 *

Also Published As

Publication number Publication date
CN1616920A (en) 2005-05-18

Similar Documents

Publication Publication Date Title
CN100557384C (en) A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging
CN105759244B (en) High-precision indoor locating system based on dual camera and localization method
CN102840825B (en) Particle locating system and method
CN106886030B (en) Synchronous mode map structuring and positioning system and method applied to service robot
CN103308149B (en) Machine vision is synchronously focused scanning type laser vibration detecting device
CN105874384B (en) Based on a variety of distance measuring methods with burnt system, method and camera system
CN103679687A (en) Target tracking method of intelligent tracking high-speed dome camera
KR20140049361A (en) Multiple sensor system, and apparatus and method for three dimensional world modeling using the same
CN1712892A (en) 3d surveying instrument and electronic storage medium
CN114745529B (en) Projector single TOF trapezoidal correction method and projector
KR101222104B1 (en) Method and Apparatus for Generating Omnidirectional 3D Image using Line Scan Camera
CN205027316U (en) Quick three -dimensional laser scanning appearance
CN112492292B (en) Intelligent visual 3D information acquisition equipment of free gesture
CN103003666A (en) Parallel online-offline reconstruction for three-dimensional space measurement
CN110196431A (en) Inexpensive interior 3D laser scanning and ranging system and method based on ARM
CN112254670B (en) 3D information acquisition equipment based on optical scanning and intelligent vision integration
CN103412318A (en) Portable infrared target locator and locating control method
CN104165587A (en) Real time three dimensional imaging system based on laser light and visual sense
CN206724906U (en) A kind of surrounding three-dimensional pattern sensing device of spinning cross line laser structured light
CN112303423A (en) Intelligent three-dimensional information acquisition equipment with stable rotation
CN203443557U (en) Novel portable CCD double-shaft autocollimator image measuring apparatus
CN107063123B (en) 360 degree of environment pattern spinning Laser Scannings
CN112254676B (en) Portable intelligent 3D information acquisition equipment
CN105093802A (en) Light-turning three-dimensional imaging apparatus and projection device and method thereof
CN212992427U (en) Image acquisition module

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20091104

Termination date: 20111114