CN100557384C - A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging - Google Patents
A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging Download PDFInfo
- Publication number
- CN100557384C CN100557384C CNB2003101133002A CN200310113300A CN100557384C CN 100557384 C CN100557384 C CN 100557384C CN B2003101133002 A CNB2003101133002 A CN B2003101133002A CN 200310113300 A CN200310113300 A CN 200310113300A CN 100557384 C CN100557384 C CN 100557384C
- Authority
- CN
- China
- Prior art keywords
- target
- information
- storage area
- subsystem
- visual processes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000000007 visual effect Effects 0.000 claims abstract description 21
- 238000000034 method Methods 0.000 claims abstract description 20
- 230000008569 process Effects 0.000 claims abstract description 17
- 230000007246 mechanism Effects 0.000 claims abstract description 7
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000006243 chemical reaction Methods 0.000 abstract description 2
- 239000004065 semiconductor Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000009434 installation Methods 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000002969 morbid Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
Images
Landscapes
- Length Measuring Devices By Optical Means (AREA)
Abstract
The present invention relates to a kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging, by the visual processes subsystem, control subsystem and mechanical mechanism three parts are formed.Camera obtains target image under the image acquisition card control, transferring to the visual processes computing machine handles, the two-dimensional position information of acquisition in image coordinate, send to common storage area, control computer at first obtains positional information through coordinate conversion and planning in real time from common storage area, output to the driver drives motor and accurately shine target by shaft-position encoder backfeed loop control laser instrument simultaneously by the D/A plate again, feed back to vision computer and draw the Three-dimension Target positional information thereby at last stadimeter is obtained depth information.This system have distance precision height, initiative good, real-time, advantage such as cost is low, technology is simple.
Description
Affiliated technical field:
The present invention obtains system for a kind of active real-time three-dimensional positional information based on binocular vision and laser ranging, belongs to Flame Image Process and automatic field, is used for quick and precisely obtaining the three dimensional local information of object.
Background technology:
At present, using binocular stereo vision is the main means that obtain the target three dimensional local information.Method commonly used is right by two camera synchronization gain stereo-pictures, according to the principle of stereoscopic vision, calculate the depth information of every bit in the public visual field of image again, generate depth map, extract the depth information of target correspondence again, determine the Three-dimension Target positional information.But all there is following problem in these equipment:
1. distance precision is low: in the past the binocular of research and multi-eye stereo vision when measuring close-in target (in 5 meters) had than higher precision (more than 1 millimeter), and be very poor even can't measure in remote (beyond 5 meters) precision.
2. initiative is poor: when the space three-dimensional scene when video camera is projected as two dimensional image, the image of same scenery under difference has a great difference, and all multifactor in the scene, as illumination condition, scene geometry and physical characteristics etc. are all by comprehensively in single gradation of image value.Obviously, in the image that has comprised so many unfavorable factors, be difficult to try to achieve exactly high accuracy depth information.And in application, also be not need each point is asked depth information under most of situation.Therefore, many calculating there is no need, and also lack the initiatively ability of select target.
3. operand is big, and real-time is poor: stereoscopic vision requires to find the solution each corresponding point in the stereoscopic image, and the abundant information that image comprised makes that the speed of the corresponding coupling of pointwise is very slow, and easily produces " morbid state " computational problem.Though be head it off, under the regularization framework, added certain constraint, problem is converted into ask the optimum solution of many conditional functions, but difficulty in computation and calculated amount have been increased greatly, make visual processes speed be difficult to improve, can't requirement of real time, limited application.
In order to improve the initiative of vision subsystem to the target three-dimensional localization, reduce 3 D visual image calculated amount of handling and the real-time that improves system, initiatively obtain the positional information of target fast, the present invention proposes a kind of method of the three dimensional local information that newly sets the goal really and use the cover positioning system that this method realizes.
Summary of the invention:
Total system is by the visual processes subsystem, and control subsystem and mechanical mechanism three parts are formed.
The visual processes subsystem is made up of visual processes computing machine (built-in image pick-up card, memo-link main card), video camera, laser range finder.Built-in image pick-up card of the present invention is installed in the PCI slot, and with the shooting function compatibility that is adopted.Memo-link is a kind of equipment that is used for two intercomputer high-speed communications, and this equipment is made up of main card and two of subcards, and with the interconnection of RS485 interface, memo-link is regarded as the common storage area of this system in the present invention.
Control subsystem comprises control computer (built-in D/A plate, memo-link subcard), driver, motor (integrated shaft-position encoder).
Mechanical mechanism by bearing and the fixed support that is used to install motor, camera and laser range finder form, have two-dimensional freedom, main rising installed and supporting role.Concrete framework is: two video cameras with the image pick-up card compatibility are fixed on the interior rectangular support frame of mechanical mechanism, the radiating portion of laser range finder in the midpoint security protection of two video cameras is semiconductor laser just, and the receiving unit that laser range finder is installed directly over laser instrument i.e. a line array CCD that has 8 centimetres of amasthenic lens of 4 centimetres of focal lengths of diameter.Horizontal positioned one 15 watts brshless DC motor at the support bracket fastened rear of rectangular parallelepiped, and motor diameter is that 4 centimeter length are 10 centimetres of built-in shaft-position encoders, is used for drive system and rotates (Y direction) up and down to specified angle.Thereunder be a wound packages support, external diameter is 6 centimetres, and internal diameter is 4 centimetres, and one 15 watts brushless diameter motor has been installed in the inside, and this motor and horizontal positioned motor are identical, is used for drive system left-right rotation (X-direction) to specified angle.
Its main technical schemes is:
Obtain the image of the place ahead target by video camera after, import image pick-up card into, is digital signal by image pick-up card with the image transitions that video camera obtains target, and obtains target position information, and it is stored in the common storage area that is installed on memo-link main card in the vision computer PCI slot.Control computer by the memo-link subcard from common storage area obtain two-dimensional position information and with visual coordinate system down the positional information of target to be converted into the generating laser be positional information under the coordinate system of initial point, calculate the controlled quentity controlled variable of target offset initial point, again the driver that respectively controlled quentity controlled variable outputed to motor of the D/A converter by 12 come drive motor to rotate and simultaneously the backfeed loop that constitutes of the shaft-position encoder by electric machine built-in control the angle that motor turns to requirement accurately----and be about to condenser lens that target is located in the laser range finder receiving end reflected signal of target is converged on the line array CCD, calculate the range information (depth information just) of target according to the output of line array CCD with triangulation, last detected depth information and two-dimensional position information feedback have just demonstrated the Three-dimension Target positional information to vision computer.
The invention has the beneficial effects as follows:
1. precision height.Laser range finder has very high precision, except realizing the precision of stereoscopic vision in the distance of closely (in 5 meters), especially when measuring the target of remote (>5 meters), incomparable precision of stereoscopic vision and stability is arranged.
2. has initiative.In application, can ask the range information----degree of depth just to interested point, and needn't the entire image pointwise be found the solution, reduce unnecessary calculating according to request for utilization.
3. cost is low.The present invention has used the structure of two CPU, and this CPU also can be with replacements such as DSP or MCU, and is lower than similar products price.
4. real-time.The depth information of target is recorded by laser ranging among the present invention, can reach the above test frequency of 100Hz.And carry out corresponding point matching without stereoscopic image, so speed is fast, real-time is very good.
5. technology is simple.Mechanical part only has motor and the fixing camera of realizing two degree of freedom, and the mounting bracket of laser range finder is formed, processing, easy for installation.
And the present invention also has the little lightweight characteristics of volume, can be easy to be integrated in the other system, exists as a kind of functional unit.
Description of drawings:
Below in conjunction with drawings and Examples use is further specified.
Fig. 1 is a system schematic of the present invention
Fig. 2 is the front elevation of mechanical mechanism
Fig. 3 is the vertical view of mechanical mechanism
Fig. 4 is a visual processes subsystem work process flow diagram
Fig. 5 is the control subsystem workflow diagram
Fig. 6 is the control subsystem block diagram
Fig. 1 is in 2,3: 1. target, 2. video camera, 3. the radiating portion of laser range finder semiconductor laser just, 4. the receiving unit of laser range finder is a line array CCD, 5.Y spindle motor (realization moves up and down), 6.X spindle motor (realization side-to-side movement), 7. rectangular parallelepiped support, 8. visual processes computing machine (built-in image pick-up card), 9. common storage area, 10. control computer (built-in D/A plate, driver).
Embodiment:
This system realizes that the concrete steps of three-dimensional localization are as follows:
The first step: binocular camera 2 is delivered to the image pick-up card in the visual processes computing machine 8 with the image of the target in the visual field 1
Second step: image pick-up card converts picture signal to digital signal, transfers to visual processes computing machine 8 (Fig. 3) and handles, and calculates target and also this information is sent to 9 li of common storage areas at the two-dimensional position of visual plane.
The 3rd step: control computer 10 reads the position data in the common storage area 9, carries out coordinate conversion and real time kinematics planning by control program (Fig. 4) according to the installation site of video camera 2 and semiconductor laser transmitter 3.
The 4th step: control program is sent to drive signal the built-in D/A plate of control computer 10.The D/A plate transfers the X that gives the driver drives correspondence after the simulating signal to, and y-axis motor 5,6 makes semiconductor laser 3 accurately shine (Fig. 5) on the target 1.
The 5th step: according to the receiving unit of the reflected light that obtains from target 1 by laser range finder is the three-dimensional information that obtains target 1 after line array CCD 4 outputs can obtain the depth information of target 1 and send 8 overall treatments of visual processes computing machine to triangulation.
Claims (1)
1. active real-time three-dimensional positioning system based on binocular vision and laser ranging, comprise the visual processes subsystem, control subsystem and mechanical mechanism three parts, wherein the visual processes subsystem is by the visual processes computing machine, camera, laser range finder is formed, described visual processes built-in computer image pick-up card, common storage area, control subsystem has comprised the control computer of D/A plate built-in, the integrated motor and the driver of shaft-position encoder, it is characterized in that: obtain the image of the place ahead target by video camera after, be converted into digital signal by image pick-up card, the acquisition target position information also is stored in the common storage area, control computer obtains two-dimensional position information from common storage area, and two-dimensional position information is converted into the generating laser down from visual coordinate system is under the coordinate system of initial point, calculate the controlled quentity controlled variable of target offset initial point, the driver that respectively controlled quentity controlled variable is outputed to motor by D/A converter comes drive motor to rotate again, the backfeed loop that constitutes of shaft-position encoder by electric machine built-in is controlled motor rotational alignment target to be measured accurately simultaneously, converge on the line array CCD by the reflected signal of laser range finder receiving end target, calculate the range information of target according to triangulation, depth information just, detect depth information and two-dimensional position information feedback at last to vision computer, just comprehensively go out the Three-dimension Target positional information.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNB2003101133002A CN100557384C (en) | 2003-11-14 | 2003-11-14 | A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNB2003101133002A CN100557384C (en) | 2003-11-14 | 2003-11-14 | A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging |
Publications (2)
Publication Number | Publication Date |
---|---|
CN1616920A CN1616920A (en) | 2005-05-18 |
CN100557384C true CN100557384C (en) | 2009-11-04 |
Family
ID=34759884
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNB2003101133002A Expired - Fee Related CN100557384C (en) | 2003-11-14 | 2003-11-14 | A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN100557384C (en) |
Families Citing this family (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1321340C (en) * | 2005-09-01 | 2007-06-13 | 上海交通大学 | Synchronous scanning binocular vision three-dimensional imaging method based on area array projection |
CN101318263B (en) * | 2007-06-08 | 2011-12-07 | 深圳富泰宏精密工业有限公司 | Laser engraving system and laser engraving method employing the same |
CN101587082B (en) * | 2009-06-24 | 2011-08-03 | 天津工业大学 | Quick three-dimensional reconstructing method applied for detecting fabric defect |
CN101699219B (en) * | 2009-10-30 | 2011-01-26 | 北京理工大学 | Method and sensor for binocular vision 3D measurement |
CN101858743B (en) * | 2010-06-04 | 2012-02-29 | 西安天和防务技术股份有限公司 | Distance measuring device and method based on large-field shooting and image processing |
JP2012118698A (en) * | 2010-11-30 | 2012-06-21 | Fuji Heavy Ind Ltd | Image processing system |
CN102510512B (en) * | 2011-11-17 | 2014-03-05 | 杭州电子科技大学 | Binocular-vision-node based self-positioning method for dynamic three-dimensional multimedia sensor network |
CN103159136A (en) * | 2011-12-14 | 2013-06-19 | 中铝国际技术发展有限公司 | An active vision control-based precise positioning system for crown blocks |
CN102914262B (en) * | 2012-09-29 | 2015-02-11 | 北京控制工程研究所 | Non-cooperative target abutting measurement method based on additional sighting distance |
CN104079868B (en) * | 2013-03-29 | 2017-06-30 | 中原工学院 | The laser assisted range unit and method of a kind of single-view video monitoring |
CN103557796B (en) * | 2013-11-19 | 2016-06-08 | 天津工业大学 | 3 D positioning system and localization method based on laser ranging and computer vision |
CN104061876B (en) * | 2014-07-17 | 2017-01-18 | 宏峰集团(福建)有限公司 | Building formwork construction monitoring system based on image measurement principle |
CN104197926B (en) * | 2014-08-06 | 2017-08-11 | 北京信息科技大学 | A kind of robot navigation device of use active vision mode |
CN104346614B (en) * | 2014-09-04 | 2018-06-01 | 四川农业大学 | Watermelon image procossing and localization method under a kind of outdoor scene |
US10028102B2 (en) * | 2014-12-26 | 2018-07-17 | Here Global B.V. | Localization of a device using multilateration |
CN105108344A (en) * | 2015-08-31 | 2015-12-02 | 鞍山英程利远科技有限公司 | Intelligent control system of robot fiber laser marking machine |
CN105783880B (en) * | 2016-03-22 | 2018-05-22 | 天津大学 | A kind of monocular laser assisted bay section docking calculation |
EP3416370B1 (en) * | 2016-03-23 | 2023-07-26 | Huawei Technologies Co., Ltd. | Photography focusing method, device, and apparatus for terminal |
CN106323242A (en) * | 2016-08-03 | 2017-01-11 | 北京奇虎科技有限公司 | Space structure detection method and device for unmanned aerial vehicle |
CN106382918A (en) * | 2016-08-31 | 2017-02-08 | 胡钊政 | Three-dimensional visual sensor |
CN106645066B (en) * | 2016-12-13 | 2019-02-01 | 天津大学 | Liquid film axial direction flow parameter double vision angle measuring method |
CN106595647B (en) * | 2016-12-14 | 2020-05-05 | 北京理工大学珠海学院 | Behavior state monitoring method, device and system |
CN107152295B (en) * | 2017-06-28 | 2018-12-28 | 中船重型装备有限公司 | A kind of shield pipe sheet assembling machine automatically grabs method and system with vision platform |
CN107747910A (en) * | 2017-09-19 | 2018-03-02 | 浙江大学 | The tunnel mark point coordinates laser measurement system and method for a kind of vision guide |
CN108318887B (en) * | 2018-01-18 | 2024-07-16 | 西安工业大学 | Laser-assisted binocular range finding system |
JP6719494B2 (en) * | 2018-02-07 | 2020-07-08 | 直之 村上 | A method of calculating the three-dimensional drive numerical value of the control device of the three-dimensional numerical drive by the drive measurement of the tracking laser distance measuring device. |
CN108489392B (en) * | 2018-04-11 | 2019-10-08 | 上海交通大学 | Mechanical arm tail end repetitive positioning accuracy measuring device and method |
CN109495692A (en) * | 2019-01-09 | 2019-03-19 | 湖南农业大学 | A kind of laser auto focusing percussion device based on three-dimensional machine vision |
CN111098035A (en) * | 2019-12-24 | 2020-05-05 | 武汉嘉铭激光股份有限公司 | Laser three-dimensional etching system and etching method |
CN117716201A (en) * | 2021-06-28 | 2024-03-15 | 元素光电智能科技(苏州)有限公司 | Measuring and positioning system based on machine vision and laser triangulation ranging |
CN114018158A (en) * | 2021-11-02 | 2022-02-08 | 中国大唐集团科技工程有限公司 | Non-contact three-dimensional thermal displacement detection system and application thereof |
-
2003
- 2003-11-14 CN CNB2003101133002A patent/CN100557384C/en not_active Expired - Fee Related
Non-Patent Citations (2)
Title |
---|
双目立体视觉技术在三维测量中的应用研究. 张长命.电子科技大学学位论文. 2001 * |
基于立体视觉的三维曲面测量关键技术研究. 张爱武,李明哲,胡少兴.***工程与电子技术,第23卷第10期. 2001 * |
Also Published As
Publication number | Publication date |
---|---|
CN1616920A (en) | 2005-05-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN100557384C (en) | A kind of active real-time three-dimensional positioning system based on binocular vision and laser ranging | |
CN105759244B (en) | High-precision indoor locating system based on dual camera and localization method | |
CN102840825B (en) | Particle locating system and method | |
CN106886030B (en) | Synchronous mode map structuring and positioning system and method applied to service robot | |
CN103308149B (en) | Machine vision is synchronously focused scanning type laser vibration detecting device | |
CN105874384B (en) | Based on a variety of distance measuring methods with burnt system, method and camera system | |
CN103679687A (en) | Target tracking method of intelligent tracking high-speed dome camera | |
KR20140049361A (en) | Multiple sensor system, and apparatus and method for three dimensional world modeling using the same | |
CN1712892A (en) | 3d surveying instrument and electronic storage medium | |
CN114745529B (en) | Projector single TOF trapezoidal correction method and projector | |
KR101222104B1 (en) | Method and Apparatus for Generating Omnidirectional 3D Image using Line Scan Camera | |
CN205027316U (en) | Quick three -dimensional laser scanning appearance | |
CN112492292B (en) | Intelligent visual 3D information acquisition equipment of free gesture | |
CN103003666A (en) | Parallel online-offline reconstruction for three-dimensional space measurement | |
CN110196431A (en) | Inexpensive interior 3D laser scanning and ranging system and method based on ARM | |
CN112254670B (en) | 3D information acquisition equipment based on optical scanning and intelligent vision integration | |
CN103412318A (en) | Portable infrared target locator and locating control method | |
CN104165587A (en) | Real time three dimensional imaging system based on laser light and visual sense | |
CN206724906U (en) | A kind of surrounding three-dimensional pattern sensing device of spinning cross line laser structured light | |
CN112303423A (en) | Intelligent three-dimensional information acquisition equipment with stable rotation | |
CN203443557U (en) | Novel portable CCD double-shaft autocollimator image measuring apparatus | |
CN107063123B (en) | 360 degree of environment pattern spinning Laser Scannings | |
CN112254676B (en) | Portable intelligent 3D information acquisition equipment | |
CN105093802A (en) | Light-turning three-dimensional imaging apparatus and projection device and method thereof | |
CN212992427U (en) | Image acquisition module |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C17 | Cessation of patent right | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20091104 Termination date: 20111114 |