CN111243016B - Automatic container identification and positioning method - Google Patents

Automatic container identification and positioning method Download PDF

Info

Publication number
CN111243016B
CN111243016B CN201811501109.8A CN201811501109A CN111243016B CN 111243016 B CN111243016 B CN 111243016B CN 201811501109 A CN201811501109 A CN 201811501109A CN 111243016 B CN111243016 B CN 111243016B
Authority
CN
China
Prior art keywords
container
camera
personal computer
binocular camera
industrial personal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811501109.8A
Other languages
Chinese (zh)
Other versions
CN111243016A (en
Inventor
许彩云
周永升
王强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhoukou Normal University
Original Assignee
Zhoukou Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhoukou Normal University filed Critical Zhoukou Normal University
Priority to CN201811501109.8A priority Critical patent/CN111243016B/en
Publication of CN111243016A publication Critical patent/CN111243016A/en
Application granted granted Critical
Publication of CN111243016B publication Critical patent/CN111243016B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/337Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/80Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Warehouses Or Storage Devices (AREA)

Abstract

The invention discloses an automatic container identification and positioning method, which comprises an industrial personal computer, a binocular camera, a monocular camera and a light source, wherein a WinCC process monitoring system application program with an SQL Server database is installed on the industrial personal computer, the position information of the container number of a container is stored in the database, the WinCC process monitoring system is provided with a set of storage and warehousing programs, the binocular camera is installed on a container lifting appliance and is used for carrying out secondary identification and positioning on the container, the monocular camera is installed at a container warehousing place and is used for automatically identifying the container number in a warehouse, the light source and the camera are installed in a matched manner, and the brightness can be automatically adjusted according to the change of ambient light. According to the method, the theoretical position of the container is stored through the database, then the binocular camera is adopted to collect the pictures of the container, and a set of algorithm based on machine vision is designed to secondarily identify and position the container.

Description

Automatic container identification and positioning method
Technical Field
The invention relates to the field of automation, in particular to an automatic container identification and positioning method.
Background
Along with the rapid development of logistics industry and the rise of labor cost, the wharf, port, goods yard and other places are urgently required to increase the goods turnover efficiency and reduce the labor management cost by improving the automation level of the machinery. The requirement on the operation of a driver is high in the link of lifting the container by the crane, and the time consumption is long when the lifting appliance is aligned to the container by adopting manual operation. The key to improving the efficiency of the link is to realize the automatic alignment of the lifting appliance and the lock hole on the container. With the progress of computer, image processing, artificial intelligence, intelligent control and other technologies, the flexible automation technology based on machine vision is realized and rapidly developed, and at present, the container identification and positioning technology based on machine vision has become a hot spot for the research of vast students.
Disclosure of Invention
In order to improve the mechanical automation level of wharfs, ports, goods yards and the like, the invention provides an automatic container identification and positioning method, which is realized by the following technical scheme:
the automatic container identifying and positioning method includes industrial computer, binocular camera, monocular camera and light source, and the industrial computer is equipped with WinCC process monitoring system application program with SQL Server data base, the binocular camera is mounted on container lifting tool, the monocular camera is mounted in container warehouse-in place, and the light source is mounted in combination with camera, and can automatically regulate brightness according to the change of ambient light. The method specifically comprises the following steps:
step 1: and respectively adjusting focal length and aperture of the binocular camera and the monocular camera, calibrating the binocular camera by adopting a Zhang plane calibration method to obtain internal and external parameters of the camera, and preparing for three-dimensional coordinate reconstruction.
Step 2: before the container is put in storage, the monocular camera scans and collects the container number pattern and uploads the pattern to the industrial personal computer, a set of automatic identification system for the container number is arranged on the industrial personal computer, the system automatically identifies and uploads the container number to a WinCC process monitoring system, the WinCC process monitoring system is provided with a set of storage in-out and in-out program, the program is used for draining and finding out empty positions of a site database, and an AGV (automatic guided vehicle) is used for automatically conveying the container to a destination nearby the empty positions.
Step 3: after the AGV guiding trolley conveys the container to a destination near the vacant site, a binocular camera on the container lifting tool collects the container picture and uploads the container picture to an industrial personal computer, a set of automatic container identification and positioning algorithm is designed in the industrial personal computer, the collected pattern is analyzed, the accurate position of a container lock hole is identified, the container lifting tool automatically punches and lifts the container to place the vacant site, meanwhile, a WinCC process monitoring system stores the position information of the container number in an SQL Server database, the AGV trolley automatically returns to an entrance and exit, and the container warehousing is completed. When the container is delivered, firstly, searching an SQL Server database according to the container number of the container to be delivered, finding out the position information corresponding to the container number, automatically enabling a container crane to reach the position, collecting the container image delivered by a binocular camera on a container lifting tool, uploading the container image to an industrial personal computer, carrying out secondary judgment on the container information by a container automatic identification and positioning algorithm in the industrial personal computer, carrying out perforation after the accurate position is identified, lifting the container to be placed on an AGV trolley to be delivered to an outlet, and deleting the position information of the container number by the database, thereby completing delivery.
In the step 3, the position of the container stored in the SQL Server database is a theoretical value and has a certain deviation from the actual position, so that the binocular camera is adopted to secondarily identify and position the container, and the accurate position of the lock hole on the container is found out, and the specific algorithm is as follows:
step 3.1: the binocular camera collects container patterns, a multi-operator fusion algorithm is adopted for the container edge extraction aiming at the patterns, noise reduction processing is carried out on the extracted edges, container edge coordinates are extracted, the relative offset angle of the container and the binocular camera is calculated, photographing is carried out again after the offset angle is zero by rotating the lifting appliance, new edge coordinates of the patterns after noise reduction are obtained, redundant backgrounds are removed by utilizing the coordinates, and a container image is intercepted.
Step 3.2: and (3) carrying out threshold processing on the cut container image, cutting out a keyhole image on the container, carrying out feature matching on the keyhole positions of the left image and the right image which are cut out, removing points which do not accord with the matching by utilizing the Euclidean distance method, and calculating the center pixel coordinate of the keyhole.
Step 3.3: and carrying out three-dimensional reconstruction on the central pixel coordinates of the lock hole, bringing the internal and external parameters marked by the camera into a projection matrix, and obtaining the central world coordinates of the lock hole according to simultaneous equations of the central pixel coordinates of the lock hole of the left and right images and the projection matrix.
Compared with the prior art, the invention has the following obvious advantages: the mechanical automation level of wharfs, ports, goods yards and other places is improved, and the efficiency of hoisting containers by a crane is improved. Firstly, the theoretical position of the container is stored in a database, and secondly, the container is secondarily identified and positioned by adopting a machine vision algorithm, so that the positioning precision is improved, the image background interference is reduced, and the algorithm is simple in processing, high in efficiency and strong in applicability.
Drawings
Fig. 1 is a flow chart of the operation of the present invention.
Detailed Description
The following further describes the implementation of the present invention:
the automatic container identifying and positioning method includes industrial computer, binocular camera, monocular camera and light source, and the industrial computer is equipped with WinCC process monitoring system application program with SQL Server data base, and the binocular camera is mounted on the container lifting tool for secondary identification and positioning of container, and the monocular camera is mounted on the container warehouse-in place for automatic identification of warehouse-in container number, and the light source is mounted together with camera, and can automatically regulate brightness according to the change of ambient light.
The method specifically comprises the following steps:
step 1: and respectively adjusting focal length and aperture of the binocular camera and the monocular camera, calibrating the binocular camera by adopting a Zhang plane calibration method to obtain internal and external parameters of the camera, and preparing for three-dimensional coordinate reconstruction.
Step 2: before the container is put in storage, the monocular camera scans and collects the container number pattern and uploads the pattern to the industrial personal computer, a set of automatic identification system for the container number is arranged on the industrial personal computer, the system automatically identifies and uploads the container number to a WinCC process monitoring system, the WinCC process monitoring system is provided with a set of storage in-out and in-out program, the program is used for draining and finding out empty positions of a site database, and an AGV (automatic guided vehicle) is used for automatically conveying the container to a destination nearby the empty positions.
Step 3: after the AGV guiding trolley conveys the container to a destination near the vacant site, a binocular camera on the container lifting tool collects the container picture and uploads the container picture to an industrial personal computer, a set of automatic container identification and positioning algorithm is designed in the industrial personal computer, the collected pattern is analyzed, the accurate position of a container lock hole is identified, the container lifting tool automatically punches and lifts the container to place the vacant site, meanwhile, a WinCC process monitoring system stores the position information of the container number in an SQL Server database, the AGV trolley automatically returns to an entrance and exit, and the container warehousing is completed. When the container is delivered, firstly, searching an SQL Server database according to the container number of the container to be delivered, finding out the position information corresponding to the container number, automatically enabling a container crane to reach the position, collecting the container image delivered by a binocular camera on a container lifting tool, uploading the container image to an industrial personal computer, carrying out secondary judgment on the container information by a container automatic identification and positioning algorithm in the industrial personal computer, carrying out perforation after the accurate position is identified, lifting the container to be placed on an AGV trolley to be delivered to an outlet, and deleting the position information of the container number by the database, thereby completing delivery.
In the step 3, the position of the container stored in the SQL Server database is a theoretical value and has a certain deviation from the actual position, so that the binocular camera is adopted to secondarily identify and position the container, and the accurate position of the lock hole on the container is found out, and the specific algorithm is as follows:
step 3.1: the binocular camera collects container patterns, a multi-operator fusion algorithm is adopted for the container edge extraction aiming at the patterns, noise reduction processing is carried out on the extracted edges, container edge coordinates are extracted, the relative offset angle of the container and the binocular camera is calculated, photographing is carried out again after the offset angle is zero by rotating the lifting appliance, new edge coordinates of the patterns after noise reduction are obtained, redundant backgrounds are removed by utilizing the coordinates, and a container image is intercepted.
Step 3.2: and (3) carrying out threshold processing on the cut container image, cutting out a keyhole image on the container, carrying out feature matching on the keyhole positions of the left image and the right image which are cut out, removing points which do not accord with the matching by utilizing the Euclidean distance method, and calculating the center pixel coordinate of the keyhole.
Step 3.3: and carrying out three-dimensional reconstruction on the central pixel coordinates of the lock hole, bringing the internal and external parameters marked by the camera into a projection matrix, and obtaining the central world coordinates of the lock hole according to simultaneous equations of the central pixel coordinates of the lock hole of the left and right images and the projection matrix.
In the design of the automatic container identification and positioning method, the theoretical position of the container is firstly stored in the database, and then the container is secondarily identified and positioned by adopting the machine vision algorithm, so that the positioning precision is improved, the image background interference is reduced, and the algorithm is simple in processing, high in efficiency and strong in applicability.
The technical means disclosed by the scheme of the invention is not limited to the technical means disclosed by the embodiment, and also comprises the technical scheme formed by any combination of the technical features. It should be noted that modifications and adaptations to the invention may occur to one skilled in the art without departing from the principles of the present invention and are intended to be within the scope of the present invention.

Claims (1)

1. A container automatic identification and positioning method is characterized in that: the system comprises an industrial personal computer, a binocular camera, a monocular camera and a light source, wherein a WinCC process monitoring system application program with an SQL Server database is installed on the industrial personal computer, the binocular camera is installed on a container lifting appliance, the monocular camera is installed at a container warehouse entry position, and the light source is installed in a matched manner with the camera and can automatically adjust brightness according to the change of ambient light; the method specifically comprises the following steps:
step 1: the focal length and aperture of the binocular camera and the monocular camera are adjusted respectively, the binocular camera is calibrated by adopting a Zhang plane calibration method, internal and external parameters of the camera are obtained, and preparation is made for three-dimensional coordinate reconstruction;
step 2: before a container is put in storage, a monocular camera scans and collects container number patterns and uploads the container number patterns to an industrial personal computer, a set of automatic container number recognition system is arranged on the industrial personal computer, the automatic container number recognition system carries out automatic recognition uploading to a WinCC process monitoring system, the WinCC process monitoring system is provided with a set of storage in-out program, the program carries out arrangement and space searching on a site database, and an AGV guide trolley automatically conveys the container to a destination nearby the space;
step 3: after the AGV guides the trolley to transport the container to the destination near the vacancy, the binocular camera on the container sling collects the container picture and uploads to the industrial personal computer, a set of container automatic identification and positioning algorithm is designed in the industrial personal computer, the collected pattern is analyzed, the accurate position of the container lock hole is identified, the container sling automatically punches and lifts the container to place the vacancy, meanwhile, the WinCC process monitoring system stores the position information of the container number in the SQL Server database, the AGV trolley automatically returns to the entrance and exit, and the container warehousing is completed;
when the container is delivered, firstly searching an SQL Server database according to the container number of the container to be delivered, finding out the position information corresponding to the container number, automatically reaching the position by a container crane, wherein the position of the container stored in the SQL Server database is a theoretical value and has a certain deviation from the actual position, so that a binocular camera is adopted to secondarily identify and position the container, and the accurate position of a lock hole on the container is found out;
the method comprises the following specific steps: the binocular camera on the container sling collects the pictures of the container coming out of the warehouse and uploads the pictures to the industrial personal computer, the automatic identification and positioning algorithm of the container in the industrial personal computer carries out secondary judgment on the information of the container, the container is placed on the AGV trolley to be delivered to the outlet after the accurate position of the lock hole of the container is identified, and meanwhile, the database deletes the position information of the number of the container to finish the coming out of the warehouse;
the specific algorithm for identifying the accurate position of the lock hole of the container is as follows:
step 3.1: the binocular camera collects container patterns, a multi-operator fusion algorithm is adopted for the container edge extraction of the patterns, noise reduction treatment is carried out on the extracted edges, container edge coordinates are extracted, the relative offset angle of the container and the binocular camera is calculated, photographing is carried out again after the offset angle is zero by rotating a lifting appliance, new edge coordinates of the patterns after noise reduction are obtained, redundant backgrounds are removed by utilizing the coordinates, and a container image is intercepted;
step 3.2: performing threshold processing on the cut container image, cutting out a keyhole image on the container, performing feature matching on the keyhole positions of the left image and the right image, removing points which do not accord with the matching by using the Euclidean distance method, and calculating the center pixel coordinate of the keyhole;
step 3.3: and carrying out three-dimensional reconstruction on the central pixel coordinates of the lock hole, bringing the internal and external parameters marked by the camera into a projection matrix, and obtaining the central actual coordinates of the lock hole according to simultaneous equations of the central pixel coordinates of the lock hole of the left and right images and the projection matrix.
CN201811501109.8A 2018-11-28 2018-11-28 Automatic container identification and positioning method Active CN111243016B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811501109.8A CN111243016B (en) 2018-11-28 2018-11-28 Automatic container identification and positioning method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811501109.8A CN111243016B (en) 2018-11-28 2018-11-28 Automatic container identification and positioning method

Publications (2)

Publication Number Publication Date
CN111243016A CN111243016A (en) 2020-06-05
CN111243016B true CN111243016B (en) 2024-03-19

Family

ID=70871276

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811501109.8A Active CN111243016B (en) 2018-11-28 2018-11-28 Automatic container identification and positioning method

Country Status (1)

Country Link
CN (1) CN111243016B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112288800B (en) * 2020-09-27 2023-05-12 山东浪潮科学研究院有限公司 Method, equipment and device for identifying door lock eyes of server cabinet
CN114219842B (en) * 2021-12-14 2022-08-12 东南大学 Visual identification, distance measurement and positioning method in port container automatic loading and unloading operation
CN114339989B (en) * 2021-12-27 2023-04-28 同济大学 Multi-agent system distributed positioning method based on azimuth angle
CN115049322B (en) * 2022-08-16 2022-12-20 安维尔信息科技(天津)有限公司 Container management method and system for container yard

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003252410A (en) * 2002-03-04 2003-09-10 Gen Kojima Simple and versatile method of controlling document or the like
JP2004099276A (en) * 2002-09-11 2004-04-02 Mitsubishi Heavy Ind Ltd Physical distribution management device and method using radio tag and physical distribution management program
CN101251381A (en) * 2007-12-29 2008-08-27 武汉理工大学 Dual container positioning system based on machine vision
CN101289156A (en) * 2008-05-30 2008-10-22 浙江工业大学 Intelligent container sling based on omniberaing vision sensor
CN102024144A (en) * 2010-11-23 2011-04-20 上海海事大学 Container number identification method
CN108062768A (en) * 2017-12-12 2018-05-22 中国矿业大学 It is a kind of based on the wirerope axis of surface texture feature to mobile status recognition methods
CN108427423A (en) * 2018-05-07 2018-08-21 温州大学瓯江学院 A kind of unmanned intelligent comprehensive monitoring and dispatching system and its control method of storing in a warehouse
CN108491851A (en) * 2018-01-29 2018-09-04 江苏大学 A kind of container lockhole based on machine vision is quick to be identified and suspender method for correcting error

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3033293B1 (en) * 2013-08-12 2017-10-11 ABB Schweiz AG Method and system for automatically landing containers on a landing target using a container crane

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003252410A (en) * 2002-03-04 2003-09-10 Gen Kojima Simple and versatile method of controlling document or the like
JP2004099276A (en) * 2002-09-11 2004-04-02 Mitsubishi Heavy Ind Ltd Physical distribution management device and method using radio tag and physical distribution management program
CN101251381A (en) * 2007-12-29 2008-08-27 武汉理工大学 Dual container positioning system based on machine vision
CN101289156A (en) * 2008-05-30 2008-10-22 浙江工业大学 Intelligent container sling based on omniberaing vision sensor
CN102024144A (en) * 2010-11-23 2011-04-20 上海海事大学 Container number identification method
CN108062768A (en) * 2017-12-12 2018-05-22 中国矿业大学 It is a kind of based on the wirerope axis of surface texture feature to mobile status recognition methods
CN108491851A (en) * 2018-01-29 2018-09-04 江苏大学 A kind of container lockhole based on machine vision is quick to be identified and suspender method for correcting error
CN108427423A (en) * 2018-05-07 2018-08-21 温州大学瓯江学院 A kind of unmanned intelligent comprehensive monitoring and dispatching system and its control method of storing in a warehouse

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
"基于双目立体视觉的集装箱识别与定位技术研究";马蕾;《中国优秀硕士学位论文全文数据库信息科技辑》;20131115(第11期);正文第1页第1段-第48页第8段,图3-1—3-8、图4-1—4.10、表4-1、图5-1—5-2 *
"基于图像的集装箱锁孔定位技术";张洪波等;《起重运输机械》;20151031(第10期);第67-69页 *
A new model of binocular stereo vision system;Lin, PD et al.;《 PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON PRECISION MECHANICAL MEASUREMENT》;第4卷;第228-231页 *
Framework for consistent maintenance of geometric data and abstract task-knowledge from range observations;Juan Carlos Ramirez et al.;《2011 IEEE International Conference on Robotics and Biomimetics》;第963-969页 *
基于双目视觉的集装箱自动识别定位***的设计;梁晓波等;《机械》;20150131;第42卷(第01期);第7页右栏第1段—第10页右栏第2段,图1-5,表1 *
基于机器视觉的港口集装箱卸船定位识别***;王雪等;《中国水运(下半月)》;20151115(第11期);第138-140页 *
梁晓波等.基于双目视觉的集装箱自动识别定位***的设计.《机械》.2015,第42卷(第01期), *
纪寿文等.《现代物流装备与技术实务》.深圳:海天出版社,2004,第100-105页. *

Also Published As

Publication number Publication date
CN111243016A (en) 2020-06-05

Similar Documents

Publication Publication Date Title
CN111243016B (en) Automatic container identification and positioning method
EP3740897B1 (en) License plate reader using optical character recognition on plural detected regions
DE102013109220B4 (en) Robotic device and method for removing bulk goods from a warehouse
CN110245663B (en) Method for identifying steel coil information
CN110084243B (en) File identification and positioning method based on two-dimensional code and monocular camera
EP2345515A1 (en) Method for taking out work
US20220322592A1 (en) Method and device for disassembling electronics
CN107324041A (en) The manipulator and automatic film magazine handling device clamped for film magazine
CN106839985A (en) The automatic identification localization method of unmanned overhead traveling crane coil of strip crawl
CN113891775A (en) Method for providing slab planning geometry data, method for cutting out a workpiece, and planar laser machine tool
CN105701492A (en) Machine vision identification system and implementation method thereof
US9818198B2 (en) Method for near-realtime workspace mapping
CN109454004B (en) Robot scanning and sorting system and method
CN111112108B (en) Hull plate cutting part sorting equipment and method
KR101445973B1 (en) Recognition Method and System for Block Production Progress using Image Process
CN112605993A (en) Automatic file grabbing robot control system and method based on binocular vision guidance
CN111855667A (en) Novel intelligent train inspection system and detection method suitable for metro vehicle
CN117745187B (en) Automatic drug delivery system and method based on AGV
CN207976755U (en) A kind of steel warehouse control system based on machine vision and PLC
CN114419437A (en) Workpiece sorting system based on 2D vision and control method and control device thereof
CN106477219B (en) A kind of plate warehousing finished products management system and method based on machine vision
CN111145254B (en) Door valve blank positioning method based on binocular vision
CN112429444A (en) Garbage recycling robot and control method thereof
CN111899145A (en) Three-dimensional warehouse inventory method and system based on machine vision
CN108037503B (en) Laser radar-based planar multi-plate positioning method for feeding and discharging of household plates

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant