CN110621447B - Robot conveyor calibration method, robot system and control system - Google Patents
Robot conveyor calibration method, robot system and control system Download PDFInfo
- Publication number
- CN110621447B CN110621447B CN201780090669.6A CN201780090669A CN110621447B CN 110621447 B CN110621447 B CN 110621447B CN 201780090669 A CN201780090669 A CN 201780090669A CN 110621447 B CN110621447 B CN 110621447B
- Authority
- CN
- China
- Prior art keywords
- robot
- sensor
- coordinate system
- conveyor member
- conveyor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1679—Programme controls characterised by the tasks executed
- B25J9/1692—Calibration of manipulator
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/0093—Programme-controlled manipulators co-operating with conveyor means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
- B25J9/1697—Vision controlled systems
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Manipulator (AREA)
Abstract
A conveyor coordinate system (X) for utilizing a movable conveyor member (18) con ) To calibrate the robot coordinate system (X) of the robot (12) base 、X mi 、X tool ) The method of (a), the method comprising: providing a sensor (24), the sensor (24) being configured to detect a position of the robot (12) in a non-contact manner; detecting a position of the robot (12) when the conveyor member (18) is positioned at the first operating position; detecting by the sensor (24) at a sensor coordinate system (X) when the conveyor member (18) is positioned at a second operative position different from the first operative position sen ) A robot (12) and/or conveyor member (18) position; and based on the in-sensor coordinate system (X) sen ) Detecting the position of at least one robot (12), determining a robot coordinate system (X) base 、X mi 、X tool ) And transmitter coordinate system (X) con ) The relationship between them. A robotic system (10) and a control system (16) are also provided.
Description
Technical Field
The present disclosure generally relates to calibrating a robot coordinate system of a robot using a conveyor coordinate system of a movable conveyor member. In particular, a method for performing such calibration by using a non-contact sensor, a robot system for such calibration comprising a robot, a conveyor and a non-contact sensor, and a control system for such calibration are provided.
Background
Calibrating the robot to the conveyor can be a cumbersome and difficult operation, which is however also very important. For example, in pick and place robotic systems, the pick accuracy (i.e., the positioning accuracy of the robot when picking objects from a moving conveyor member of the conveyor) is well established depending entirely on the relationship between the position of the robot and the conveyor member.
The most common procedure used today for calibrating robots to conveyor components is to perform the calibration steps of the system manually. However, this process requires expertise (e.g., knowledge and experience) and is time consuming. Manual techniques are also required with good accuracy when the robot Tool Center Point (TCP) has to be jogged (jogged) to different reference points that are recorded with high precision.
US2017066133A1 discloses a coordinate system setting method configured to set a conveyor coordinate system having a predefined relationship with a base coordinate system of a robot as a coordinate system for defining a position of an object on a conveyor, having in a system an arrangement of: wherein the position of the object transferred by the conveyor is detected, and the robot performs work on the corresponding object based on the detected position. The method uses a plurality of features on a movable portion of the conveyor and a non-contact sensor provided on the robot.
WO0045229A1 discloses an apparatus and method for enabling an uncalibrated, model-independent controller for a mechanical system using a dynamic quasi-newtonian algorithm incorporating a velocity component of any moving system parameter.
WO2015121767A1 discloses an automatic calibration method for a robotic system, the method comprising: calibrating intrinsic parameters of the sensor and the sensor coordinate system; controlling the robot under the guidance of the calibrated sensor; and calculating a transformation matrix of the tool coordinate system relative to a tool center point coordinate system of the robot.
US2012229620A1 discloses an image processing apparatus including a management unit, an updating unit, an identifying unit, and a transmitting unit.
Disclosure of Invention
It is an object of the present disclosure to provide a method for calibrating a robot coordinate system of a robot using a conveyor coordinate system of a movable conveyor member, which method enables calibration to be simple, fast, automated and/or accurate.
It is a further object of the present disclosure to provide a robotic system configured to perform such calibration that addresses the above-mentioned objectives.
It is a further object of the present disclosure to provide a control system configured to control such calibration that addresses the above mentioned objectives.
According to one aspect, there is provided a method for calibrating a robot coordinate system of a robot using a conveyor coordinate system of a movable conveyor member. The method includes providing a sensor configured to detect a position of the robot in a non-contact manner; detecting, by the sensor, a position of the robot in a sensor coordinate system of the sensor when the conveyor member is positioned at the first operating position; detecting, by a sensor, a position of the robot and/or a position of the conveyor member in a sensor coordinate system when the conveyor member is positioned at a second operational position different from the first operational position; and determining a relationship between the robot coordinate system and the conveyor coordinate system based on the at least one detected position of the robot in the sensor coordinate system.
The conveyor member may be comprised by a conveyor. The conveyor member may be arranged to convey the object into (or within) the working range of the robot. As one example, the conveyor member may be constructed from a linear conveyor member (e.g., a conveyor belt). Alternatively, the conveyor member may be constituted by an endless conveyor member.
The conveyor member may be moved from the first position to the second position and vice versa. The conveyor member does not necessarily have to stop at the first and second operating positions. According to a variant, the conveyor member is continuously moved (e.g. at low speed) through the first and second operating positions. However, according to a variant, the conveyor member stops in one or both of the first and second operating positions. The robot may also be stationary or not when the same position is detected.
The sensor may be any type of sensor for detecting the position of the robot in a non-contact manner. For example, the sensor may be constituted by a visual sensor, such as: two-dimensional (2D) or three-dimensional (3D) vision sensors (e.g., cameras). The sensor may alternatively be formed by radar.
As used herein, a detected position may have translational components (e.g., x, y, and z offsets). Optionally, the detected position also has an orientation component (e.g., three euler angles) to indicate the orientation of the detected position (e.g., the orientation of the tool or marker).
By providing a sensor to detect the position of the robot in a non-contact manner, a simplified installation and a simplified removal of the sensor is made possible compared to attaching the sensor to the robot. For example, provision of a sensor configured to detect the position of the robot in a non-contact manner may include simply placing the sensor on a conveyor member or fixture structure (such as on a fixture portion of the conveyor or on a fixture structure on the floor). The simple installation and removal of the sensors helps to speed up the calibration process of the robotic system and reduce down time of the robotic system.
In the case where the sensor is positioned on the fixture structure (e.g., outside of the conveyor member), the sensor may remain at this position during operation of the robotic system. Thus, after stopping the operation of the robot system, a further calibration process may be started quickly.
The robot may include a tool, and the position of the robot may be a position of the tool. For industrial robots, the position of the tool in the robot coordinate system is basically known. However, the position of the robot may be any position that can be identified by the sensors and has a known or calculable position in the robot coordinate system. For example, markers may be attached to the robot to define the position of the robot to be detected by the sensor.
The method may further comprise: the position of the robot in the different poses is detected in the sensor coordinate system by the sensor when the conveyor member is in the first operating position and/or when the conveyor member is in the second operating position. For example, the sensor may detect two poses of the robot when the conveyor member is positioned at the first operative position, and the sensor may detect one pose of the robot when the conveyor member is positioned at the second operative position. In this situation, the robot may move from the first pose to the second pose before the conveyor member moves from the first operative position to the second operative position. As a further example, the sensor may only detect a first pose of the robot when the conveyor member is positioned at the first operative position, and the sensor may only detect a second pose of the robot when the conveyor member is positioned at the second operative position.
The sensor may be positioned on the conveyor member, and the method may include: the position of the robot is detected in the sensor coordinate system by the sensor when the conveyor member is positioned at the first operating position and when the conveyor member is positioned at the second operating position. For example, the sensor may simply be placed on or secured to the conveyor member (e.g., by using a clamp). In this case, the step of determining the relationship between the robot coordinate system and the conveyor coordinate system may be based on two positions of the robot detected in the sensor coordinate system (i.e. in the first operating position of the conveyor member and the second operating position of the conveyor member).
The method may further comprise: determining a direction of movement of the conveyor member in the robot coordinate system based on the detected position of the robot in the sensor coordinate system; and determining a relationship between the robot coordinate system and the conveyor coordinate system based on the determined direction of movement of the conveyor member. For example, if the sensor is positioned on a linear conveyor member and the conveyor member is moved from a first operative position to a second operative position, the movement of the sensor may be defined by a vector that is parallel to the direction of movement of the conveyor member. If the conveyor member is constituted by an endless conveyor member, the direction of movement of the conveyor member may be determined based on the position of the robot detected in three different operating positions of the conveyor member. The direction of movement of the conveyor member may first be determined in the sensor coordinate system and then in the robot coordinate system.
The method may be used to calibrate a plurality of robots along a conveyor member. In this case, the method may further include: moving the conveyor member from the second operative position to a third operative position; detecting, by the sensor, a position of the second robot in the sensor coordinate system when the conveyor member is positioned at the third operating position; moving the conveyor member from the third operating position to a fourth operating position; detecting, by the sensor, a position of the second robot in the sensor coordinate system when the conveyor member is positioned at the fourth operating position; and determining a relationship between the robot coordinate system and the conveyor coordinate system of the second robot based on the position of the second robot detected in the sensor coordinate system (i.e. based on the at least one position of the second robot when the conveyor member is positioned at the third operating position and based on the at least one position of the second robot when the conveyor member is positioned at the fourth operating position). The third operating position may be downstream of the second operating position, and the fourth operating position may be downstream of the third operating position, as seen in the direction of movement of the conveyor member.
The relationship between the sensor coordinate system and the transmitter coordinate system may be known in advance. Alternatively, it may be detected or set, for example, during calibration. This may be useful when the position of the conveyor member is not registered by the sensor (e.g. when the sensor is arranged to face only the robot).
The sensor may be further configured to detect the position of the conveyor member in a non-contact manner. Thus, the sensor may be positioned on the conveyor member to face both the robot and the conveyor member. In this situation: the sensor may detect a position of the robot when the conveyor member is positioned at the first operating position; the sensor may detect a position of the robot when the conveyor member is positioned at the second operating position; and the sensor may detect the position of the conveyor member when the conveyor member is positioned at the first operative position, the second operative position, or at any other operative position.
The method may further comprise: detecting, by a sensor, a position of a conveyor member in a sensor coordinate system; and determining a relationship between the sensor coordinate system and the conveyor coordinate system based on the detected position of the conveyor member in the sensor coordinate system.
At least one calibration mark may be provided on the conveyor component, which calibration mark is used for detection of the position of the conveyor component. The position of the at least one calibration mark in the conveyor coordinate system may be known in advance. Alternatively, it may be detected or set during, for example, calibration.
The sensor may be positioned on the mount structure so that the conveyor member moves relative to the sensor, and the sensor may be further configured to detect the position of the conveyor member in a non-contact manner. Thus, the sensor may be positioned on the fixture structure to face both the robot and the conveyor member. In such a situation, the step of determining the relationship between the robot coordinate system and the conveyor coordinate system may be based on only one position of the robot detected in the sensor coordinate system (i.e. when the conveyor member is positioned at the first operating position, the second operating position, or at any other operating position).
The fixing structure may be constituted, for example, by a fixing part of the conveyor or by a fixing structure on the floor, such as a shelf or table, on which the sensor is positioned. The fixture structure according to the present disclosure may also be constituted by a mobile device which is kept stationary when the calibration method is performed. At least one calibration mark may be provided on the conveyor component, which calibration mark is used for detection of the position of the conveyor component.
The method may further comprise: detecting, by a sensor, a position of at least one calibration mark in a sensor coordinate system when the conveyor member is positioned at the first operating position; detecting, by the sensor, a position of the at least one calibration mark in the sensor coordinate system when the conveyor member is positioned at the second operating position; determining a direction of movement of the conveyor member in the robot coordinate system based on the position of the at least one calibration mark detected in the sensor coordinate system; and determining a relationship between the robot coordinate system and the conveyor coordinate system based on the determined direction of movement of the conveyor member. The position of the at least one calibration mark in the conveyor coordinate system may be known in advance. Alternatively, it may be detected or set during, for example, calibration.
If the conveyor member is constituted by a linear conveyor member, the direction of movement of the conveyor member may be determined based on the position of the at least one calibration mark detected in two different operating positions of the conveyor member. If the conveyor member is constituted by an endless conveyor member, the direction of movement of the conveyor member may be determined on the basis of the position of the at least one calibration mark detected in three different operating positions of the conveyor member.
According to a further aspect, there is provided a robotic system comprising: at least one robot, a movable conveyor member, and a sensor configured to detect a position of the robot in a non-contact manner. The robotic system may be configured to perform any method according to the present disclosure. A robotic system may include a plurality of robots working along a conveyor member (e.g., by picking up objects). One or more robots, conveyor members, and sensors of a robotic system may be of any type in accordance with the present disclosure.
According to a further aspect, there is provided a control system for calibrating a robot coordinate system of a robot using a conveyor coordinate system of a movable conveyor member in a robot system, the robot system comprising: a robot, a conveyor member, and a sensor configured to detect a position of the robot in a non-contact manner, the control system comprising: a data processing apparatus and a memory, the memory having stored thereon a computer program comprising program code which, when executed by the data processing apparatus, causes the data processing apparatus to perform the steps of: controlling the sensor to detect a position of the robot in a sensor coordinate system of the sensor when the conveyor member is positioned at the first operating position; controlling the sensor to detect a position of the robot and/or the conveyor member in a sensor coordinate system when the conveyor member is positioned at a second operational position different from the first operational position; and determining a relationship between the robot coordinate system and the conveyor coordinate system based on the detected at least one position of the robot in the sensor coordinate system. The control system thus provides for an automatic and contactless calibration method.
Drawings
Further details, advantages and aspects of the disclosure will become apparent from the following examples taken in conjunction with the accompanying drawings, in which
Fig. 1a schematically shows a perspective view of a robotic system according to a first embodiment, wherein the conveyor member is positioned at a first operative position;
FIG. 1b schematically illustrates a perspective view of the robotic system in FIG. 1a, but with the conveyor member positioned at a second operative position;
figure 2a schematically shows a perspective view of the robotic system according to a second embodiment, wherein the conveyor member is positioned at a first operative position;
FIG. 2b schematically shows a perspective view of the robotic system in FIG. 2a, but with the conveyor member positioned at a second operating position;
fig. 3 schematically shows a perspective view of a further robot system according to the first embodiment;
fig. 4 schematically shows a perspective view of a further robot system according to a second embodiment;
fig. 5a schematically shows a perspective view of a robot system according to a third embodiment, wherein the conveyor member is positioned at a first operating position; and
fig. 5b schematically shows a perspective view of the robotic system in fig. 5a, but with the conveyor member positioned at the second operating position.
Detailed Description
Hereinafter, a robot-conveyor calibration method using a non-contact sensor, a robot system including a robot, a conveyor, and a non-contact sensor for this calibration, and a control system for this calibration will be described. The same reference numerals will be used to designate the same or similar structural features.
Fig. 1a and 1b schematically show perspective views of a robot system 10 according to a first embodiment. The robot system 10 includes: a robot 12, a conveyor 14, and a control system 16.
The robot 12 illustrated in fig. 1a comprises three robot coordinate systems: base coordinate system X base Tool coordinate system X tool And a mounting interface coordinate system X mi . Base coordinate system X base Is a cartesian coordinate system with its origin at the base of the robot 12. Tool coordinate system X tool Is a cartesian coordinate system with its origin at the tool 22 of the robot 12 (here exemplified as a vacuum gripper with a single suction cup). Mounting interface coordinate system X mi Is its originA cartesian coordinate system at the mounting interface of the tool 22. According to the present disclosure, the base coordinate system X of the robot 12 base Tool coordinate system X tool Mounting interface coordinate system X mi Or any other coordinate system may be used as the robot coordinate system of robot 12, which is used for the conveyor coordinate system X with the conveyor members 18 con And (6) calibrating. Transmitter coordinate system X con Is also a cartesian coordinate system and has its origin on the conveyor member 18.
When the robot 12 performs a treatment operation on one or more objects, it is important that the robot coordinate system X of the robot 12 base 、X mi 、X tool And the transmitter coordinate system X of the transmitter member 18 con Is well calibrated. With good calibration, the defined positions in the conveyor coordinate system (such as the position of an object on the conveyor member 18) can be in the robot coordinate system X base 、X mi 、X tool Is accurately defined. Thus, the precision of the treatment operations performed by the robot 12 on the objects on the conveyor members 18 may be improved, wherein in turn the robot 12 is enabled to perform more complex and/or faster tasks. As a further result, the risk of failure of the robotic system 10 may be reduced.
The robotic system 10 also includes sensors 24. The sensor 24 is a non-contact sensor and may for example be constituted by a 2D or 3D vision sensor (e.g. a camera). Cartesian sensor coordinate system X sen Is associated with the sensor 24.
The sensor 24 of the first embodiment is positioned on the conveyor member 18. As can be seen in fig. 1a, the sensor 24 is oriented vertically upwards. Thus, the sensor 24 is configured to detect the position of the robot 12 in a non-contact manner. Position detection may be accomplished by any known measurement technique. In fig. 1a, the sensor 24 is configured to detect the position of the tool 22 of the robot 12 as the position of the robot 12.
According to a first embodiment, for using the transmitter coordinate system X con To calibrate the robot coordinate system X base 、X mi 、X tool Will now be described. First, the sensor 24 is placed on the conveyor member 18 facing the robot 12. In fig. 1a, conveyor member 18 is positioned in a first operating position. When conveyor member 18 is positioned at the first operating position, sensor 24 detects a position in sensor coordinate system X sen Of the tool 22. In other words, the transformation between the tool 22 and the sensor 24 is measured. When the conveyor member 18 is positioned at the first operating position, the position of the tool 22 is detected for at least one pose of the robot 12.
Then, as illustrated in fig. 1b, the conveyor member 18 (and the sensor 24 thereon) is moved in the moving direction 20 from the first operating position to the second operating position. When conveyor member 18 is positioned at the second operating position, sensor 24 detects that tool 22 is in sensor coordinate system X sen To a further position in (a). For this detection, the robot 12 may be the same pose as in fig. 1a, or may be a different pose. In the example of fig. 1a and 1b, the robot 12 remains in the same pose when the conveyor member 18 is positioned at the first operative position and at the second operative position.
From the data collected by sensors 24, the direction of movement 20 of conveyor member 18 may be determined, but the relationship between robot 12 and conveyor member 18 cannot be determined. The relative position of the sensor 24 in space can be used to find the direction of movement 20. Two points of the sensor 24 in space may be used to construct a vector from which the direction of movement 20 may be determined.
For example, the motion vector may be in the robot coordinate system X tool Is calculated and expressed as follows. The robot 12 is caused to have the same posture for the first operation position and the second operation position. The measured position of tool 22 at the first operative position of conveyor member 18 is inverted. This will give the sensor 24 the robot coordinate system X tool To the first position. The measured position of tool 22 at the second operative position of conveyor member 18 is inverted. This will give the sensor 24 translated in the robot coordinate system X tool Of (c) is used. Subtracting the two positions to obtain the coordinate system X of the robot tool The motion vector expressed in (1).
The transformation between sensor 24 and transmitter member 18 may be known in advance in order to obtain the final transformation between sensor 24 and transmitter member 18. Alternatively, it may be detected or set during, for example, calibration. Once calibration is complete, the sensors 24 may be removed from the conveyor members 18 and the robotic system 10 is ready for operation.
By using the calibration method according to the first embodiment, all calibration steps can be automated and the calibration accuracy will be high without relying on manual or professional techniques. It is also easier to simply place the sensor 24 on the conveyor member 18 than to mount the sensor 24 on the tool 22 of the robot 12.
For calibration, the conveyor member 18 may be moved to a further operating position for detecting a further position of the robot 12 by the sensor 24. At each operating position of conveyor member 18, sensor 24 may detect more than one position of robot 12 (e.g., different poses of robot 12). If several poses of the robot 12 are detected at one operational position of the conveyor member 18, then from the mounting interface coordinate system X mi Tool coordinate system X tool May be calculated as an additional result.
From the installation interface coordinate system X mi Tool coordinate system X tool May not always be known. The tool 22 is essentially customized for the application that the robot 12 is to execute (e.g., pick up cheese). Size of tool 22 and position (X) of tool 22 tool ) Will be different for different user scenarios. However, the size of the robot 12 (including the position X of the mounting interface) mi ) Are basically known beforehand.
However, the position (X) of the tool 22 may be found by having the sensor 24 for multiple (e.g., at least two) different poses of the robot 12 tool ) Thereby finding the transformation. Since the pose of the robot 12 is known, andthe mounting interface coordinate system X from the tool 22 using the data found by the sensor 24 mi Tool coordinate system X tool May be calculated. From the installation interface coordinate system X mi Tool coordinate system X tool Transformation X of mt Can be calculated as follows.
Wherein X tooli Is X tool Position of the ith measurement, X toolj Is X tool Position of the j-th measurement, X mii Is an installation interface X mi Ith position of (2), X mij Is an installation interface X mi And i and j are positive integers.
The control system 16 includes a data processing device 26 (e.g., a central processing unit, CPU) and a memory 28. The computer program is stored in the memory 28. In a first embodiment, the computer program may comprise program code which, when executed by the data processing apparatus 26, causes the data processing apparatus 26 to: controlling sensor 24 to detect that robot 12 is in sensor coordinate system X of sensor 24 when conveyor member 18 is positioned at the first operating position sen The position of (1); controlling movement of conveyor member 18 from the first operative position to the second operative position; controlling sensor 24 to detect that robot 12 is in sensor coordinate system X when conveyor member 18 is positioned at the second operating position sen The position of (1); and based on the in-sensor coordinate system X sen The detected position of the robot 12 is determined in the robot coordinate system X base 、X mi 、X tool And transmitter coordinate system X con The relationship between them. In accordance with the present disclosure, the computer program may also include computer code,wherein the data processing device 26, when executed by the data processing device 26, is caused to control the conveyor members 18, the sensors 24, and the robot 12 (and possibly other robots) according to the present disclosure. Control system 16 is in signal communication with conveyor member 18, sensors 24, and robot 12 (and possibly other robots).
Fig. 2a and 2b schematically show perspective views of a robot system 10 according to a second embodiment. The main differences with respect to the first embodiment will be described.
The sensor 24 of the second embodiment is also positioned on the conveyor member 18. As can be seen in fig. 2a, the sensor 24 is angled slightly upwards with respect to the horizontal and faces both the conveyor member 18 and the robot 12. Accordingly, sensor 24 is configured to detect the position of robot 12 and to detect the position of conveyor member 18.
Calibration marks 30 are provided on conveyor component 18. Sensor 24 can thus detect that conveyor member 18 is in sensor coordinate system X sen Of (c) is used. Calibration marks 30 may be any type of feature on conveyor component 18 that is identifiable by sensor 24. Calibration marks 30 may be provided permanently on conveyor component 18 (e.g., painted marks) or may be provided temporarily on conveyor component 18 (e.g., attached pyramids).
According to a second embodiment, the transmitter coordinate system X is used con To calibrate the robot coordinate system X base 、X mi 、X tool Will now be described. Sensor 24 is first placed on conveyor member 18, facing both conveyor member 18 and robot 12. In fig. 2a, conveyor member 18 is positioned in a first operating position. When conveyor member 18 is positioned at the first operating position, sensor 24 is in sensor coordinate system X sen The position of the detection tool 22 and the position of the calibration marks 30. In other words, the transformation between the tool 22 and the sensor 24 and the transformation between the calibration marks 30 and the sensor 24 are measured. From these transformations, a transformation between the calibration mark 30 and the tool 22 can be found. When the conveyor component18 are positioned at the first operating position, the position of the tool 22 is detected for at least one pose of the robot 12.
Then, as illustrated in fig. 2b, the conveyor member 18 (and the sensor 24 thereon) is moved in the moving direction 20 from the first operating position to the second operating position. When conveyor member 18 is positioned at the second operative position, sensor 24 is in sensor coordinate system X sen Detects a further position of the tool 22. For this detection, the robot 12 may be in the same pose as in fig. 2a, or may be in a different pose. Sensor 24 may alternatively detect the position of calibration marks 30 when conveyor member 18 is in the second operating position or any other operating position.
The direction of movement 20 may be determined as described above by data from the tool 22 collected by the sensor 24. In the transmitter coordinate system X con The position of the calibration marks 30 in (a) may be known in advance to obtain the final transformation between the tool 22 and the conveyor member 18. Alternatively, it may be detected or set during, for example, calibration.
By using the calibration method according to the second embodiment, all calibration steps can be automated and the calibration accuracy will be high without relying on manual or professional techniques. It is also easier to simply place the sensor 24 on the conveyor member 18 than to mount the sensor 24 on the tool 22 of the robot 12.
Fig. 3 schematically shows a perspective view of a further robot system 10 according to a first embodiment, and fig. 4 schematically shows a perspective view of a further robot system 10 according to a second embodiment. Referring collectively to fig. 3 and 4, the robotic system 10 includes two robots, a first robot 12 and a second robot 32.
Each of the calibration methods of the variations of the first and second embodiments in fig. 3 and 4 includes: moving conveyor member 18 from the second operative position to the third operative position; when the conveyor member is positioned at the third operative position, in the sensor coordinate system X by the sensor 24 sen Detects the position of the second robot 32; moving conveyor member 18 from the third operative position to the fourth operative position; when the conveyor member is positioned at the fourth operative position, in the sensor coordinate system X by the sensor 24 sen Detects the position of the second robot 32; and based on the in-sensor coordinate system X sen The detected position of the second robot 32 is detected, and the robot coordinate system X of the second robot 32 is determined base 、X mi 、X tool And transmitter coordinate system X con The relationship between them. Fig. 3 illustrates the conveyor member 18 in a second operating position, and fig. 4 illustrates the conveyor member 18 in a third operating position.
Thus, with the variation in fig. 3 and 4, several robots along the same conveyor member 18 can be calibrated by moving only the conveyor member 18 with the sensor 24 forward to the next robot 32 after the calibration of the previous robot 12. This calibration process is very simple and fast.
Fig. 5a and 5b schematically show perspective views of a robot system 10 according to a third embodiment. The main differences corresponding to the first and second embodiments will be described.
The sensor 24 of the third embodiment is positioned on a mount structure 34. In the example of fig. 5a, the fixture structure 34 is implemented as a shelf on the floor. As can be seen in fig. 5a, the sensor 24 is facing both the robot 12 and the conveyor member 18 so that the calibration marks 30 thereon can be seen. Accordingly, the sensor 24 is configured to detect the position of the robot 12 and to detect the position of the conveyor member 18. The fixture structure 34 may alternatively be attached to a wall or may be constructed from the fixture portion of the transmitter 14.
According to a third embodiment, the transmitter coordinate system X is used con To calibrate the robot coordinate system X base 、X mi 、X tool Will now be described. Sensor 24 is placed on the outside of conveyor member 18, facing both the upper layers of conveyor member 18 and robot 12. In FIG. 5a, conveyor member 18 is positioned atIn the first operating position. When transmitter member 18 is positioned at the first operative position, sensor 24 is in sensor coordinate system X sen The position of the detection tool 22 and the position of the calibration marks 30. In other words, the shift between the tool 22 and the sensor 24 and the shift between the calibration mark 30 and the sensor 24 are measured. From these transformations, a transformation between the calibration mark 30 and the tool 22 can be found. When the conveyor member 18 is positioned at the first operating position, the position of the tool 22 is detected for at least one pose of the robot 12.
Then, illustrated in fig. 5b, the conveyor member 18 (instead of the sensor 24) is moved in the moving direction 20 from the first operating position to the second operating position. When conveyor member 18 is positioned at the second operating position, sensor 24 is in sensor coordinate system X sen Detecting a further position of the calibration mark 30.
From the data of the calibration marks 30 collected by the sensor 24, the direction of movement 20 can be determined. The relative position in space of the calibration marks 30 is used to find the direction of movement 20. For example, the motion vector may be in the robot coordinate system X base 、X mi 、X tool Is calculated and expressed as follows. Calibration mark 30 is in sensor coordinate system X sen Is subtracted to obtain the position in the sensor coordinate system X sen The motion vector of (1). Since the robot 12 is in the (now fixed) sensor coordinate system X sen Has been measured, so the motion vector can be derived from the sensor coordinate system X sen Is transformed to the robot coordinate system X base 、X mi 、X tool . Alignment marks 30 in the conveyor coordinate system X con May be known in advance to obtain the final transformation between tool 22 and conveyor member 18. Alternatively, it may be detected or set during, for example, calibration.
By using the calibration method according to the third embodiment, all calibration steps can be automated and the calibration accuracy will be high without relying on manual or professional techniques. The third embodiment also has the advantage that the sensor 24 can be placed in any suitable location where it can "see" both the conveyor member 18 and the robot 12.
While the present disclosure has been described with reference to exemplary embodiments, it should be appreciated that the invention is not limited to what has been described above. For example, it should be appreciated that the dimensions of the parts may be varied as desired. Accordingly, the invention is intended to be limited only by the scope of the appended claims.
Claims (15)
1. A conveyor coordinate system (X) using a movable conveyor member (18) con ) To calibrate the robot coordinate system (X) of the robot (12) base 、X mi 、X tool ) The method of (1), the method comprising:
providing a sensor (24), the sensor (24) being configured to detect a position of the robot (12) in a non-contact manner;
when the conveyor member (18) is positioned at a first operating position, a sensor coordinate system (X) at the sensor (24) by the sensor (24) sen ) Detecting a position of the robot (12);
by the sensor (24) in the sensor coordinate system (X) when the conveyor member (18) is positioned at a second operative position different from the first operative position sen ) Detecting a position of the robot (12) and/or the conveyor member (18); and
based on the robot (12) in the sensor coordinate system (X) sen ) Determines the robot coordinate system (X) base 、X mi 、X tool ) And said transmitter coordinate system (X) con ) The relationship between them.
2. The method of claim 1, wherein the robot (12) includes a tool (22), and wherein the position of the robot (12) is a position of the tool (22).
3. The method according to claim 1 or 2, wherein the method further comprises: by the sensor (24) in the sensor coordinate system (X) when the conveyor member (18) is in the first operative position, and/or when the conveyor member (18) is in the second operative position sen ) Detecting the position of the robot (12) in different poses.
4. The method of claim 1 or 2, wherein the sensor (24) is positioned on the conveyor member (18), and wherein the method comprises: when the conveyor member (18) is positioned at the first operative position, and when the conveyor member (18) is positioned at the second operative position, by the sensor (24) in the sensor coordinate system (X) sen ) Detecting a position of the robot (12).
5. The method of claim 4, wherein the method further comprises:
based on the robot (12) in the sensor coordinate system (X) sen ) Is determined in the robot coordinate system (X) base 、X mi 、X tool ) A direction of movement (20) of the conveyor member (18); and
determining the robot coordinate system (X) based on the determined movement direction (20) of the conveyor member (18) base 、X mi 、X tool ) With the transmitter coordinate system (X) con ) The relationship between them.
6. The method of claim 4, wherein the robot (12) constitutes a first robot (12), and wherein the method further comprises:
moving the conveyor member (18) from the second operative position to a third operative position;
when the conveyor member (18) is positioned at the third operative position, by the sensor (24) in the sensor coordinate system (X) sen ) Detecting a position of the second robot (32);
moving the conveyor member (18) from the third operative position to a fourth operative position;
when the transmitter member (18) is positioned at the fourth operative position, passing the sensor (24) in the sensor coordinate system (X) sen ) Detecting a position of the second robot (32); and
based on the second robot (32) in the sensor coordinate system (X) sen ) Determines a robot coordinate system (X) of the second robot (32) base 、X mi 、X tool ) And said transmitter coordinate system (X) con ) The relationship between them.
7. The method of claim 4, wherein the sensor coordinate system (X) sen ) With the transmitter coordinate system (X) con ) The relationship between them is known in advance.
8. The method of claim 4, wherein the sensor (24) is further configured to detect the position of the conveyor member (18) in a non-contact manner.
9. The method of claim 8, wherein the method further comprises:
by the sensor (24) in the sensor coordinate system (X) sen ) Detecting a position of the conveyor member (18); and
based on the transmitter member (18) in the sensor coordinate system (X) sen ) Determining the sensor coordinate system (X) sen ) And said transmitter coordinate system (X) con ) The relationship between them.
10. The method of claim 1 or 2, wherein the sensor (24) is positioned on a fixture structure (34) such that the conveyor member (18) moves relative to the sensor (24), and wherein the sensor (24) is further configured to detect the position of the conveyor member (18) in a non-contact manner.
11. Method according to claim 9, wherein at least one calibration mark (30) is provided on the conveyor member (18) for detection of the position of the conveyor member (18).
12. The method of claim 10, wherein at least one calibration mark (30) is provided on the conveyor member (18) for detection of the position of the conveyor member (18), and the method further comprises:
when the conveyor member (18) is positioned at the first operative position, passing the sensor (24) in the sensor coordinate system (X) sen ) Detecting the position of the at least one calibration mark (30);
when the conveyor member (18) is positioned at the second operative position, by the sensor (24) in the sensor coordinate system (X) sen ) Detecting a position of the at least one calibration mark (30);
based on the at least one calibration mark (30) in the sensor coordinate system (X) sen ) Is determined in the robot coordinate system (X) base 、X mi 、X tool ) A direction of movement (20) of the conveyor member (18); and
determining the robot coordinate system (X) based on the determined movement direction (20) of the conveyor member (18) base 、X mi 、X tool ) And said transmitter coordinate system (X) con ) The relationship between them.
13. Method according to claim 11, wherein in the transmitter coordinate system (X) con ) The above-mentionedThe position of at least one calibration mark (30) is known in advance.
14. A robotic system (10), comprising: at least one robot (12, 32), a movable conveyor member (18) and a sensor (24), the sensor (24) being configured to detect a position of the robot (12, 32) in a non-contact manner, wherein the robotic system (10) is configured to perform the method according to any of the preceding claims.
15. A control system (16) for utilizing a conveyor coordinate system (X) of a movable conveyor member (18) in a robotic system (10) con ) To calibrate the robot coordinate system (X) of the robot (12) base 、X mi 、X tool ) The robot system includes: the robot (12), the conveyor member (18) and a sensor (24), the sensor (24) being configured to detect a position of the robot (12) in a non-contact manner, the control system (16) comprising a data processing device (26) and a memory (28) having stored thereon a computer program comprising program code, wherein the program code, when executed by the data processing device (26), causes the data processing device (26) to perform the steps of:
controlling the sensor (24) to detect a sensor coordinate system (X) at the sensor (24) when the conveyor member (18) is positioned at a first operative position sen ) The position of the robot (12);
controlling the sensor (24) to detect in the sensor coordinate system (X) when the conveyor member (18) is positioned at a second operating position different from the first operating position sen ) A position of the robot (12) and/or a position of the conveyor member (18); and
based on the robot (12) in the sensor coordinate system (X) sen ) Determining the robot coordinate system (X) from the detected at least one position base 、X mi 、X tool ) And withSaid transmitter coordinate system (X) con ) The relationship between them.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2017/062287 WO2018215047A1 (en) | 2017-05-22 | 2017-05-22 | Robot-conveyor calibration method, robot system and control system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110621447A CN110621447A (en) | 2019-12-27 |
CN110621447B true CN110621447B (en) | 2022-11-11 |
Family
ID=58794057
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201780090669.6A Active CN110621447B (en) | 2017-05-22 | 2017-05-22 | Robot conveyor calibration method, robot system and control system |
Country Status (4)
Country | Link |
---|---|
US (1) | US11511435B2 (en) |
EP (1) | EP3630417A1 (en) |
CN (1) | CN110621447B (en) |
WO (1) | WO2018215047A1 (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3717183A4 (en) * | 2017-11-27 | 2021-07-21 | ABB Schweiz AG | Apparatus and method for use with robot |
JP6659744B2 (en) * | 2018-01-25 | 2020-03-04 | ファナック株式会社 | Robot system |
EP3946825A1 (en) * | 2019-03-25 | 2022-02-09 | ABB Schweiz AG | Method and control arrangement for determining a relation between a robot coordinate system and a movable apparatus coordinate system |
JP7127592B2 (en) * | 2019-03-27 | 2022-08-30 | オムロン株式会社 | Notification system |
JP7336711B2 (en) * | 2019-06-14 | 2023-09-01 | パナソニックIpマネジメント株式会社 | repair welding system |
CN111775154B (en) * | 2020-07-20 | 2021-09-03 | 广东拓斯达科技股份有限公司 | Robot vision system |
EP4322881A1 (en) * | 2021-04-13 | 2024-02-21 | Abb Schweiz Ag | Method and apparatus for robot system management |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3834088B2 (en) | 1995-11-10 | 2006-10-18 | ファナック株式会社 | A vision sensor robot system for tracking multiple robots |
WO2000045229A1 (en) * | 1999-01-29 | 2000-08-03 | Georgia Tech Research Corporation | Uncalibrated dynamic mechanical system controller |
JP2002192486A (en) * | 2000-12-25 | 2002-07-10 | Seiko Epson Corp | Robot control method and robot controller applying the method |
JP4174342B2 (en) * | 2003-02-19 | 2008-10-29 | ファナック株式会社 | Work transfer device |
DE10351669B4 (en) | 2003-11-05 | 2012-09-13 | Kuka Laboratories Gmbh | Method and device for controlling a handling device relative to an object |
JP2005262369A (en) * | 2004-03-18 | 2005-09-29 | Yaskawa Electric Corp | Robot system |
WO2010060459A1 (en) * | 2008-11-25 | 2010-06-03 | Abb Technology Ab | A method and an apparatus for calibration of an industrial robot system |
JP2012187651A (en) | 2011-03-09 | 2012-10-04 | Omron Corp | Image processing apparatus, image processing system, and guidance apparatus therefor |
JP5810562B2 (en) * | 2011-03-15 | 2015-11-11 | オムロン株式会社 | User support device directed to image processing system, program thereof, and image processing device |
US8930009B2 (en) | 2011-10-20 | 2015-01-06 | Kabushiki Kaisha Yaskawa Denki | Robot system and processed object manufacturing method |
JP5949242B2 (en) * | 2012-07-11 | 2016-07-06 | セイコーエプソン株式会社 | Robot system, robot, robot control apparatus, robot control method, and robot control program |
DE102013014467A1 (en) * | 2013-08-30 | 2015-03-05 | Dürr Ecoclean GmbH | "Method for measuring and / or calibrating a robot" |
US9782896B2 (en) * | 2013-11-28 | 2017-10-10 | Mitsubishi Electric Corporation | Robot system and control method for robot system |
CN104827480A (en) * | 2014-02-11 | 2015-08-12 | 泰科电子(上海)有限公司 | Automatic calibration method of robot system |
JP5887383B2 (en) * | 2014-07-04 | 2016-03-16 | ファナック株式会社 | Article alignment apparatus for aligning articles on a conveyor |
JP6415190B2 (en) * | 2014-09-03 | 2018-10-31 | キヤノン株式会社 | ROBOT DEVICE, ROBOT CONTROL PROGRAM, RECORDING MEDIUM, AND ROBOT DEVICE CONTROL METHOD |
JP5893695B1 (en) | 2014-09-10 | 2016-03-23 | ファナック株式会社 | Article transport system |
US10525597B2 (en) * | 2014-11-21 | 2020-01-07 | Seiko Epson Corporation | Robot and robot system |
DE102015104582A1 (en) * | 2015-03-26 | 2016-09-29 | Pi4_Robotics Gmbh | Method for calibrating a robot at a work area and system for carrying out the method |
US10335951B2 (en) * | 2015-07-29 | 2019-07-02 | Canon Kabushiki Kaisha | Information processing apparatus, information processing method, robot control apparatus, and robot system |
JP6407826B2 (en) | 2015-09-03 | 2018-10-17 | ファナック株式会社 | Coordinate system setting method, coordinate system setting device, and robot system provided with coordinate system setting device |
DE102015014485A1 (en) * | 2015-11-10 | 2017-05-24 | Kuka Roboter Gmbh | Calibrating a system with a conveyor and at least one robot |
JP6551184B2 (en) * | 2015-11-18 | 2019-07-31 | オムロン株式会社 | Simulation apparatus, simulation method, and simulation program |
CN107214692B (en) * | 2016-03-22 | 2020-04-03 | 泰科电子(上海)有限公司 | Automatic calibration method of robot system |
JP6898374B2 (en) * | 2019-03-25 | 2021-07-07 | ファナック株式会社 | Motion adjustment device for adjusting the operation of the robot device and motion adjustment method for adjusting the motion of the robot device |
JP7396819B2 (en) * | 2019-06-21 | 2023-12-12 | ファナック株式会社 | A monitoring device equipped with a camera that captures video images of robot equipment operations. |
-
2017
- 2017-05-22 US US16/612,955 patent/US11511435B2/en active Active
- 2017-05-22 CN CN201780090669.6A patent/CN110621447B/en active Active
- 2017-05-22 WO PCT/EP2017/062287 patent/WO2018215047A1/en active Application Filing
- 2017-05-22 EP EP17726240.9A patent/EP3630417A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
WO2018215047A1 (en) | 2018-11-29 |
EP3630417A1 (en) | 2020-04-08 |
US20200164518A1 (en) | 2020-05-28 |
US11511435B2 (en) | 2022-11-29 |
CN110621447A (en) | 2019-12-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110621447B (en) | Robot conveyor calibration method, robot system and control system | |
CN111452040B (en) | System and method for associating machine vision coordinate space in a pilot assembly environment | |
JP5371927B2 (en) | Coordinate system calibration method and robot system | |
US20200298411A1 (en) | Method for the orientation of an industrial robot, and industrial robot | |
JP6855492B2 (en) | Robot system, robot system control device, and robot system control method | |
EP2636493A2 (en) | Information processing apparatus and information processing method | |
US20160279800A1 (en) | Robot, robot control device, and robotic system | |
CN110740841B (en) | Operating system | |
JP2005342832A (en) | Robot system | |
EP2271465A1 (en) | Robot parts assembly on a workpiece moving on an assembly line | |
US20180354137A1 (en) | Robot System Calibration | |
JP2013063474A (en) | Robot system and imaging method | |
CN107186714B (en) | A kind of accurate positioning method, positioning system and robot device | |
CN111278608B (en) | Calibration article for 3D vision robot system | |
KR101842286B1 (en) | Method for Automatic Calibration of Robot | |
KR20110095700A (en) | Industrial robot control method for workpiece object pickup | |
CN109983299A (en) | The measuring system and method for industrial robot | |
WO2022075303A1 (en) | Robot system | |
CN117794704A (en) | Robot control device, robot control system, and robot control method | |
US20220388179A1 (en) | Robot system | |
JP5516974B2 (en) | Vision sensor mounting apparatus and method | |
EP3360652B1 (en) | Detection of engagement of robot with object | |
KR102362476B1 (en) | 3d rotary gantry precision positioning system and method therefor | |
CN110962121B (en) | Movement device for loading 3D detection unit and material grabbing method thereof | |
CN117769483A (en) | Robot control device, robot control system, and robot control method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |