EP2659316B1 - Methods, systems, and apparatus for calibration of an orientation between an end effector and an article - Google Patents
Methods, systems, and apparatus for calibration of an orientation between an end effector and an article Download PDFInfo
- Publication number
- EP2659316B1 EP2659316B1 EP12760915.4A EP12760915A EP2659316B1 EP 2659316 B1 EP2659316 B1 EP 2659316B1 EP 12760915 A EP12760915 A EP 12760915A EP 2659316 B1 EP2659316 B1 EP 2659316B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- light beam
- end effector
- geometrical
- feature
- teach tool
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000012636 effector Substances 0.000 title claims description 150
- 238000000034 method Methods 0.000 title claims description 52
- 238000012545 processing Methods 0.000 description 18
- 238000012360 testing method Methods 0.000 description 17
- 230000033001 locomotion Effects 0.000 description 10
- 238000005259 measurement Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 239000013060 biological fluid Substances 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 210000001124 body fluid Anatomy 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010339 medical test Methods 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1679—Programme controls characterised by the tasks executed
- B25J9/1692—Calibration of manipulator
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/39—Robotics, robotics to robotics hand
- G05B2219/39021—With probe, touch reference positions
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/39—Robotics, robotics to robotics hand
- G05B2219/39024—Calibration of manipulator
Definitions
- the present invention relates generally to methods, systems, and apparatus adapted to calibrate a positional orientation of a robotic component.
- sample containers such as test tubes, sample cups, vials, and the like
- sample racks sometimes referred to as "cassettes”
- WO 2009/086164 A2 provides for example a method for calibrating alignment of an end effector with respect to a chuck in a plasma processing system.
- Such transportation may be accomplished by the use of an automated mechanism, which may include a suitable robotic component (e.g., a moveable robot arm or gantry arrangement) having a moveable end effector that may have gripper fingers coupled thereto.
- the end effector may be moved in two or more coordinate directions (e.g., X, R, and Z).
- a sample container containing a specimen to be tested or processed
- the sample container may be moved to and from a receptacle of a sample rack.
- EP 0045174 A1 discloses a gripping device on an industrial robot with a plurality of light-emitting members for generating a plurality of light beams, and a plurality of light-receiving elements for receiving the light beams. From US 2009/0302795 A1 an automated robot teach tool is known that enables a robot to automatically program all of the pick and place positions associated with a robotic workcell without robot operator intervention.
- Inaccurate calibration may result in inaccurate positioning of the end effector and may cause collisions or jams between the end effector and the sample container, and/or between the sample container being moved and the testing or processing system or sample rack. Additionally, inaccurate calibration may contribute to jarring pick and place operations of the sample container, which may contribute to unwanted spillage of specimen from the sample container. Furthermore, knowing a precise rotational orientation of the end effector fingers may allow for the manufacture of smaller sample racks, in that the fingers may be placed in a defined orientation when grasping the sample container, thereby allowing the distance between respective sample containers in the sample rack in other directions to be minimized.
- an improved method of calibrating a position of an article relative to an end effector of a robot includes providing a robotic component having the end effector with end effector fingers adapted for grasping a teach tool and a light beam sensor provided in a fixed orientation to the end effector fingers; providing a teach tool at an approximately known location on the article within a work envelope reachable by the end effector, the teach tool having a geometrical calibration feature; positioning the end effector with the light beam sensor at a first location proximate to the geometrical calibration feature, the geometrical calibration feature 112 adapted for use to determine a positional calibration; positioning the end effector and sensing with the light beam sensor a first engagement edge of the geometrical calibration feature of the teach tool; and positioning the end effector and sensing with the light beam sensor a second engagement edge of the geometrical calibration feature of the teach tool; using the sensing of the first engagement edge 134 and the second engagement edge 136 to calibrate a position of the article 105 relative to the end effector 105
- an improved robot calibration system includes a robotic component having an end effector with end effector fingers adapted for grasping a teach tool 102; a light beam sensor provided in a fixed orientation to the end effector fingers; a teach tool coupled to an article at a first location, the teach tool including a geometrical calibration feature; and a controller adapted to position a light beam of the light beam sensor around the geometrical calibration feature of the teach tool and calculate a position thereof based upon edge interferences between the geometrical calibration feature and the light beam characterized in that the teach tool 102 includes a vertical geometrical feature 112A and the controller 110 is adapted to move the light beam 108C emitted from the light beam sensor 108 vertically relative to the vertical geometrical feature 112A to determine a height dimension of the vertical geometrical feature 112A upon contact of the light beam 108C with the vertical geometrical feature 112A.
- a calibration assisting tool in an apparatus aspect, includes a base adapted to couple to an article; a first geometrical calibration feature extending from the base, the geometrical calibration feature including a cylindrical post extending from the base; a second geometrical calibration feature including a flat surface; and a third geometrical feature extending crosswise through the base or cylindrical post.
- a method of calibrating a rotational position of fingers of an end effector includes providing a robotic component having the end effector and a light beam sensor provided in a fixed orientation to the end effector fingers; providing a teach tool within a work envelope reachable by the end effector, the teach tool having a rotational geometrical calibration feature; grasping the teach tool with the fingers of the end effector and rotating the teach tool relative to a scanner; scanning the teach tool during the rotation to determine a rotational orientation of the teach tool; positioning the teach tool with the end effector in a known rotational orientation and releasing the end effector fingers from the teach tool; positioning the end effector with the light beam sensor proximate to the rotational geometrical calibration feature; and rotating the end effector and the light beam of the light beam sensor to determine the rotational orientation of the fingers relative to the rotational geometrical calibration feature.
- End effector is any member coupled to a robot that is used in robotic operations to grasp and/or move a device (e.g., a sample container) from one location to another, such as in a pick and place operation.
- a device e.g., a sample container
- positional precision to several thousands of an inch or less may be desirable.
- tolerance stack-ups due to manufacturing variances and assembly variances of the multitude of connected system components may amount to many thousandths, or many hundredths, or even many tenths of an inch.
- means for appropriately determining an actual position of a robotic end effector relative to an article e.g., in X and R; X, R, and Z; X, R, and T, or X, R, Z, and T
- an article e.g., in X and R; X, R, and Z; X, R, and T, or X, R, Z, and T
- the present invention provides calibration methods, calibration systems, and calibration assisting tools for readily determining an actual position of an article relative to an end effector in a robotic system.
- a method of calibrating a position of an article relative to an end effector of a robot includes providing a robot with an attached end effector and end effector fingers and a light beam sensor provided in a fixed orientation thereto, and a teach tool on the article.
- the light beam sensor may be fixed (immoveable) vertically, and horizontally (in X-R coordinates) relative to the end effector, and fixed relative to the fingers such that a light beam always remains in a fixed orientation relative to the fingers, i.e., the light beam rotates with the fingers.
- the teach tool has a geometrical calibration feature (e.g., a cylindrical post) thereon.
- the light beam sensor is positioned proximate to the geometrical calibration feature and rotated to sense with the light beam several engagement edges of the geometrical calibration feature.
- a location of the geometrical calibration feature is calculated based upon the sensed location of several engagement edges.
- another feature of the teach tool may be measured (e.g., a vertical geometrical calibration feature) such that orientation in another degree of freedom (e.g., the Z direction) may be determined.
- an orientation of a rotational geometrical calibration feature e.g., a hole through the teach tool
- the teach tool may be determined by orienting and rotating the fingers and light beam sensor relative to the rotational geometrical calibration feature. This may determine an orientation of the end effector fingers in a T direction (e.g., rotation).
- a robot calibration system in another aspect, includes a robotic component having a moveable end effector with end effector fingers, and a light beam sensor provided on the end effector.
- the system also includes a teach tool coupled to an article at a first location whose orientation is to be determined, wherein the teach tool has a geometrical calibration feature thereon.
- the system includes a controller adapted to rotate a light beam of the light beam sensor around the geometrical calibration feature of the teach tool and thereafter calculate a position (e.g., center in X-R coordinates) of the geometrical calibration feature that is based upon edge interferences between the geometrical calibration feature and the light beam.
- the controller 110 is adapted to move the light beam 108C emitted from the light beam sensor 108 vertically relative to the vertical geometrical feature 112A to determine a height dimension of the vertical geometrical feature 112A upon contact of the light beam 108C with the vertical geometrical feature 112A.
- a calibration assisting tool in another aspect, includes a base adapted to couple to an article, a first geometrical calibration feature extending from the base, the geometrical calibration feature including a cylindrical post extending from the base; a second geometrical calibration feature including a flat surface; and a third geometrical feature extending crosswise through the base or cylindrical post.
- a method of calibrating a rotational orientation of end effector fingers of an end effector involves scanning the teach tool to determine an orientation of a rotational geometrical calibration feature thereon, placing the tool in a known orientation (e.g., in a receptacle of a sample rack), and then rotating the end effector fingers about the teach tool to determine the rotational orientation of the fingers to the rotational geometrical calibration feature of known orientation.
- a known orientation e.g., in a receptacle of a sample rack
- a robot calibration system 100 is described.
- the robot calibration system 100 is useful for aiding in the calibration of any robotic system, such as those used in automated clinical analyzers, centrifuges, or other processing or testing systems (e.g., biological fluid specimen processing or testing systems).
- the calibration system 100 is useful for precisely calibrating the location of a receptacle 106 of a sample rack 105 adapted to receive one or more sample containers containing biological fluid (e.g., blood collection tubes, etc.).
- the robot calibration system 100 includes a robotic apparatus 101 and a teach tool 102.
- the robotic apparatus 101 includes a robotic component 103 having an end effector 104 being coupled thereto.
- the end effector 104 may have two or more moveable jaws or fingers 104A, 104B that are adapted to grasp components, such as sample containers (e.g., sample tubes) and/or sample racks 105 that are adapted to receive sample containers in one or more receptacles 106 thereof.
- a partial cross sectional view of the sample rack 105 is shown in FIG. 1A . Only one receptacle 106 is shown. However, it should be recognized that the sample rack 105 may include one or more than one receptacle (see FIG. 1G ) and thus may receive a number of sample containers therein.
- the location of the sample rack 105 on a component of the testing or processing system may be only "generally known” in three-dimensional space.
- the location of the sample rack 105 on a system component such as on a tray or portion of a frame 107 of the system may only be “generally known.”
- the sample rack 105 may include one or more geometrical features that aid in generally locating the sample rack 105 on the tray or frame 107, such as locator pins or features, tabs, locking mechanisms, or other orienting features (not shown).
- the location of the sample rack 105 may only be “generally known” because of the tolerance stack-ups in manufacturing of the system, and that a precise location of one or more of the receptacles 106 is desired to be “precisely known” for the reasons listed above. Accordingly, the present invention (method and system) has great utility in enabling a location of one or more receptacles 106 of the sample rack 105 to be “precisely known,” that is known with a relative high degree of certainty or precision.
- the robotic apparatus 101 includes a light beam sensor 108 that enables the robotic apparatus 101 to gauge whether the gripper fingers 104A, 104B have an item in their vicinity to grasp.
- the light beam sensor 108 may include fiber optic components, such as a light source 108A, an optical fiber 108B adapted to carry and direct a light beam 108C, and a light detector 108D adapted to receive and detect a presence of a light beam 108C thereat.
- the light beam sensor 108 functions to send a light beam 108C from the optical fiber 108B to the detector 108D.
- the light beam sensor 108 may be coupled directly to a portion of the end effector 104 or to a portion of the robotic component (e.g., to a robot arm, boom, or beam), but the location between the centerline axis 104C of the end effector 104 and the light beam sensor 108 is fixed and known.
- the light beam 108C is oriented so that the light beam 108C passes through the centerline axis 104C of the end effector 104 (i.e., through the T axis of rotation).
- the light beam 108C may be oriented generally horizontally.
- the light beam 108C may be made as small as practical.
- the Z dimension between the lower terminal ends of the gripper fingers 104A, 104B or gripping members of the end effector 104 and the light beam 108C is also fixed and known. Rotation of the fingers 104A, 104B of the end effector 104 relative to the robotic component 103 causes the light beam 108C to also rotate with the fingers 104A, 104B in a fixed relationship thereto.
- the robotic apparatus 101 may include a suitable controller 110 that may command the robotic component 103 and attached end effector 104 and move the end effector 104 and light beam sensor 108 in one or more coordinate directions, two or more coordinate directions (e.g., X and R), three or more coordinate directions (e.g., X, R, and Z or X, R, and T), or even four directions (e.g., X, R, Z, and T), where X is into and out of the paper in FIG. 1A , R is laterally on the paper, Z is vertically on the paper, and T is a rotation about the axis 104C of the end effector 104.
- a suitable controller 110 may command the robotic component 103 and attached end effector 104 and move the end effector 104 and light beam sensor 108 in one or more coordinate directions, two or more coordinate directions (e.g., X and R), three or more coordinate directions (e.g., X, R, and Z or X, R, and T), or even four directions
- the controller 110 may be any suitable controller adapted to interact with the robotic component 103, and may include a suitable microprocessor, memory, conditioning electronics, and circuitry adapted to carry out the motions, measurements, and calculations associated with the calibration and motion of the robotic component 103 and end effector 104.
- Any suitable robotic component 103 may be used, such as a moveable multi-arm robot (e.g., having included one or more shoulder, elbow, or wrist elements), a telescopic boom robot, or a beam or beams having one or more motors coupled thereto. Any suitable mechanism for imparting motion to the end effector 104 may be used. In one implementation, the robotic component 103 may be used to accomplish three-dimensional coordinate motion (X, R, and Z) of the end effector 104 so that sample containers may be placed in a receptacle 106 of a sample rack 105.
- X, R, and Z three-dimensional coordinate motion
- the robotic component 103 may accomplish a rotation (T) of the end effector 104, which is rotation about the axis 104C, so that the fingers 104A, 104B may be precisely oriented relative to a sample container (not shown) in a sample rack 105, or relative to the sample rack 105 when a sample container is being inserted in the sample rack 105.
- T rotation of the end effector 104
- the robotic component 103 may include a moveable assembly including an R axis motor adapted to impart R axis motion to the end effector 104 relative to a frame of the testing or processing system, an X axis motor adapted to cause X axis motion of the end effector 104 relative to the frame, a Z axis motor adapted to cause Z axis motion of the end effector 104 relative to the frame, and a T axis motor adapted to cause rotation of the end effector fingers 104A, 104B relative to the frame in the T direction (about the axis 104C).
- Suitable feedback mechanisms may be provided for each degree of motion, such as position and/or rotation sensors.
- the robotic component 103 may include suitable tracks or guides and suitable motors, such as one or more stepper motors, servo motors, pneumatic or hydraulic motors, electric motors, or combinations thereof. Furthermore, drive systems including chains, guides, pulleys and belt arrangements, gear or worm drives or other conventional drive components may be utilized to cause the various motion of the end effector 104. Other types of robotic components 103 may be employed.
- the opposed gripper fingers 104A, 104B may be driven to open and close along any suitable direction in the X-R plane (e.g., in the X or R direction or combinations thereof) by a suitable end effector finger drive apparatus, such as a pneumatic or hydraulic servo motor or the like. Any suitable mechanism for causing gripping action of the fingers 104A, 104B may be used.
- a suitable end effector finger drive apparatus such as a pneumatic or hydraulic servo motor or the like.
- Any suitable mechanism for causing gripping action of the fingers 104A, 104B may be used.
- the present invention is equally applicable to end effectors having more than two fingers or grippers, albeit in such a case, the light beam sensor 108 may be positioned other than on the fingers, but rotatable therewith and provided in a fixed Z orientation to the end effector 104.
- the robot calibration system 100 includes one or more teach tools 102.
- the one or more teach tools 102 may be mounted to the article (e.g., sample rack 105) for which the precise positional calibration is to be determined.
- one or more teach tools 102 may be mounted in one or more receptacles 106 of the sample rack 105.
- the sample rack 105 and teach tool 102 may be placed in a testing or processing system at any location within the reach of the robotic component 103.
- the sample rack 105 may be placed and locked in a generally-known position in the testing or processing system within the reach of the robotic component 103.
- one or more teach tools 102 may be used to assist in a determination (calibration) of a position of one or more receptacles 106 in a multi-sample sample rack 105.
- a fifty position sample rack 105 is shown.
- the present invention is applicable to calibration of the location of receptacles 106 in any sized sample rack.
- the calibration may take place at one or more locations in the sample rack 105.
- teach tools 102 may be provided at opposite diagonal corners of the sample rack 105, as shown. Optionally, other locations may be used.
- the teach tool 102 may have a rounded bottom 102A having a radius and diameter such that it resembles the geometry of a sample container (e.g., sample tube).
- the teach tool 102 may be manually inserted in the receptacle 106.
- the teach tool 102 may be picked up from a designated and known home location in the testing or processing system, and delivered to a receptacle 106 by the robotic component 103.
- teach tool 102 includes a geometrical calibration feature 112.
- the geometrical calibration feature 112 may be a generally cylindrical post extending upwardly from a base 114 of the teach tool 102.
- the teach tool 102 may be received securely in the receptacle 106 of the sample rack 105 by any suitable means, such as first and second leaf springs 116F, 116S ( FIG. 1A ).
- the teach tool 102 may register (e.g., contact) at the bottom of the receptacle 106 in the same manner as does a sample tube.
- the geometrical calibration feature 112 may be oriented in a geometrical center of the receptacle 106 and may be used to determine a center location of the receptacle in the X-R plane.
- the teach tool 102 may further include a vertical geometrical calibration feature 112A, which may comprise a planar upper surface that is generally perpendicular to a tool axis 120 extending through the center of the geometrical calibration feature 112, i.e., through the center of the cylindrical post.
- the vertical geometrical calibration feature 112A is used to determine and calibrate a vertical orientation of the bottom registry point 122 (e.g., the point contacted by a sample tube) of the rack 105 in the Z direction.
- the vertical length of the teach tool 102 and the diameter of the geometrical calibration feature 112, i.e., the cylindrical post, are precisely known.
- the vertical length from end to end of the teach tool 102 may be about 100 mm, for example.
- the diameter of the cylindrical post may be about 2.54 mm, for example.
- the length of the cylindrical post may be about 20 mm, for example.
- the diameter of the base 114 may be about 16 mm, for example. Other dimension may be used.
- the teach tool 102 may include a rotational geometrical calibration feature 124 that is used to determine and calibrate a rotational orientation of the end effector fingers 104A, 104B. Knowing the rotational orientation of the fingers 104A, 104B allows the rack 105 to be made smaller in at least one direction, because the clearance needed for the fingers 104A, 104B may be eliminated in that direction.
- the rotational geometrical calibration feature 124 may comprise a through hole formed through the teach tool 102.
- the through hole may be formed crosswise through the body or optionally through the post as is shown in FIG. 1I .
- the through hole may include a center axis that intersects the axis of the geometrical calibration feature 112.
- the hole is preferably of constant diameter along its length and may have a diameter of about 2.54 mm, for example. Other diameters may be used.
- the teach tool 102 may include a hoop groove 126 that may encircle the perimeter of the base 114. Furthermore, the teach tool 102 may include a start groove 128 that extends along a direction parallel to the tool axis 120, i.e., in a vertical orientation. Furthermore, a bar code label 130 may be positioned and affixed on the surface of the teach tool 102, such as on the base 114 thereof. The bar code label 130 may be affixed to the base 114 in a known orientation, such as shown. In particular, the location of the start groove 128 may be generally aligned with the axis 120 and also with the axis of the rotational geometrical calibration feature 124.
- the bar code 130 may include a detectable feature such as a detectable edge 130A placed so as to abut an edge of the start groove 128.
- the detectable edge 130A may be detectable by a bar code reader 132 ( FIG. 1H ), as will be explained below.
- the detectable edge 130A may be formed by the right end of each of the bars of the bar code label 130 or another detectable feature of the bar code label 130. This detectable edge 130A is provided in a generally known orientation to the start groove 128 and to the rotational geometrical calibration feature 124.
- a robotic component 103 is provided having an end effector 104 with end effector fingers 104A, 104B and a light beam sensor 108 provided in a fixed orientation to the end effector fingers 104A, 104B.
- a teach tool 102 is provided at an approximately known location on an article within a work envelope reachable by the end effector 104 wherein the teach tool 102 has a geometrical calibration feature 112 thereon.
- the article may be any component for which it is desired to obtain precise positional information in X, R, Z, T, or any combination thereof.
- the article is a sample rack 105 and the teach tool 102 is situated on (bottomed in) the sample rack 105, such as in a receptacle 106 thereof.
- the end effector 104 with the light beam sensor 108 is positioned at a first location proximate to the geometrical calibration feature 112 (e.g., adjacent to and vertically posited roughly midway along the cylindrical post).
- the light beam 108C is provided at a position offset from the geometrical calibration feature 112 where the beam 108C will make contact with the geometrical calibration feature 112 upon rotation of the end effector 104.
- the beam 108C may be located at about 6 mm to about 10 mm away from the geometrical calibration feature 112.
- the end effector 104 is rotated from its initial position in FIG. 1C to a first rotational position as is shown in FIG. 1D .
- the light beam sensor 108 senses a first engagement edge 134 of the geometrical calibration feature 112 of the teach tool 102. The sensing occurs when the light beam 108C is first broken by the interference of the geometrical calibration feature 112 with the light beam 108C at the first engagement edge 134. As the light beam 108C is broken as shown in FIG.
- the detector 108D no longer provides a signal to the controller 110, and a first rotational orientation of the end effector 104 is recorded in memory of the controller 110.
- the rotational orientation of the end effector 104 may be provided by any suitable rotational sensor or feedback device coupled to the end effector 104 that provides a reading of the rotational position of the end effector fingers 104A, 104B about the axis 104C.
- step 210 the end effector 104 is again rotated, and a second engagement edge 136 of the geometrical calibration feature 112 of the teach tool 102 is sensed with the light beam sensor 108.
- the light beam 108C may be rotated continuously from the contact with the first engagement edge 134 to the second engagement edge 136 in a clockwise direction, for example.
- the second rotational position is recorded in memory.
- the rotation be in one direction (e.g., clockwise or counterclockwise) wherein during the rotational motion both edges 134, 136 are sensed, in some embodiments, the edges 134, 136 may be approached from alternate rotational directions.
- a length (distance) to the geometrical calibration feature 112 of the teach tool 102 based upon a location of the first and second engagement edges 134, 136 is calculated in step 212 by the controller 110. From this, the distance between the location of the center of the geometrical calibration feature 112 in the X-R plane and the center of the end effector 104 is determined. By moving the end effector 104 in the R and X directions and then repeating the edge finding routine, the exact location of the article (e.g., the receptacle 106 of the sample rack 105) may be precisely determined.
- the procedure above may be repeated by positioning the end effector 104 at a third location offset from the geometrical calibration feature 112 in the X-R plane and repeating the steps above, but relative to additional engagement edges of the geometrical calibration feature 112.
- the exact location of the center of the geometrical calibration feature 112 in X-R coordinates may be more precisely determined by repeating the above method.
- the end effector 104 may be moved in the X and R directions by known amounts, and then the edge finding method described above for determining the center of the geometrical calibration feature 112 is repeated.
- a precise determination of the center is obtained by moving the end effector 104 with the light beam sensor 108 to a second location proximate to the geometrical calibration feature 112 of the teach tool 102.
- the second location is different than the first location.
- the geometrical calibration feature comprises a cylinder oriented with a cylindrical axis being vertical and located at an approximately known location on the article 105.
- the end effector 104 rotates about the axis 104C so that the fingers 104A, 104B are precisely oriented relative to a sample container in a sample rack 105.
- the end effector 104 is again rotated and a third engagement edge of the geometrical calibration feature 112 is sensed with the light beam sensor 108 via breaking the light beam 108C.
- the rotation of the end effector 104 then may continue in the same direction and a fourth engagement edge of the geometrical calibration feature 112 is sensed when the light beam 108C is again detected by detector 108D of the light beam sensor 108.
- an exact location of the center of the geometrical calibration feature 112 of the teach tool 102 relative to the centerline axis 104C of the end effector 104 in the X-R plane may be determined geometrically using the cosine rule of Equations 3, 4, and 5 below and referring to FIGs. 1N-1P .
- an additional calibration routine may be executed to determine a vertical location of a vertical geometrical calibration feature 112A of the teach tool 102, as best shown in FIG. 1F .
- the vertical calibration routine may follow immediately after the center finding routine previously described.
- the teach tool 102 is already seated in the sample rack 105 such that the teach tool 102 contacts a known registry point 122 in the bottom of the sample rack 105.
- the end effector 104 and the light beam 108C of the light beam sensor 108 are first positioned at a known position above the vertical geometrical calibration feature 112A.
- the vertical geometrical calibration feature 112A is a flat surface on the top of a cylindrical post extending from the base 114.
- the end effector 104 and light beam 108C are then lowered in the -Z direction until the light beam 108C is broken, as shown in FIG. 1F .
- the vertical (Z) position is recorded. Accordingly, the orientation of the sample rack 105 to the end effector 104 and fingers 104A, 104B thereof is now known in the Z direction.
- the bottom registry point 122 in the Z direction is known because the length of the teach tool is precisely known.
- the end effector 104 may precisely pick and place sample containers (not shown) from the sample rack 105 as part of the sample testing and processing in the system.
- a calibration method adapted to determine a rotational orientation of the end effector fingers 104A, 104B relative to the teach tool 102 and the article (e.g., sample rack 105) is provided.
- This calibration may be accomplished in addition to the center-finding calibration method and/or the vertical calibration method where it is desired to know the rotational orientation of the end effector fingers 104A, 104B relative to an article.
- the teach tool 102 may be engaged (e.g., gripped) by the end effector 104 (e.g., by gripper fingers 104A, 104B) as shown in FIG. 1H .
- the teach tool 102 may be grasped by the geometrical calibration feature 112 comprising a cylindrical post by the fingers 104A, 104B oriented in any random rotational orientation.
- the teach tool 102 including the bar code 130 that has been placed in a predefined location on the teach tool 102, may be rotated relative to a bar code reader 132.
- the bar code reader 132 may be placed in the testing or processing system at any defined location. In general, the system may already include the bar code reader 132 to be able to read bar code labels 130 on sample containers being processed by the system.
- the teach tool 102 is rotated until a known feature of the tool is recognized by the bar code reader 132 (e.g., a detectable edge location 130A on the bar code 130). Other features may be used.
- the rotational orientation of the feature 130A is recorded in memory.
- the location of the rotational geometrical calibration feature 124 is now generally known (albeit without a great amount of precision) because the orientation of the rotational geometrical calibration feature 124 is generally known relative to the bar code 130.
- the bar code edge 130A may be aligned vertically with a center of the rotational geometrical calibration feature 124. It should be recognized that the location of the fingers 104A, 104B of the end effector 104 relative to the rotational geometrical calibration feature 124 is not yet known.
- the teach tool 102 is again placed (bottomed) in the sample rack 105 as shown in FIG. 1J .
- the end effector fingers 104A, 104B are retracted to a position larger than the diameter of the portion of the teach tool 102 including the rotational geometrical calibration feature 124 and lowered to a height of a center of the rotational geometrical calibration feature 124, as shown in FIG. 1K .
- the end effector 104 is then rotated about axis 104C in either a clockwise or counterclockwise direction.
- the light beam 108C first emerges through the rotational geometrical calibration feature 124 and is sensed by the light detector 108D such as shown in FIG. 1L , the first rotational position thereof is recorded.
- the rough orientation of the fingers 104A, 104B to the rotational geometrical calibration feature 124 is known.
- the rough orientation of the fingers 104A, 104B to the frame of the system is known, having oriented the bar code detectable edge feature 130A in a previous step.
- the end effector 104 may be further rotated until the light beam 108C is no longer detected by the light detector 108D, as shown in FIG. 1M , and this second rotational angle may be recorded. The average of the two angular readings may then be used to determine the exact center of the rotational geometrical calibration feature 124. Thus, based on this, a precise orientation of the fingers 104A, 104B to the sample rack 105, as well as the frame 107 of the system 100, is known.
- the routine may be executed first with a faster rotation for rough orientation determination, followed by a slower rotation (e.g., step by step) to precisely determine the center location of the geometrical calibration feature 112 and/or the angular orientation of the of the rotational geometrical calibration feature 124.
- the light beam 108C when first oriented at the rotational geometrical calibration feature 124, will by mere chance be oriented along the rotational geometrical calibration feature 124.
- the end effector 104 will be rotated through a predetermined angle (e.g., 90 degrees) such that the rotational orientation measurement sequence will start with the light beam 108C not passing through the rotational geometrical calibration feature 124, and then carried out as discussed above.
- the above calibration methods may be carried out in any order, but will be best implemented by first calibrating the center of the geometrical calibration feature 112, then calibrating the Z axis height of the vertical calibration feature 112A, followed by calibration of the rotational orientation of the fingers 104A, 104B to a center of the rotational geometrical calibration feature 124.
- the calibration method is carried out to determine the orientation of the end effector 104 in the X-R plane, and Z, and T directions.
- the calibration method is carried out relative to the teach tool 102 including the geometrical calibration feature 112, the vertical calibration feature 112A, and the rotational geometrical calibration feature 124.
- One method of calibrating a position of an article relative to an end effector of a robot may be carried out as follows.
- a robotic component 103 is provided in 202 having the end effector 104 and a light beam sensor 108 provided in a fixed orientation to the end effector 104.
- a teach tool 102 is provided in 204 at an approximately known location on the article (e.g., a sample rack 105) within a work envelope reachable by the end effector 104.
- the teach tool 102 has a geometrical calibration feature 112, such as a cylindrical post.
- the end effector 104 with the light beam sensor 108 is positioned in 206 at a first location proximate to the geometrical calibration feature 112.
- the end effector 104 is rotated in 208 and a first engagement edge 134 of the geometrical calibration feature 112 of the teach tool 102 is sensed with the light beam sensor 108 (e.g., by breaking the beam 108C).
- the end effector 104 is again rotated in 210 and a second engagement edge 136 of the geometrical calibration feature 112 of the teach tool 102 is sensed with the light beam sensor 108.
- the calculation of a location (e.g., the center) of the geometrical calibration feature 112 of the teach tool 102 based upon a location of the first and second engagement edges 134, 136 may be carried out in 212, as discussed above.
- the exact positional center location of the geometrical calibration feature 112 in X-R space may be found.
- the vertical orientation of the end effector 104 to the article e.g., a receptacle 106 of the sample rack 105) may be determined by calibrating the vertical geometrical feature 112A as described above.
- the rotational calibration method may be used. Accordingly, the X, R, Z location of the article (e.g., a receptacle 106 of the sample rack 105) may be determined.
- the rotational orientation of the fingers 104A, 104B of the end effector 104 may be determined relative to the article and/or frame of the processing or testing system.
- one or more additional teach tools 102 may be used (or moved to other locations) on other system component(s) within the reach of the end effector 104.
- positions of other features of an article may be calibrated.
- the teach tool 102 may be arranged at more than one location of the article (e.g. in more than one receptacle 106 of a sample rack 105) as shown in FIG. 1G .
- the general orientation of more than one receptacle 106 of the sample rack 105 may be determined.
- a robotic component 103 having an end effector 104 and a light beam sensor 108 provided in a fixed orientation to the end effector fingers 104A, 104B of the end effector 104 is provided in 302.
- a teach tool 102 is provided within a work envelope reachable by the end effector 104, the teach tool 102 having a rotational geometrical calibration feature 124.
- Step 306 involves grasping the teach tool 102 is grasped with fingers 104A, 104B of the end effector 104 and rotating the teach tool 102 relative to a reader (e.g., a bar code reader 132).
- a reader e.g., a bar code reader 1302.
- scanning of the teach tool 102 during the rotation is undertaken to determine a rotational orientation of the teach tool 102.
- the scanning aids in locating a feature (edge 130A) of the teach tool 102, which is provided in a fixed orientation to a rotational geometrical calibration feature 124.
- the teach tool 102 is positioned (e.g., in a sample rack 105) by the end effector 104 in a known rotational orientation, and the end effector fingers 104A, 104B are released from the teach tool 102.
- the end effector 104 with the light beam sensor 108 is positioned proximate to the rotational geometrical calibration feature 124; and, in 314, the end effector 104 and the light beam 108C of the light beam sensor 108 are rotated to determine the rotational orientation of the fingers 104A, 104B relative to the rotational geometrical calibration feature 124.
- the orientation is determined by sensing the breaking of the light beam 108C on edges of the rotational geometrical calibration feature 124 as described with reference to FIGs. 1L-1M .
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Manipulator (AREA)
Description
- This application claims priority to
U.S. Provisional Application Serial Number 61/454,069 - The present invention relates generally to methods, systems, and apparatus adapted to calibrate a positional orientation of a robotic component.
- In medical testing and processing, the use of robotics may minimize exposure to, or contact with, bodily fluid samples (otherwise referred to as "specimens") and/or may increase productivity. For example, in some automated testing and processing systems (e.g., clinical analyzers and centrifuges), sample containers (such as test tubes, sample cups, vials, and the like) may be transported to and from sample racks (sometimes referred to as "cassettes") and to and from a testing or processing location or system.
WO 2009/086164 A2 provides for example a method for calibrating alignment of an end effector with respect to a chuck in a plasma processing system. - Such transportation may be accomplished by the use of an automated mechanism, which may include a suitable robotic component (e.g., a moveable robot arm or gantry arrangement) having a moveable end effector that may have gripper fingers coupled thereto. The end effector may be moved in two or more coordinate directions (e.g., X, R, and Z). In this way, a sample container (containing a specimen to be tested or processed) may be gripped by the end effector, and then moved from one location to another in relationship to the testing or processing location or system. For example, the sample container may be moved to and from a receptacle of a sample rack.
-
EP 0045174 A1 discloses a gripping device on an industrial robot with a plurality of light-emitting members for generating a plurality of light beams, and a plurality of light-receiving elements for receiving the light beams. FromUS 2009/0302795 A1 an automated robot teach tool is known that enables a robot to automatically program all of the pick and place positions associated with a robotic workcell without robot operator intervention. - Inaccurate calibration may result in inaccurate positioning of the end effector and may cause collisions or jams between the end effector and the sample container, and/or between the sample container being moved and the testing or processing system or sample rack. Additionally, inaccurate calibration may contribute to jarring pick and place operations of the sample container, which may contribute to unwanted spillage of specimen from the sample container. Furthermore, knowing a precise rotational orientation of the end effector fingers may allow for the manufacture of smaller sample racks, in that the fingers may be placed in a defined orientation when grasping the sample container, thereby allowing the distance between respective sample containers in the sample rack in other directions to be minimized.
- Accordingly, methods, systems, and apparatus that may improve accuracy of positioning of a robotic component relative to an article, such as a sample rack, in testing and processing systems are desired. Furthermore, methods that improve accuracy of positioning of robot fingers of end effectors are also desired.
- In a method aspect, an improved method of calibrating a position of an article relative to an end effector of a robot is provided. The method includes providing a robotic component having the end effector with end effector fingers adapted for grasping a teach tool and a light beam sensor provided in a fixed orientation to the end effector fingers; providing a teach tool at an approximately known location on the article within a work envelope reachable by the end effector, the teach tool having a geometrical calibration feature; positioning the end effector with the light beam sensor at a first location proximate to the geometrical calibration feature, the
geometrical calibration feature 112 adapted for use to determine a positional calibration; positioning the end effector and sensing with the light beam sensor a first engagement edge of the geometrical calibration feature of the teach tool; and positioning the end effector and sensing with the light beam sensor a second engagement edge of the geometrical calibration feature of the teach tool; using the sensing of thefirst engagement edge 134 and thesecond engagement edge 136 to calibrate a position of thearticle 105 relative to theend effector 105 of the robot; the method being characterized by moving theend effector 104 with thelight beam sensor 108 to a second location proximate to thegeometrical calibration feature 112 of theteach tool 102, the second location being different than the first location, wherein thegeometrical calibration feature 112 comprises a cylinder oriented with a cylindrical axis being vertical and located at an approximately known location on thearticle 105; theend effector 104 rotates about theaxis 104C, so that thefingers sample rack 105; rotating theend effector 104 and sensing with the light beam sensor 108 a third engagement edge of thegeometrical calibration feature 112 of the teach tool; rotating theend effector 104 and sensing with the light beam sensor 108 a fourth engagement edge of the geometrical calibration feature 112 of theteach tool 102; and calculating a location of the geometrical calibration feature 112of theteach tool 102. - According to another aspect, an improved robot calibration system is provided. The system includes a robotic component having an end effector with end effector fingers adapted for grasping a
teach tool 102; a light beam sensor provided in a fixed orientation to the end effector fingers; a teach tool coupled to an article at a first location, the teach tool including a geometrical calibration feature; and a controller adapted to position a light beam of the light beam sensor around the geometrical calibration feature of the teach tool and calculate a position thereof based upon edge interferences between the geometrical calibration feature and the light beam characterized in that theteach tool 102 includes a verticalgeometrical feature 112A and thecontroller 110 is adapted to move thelight beam 108C emitted from thelight beam sensor 108 vertically relative to the verticalgeometrical feature 112A to determine a height dimension of the verticalgeometrical feature 112A upon contact of thelight beam 108C with the verticalgeometrical feature 112A. - In an apparatus aspect, a calibration assisting tool is provided. The calibration assisting tool includes a base adapted to couple to an article; a first geometrical calibration feature extending from the base, the geometrical calibration feature including a cylindrical post extending from the base; a second geometrical calibration feature including a flat surface; and a third geometrical feature extending crosswise through the base or cylindrical post.
- In another method aspect, a method of calibrating a rotational position of fingers of an end effector is provided. The method includes providing a robotic component having the end effector and a light beam sensor provided in a fixed orientation to the end effector fingers; providing a teach tool within a work envelope reachable by the end effector, the teach tool having a rotational geometrical calibration feature; grasping the teach tool with the fingers of the end effector and rotating the teach tool relative to a scanner; scanning the teach tool during the rotation to determine a rotational orientation of the teach tool; positioning the teach tool with the end effector in a known rotational orientation and releasing the end effector fingers from the teach tool; positioning the end effector with the light beam sensor proximate to the rotational geometrical calibration feature; and rotating the end effector and the light beam of the light beam sensor to determine the rotational orientation of the fingers relative to the rotational geometrical calibration feature.
Still other aspects, features, and advantages of the present invention may be readily apparent from the following detailed description by illustrating a number of exemplary embodiments and implementations, including the best mode contemplated for carrying out the present invention. The present invention may also be capable of other and different embodiments, and its several details may be modified in various respects, all without departing from the spirit and scope of the present invention. Accordingly, the drawings and descriptions are to be regarded as illustrative in nature, and not as restrictive. The drawings are not necessarily drawn to scale. The invention is to cover all modifications and alternatives falling within the scope of the invention. -
-
FIG. 1A is a partially cross sectioned side view illustration of an exemplary robot assembly and calibration-assisting teaching tool according to embodiments of the invention.FIG. 1B is a partially cross sectioned side view graphical depiction that illustrates a position of an end effector relative to a cylindrical post of the teach tool during a measurement step according to embodiments of the invention.FIG. 1C is a top view graphical depiction that illustrates a starting position of a light beam of a light beam sensor relative to a teach tool in X-R coordinates according to embodiments of the invention. -
FIG. 1D is a top view graphical depiction that illustrates a first edge engagement position of a light beam of a light beam sensor relative to a teach tool in X-R coordinates according to embodiments of the invention. -
FIG. 1E is a top view graphical depiction that illustrates a second edge engagement position of a light beam of a light beam sensor relative to a teach tool in X-R coordinates according to embodiments of the invention. -
FIG. 1F is a partially cross sectioned side view graphical depiction that illustrates a position of an end effector relative to a vertical geometrical calibration feature of the teach tool during a vertical measurement step according to embodiments of the invention. -
FIG. 1G is a top view of a sample rack including multiple teach tools installed in receptacles at diagonal corners thereof according to embodiments of the invention. -
FIG. 1H is a side view graphical depiction that illustrates end effector fingers of an end effector rotating the teach tool relative to a scanner according to embodiments of the invention. -
FIG. 1I is a partial side view illustrating an alternate embodiment of a teach tool according to embodiments of the invention. -
FIG. 1J is a partially cross sectioned side view graphical depiction that illustrates an end effector placing the teach tool in a sample rack in a known orientation according to embodiments of the invention. -
FIG. 1K is a partially cross sectioned side view graphical depiction that illustrates a light beam of a light beam sensor being rotated relative to a rotational geometrical calibration feature of a teach tool according to embodiments of the invention. -
FIGs. 1L-1M are top cross sectioned views that illustrate a light beam of a light beam sensor being rotated relative to a rotational geometrical calibration feature of a teach tool according to embodiments of the invention. -
FIGs. 1N-1P are graphic illustrations showing the various geometrical features used to calculate a position of the geometrical calibration feature according to embodiments of the invention. -
FIG. 2 is a flowchart illustrating a first method according to embodiments of the present invention. -
FIG. 3 is a flowchart illustrating a second method according to embodiments of the present invention. - In robotic apparatus, such as those used to accomplish robotic pick and place operations in clinical analyzers or other testing or processing systems, for the aforementioned reasons, achieving precision in the placement of robotic end effector fingers is desirable. "End effector" as used herein is any member coupled to a robot that is used in robotic operations to grasp and/or move a device (e.g., a sample container) from one location to another, such as in a pick and place operation. In such robotic systems, positional precision to several thousands of an inch or less may be desirable. However, in many instances, tolerance stack-ups due to manufacturing variances and assembly variances of the multitude of connected system components may amount to many thousandths, or many hundredths, or even many tenths of an inch. Accordingly, means for appropriately determining an actual position of a robotic end effector relative to an article (e.g., in X and R; X, R, and Z; X, R, and T, or X, R, Z, and T) in such a robotic system is desired.
- In view of the foregoing problems, the present invention provides calibration methods, calibration systems, and calibration assisting tools for readily determining an actual position of an article relative to an end effector in a robotic system.
- In a first aspect, a method of calibrating a position of an article relative to an end effector of a robot is provided. The method includes providing a robot with an attached end effector and end effector fingers and a light beam sensor provided in a fixed orientation thereto, and a teach tool on the article. The light beam sensor may be fixed (immoveable) vertically, and horizontally (in X-R coordinates) relative to the end effector, and fixed relative to the fingers such that a light beam always remains in a fixed orientation relative to the fingers, i.e., the light beam rotates with the fingers. The teach tool has a geometrical calibration feature (e.g., a cylindrical post) thereon. The light beam sensor is positioned proximate to the geometrical calibration feature and rotated to sense with the light beam several engagement edges of the geometrical calibration feature. A location of the geometrical calibration feature is calculated based upon the sensed location of several engagement edges. Once the location of the geometrical calibration feature is determined, another feature of the teach tool may be measured (e.g., a vertical geometrical calibration feature) such that orientation in another degree of freedom (e.g., the Z direction) may be determined. In other embodiments, an orientation of a rotational geometrical calibration feature (e.g., a hole through the teach tool) of the teach tool may be determined by orienting and rotating the fingers and light beam sensor relative to the rotational geometrical calibration feature. This may determine an orientation of the end effector fingers in a T direction (e.g., rotation).
- In another aspect, a robot calibration system is provided. The robot calibration system includes a robotic component having a moveable end effector with end effector fingers, and a light beam sensor provided on the end effector. The system also includes a teach tool coupled to an article at a first location whose orientation is to be determined, wherein the teach tool has a geometrical calibration feature thereon. The system includes a controller adapted to rotate a light beam of the light beam sensor around the geometrical calibration feature of the teach tool and thereafter calculate a position (e.g., center in X-R coordinates) of the geometrical calibration feature that is based upon edge interferences between the geometrical calibration feature and the light beam. The
controller 110 is adapted to move thelight beam 108C emitted from thelight beam sensor 108 vertically relative to the verticalgeometrical feature 112A to determine a height dimension of the verticalgeometrical feature 112A upon contact of thelight beam 108C with the verticalgeometrical feature 112A. - In another aspect, a calibration assisting tool is provided. The calibration assisting tool includes a base adapted to couple to an article, a first geometrical calibration feature extending from the base, the geometrical calibration feature including a cylindrical post extending from the base; a second geometrical calibration feature including a flat surface; and a third geometrical feature extending crosswise through the base or cylindrical post.
- In yet another aspect, a method of calibrating a rotational orientation of end effector fingers of an end effector is provided. The method involves scanning the teach tool to determine an orientation of a rotational geometrical calibration feature thereon, placing the tool in a known orientation (e.g., in a receptacle of a sample rack), and then rotating the end effector fingers about the teach tool to determine the rotational orientation of the fingers to the rotational geometrical calibration feature of known orientation.
- These and other aspects and features of the invention will be described with reference to
FIGs. 1A-3 herein. - In accordance with a first embodiment of the invention, as best shown in
FIGs. 1A-1K , arobot calibration system 100 is described. Therobot calibration system 100 is useful for aiding in the calibration of any robotic system, such as those used in automated clinical analyzers, centrifuges, or other processing or testing systems (e.g., biological fluid specimen processing or testing systems). In particular, thecalibration system 100 is useful for precisely calibrating the location of areceptacle 106 of asample rack 105 adapted to receive one or more sample containers containing biological fluid (e.g., blood collection tubes, etc.). Therobot calibration system 100 includes arobotic apparatus 101 and ateach tool 102. - The
robotic apparatus 101 includes arobotic component 103 having anend effector 104 being coupled thereto. Theend effector 104 may have two or more moveable jaws orfingers sample racks 105 that are adapted to receive sample containers in one ormore receptacles 106 thereof. A partial cross sectional view of thesample rack 105 is shown inFIG. 1A . Only onereceptacle 106 is shown. However, it should be recognized that thesample rack 105 may include one or more than one receptacle (seeFIG. 1G ) and thus may receive a number of sample containers therein. - Prior to calibration, the location of the
sample rack 105 on a component of the testing or processing system may be only "generally known" in three-dimensional space. For example, the location of thesample rack 105 on a system component, such as on a tray or portion of aframe 107 of the system may only be "generally known." Thesample rack 105 may include one or more geometrical features that aid in generally locating thesample rack 105 on the tray orframe 107, such as locator pins or features, tabs, locking mechanisms, or other orienting features (not shown). It is said herein that the location of thesample rack 105 may only be "generally known" because of the tolerance stack-ups in manufacturing of the system, and that a precise location of one or more of thereceptacles 106 is desired to be "precisely known" for the reasons listed above. Accordingly, the present invention (method and system) has great utility in enabling a location of one ormore receptacles 106 of thesample rack 105 to be "precisely known," that is known with a relative high degree of certainty or precision. - In more detail, the
robotic apparatus 101 includes alight beam sensor 108 that enables therobotic apparatus 101 to gauge whether thegripper fingers light beam sensor 108 may include fiber optic components, such as alight source 108A, anoptical fiber 108B adapted to carry and direct alight beam 108C, and alight detector 108D adapted to receive and detect a presence of alight beam 108C thereat. Thelight beam sensor 108 functions to send alight beam 108C from theoptical fiber 108B to thedetector 108D. Thelight beam sensor 108 may be coupled directly to a portion of theend effector 104 or to a portion of the robotic component (e.g., to a robot arm, boom, or beam), but the location between thecenterline axis 104C of theend effector 104 and thelight beam sensor 108 is fixed and known. Preferably, thelight beam 108C is oriented so that thelight beam 108C passes through thecenterline axis 104C of the end effector 104 (i.e., through the T axis of rotation). For example, thelight beam 108C may be oriented generally horizontally. Thelight beam 108C may be made as small as practical. Likewise, the Z dimension between the lower terminal ends of thegripper fingers end effector 104 and thelight beam 108C is also fixed and known. Rotation of thefingers end effector 104 relative to therobotic component 103 causes thelight beam 108C to also rotate with thefingers - The
robotic apparatus 101 may include asuitable controller 110 that may command therobotic component 103 and attachedend effector 104 and move theend effector 104 andlight beam sensor 108 in one or more coordinate directions, two or more coordinate directions (e.g., X and R), three or more coordinate directions (e.g., X, R, and Z or X, R, and T), or even four directions (e.g., X, R, Z, and T), where X is into and out of the paper inFIG. 1A , R is laterally on the paper, Z is vertically on the paper, and T is a rotation about theaxis 104C of theend effector 104. Thecontroller 110 may be any suitable controller adapted to interact with therobotic component 103, and may include a suitable microprocessor, memory, conditioning electronics, and circuitry adapted to carry out the motions, measurements, and calculations associated with the calibration and motion of therobotic component 103 andend effector 104. - Any suitable
robotic component 103 may be used, such as a moveable multi-arm robot (e.g., having included one or more shoulder, elbow, or wrist elements), a telescopic boom robot, or a beam or beams having one or more motors coupled thereto. Any suitable mechanism for imparting motion to theend effector 104 may be used. In one implementation, therobotic component 103 may be used to accomplish three-dimensional coordinate motion (X, R, and Z) of theend effector 104 so that sample containers may be placed in areceptacle 106 of asample rack 105. Additionally, therobotic component 103 may accomplish a rotation (T) of theend effector 104, which is rotation about theaxis 104C, so that thefingers sample rack 105, or relative to thesample rack 105 when a sample container is being inserted in thesample rack 105. - The
robotic component 103 may include a moveable assembly including an R axis motor adapted to impart R axis motion to theend effector 104 relative to a frame of the testing or processing system, an X axis motor adapted to cause X axis motion of theend effector 104 relative to the frame, a Z axis motor adapted to cause Z axis motion of theend effector 104 relative to the frame, and a T axis motor adapted to cause rotation of theend effector fingers axis 104C). Suitable feedback mechanisms may be provided for each degree of motion, such as position and/or rotation sensors. Therobotic component 103 may include suitable tracks or guides and suitable motors, such as one or more stepper motors, servo motors, pneumatic or hydraulic motors, electric motors, or combinations thereof. Furthermore, drive systems including chains, guides, pulleys and belt arrangements, gear or worm drives or other conventional drive components may be utilized to cause the various motion of theend effector 104. Other types ofrobotic components 103 may be employed. - Again referring to
FIGs. 1A-1B , theopposed gripper fingers fingers light beam sensor 108 may be positioned other than on the fingers, but rotatable therewith and provided in a fixed Z orientation to theend effector 104. - As previously mentioned, the
robot calibration system 100 includes one ormore teach tools 102. The one ormore teach tools 102 may be mounted to the article (e.g., sample rack 105) for which the precise positional calibration is to be determined. For example, in the present instance, one ormore teach tools 102 may be mounted in one ormore receptacles 106 of thesample rack 105. Thesample rack 105 and teachtool 102 may be placed in a testing or processing system at any location within the reach of therobotic component 103. For example, thesample rack 105 may be placed and locked in a generally-known position in the testing or processing system within the reach of therobotic component 103. - As shown in
FIG. 1G , one ormore teach tools 102 may be used to assist in a determination (calibration) of a position of one ormore receptacles 106 in amulti-sample sample rack 105. A fiftyposition sample rack 105 is shown. However, the present invention is applicable to calibration of the location ofreceptacles 106 in any sized sample rack. In the depicted embodiment, the calibration may take place at one or more locations in thesample rack 105. For example, teachtools 102 may be provided at opposite diagonal corners of thesample rack 105, as shown. Optionally, other locations may be used. In some embodiments, theteach tool 102 may have a roundedbottom 102A having a radius and diameter such that it resembles the geometry of a sample container (e.g., sample tube). Theteach tool 102 may be manually inserted in thereceptacle 106. Optionally, theteach tool 102 may be picked up from a designated and known home location in the testing or processing system, and delivered to areceptacle 106 by therobotic component 103. - In the depicted embodiment, teach
tool 102 includes ageometrical calibration feature 112. Thegeometrical calibration feature 112 may be a generally cylindrical post extending upwardly from abase 114 of theteach tool 102. Theteach tool 102 may be received securely in thereceptacle 106 of thesample rack 105 by any suitable means, such as first andsecond leaf springs FIG. 1A ). Theteach tool 102 may register (e.g., contact) at the bottom of thereceptacle 106 in the same manner as does a sample tube. Thegeometrical calibration feature 112 may be oriented in a geometrical center of thereceptacle 106 and may be used to determine a center location of the receptacle in the X-R plane. Theteach tool 102 may further include a verticalgeometrical calibration feature 112A, which may comprise a planar upper surface that is generally perpendicular to atool axis 120 extending through the center of thegeometrical calibration feature 112, i.e., through the center of the cylindrical post. The verticalgeometrical calibration feature 112A is used to determine and calibrate a vertical orientation of the bottom registry point 122 (e.g., the point contacted by a sample tube) of therack 105 in the Z direction. The vertical length of theteach tool 102 and the diameter of thegeometrical calibration feature 112, i.e., the cylindrical post, are precisely known. The vertical length from end to end of theteach tool 102 may be about 100 mm, for example. The diameter of the cylindrical post may be about 2.54 mm, for example. The length of the cylindrical post may be about 20 mm, for example. The diameter of the base 114 may be about 16 mm, for example. Other dimension may be used. - In another aspect, the
teach tool 102 may include a rotationalgeometrical calibration feature 124 that is used to determine and calibrate a rotational orientation of theend effector fingers fingers rack 105 to be made smaller in at least one direction, because the clearance needed for thefingers geometrical calibration feature 124 may comprise a through hole formed through theteach tool 102. The through hole may be formed crosswise through the body or optionally through the post as is shown inFIG. 1I . The through hole may include a center axis that intersects the axis of thegeometrical calibration feature 112. The hole is preferably of constant diameter along its length and may have a diameter of about 2.54 mm, for example. Other diameters may be used. - Additionally, the
teach tool 102 may include ahoop groove 126 that may encircle the perimeter of thebase 114. Furthermore, theteach tool 102 may include astart groove 128 that extends along a direction parallel to thetool axis 120, i.e., in a vertical orientation. Furthermore, abar code label 130 may be positioned and affixed on the surface of theteach tool 102, such as on thebase 114 thereof. Thebar code label 130 may be affixed to the base 114 in a known orientation, such as shown. In particular, the location of thestart groove 128 may be generally aligned with theaxis 120 and also with the axis of the rotationalgeometrical calibration feature 124. Thebar code 130 may include a detectable feature such as adetectable edge 130A placed so as to abut an edge of thestart groove 128. Thedetectable edge 130A may be detectable by a bar code reader 132 (FIG. 1H ), as will be explained below. Thedetectable edge 130A may be formed by the right end of each of the bars of thebar code label 130 or another detectable feature of thebar code label 130. Thisdetectable edge 130A is provided in a generally known orientation to thestart groove 128 and to the rotationalgeometrical calibration feature 124. - A first method aspect of a
method 200 of the invention will now be explained in detail with reference to the flowchart inFIG. 2 and therobot calibration system 100 inFIGs. 1A-1F . Instep 202, arobotic component 103 is provided having anend effector 104 withend effector fingers light beam sensor 108 provided in a fixed orientation to theend effector fingers step 204, ateach tool 102 is provided at an approximately known location on an article within a work envelope reachable by theend effector 104 wherein theteach tool 102 has ageometrical calibration feature 112 thereon. The article may be any component for which it is desired to obtain precise positional information in X, R, Z, T, or any combination thereof. For example, in one example, the article is asample rack 105 and theteach tool 102 is situated on (bottomed in) thesample rack 105, such as in areceptacle 106 thereof. Instep 206, theend effector 104 with thelight beam sensor 108 is positioned at a first location proximate to the geometrical calibration feature 112 (e.g., adjacent to and vertically posited roughly midway along the cylindrical post). In particular, as shown inFIGs. 1B and 1C , thelight beam 108C is provided at a position offset from thegeometrical calibration feature 112 where thebeam 108C will make contact with thegeometrical calibration feature 112 upon rotation of theend effector 104. For example, thebeam 108C may be located at about 6 mm to about 10 mm away from thegeometrical calibration feature 112. Instep 208, theend effector 104 is rotated from its initial position inFIG. 1C to a first rotational position as is shown inFIG. 1D . In this position, thelight beam sensor 108 senses afirst engagement edge 134 of thegeometrical calibration feature 112 of theteach tool 102. The sensing occurs when thelight beam 108C is first broken by the interference of thegeometrical calibration feature 112 with thelight beam 108C at thefirst engagement edge 134. As thelight beam 108C is broken as shown inFIG. 1D , thedetector 108D no longer provides a signal to thecontroller 110, and a first rotational orientation of theend effector 104 is recorded in memory of thecontroller 110. The rotational orientation of theend effector 104 may be provided by any suitable rotational sensor or feedback device coupled to theend effector 104 that provides a reading of the rotational position of theend effector fingers axis 104C. - In
step 210, theend effector 104 is again rotated, and asecond engagement edge 136 of thegeometrical calibration feature 112 of theteach tool 102 is sensed with thelight beam sensor 108. In some embodiments, thelight beam 108C may be rotated continuously from the contact with thefirst engagement edge 134 to thesecond engagement edge 136 in a clockwise direction, for example. As thelight beam 108C is again sensed by thedetector 108D as is shown inFIG. 1E , the second rotational position is recorded in memory. Although it is preferred that the rotation be in one direction (e.g., clockwise or counterclockwise) wherein during the rotational motion bothedges edges edges geometrical calibration feature 112 of theteach tool 102 based upon a location of the first and second engagement edges 134, 136 is calculated instep 212 by thecontroller 110. From this, the distance between the location of the center of thegeometrical calibration feature 112 in the X-R plane and the center of theend effector 104 is determined. By moving theend effector 104 in the R and X directions and then repeating the edge finding routine, the exact location of the article (e.g., thereceptacle 106 of the sample rack 105) may be precisely determined. If a more precise location is desired, the procedure above may be repeated by positioning theend effector 104 at a third location offset from thegeometrical calibration feature 112 in the X-R plane and repeating the steps above, but relative to additional engagement edges of thegeometrical calibration feature 112. - As shown in the graphic illustration of
FIGs. 1N-1P , once the first and second angles θ1 and θ2 are determined, the calculation of the distance to the center is determined according to the following relationship in Equation 1:
Sincer r is known because the diameter D (i.e., D = 2r) of thegeometrical calibration feature 112 is precisely known, and α is known through measurement of first and second angles θ1 and θ2, L1 can be determined, wherein L1 is the distance between thecenter axis 104C of theend effector 104 and the center of thegeometrical calibration feature 112. The exact location of the center of thegeometrical calibration feature 112 in X-R coordinates may be more precisely determined by repeating the above method. Thus, theend effector 104 may be moved in the X and R directions by known amounts, and then the edge finding method described above for determining the center of thegeometrical calibration feature 112 is repeated. - In more detail, a precise determination of the center is obtained by moving the
end effector 104 with thelight beam sensor 108 to a second location proximate to thegeometrical calibration feature 112 of theteach tool 102. The second location is different than the first location. The geometrical calibration feature comprises a cylinder oriented with a cylindrical axis being vertical and located at an approximately known location on thearticle 105. Theend effector 104 rotates about theaxis 104C so that thefingers sample rack 105. Theend effector 104 is again rotated and a third engagement edge of thegeometrical calibration feature 112 is sensed with thelight beam sensor 108 via breaking thelight beam 108C. The rotation of theend effector 104 then may continue in the same direction and a fourth engagement edge of thegeometrical calibration feature 112 is sensed when thelight beam 108C is again detected bydetector 108D of thelight beam sensor 108. The length (L2) from the second rotation point to the center of thegeometrical calibration feature 112 of theteach tool 102 may then be calculated based upon a location of the third and fourth engagement edge and using Equation 2: - Once L1 and L2 are known, an exact location of the center of the
geometrical calibration feature 112 of theteach tool 102 relative to thecenterline axis 104C of theend effector 104 in the X-R plane may be determined geometrically using the cosine rule ofEquations 3, 4, and 5 below and referring toFIGs. 1N-1P .geometrical calibration feature 112 of theteach tool 102 relative to thecenterline axis 104C is also known. The calibration may be repeated a third time to even more precisely locate the exact center of thegeometrical calibration feature 112. - Once the center location of the
geometrical calibration feature 112 is known, an additional calibration routine may be executed to determine a vertical location of a verticalgeometrical calibration feature 112A of theteach tool 102, as best shown inFIG. 1F . The vertical calibration routine may follow immediately after the center finding routine previously described. In this case, theteach tool 102 is already seated in thesample rack 105 such that theteach tool 102 contacts a knownregistry point 122 in the bottom of thesample rack 105. Theend effector 104 and thelight beam 108C of thelight beam sensor 108 are first positioned at a known position above the verticalgeometrical calibration feature 112A. In this embodiment, the verticalgeometrical calibration feature 112A is a flat surface on the top of a cylindrical post extending from thebase 114. Theend effector 104 andlight beam 108C are then lowered in the -Z direction until thelight beam 108C is broken, as shown inFIG. 1F . The vertical (Z) position is recorded. Accordingly, the orientation of thesample rack 105 to theend effector 104 andfingers bottom registry point 122 in the Z direction is known because the length of the teach tool is precisely known. Thus, now being calibrated in the X, R, and Z directions, theend effector 104 may precisely pick and place sample containers (not shown) from thesample rack 105 as part of the sample testing and processing in the system. - In another broad aspect of the invention, a calibration method adapted to determine a rotational orientation of the
end effector fingers teach tool 102 and the article (e.g., sample rack 105) is provided. This calibration may be accomplished in addition to the center-finding calibration method and/or the vertical calibration method where it is desired to know the rotational orientation of theend effector fingers teach tool 102 may be engaged (e.g., gripped) by the end effector 104 (e.g., bygripper fingers FIG. 1H . Theteach tool 102 may be grasped by thegeometrical calibration feature 112 comprising a cylindrical post by thefingers teach tool 102, including thebar code 130 that has been placed in a predefined location on theteach tool 102, may be rotated relative to abar code reader 132. Thebar code reader 132 may be placed in the testing or processing system at any defined location. In general, the system may already include thebar code reader 132 to be able to read bar code labels 130 on sample containers being processed by the system. Theteach tool 102 is rotated until a known feature of the tool is recognized by the bar code reader 132 (e.g., adetectable edge location 130A on the bar code 130). Other features may be used. The rotational orientation of thefeature 130A is recorded in memory. As previously discussed, the location of the rotationalgeometrical calibration feature 124 is now generally known (albeit without a great amount of precision) because the orientation of the rotationalgeometrical calibration feature 124 is generally known relative to thebar code 130. For example, thebar code edge 130A may be aligned vertically with a center of the rotationalgeometrical calibration feature 124. It should be recognized that the location of thefingers end effector 104 relative to the rotationalgeometrical calibration feature 124 is not yet known. - Now the
teach tool 102 is again placed (bottomed) in thesample rack 105 as shown inFIG. 1J . Then theend effector fingers teach tool 102 including the rotationalgeometrical calibration feature 124 and lowered to a height of a center of the rotationalgeometrical calibration feature 124, as shown inFIG. 1K . Theend effector 104 is then rotated aboutaxis 104C in either a clockwise or counterclockwise direction. When thelight beam 108C first emerges through the rotationalgeometrical calibration feature 124 and is sensed by thelight detector 108D such as shown inFIG. 1L , the first rotational position thereof is recorded. At this point, the rough orientation of thefingers geometrical calibration feature 124 is known. Likewise, the rough orientation of thefingers detectable edge feature 130A in a previous step. - The
end effector 104 may be further rotated until thelight beam 108C is no longer detected by thelight detector 108D, as shown inFIG. 1M , and this second rotational angle may be recorded. The average of the two angular readings may then be used to determine the exact center of the rotationalgeometrical calibration feature 124. Thus, based on this, a precise orientation of thefingers sample rack 105, as well as theframe 107 of thesystem 100, is known. In each of the rotation-determining sequences, the routine may be executed first with a faster rotation for rough orientation determination, followed by a slower rotation (e.g., step by step) to precisely determine the center location of thegeometrical calibration feature 112 and/or the angular orientation of the of the rotationalgeometrical calibration feature 124. - In some instances, the
light beam 108C, when first oriented at the rotationalgeometrical calibration feature 124, will by mere chance be oriented along the rotationalgeometrical calibration feature 124. In this instance, theend effector 104 will be rotated through a predetermined angle (e.g., 90 degrees) such that the rotational orientation measurement sequence will start with thelight beam 108C not passing through the rotationalgeometrical calibration feature 124, and then carried out as discussed above. - The above calibration methods may be carried out in any order, but will be best implemented by first calibrating the center of the
geometrical calibration feature 112, then calibrating the Z axis height of thevertical calibration feature 112A, followed by calibration of the rotational orientation of thefingers geometrical calibration feature 124. - Thus, in one implementation, the calibration method is carried out to determine the orientation of the
end effector 104 in the X-R plane, and Z, and T directions. The calibration method is carried out relative to theteach tool 102 including thegeometrical calibration feature 112, thevertical calibration feature 112A, and the rotationalgeometrical calibration feature 124. - One method of calibrating a position of an article relative to an end effector of a robot may be carried out as follows. According to the method, as best shown in
FIG. 2 andFIGs. 1A-1E , arobotic component 103 is provided in 202 having theend effector 104 and alight beam sensor 108 provided in a fixed orientation to theend effector 104. Ateach tool 102 is provided in 204 at an approximately known location on the article (e.g., a sample rack 105) within a work envelope reachable by theend effector 104. Theteach tool 102 has ageometrical calibration feature 112, such as a cylindrical post. Theend effector 104 with thelight beam sensor 108 is positioned in 206 at a first location proximate to thegeometrical calibration feature 112. Theend effector 104 is rotated in 208 and afirst engagement edge 134 of thegeometrical calibration feature 112 of theteach tool 102 is sensed with the light beam sensor 108 (e.g., by breaking thebeam 108C). Theend effector 104 is again rotated in 210 and asecond engagement edge 136 of thegeometrical calibration feature 112 of theteach tool 102 is sensed with thelight beam sensor 108. The calculation of a location (e.g., the center) of thegeometrical calibration feature 112 of theteach tool 102 based upon a location of the first and second engagement edges 134, 136 may be carried out in 212, as discussed above. - Using the above center-finding calibration method, the exact positional center location of the
geometrical calibration feature 112 in X-R space may be found. The vertical orientation of theend effector 104 to the article (e.g., areceptacle 106 of the sample rack 105) may be determined by calibrating the verticalgeometrical feature 112A as described above. Alternatively, or in addition, the rotational calibration method may be used. Accordingly, the X, R, Z location of the article (e.g., areceptacle 106 of the sample rack 105) may be determined. Moreover, the rotational orientation of thefingers end effector 104 may be determined relative to the article and/or frame of the processing or testing system. - It should be understood that one or more
additional teach tools 102 may be used (or moved to other locations) on other system component(s) within the reach of theend effector 104. Thus, positions of other features of an article may be calibrated. For example, theteach tool 102 may be arranged at more than one location of the article (e.g. in more than onereceptacle 106 of a sample rack 105) as shown inFIG. 1G . Thus, the general orientation of more than onereceptacle 106 of thesample rack 105 may be determined. - An exemplary method of determining a rotational orientation of the
end effector fingers end effector 104 will now be described with reference toFIG. 3 in accordance with another broad aspect of the invention. According to themethod 300, arobotic component 103 having anend effector 104 and alight beam sensor 108 provided in a fixed orientation to theend effector fingers end effector 104 is provided in 302. In 304, ateach tool 102 is provided within a work envelope reachable by theend effector 104, theteach tool 102 having a rotationalgeometrical calibration feature 124. Step 306 involves grasping theteach tool 102 is grasped withfingers end effector 104 and rotating theteach tool 102 relative to a reader (e.g., a bar code reader 132). In 308, scanning of theteach tool 102 during the rotation is undertaken to determine a rotational orientation of theteach tool 102. As discussed above, the scanning aids in locating a feature (edge 130A) of theteach tool 102, which is provided in a fixed orientation to a rotationalgeometrical calibration feature 124. In 310, theteach tool 102 is positioned (e.g., in a sample rack 105) by theend effector 104 in a known rotational orientation, and theend effector fingers teach tool 102. In 312, theend effector 104 with thelight beam sensor 108 is positioned proximate to the rotationalgeometrical calibration feature 124; and, in 314, theend effector 104 and thelight beam 108C of thelight beam sensor 108 are rotated to determine the rotational orientation of thefingers geometrical calibration feature 124. The orientation is determined by sensing the breaking of thelight beam 108C on edges of the rotationalgeometrical calibration feature 124 as described with reference toFIGs. 1L-1M . - While the invention is susceptible to various modifications and alternative forms, specific system and apparatus embodiments and methods thereof have been shown by way of example in the drawings and are described in detail herein. It should be understood, however, that it is not intended to limit the invention to the particular systems, apparatus, or methods disclosed but, to the contrary, the intention is to cover all modifications and alternatives falling within the scope of the invention.
Claims (13)
- A method of calibrating a position of an article (105) relative to an end effector (104) of a robot, comprising:providing a robotic component (103) having the end effector (104) with a vertical axis (104C) and end effector fingers (104A, 104B) for grasping a teach tool (102) and having a light beam sensor (108) provided in a fixed orientation to the end effector fingers(104A, 104B) ;providing the teach tool (102) at an approximately known location on the article (105) within a work envelope reachable by the end effector (104), the teach tool (102) having a geometrical calibration feature (112);positioning the end effector (104) with the light beam sensor (108) at a first location proximate to the geometrical calibration feature (112), the geometrical calibration feature (112)adapted for use to determine a positional calibration;positioning the end effector (104)and sensing with the light beam sensor (108) a first engagement edge (134) of the geometrical calibration feature (112)of the teach tool (102);positioning the end effector (104) and sensing with the light beam sensor (108) a second engagement edge (136) of the geometrical calibration feature (112)of the teach tool (102); andusing the sensing of the first engagement edge (134) and the second engagement edge (136) to calibrate a position of the article (105) relative to the end effector (104) of the robot; the method being characterized by
moving the end effector (104) with the light beam sensor (108) to a second location proximate to the geometrical calibration feature (112) of the teach tool (102), the second location being different than the first location, whereinthe geometrical calibration feature (112) comprises a cylinder oriented with a longitudinal axis being vertical and located at an approximately known location on the article (105),the end effector (104) rotates about the vertical axis (104C), sc that the fingers (104A, 104B) are precisely oriented relative to a sample container in a sample rack (105);rotating the end effector (104) and sensing with the light beam sensor (108) a third engagement edge of the geometrical calibration feature (112) of the teach tool (102);rotating the end effector (104) and sensing with the light beam sensor (108) a fourth engagement edge of the geometrical calibration feature (112) of the teach tool (102); andcalculating a location of the geometrical calibration feature (112) of the teach tool (102). - The method of claim 1, further comprising calculating a distance to the location of the geometrical calibration feature (112) of the teach tool (102) based upon a location of the first (134) and second engagement edge (136).
- The method of claim 1, further comprising receiving the teach tool (102) in a sample tube receptacle (106) of a sample rack (105), the sample tube receptacle being adapted to receive a sample tube.
- The method of claim 1, further comprising providing the geometrical calibration feature (112) as a cylindrical post having a flat top surface.
- The method of claim 2, further comprising:positioning the light beam sensor (108) above a center location of the geometrical calibration feature (112) of the teach tool (102) determined by calculation; andmoving a light beam (108C) of the light beam sensor (108) vertically until an upper engagement edge of a vertical geometrical calibration feature (112A) of the teach tool (102) is engaged by the light beam (108C).
- The method of claim 5, wherein the vertical geometrical calibration feature (112A) of the teach tool (102) is a flat surface on a top of a cylindrical post.
- The method of claim 1, further comprising:rotating the teach tool(102); andscanning the teach tool (102) to determine a rotational orientation of the teach tool(102).
- The method of claim 7, further comprising:
scanning a bar code on the teach tool (102) with a bar code reader (132) wherein a position of a rotational geometrical calibration feature (124) is determined based upon a scanned determination of a geometrical feature of the bar code. - The method of claim 1, further comprising:moving the light beam sensor (108) into vertical alignment with a rotational geometrical calibration feature (124) of the teach tool (102); androtating the light beam sensor (108) relative to the rotational geometrical feature (124).
- The method of claim 9, further comprising:
recording one or more rotational positions of an interference of a light beam (108C) of the light beam sensor (108) with one or more engagement ends of the rotational geometrical calibration feature (124). - A robot calibration system, comprising:robotic component (103) having an end effector (104) with end effector fingers (104A, 104B) adapted for grasping a teach tool (102);a light beam sensor (108) provided in a fixed orientation to the end effector fingers (104A, 104B) ;a teach tool (102) coupled to an article (105) at a first location, the teach tool (102) including a geometrical calibration feature (112); anda controller (110) adapted to command a robotic component (103) to position a light beam (108C) of the light beam sensor (108) around the geometrical calibration feature (112)of the teach tool (102) and calculate a position of a center of the geometrical calibration feature (112)based upon edge interferences between the geometrical calibration feature (112) and the light beam (108C) characterized in thatthe teach tool (102) includes a vertical geometrical feature (112A), and the controller (110) is adapted to move the light beam (108C) emitted from the light beam sensor (108) vertically relative to the vertical geometrical feature (112A) for determining a height dimension of the vertical geometrical feature (112A) upon contact of the light beam (108C) with the vertical geometrical feature (112A).
- The robot calibration system of claim 11, wherein the teach tool (102) includes a rotational geometrical feature (124) and the controller (110) is adapted to rotate the light beam (108C) of the light beam sensor (108) relative to the rotational geometrical feature (124) of the teach tool (102) for determining a rotational orientation of the rotational geometrical feature (124) by contact of the light beam sensor (108) with the rotational geometrical feature (124).
- The robot calibration system of claim 11, comprising a bar code on the teach tool (102) having a defined location relative to the rotational geometrical feature (124).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161454069P | 2011-03-18 | 2011-03-18 | |
PCT/US2012/029501 WO2012129110A1 (en) | 2011-03-18 | 2012-03-16 | Methods, systems, and apparatus for calibration of an orientation between and end effector and an article |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2659316A1 EP2659316A1 (en) | 2013-11-06 |
EP2659316A4 EP2659316A4 (en) | 2015-10-07 |
EP2659316B1 true EP2659316B1 (en) | 2019-10-02 |
Family
ID=46879693
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12760915.4A Active EP2659316B1 (en) | 2011-03-18 | 2012-03-16 | Methods, systems, and apparatus for calibration of an orientation between an end effector and an article |
Country Status (3)
Country | Link |
---|---|
US (1) | US9310791B2 (en) |
EP (1) | EP2659316B1 (en) |
WO (1) | WO2012129110A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102019215799A1 (en) * | 2019-10-15 | 2021-04-15 | Carl Zeiss Smt Gmbh | Method for calibrating a sensor and device for calibrating a sensor |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9791466B2 (en) | 2011-07-21 | 2017-10-17 | Brooks Automation, Inc. | Method and device for compensation for dimensional variations in low temperature sample group holders |
WO2014099104A1 (en) | 2012-12-21 | 2014-06-26 | Beckman Coulter, Inc. | System and method for laser-based auto-alignment |
US9724795B2 (en) * | 2013-11-07 | 2017-08-08 | Apex Brands, Inc. | Tooling system with visual identification of attached component |
US9731392B2 (en) * | 2014-08-05 | 2017-08-15 | Ati Industrial Automation, Inc. | Robotic tool changer alignment modules |
WO2016133915A1 (en) * | 2015-02-17 | 2016-08-25 | Siemens Healthcare Diagnostics Inc. | Classification of barcode tag conditions from top view sample tube images for laboratory automation |
US20170007853A1 (en) * | 2015-07-10 | 2017-01-12 | Medtronic, Inc. | Physiological monitoring for ultrasound therapy |
US10456925B2 (en) | 2015-10-30 | 2019-10-29 | Thermo Fisher Scientific Oy | Gripper finger and gripper |
JP6805323B2 (en) * | 2016-07-14 | 2020-12-23 | シーメンス・ヘルスケア・ダイアグノスティックス・インコーポレーテッドSiemens Healthcare Diagnostics Inc. | Methods and devices for calibrating the orientation between the robot gripper and its components |
KR102586862B1 (en) | 2016-10-28 | 2023-10-11 | 베크만 컬터, 인코포레이티드 | Material Readiness Assessment System |
EP3367102A1 (en) * | 2017-02-23 | 2018-08-29 | Roche Diagnostics GmbH | Gripping device and sample container processing system |
CN106926261B (en) * | 2017-04-25 | 2024-02-02 | 东莞台一盈拓科技股份有限公司 | Relative position measuring instrument |
US11226390B2 (en) * | 2017-08-28 | 2022-01-18 | Teradyne, Inc. | Calibration process for an automated test system |
SG11202108522TA (en) | 2019-02-08 | 2021-09-29 | Yaskawa America Inc | Through-beam auto teaching |
US11820006B2 (en) * | 2019-09-27 | 2023-11-21 | Abb Schweiz Ag | Apparatus and method for calibrating laser displacement sensor for use with robot |
WO2021157117A1 (en) * | 2020-02-06 | 2021-08-12 | 村田機械株式会社 | Clamping device and stacking device |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4260187A (en) * | 1979-03-23 | 1981-04-07 | Nasa | Terminal guidance sensor system |
JPS59353B2 (en) * | 1980-07-24 | 1984-01-06 | ファナック株式会社 | gripping device |
USH65H (en) * | 1983-05-27 | 1986-05-06 | At&T Bell Laboratories | Dynamic optical sensing: Robotic system and manufacturing method utilizing same |
US4849643A (en) * | 1987-09-18 | 1989-07-18 | Eaton Leonard Technologies | Optical probe with overlapping detection fields |
US5177563A (en) * | 1989-02-01 | 1993-01-05 | Texas A&M University System | Method and apparatus for locating physical objects |
US6934606B1 (en) * | 2003-06-20 | 2005-08-23 | Novellus Systems, Inc. | Automatic calibration of a wafer-handling robot |
US7319920B2 (en) * | 2003-11-10 | 2008-01-15 | Applied Materials, Inc. | Method and apparatus for self-calibration of a substrate handling robot |
US7490398B1 (en) | 2006-02-22 | 2009-02-17 | Western Digital Technologies, Inc. | Methods for assembling a disk drive using robotic end effector |
JP5417343B2 (en) | 2007-12-27 | 2014-02-12 | ラム リサーチ コーポレーション | System and method for calibrating an end effector alignment using at least one light source |
US8242730B2 (en) * | 2008-06-10 | 2012-08-14 | Nichols Michael J | Automated robot teach tool and method of use |
US8170271B2 (en) * | 2008-06-25 | 2012-05-01 | Jadak Llc | System and method for test tube and cap identification |
US8321055B2 (en) * | 2009-11-03 | 2012-11-27 | Jadak, Llc | System and method for multiple view machine vision target location |
US8116902B2 (en) * | 2010-02-26 | 2012-02-14 | National Formosa University | Method of detecting a dynamic path of a five-axis machine tool and dectecting assembly for the same |
-
2012
- 2012-03-16 EP EP12760915.4A patent/EP2659316B1/en active Active
- 2012-03-16 US US14/004,859 patent/US9310791B2/en active Active
- 2012-03-16 WO PCT/US2012/029501 patent/WO2012129110A1/en active Application Filing
Non-Patent Citations (1)
Title |
---|
None * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102019215799A1 (en) * | 2019-10-15 | 2021-04-15 | Carl Zeiss Smt Gmbh | Method for calibrating a sensor and device for calibrating a sensor |
Also Published As
Publication number | Publication date |
---|---|
EP2659316A4 (en) | 2015-10-07 |
US9310791B2 (en) | 2016-04-12 |
US20140005829A1 (en) | 2014-01-02 |
EP2659316A1 (en) | 2013-11-06 |
WO2012129110A1 (en) | 2012-09-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2659316B1 (en) | Methods, systems, and apparatus for calibration of an orientation between an end effector and an article | |
US9110457B2 (en) | Methods, systems, and apparatus for calibration of a positional offset between an end effector and a position sensor | |
EP2658958B1 (en) | Methods and systems for calibration of a positional orientation between a sample container and nozzle tip | |
US5783834A (en) | Method and process for automatic training of precise spatial locations to a robot | |
EP3484676B1 (en) | Methods and apparatus to calibrate a positional orientation between a robot gripper and a component | |
CN100431806C (en) | Wafer position teaching method and teaching jig | |
US6592324B2 (en) | Gripper mechanism | |
US20190160666A1 (en) | Methods and apparatus for dynamic position adjustments of a robot gripper based on sample rack imaging data | |
WO2013023130A1 (en) | Methods and apparatus to calibrate an orientation between a robot gripper and a camera | |
US8112177B2 (en) | Wafer position teaching method and teaching tool | |
US7264432B2 (en) | Device and method for transferring objects | |
US20180361587A1 (en) | Calibrating A System With A Conveying Means And At Least One Robot | |
JP2005031087A5 (en) | ||
US20230033463A1 (en) | Labware transport robot | |
Ali et al. | Arm grasping for mobile robot transportation using Kinect sensor and kinematic analysis | |
WO2022174240A1 (en) | Apparatus and methods for aligning a robotic arm with a sample tube carrier | |
US20230158684A1 (en) | Automated Work-holding for Precise Fastening of Light Parts during Automated Transfer | |
WO2024063857A1 (en) | Automated work-holding for precise fastening of light parts during automated transfer |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130730 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01B 11/00 20060101ALI20150515BHEP Ipc: G01B 11/27 20060101ALI20150515BHEP Ipc: B25J 9/16 20060101ALN20150515BHEP Ipc: B25J 19/02 20060101ALN20150515BHEP Ipc: G05B 19/04 20060101AFI20150515BHEP Ipc: G01B 11/04 20060101ALI20150515BHEP |
|
RA4 | Supplementary search report drawn up and despatched (corrected) |
Effective date: 20150908 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G05B 19/04 20060101AFI20150902BHEP Ipc: G01B 11/04 20060101ALI20150902BHEP Ipc: G01B 11/27 20060101ALI20150902BHEP Ipc: B25J 19/02 20060101ALN20150902BHEP Ipc: G01B 11/00 20060101ALI20150902BHEP Ipc: B25J 9/16 20060101ALN20150902BHEP |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20170816 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01B 11/00 20060101ALI20190404BHEP Ipc: B25J 19/02 20060101ALN20190404BHEP Ipc: G01B 11/27 20060101ALI20190404BHEP Ipc: B25J 9/16 20060101ALN20190404BHEP Ipc: G01B 11/04 20060101ALI20190404BHEP Ipc: G05B 19/04 20060101AFI20190404BHEP |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01B 11/27 20060101ALI20190410BHEP Ipc: G05B 19/04 20060101AFI20190410BHEP Ipc: G01B 11/00 20060101ALI20190410BHEP Ipc: B25J 19/02 20060101ALN20190410BHEP Ipc: G01B 11/04 20060101ALI20190410BHEP Ipc: B25J 9/16 20060101ALN20190410BHEP |
|
INTG | Intention to grant announced |
Effective date: 20190426 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SIEMENS HEALTHCARE DIAGNOSTICS INC. |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP Ref country code: AT Ref legal event code: REF Ref document number: 1186881 Country of ref document: AT Kind code of ref document: T Effective date: 20191015 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602012064538 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20191002 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1186881 Country of ref document: AT Kind code of ref document: T Effective date: 20191002 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200203 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200102 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200102 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200103 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200224 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602012064538 Country of ref document: DE |
|
PG2D | Information on lapse in contracting state deleted |
Ref country code: IS |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200202 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 |
|
26N | No opposition filed |
Effective date: 20200703 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20200331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200316 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200331 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200331 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200331 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200316 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200331 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20200316 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200316 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191002 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240517 Year of fee payment: 13 |