EP3495769B1 - Surveying device, and calibration method and calibration program for surveying device - Google Patents
Surveying device, and calibration method and calibration program for surveying device Download PDFInfo
- Publication number
- EP3495769B1 EP3495769B1 EP18206442.8A EP18206442A EP3495769B1 EP 3495769 B1 EP3495769 B1 EP 3495769B1 EP 18206442 A EP18206442 A EP 18206442A EP 3495769 B1 EP3495769 B1 EP 3495769B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- laser
- plane
- points
- scanning
- positioning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 31
- 238000000926 separation method Methods 0.000 claims description 63
- 230000003287 optical effect Effects 0.000 claims description 41
- 238000012545 processing Methods 0.000 description 17
- 230000008569 process Effects 0.000 description 15
- 238000003384 imaging method Methods 0.000 description 8
- 238000005259 measurement Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000001681 protective effect Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 3
- 239000013598 vector Substances 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000017105 transposition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C15/00—Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
- G01C15/002—Active optical surveying means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C25/00—Manufacturing, calibrating, cleaning, or repairing instruments or devices referred to in the other groups of this subclass
Definitions
- the present invention relates to a technique for calibrating a surveying device.
- a publicly known surveying device may include a total station (TS).
- TS total station
- a TS is disclosed in Japanese Unexamined Patent Applications Laid-Open Nos. 2009-229192 and 2012-202821 , for example.
- a laser scanner that performs high-speed laser scanning by rotating an optical system is publicly known.
- Such a laser scanner is disclosed in U.S. Patent No. 8767190 , for example.
- Another publicly known laser scanner performs electronic control of a scanning direction. This laser scanner is disclosed in U.S. Patent Application Publication No. 2015/0293224 , for example.
- the TS has a laser distance measuring function, which is known as being useable to make the TS also useable as a laser scanner.
- This laser scanner performs laser scanning in laser distance measurement with respect to each point, while an optical system of the TS moves vertically and laterally. This method is simple and easy, but is inferior to a dedicated laser scanner in scanning speed and scanning resolution.
- the laser scanner can perform high-speed scanning but has a positioning accuracy for each of the scanned points inferior to that of a laser positioning function of a TS. This is due to high speed scanning of the dedicated laser scanner. That is, a timing of measuring a distance by using laser distance measuring light differs from a timing of measuring an emitting direction of the laser distance measuring light, and this difference generates a measurement error and decreases positioning accuracy.
- a highly accurate laser distance measuring unit of the TS and the function to make the TS useable as the laser scanner are separated as independent units and are combined together.
- the position of optical origin of the highly accurate laser distance measuring unit is physically separated from the position of optical origin of a unit having the separated function for the laser scanner.
- the separated amount is preliminarily set as an offset value at the time of designing in order to enable correction of positioning data, but this is not sufficient, and calibration is required after the product is completed.
- calibration is performed at the time a product is shipped.
- the calibration can also be performed as a service of a manufacturer or a maintenance company after sale.
- the calibration requires a dedicated apparatus and complicated operation.
- the calibration described above is normally performed in presupposed specific circumstances, and therefore, the calibrated condition may not be appropriate in actual surveying circumstances. Moreover, the calibrated condition can change over time. For these reasons, the calibration should be performed regularly or be performed before use.
- EP 2 620 745 A1 discloses a surveying system comprising a surveying device and a scanning module with fastening means for fastening the scanning module on a recording and with a motorized beam deflecting element that can be rotated around an axis of rotation for deflecting a scan laser beam, wherein the axis of rotation is arranged in a defined angle relative to a swivel axis, and with a second angle measuring functionality for the determination of a rotation angle from an angular position of the beam deflection element.
- the surveying device further comprises a measuring device constructed in such a way that the scan module can be connected to the fasteners on the surveying instrument in a defined position.
- JP 2013-190272 A discloses a three-dimensional measuring apparatus that is configured by combining an electro-optical distance meter and a laser scanner.
- the coordinates of a mechanical point are acquired by the electro-optical distance meter, a measuring target is scanned from the mechanical point by the laser scanner and the coordinates of respective measurement points included in the measuring target are calculated based on data acquired by the electro-optical distance meter and the laser scanner.
- XP055707513 discloses to determine a plane from laser scanner point cloud data, and to use at least three points obtained from a total station in order to validate the plane as determined from the laser scanner point cloud data.
- an object of the present invention is to provide a technique that enables calibration of a TS having a laser scanner at a surveying site or at other sites.
- An aspect of the present invention provides a surveying device including an optical system, a laser positioning part, a plane determining part, a laser scanner, a separation amount calculator, and an exterior orientation parameter calculator.
- the optical system is used for sighting a positioning target.
- the laser positioning part emits laser light via the optical system to the positioning target to position the positioning target.
- the plane determining part determines a location of a specific plane on the basis of a result of the positioning performed by the laser positioning part.
- the laser scanner performs laser scanning of the specific plane to obtain multiple scanning points.
- the separation amount calculator calculates a separation amount of the respective multiple scanning points obtained by the laser scanner, from the specific plane of which the location is determined by the plane determining part.
- the exterior orientation parameter calculator calculates exterior orientation parameters of one or both of the laser positioning part and the laser scanner on the basis of the calculated separation amount.
- the laser positioning part positions three or more points on the specific plane to determine the location of the specific plane.
- a surveying device including an optical system, a laser positioning part, a plane determining part, a laser scanner, a separation amount calculator, and an appropriateness judging part.
- the optical system is used for sighting a positioning target.
- the laser positioning part emits laser light via the optical system to the positioning target to position the positioning target.
- the plane determining part determines a location of a specific plane on the basis of a result of the positioning performed by the laser positioning part.
- the laser scanner performs laser scanning of the specific plane to obtain multiple scanning points.
- the separation amount calculator calculates a separation amount of the respective multiple scanning points obtained by the laser scanner, from the specific plane of which the location is determined by the plane determining part.
- the appropriateness judging part judges an appropriateness of a calibrated condition relating to exterior orientation parameters of the laser positioning part and the laser scanner, on the basis of the calculated separation amount.
- the laser positioning part positions three or more points on the specific plane to determine the location of the specific plane.
- a distribution area of the three or more points and a laser scanning area of the laser scanner preferably overlap.
- the laser scanning area of the laser scanner is preferably set within the distribution area of the three or more points.
- the surveying device preferably further includes a noise eliminating part that calculates a fitting plane to which the multiple scanning points fit, and the noise eliminating part eliminates a scanning point, of which a separation amount from a fitting plane is a specified value or greater, as a noise point from among the multiple scanning points.
- the separation amount is preferably a distance between the specific plane, of which the location is identified by the plane determining part, and the fitting plane that fits to the multiple scanning points obtained by the laser scanner.
- Yet another aspect of the present invention provides a calibration method of a surveying device.
- the method includes determining a location of a specific plane by positioning three or more points on the specific plane by using a laser positioning part, and performing laser scanning of the specific plane by a laser scanner to obtain multiple scanning points.
- the method also includes calculating a separation amount of the respective multiple scanning points obtained by the laser scanning, from the specific plane of which the location is determined, and calculating exterior orientation parameters of one or both of the laser positioning part and the laser scanner on the basis of the separation amount.
- Yet another aspect of the present invention provides a non-transitory computer recording medium storing computer executable instructions for calibrating a surveying device.
- the computer executable instructions when executed by a computer processor, cause the computer processor to determine a location of a specific plane by positioning three or more points on the specific plane by using a laser positioning part, and perform laser scanning of the specific plane by a laser scanner to obtain multiple scanning points.
- the computer executable instructions also cause the computer processor to calculate a separation amount of the respective multiple scanning points obtained by the laser scanning, from the specific plane of which the location is determined, and calculate exterior orientation parameters of one or both of the laser positioning part and the laser scanner on a basis of the separation amount.
- the present invention provides a technique that enables check of a calibrated condition of a TS having a laser scanner at a surveying site or at other sites.
- Fig. 1 shows a perspective view of a total station (TS) 100 having a laser scanner and using the present invention.
- Fig. 2 shows a front view of the TS 100.
- the TS 100 has the same functions as those of an ordinary TS, except that the TS 100 has a laser scanner 109 and has a function of performing a processing relating to calibration of a positioning function of the TS 100 and calibration of the laser scanner 109.
- the laser scanner 109 is described later.
- the positioning function of the TS 100 is performed by a laser positioning part 200, which is described later.
- a detailed structure of a TS is disclosed in Japanese Unexamined Patent Applications Laid-Open Nos. 2009-229192 and 2012-202821 , for example.
- the TS 100 has a main body 150 and a laser scanner 109 in a composite manner.
- the TS 100 has a main unit 11 that is held in a horizontally rotatable manner by a base 12.
- the base 12 may be fixed on a top of a tripod (not shown).
- the main unit 11 has an approximately U-shape with two extending parts that extend upwardly as viewed from a Y-axis direction.
- the main unit 11 also has a movable part 13 that is held between the two extending parts so as to be controllable in a vertical angle.
- the vertical angle is composed of an elevation angle and a depression angle.
- the main unit 11 is rotated relative to the base 12 by a motor. That is, the horizontal rotation angle of the main unit 11 relative to the base 12 is controlled by the motor.
- the vertical angle of the movable part 13 is also controlled by a motor.
- Driving to control the horizontal rotation angle and the vertical angle is performed by a vertical and horizontal rotation driving unit 106 that is incorporated in the main unit 11.
- the vertical and horizontal rotation driving unit 106 is shown in the block diagram in Fig. 3 .
- the main unit 11 has a horizontal rotation angle controlling dial 14a and a vertical angle controlling dial 14b arranged thereon.
- the horizontal rotation angle controlling dial 14a is operated to adjust the horizontal rotation angle of the main unit 11 and the movable part 13.
- the vertical angle controlling dial 14b is operated to adjust the vertical angle of the movable part 13.
- the movable part 13 has a rectangular cylindrical sighting unit 15a for approximate sighting, arranged on a top thereof.
- the movable part 13 also has an optical sighting unit 15b with a visual field narrower than that of the sighting unit 15a and has a telescope 16 that can be collimated at a high accuracy.
- the telescope 16 also serves as an optical system for distance measuring laser light and for tracking light.
- the tracking light is used to track and capture an object of which a distance is to be measured.
- An example of the object includes a target using a dedicated reflective prism.
- the distance measuring laser light is abbreviated as "distance measuring light” hereinafter.
- the optical system is designed so that the optical axes of the distance measuring light and the tracking light will coincide with an optical axis of the telescope 16.
- the structure of this part is the same as that of a commercially available TS.
- the main unit 11 has displays 18 and 19 attached thereto.
- the display 18 is integrated with a controller 101.
- the controller 101 has a numeric keypad, a cross operation button, and other operation parts arranged thereon, which are used to perform various operations relating to the TS 100 and input data.
- the displays 18 and 19 display various pieces of information necessary to operate the TS 100, surveying data, and other information. These two displays are mounted in order to enable viewing the display from either the front side or the back side without having to rotate the main unit 11.
- the main unit 11 has the laser scanner 109 that is fixed on a top.
- the laser scanner 109 has a first column 301 and a second column 302.
- the first column 301 and the second column 302 are connected by a connecting part 303.
- the space over the connecting part 303 between the first column 301 and the second column 302 is covered with a protective case 304.
- the protective case 304 is made of a member that transmits laser scanning light.
- the protective case 304 houses a rotating part 305 that protrudes from the first column 301 in an X-axis direction. An end of the rotating part 305 is obliquely cut off, and this end has a tilt mirror 306 fixed thereon.
- the rotating part 305 is driven to be rotated around the X-axis by a motor contained in the first column 301.
- the first column 301 contains, in addition to the motor, a driving circuit for driving the motor, a control circuit for the driving circuit, a sensor for measuring a rotation angle of the rotating part 305, and a peripheral circuit of the sensor.
- the second column 302 contains a light emitting part that generates multiple pulsed beams of laser scanning light, a light receiving part that receives laser scanning light reflected back from an object, an optical system for the light emitting part and the light receiving part, and a distance calculator that calculates a distance to a scanning point.
- the laser scanner 109 further contains a scanning-point location calculator that calculates three-dimensional coordinates of a scanning point on the basis of a rotation angle of the rotating part 305, a horizontal rotation angle of the main unit 11, and a distance to the scanning point from the main unit 11.
- the laser scanning light is emitted from an inside of the second column 302 to the tilt mirror 306 and is reflected thereat to exit to the outside via the transparent protective case 304.
- the laser scanning light that is reflected back from an object reverses the path of the emitted light and is received by the light receiving part in the second column 302.
- the point that reflects the laser scanning light is positioned as a scanning point by referring to a light emission timing and a light reception timing of the laser scanning light as well as a rotation angle of the rotating part 305 and a horizontal rotation angle of the main unit 11 at each of these timings.
- the principle of the positioning is the same as that for the laser positioning part 200, which is described later.
- the multiple pulsed beams of the laser scanning light are intermittently emitted from the transparent protective case 304 to the outside, in a fan shape with an expansion angle of approximately 20 to 45 degrees along an extending direction of the rotation axis of the rotating part 305.
- the laser scanning light is emitted while the rotating part 305 rotates.
- the fan-shaped laser scanning light with a width of some degree in the X-axis direction is emitted from the laser scanner 109 while scanning around the X-axis.
- the laser scanning light is emitted while the main unit 11 is horizontally rotated around a Z-axis.
- the laser scanning light may be composed of one pulsed beam, and laser scanning may be performed along a vertical plane including the optical axis of the telescope 16.
- the technique relating to the laser scanner is disclosed in Japanese Unexamined Patent Applications Laid-Open Nos. 2010-151682 and 2008-268004 and U.S. Patent No. 8767190 , for example.
- the laser scanner can be one that electronically performs scanning, as disclosed in U.S. Patent Application Publication No. 2015/0293224 .
- Fig. 3 shows a block diagram of the TS 100.
- the basic functions of the TS 100 as a total station are the same as those of an existing total station.
- the TS 100 differs from an existing total station in that the TS 100 is combined with the independent laser scanner 109 and in that the TS 100 has a function of performing calibration between the combined laser scanner 109 and the positioning function of the TS 100.
- the positioning function of the TS 100 is performed by the laser positioning part 200.
- the TS 100 includes a controller 101, an imaging unit 102, displays 18 and 19, a laser positioning part 200, a laser scanner 109, a calibration processing part 110, a calibrated condition appropriateness judging unit 117, a movement controlling unit 121, a storage 122, and an optical system 201.
- the laser positioning part 200 performs positioning that is a function originally provided to a TS.
- the laser positioning part 200 includes a distance-measuring-light emitting unit 104, a distance-measuring-light receiving unit 105, a vertical and horizontal rotation driving unit 106, a vertical and horizontal rotation angle measuring unit 107, and a three-dimensional location calculator 108.
- the optical system 201 includes the sighting unit 15b (refer to Fig. 2 ), the telescope 16 (refer to Fig. 2 ), an optical system of the laser positioning part 200, an optical system of the imaging unit 102, and an optical system containing a light path of tracking light (not shown).
- the optical system 201 is configured in a similar manner as in an ordinary TS and includes various types of lenses, a mirror, a dichroic mirror for separating and combining light paths, a half-mirror, a polarizing mirror, or other parts.
- the distance measuring light emitted from the distance-measuring-light emitting unit 104 passes through the telescope 16 and reaches an object to be positioned, and the distance measuring light is reflected back from the object through the telescope 16 and is received by the distance-measuring-light receiving unit 105.
- the optical system 201 conducts an image captured by the telescope 16, to the eyepiece 17 and to the imaging unit 102.
- the TS 100 also includes a tracking light emitting unit, a tracking light receiving unit, and a track controlling unit.
- the tracking light emitting unit emits tracking light for tracking a target such as a reflective prism.
- the tracking light receiving unit receives the tracking light that is reflected back from the target.
- the track controlling unit outputs a control signal to the vertical and horizontal rotation driving unit 106 so that the tracking light will be captured at a collimation position in a visual field of the telescope 16.
- the controller 101 receives contents of operation of the TS 100 input by an operator.
- the TS 100 is operated through a button switch or other operation parts of the TS 100.
- a tablet or a smartphone can also be used as a controller.
- dedicated application software may be installed in a tablet or a smartphone to make the tablet or the smartphone function as a control means of the TS 100.
- the imaging unit 102 images an image captured by the telescope 16.
- the imaging is performed by, for example, a CCD imaging sensor or a CMOS imaging sensor.
- the displays 18 and 19 display images imaged by the imaging unit 102, information necessary to operate the TS 100, information relating to movement of the TS 100 such as distance measuring data and direction of a target, and other information.
- Each of the displays 18 and 19 may use a liquid crystal display, an electroluminescent (EL) display, or other display.
- the displays 18 and 19 also display a 3D image formed of point cloud data obtained by the laser scanner 109.
- the 3D display of the point cloud data is disclosed in, for example, Japanese Patent Application No. 2016-173468 .
- the distance-measuring-light emitting unit 104 emits laser light for measuring a distance, which is referred to as distance measuring light in this embodiment.
- the distance measuring light passes through the telescope 16 in the same axis direction as the optical axis of the telescope 16.
- the distance-measuring-light receiving unit 105 receives the distance measuring light reflected back from an object through the telescope 16.
- the distance-measuring-light receiving unit 105 uses an optical measuring device such as a photodiode.
- the optical axis of the distance measuring light, which is emitted from the distance-measuring-light emitting unit 104, and the optical axis of the distance measuring light, which is reflected back from the object to the TS 100 and enters the distance-measuring-light receiving unit 105, are combined by using the optical system, such as the dichroic mirror, the half-mirror, and the polarizing mirror.
- the vertical and horizontal rotation driving unit 106 drives to horizontally rotate the main unit 11 and drives to vertically rotate the movable part 13.
- the vertical and horizontal rotation driving unit 106 includes a motor, a gear mechanism, and a driving circuit for performing these drivings.
- the vertical and horizontal rotation angle measuring unit 107 measures a horizontal rotation angle of the main unit 11 and measures a vertical angle of the movable part 13 in terms of an elevation angle and a depression angle.
- the measurement of the angles is performed by a rotary encoder.
- the horizontal rotation angle is measured, for example, in a clockwise direction starting from the direction of north as 0 degrees as viewed downwardly.
- the elevation angle is measured on the condition that an elevation direction starting from the horizontal direction as 0 degrees is a positive angle
- the depression angle is measured on the condition that a depression direction starting from the horizontal direction as 0 degrees is a negative angle.
- the three-dimensional location calculator 108 calculates values of three-dimensional coordinates of an object from a distance to the object and an emitting direction of the distance measuring light.
- the object is a target of which the distance is to be measured, such as a reflection point that reflects the distance measuring light.
- the distance is calculated on the basis of a time-of-flight of the distance measuring light from the distance-measuring-light emitting unit 104.
- the three-dimensional coordinates of the object of which the distance is to be measured is obtained in terms of values in a coordinate system having the origin at the TS 100. This coordinate system is referred as a "TS coordinate system" hereinafter.
- the TS 100 is installed at a location of which coordinates in an absolute coordinate system are known, and therefore, coordinates of location data obtained in the TS coordinate system can be converted into coordinates of the absolute coordinate system by performing parallel movement and, as necessary, by also performing rotation.
- the absolute coordinate system is a global coordinate system fixed relative to the ground.
- a GNSS normally uses an absolute coordinate system.
- a map is described in the absolute coordinate system.
- the absolute coordinate system uses, for example, longitude, latitude, and elevation above mean sea level to specify a location.
- the distance from the TS 100 to the object of which a distance is to be measured is calculated as follows.
- the TS 100 incorporates a reference light path with a known light path length for conducting light emitted from the distance-measuring-light emitting unit 104.
- the light from the distance-measuring-light emitting unit 104 is divided into two beams, and one beam advances from the telescope 16 through a light path connecting the telescope 16, a positioning point, the telescope 16, and the distance-measuring-light receiving unit 105, in this order, whereas the other beam advances from the reference light path to the distance-measuring-light receiving unit 105.
- the distance measuring light is pulsed light, and therefore, the one beam of the distance measuring light advancing through the light path and the other beam of the distance measuring light advancing the other light path are received at different timings by the distance-measuring-light receiving unit 105. This generates a phase difference between waveforms that are measured by the distance-measuring-light receiving unit 105. The phase difference is used to calculate the distance to the reflection point.
- the direction of the reflection point that reflects the distance measuring light is obtained in terms of angle by the vertical and horizontal rotation angle measuring unit 107.
- the distance and direction determined provides a three-dimensional location of the reflection point that reflects the distance measuring light.
- the three-dimensional location is represented by using the TS 100 as reference or the origin. This process is performed by the three-dimensional location calculator 108.
- the laser positioning part 200 measures the location of the positioning point.
- the laser scanner 109 obtains scanning points that are scanned by means of laser scanning, that is, obtains point cloud data that contains laser scanning point clouds obtained by means of laser scanning.
- the range of the laser scanning can be set as desired.
- the calibration processing part 110 performs calibration relating to exterior orientation parameters (location and direction) between the laser positioning part 200 and the laser scanner 109.
- the calibration is performed to correct a dislocation from an initial calibrated condition.
- the calibration is performed as follows: data of location, which is positioned using a plane by the laser positioning part 200, and the point cloud data, which is obtained by the laser scanner 109, are compared to evaluate a dislocation, and exterior orientation parameters of the laser scanner 109 are adjusted so that the dislocation will be minimum.
- the calibration processing part 110 is an arithmetic proceeding part that functions as a computer.
- the calibration processing part 110 includes a positioning-point location data acquiring unit 111, a scanning data acquiring unit 112, a noise eliminating unit 113, a plane equation calculator 114, a separation amount calculator 115, and an exterior orientation parameter calculator 116.
- Each of these functional units may be embodied by a dedicated integrated circuit using an ASIC, FPGA, or other component or may be implemented by causing a CPU to execute a program.
- the calibration processing part 110 may be embodied by combining a microcomputer and a dedicated arithmetic circuit.
- the calibration processing part 110 may also be embodied by using a personal computer (PC) connected to the outside.
- PC personal computer
- the positioning-point location data acquiring unit 111 acquires location data of points positioned by the laser positioning part 200.
- the laser positioning part 200 is used to position three or more points on a target planar plane, and the positioning-point location data acquiring unit 111 acquires data of locations of the positioned three or more points.
- the scanning data acquiring unit 112 acquires location data of scanning points that are obtained by the laser scanner 109.
- laser scanning is performed on the same target plane as the positioning-point location data acquiring unit 111, and the resultant data of the laser scanning is acquired by the scanning data acquiring unit 112.
- the plane to be targeted by the positioning-point location data acquiring unit 111 is referred as a "first plane".
- the center of an area of the laser scanning is made to coincide with the center of the first plane with the most possible accuracy.
- the center of the first plane is set at the center of gravity of the three or more positioning points that are used for obtaining the first plane.
- the scanning area is set inside a distribution area of the positioning points that are used for determining the first plane.
- Fig. 4 illustrates a situation of using one plane of a cubic object 300, which is prepared as a target for calibration, as a target plane 301 for calibration serving as the first plane.
- the distribution area of multiple positioning points used to obtain the first plane and the scanning area of the laser scanner 109 shall be at least partially overlapped.
- a plane that is close to a complete flat plane as much as possible is selected as the target plane 301 for the calibration.
- the noise eliminating unit 113 eliminates noise points from among the multiple scanning points obtained by the laser scanner 109.
- the elimination of a noise point is performed as described below.
- multiple scanning points of a scanning point cloud are obtained as targets.
- a plane equation that fits to the obtained scanning point cloud is calculated, and a plane is obtained.
- a distance of each of the scanning points from the obtained plane is calculated in terms of absolute value.
- a distance in a direction perpendicular to the plane is calculated.
- the scanning point with the distance of a threshold value or greater is eliminated as noise.
- the threshold value is set in consideration of the accuracy of the laser scanner 109. For example, in a case in which the laser scanner 109 has a distance measuring accuracy of 5 mm, the threshold value is set at 2.5 mm.
- the plane equation calculator 114 calculates a plane equation that fits to the three or more points, on the basis of the location data of the three or more points acquired by the positioning-point location data acquiring unit 111.
- the coordinate values of the three more points are substituted into the general formula, and simultaneous equations are solved, whereby a plane equation of a plane containing the three or more points is obtained.
- This plane equation is described in a TS coordinate system.
- a plane equation is calculated so that an integrated value of separation amounts of the positioning points from the plane will be minimum.
- a point that is not contained in a plane may be ignored, and a plane equation may be calculated by using only positioning points that exist on the plane.
- the separation amount calculator 115 calculates a separation amount of the scanning point, which is acquired by the scanning data acquiring unit 112, from the plane calculated by the plane equation calculator 114.
- the separation amount is represented by a distance in terms of absolute value.
- the calculation may use all or some of the scanning points that are obtained from the scanning data. However, using a greater number of the scanning points enables increasing final accuracy.
- the separation amount is obtained by measuring a length of a perpendicular to the plane, of the scanning point, that is, by measuring a distance in a direction perpendicular to the plane between the scanning point and the plane.
- Fig. 5 illustrates a distance dn between a scanning point n (n is a natural number of 1, 2, 3, 4, ...) and a plane, which is calculated by the plane equation calculator 114.
- the distance dn represents the separation amount of each of the scanning points from the plane, which is calculated by the plane equation calculator 114.
- This plane is a target plane for the calibration determined on the basis of the positioning data from the laser positioning part 200.
- the exterior orientation parameter calculator 116 adjusts values of the exterior orientation parameters (location and attitude) of the laser scanner 109 so that the separation amount dn, which is calculated by the separation amount calculator 115, will be minimum.
- the following describes an example of a process performed by the exterior orientation parameter calculator 116.
- initial values of the exterior orientation parameters of the laser scanner 109 are represented as Pos_scan(Pos_x, Pos_y, Pos_z) and Att_scan(roll, pitch, yaw).
- the initial value (Pos_scan) represents a location of the laser scanner 109, or more exactly, a location of an optical origin of the laser scanner 109.
- the initial value (Att_scan) represents an attitude (direction) of the laser scanner 109.
- the initial values (Posscan, Att scan) are described in the TS coordinate system having the origin at an optical origin of the laser positioning part 200. Current values, that is, values that are obtained in the calibration process performed before, are used for the initial values (Pos scan, Att_scan).
- correction amounts from the initial values are represented as ( ⁇ Pos_x, ⁇ Pos_y, ⁇ Pos_z, ⁇ roll, ⁇ pitch, ⁇ yaw) as unknown parameters.
- ⁇ P a separation amount of one of the scanning points, from a plane determined on the basis of the result of positioning performed by the laser positioning part 200.
- ⁇ P Px Py Pz J ⁇ Pos _ x , ⁇ Pos _ y , ⁇ Pos _ z , ⁇ roll , ⁇ pitch , ⁇ yaw ⁇ T
- the separation amount ⁇ P is substituted into Fourth Formula, whereby a least square solution of x is obtained. Resultant values of ⁇ Pos_x, ⁇ Pos_y, ⁇ Pos_z, ⁇ roll, ⁇ pitch, and ⁇ yaw are added to the initial values (Pos_scan, Att scan), and the obtained values are used to recalculate point cloud data of the laser scanning data.
- the recalculated laser scanning data is used to recalculate the separation amount ⁇ P of each of the scanning points from the plane, which is calculated by the plane equation calculator 114.
- the recalculated separation amount ⁇ P is used to recalculate First Formula to Fourth Formula, to calculate the unknown parameters ( ⁇ Pos_x, ⁇ Pos_y, ⁇ Pos_z, ⁇ roll, ⁇ pitch, ⁇ yaw) again.
- the above calculation cycle is repeated until a predetermined convergence condition is satisfied, and optimal estimation values of the unknown parameters ( ⁇ Posx, ⁇ Pos_y, ⁇ Pos_z, ⁇ roll, ⁇ pitch, ⁇ yaw) are determined.
- the convergence condition is satisfied when the unknown parameters converge or when the separation amount ⁇ P becomes sufficiently small.
- the separation amount ⁇ P As variations in the values of the unknown parameters ( ⁇ Pos_x, ⁇ Pos_y, ⁇ Pos_z, ⁇ roll, ⁇ pitch, ⁇ yaw) become small or converge, the separation amount ⁇ P also converges to the minimum value.
- the exterior orientation parameters of the laser scanner 109 when the separation amount dn (refer to Fig. 5 ) of each of the scanning points is minimum, are calculated, and a more optimized relationship of the exterior orientation parameters between the laser positioning part 200 and the laser scanner 109 is obtained. That is, calibration relating to the exterior orientation parameters between the laser positioning part 200 and the laser scanner 109 is performed.
- Multiple planes having different normal directions are preferably used for calculation of the exterior orientation parameters. This is because a margin of error still exists in the relative relationship of parallel position between the laser positioning part 200 and the laser scanner 109 even when the plane, which is determined by the laser positioning part 200, coincides with the scanning data of the laser scanner 109. However, this margin of error is decreased by optimizing the exterior orientation parameters using multiple planes having different normal vectors.
- the above description exemplifies a case of calculating and optimizing the exterior orientation parameters of the laser scanner 109.
- exterior orientation parameters of the laser positioning part 200 including the optical system 201 may be corrected.
- both of the exterior orientation parameters of the laser positioning part 200 including the optical system 201 and the exterior orientation parameters of the laser scanner 109 may be corrected.
- An artificial structure such as a wall surface of a building, a plate member prepared as a target for the calibration, and a cubic structure as illustrated in Fig. 4 may be used to obtain the target plane.
- a structure with multiple planes having different normal vectors is preferable.
- an object that exists in nature may also be used to obtain the plane for the calibration. Note that, in a case in which the state of the plane is not known, an object having the most possible planarity should be selected as the target plane for the calibration.
- the calibrated condition appropriateness judging unit 117 judges the appropriateness of the calibrated condition relating to the laser positioning part 200 and the laser scanner 109. In a case in which the calibrated condition relating to the laser positioning part 200 and the laser scanner 109 is "appropriate", the exterior orientation parameters of both of the laser positioning part 200 and the laser scanner 109 are obtained at acceptable accuracies.
- the exterior orientation parameters of at least one of the laser positioning part 200 and the laser scanner 109 contain a margin of error at an unacceptable degree.
- problems will occur in matching and interchanging of data between the laser positioning part 200 and the laser scanner 109, resulting in generation of a range of error in integrated data of the laser positioning part 200 and the laser scanner 109 to an unacceptable degree.
- the exterior orientation parameters of both of the laser positioning part 200 and the laser scanner 109 and the relationship of the exterior orientation parameters between the laser positioning part 200 and the laser scanner 109 are determined in advance in a preliminary calibration process.
- various kinds of causes such as variation with time, may generate deviations from appropriate values and generate a range of error, in the values of the exterior orientation parameters of the laser scanner 109 relative to the laser positioning part 200.
- these various kinds of causes may generate a deviation from an appropriate value and generate a margin of error, in the relationship of the exterior orientation parameters between the laser positioning part 200 and the laser scanner 109.
- this margin of error is so great as to be not negligible, the calibrated condition relating to the laser positioning part 200 and the laser scanner 109 is in an inappropriate condition.
- the judgement of the appropriateness of the calibrated condition is performed by the calibrated condition appropriateness judging unit 117.
- the judgement of the appropriateness of the calibrated condition is performed on the basis of the separation amount, which is calculated by the separation amount calculator 115.
- the calibrated condition is judged as being “appropriate” if Edn/n is smaller than a predetermined threshold value, whereas the calibrated condition is judged as being “inappropriate” if Edn/n is the predetermined threshold value or greater.
- the threshold value serves as a criterion for the judgement and is set depending on an acceptable degree of range of error.
- the movement controlling unit 121 comprehensively controls the operation of the TS 100. For example, the control relating to a processing shown in Fig. 6 is performed by the movement controlling unit 121.
- the storage 122 stores information necessary to operate the TS 100, such as data and programs, and also stores surveying data obtained as a result of the operation of the TS 100.
- Fig. 6 is a flowchart showing an example of a processing procedure performed by the calibration processing part 110.
- Programs for executing the processing shown in Fig. 6 are stored in the storage 122 or an appropriate storage medium or both.
- the processing procedure is executed under control of the movement controlling unit 121.
- a calibration process using the target plane 301 for the calibration illustrated in Fig. 4 is exemplified below.
- positioning points 303 are positioned first by the laser positioning part 200, and the resultant data of the positioning is acquired by the positioning-point location data acquiring unit 111 (step S101).
- the positioning-point location data acquiring unit 111 In the case shown in Fig. 4 , six positioning points 303 are positioned. Coordinates of the positioning point 303 are described in the TS coordinate system, which is a three-dimensional coordinate system fixed relative to the TS 100.
- the operation for positioning the positioning point 303 is conducted by an operator by using the TS 100. At this time, the operator sights a point on the target plane 301 for the calibration, by viewing through the eyepiece 17. The operator selects six points on the target plane 301 as positioning points 303 and positions the selected positioning points 303.
- a plane that fits to the six positioning points 303 is determined (step S102). This process is performed by the plane equation calculator 114. This process performs calculation of a plane equation of a plane that fits to the six positioning points 303 in the TS coordinate system.
- laser scanning is performed on the target plane 301 for the calibration, by using the laser scanner 109, to obtain scanning data of the target plane 301 for the calibration.
- This scanning data is acquired by the scanning data acquiring unit 112 (step S103).
- step S104 a separation amount of the respective scanning points, which are contained in the scanning data obtained in step S103, from the plane, which is calculated in step S102, is calculated (step S104). This process is performed by the separation amount calculator 115.
- the exterior orientation parameters of the laser scanner 109 are calculated so that the separation amount will be minimum (step S105).
- This process is performed by the exterior orientation parameter calculator 116.
- the process in Fig. 6 performs optimization calculation of the exterior orientation parameters of the laser scanner 109 so that the separation amount will be minimum.
- This process is performed to correct the exterior orientation parameters of the laser scanner 109 relative to the laser positioning part 200.
- the exterior orientation parameters of the laser positioning part 200 may be calculated so that the separation amount will be minimum.
- the exterior orientation parameters of both of the laser positioning part 200 and the laser scanner 109 may be calculated so that the separation amount will be minimum.
- the separation amount of the scanning point, which is obtained by the laser scanner 109, from the plane, which is determined by using the function of the laser positioning part 200, may be calculated as described below. That is, assuming that the plane is referred as a "first plane", a plane that fits to the scanning point contained in the laser scanning data is calculated as a second plane, and a separation amount between the first plane and the second plane is calculated.
- the separation amount is calculated at a point on a grid set on the first plane or the second plane.
- the interval of the grid may be 1 to 30 cm, for example. Also in this modification example, it is preferable to use two or more planes that have different normal vectors.
- the appropriateness of the calibrated condition may be judged on the basis of the separation amount obtained in step S 104.
- the appropriateness of the calibrated condition between the laser positioning part 200 and the laser scanner 109 is judged by the calibrated condition appropriateness judging unit 117.
- the result of the judgment is shown on the displays 18 and 19. Additionally, in one example, the result of the judgment may be transmitted to the outside of the TS 100.
- a curved plane can also be used as the target plane for the calibration exemplified in Fig. 4 .
- a curved plane with known mathematical specification such as a curvature, is prepared as the target plane for the calibration.
- the mathematical structure of the target plane for the calibration is obtained in advance. For example, an equation of the curved plane and detailed numerical information are preliminarily obtained.
- multiple points that are necessary to identify the prepared target plane for the calibration are positioned by the laser positioning part 200, and the prepared target plane for the calibration that fits to the positioned points is identified.
- an indeterminate coefficient in a plane equation of the prepared target plane for the calibration is determined.
- the curved plane may be a spherical surface, an ellipsoid, a hyperboloid, a cylindrical surface, a conical surface, or any other curved surface.
- the exterior orientation parameters of the laser positioning part 200 can be corrected and be optimized by using the First Formula to Fourth Formula.
- the unknown parameters ( ⁇ Pos_x, ⁇ Pos_y, ⁇ Pos_z, ⁇ roll, ⁇ pitch, ⁇ yaw) of the laser positioning part 200 are calculated, the positioning points 303 and the plane equation are recalculated by using the calculated unknown parameters.
- the First Formula to Fourth Formula are calculated again. This cycle is repeated until a predetermined convergence condition is satisfied, and optimal values of the unknown parameters ( ⁇ Pos_x, ⁇ Pos_y, ⁇ Pos_z, ⁇ roll, ⁇ pitch, ⁇ yaw) relating to the laser positioning part 200 are determined.
- the convergence condition is satisfied when the unknown parameters converge or when the separation amount ⁇ P becomes sufficiently small.
- unknown parameters ⁇ Pos_x, ⁇ Pos_y, ⁇ Pos_z, ⁇ roll, ⁇ pitch, ⁇ yaw
- the present invention can also be used in a surveying device having a TS and a laser scanner in a combined manner with the optical origins thereof made to coincide with each other. Even if the optical origins of the TS and the laser scanner are made to coincide with each other by design, and a product is finished in consideration of part accuracy and assembling accuracy, timing of measuring a direction performed by the laser scanner and timing of acquiring positioning data can differ, and measurement errors can occur. From this point of view, this surveying device also requires the calibration process to obtain reliable interchangeability of data between the TS positioning function and the laser scanner. The present invention can be used in such cases.
- the present invention can be used in a surveying device having both a function of TS and a function of a laser scanner.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Manufacturing & Machinery (AREA)
- Computer Networks & Wireless Communication (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Length Measuring Devices By Optical Means (AREA)
Description
- The present invention relates to a technique for calibrating a surveying device.
- A publicly known surveying device may include a total station (TS). Such a TS is disclosed in Japanese Unexamined Patent Applications Laid-Open Nos.
2009-229192 2012-202821 U.S. Patent No. 8767190 , for example. Another publicly known laser scanner performs electronic control of a scanning direction. This laser scanner is disclosed inU.S. Patent Application Publication No. 2015/0293224 , for example. - The TS has a laser distance measuring function, which is known as being useable to make the TS also useable as a laser scanner. This laser scanner performs laser scanning in laser distance measurement with respect to each point, while an optical system of the TS moves vertically and laterally. This method is simple and easy, but is inferior to a dedicated laser scanner in scanning speed and scanning resolution.
- The laser scanner, as disclosed in, for example,
U.S. Patent No. 8767190 , can perform high-speed scanning but has a positioning accuracy for each of the scanned points inferior to that of a laser positioning function of a TS. This is due to high speed scanning of the dedicated laser scanner. That is, a timing of measuring a distance by using laser distance measuring light differs from a timing of measuring an emitting direction of the laser distance measuring light, and this difference generates a measurement error and decreases positioning accuracy. In view of this, in order to obtain advantages of both the TS and the dedicated laser scanner, a highly accurate laser distance measuring unit of the TS and the function to make the TS useable as the laser scanner are separated as independent units and are combined together. - In this condition, the position of optical origin of the highly accurate laser distance measuring unit is physically separated from the position of optical origin of a unit having the separated function for the laser scanner. The separated amount is preliminarily set as an offset value at the time of designing in order to enable correction of positioning data, but this is not sufficient, and calibration is required after the product is completed. Normally, calibration is performed at the time a product is shipped. The calibration can also be performed as a service of a manufacturer or a maintenance company after sale. However, the calibration requires a dedicated apparatus and complicated operation.
- The calibration described above is normally performed in presupposed specific circumstances, and therefore, the calibrated condition may not be appropriate in actual surveying circumstances. Moreover, the calibrated condition can change over time. For these reasons, the calibration should be performed regularly or be performed before use.
-
EP 2 620 745 A1 -
JP 2013-190272 A - XP055707513 discloses to determine a plane from laser scanner point cloud data, and to use at least three points obtained from a total station in order to validate the plane as determined from the laser scanner point cloud data.
- In view of these circumstances, an object of the present invention is to provide a technique that enables calibration of a TS having a laser scanner at a surveying site or at other sites.
- An aspect of the present invention provides a surveying device including an optical system, a laser positioning part, a plane determining part, a laser scanner, a separation amount calculator, and an exterior orientation parameter calculator. The optical system is used for sighting a positioning target. The laser positioning part emits laser light via the optical system to the positioning target to position the positioning target. The plane determining part determines a location of a specific plane on the basis of a result of the positioning performed by the laser positioning part. The laser scanner performs laser scanning of the specific plane to obtain multiple scanning points. The separation amount calculator calculates a separation amount of the respective multiple scanning points obtained by the laser scanner, from the specific plane of which the location is determined by the plane determining part. The exterior orientation parameter calculator calculates exterior orientation parameters of one or both of the laser positioning part and the laser scanner on the basis of the calculated separation amount. The laser positioning part positions three or more points on the specific plane to determine the location of the specific plane.
- Another aspect of the present invention provides a surveying device including an optical system, a laser positioning part, a plane determining part, a laser scanner, a separation amount calculator, and an appropriateness judging part. The optical system is used for sighting a positioning target. The laser positioning part emits laser light via the optical system to the positioning target to position the positioning target. The plane determining part determines a location of a specific plane on the basis of a result of the positioning performed by the laser positioning part. The laser scanner performs laser scanning of the specific plane to obtain multiple scanning points. The separation amount calculator calculates a separation amount of the respective multiple scanning points obtained by the laser scanner, from the specific plane of which the location is determined by the plane determining part. The appropriateness judging part judges an appropriateness of a calibrated condition relating to exterior orientation parameters of the laser positioning part and the laser scanner, on the basis of the calculated separation amount. The laser positioning part positions three or more points on the specific plane to determine the location of the specific plane.
- A distribution area of the three or more points and a laser scanning area of the laser scanner preferably overlap. Moreover, the laser scanning area of the laser scanner is preferably set within the distribution area of the three or more points.
- In one example of the present invention, the surveying device preferably further includes a noise eliminating part that calculates a fitting plane to which the multiple scanning points fit, and the noise eliminating part eliminates a scanning point, of which a separation amount from a fitting plane is a specified value or greater, as a noise point from among the multiple scanning points. Moreover, in one example of the present invention, the separation amount is preferably a distance between the specific plane, of which the location is identified by the plane determining part, and the fitting plane that fits to the multiple scanning points obtained by the laser scanner.
- Yet another aspect of the present invention provides a calibration method of a surveying device. The method includes determining a location of a specific plane by positioning three or more points on the specific plane by using a laser positioning part, and performing laser scanning of the specific plane by a laser scanner to obtain multiple scanning points. The method also includes calculating a separation amount of the respective multiple scanning points obtained by the laser scanning, from the specific plane of which the location is determined, and calculating exterior orientation parameters of one or both of the laser positioning part and the laser scanner on the basis of the separation amount.
- Yet another aspect of the present invention provides a non-transitory computer recording medium storing computer executable instructions for calibrating a surveying device. The computer executable instructions, when executed by a computer processor, cause the computer processor to determine a location of a specific plane by positioning three or more points on the specific plane by using a laser positioning part, and perform laser scanning of the specific plane by a laser scanner to obtain multiple scanning points. The computer executable instructions also cause the computer processor to calculate a separation amount of the respective multiple scanning points obtained by the laser scanning, from the specific plane of which the location is determined, and calculate exterior orientation parameters of one or both of the laser positioning part and the laser scanner on a basis of the separation amount.
- The present invention provides a technique that enables check of a calibrated condition of a TS having a laser scanner at a surveying site or at other sites.
-
-
Fig. 1 is a perspective view of a total station (TS) using the present invention. -
Fig. 2 is a front view of the TS using the present invention. -
Fig. 3 is a block diagram of the TS using the present invention. -
Fig. 4 illustrates a situation in which a scanning area is set within a distribution area of positioning points. -
Fig. 5 illustrates a relationship between a scanning point and a plane that is based on multiple points acquired by a positioning-point location data acquiring unit 111 and that is used for calibration. -
Fig. 6 is a flowchart showing an example of a processing procedure. -
Fig. 1 shows a perspective view of a total station (TS) 100 having a laser scanner and using the present invention.Fig. 2 shows a front view of theTS 100. TheTS 100 has the same functions as those of an ordinary TS, except that theTS 100 has alaser scanner 109 and has a function of performing a processing relating to calibration of a positioning function of theTS 100 and calibration of thelaser scanner 109. Thelaser scanner 109 is described later. The positioning function of theTS 100 is performed by alaser positioning part 200, which is described later. A detailed structure of a TS is disclosed in Japanese Unexamined Patent Applications Laid-Open Nos.2009-229192 2012-202821 - The
TS 100 has amain body 150 and alaser scanner 109 in a composite manner. TheTS 100 has amain unit 11 that is held in a horizontally rotatable manner by abase 12. The base 12 may be fixed on a top of a tripod (not shown). Themain unit 11 has an approximately U-shape with two extending parts that extend upwardly as viewed from a Y-axis direction. Themain unit 11 also has amovable part 13 that is held between the two extending parts so as to be controllable in a vertical angle. The vertical angle is composed of an elevation angle and a depression angle. - The
main unit 11 is rotated relative to thebase 12 by a motor. That is, the horizontal rotation angle of themain unit 11 relative to thebase 12 is controlled by the motor. The vertical angle of themovable part 13 is also controlled by a motor. Driving to control the horizontal rotation angle and the vertical angle is performed by a vertical and horizontalrotation driving unit 106 that is incorporated in themain unit 11. The vertical and horizontalrotation driving unit 106 is shown in the block diagram inFig. 3 . - The
main unit 11 has a horizontal rotationangle controlling dial 14a and a verticalangle controlling dial 14b arranged thereon. The horizontal rotationangle controlling dial 14a is operated to adjust the horizontal rotation angle of themain unit 11 and themovable part 13. The verticalangle controlling dial 14b is operated to adjust the vertical angle of themovable part 13. - The
movable part 13 has a rectangularcylindrical sighting unit 15a for approximate sighting, arranged on a top thereof. Themovable part 13 also has anoptical sighting unit 15b with a visual field narrower than that of thesighting unit 15a and has atelescope 16 that can be collimated at a high accuracy. - An image captured by the
sighting unit 15b and thetelescope 16 can be visually recognized by looking into aneyepiece 17. Thetelescope 16 also serves as an optical system for distance measuring laser light and for tracking light. The tracking light is used to track and capture an object of which a distance is to be measured. An example of the object includes a target using a dedicated reflective prism. The distance measuring laser light is abbreviated as "distance measuring light" hereinafter. The optical system is designed so that the optical axes of the distance measuring light and the tracking light will coincide with an optical axis of thetelescope 16. The structure of this part is the same as that of a commercially available TS. - The
main unit 11 hasdisplays display 18 is integrated with acontroller 101. Thecontroller 101 has a numeric keypad, a cross operation button, and other operation parts arranged thereon, which are used to perform various operations relating to theTS 100 and input data. Thedisplays TS 100, surveying data, and other information. These two displays are mounted in order to enable viewing the display from either the front side or the back side without having to rotate themain unit 11. - The
main unit 11 has thelaser scanner 109 that is fixed on a top. Thelaser scanner 109 has afirst column 301 and asecond column 302. Thefirst column 301 and thesecond column 302 are connected by a connectingpart 303. The space over the connectingpart 303 between thefirst column 301 and thesecond column 302 is covered with aprotective case 304. Theprotective case 304 is made of a member that transmits laser scanning light. Theprotective case 304 houses arotating part 305 that protrudes from thefirst column 301 in an X-axis direction. An end of therotating part 305 is obliquely cut off, and this end has atilt mirror 306 fixed thereon. - The
rotating part 305 is driven to be rotated around the X-axis by a motor contained in thefirst column 301. Thefirst column 301 contains, in addition to the motor, a driving circuit for driving the motor, a control circuit for the driving circuit, a sensor for measuring a rotation angle of therotating part 305, and a peripheral circuit of the sensor. - The
second column 302 contains a light emitting part that generates multiple pulsed beams of laser scanning light, a light receiving part that receives laser scanning light reflected back from an object, an optical system for the light emitting part and the light receiving part, and a distance calculator that calculates a distance to a scanning point. Thelaser scanner 109 further contains a scanning-point location calculator that calculates three-dimensional coordinates of a scanning point on the basis of a rotation angle of therotating part 305, a horizontal rotation angle of themain unit 11, and a distance to the scanning point from themain unit 11. The laser scanning light is emitted from an inside of thesecond column 302 to thetilt mirror 306 and is reflected thereat to exit to the outside via the transparentprotective case 304. The laser scanning light that is reflected back from an object reverses the path of the emitted light and is received by the light receiving part in thesecond column 302. - The point that reflects the laser scanning light is positioned as a scanning point by referring to a light emission timing and a light reception timing of the laser scanning light as well as a rotation angle of the
rotating part 305 and a horizontal rotation angle of themain unit 11 at each of these timings. The principle of the positioning is the same as that for thelaser positioning part 200, which is described later. - The multiple pulsed beams of the laser scanning light are intermittently emitted from the transparent
protective case 304 to the outside, in a fan shape with an expansion angle of approximately 20 to 45 degrees along an extending direction of the rotation axis of therotating part 305. At this time, the laser scanning light is emitted while therotating part 305 rotates. Thus, the fan-shaped laser scanning light with a width of some degree in the X-axis direction is emitted from thelaser scanner 109 while scanning around the X-axis. In the meantime, the laser scanning light is emitted while themain unit 11 is horizontally rotated around a Z-axis. As a result, the entirety of the surroundings or a necessary area is subjected to the laser scanning. In one example, the laser scanning light may be composed of one pulsed beam, and laser scanning may be performed along a vertical plane including the optical axis of thetelescope 16. - The technique relating to the laser scanner is disclosed in Japanese Unexamined Patent Applications Laid-Open Nos.
2010-151682 2008-268004 U.S. Patent No. 8767190 , for example. The laser scanner can be one that electronically performs scanning, as disclosed inU.S. Patent Application Publication No. 2015/0293224 . -
Fig. 3 shows a block diagram of theTS 100. The basic functions of theTS 100 as a total station are the same as those of an existing total station. TheTS 100 differs from an existing total station in that theTS 100 is combined with theindependent laser scanner 109 and in that theTS 100 has a function of performing calibration between the combinedlaser scanner 109 and the positioning function of theTS 100. The positioning function of theTS 100 is performed by thelaser positioning part 200. - The
TS 100 includes acontroller 101, animaging unit 102, displays 18 and 19, alaser positioning part 200, alaser scanner 109, acalibration processing part 110, a calibrated condition appropriateness judging unit 117, a movement controlling unit 121, astorage 122, and anoptical system 201. - The
laser positioning part 200 performs positioning that is a function originally provided to a TS. Thelaser positioning part 200 includes a distance-measuring-light emitting unit 104, a distance-measuring-light receiving unit 105, a vertical and horizontalrotation driving unit 106, a vertical and horizontal rotationangle measuring unit 107, and a three-dimensional location calculator 108. Theoptical system 201 includes thesighting unit 15b (refer toFig. 2 ), the telescope 16 (refer toFig. 2 ), an optical system of thelaser positioning part 200, an optical system of theimaging unit 102, and an optical system containing a light path of tracking light (not shown). - The
optical system 201 is configured in a similar manner as in an ordinary TS and includes various types of lenses, a mirror, a dichroic mirror for separating and combining light paths, a half-mirror, a polarizing mirror, or other parts. With use of theoptical system 201, the distance measuring light emitted from the distance-measuring-light emitting unit 104 passes through thetelescope 16 and reaches an object to be positioned, and the distance measuring light is reflected back from the object through thetelescope 16 and is received by the distance-measuring-light receiving unit 105. Theoptical system 201 conducts an image captured by thetelescope 16, to theeyepiece 17 and to theimaging unit 102. - The
TS 100 also includes a tracking light emitting unit, a tracking light receiving unit, and a track controlling unit. The tracking light emitting unit emits tracking light for tracking a target such as a reflective prism. The tracking light receiving unit receives the tracking light that is reflected back from the target. The track controlling unit outputs a control signal to the vertical and horizontalrotation driving unit 106 so that the tracking light will be captured at a collimation position in a visual field of thetelescope 16. These structures are the same as those of an existing commercially available product, and therefore, detailed descriptions thereof are not given. The structure relating to the tracking light of the TS is disclosed in, for example, Japanese Patent No.5124319 - The
controller 101 receives contents of operation of theTS 100 input by an operator. TheTS 100 is operated through a button switch or other operation parts of theTS 100. A tablet or a smartphone can also be used as a controller. In this case, dedicated application software may be installed in a tablet or a smartphone to make the tablet or the smartphone function as a control means of theTS 100. - The
imaging unit 102 images an image captured by thetelescope 16. The imaging is performed by, for example, a CCD imaging sensor or a CMOS imaging sensor. Thedisplays imaging unit 102, information necessary to operate theTS 100, information relating to movement of theTS 100 such as distance measuring data and direction of a target, and other information. Each of thedisplays displays laser scanner 109. The 3D display of the point cloud data is disclosed in, for example, Japanese Patent Application No.2016-173468 - The distance-measuring-
light emitting unit 104 emits laser light for measuring a distance, which is referred to as distance measuring light in this embodiment. The distance measuring light passes through thetelescope 16 in the same axis direction as the optical axis of thetelescope 16. The distance-measuring-light receiving unit 105 receives the distance measuring light reflected back from an object through thetelescope 16. The distance-measuring-light receiving unit 105 uses an optical measuring device such as a photodiode. - The optical axis of the distance measuring light, which is emitted from the distance-measuring-
light emitting unit 104, and the optical axis of the distance measuring light, which is reflected back from the object to theTS 100 and enters the distance-measuring-light receiving unit 105, are combined by using the optical system, such as the dichroic mirror, the half-mirror, and the polarizing mirror. - The vertical and horizontal
rotation driving unit 106 drives to horizontally rotate themain unit 11 and drives to vertically rotate themovable part 13. The vertical and horizontalrotation driving unit 106 includes a motor, a gear mechanism, and a driving circuit for performing these drivings. - The vertical and horizontal rotation
angle measuring unit 107 measures a horizontal rotation angle of themain unit 11 and measures a vertical angle of themovable part 13 in terms of an elevation angle and a depression angle. The measurement of the angles is performed by a rotary encoder. The horizontal rotation angle is measured, for example, in a clockwise direction starting from the direction of north as 0 degrees as viewed downwardly. The elevation angle is measured on the condition that an elevation direction starting from the horizontal direction as 0 degrees is a positive angle, and the depression angle is measured on the condition that a depression direction starting from the horizontal direction as 0 degrees is a negative angle. - The three-
dimensional location calculator 108 calculates values of three-dimensional coordinates of an object from a distance to the object and an emitting direction of the distance measuring light. The object is a target of which the distance is to be measured, such as a reflection point that reflects the distance measuring light. The distance is calculated on the basis of a time-of-flight of the distance measuring light from the distance-measuring-light emitting unit 104. The three-dimensional coordinates of the object of which the distance is to be measured is obtained in terms of values in a coordinate system having the origin at theTS 100. This coordinate system is referred as a "TS coordinate system" hereinafter. - Normally, the
TS 100 is installed at a location of which coordinates in an absolute coordinate system are known, and therefore, coordinates of location data obtained in the TS coordinate system can be converted into coordinates of the absolute coordinate system by performing parallel movement and, as necessary, by also performing rotation. The absolute coordinate system is a global coordinate system fixed relative to the ground. For example, a GNSS normally uses an absolute coordinate system. Typically, a map is described in the absolute coordinate system. The absolute coordinate system uses, for example, longitude, latitude, and elevation above mean sea level to specify a location. - The distance from the
TS 100 to the object of which a distance is to be measured is calculated as follows. TheTS 100 incorporates a reference light path with a known light path length for conducting light emitted from the distance-measuring-light emitting unit 104. The light from the distance-measuring-light emitting unit 104 is divided into two beams, and one beam advances from thetelescope 16 through a light path connecting thetelescope 16, a positioning point, thetelescope 16, and the distance-measuring-light receiving unit 105, in this order, whereas the other beam advances from the reference light path to the distance-measuring-light receiving unit 105. The distance measuring light is pulsed light, and therefore, the one beam of the distance measuring light advancing through the light path and the other beam of the distance measuring light advancing the other light path are received at different timings by the distance-measuring-light receiving unit 105. This generates a phase difference between waveforms that are measured by the distance-measuring-light receiving unit 105. The phase difference is used to calculate the distance to the reflection point. - Meanwhile, the direction of the reflection point that reflects the distance measuring light, as viewed from the
TS 100, is obtained in terms of angle by the vertical and horizontal rotationangle measuring unit 107. The distance and direction determined provides a three-dimensional location of the reflection point that reflects the distance measuring light. The three-dimensional location is represented by using theTS 100 as reference or the origin. This process is performed by the three-dimensional location calculator 108. Thus, thelaser positioning part 200 measures the location of the positioning point. - The
laser scanner 109 obtains scanning points that are scanned by means of laser scanning, that is, obtains point cloud data that contains laser scanning point clouds obtained by means of laser scanning. The range of the laser scanning can be set as desired. - The
calibration processing part 110 performs calibration relating to exterior orientation parameters (location and direction) between thelaser positioning part 200 and thelaser scanner 109. In this embodiment, for example, the calibration is performed to correct a dislocation from an initial calibrated condition. In this case, the calibration is performed as follows: data of location, which is positioned using a plane by thelaser positioning part 200, and the point cloud data, which is obtained by thelaser scanner 109, are compared to evaluate a dislocation, and exterior orientation parameters of thelaser scanner 109 are adjusted so that the dislocation will be minimum. - Basically, at the stage of shipping, various kinds of calibrations relating to the
TS 100 are already completed, and thus, the calibration relating to the relationship of the exterior orientation parameters between thelaser positioning part 200 and thelaser scanner 109 is also preliminarily performed. Nevertheless, due to variation with time in the calibrated conditions and due to difference of the conditions in use from the conditions in use that were assumed in the preliminary calibration, calibration should be performed again in some cases. In such cases, a calibration process is performed by using thecalibration processing part 110. - The
calibration processing part 110 is an arithmetic proceeding part that functions as a computer. Thecalibration processing part 110 includes a positioning-point location data acquiring unit 111, a scanningdata acquiring unit 112, a noise eliminating unit 113, a plane equation calculator 114, aseparation amount calculator 115, and an exterior orientation parameter calculator 116. Each of these functional units may be embodied by a dedicated integrated circuit using an ASIC, FPGA, or other component or may be implemented by causing a CPU to execute a program. Alternatively, thecalibration processing part 110 may be embodied by combining a microcomputer and a dedicated arithmetic circuit. Thecalibration processing part 110 may also be embodied by using a personal computer (PC) connected to the outside. - The positioning-point location data acquiring unit 111 acquires location data of points positioned by the
laser positioning part 200. In one example according to the technique of the disclosure, thelaser positioning part 200 is used to position three or more points on a target planar plane, and the positioning-point location data acquiring unit 111 acquires data of locations of the positioned three or more points. - The scanning
data acquiring unit 112 acquires location data of scanning points that are obtained by thelaser scanner 109. In one example according to the technique of the disclosure, laser scanning is performed on the same target plane as the positioning-point location data acquiring unit 111, and the resultant data of the laser scanning is acquired by the scanningdata acquiring unit 112. - Hereinafter, the plane to be targeted by the positioning-point location data acquiring unit 111 is referred as a "first plane". The center of an area of the laser scanning is made to coincide with the center of the first plane with the most possible accuracy. The center of the first plane is set at the center of gravity of the three or more positioning points that are used for obtaining the first plane. The scanning area is set inside a distribution area of the positioning points that are used for determining the first plane. An example of this situation is shown in
Fig. 4. Fig. 4 illustrates a situation of using one plane of acubic object 300, which is prepared as a target for calibration, as atarget plane 301 for calibration serving as the first plane. The distribution area of multiple positioning points used to obtain the first plane and the scanning area of thelaser scanner 109 shall be at least partially overlapped. A plane that is close to a complete flat plane as much as possible is selected as thetarget plane 301 for the calibration. - Setting the laser scanning area to satisfy the above conditions increases the calculation accuracy of the exterior orientation parameters of the
laser scanner 109. This calculation is described later. On the other hand, in a case in which distribution locations of the points used for obtaining the first plane are separated from the laser scanning area, as the separation amount increases, the accuracy of the calibration decreases because the calibration is performed on different observation references. - The noise eliminating unit 113 eliminates noise points from among the multiple scanning points obtained by the
laser scanner 109. The elimination of a noise point is performed as described below. First, multiple scanning points of a scanning point cloud are obtained as targets. Thereafter, a plane equation that fits to the obtained scanning point cloud is calculated, and a plane is obtained. A distance of each of the scanning points from the obtained plane is calculated in terms of absolute value. At this time, a distance in a direction perpendicular to the plane is calculated. After the distance of each of the scanning points from the plane is calculated, the scanning point with the distance of a threshold value or greater is eliminated as noise. The threshold value is set in consideration of the accuracy of thelaser scanner 109. For example, in a case in which thelaser scanner 109 has a distance measuring accuracy of 5 mm, the threshold value is set at 2.5 mm. - The plane equation calculator 114 calculates a plane equation that fits to the three or more points, on the basis of the location data of the three or more points acquired by the positioning-point location data acquiring unit 111.
- For example, a general formula of the plane equation is: ax + by + cz + d = 0. The coordinate values of the three more points are substituted into the general formula, and simultaneous equations are solved, whereby a plane equation of a plane containing the three or more points is obtained. This plane equation is described in a TS coordinate system.
- In a case in which four or more positioning points are used, and there is a point that is not contained in a plane among these positioning points, a plane equation is calculated so that an integrated value of separation amounts of the positioning points from the plane will be minimum. Alternatively, a point that is not contained in a plane may be ignored, and a plane equation may be calculated by using only positioning points that exist on the plane.
- The
separation amount calculator 115 calculates a separation amount of the scanning point, which is acquired by the scanningdata acquiring unit 112, from the plane calculated by the plane equation calculator 114. The separation amount is represented by a distance in terms of absolute value. The calculation may use all or some of the scanning points that are obtained from the scanning data. However, using a greater number of the scanning points enables increasing final accuracy. The separation amount is obtained by measuring a length of a perpendicular to the plane, of the scanning point, that is, by measuring a distance in a direction perpendicular to the plane between the scanning point and the plane. -
Fig. 5 illustrates a distance dn between a scanning point n (n is a natural number of 1, 2, 3, 4, ...) and a plane, which is calculated by the plane equation calculator 114. In this case, the distance dn represents the separation amount of each of the scanning points from the plane, which is calculated by the plane equation calculator 114. As the separation amount increases, the difference of the scanning point from the plane, which is calculated by the plane equation calculator 114, increases, and the degree of coincidence therebetween is lower. This plane is a target plane for the calibration determined on the basis of the positioning data from thelaser positioning part 200. - The exterior orientation parameter calculator 116 adjusts values of the exterior orientation parameters (location and attitude) of the
laser scanner 109 so that the separation amount dn, which is calculated by theseparation amount calculator 115, will be minimum. The following describes an example of a process performed by the exterior orientation parameter calculator 116. - First, it is assumed that initial values of the exterior orientation parameters of the
laser scanner 109 are represented as Pos_scan(Pos_x, Pos_y, Pos_z) and Att_scan(roll, pitch, yaw). The initial value (Pos_scan) represents a location of thelaser scanner 109, or more exactly, a location of an optical origin of thelaser scanner 109. The initial value (Att_scan) represents an attitude (direction) of thelaser scanner 109. The initial values (Posscan, Att scan) are described in the TS coordinate system having the origin at an optical origin of thelaser positioning part 200. Current values, that is, values that are obtained in the calibration process performed before, are used for the initial values (Pos scan, Att_scan). - Moreover, it is also assumed that correction amounts from the initial values are represented as (δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw) as unknown parameters. Under these conditions, the following First Formula is established by using ΔP as a separation amount of one of the scanning points, from a plane determined on the basis of the result of positioning performed by the
laser positioning part 200. - The mathematical sign []^T represents transposition, and the mathematical sign J represents a Jacobian matrix.
-
- A = J, and
- x = [δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw]^T, an observation equation represented by the Second Formula is obtained.
- Observation values of each of the scanning points, which are values of Pos_scan and Att_scan at the time each of the scanning points is obtained, are substituted into the observation equation of Second Formula. Then, a transposed matrix A^T for A is multiplied from the left side in Second Formula to obtain a normal equation of Third Formula.
-
- The separation amount ΔP is substituted into Fourth Formula, whereby a least square solution of x is obtained. Resultant values of δPos_x, δPos_y, δPos_z, δroll, δpitch, and δyaw are added to the initial values (Pos_scan, Att scan), and the obtained values are used to recalculate point cloud data of the laser scanning data.
- The recalculated laser scanning data is used to recalculate the separation amount ΔP of each of the scanning points from the plane, which is calculated by the plane equation calculator 114. The recalculated separation amount ΔP is used to recalculate First Formula to Fourth Formula, to calculate the unknown parameters (δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw) again.
- The above calculation cycle is repeated until a predetermined convergence condition is satisfied, and optimal estimation values of the unknown parameters (δPosx, δPos_y, δPos_z, δroll, δpitch, δyaw) are determined. For example, the convergence condition is satisfied when the unknown parameters converge or when the separation amount ΔP becomes sufficiently small.
- After the optimal values of the unknown parameters (δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw) are obtained, these optimal values are used to correct the known initial values (Pos_scan, Att scan) to obtain optimally corrected exterior orientation parameters of the
laser scanner 109. - As variations in the values of the unknown parameters (δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw) become small or converge, the separation amount ΔP also converges to the minimum value. From this point of view, it is possible to find values of the unknown parameters (δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw) at a condition at which the separation amount ΔP is regarded as the minimum, also by searching for a condition at which the unknown parameters (δPosx, δPos_y, δPos_z, δroll, δpitch, δyaw) converge. In an ideal case, there exists a condition at which the separation amount ΔP is zero. However, the separation amount ΔP may not be zero due to various kinds of margin of errors.
- As described above, the exterior orientation parameters of the
laser scanner 109 when the separation amount dn (refer toFig. 5 ) of each of the scanning points is minimum, are calculated, and a more optimized relationship of the exterior orientation parameters between thelaser positioning part 200 and thelaser scanner 109 is obtained. That is, calibration relating to the exterior orientation parameters between thelaser positioning part 200 and thelaser scanner 109 is performed. - Multiple planes having different normal directions are preferably used for calculation of the exterior orientation parameters. This is because a margin of error still exists in the relative relationship of parallel position between the
laser positioning part 200 and thelaser scanner 109 even when the plane, which is determined by thelaser positioning part 200, coincides with the scanning data of thelaser scanner 109. However, this margin of error is decreased by optimizing the exterior orientation parameters using multiple planes having different normal vectors. - The above description exemplifies a case of calculating and optimizing the exterior orientation parameters of the
laser scanner 109. In the embodiment of the technology, it is important to calibrate and determine the relationship between the exterior orientation parameters of thelaser positioning part 200 including theoptical system 201 and the exterior orientation parameters of thelaser scanner 109. This is because there can be a range of error in comparison and interchanging of data of thelaser positioning part 200 and data of thelaser scanner 109, unless the relationship of the exterior orientation parameters between thelaser positioning part 200 and thelaser scanner 109 is determined. In view of this, in one example, exterior orientation parameters of thelaser positioning part 200 including theoptical system 201 may be corrected. Alternatively, in another example, both of the exterior orientation parameters of thelaser positioning part 200 including theoptical system 201 and the exterior orientation parameters of thelaser scanner 109 may be corrected. - An artificial structure such as a wall surface of a building, a plate member prepared as a target for the calibration, and a cubic structure as illustrated in
Fig. 4 may be used to obtain the target plane. In a case of preparing a target for the calibration, a structure with multiple planes having different normal vectors is preferable. Alternatively or additionally, an object that exists in nature may also be used to obtain the plane for the calibration. Note that, in a case in which the state of the plane is not known, an object having the most possible planarity should be selected as the target plane for the calibration. - The calibrated condition appropriateness judging unit 117 judges the appropriateness of the calibrated condition relating to the
laser positioning part 200 and thelaser scanner 109. In a case in which the calibrated condition relating to thelaser positioning part 200 and thelaser scanner 109 is "appropriate", the exterior orientation parameters of both of thelaser positioning part 200 and thelaser scanner 109 are obtained at acceptable accuracies. - In this case, even if the exterior orientation parameters of one or both of the
laser positioning part 200 and thelaser scanner 109 contain a margin of error, this falls in an acceptable range and does not cause problems in matching and interchanging of data between thelaser positioning part 200 and thelaser scanner 109, or this may generate a range of error in the matching and the interchanging of the data, but this error still falls in an acceptable range. - On the other hand, in a case in which the calibrated condition relating to the
laser positioning part 200 and thelaser scanner 109 is "inappropriate", the exterior orientation parameters of at least one of thelaser positioning part 200 and thelaser scanner 109 contain a margin of error at an unacceptable degree. In this case, problems will occur in matching and interchanging of data between thelaser positioning part 200 and thelaser scanner 109, resulting in generation of a range of error in integrated data of thelaser positioning part 200 and thelaser scanner 109 to an unacceptable degree. - The exterior orientation parameters of both of the
laser positioning part 200 and thelaser scanner 109 and the relationship of the exterior orientation parameters between thelaser positioning part 200 and thelaser scanner 109 are determined in advance in a preliminary calibration process. However, various kinds of causes, such as variation with time, may generate deviations from appropriate values and generate a range of error, in the values of the exterior orientation parameters of thelaser scanner 109 relative to thelaser positioning part 200. Alternatively or additionally, these various kinds of causes may generate a deviation from an appropriate value and generate a margin of error, in the relationship of the exterior orientation parameters between thelaser positioning part 200 and thelaser scanner 109. In a case in which this margin of error is so great as to be not negligible, the calibrated condition relating to thelaser positioning part 200 and thelaser scanner 109 is in an inappropriate condition. The judgement of the appropriateness of the calibrated condition is performed by the calibrated condition appropriateness judging unit 117. - The judgement of the appropriateness of the calibrated condition is performed on the basis of the separation amount, which is calculated by the
separation amount calculator 115. In a specific example, assuming that an average of the separation amounts d of the scanning points is represented as Σdn/n in which "n" is the number of the scanning points, the calibrated condition is judged as being "appropriate" if Edn/n is smaller than a predetermined threshold value, whereas the calibrated condition is judged as being "inappropriate" if Edn/n is the predetermined threshold value or greater. The threshold value serves as a criterion for the judgement and is set depending on an acceptable degree of range of error. - The movement controlling unit 121 comprehensively controls the operation of the
TS 100. For example, the control relating to a processing shown inFig. 6 is performed by the movement controlling unit 121. Thestorage 122 stores information necessary to operate theTS 100, such as data and programs, and also stores surveying data obtained as a result of the operation of theTS 100. Example of Processing -
Fig. 6 is a flowchart showing an example of a processing procedure performed by thecalibration processing part 110. Programs for executing the processing shown inFig. 6 are stored in thestorage 122 or an appropriate storage medium or both. The processing procedure is executed under control of the movement controlling unit 121. - A calibration process using the
target plane 301 for the calibration illustrated inFig. 4 is exemplified below. After the processing starts, positioning points 303 are positioned first by thelaser positioning part 200, and the resultant data of the positioning is acquired by the positioning-point location data acquiring unit 111 (step S101). In the case shown inFig. 4 , sixpositioning points 303 are positioned. Coordinates of thepositioning point 303 are described in the TS coordinate system, which is a three-dimensional coordinate system fixed relative to theTS 100. - The operation for positioning the
positioning point 303 is conducted by an operator by using theTS 100. At this time, the operator sights a point on thetarget plane 301 for the calibration, by viewing through theeyepiece 17. The operator selects six points on thetarget plane 301 as positioningpoints 303 and positions the selected positioning points 303. - After the six
positioning points 303 are positioned, a plane that fits to the sixpositioning points 303 is determined (step S102). This process is performed by the plane equation calculator 114. This process performs calculation of a plane equation of a plane that fits to the sixpositioning points 303 in the TS coordinate system. - Thereafter, laser scanning is performed on the
target plane 301 for the calibration, by using thelaser scanner 109, to obtain scanning data of thetarget plane 301 for the calibration. This scanning data is acquired by the scanning data acquiring unit 112 (step S103). - Next, on the basis of the principle shown in
Fig. 5 , a separation amount of the respective scanning points, which are contained in the scanning data obtained in step S103, from the plane, which is calculated in step S102, is calculated (step S104). This process is performed by theseparation amount calculator 115. - Then, the exterior orientation parameters of the
laser scanner 109 are calculated so that the separation amount will be minimum (step S105). This process is performed by the exterior orientation parameter calculator 116. The process inFig. 6 performs optimization calculation of the exterior orientation parameters of thelaser scanner 109 so that the separation amount will be minimum. This process is performed to correct the exterior orientation parameters of thelaser scanner 109 relative to thelaser positioning part 200. Alternatively, the exterior orientation parameters of thelaser positioning part 200 may be calculated so that the separation amount will be minimum. Further alternatively, the exterior orientation parameters of both of thelaser positioning part 200 and thelaser scanner 109 may be calculated so that the separation amount will be minimum. - The separation amount of the scanning point, which is obtained by the
laser scanner 109, from the plane, which is determined by using the function of thelaser positioning part 200, may be calculated as described below. That is, assuming that the plane is referred as a "first plane", a plane that fits to the scanning point contained in the laser scanning data is calculated as a second plane, and a separation amount between the first plane and the second plane is calculated. - The separation amount is calculated at a point on a grid set on the first plane or the second plane. The smaller the grid interval, the greater the calculation accuracy, but the amount of calculation increases accordingly. The interval of the grid may be 1 to 30 cm, for example. Also in this modification example, it is preferable to use two or more planes that have different normal vectors.
- In the processing shown in
Fig. 6 , instead of the process in step S105, the appropriateness of the calibrated condition may be judged on the basis of the separation amount obtained instep S 104. In this case, the appropriateness of the calibrated condition between thelaser positioning part 200 and thelaser scanner 109 is judged by the calibrated condition appropriateness judging unit 117. The result of the judgment is shown on thedisplays TS 100. - A curved plane can also be used as the target plane for the calibration exemplified in
Fig. 4 . In this case, a curved plane with known mathematical specification, such as a curvature, is prepared as the target plane for the calibration. The mathematical structure of the target plane for the calibration is obtained in advance. For example, an equation of the curved plane and detailed numerical information are preliminarily obtained. - In the calibration process, multiple points that are necessary to identify the prepared target plane for the calibration, normally, three or more points, are positioned by the
laser positioning part 200, and the prepared target plane for the calibration that fits to the positioned points is identified. At this stage, an indeterminate coefficient in a plane equation of the prepared target plane for the calibration is determined. - Thereafter, laser scanning is performed on the identified target plane for the calibration, by using the
laser scanner 109, to obtain a large number of scanning points on the identified target plane for the calibration. Under these conditions, a separation amount of the respective multiple scanning points, which are obtained by the laser scanning, from the identified target plane for the calibration is calculated. At this time, the numerical specification of the identified target plane for the calibration is already determined. Then, the exterior orientation parameters of thelaser scanner 109 are calculated so that the separation amount will be minimum. The curved plane may be a spherical surface, an ellipsoid, a hyperboloid, a cylindrical surface, a conical surface, or any other curved surface. - The exterior orientation parameters of the
laser positioning part 200 can be corrected and be optimized by using the First Formula to Fourth Formula. In this case, after the unknown parameters (δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw) of thelaser positioning part 200 are calculated, the positioning points 303 and the plane equation are recalculated by using the calculated unknown parameters. In this condition, the First Formula to Fourth Formula are calculated again. This cycle is repeated until a predetermined convergence condition is satisfied, and optimal values of the unknown parameters (δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw) relating to thelaser positioning part 200 are determined. For example, the convergence condition is satisfied when the unknown parameters converge or when the separation amount ΔP becomes sufficiently small. - To correct the exterior orientation parameters of both of the
laser positioning part 200 and thelaser scanner 109, unknown parameters (δPos_x, δPos_y, δPos_z, δroll, δpitch, δyaw) of both of thelaser positioning part 200 and thelaser scanner 109 are corrected alternately. - The present invention can also be used in a surveying device having a TS and a laser scanner in a combined manner with the optical origins thereof made to coincide with each other. Even if the optical origins of the TS and the laser scanner are made to coincide with each other by design, and a product is finished in consideration of part accuracy and assembling accuracy, timing of measuring a direction performed by the laser scanner and timing of acquiring positioning data can differ, and measurement errors can occur. From this point of view, this surveying device also requires the calibration process to obtain reliable interchangeability of data between the TS positioning function and the laser scanner. The present invention can be used in such cases.
- The present invention can be used in a surveying device having both a function of TS and a function of a laser scanner.
Claims (8)
- A surveying device (100) comprising:an optical system (201) to be used for sighting a positioning target (300); anda laser positioning part (200) that emits laser light via the optical system (201) to the positioning target (300) to position the positioning target (300), characterized in that the surveying device (100) further comprises:a plane determining part (114) that determines a location of a specific plane (301) on a basis of a result of the positioning performed by the laser positioning part (200);a laser scanner (109) that performs laser scanning of the specific plane (301) to obtain multiple scanning points (302);a separation amount calculator (115) that calculates a separation amount of the respective multiple scanning points (302) obtained by the laser scanner (109), from the specific plane (301) of which the location is determined by the plane determining part (114); andan exterior orientation parameter calculator (116) that calculates exterior orientation parameters of one or both of the laser positioning part (200) and the laser scanner (109) on a basis of the calculated separation amount,wherein the laser positioning part (200) positions three or more points on the specific plane (301) to determine the location of the specific plane (301).
- A surveying device (100) comprising:an optical system (201) to be used for sighting a positioning target (300); anda laser positioning part (200) that emits laser light via the optical system (201) to the positioning target (300) to position the positioning target (300), characterized in that the surveying device (100) further comprises:a plane determining part (114) that determines a location of a specific plane (301) on a basis of a result of the positioning performed by the laser positioning part (200);a laser scanner (109) that performs laser scanning of the specific plane (301) to obtain multiple scanning points (302);a separation amount calculator (115) that calculates a separation amount of the respective multiple scanning points (302) obtained by the laser scanner (109), from the specific plane (301) of which the location is determined by the plane determining part (200); andan appropriateness judging unit (117) that judges an appropriateness of a calibrated condition relating to exterior orientation parameters of the laser positioning part (200) and the laser scanner (109), on a basis of the calculated separation amount,wherein the laser positioning part (200) positions three or more points on the specific plane (301) to determine the location of the specific plane (301).
- The surveying device (100) according to claim 1 or 2, wherein a distribution area of the three or more points and a laser scanning area of the laser scanner (109) overlap.
- The surveying device (100) according to any one of claims 1 to 3, wherein the laser scanning area of the laser scanner (109) is set within the distribution area of the three or more points.
- The surveying device (100) according to any one of claims 1 to 4, further comprising a noise eliminating part (113) that calculates a fitting plane to which the multiple scanning points (302) fit, and the noise eliminating part (103) eliminating a scanning point, of which a separation amount from a fitting plane is a specified value or greater, as a noise point from among the multiple scanning points (302).
- The surveying device (100) according to any one of claims 1 to 5, wherein the separation amount is a distance between the specific plane (301), of which the location is identified by the plane determining part (114), and the fitting plane that fits to the multiple scanning points (302) obtained by the laser scanner (109).
- A calibration method of a surveying device (100), characterized in that the calibration method comprises:determining a location of a specific plane (301) by positioning three or more points on the specific plane (301) by using a laser positioning part (200);performing laser scanning of the specific plane (301) by a laser scanner (109) to obtain multiple scanning points (302);calculating a separation amount of the respective multiple scanning points (302) obtained by the laser scanning, from the specific plane (301) of which the location is determined; andcalculating exterior orientation parameters of one or both of the laser positioning part (200) and the laser scanner (109) on a basis of the separation amount.
- A non-transitory computer recording medium storing computer executable instructions for calibrating a surveying device (100), characterized in that the computer executable instructions, when executed by a computer processor, cause the computer processor to:determine a location of a specific plane (301) by positioning three or more points on the specific plane (301) by using a laser positioning part (200);perform laser scanning of the specific plane by a laser scanner (109) to obtain multiple scanning points (302);calculate a separation amount of the respective multiple scanning points (302) obtained by the laser scanning, from the specific plane (301) of which the location is determined; andcalculate exterior orientation parameters of one or both of the laser positioning part (200) and the laser scanner (109) on a basis of the separation amount.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017233469A JP7007167B2 (en) | 2017-12-05 | 2017-12-05 | Surveying equipment, surveying equipment calibration method and surveying equipment calibration program |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3495769A1 EP3495769A1 (en) | 2019-06-12 |
EP3495769B1 true EP3495769B1 (en) | 2021-01-13 |
Family
ID=64331740
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18206442.8A Active EP3495769B1 (en) | 2017-12-05 | 2018-11-15 | Surveying device, and calibration method and calibration program for surveying device |
Country Status (3)
Country | Link |
---|---|
US (1) | US11460561B2 (en) |
EP (1) | EP3495769B1 (en) |
JP (1) | JP7007167B2 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP4242584A1 (en) | 2022-03-11 | 2023-09-13 | Leica Geosystems AG | A reference free calibration method for a point cloud measuring module combined with a geodetic single point measurement unit |
EP4361558A1 (en) | 2022-10-24 | 2024-05-01 | Leica Geosystems AG | A point cloud aided calibration of a combined geodetic survey instrument |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200410373A1 (en) * | 2019-06-27 | 2020-12-31 | Mohamad Zaim BIN AWANG PON | Predictive analytic method for pattern and trend recognition in datasets |
JP7300915B2 (en) * | 2019-07-16 | 2023-06-30 | 株式会社トプコン | surveying equipment |
CN110837080B (en) * | 2019-10-28 | 2023-09-05 | 武汉海云空间信息技术有限公司 | Rapid calibration method of laser radar mobile measurement system |
EP3825720B1 (en) * | 2019-11-19 | 2024-03-27 | Leica Geosystems AG | Laser scanner with calibration functionality |
CN113466834A (en) * | 2020-03-12 | 2021-10-01 | 华为技术有限公司 | Laser radar parameter calibration method and device |
US20210325520A1 (en) * | 2020-04-17 | 2021-10-21 | Velodyne Lidar, Inc. | Systems and Methods for Calibrating a LIDAR Device |
JP2022023592A (en) | 2020-07-27 | 2022-02-08 | 株式会社トプコン | Survey system, survey method and program for survey |
JP7452797B2 (en) | 2020-08-06 | 2024-03-19 | 株式会社イクシス | measurement system |
JP7449506B2 (en) | 2020-08-06 | 2024-03-14 | 株式会社イクシス | measurement system |
CN112485774B (en) * | 2020-11-26 | 2024-03-15 | 中国第一汽车股份有限公司 | Vehicle-mounted laser radar calibration method, device, equipment and storage medium |
CN113722331A (en) * | 2021-09-09 | 2021-11-30 | 中国铁建国际集团有限公司 | Scanning method, device and system based on total station |
EP4155664A1 (en) * | 2021-09-27 | 2023-03-29 | Leica Geosystems AG | Measuring device comprising a targeting unit and a scanning module |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019032588A1 (en) * | 2017-08-11 | 2019-02-14 | Zoox, Inc. | Vehicle sensor calibration and localization |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS5124319B2 (en) | 1972-11-11 | 1976-07-23 | ||
JP5263804B2 (en) | 2007-04-20 | 2013-08-14 | 株式会社トプコン | Multipoint measuring method and surveying device |
JP5124319B2 (en) | 2008-03-21 | 2013-01-23 | 株式会社トプコン | Surveying instrument, surveying system, measuring object detection method, and measuring object detection program |
JP5688876B2 (en) | 2008-12-25 | 2015-03-25 | 株式会社トプコン | Calibration method for laser scanner measurement system |
EP3901653A3 (en) | 2010-05-17 | 2022-03-02 | Velodyne Lidar USA, Inc. | High definition lidar system |
JP5580164B2 (en) * | 2010-10-18 | 2014-08-27 | 株式会社トプコン | Optical information processing apparatus, optical information processing method, optical information processing system, and optical information processing program |
JP5725922B2 (en) | 2011-03-25 | 2015-05-27 | 株式会社トプコン | Surveying system, surveying pole used in this surveying system, and portable wireless transceiver used in this surveying system |
EP2620745A1 (en) * | 2012-01-30 | 2013-07-31 | Hexagon Technology Center GmbH | Measuring system with a measuring device and a scan module |
JP2013190272A (en) * | 2012-03-13 | 2013-09-26 | Kyushu Univ | Three-dimensional laser measuring apparatus and three-dimensional laser measuring method |
US10132928B2 (en) | 2013-05-09 | 2018-11-20 | Quanergy Systems, Inc. | Solid state optical phased array lidar and method of using same |
JP6234169B2 (en) * | 2013-10-31 | 2017-11-22 | 三菱重工業株式会社 | Three-dimensional shape measuring apparatus, method and program |
JP6368669B2 (en) | 2015-03-17 | 2018-08-01 | ソニーセミコンダクタソリューションズ株式会社 | Display device and correction method |
JP6498528B2 (en) * | 2015-05-28 | 2019-04-10 | 株式会社トプコン | Surveying equipment |
JP6906916B2 (en) | 2016-09-06 | 2021-07-21 | 株式会社トプコン | Image processing device, image processing method, image processing program |
JP2019090653A (en) * | 2017-11-13 | 2019-06-13 | 株式会社トプコン | Surveying device, calibration confirmation method for surveying device, and program for surveying device calibration confirmation |
-
2017
- 2017-12-05 JP JP2017233469A patent/JP7007167B2/en active Active
-
2018
- 2018-11-15 EP EP18206442.8A patent/EP3495769B1/en active Active
- 2018-11-30 US US16/205,420 patent/US11460561B2/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019032588A1 (en) * | 2017-08-11 | 2019-02-14 | Zoox, Inc. | Vehicle sensor calibration and localization |
Non-Patent Citations (1)
Title |
---|
SAMUEL RONDEEL ET AL: "Calibration, Validation, and Verification of Static Terrestrial Laser Scanning for Professional Land Surveying of 3D Boundaries", 1 January 2017 (2017-01-01), XP055707513, Retrieved from the Internet <URL:https://prism.ucalgary.ca/bitstream/handle/11023/3981/ucalgary_2017_rondeel_samuel.pdf?sequence=1&isAllowed=y> DOI: 10.11575/PRISM/25193 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP4242584A1 (en) | 2022-03-11 | 2023-09-13 | Leica Geosystems AG | A reference free calibration method for a point cloud measuring module combined with a geodetic single point measurement unit |
EP4361558A1 (en) | 2022-10-24 | 2024-05-01 | Leica Geosystems AG | A point cloud aided calibration of a combined geodetic survey instrument |
Also Published As
Publication number | Publication date |
---|---|
EP3495769A1 (en) | 2019-06-12 |
US20190170865A1 (en) | 2019-06-06 |
JP7007167B2 (en) | 2022-01-24 |
JP2019100915A (en) | 2019-06-24 |
US11460561B2 (en) | 2022-10-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3495769B1 (en) | Surveying device, and calibration method and calibration program for surveying device | |
EP3483554B1 (en) | Calibration checking method for surveying device | |
KR101703774B1 (en) | Calibration method for a device having a scan function | |
EP1903304B1 (en) | Position measuring system, position measuring method and position measuring program | |
EP2096405B1 (en) | Calibration of a surveying instrument | |
JP6823482B2 (en) | 3D position measurement system, 3D position measurement method, and measurement module | |
EP3274648B1 (en) | Device system and method for determining the relative orientation between two different locations | |
CN102239422B (en) | Telescope based calibration of a three dimensional optical scanner | |
US11085794B2 (en) | Surveying device | |
US10634795B2 (en) | Rover and rover measuring system | |
US20160102977A1 (en) | Surveying Instrument | |
EP3677870B1 (en) | Surveying instrument and photogrammetric method | |
JP7345377B2 (en) | Alignment measurement system, information processing device, alignment measurement method and program | |
KR101723295B1 (en) | Measuring device | |
JP2021067615A (en) | Scanner system and scan method | |
US20240112327A1 (en) | Bar arrangement inspection system and bar arrangement inspection method | |
JP2023048409A (en) | Survey system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20191212 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20200821 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: SASAKI, YOU |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602018011805 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: VALIPAT S.A. C/O BOVARD SA NEUCHATEL, CH |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1354911 Country of ref document: AT Kind code of ref document: T Effective date: 20210215 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1354911 Country of ref document: AT Kind code of ref document: T Effective date: 20210113 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20210113 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210414 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210413 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210513 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210413 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210513 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602018011805 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
26N | No opposition filed |
Effective date: 20211014 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210513 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211115 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211130 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20211130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211115 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211130 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210113 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20221115 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20181115 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221115 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230929 Year of fee payment: 6 Ref country code: CH Payment date: 20231202 Year of fee payment: 6 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210113 |