WO2003065073A1 - A method for field calibration of system parameters in a multibeam echo sounder system - Google Patents

A method for field calibration of system parameters in a multibeam echo sounder system Download PDF

Info

Publication number
WO2003065073A1
WO2003065073A1 PCT/NO2003/000012 NO0300012W WO03065073A1 WO 2003065073 A1 WO2003065073 A1 WO 2003065073A1 NO 0300012 W NO0300012 W NO 0300012W WO 03065073 A1 WO03065073 A1 WO 03065073A1
Authority
WO
WIPO (PCT)
Prior art keywords
strips
parameters
vessel
vector
equation
Prior art date
Application number
PCT/NO2003/000012
Other languages
French (fr)
Inventor
Jan Terje BJØRKE
Original Assignee
Bjoerke Jan Terje
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bjoerke Jan Terje filed Critical Bjoerke Jan Terje
Publication of WO2003065073A1 publication Critical patent/WO2003065073A1/en
Priority to DK200401289A priority Critical patent/DK200401289A/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/52004Means for monitoring or calibrating
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/89Sonar systems specially adapted for specific applications for mapping or imaging
    • G01S15/8902Side-looking sonar

Definitions

  • the present invention relates in general to echo sounding, and more particularly to so-called multibeam echo sounder systems.
  • the invention con- 5 cerns a method for field calibration of system parameters in multibeam echo sounder systems for seabed mapping, in which method a vessel carries multibeam transducer equipment mounted underneath said vessel for swath coverage of plural depth values in a plane generally perpendicular to the vessel travel direction, emitting sonar energy in a number of different 10 angles to the vertical and receiving reflected sonar energy along the same angles, completing a survey strip by travelling straight ahead a given distance, overlapping survey strips are provided by running said vessel in opposite or crossing directions, and the survey strips are transformed to a common reference system by re- i5 sampling recorded reflection time measurement values to establish grid models, the system parameters being parameters in a parameter group including offset in vessel roll, pitch, yaw, vessel travel direction, direction in horizontal plane orthogonal to the vessel travel direction, vertical depth direction, scale factor in a swath direction,
  • multibeam system A relatively new system in the field of underwater acoustics is the so-called multibeam system.
  • This system can be used to obtain the geometry of the seabed below the vessel on which it is mounted. Information about the geometry of the seabed is important and can be used for many applications, e.g. dredging or making bathymetric maps.
  • 25 In contrast to the traditional echo sounder, which uses only one vertically aimed beam, multibeam is able to measure much more data during a shorter time interval, because it transmits many beams simultaneously.
  • Multibeam systems are usually mounted below a ship's hull and produce a fan-shaped beam pattern. Many beams are emitted at once using beamwidths of 3 o approximately 2° angle in cross-track direction.
  • Diffraction Due to diffraction, only a small part of the emitted energy will return to the transducer. Diffraction causes acoustic energy to be spread in all possible directi- ons as a result of irregularities on the sea bottom.
  • the present invention does however not deal with the aspect of recording the single echo signals correctly, so for the purposes of the present invention we suppose that single footprint reflections are recorded correctly.
  • the multibeam system however, has to cope with a lot of extra errors, as a consequence of the fan-shaped beam-pattern.
  • the propagation of these errors into the resulting 3D coordinates and the precision of the multibeam measurements are aspects which have been investigated thoroughly the last few years.
  • the method computes roll, pitch, yaw (heading) and time delay.
  • the drawback of this procedure is low accuracy due to the ignorance of the correlation between the parameters to be estimated, and that the method does not utilize neither crossing strips nor more than two overlapping strips.
  • the prior art method does not even consider the problem of gradient computation, and does not describe how to compute adjusted depth values of overlapping strips. Nor does it deal with any evaluation of the reliability of computed parameters. Finally, this prior art method presents only a very general set of calibration parameters, and not all of the parameters are closely related to the operational characteristic of field calibration. (For example the parameter dsj can only be determined if the true seabed is known, which means that it is impossible to determine this parameter from field calibration, unless the seafloor is known from other measurements.)
  • the present invention sets out to remedy or at least alleviate the problems of the prior art as discussed above.
  • X is a vector of unknown calibration parameters
  • Ai is a coefficient matrix
  • Pi is a weight matrix of the measured depth values
  • l_ ⁇ is a vector of the differences between a mean value H*(u) and Hj(u), where
  • n is the number of overlapping strips in grid point u and Hj(u) is the depth value of strip i in u, l_ 2 is a vector of a priori parameter values, and P 2 is a weight matrix of parameters to be computed.
  • the present invention provides primarily a method for field calibration of system parameters like offset in roll, pitch, yaw, x, y and scale, but the invention will also provide a method for computation of an adjusted terrain model from overlapping multibeam strips, i.e. block adjustment.
  • the method of the present invention will accept crossing strips as well as an infinite number of strips, i.e. limited only by the computer memory.
  • the method does not rely on objects with known shape and position like some prior art solutions.
  • the inventive method is quite efficient for computing the gradient field of the terrain relief, i.e. with regard to processing time and accuracy.
  • measured strips are compared to an approximation of the true surface, which is another advantage.
  • the method of the present invention also presents a comprehensive method for evaluation of the reliability of parameters that have been computed, and the set of calibration parameters is well defined.
  • Fig. 1 is a sketch showing the general geometry of the survey situation
  • Fig. 2 is an illustration of crossing and overlapping survey strips
  • Fig. 3 illustrates the use of closest neighbour grid points for gradient computation. It is first referred to fig. 1 , in which a survey vessel 10 sails along a direction x while making echo sounder measurements of the sea bottom 20. A multi-beam technique is used, whereby a number of ultrasound rays 2 are emitted simultaneously in different directions in a "fan” transverse to the x direction, hitting the seabed in small “footprint” areas (4).
  • the collection of footprints/rays per swath usu- ally is between 80 and 260.
  • the different rays 2 are produced by different transducers in a transducer array 8 arranged preferably at the bottom of the vessel 10.
  • the transducer array position defines an origin of coordinates, however a moving origin.
  • the transducer array 8 fires "pings" (all transducers simultaneously) to cover successive swaths 6 as the vessel advances along the x direction.
  • Swath width is usually comparable to water depth, often 2x - 6x water depth, or even wider, and travel distance between two successive swaths will be comparable to the footprint (4) diameter. However, all these parameters can be varied within wide limits.
  • a "strip" 12 is generated as a collection of all successive swaths 6.
  • a set of overlapping such strips 12 of terrain are used to compute the static offset of roll, pitch, yaw, x, y, scale and time delay.
  • Horizontal scale factor dm y is introduced as a common parameter for all the strips. This parameter is efficient to model errors in the sound speed.
  • the strips must run in different directions; opposite directions or crossing directions, see the example in Fig. 2.
  • Fig. 2 the vessel run directions are indicated by means of arrows.
  • the four strips are indicated by reference numerals 12a, 12b, 12c, 12d.
  • the accuracy of the computed offset corrections depends on the number of the overlapping strips, their configuration and the relief of the seabed. Resampling to a common reference system
  • the strips are transformed to a common reference system by resampling the measurements to grid models.
  • the grid procedure is crucial to the calibration procedure. Therefore, accurate interpolation like kriging (see for example Hans Wackemagel, "Multivariate geostatistics", Springer, Paris, second edition, 1998), an inverse distance polynomial method or Delauney triangulation must be applied.
  • this model can be introduced by defining
  • dm and dH 0 cannot be determined.
  • dHj factor where i is the strip number, i.e. we compute the relative vertical translation of the strips.
  • H* is computed from Equation 1 , i.e. we base the computation of the 9-polynomial coefficients on the mean model, derived from the overlapping strips.
  • the coefficients of the 9-polynomial is computed from the nine neighbouring grid points 16 as shown in Fig. 3.
  • Grid point p among the nine points is the point (x p , y p ), and the grid is designated by reference numeral 14.
  • Equation 5 we compute the gradient in (x p , y p ) from the first derivative of the 9-polynomial as
  • Equation 7 we can set up the equation for least-squares adjustment as
  • X (A ⁇ PA) "1 A T PL (8)
  • X is the vector of the calibration parameters
  • A is the coefficient matrix
  • P is the weight matrix
  • L is the discrepancy vector.
  • X is a vector of the unknown calibration parameters.
  • the forthcoming sec- tion will show how X is derived from Equation 12;
  • a ⁇ is the coefficient matrix.
  • Ai is derived from Table 2;
  • Pi is the weight matrix of the measured depth values.
  • the forthcoming section will show how Pi is derived from Equation 13;
  • Li is a vector of the differences between the mean value H*, which is defined in Equation 1 , and the measured value Hj(u) of grid point u in strip i, i.e.
  • L 2 is a vector of the a priori parameter values.
  • the forthcoming section will show how the initial values of P 2 are derived from Table 3.
  • the weight matrix P 2 offers great flexibility in the design of the parameters to be computed. A large value of an element in P 2 , for example, will fix the corresponding offset value to its parameter value in L 2 .
  • the unknown parameters in vector X are related to a) parameters which are individual for the strips, b) parameters which are common for all the strips, c) other parameters; for example calibration parameters related to the speed of the vessel or parameters which are individual for the beams.
  • Equation 12 The parameters of Equation 12 are described in Tables 1 and 2. The weight of the measured depth values
  • the weight matrix Pi in Equation 10 describes the weight of the observed depth values.
  • the correlation and the variances of the measurements can be introduced into P-j, but for operational purposes we will define
  • the diagonal elements of Pi are equal to 1 and the other elements of P-j are equal to zero.
  • the weight matrix P 2 in Equation 9 offers great flexibility in the design of the parameters. High value of the weight, for example, will fix its parameter to the initial parameter value.
  • the values given by Table 3 can be taken as guidelines for appropriate weight values.
  • the variance/covariance matrix Q x of the unknown parameters is computed from the adjustment, see for example Alfred Leick, “GPS: Satellite surveying", John Wiley & Sons, Inc., USA, second edition, 1995, page 126, as
  • the accuracy of the computed parameters is related to the number of strips, the amount of overlap between the strips, the run direction of the strips, the relief of the sea floor, and the sea depth.
  • the computation of the standard deviation of the parameters from Equation 14 gives an estimate of the accuracy of the parameters, but it does not evaluate all the error sources of the computation as: (1 ) the accuracy of the resampling or (2) the accuracy of the gradient computation.
  • the correlation may have several local minima due to the shape of the seabed relief.
  • the stability of the system of equations can be evaluated from simulation. The following example demonstrates the simulation developed for the purpose considered.
  • Equation 12 the calibration is computed following the ordinary calibration procedure as described by Equation 9.
  • the first round gives vector Ci of calibration values.
  • Ci + C° the parameter values given by Ci + C°
  • is a vector of offset values
  • appropriate values of C° are given in Table 4.
  • the corrections of the strips are computed from the differential corrections given in Table 2.
  • the calibration values from the second round are given by vector C 2 .
  • the difference between C 2 and C° is an expression for the reliability of the calibration. Ideally, C 2 should be equal to C°, but due to many error sources, the two may be different. If the relative value
  • the test developed is very important, since it gives a comprehensive control of the calibration. Generally, it is hard to prove that a computer programme works as it should. The previous test however, covers both the implementation of the calibration procedure, the gradient model and the configuration of the measurements used in the calibration.
  • the adjusted depth values can be computed from a similar procedure as the calibration.
  • the parameter values are calculated from the calibration.
  • the measured strips are transformed according to the differential corrections given by Equation 4.
  • the new surface model is computed as the weighted mean model of the overlapp- ing strips. From the gridded strips the adjusted depth value ⁇ (u) in grid point u is computed as
  • n is the number of the overlapping strips in grid point u
  • Hj(u) is the depth value of strip I in u
  • pj(u) is a weight computed according to the inverse distance function as
  • the method of the present invention does not require knowledge of the true shape of the terrain surface, but overlapping strips must be desig- ned so that the effect of the error sources can be measured. Two totally overlapp- ing strips running in opposite directions, for example, will maximize the effect of static error on several of the system parameters.
  • the strips are matched together by the application of: (1) a gradient method and (2) least-squares adjustment with weighted parameters. All the error sources are computed simultaneously. Their variance/covariance is computed. In addition to the variance computation, the reliability of the computed parameters is evaluated from a simulation procedure. Since the measurement of the different strips does not refer to a common point pattern, the measurements are resampled to a regular grid. The resampling requires interpolation procedures as kriging or Delaunay triangulation.
  • the computation of the gradient can be based on another subset of data points than the nine neighboring points, e.g., more than nine points combined with least squares computation of the coefficients in Equation 5.
  • the computation of the gradient can be based on other mathematical surfaces than the surface defined by Equation 5, e.g., other coefficients of the bi-cubic polynomial than the nine coefficients given by Equation 5.
  • Equation 12 Other calibration parameters than the parameters given by Equation 12 can be introduced, for example, parameters for the individual beams. This can be of particular interest for the outer beams.
  • outliers can be removed from the data set by some kind of thresholding, e.g. by removing the measured depths which deviate more than a certain value from the computed mean value.
  • the differential corrections of Equation 4 assume that yaw and pitch are approximately equal to zero. If this is not the case, the differentiation cannot be based on the simplification considered.
  • the general formulae of the differential corrections can be of interest for multibeam echo sounders mounted on submarines or other similar crafts.
  • a multiresolution grid based on e.g. "quadtree tessellation”. This kind of grid can adapt the grid to the density of the measured depth points.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)

Abstract

A seagoing vessel carries multibeam echo sounder transducer equipment for swath coverage of the sea floor for mapping thereof, covering a survey strip by traveling a given distance. Overlapping such strips are provided by running the vessel in opposite or crossing directions. The survey strips are transformed to a common reference system by resampling recorded reflection time measurement values to establish grid models. In order to execute field calibration of system parameters like offset in vessel roll (ϕ), pitch (ω), yaw (κ), vessel travel direction (x), direction (y) in horizontal plane orthogonal to said vessel travel direction, vertical depth direction (H), scale factor (my) in a swath direction, angular scale factor (mϕ) and time delay (τ), a difference between measured survey strips and an approximation of a true sea floor relief is minimized, using the equation: X = (N1 + P2)-1 (U1 + P2L2) where formula I and X is a vector of unknown calibration parameters, A1 is a coefficient matrix, P1 is a weight matrix of the measured depth values, L1 is a vector of the differences between a mean value H*(u) and Hi(u), where formula II and n is the number of overlapping strips in grid point u and Hi(u) is the depth value of strip i in u, L2 is a vector of a priori parameter values, and P2 is a weight matrix of parameters to be computed.

Description

A method for field calibration of system parameters in a multibeam echo sounder system
The present invention relates in general to echo sounding, and more particularly to so-called multibeam echo sounder systems. Precisely, the invention con- 5 cerns a method for field calibration of system parameters in multibeam echo sounder systems for seabed mapping, in which method a vessel carries multibeam transducer equipment mounted underneath said vessel for swath coverage of plural depth values in a plane generally perpendicular to the vessel travel direction, emitting sonar energy in a number of different 10 angles to the vertical and receiving reflected sonar energy along the same angles, completing a survey strip by travelling straight ahead a given distance, overlapping survey strips are provided by running said vessel in opposite or crossing directions, and the survey strips are transformed to a common reference system by re- i5 sampling recorded reflection time measurement values to establish grid models, the system parameters being parameters in a parameter group including offset in vessel roll, pitch, yaw, vessel travel direction, direction in horizontal plane orthogonal to the vessel travel direction, vertical depth direction, scale factor in a swath direction, angular scale factor, and time delay. 20 A relatively new system in the field of underwater acoustics is the so-called multibeam system. This system can be used to obtain the geometry of the seabed below the vessel on which it is mounted. Information about the geometry of the seabed is important and can be used for many applications, e.g. dredging or making bathymetric maps. 25 In contrast to the traditional echo sounder, which uses only one vertically aimed beam, multibeam is able to measure much more data during a shorter time interval, because it transmits many beams simultaneously.
Multibeam systems are usually mounted below a ship's hull and produce a fan-shaped beam pattern. Many beams are emitted at once using beamwidths of 3o approximately 2° angle in cross-track direction.
Many different designs of multibeam systems exist, but they are all based on the same principle. A large array of transducers emits many beams of acoustic pulses simultaneously. Depending on the water depth, the speed of the vessel and the beam angle, it may be possible to cover swaths up to 7 to 8 times the water depth below the transducer.
Due to diffraction, only a small part of the emitted energy will return to the transducer. Diffraction causes acoustic energy to be spread in all possible directi- ons as a result of irregularities on the sea bottom.
The present invention does however not deal with the aspect of recording the single echo signals correctly, so for the purposes of the present invention we suppose that single footprint reflections are recorded correctly.
Looking at the appended fig. 1 , we see, thus, that a complete measurement session, called "a strip", consists of many successive swaths executed as the vessel sails along.
The multibeam system however, has to cope with a lot of extra errors, as a consequence of the fan-shaped beam-pattern. The propagation of these errors into the resulting 3D coordinates and the precision of the multibeam measurements are aspects which have been investigated thoroughly the last few years.
In the mapping community there is a growing need for accurate digital elevation models. Such data are frequently used to calculate slope, aspect, inter visibility and perspective views. The new generation multibeam echo sounder systems measure the terrain elevation with high precision, and GPS or other geodetic systems determine the position of the sensors with high precision. Therefore, there is a pressing need for accurate calibration of the systems considered. Since the multibeam echo sounder is integrated into complex computer systems, there are many error sources. Field calibration, therefore, is a very important tool to verify that all the static error sources are properly corrected and that the random mea- surement error is lower than a given threshold.
From Andre Godin: "Field procedures for the calibration of shallow water multibeam echo-sounding systems", Canadian Hydrographic Conference, June 1996, Halifax, Nova Scotia, Canadian Hydrographic Service and from the Internet article http://crunch.tec.army.mil/information/publications/multibeam/multibeam.html is known a calibration method that is related to the present invention. However, this previous method does not consider three-dimensional movement of measured points, so that it is not able to model the interrelationship between a change of depth and change of the planar coordinates (x, y). This is a clear drawback. Another method is known from an "Operator Manual: Neptune, Bathymetric Post-Processing", Kongsberg Simrad AS, P.O. Box 111 , N-3191 Horten, Norway. This is a calibration method based on a step by step procedure. The method computes roll, pitch, yaw (heading) and time delay. The drawback of this procedure is low accuracy due to the ignorance of the correlation between the parameters to be estimated, and that the method does not utilize neither crossing strips nor more than two overlapping strips.
However, the closest prior art known to the inventor of the present invention, is believed to be the article "A study of digital correlation methods in post pro- cessing of multibeam sounder data", Jan Terje Bjørke and Ivar Maalen-Johansen, Kart og Plan no. 5, 1987, Universitetsforlaget, Oslo, Norway, pp. 473-477. This article shows how a gradient method and a least squares method can be used to match multibeam strips. However, only two strips can be matched, and correlation is only defined relative to a strip, not to a true surface or an approximation thereto. Further, this prior art method suffers from constraints like moving images (i.e. measurement sets of the strips) as short distances as possible from their initial positions, during the correlation. Further, the prior art method does not even consider the problem of gradient computation, and does not describe how to compute adjusted depth values of overlapping strips. Nor does it deal with any evaluation of the reliability of computed parameters. Finally, this prior art method presents only a very general set of calibration parameters, and not all of the parameters are closely related to the operational characteristic of field calibration. (For example the parameter dsj can only be determined if the true seabed is known, which means that it is impossible to determine this parameter from field calibration, unless the seafloor is known from other measurements.)
The present invention sets out to remedy or at least alleviate the problems of the prior art as discussed above.
In accordance with the present invention there is provided a method for field calibration of system parameters such as defined in the introduction, and the met- hod is characterized by minimizing a difference between measured survey strips and an approximation of a true seabed relief, using the equation
Figure imgf000004_0001
where
Figure imgf000005_0001
U, = A^ P, L,
and X is a vector of unknown calibration parameters, Ai is a coefficient matrix, Pi is a weight matrix of the measured depth values, l_ι is a vector of the differences between a mean value H*(u) and Hj(u), where
∑Ht{u)
H * (u) ≡ -
and n is the number of overlapping strips in grid point u and Hj(u) is the depth value of strip i in u, l_2 is a vector of a priori parameter values, and P2 is a weight matrix of parameters to be computed.
Preferred embodiments of the method of the invention appear from the appended dependent claims 2-6.
Thus, it appears that the present invention provides primarily a method for field calibration of system parameters like offset in roll, pitch, yaw, x, y and scale, but the invention will also provide a method for computation of an adjusted terrain model from overlapping multibeam strips, i.e. block adjustment.
The method of the present invention will accept crossing strips as well as an infinite number of strips, i.e. limited only by the computer memory. The method does not rely on objects with known shape and position like some prior art solutions. Further, the inventive method is quite efficient for computing the gradient field of the terrain relief, i.e. with regard to processing time and accuracy. In the method, measured strips are compared to an approximation of the true surface, which is another advantage. The method of the present invention also presents a comprehensive method for evaluation of the reliability of parameters that have been computed, and the set of calibration parameters is well defined.
In the following, the method of the present invention shall be explained in more detail by means of descriptions of preferred embodiments, and it is at the same time referred to the appended drawings, of which Fig. 1 is a sketch showing the general geometry of the survey situation,
Fig. 2 is an illustration of crossing and overlapping survey strips, and
Fig. 3 illustrates the use of closest neighbour grid points for gradient computation. It is first referred to fig. 1 , in which a survey vessel 10 sails along a direction x while making echo sounder measurements of the sea bottom 20. A multi-beam technique is used, whereby a number of ultrasound rays 2 are emitted simultaneously in different directions in a "fan" transverse to the x direction, hitting the seabed in small "footprint" areas (4). The collection of footprints/rays per swath usu- ally is between 80 and 260.
The different rays 2 are produced by different transducers in a transducer array 8 arranged preferably at the bottom of the vessel 10. The transducer array position defines an origin of coordinates, however a moving origin.
The transducer array 8 fires "pings" (all transducers simultaneously) to cover successive swaths 6 as the vessel advances along the x direction. Swath width is usually comparable to water depth, often 2x - 6x water depth, or even wider, and travel distance between two successive swaths will be comparable to the footprint (4) diameter. However, all these parameters can be varied within wide limits. As the vessel 10 completes a predetermined survey distance along the x direction, a "strip" 12 is generated as a collection of all successive swaths 6.
In the present invention, a set of overlapping such strips 12 of terrain are used to compute the static offset of roll, pitch, yaw, x, y, scale and time delay. Horizontal scale factor dmy is introduced as a common parameter for all the strips. This parameter is efficient to model errors in the sound speed. The method introduces another scale factor drriφ which is associated to the angle of the beams, i.e. dψ = φdnriφ. This angle scale factor is efficient to model the angular error of the outer beams.
The strips must run in different directions; opposite directions or crossing directions, see the example in Fig. 2. In Fig. 2 the vessel run directions are indicated by means of arrows. The four strips are indicated by reference numerals 12a, 12b, 12c, 12d.
The accuracy of the computed offset corrections depends on the number of the overlapping strips, their configuration and the relief of the seabed. Resampling to a common reference system
The strips are transformed to a common reference system by resampling the measurements to grid models. The grid procedure is crucial to the calibration procedure. Therefore, accurate interpolation like kriging (see for example Hans Wackemagel, "Multivariate geostatistics", Springer, Paris, second edition, 1998), an inverse distance polynomial method or Delauney triangulation must be applied.
The computation of the approximated surface
From the gridded strips an approximation H*(u) to the true seabed relief is computed as
∑H )
H * (u) ≡ (=1
(1 )
where n i s t he n umber o f t he o veriapping s trips i n g rid p oint u and H j(u) i s t he depth value of strip i in u. If less t han two strips overlap in u, the grid point is marked no value, else H*(u) is set to the mean value of the overlapping strips according to Equation 1.
If the true terrain relief H is known, this model can be introduced by defining
H* = H (2)
The geometry model
We assume, as previously mentioned, a coordinate system with center (Xo, Yo, Ho) in the transducer; the positive X-axis in the strip direction, the Y-axis in the swath direction, i.e. across the strip direction, and the positive H-axis pointing to the center of the earth, see Fig. 1. The coordinates of the measured points are computed as
Figure imgf000007_0002
Figure imgf000007_0001
where Rκ and Rω are the rotation matrices for yaw and pitch, respectively. Usually, the multibeam echo sounder system is designed so that ΛΓ « 0 and ω«0. Based on the previous assumption we derive the differential corrections from Equation 3 as
dx y dκ-h dω + dXQ cly h dφ + y dmy + dY0 (4) dh - ydφ+h dmh + dH0
where
1 ) dφ is the roll offset; 2) dω is the pitch offset; 3) di is the yaw offset; 4) dx is the X0 offset; 5) dy is the Yo offset; 6) dHo is the H0 offset; 7) diriy is a scale factor in the swath direction, i.e. in the Y direction, and 8) dmh is a scale factor in the H direction.
Usually, dm and dH0 cannot be determined. As we will show later, we will apply the dHj factor where i is the strip number, i.e. we compute the relative vertical translation of the strips.
The computation of the gradient The computation of the gradient is very crucial to the accuracy of the calibration. Experiments have shown that appropriate values of the gradient of the terrain relief in point (xp, yp) can be computed from the 9-polynomial as H*(x,y) = a00+ aιo(x - x ) + aoι(y - yP) + a11(x - xp)(y - yp) + (5) a2o(x - xP)2 +
Figure imgf000009_0001
2(x - xp)(y - yP)2 + a22(x - xp)2(y - yp)2
where H* is computed from Equation 1 , i.e. we base the computation of the 9-polynomial coefficients on the mean model, derived from the overlapping strips. The coefficients of the 9-polynomial is computed from the nine neighbouring grid points 16 as shown in Fig. 3. Grid point p among the nine points is the point (xp, yp), and the grid is designated by reference numeral 14. From Equation 5 we compute the gradient in (xp, yp) from the first derivative of the 9-polynomial as
5HX = a™ and δHy = a0ι (6)
Least squares approximation
When the partial gradients 5HX and δHy are known, we can compute the H component of a translation in X and Y. Therefore, we can combine the differential corrections in Equation 4 as
dH = SHxy dK - 5Hxh dω +
(SHyh - y)dφ +
5HxdXo + 5HydYo + (7) dH0 + δHyy dmy + h dmh
From Equation 7 we can set up the equation for least-squares adjustment as
X = (Aτ PA)"1ATPL (8) where X is the vector of the calibration parameters, A is the coefficient matrix, P is the weight matrix and L is the discrepancy vector.
If it should happen that some of the parameters cannot be determined by the equations considered, the computation will fail. In order to prevent numerical problems of the kind considered, we apply the method of weighted parameters, see for example Alfred Leick, "GPS: Satellite surveying", John Wiley & Sons, Inc., USA, second edition, 1995, page 126. In the case of weighted parameters the offset parameters are computed from
X = (Ni + P2)'1 (Ui + P2 L2) (9)
where
, = A^ P, A,
IX = Ax τ P, L, (10)
where
a) X is a vector of the unknown calibration parameters. The forthcoming sec- tion will show how X is derived from Equation 12; b) Aι is the coefficient matrix. The forthcoming section will show how Ai is derived from Table 2; c) Pi is the weight matrix of the measured depth values. The forthcoming section will show how Pi is derived from Equation 13; d) Li is a vector of the differences between the mean value H*, which is defined in Equation 1 , and the measured value Hj(u) of grid point u in strip i, i.e.
Ln(u) = H*(u) - Hi(u) (11)
e) L2 is a vector of the a priori parameter values. Usually, L2 = 0; f) P2 is the weight matrix of the parameters to be computed. The forthcoming section will show how the initial values of P2 are derived from Table 3. The weight matrix P2 offers great flexibility in the design of the parameters to be computed. A large value of an element in P2, for example, will fix the corresponding offset value to its parameter value in L2. Knowledge of the standard devi- ation σ of the different parameters to be computed can be used to determine the weights of P2, i.e. p = 1/σ2.
The calibration parameters
The unknown parameters in vector X are related to a) parameters which are individual for the strips, b) parameters which are common for all the strips, c) other parameters; for example calibration parameters related to the speed of the vessel or parameters which are individual for the beams.
For operational purposes we have selected the parameters given by
Figure imgf000011_0001
where i is the number of strips. The parameters of Equation 12 are described in Tables 1 and 2. The weight of the measured depth values
The weight matrix Pi in Equation 10 describes the weight of the observed depth values. In principle, the correlation and the variances of the measurements can be introduced into P-j, but for operational purposes we will define
Pι = l (13)
that is, the diagonal elements of Pi are equal to 1 and the other elements of P-j are equal to zero.
The weight of the parameters
The weight matrix P2 in Equation 9 offers great flexibility in the design of the parameters. High value of the weight, for example, will fix its parameter to the initial parameter value. The values given by Table 3 can be taken as guidelines for appropriate weight values.
The variance/covariance matrix of the parameters
The variance/covariance matrix Qx of the unknown parameters is computed from the adjustment, see for example Alfred Leick, "GPS: Satellite surveying", John Wiley & Sons, Inc., USA, second edition, 1995, page 126, as
Qx = (Nι + P2)-X (14)
The correlation of the parameters Very often, pitch offset and X offset are correlated to a high degree. Their correlation coefficient measures how separable the two parameters are. Generally, the correlation coefficient px,x is derived from Qx in Equation 14 as
Figure imgf000012_0001
where Xj and are two parameters. The reliability of the computed calibration parameters
The accuracy of the computed parameters is related to the number of strips, the amount of overlap between the strips, the run direction of the strips, the relief of the sea floor, and the sea depth. The computation of the standard deviation of the parameters from Equation 14 gives an estimate of the accuracy of the parameters, but it does not evaluate all the error sources of the computation as: (1 ) the accuracy of the resampling or (2) the accuracy of the gradient computation. Moreover, the correlation may have several local minima due to the shape of the seabed relief. However, the stability of the system of equations can be evaluated from simulation. The following example demonstrates the simulation developed for the purpose considered.
We assume the parameters given by Equation 12, see their description in Tables 1 and 2. In a first round, the calibration is computed following the ordinary calibration procedure as described by Equation 9. The first round gives vector Ci of calibration values. Before a second round is started, the measured strips are corrected according to the parameter values given by Ci + C°, where C° is a vector of offset values; appropriate values of C° are given in Table 4. The corrections of the strips are computed from the differential corrections given in Table 2. The calibration values from the second round are given by vector C2. The difference between C2 and C° is an expression for the reliability of the calibration. Ideally, C2 should be equal to C°, but due to many error sources, the two may be different. If the relative value
Δ(k) = | C2(k) - C°(k) | / C° (k) > t , (16)
the system is not able to compute reliable values of parameter k. Appropriate values of t and their interpretation are given in Table 5. The interpretation of the test above must consider the weights of the parameters. If Δ(k) « 1 , it may happen that parameter k is given high weight. If the parameter really is to be fixed to its initial value, the calibration is accepted, else the weight should be relaxed.
The test developed is very important, since it gives a comprehensive control of the calibration. Generally, it is hard to prove that a computer programme works as it should. The previous test however, covers both the implementation of the calibration procedure, the gradient model and the configuration of the measurements used in the calibration.
Block adjustment of the depth values The adjusted depth values can be computed from a similar procedure as the calibration. In a first round, the parameter values are calculated from the calibration. Then the measured strips are transformed according to the differential corrections given by Equation 4. When all the strips are corrected, i.e.,
(Hi,Xl, Yl) = f(Hi ' ,Xi ' , Y: ) (17)
for = 1 ... n,
the new surface model is computed as the weighted mean model of the overlapp- ing strips. From the gridded strips the adjusted depth value Η(u) in grid point u is computed as
Figure imgf000014_0001
where n is the number of the overlapping strips in grid point u, Hj(u) is the depth value of strip I in u and pj(u) is a weight computed according to the inverse distance function as
p(u) = Ms2 (19)
where s is the distance from the transducer to point u; see the geometry model in Fig. 1.
To summarize, the method of the present invention does not require knowledge of the true shape of the terrain surface, but overlapping strips must be desig- ned so that the effect of the error sources can be measured. Two totally overlapp- ing strips running in opposite directions, for example, will maximize the effect of static error on several of the system parameters.
Hence, it is possible to measure static errors in multibeam echo sounder systems from overlapping strips. The strips are matched together by the application of: (1) a gradient method and (2) least-squares adjustment with weighted parameters. All the error sources are computed simultaneously. Their variance/covariance is computed. In addition to the variance computation, the reliability of the computed parameters is evaluated from a simulation procedure. Since the measurement of the different strips does not refer to a common point pattern, the measurements are resampled to a regular grid. The resampling requires interpolation procedures as kriging or Delaunay triangulation.
It must be underlined that the description above has been centered around a certain embodiment of the method of the invention, however, several method steps can be varied. For instance, the computation of the gradient can be based on another subset of data points than the nine neighboring points, e.g., more than nine points combined with least squares computation of the coefficients in Equation 5. Further, the computation of the gradient can be based on other mathematical surfaces than the surface defined by Equation 5, e.g., other coefficients of the bi-cubic polynomial than the nine coefficients given by Equation 5.
Other calibration parameters than the parameters given by Equation 12 can be introduced, for example, parameters for the individual beams. This can be of particular interest for the outer beams.
Also, in the computation of the approximate and the adjusted surface in Equations 1 and 18, respectively, one must usually filter out unexpected depth measurements, i.e. outliers. The outliers can be removed from the data set by some kind of thresholding, e.g. by removing the measured depths which deviate more than a certain value from the computed mean value.
The differential corrections of Equation 4 assume that yaw and pitch are approximately equal to zero. If this is not the case, the differentiation cannot be based on the simplification considered. The general formulae of the differential corrections can be of interest for multibeam echo sounders mounted on submarines or other similar crafts. Finally, it is also possible to use a multiresolution grid based on e.g. "quadtree tessellation". This kind of grid can adapt the grid to the density of the measured depth points.

Claims

C L A I M S
1. A method for field calibration of system parameters in multibeam echo sounder systems for seabed mapping, in which method - a vessel carries multibeam transducer equipment mounted underneath said vessel for swath coverage of plural depth values in a plane generally perpendicular to the vessel travel direction, emitting sonar energy in a number of different angles to the vertical and receiving reflected sonar energy along the same angles, completing a survey strip by travelling straight ahead a given distance, - overlapping survey strips are provided by running said vessel in opposite or crossing directions, and the survey strips are transformed to a common reference system by resampling recorded reflection time measurement values to establish grid models, said system parameters being parameters in a parameter group including offset in vessel roll (φ), pitch (ω), yaw ( ), vessel travel direction (x), direction (y) in horizontal plane orthogonal to said vessel travel direction, vertical depth direction (H), scale factor (my) in a swath direction, angular scale factor (mφ) and time delay (τ), c h a r a c t e r i z e d b y - minimizing a difference between measured survey strips and an approximation of a true seabed relief, using the equation
X = (Ni + P2)"1 (Ui + P2 L2) (9)
where
N, = A^ P, A,
U, = A^ P, L, (10)
and X is a vector of unknown calibration parameters, Ai is a coefficient matrix, Pi is a weight matrix of the measured depth values, Li is a vector of the differences between a mean value H*(u) and Hj(u), where
Figure imgf000018_0001
and n is the number of overlapping strips in grid point u and Hj(u) is the depth value of strip i in u, L2 is a vector of a priori parameter values, and P2 is a weight matrix of parameters to be computed.
2. The method of claim 1 , characterized in that gradients 5HX, δHy of the seabed relief in a grid point u = (xp, yp) are computed on the basis of the closest neighbouring grid points, by means of the equations
Figure imgf000018_0002
X~~ Xp X"-Xp y=y y=yP
and
H*(x, y) = a00 +
Figure imgf000018_0003
a0ι(y-yP) +
Figure imgf000018_0004
a20(x-xP)2 + a02(y-yP)2 + a2ι(x-xp)2(y-yP) + a12(x-xp)(y-yp)2 +
Figure imgf000018_0005
where aoo ■■■■ a22 are coefficients that are computed from equation (5) and equation (1) using said neighbouring grid points.
3. The method of claim 1 , characterized in that said difference is minimized also taking into consideration a further system parameter which is a tide correction (dHoi) that is individual for each survey strip (i), the previously mentioned system parameters being common for all the strips.
4. The method of claim 1 , characterized in that differential corrections of system parameters are applied as follows:
parameter description diff. corr. coefficient
dHoi tide correction, strip i 1 dφ roll offset SHyh-y dω pitch offset -5Hxh dK yaw offset δHxy dX0 linear offset along strip δHx dY0 linear offset across strip δHy dmφ angular scale factor (δHyh-y) arctan (y/h] dnriv linear scale factor δHyy dτ time delay 9Hxv
v being vessel speed.
5. The method of claim 4, characterized by executing a reliability test for determined system parameter errors, first defining
t = I C2(k)-C°(k) | / C° (k) (16)
where C° is a vector of simulated offset values regarding all system parameters k, and C2 is a vector of calibration values resulting from two rounds of computing using equation (9), a first round giving a vector Ci of calibration values to be added to vector C° to provide Cι+C°, whereupon a second round of computation using equation (9) is based on the differential corrections, and subsequently evaluating t, t < 0,1 signifying unquestionable reliability and t > 0,9 signifying unquestionable non-reliability.
6. The method of claim 1 , c h a r a c t e r i z e d i n that an adjusted depth value H(u) in grid point u is computed by means of inverse distance weighting, in accordance with the equation
Figure imgf000020_0001
in which pι(u) is a weight computed according to the inverse distance function as
p(u) = s"2 (19)
s being the distance from the transducer to point u,
thereby obtaining block adjustment.
PCT/NO2003/000012 2002-01-28 2003-01-16 A method for field calibration of system parameters in a multibeam echo sounder system WO2003065073A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DK200401289A DK200401289A (en) 2002-01-28 2004-08-26 Method of field calibration of system parameters in a multi-beam sonar system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NO20020430 2002-01-28
NO20020430A NO315766B1 (en) 2002-01-28 2002-01-28 A method for field calibration of system parameters in a multi-jet sonar system

Publications (1)

Publication Number Publication Date
WO2003065073A1 true WO2003065073A1 (en) 2003-08-07

Family

ID=19913260

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NO2003/000012 WO2003065073A1 (en) 2002-01-28 2003-01-16 A method for field calibration of system parameters in a multibeam echo sounder system

Country Status (3)

Country Link
DK (1) DK200401289A (en)
NO (1) NO315766B1 (en)
WO (1) WO2003065073A1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011048224A1 (en) * 2009-10-23 2011-04-28 Thales Method for simultaneously locating and mapping via resilient non-linear filtering
CN104880732A (en) * 2015-06-04 2015-09-02 中国石油天然气集团公司 Method and device for constructing cross subset
US9772400B2 (en) 2013-03-15 2017-09-26 Daniel L. ORANGE System and method for calibration of echo sounding systems and improved seafloor imaging using such systems
CN107807352A (en) * 2017-09-30 2018-03-16 武汉大学 A kind of constant Beamforming Method of offshore platform higher-frequency radar array
CN108919274A (en) * 2018-04-11 2018-11-30 华南理工大学 It is a kind of based on the shallow water of simple beam with wave scanning probe system and its working method
CN109031256A (en) * 2018-07-03 2018-12-18 交通运输部天津水运工程科学研究所 Multibeam echosounder depth measurement and sweep wide feature calibration method
CN109284703A (en) * 2018-09-07 2019-01-29 广州南方测绘科技股份有限公司 Obstacle recognition method, equipment, medium based on acoustics multibeam echosounder
US10429505B2 (en) * 2017-07-03 2019-10-01 R2Sonic, Llc Multi-perspective ensonification system and method
CN114415159A (en) * 2022-01-24 2022-04-29 交通运输部天津水运工程科学研究所 Metering calibration method and device for shallow stratum profiler
CN117907995A (en) * 2024-03-19 2024-04-19 厦门伟卓智慧海洋科技有限公司 Submarine topography detection method and device
CN117907995B (en) * 2024-03-19 2024-06-07 厦门伟卓智慧海洋科技有限公司 Submarine topography detection method and device

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113093159B (en) * 2021-03-01 2023-12-22 中国人民解放军海军大连舰艇学院 Multi-beam sounding error improved model design method
CN115575496A (en) * 2022-09-30 2023-01-06 大连理工大学 High-resolution ultrasonic frequency domain full focusing method based on inverse distance weight

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5033029A (en) * 1983-05-12 1991-07-16 Westinghouse Electric Corp. Interlaced sonar system
US5422860A (en) * 1992-10-23 1995-06-06 Rowe, Deines Instruments Incorporated Correlation sonar system
US5485432A (en) * 1993-12-24 1996-01-16 Stn Atlas Elektronik Gmbh Method of measuring the acoustic backscatter property of the floor of bodies of water
WO2001042808A2 (en) * 1999-12-08 2001-06-14 Stn Atlas Marine Electronics Gmbh Method for determining the mean speed of sound in a body of water

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5033029A (en) * 1983-05-12 1991-07-16 Westinghouse Electric Corp. Interlaced sonar system
US5422860A (en) * 1992-10-23 1995-06-06 Rowe, Deines Instruments Incorporated Correlation sonar system
US5485432A (en) * 1993-12-24 1996-01-16 Stn Atlas Elektronik Gmbh Method of measuring the acoustic backscatter property of the floor of bodies of water
WO2001042808A2 (en) * 1999-12-08 2001-06-14 Stn Atlas Marine Electronics Gmbh Method for determining the mean speed of sound in a body of water

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011048224A1 (en) * 2009-10-23 2011-04-28 Thales Method for simultaneously locating and mapping via resilient non-linear filtering
FR2951830A1 (en) * 2009-10-23 2011-04-29 Thales Sa METHOD OF SIMULTANEOUS LOCATION AND MAPPING BY ELASTICAL NONLINEAR FILTRATION
US9097803B2 (en) 2009-10-23 2015-08-04 Thales Method for simultaneously locating and mapping via resilient non-linear filtering
US10359508B2 (en) 2013-03-15 2019-07-23 Daniel L. ORANGE System and method for calibration of echo sounding systems and improved seafloor imaging using such systems
US9772400B2 (en) 2013-03-15 2017-09-26 Daniel L. ORANGE System and method for calibration of echo sounding systems and improved seafloor imaging using such systems
CN104880732A (en) * 2015-06-04 2015-09-02 中国石油天然气集团公司 Method and device for constructing cross subset
US10429505B2 (en) * 2017-07-03 2019-10-01 R2Sonic, Llc Multi-perspective ensonification system and method
US11428810B2 (en) 2017-07-03 2022-08-30 R2Sonic, Llc Multi-perspective ensonification system and method
CN107807352A (en) * 2017-09-30 2018-03-16 武汉大学 A kind of constant Beamforming Method of offshore platform higher-frequency radar array
CN107807352B (en) * 2017-09-30 2020-07-10 武汉大学 Method for forming invariant beam of high-frequency radar array of offshore platform
CN108919274A (en) * 2018-04-11 2018-11-30 华南理工大学 It is a kind of based on the shallow water of simple beam with wave scanning probe system and its working method
CN108919274B (en) * 2018-04-11 2022-06-14 华南理工大学 Shallow water wave following scanning detection system based on single wave beam and working method thereof
CN109031256A (en) * 2018-07-03 2018-12-18 交通运输部天津水运工程科学研究所 Multibeam echosounder depth measurement and sweep wide feature calibration method
CN109284703A (en) * 2018-09-07 2019-01-29 广州南方测绘科技股份有限公司 Obstacle recognition method, equipment, medium based on acoustics multibeam echosounder
CN114415159A (en) * 2022-01-24 2022-04-29 交通运输部天津水运工程科学研究所 Metering calibration method and device for shallow stratum profiler
CN117907995A (en) * 2024-03-19 2024-04-19 厦门伟卓智慧海洋科技有限公司 Submarine topography detection method and device
CN117907995B (en) * 2024-03-19 2024-06-07 厦门伟卓智慧海洋科技有限公司 Submarine topography detection method and device

Also Published As

Publication number Publication date
NO20020430L (en) 2003-07-29
DK200401289A (en) 2004-08-26
NO315766B1 (en) 2003-10-20
NO20020430D0 (en) 2002-01-28

Similar Documents

Publication Publication Date Title
CN110208812A (en) Unmanned vehicles seabed dimensional topography detection device and method partly latent
Ånonsen et al. An analysis of real-time terrain aided navigation results from a HUGIN AUV
Singh et al. Microbathymetric mapping from underwater vehicles in the deep ocean
CN105258684B (en) Multi-beam based on laser point cloud for constraint is grazed firing angle wave beam method for homing
Nygren Terrain navigation for underwater vehicles
Guerneve et al. Underwater 3d reconstruction using blueview imaging sonar
CN101587187A (en) Method for correcting deviation of depth measuring sonar system
WO2003065073A1 (en) A method for field calibration of system parameters in a multibeam echo sounder system
JP6655022B2 (en) Synthetic antenna sonar and method for forming a synthetic antenna beam
CN111220146B (en) Underwater terrain matching and positioning method based on Gaussian process regression learning
Vàsquez Tuning the CARIS implementation of CUBE for Patagonian Waters
Mohammadloo et al. Correcting multibeam echosounder bathymetric measurements for errors induced by inaccurate water column sound speeds
Johnson et al. Seafloor map generation for autonomous underwater vehicle navigation
JP5074198B2 (en) Method and system for synthetic aperture sonar
Aykut et al. Hydrographic data modeling methods for determining precise seafloor topography
Grządziel et al. Estimation of effective swath width for dual-head multibeam echosounder
Seube et al. Multibeam echo sounders-IMU automatic boresight calibration on natural surfaces
Durá et al. Reconstruction of textured seafloors from side-scan sonar images
Bjorke Computation of calibration parameters for multibeam echo sounders using the least squares method
JP7390366B2 (en) Methods for determining depth or water depth profiles based on average sound velocity profiles, methods for determining such velocity profiles, and associated sonar systems
Canepa et al. A new algorithm for automatic processing of bathymetric data
CN112731409B (en) Multi-beam sounding data optimization method
CN112902931B (en) Method for measuring and eliminating delay between depth measurement data and positioning data of unmanned ship
Makar Reliability of the Digital Sea Bottom Model Sourced by Multibeam Echosounder in Shallow Water
Makar Verification of the Digital Sea Bottom Model Built by Bathymetric Data–Deep Water Study

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP