CN109813283B - Handheld device, method for image-based measurement using a handheld device - Google Patents
Handheld device, method for image-based measurement using a handheld device Download PDFInfo
- Publication number
- CN109813283B CN109813283B CN201811373767.3A CN201811373767A CN109813283B CN 109813283 B CN109813283 B CN 109813283B CN 201811373767 A CN201811373767 A CN 201811373767A CN 109813283 B CN109813283 B CN 109813283B
- Authority
- CN
- China
- Prior art keywords
- image
- camera
- handheld device
- remote object
- analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005259 measurement Methods 0.000 title claims abstract description 45
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000004590 computer program Methods 0.000 claims description 6
- 238000013500 data storage Methods 0.000 claims description 4
- 238000001454 recorded image Methods 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 3
- 238000000926 separation method Methods 0.000 claims 1
- 238000012937 correction Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003252 repetitive effect Effects 0.000 description 2
- 230000002950 deficient Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/08—Arrangements of cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/02—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/04—Interpretation of pictures
- G01C11/06—Interpretation of pictures by comparison of two or more pictures of the same area
- G01C11/12—Interpretation of pictures by comparison of two or more pictures of the same area the pictures being supported in the same relative position as when they were taken
- G01C11/14—Interpretation of pictures by comparison of two or more pictures of the same area the pictures being supported in the same relative position as when they were taken with optical projection
- G01C11/16—Interpretation of pictures by comparison of two or more pictures of the same area the pictures being supported in the same relative position as when they were taken with optical projection in a common plane
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/10—Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with variable angles and a base of fixed length in the observation station, e.g. in the instrument
- G01C3/14—Measuring distances in line of sight; Optical rangefinders using a parallactic triangle with variable angles and a base of fixed length in the observation station, e.g. in the instrument with binocular observation at a single point, e.g. stereoscopic type
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/593—Depth or shape recovery from multiple images from stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/296—Synchronisation thereof; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N2013/0074—Stereoscopic image analysis
- H04N2013/0092—Image segmentation from stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2213/00—Details of stereoscopic systems
- H04N2213/001—Constructional or mechanical details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Health & Medical Sciences (AREA)
- Aviation & Aerospace Engineering (AREA)
- Electromagnetism (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Image Analysis (AREA)
Abstract
A handheld device, a method of image-based measurement using a handheld device. A hand-held device (1) comprising: a housing (10) having a front side (11) and a rear side (12); a first camera (3a) and a second camera (3b) for recording images (51, 52) of an object (5), which are arranged on the rear face (12) and have a stereo base line (30); an analysis unit having an algorithm for performing a stereographic measurement analysis of the images (51, 52) of the cameras (3a, 3 b); and a display unit (20) arranged at the front face (11) for displaying an image (50) of the object (5) and the results of the stereographic measurement analysis, wherein the housing (10) has a longitudinal axis (15), the stereo base line (30) is aligned diagonally with respect to the longitudinal axis (15), and the analysis unit is designed to take into account the relative alignment of the stereo base line (30) during the stereographic measurement analysis.
Description
Technical Field
The invention relates to a handheld device comprising a stereo camera and a method for image-based measurement of a remote object by means of such a device.
Background
Apparatuses and methods for stereographic image recording are generally known in the prior art and are used in various ways for performing measurements in images, i.e. in particular for determining dimensions in images, e.g. distances between depicted features.
For example, EP 2918972 a2 discloses a method and a corresponding hand-held device for generating a spatial model by stereography.
If known stereographic measuring devices are used to record images of artificial and/or man-made structures, such as buildings, errors can occur during automatic matching of the images by feature extraction. This is because modern buildings in particular have many equivalent and repeating features. If the stereo baseline of the stereographic measuring device is coincidentally parallel with the repeat direction during recording, equivalent features in the two images may in some cases be erroneously associated with each other, thus producing incorrectly edited stereo images and defective image measurements performed therein.
Disclosure of Invention
It is therefore an object of the present invention to provide an apparatus and a method by means of which the probability of errors during editing of images in the scope of stereophotogrammetry can be reduced.
In particular, it is an object of the invention to provide such an apparatus and such a method, by means of which the error probability can be reduced without special design expenditure or significantly increased computing power.
Another object is to provide such a device and such a method, which can be handled simply and intuitively by a user.
Since modern buildings in particular are usually planned and constructed straight and have a plurality of right angles, they are aligned with the direction of gravity and with a horizontal line orthogonal thereto. This results in a building where the repeat direction of the same feature (e.g., the window of a window facade) is generally completely horizontal and/or vertical. In the stereo camera device according to the invention, a stereo baseline is therefore used according to the invention, which is arranged diagonally with respect to the longitudinal axis of the device, which longitudinal axis is aligned substantially horizontally during normal use.
A first aspect of the invention relates to a hand-held device for image-based measurement of a remote object, the hand-held device comprising a housing having a front side and a back side; a first camera and a second camera for recording an image of an object, which are provided on the back surface, having a stereo base line as a fixed interval from each other; an analysis unit comprising an algorithm for performing a stereographic measurement analysis of the images of the first and second cameras; and a display unit disposed on the front surface for displaying an image of the subject and a result of the stereographic measurement analysis. The housing has a longitudinal axis and the stereo baseline is aligned diagonally with respect to the longitudinal axis, wherein the analysis unit is designed to take into account the relative alignment of the stereo baseline during the stereophotogrammetric analysis.
According to one embodiment, the device comprises an electronic distance meter, in particular designed as a laser distance meter, which is arranged on the rear side for measuring the distance to the remote object, wherein the analysis unit is designed to take into account the measured distance during the stereographic measurement analysis.
According to another embodiment of the device, the stereo base line is arranged at an angle of at least 20 ° with respect to the longitudinal axis, in particular at an angle of between 30 ° and 60 °.
According to another embodiment, the device is designed for handheld use by a user, so that the device is held with the longitudinal axis substantially horizontal for recording an image of the object.
According to one embodiment, the camera is arranged in such a way that: the stereo baseline comprises at least 75%, in particular at least 90%, of the maximum extension of the back face.
In one embodiment, the device has an input device, which is arranged on the front side, for the input of data and/or commands by a user. The input means may be embodied in particular as buttons, or the display unit and the input means are designed as a touch screen.
The input means are in particular designed to be able to mark or select a pixel in an image of the object by the user, wherein the pixel corresponds to a target point of the object. The analysis unit may be designed to determine the distance between the target points corresponding to the selected pixels and to display this distance on the display unit.
In one embodiment, the device has a recording function which runs automatically upon a user trigger, within the scope of which recording a first image is recorded by the first camera and a second image of the object is recorded by the second camera chronologically, in particular simultaneously; the algorithm of the analysis unit associates the first image and the second image with each other by feature recognition and based on knowledge about the stereoscopic basis, and displays an image of the object on the display unit.
In this case, in particular, the process of associating the first image and the second image with each other may comprise a correction of the images and a stereo matching of the corrected images, in particular by a semi-global matching method.
According to a further embodiment, the analysis unit is designed to recognize a repeating pattern of at least one of the images and to derive therefrom a repeating direction of a repeating feature of the object, and to determine an angle β between the repeating direction and the epipolar line.
A second aspect of the invention relates to a hand-held device for image-based measurement of a remote object, the hand-held device having a front and a back housing; a first camera and a second camera for recording an image of an object, which are provided on the back surface, having a stereo base line as a fixed interval from each other; an analysis unit comprising an algorithm for performing a stereographic measurement analysis of the images of the first and second cameras; and a display unit disposed on the front surface for displaying an image of the subject and a result of the stereographic measurement analysis. According to this aspect of the invention, the analysis unit is designed for recognizing a repeating pattern of at least one of the images and deriving therefrom a repeating direction of a repeating feature of the object, and determining an angle β between the repeating direction and the epipolar line. Wherein the analysis unit is designed to initiate a measure if the value of the angle β is below a predetermined threshold value, wherein the measure enables a further recording of an image of the object, the predetermined threshold value being reached or exceeded in the further recorded image.
According to an embodiment of the device, the measures comprise a handling instruction for holding the device diagonally compared to a previous recording for the further recording by a user, in particular wherein the handling instruction is displayed on a display unit.
A third aspect of the invention relates to a method of image-based measurement of a remote object by means of a handheld device, the handheld device being a device according to the first or second aspect of the invention, the method comprising: and performing stereo recording on the images by the first camera and the second camera, and performing stereo photogrammetric analysis on the images of the first camera and the second camera. According to this aspect of the invention, the images are analyzed in view of a known angle α, wherein the first camera and the second camera are arranged on the device with the stereo baseline being a fixed spacing from each other such that the stereo baseline is diagonally oriented at the angle α with respect to the longitudinal axis of the device.
According to one embodiment, the method includes
-displaying an image on a display unit of the device based on at least one of the images of the first camera and the second camera,
-selecting by the user the dimensions to be measured,
-making a measurement corresponding to the selection based on the stereographic measurement analyzed image, and
-outputting the result on a display unit and/or storing the result in a data storage unit of the device.
A fourth aspect of the invention relates to a computer program product with a program code, stored on a machine-readable carrier, for performing a method of image-based remote object measurement by a handheld apparatus, in particular a method according to the third aspect, wherein the program is executed in an analyzing unit of an apparatus according to the first or second aspect of the invention and comprises at least the steps of:
-the first camera and the second camera perform a stereo recording of the images, and
-performing a stereographic analysis of the images of the first and second cameras, wherein the analysis is performed taking into account a known angle a, wherein the first and second cameras are arranged on the device with a stereo baseline being a fixed spacing from each other such that the stereo baseline is diagonally oriented with respect to the longitudinal axis of the device at the angle a.
A fifth aspect of the invention relates to a system for image-based measurement of a remote object, the system comprising a handheld device and a computer program product. In this case, the hand-held device includes a housing having a front side and a back side; a first camera and a second camera for recording an image of an object, which are provided on the back surface, having a stereo base line as a fixed interval from each other; and a data interface for transmitting digital image data of the recorded image to an external electronic device. The computer program product has a program code stored on a machine-readable carrier, the program code having an algorithm for stereo photogrammetric analysis of images of the first camera and the second camera. The housing has a longitudinal axis and the stereo baseline is aligned diagonally with respect to the longitudinal axis, wherein the program code contains an item of information about the relative alignment of the stereo baseline, is executable in the external electronic device, and is designed to take into account the relative alignment of the stereo baseline during the stereo photogrammetric analysis.
According to one embodiment, the handheld device comprises a machine-readable carrier, in particular wherein the machine-readable carrier is a permanently installed data storage unit, and is designed to transmit the program code to an external electronic device via the data interface.
Drawings
In the following, the device according to the invention and the method according to the invention will be described in more detail, by way of example only, on the basis of specific exemplary embodiments which are schematically shown in the drawings, wherein further advantages of the invention will also be discussed. In the detailed description of the drawings:
fig. 1 shows recording of an image of a building by means of a hand-held stereo photogrammetric device of the prior art;
2 a-2 b show the stereographic measuring device of FIG. 1;
3 a-3 c illustrate problems during photogrammetric measurements of buildings using the apparatus of FIG. 1;
4 a-4 b illustrate an exemplary embodiment of a handheld stereo photogrammetric device according to the present invention;
fig. 5 shows the recording of an image of a building by means of an exemplary embodiment of a hand-held stereographic measuring device according to the present invention.
6 a-6 c show photogrammetric measurements of a building using a device according to the invention;
FIG. 7 illustrates an exemplary embodiment of a method for image-based measurement of a remote object in accordance with the present invention;
8 a-8 b illustrate identification of an angle between an object line and a repeat direction of a feature;
FIG. 9 shows method steps for identifying an angle between an epipolar line and a repeat direction; and
fig. 10 shows an exemplary embodiment of a system for image-based measurement of a remote object according to the present invention.
Detailed Description
The recording of an image 50 of a building 5 by means of a hand-held stereographic measuring device 1 of the prior art is shown in fig. 1. The user facing front 11 of the device 1 is shown during recording. The front face has a display unit 20, which is implemented for example as a touch screen, and a panel with buttons 21 for selecting functions of the device 1.
The two cameras 3a, 3b are arranged with a stereo baseline 30 on the back of the device 1 facing the building 5 to be recorded. The stereo baseline 30 is here parallel to the longitudinal axis of the device 1.
A building 5, which is the object to be recorded by the cameras 3a, 3b, is here shown in front of the horizon 6 for illustration, with an array of distinct features arranged horizontally, i.e. along the X-axis. This involves windows and eaves aligned along horizontal lines 61-64, for example. In addition, mainly right angles are used, so the window and wall features also extend vertically.
The stereographic measuring device 1 is designed such that it is preferably held straight by the user, i.e. its longitudinal axis is parallel to the horizon 6, especially since the measured values displayed on the display unit 20 are therefore most easily readable. This results in the stereo baseline 30 extending in the same direction as the obvious features of the building 5.
The stereographic measuring device 1 in fig. 1 is shown in detail in fig. 2a and 2 b. In this case, fig. 2a shows the front side 11 with the display unit 20 and the buttons 21, and fig. 2b shows the back side 12 with the two cameras 3a, 3b, which are arranged at the same height of the housing.
Fig. 3 a-3 c show problems that arise in the case of recording the building 5 shown in fig. 1 by means of the device 1 shown in fig. 2 a-2 b.
Fig. 3a shows that the images 51, 52 of the building recorded simultaneously by the two cameras 3a, 3b are adjacent to each other. In a typical algorithm for stereo matching, for example, "semi-global matching", as a look-ahead step, the images have to be corrected for each other.
In fig. 3b, the image of fig. 3a is corrected accordingly. In the corrected images 51 ', 52' epipolar lines 70 are shown, which intersect the respective images in straight lines. After correction, the epipolar line 70 is horizontal in the corrected images 51 ', 52', i.e. the pixels in the second image 52 'corresponding to the pixels located in the first image 51' are located on the same image line. The pixels 72 in the second image 52 'corresponding to the points 71 arranged in the first image 51' and located on the shown epipolar line 70 can thus also be located only on the epipolar line 70.
In order to match the two images 51, 52, the algorithm must therefore compare features in the first corrected image 51 'with only those of the second corrected image 52' which lie on the same epipolar line 70. The corner where the windows intersect is shown as feature 71 in the left image 51' as an example. Due to the uniform construction, the same features are repeated on the building in the horizontal direction-both windows have the same size and the same design and are located at the same height.
Since the epipolar line 70 also extends horizontally in the corrected images 51 ', 52', a plurality of similar or identical features 72, 72 'are adjacent to each other on the epipolar line 70 in the right image 52'. Thus, if the algorithm incorrectly associates the equivalent feature 72' with the feature 71 in the first image 51, rather than with the actual corresponding feature 72 in the second image 52, an error may occur during feature matching.
Fig. 3c shows the corrected images 51 ', 52', in which the distance measurement is performed between two points. In the left image 51', there are points 73 and 71, respectively, which are located on the horizontally extending line of the building. Due to the parallelism of the two epipolar lines 70, 70' with the building features, errors can also occur here, so that incorrect distance measurements are performed.
Fig. 4a and 4b show an exemplary embodiment of a stereographic measuring device 1 according to the present invention. In this case, the rear side 12 of the housing 10 of the device 1 with the cameras 3a, 3b is shown separately. Fig. 4a additionally shows a laser distance measuring device 4 for measuring the distance to a remote object (for example to a point on a building) and a locking unit 17 for locking the device 1 on a fixed surface.
The distance recorded using the laser rangefinder 4 may in particular be used for zooming the images recorded by the cameras 3a, 3b, which improves the accuracy of the photogrammetry.
Figure 4b illustrates the geometry. A housing longitudinal axis 15, a housing transverse axis 16 extending orthogonally thereto, and a stereo baseline 30 aligned diagonally with respect to the two axes are shown. In addition to the longitudinal spacing 33, which extends along the longitudinal axis 15 or parallel to the longitudinal axis 15, the two cameras are also arranged with a transverse spacing 35 to each other, which transverse spacing 35 extends orthogonally to the longitudinal axis 15. Thus, an angle α is produced between the base line 30 and the longitudinal axis 15 of the housing, which angle α is dependent on the longitudinal spacing 33 and the transverse spacing 35.
With the shown apparatus 1, even untrained users can take high quality photogrammetry of buildings and other man-made structures. In this case, it is generally not necessary to hold the apparatus 1 diagonally during image recording. Furthermore, due to the oblique arrangement of the cameras 3a, 3b, a maximum length of the stereo baseline 30 can advantageously be achieved.
However, in the case where a natural or artificial subject is to be measured, it is necessary to hold the apparatus diagonally, in which case the subject features repeat at an angle corresponding to the inclination of the stereo baseline 30. However, this situation occurs relatively rarely in practice.
Fig. 5 shows, analogously to fig. 1, the recording of an image 50 of the building 5 by means of the handheld stereographic measuring device 1 of fig. 4a and 4 b. In contrast to the apparatus 1 shown in fig. 1, although the apparatus 1 is held linearly, the stereo baseline 30 is not aligned parallel with respect to the horizontal lines 61-64, and the salient features of the building 5 are aligned along the horizontal lines 61-64.
The user can record a stereo image of the building 5 using the cameras 3a, 3b and can mark pixels 56, 57 in the image 50 displayed by the display unit 20, which correspond to target points 66, 67 on the actual building 5, and can determine the distance 68 between the target points by photogrammetry and display the distance.
Fig. 6 a-6 c show how the problems shown in fig. 3 a-3 c are avoided by means of the device according to the invention.
Fig. 6a shows images 51, 52 of a building recorded simultaneously by the two cameras 3a, 3b of the device in fig. 5. In a general stereo matching algorithm, for example, "semi-global matching" is a preceding step in which images are corrected with each other.
In fig. 6b, the image of fig. 6a is corrected accordingly. In the corrected images 51 ', 52' epipolar lines 70 are shown, which intersect the respective images in straight lines. After correction, the epipolar line 70 is horizontal in the corrected images 51 ', 52', i.e. the pixels in the second image 52 'corresponding to the pixels located in the first image 51' are located on the same image line. The pixels 72 in the second image 52 'corresponding to the points 71 arranged in the first image 51' and located on the shown epipolar line 70 can thus also be located only on the epipolar line 70.
In order to match the two images 51, 52, the algorithm must therefore compare features in the first corrected image 51 'with only those of the second corrected image 52' which lie on the same epipolar line 70. The corner where the windows intersect is shown as feature 71 in the left image 51' as an example. Due to the uniform construction, the same features are repeated on the building in the horizontal direction-both windows have the same size and the same design and are located at the same height.
These natural horizontal lines extend diagonally in the corrected image due to the diagonal arrangement of the camera. Thus, in contrast to fig. 3b, in the right image 52', a plurality of similar or identical features are not adjacent to each other on the epipolar line 70, but only the feature 72 corresponding to the feature 71 in the first image 51. Thus avoiding errors during association.
Fig. 6c shows a corrected image 51 ', 52' in which a distance measurement of the route 75 between two points is to be performed. In the left image 51', there are points 73 and 71, which are each located on a horizontally extending line of the building. These natural horizontal lines extend diagonally in the corrected image due to the diagonal arrangement of the camera. Thus, the points 72, 74 in the right image 52 'may be uniquely associated with the points 71, 73 in the left image 51', whereby the distance of the path 75 may also be determined without error.
Alternatively, it is needless to say that the matching may be performed without prior correction. In the case of the conventional arrangement of fig. 1, the (nominal) horizontal epipolar line 70 then passes through a plurality of identically appearing horizontally aligned features 72 and 72'. In contrast, with the device according to the invention from fig. 5, the epipolar line advantageously passes only through the feature 72.
Alternatively, only certain points of interest may be related to each other, rather than having to process the entire image. For example, template matching may be performed after the user selects a point of interest.
Fig. 7 illustrates an exemplary embodiment of a method 100 according to the present invention for image-based measurement of a remote object by means of a handheld device according to the present invention.
In step 110, images of an object are first recorded stereoscopically by means of two cameras. Optionally, the distance to the object measurement 130 may be performed simultaneously to enable accurate scaling of the image and thus have an accurate scale for the measurement in the image.
Using knowledge about the angle a (i.e. about the relative alignment of the stereo baseline with respect to the longitudinal axis of the device, see fig. 4b), and optionally the distance measurements, a stereographic analysis of the stereo recorded images is performed in step 140.
Meanwhile, in step 120, an image of the object, which may be, for example, one of the images of the camera, or an edited image, is displayed to the user on the display unit of the apparatus. Thus, the user selects certain routes or regions to be sized based on the image in step 150. These dimensions are determined in step 160 by image measurements in the stereometric analyzed images and finally displayed to the user in step 170 on a display unit and stored in a memory unit of the device in step 180.
In one embodiment, the analysis unit of the device is designed to recognize a repeating pattern in the image and to derive therefrom a repeating direction of the repeating real feature. This is shown in fig. 8a and 8 b.
Fig. 8a shows by way of example a corrected image 51' of an object recorded by the apparatus in fig. 1. The algorithm of the analysis unit identifies the window of the building as repeating features 77 and derives therefrom the repeating direction 78 of these features.
Subsequently, it is determined that the repetition direction 78 is parallel to the epipolar line 70, which may lead to errors during image matching, as shown in fig. 3 b. In this case, the analysis unit initiates measures to end this parallelism. In particular, these measures may comprise instructing the user to make a new recording in which the device is held differently, in particular tilted with respect to the last recording. The indication may preferably be performed on a display unit, and furthermore, an acoustic signal or a vibration may be triggered.
As an example, fig. 8b shows a corrected image 51' in which the angle β between the repetition direction 78 of the feature 77 and the epipolar line 70 is sufficiently large. This may be the result of, inter alia, changing the attitude of the device relative to fig. 8 a-or the result of a recording using the device of fig. 5.
The evaluation unit is preferably designed to determine the angle β between the repetition direction 78 and the epipolar line 70 and to initiate this measure if the value of the angle β is below a predetermined threshold.
Fig. 9 shows a further step as part 200 of the method 100 of fig. 7, which relates to a comparison of the epipolar lines and the repetition directions shown in fig. 8a, 8 b.
In particular, the method portion 200 may be arranged before that shown in FIG. 7. Starting at step 210, an image is recorded by one or both of the cameras of the device, wherein at least one image of the object to be measured is recorded. In the image, the repetitive object features are identified as a repetitive pattern (step 220) and compared to epipolar lines (step 230). The known angle a of the stereo baseline can be used for this purpose. If the direction of repetition and epipolar line are too close, i.e. if the value of the angle β is below the established threshold, a processing indication to hold the device differently is output to the user (step 240). Otherwise, the method shown in fig. 7 may be performed.
Fig. 10 shows a further exemplary embodiment of a hand-held stereographic measuring device 1 according to the present invention. The device has at least one interface 90, 95 for connecting to an external electronic device, such as a laptop computer 2. A plug interface 90 for establishing a wired connection 92 (e.g. by USB) and a wireless interface 95 for establishing a wireless connection 97 (e.g. by means of WLAN or bluetooth) are shown here by way of example. The image data of the images recorded by the cameras 3a, 3b are transmitted via (wired or wireless) connections 92, 97 to the laptop 2, where they are subjected to a stereographic analysis. The system has corresponding software which also provides an item of information about the settings of the two cameras 3a, 3b and is installed on the laptop 2 for this purpose. The software is preferably stored in the memory unit 19 of the device 1 and transmitted to the laptop 2 via a (wired or wireless) connection 92, 97. It may also be provided on a data carrier or in the cloud. This embodiment has the advantage that the hand-held device 1 does not necessarily have to have a separate analysis unit; the display unit is also not necessary. The resulting device 1 can therefore be relatively compact and light and can be produced with less technical expenditure.
The user records images using the stereographic measurement device 1, the data of which is transmitted to the laptop 2 in real time or after the recording sequence. The software is stored in the memory unit 19 and transmitted to the laptop, for example, together with the image data. . In particular, step 140 and 170 from the method 100 of FIG. 7 may be executable on the laptop computer.
It is clear that these shown figures only schematically show possible exemplary embodiments. The various methods may also be combined with each other and with prior art methods and devices.
Claims (25)
1. A handheld device (1) for image-based measurement of a remote object (5), the handheld device (1) comprising:
a housing (10) having a front side (11) and a rear side (12);
a first camera (3a) and a second camera (3b) for recording a first image (51) and a second image (52) of the remote object (5), which are arranged on the rear face (12), with a stereo base line (30) as a fixed spacing from each other;
an analysis unit having an algorithm for performing a stereographic analysis of the first image (51) and the second image (52) recorded by the first camera (3a) and the second camera (3 b); and
a display unit (20) arranged on the front side (11) for displaying an image (50) of the remote object (5) and a result of the stereographic measurement analysis,
wherein the housing (10) has a longitudinal axis (15) and the handheld device (1) is designed for handheld use by a user, holding the handheld device (1) with the longitudinal axis (15) substantially horizontal for recording the first image (51) and the second image (52) of the remote object (5),
characterized in that the stereo baseline (30) is aligned diagonally with respect to the longitudinal axis (15), wherein the analysis unit is designed to take into account the relative alignment of the stereo baseline (30) during the stereo photogrammetry analysis.
2. A hand-held device (1) according to claim 1, characterised in that an electronic distance meter (4) for measuring the distance to the remote object (5) is provided at the rear side (12), wherein the analysis unit is designed to take into account the measured distance during the stereographic measurement analysis.
3. The hand-held device (1) according to claim 2, characterized in that the electronic distance meter (4) is designed as a laser distance meter.
4. A hand-held device (1) according to claim 1 or 2, characterised in that the stereo baseline (30) is arranged at an angle (a) of at least 20 ° with respect to the longitudinal axis (15).
5. The hand-held device (1) according to claim 4, characterized in that the stereo baseline (30) is arranged at an angle (a) between 30 ° and 60 ° with respect to the longitudinal axis (15).
6. A hand-held device (1) according to claim 1, characterised in that the first camera (3a) and the second camera (3b) are arranged such that the stereo baseline (30) comprises at least 75% of the maximum extension of the back side (12).
7. The handheld device (1) according to claim 6, wherein the first camera (3a) and the second camera (3b) are arranged such that the stereo baseline (30) comprises at least 90% of the maximum extension of the back side (12).
8. A hand-held device (1) according to claim 1, characterised by input means provided at the front side (11) for inputting data and/or commands by a user.
9. The handheld device (1) of claim 8, wherein the input device:
is realized as a button (21), or the display unit (20) and the input means are designed as a touch screen; and/or
Is designed to be able to mark or select a pixel (56, 57) in the image (50) of the remote object (5) by a user, wherein the pixel (56, 57) corresponds to a target point (66, 67) of the remote object (5), and the analysis unit is designed to determine a distance (68) between the target points (66, 67) corresponding to the selected pixel (56, 57) and to display the determined distance (68) on a display unit (20).
10. A hand-held device (1) according to claim 1, characterised by a recording function that runs automatically after a user trigger, within the scope of which recording function:
chronologically related, the first camera (3a) recording a first image (51) of the remote object (5) and the second camera (3b) recording a second image (52) of the remote object (5),
the algorithm of the analysis unit associates the first image (51) and the second image (52) with each other by feature recognition and based on knowledge about the stereo baseline (30), and
displaying an image (50) of the remote object (5) on the display unit (20).
11. The handheld device (1) according to claim 10, wherein simultaneously the first camera (3a) records a first image (51) of the remote object (5) and the second camera (3b) records a second image (52) of the remote object (5).
12. The handheld device (1) of claim 10, wherein the process of associating the first image (51) and the second image (52) with each other comprises:
correcting the first image (51) and the second image (52), and
stereo matching is performed on the corrected images (51 ', 52').
13. The handheld device (1) according to claim 12, wherein the stereo matching is performed by a semi-global matching method.
14. The handheld device (1) according to claim 1, characterized in that the analysis unit is designed to recognize a repeating pattern in at least one of the first image (51) and the second image (52) and to derive therefrom a repeating direction (78) of a repeating feature (77) of the remote object (5), and
an angle (β) between the repetition direction (78) and the epipolar line (70) is determined.
15. A handheld device (1) for image-based measurement of a remote object (5), the handheld device (1) comprising:
a housing (10) having a front side (11) and a rear side (12);
a first camera (3a) and a second camera (3b) for recording a first image (51) and a second image (52) of the remote object (5), which are arranged on the rear face (12), with a stereo base line (30) as a fixed spacing from each other;
an analysis unit having an algorithm for performing a stereographic measurement analysis of the first image (51) and the second image (52) recorded by the first camera (3a) and the second camera (3 b); and
a display unit (20) arranged on the front side (11) for displaying an image (50) of the remote object (5) and a result of the stereographic measurement analysis,
characterized in that the analysis unit is designed to
Identifying a repeating pattern of at least one of the first image (51) and the second image (52) and deriving therefrom a direction (78) of repetition of a repeating feature (77) of the remote object (5), and
determining an angle (beta) between the repetition direction (78) and the epipolar line (70),
wherein the analysis unit is designed to initiate a measure if the value of the angle (β) is below a predetermined threshold value, wherein the measure enables a further recording of the first image (51) and the second image (52) of the remote object (5), the predetermined threshold value being reached or exceeded in the further recorded images.
16. The handheld device (1) of claim 15 wherein said measures include a processing instruction that causes a user to hold said handheld device (1) diagonally compared to a previous recording for said further recording.
17. The handheld device (1) of claim 16, wherein the processing instructions are displayed on the display unit (20).
18. A method (100) of image-based measurement of a remote object (5) by means of a handheld device (1), the method comprising the steps of:
stereoscopically recording (110) a first image (51) and a second image (52) by a first camera (3a) and a second camera (3b), and
-performing a stereographic measurement analysis (140) of said first image (51) and said second image (52) recorded by the first camera (3a) and the second camera (3b),
characterized in that the analysis (140) of the first image (51) and the second image (52) is performed taking into account a known angle (a), wherein the first camera (3a) and the second camera (3b) are arranged on the handheld device (1) with a stereo baseline (30) as a fixed separation from each other, which stereo baseline (30) is diagonally oriented with respect to a longitudinal axis (15) of the handheld device (1) at the known angle (a).
19. The method according to claim 18, wherein the handheld device (1) is a handheld device according to any one of claims 1-17.
20. The method (100) of claim 18, wherein:
displaying (120) an image (50) on a display unit (20) of the handheld device (1) based on at least one of the first image (51) and the second image (52) recorded by the first camera (3a) and the second camera (3b),
selecting (150) a size to be measured by a user,
making a measurement (160) corresponding to the selection (150) based on the first image (51) and the second image (52) after the stereometric analysis, an
-outputting (170) the result on a display unit (20) and/or storing (180) the result in a data storage unit of the handheld device (1).
21. A machine readable carrier storing a computer program which, when run by a handheld apparatus, causes the handheld apparatus (1) to perform a method of image-based measurement of a remote object (5), wherein the program is executed in the analysis unit of the handheld apparatus (1) according to any one of claims 1 to 17 and comprises at least the steps of:
stereoscopically recording (110) the first image (51) and the second image (52) by a first camera (3a) and a second camera (3b), and
-subjecting the first (51) and second (52) images recorded by the first (3a) and second (3b) cameras to a stereographic analysis (140), wherein the analysis (140) is performed taking into account a known angle (a).
22. The machine readable carrier of claim 21, wherein the method is according to any one of claims 18 to 20.
23. A system for image-based measurement of a remote object (5), the system comprising a handheld device (1) and a machine-readable carrier having a computer program stored thereon, wherein the handheld device (1) comprises:
a housing (10) having a front side (11) and a rear side (12);
a first camera (3a) and a second camera (3b) for recording a first image (51) and a second image (52) of the remote object (5), which are arranged on the rear face (12), with a stereo base line (30) as a fixed spacing from each other; and
a data interface (90, 95) for transmitting the recorded digital image data of the first image (51) and the second image (52) to an external electronic device (2),
wherein the housing (10) has a longitudinal axis (15) and the handheld device (1) is designed for handheld use by a user, the handheld device (1) is held in a substantially horizontal manner with the longitudinal axis (15) for recording the first image (51) and the second image (52) of the remote object (5), and
wherein the computer program, when executed by the handheld device, causes the handheld device to perform a stereographic analysis of the first image (51) and the second image (52) recorded by the first camera (3a) and the second camera (3b),
characterized in that said stereo base line (30) is aligned diagonally with respect to the longitudinal axis (15), wherein the program code:
containing an item of information about the relative alignment of the stereo baselines (30),
can be executed in an external electronic device (2), and
is designed to take into account the relative alignment of the stereo baselines (30) during the stereo photogrammetric analysis.
24. The system of claim 23, wherein the first and second sensors are arranged in a single unit,
characterized in that, the hand-held device (1)
Comprises the machine-readable carrier, and
is designed to transmit said program code to an external electronic device (2) via said data interface (90, 95).
25. The system of claim 24, wherein the first and second light sources are,
wherein the machine readable carrier is a permanently installed data storage unit (19).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP17202630.4 | 2017-11-20 | ||
EP17202630.4A EP3486606A1 (en) | 2017-11-20 | 2017-11-20 | Stereo camera and stereophotogrammetric method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109813283A CN109813283A (en) | 2019-05-28 |
CN109813283B true CN109813283B (en) | 2021-05-07 |
Family
ID=60421612
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811373767.3A Active CN109813283B (en) | 2017-11-20 | 2018-11-19 | Handheld device, method for image-based measurement using a handheld device |
Country Status (3)
Country | Link |
---|---|
US (1) | US11509881B2 (en) |
EP (1) | EP3486606A1 (en) |
CN (1) | CN109813283B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3486607B1 (en) * | 2017-11-20 | 2021-09-01 | Leica Geosystems AG | Image-based edge measurement |
DE102020127060A1 (en) | 2020-10-14 | 2022-04-14 | Thyssenkrupp Elevator Innovation And Operations Gmbh | Procedure for modeling an elevator rail system |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102013202658A1 (en) * | 2013-02-19 | 2014-08-21 | Frederic Ludley | Method for determining dimensions of objects, involves evaluating recorded images of object from predetermined distances of optical axes of camera and comparison of each superimposed images of object recorded electronically with camera |
CN106382917A (en) * | 2015-08-07 | 2017-02-08 | 武汉海达数云技术有限公司 | Continuous acquisition method for three-dimensional information of indoor environment |
Family Cites Families (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6038074A (en) * | 1997-05-20 | 2000-03-14 | Ricoh Company, Ltd. | Three-dimensional measuring apparatus and method, image pickup apparatus, and apparatus and method for inputting image |
JP4480083B2 (en) * | 2005-02-23 | 2010-06-16 | アイシン精機株式会社 | Object recognition device |
US8090194B2 (en) * | 2006-11-21 | 2012-01-03 | Mantis Vision Ltd. | 3D geometric modeling and motion capture using both single and dual imaging |
EP2618102A2 (en) * | 2006-11-21 | 2013-07-24 | Mantisvision Ltd. | 3d geometric modeling and 3d video content creation |
JP4931668B2 (en) * | 2007-03-29 | 2012-05-16 | 富士フイルム株式会社 | Compound eye imaging device |
JP4856611B2 (en) * | 2007-10-29 | 2012-01-18 | 富士重工業株式会社 | Object detection device |
US20100194860A1 (en) * | 2009-02-03 | 2010-08-05 | Bit Cauldron Corporation | Method of stereoscopic 3d image capture using a mobile device, cradle or dongle |
WO2011096251A1 (en) * | 2010-02-02 | 2011-08-11 | コニカミノルタホールディングス株式会社 | Stereo camera |
JP5464280B2 (en) * | 2010-12-28 | 2014-04-09 | コニカミノルタ株式会社 | Information processing apparatus and information processing method |
US20120274626A1 (en) * | 2011-04-29 | 2012-11-01 | Himax Media Solutions, Inc. | Stereoscopic Image Generating Apparatus and Method |
US9324190B2 (en) * | 2012-02-24 | 2016-04-26 | Matterport, Inc. | Capturing and aligning three-dimensional scenes |
CN104272715A (en) * | 2012-05-01 | 2015-01-07 | 中央工程株式会社 | Stereo camera and stereo camera system |
US9185387B2 (en) * | 2012-07-03 | 2015-11-10 | Gopro, Inc. | Image blur based on 3D depth information |
US20150009119A1 (en) * | 2013-01-29 | 2015-01-08 | Imimtek, Inc. | Built-in design of camera system for imaging and gesture processing applications |
US20140210950A1 (en) * | 2013-01-31 | 2014-07-31 | Qualcomm Incorporated | Systems and methods for multiview metrology |
US9609305B1 (en) * | 2013-03-13 | 2017-03-28 | Amazon Technologies, Inc. | Feature-based rectification of stereo cameras |
US9303982B1 (en) * | 2013-05-08 | 2016-04-05 | Amazon Technologies, Inc. | Determining object depth information using image data |
KR101775591B1 (en) * | 2013-06-11 | 2017-09-06 | 퀄컴 인코포레이티드 | Interactive and automatic 3-d object scanning method for the purpose of database creation |
TWI486551B (en) * | 2013-10-21 | 2015-06-01 | Univ Nat Taiwan Science Tech | Method and system for three-dimensional data acquisition |
EP2919067B1 (en) * | 2014-03-12 | 2017-10-18 | Ram Srikanth Mirlay | Multi-planar camera apparatus |
EP2918972B1 (en) | 2014-03-14 | 2019-10-09 | Leica Geosystems AG | Method and handheld distance measuring device for generating a spatial model |
US10049454B2 (en) * | 2014-06-24 | 2018-08-14 | Mantis Vision Ltd. | Active triangulation calibration |
KR102172992B1 (en) * | 2014-07-31 | 2020-11-02 | 삼성전자주식회사 | Image photographig apparatus and method for photographing image |
WO2016024200A2 (en) * | 2014-08-12 | 2016-02-18 | Mantisvision Ltd. | Structured light projection and imaging |
US11019323B2 (en) * | 2015-02-06 | 2021-05-25 | Tara Chand Singhal | Apparatus and method for 3D like camera system in a handheld mobile wireless device |
CN107850425B (en) * | 2015-07-13 | 2022-08-26 | 瑞尼斯豪公司 | Method for measuring an article |
CN106709899B (en) * | 2015-07-15 | 2020-06-02 | 华为终端有限公司 | Method, device and equipment for calculating relative positions of two cameras |
US10587858B2 (en) * | 2016-03-14 | 2020-03-10 | Symbol Technologies, Llc | Device and method of dimensioning using digital images and depth data |
CN109997170B (en) * | 2016-10-18 | 2023-08-11 | 弗托斯传感与算法公司 | Apparatus and method for obtaining distance information from view |
US10109055B2 (en) * | 2016-11-21 | 2018-10-23 | Seiko Epson Corporation | Multiple hypotheses segmentation-guided 3D object detection and pose estimation |
US10726558B2 (en) * | 2017-02-27 | 2020-07-28 | Dolphin AI, Inc. | Machine learning-based image recognition of weather damage |
US10460512B2 (en) * | 2017-11-07 | 2019-10-29 | Microsoft Technology Licensing, Llc | 3D skeletonization using truncated epipolar lines |
-
2017
- 2017-11-20 EP EP17202630.4A patent/EP3486606A1/en active Pending
-
2018
- 2018-11-19 US US16/195,659 patent/US11509881B2/en active Active
- 2018-11-19 CN CN201811373767.3A patent/CN109813283B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102013202658A1 (en) * | 2013-02-19 | 2014-08-21 | Frederic Ludley | Method for determining dimensions of objects, involves evaluating recorded images of object from predetermined distances of optical axes of camera and comparison of each superimposed images of object recorded electronically with camera |
CN106382917A (en) * | 2015-08-07 | 2017-02-08 | 武汉海达数云技术有限公司 | Continuous acquisition method for three-dimensional information of indoor environment |
Also Published As
Publication number | Publication date |
---|---|
US11509881B2 (en) | 2022-11-22 |
EP3486606A1 (en) | 2019-05-22 |
US20190158811A1 (en) | 2019-05-23 |
CN109813283A (en) | 2019-05-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10810734B2 (en) | Computer aided rebar measurement and inspection system | |
EP3368859B1 (en) | Method of solving initial azimuth for survey instruments, cameras, and other devices with position and tilt information | |
US11015930B2 (en) | Method for 2D picture based conglomeration in 3D surveying | |
US9800867B2 (en) | Calibration device of camera, camera system, and calibration method of camera | |
CN102834691B (en) | Surveying method | |
JP5715735B2 (en) | Three-dimensional measurement method, apparatus and system, and image processing apparatus | |
US20180108143A1 (en) | Height measuring system and method | |
JPWO2005017644A1 (en) | Three-dimensional survey device and electronic storage medium | |
CN113418543A (en) | Method and device for detecting automatic driving sensor, electronic equipment and storage medium | |
CN109813283B (en) | Handheld device, method for image-based measurement using a handheld device | |
CN103890541A (en) | Device, method, and program for measuring diameter of cylindrical object | |
JP2005017286A (en) | Method and system for camera calibration | |
US11595558B2 (en) | Apparatus and method for measuring cracks in wall surface | |
JP6614954B2 (en) | Crack width measuring device | |
JP5987549B2 (en) | System and method for measuring installation accuracy of construction members | |
KR101535801B1 (en) | Process inspection device, method and system for assembling process in product manufacturing using depth map sensors | |
JP2007212187A (en) | Stereo photogrammetry system, stereo photogrammetry method, and stereo photogrammetry program | |
JP2017068465A (en) | Information processing device, control method, and program | |
WO2015159835A1 (en) | Image processing device, image processing method, and program | |
JP2007026423A (en) | Image processor and image processing method | |
JP6448413B2 (en) | Roof slope estimation system and roof slope estimation method | |
KR101475742B1 (en) | Apparatus and method for performing photogrammetry | |
CN113140031A (en) | Three-dimensional image modeling system and method and oral cavity scanning equipment applying same | |
KR102423217B1 (en) | Crack investigation device using 3D distance distribution information of ToF sensor and method of deriving crack information using the same | |
JP7057732B2 (en) | 3D measuring device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |