Measurement method, measurement systems and auxiliary measurement instruments for displaying desired positions in a live image

Patent metadata

Field	Value
Publication number	US-12008679-B2
Application number	US-202117550357-A
Country	US
Kind code	B2
Filing date	Dec 14, 2021
Priority date	Dec 13, 2018
Publication date	Jun 11, 2024
Grant date	Jun 11, 2024

Abstract

A method and device for displaying desired positions in a live image of a construction site. The method mat include recording at least one position-referenced image of the construction site; linking at least one desired position to the position-referenced image; storing the position-referenced image together with desired position linkage in an electronic memory; recording a live image of the construction site, in particular in the form of a video, wherein the live image and the position-referenced image at least partially represent an identical detail of the construction site; retrieving the stored position-referenced image from the memory; fitting the position-referenced image with the live image, so that the desired position linked to the position-referenced image can be overlaid in a position-faithful manner on the live image; and position-faithful display of the desired position as a graphic marking in the live image.

First claim

The invention claimed is:

1. A method for displaying desired positions in a live image of a construction site, comprising:
recording at least one position-referenced image of the construction site,
linking at least one desired position to the position-referenced image, storing the position-referenced image together with desired position linkage in an electronic memory,
recording a live image of the construction site, wherein the live image and the position-referenced image at least partially represent an identical detail of the construction site,
retrieving the stored position-referenced image from the memory,
fitting the position-referenced image with the live image, so that the desired position linked to the position-referenced image can be overlaid in a position-faithful manner on the live image,
position-faithful display of the desired position as a graphic marking in the live image.

2. The method as claimed in claim 1 , wherein the linkage of the at least one desired position is produced in the form of an image layer overlaid on the position-referenced image having graphic markings of the desired position and the position-faithful display of the at least one desired position in the live image is carried out by overlaying the image layer in the live image.

3. The method as claimed in claim 1 , wherein the recording of the at least one position-referenced image is carried out by means of a surveying device which has a distance and direction measuring functionality.

4. The method as claimed in claim 1 , wherein the recording and display of the live image of the construction site is carried out by means of a handheld mobile device.

5. The method as claimed in claim 1 , wherein the fitting is carried out by means of template matching, using marking objects attached for this purpose in the construction site and imaged both in the position-referenced image and also in the live image.

6. The method as claimed in claim 1 , wherein:
the desired position is used to execute a construction activity,
an actual status image of the construction site is recorded after completed construction activity,
position referencing of the actual status image is carried out on a basis of the position-referenced image,
the position-referenced actual status image is stored in the memory.

7. The method as claimed in claim 6 , wherein an estimation of the accuracy of the position reference of the actual status image is carried out and if an accuracy below a defined threshold is present, a warning is automatically output to a user.

8. The method as claimed in claim 1 , wherein the position-referenced image and the live image are three-dimensional images.

9. The method as claimed in claim 1 , wherein:
a comparison of the live image to the position-referenced image is carried out in such a way that construction site elements are recognized in the live image, which are not imaged in the position-referenced image or are imaged at the incorrect point in the live image, and
these construction site elements are graphically marked in the live image.

10. A measurement system for surveying or staking out measurement points having surveying functionality, wherein the surveying system comprises:
a room-based surveying device which can be absolutely located,
a handheld auxiliary measurement instrument, wherein the auxiliary measurement instrument comprises:
a handheld carrier,
a mobile computer terminal supported by the carrier and including a display screen and a first camera,
means for determining or making determinable a pose of the auxiliary measurement instrument,

wherein upon execution of the surveying functionality:
the pose of the auxiliary measurement instrument and thus the computer terminal relative to the surveying device is uniquely determined, wherein at least one pose-dependent degree of freedom is determined by the surveying device,
a measurement environment image is recorded by means of the first camera, and
the measurement environment image is displayed on the display screen, wherein at least one measurement point is displayed overlaid faithfully in position on the measurement environment image using the determined pose of the computer terminal.

11. The measurement system as claimed in claim 10 , wherein the carrier comprises a gimbal mount for pose stabilization of the computer terminal, wherein the gimbal mount is designed as an active gimbal mount and is used to deliberately set an alignment of the computer terminal.

12. The measurement system as claimed in claim 11 , wherein upon execution of the surveying functionality, by means of the active gimbal mount:
a measurement point to be staked out is automatically targeted by the computer terminal or
in the measurement environment image, a measurement point to be surveyed is manually marked by a user in the measurement environment image and the computer terminal is automatically aligned on the measurement point to be surveyed based on the image marking.

13. The measurement system as claimed in claim 10 , wherein the surveying functionality is designed in such a way that by means of the computer terminal, the position of at least one measurement point to be surveyed of the measurement environment is measured relative to the computer terminal and on a basis of this position and the ascertained pose of the auxiliary measurement instrument, an absolute position of the measurement point is ascertained, and
the point position measurement is carried out by the computer terminal based on a measurement beam or photogrammetrically, or
the surveying functionality is designed in such a way that scanning surveying of a plurality of measurement points takes place.

14. The measurement system as claimed in claim 10 , wherein the auxiliary measurement instrument comprises at least one marker for oriented marking and the surveying functionality is designed in such a way that, on a basis of the absolute locating of the surveying device and the ascertained relative pose of the auxiliary measurement instrument, at least one measurement point to be staked out is marked in a position-faithful manner on a surface of the measurement environment by means of the marker.

15. The measurement system as claimed in claim 10 , wherein the surveying functionality is designed in such a way that, based on the absolute locating of the surveying device and the ascertained relative pose of the auxiliary measurement instrument, at least one desired position retrieved from a memory is overlaid on the measurement environment image as the measurement point to be staked out.

16. The measurement system as claimed in claim 10 , wherein:
a body, which is spherical or polyhedral, having optical one-to-one code distributed on a surface of the body, is arranged on the carrier,
whereby by means of image processing of an image of the body recorded by a second camera arranged on the surveying device,
decoding is carried out in such a way that an orientation and distance of the carrier relative to the surveying device is determined one-to-one,
a direction of the target axis aligned on the auxiliary measurement instrument is determined,
the pose of the auxiliary measurement instrument is determined on basis of the orientation, distance, and direction.

17. A room-based surveying system comprising:
a surveying device, wherein the surveying device comprises:
a distance and direction measuring functionality, whereby a distance and direction to a target to be surveyed in a measurement environment of the surveying device is determinable in the direction of a target axis

Assignees

• Leica Geosystems Ag

Inventors

• Mueller Josef
• Faix Oliver
• Scheja Jochen
• Petkov Stefan
• Lais Josef
• Mayer Tim
• Metzler Bernhard

Classifications

• G06F3/041

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G01C11/025

  by scanning the object · CPC title

• G01C11/08

  the pictures not being supported in the same relative position as when they were taken · CPC title

• G06T2207/20104

  Interactive definition of region of interest [ROI] · CPC title