Reality capture with a laser scanner and a camera

Patent metadata

Field	Value
Publication number	US-2025093467-A1
Application number	US-202418963385-A
Country	US
Kind code	A1
Filing date	Nov 27, 2024
Priority date	Dec 21, 2018
Publication date	Mar 20, 2025
Grant date	—

Abstract

The present disclosure relates to a reality capture device for generating a digital three-dimensional representation of an environment, particularly for surveying and/or for detecting an object within an infrastructure. One aspect relates to a mobile reality capture device configured to be carried and moved by a mobile carrier, particularly a person or a robot or a vehicle, and to be moved during a measuring process for generating a digital representation of an environment. The mobile reality capture device has a localization unit, particularly comprising an inertial measurement unit (IMU), wherein the localization unit is configured for generating localization data for determining a trajectory of the mobile reality capture device.

First claim

1 . A mobile reality capture device configured to be carried and moved by a mobile carrier, particularly a person or a robot or a vehicle, and to be moved during a measuring process for generating a digital representation of an environment, with a housing enclosing an internal space, wherein the internal space comprises a rotating component, which is configured to rotate, and, based thereof,
to provide a scanning movement of a laser measurement beam for generating light detection and ranging (LIDAR) data, and to provide generation of an airflow to drive an air cooling system of the mobile reality capture device, particularly wherein the rotating component is equipped with a rotor blade.

2 . The mobile reality capture device according to claim 1 , wherein the rotating component drives an internal air circulation, which is sealed from the ambience and comprises a cooling section for cooling air passing through.

3 . The mobile reality capture device according to claim 2 , wherein the mobile reality capture device has an air entrance and the cooling system is configured that the rotation of the rotating component causes a flow of external air entering via the air entrance.

4 . The mobile reality capture device according to claim 1 , wherein:
the rotating component is equipped with a rotor blade, the rotating component is arranged in an area which has an air inlet of an air channel to supply air into the area, and an air outlet to remove air from the area, and the rotor blade is configured and arranged that caused by the rotation of the rotating component the rotor blade passes the inlet or the outlet, respectively, in order to generate a pressure gradient at the inlet or the outlet, respectively, which drives the air from the inlet to the outlet.

5 . The mobile reality capture device according to claim 1 , further comprising
a localization unit, particularly comprising an inertial measurement unit (IMU), the localization unit being configured for generating localization data for determining a trajectory of the mobile reality capture device, and a laser scanner configured to carry out, during movement of the mobile reality capture device, the scanning movement of the laser measurement beam relative to two rotation axes, and, based thereof, to generate the light detection and ranging (LIDAR) data for generating a three-dimensional point cloud.

6 . The mobile reality capture device according to claim 5 , wherein the laser scanner comprises a base and a support, wherein the support is mounted on the base and rotatable relative to the base, and the rotating body is mounted on the support and rotatable relative to the support, wherein and the generation of the LIDAR data comprises:
a continuous rotation of the support relative to the base and a continuous rotation of the rotating body relative to the support, and emission of the laser measurement beam via the passage area of the rotating body and detection of parts of the laser measurement beam returning via the reflecting surface of the rotating body.

7 . The mobile reality capture device according to claim 6 , wherein the laser scanner is configured that the continuous rotation of the rotating body relative to the support is faster than the continuous rotation of the support relative to the base, wherein the continuous rotation of the support is at least 0.1 Hz or 1 Hz and the continuous rotation of the rotating body is at least 50 Hz.

8 . The mobile reality capture device according to claim 5 , wherein:
the mobile reality capture device comprises a panoramic camera unit arranged on a lateral surface of the mobile reality capture device, the lateral surface defining a standing axis of the mobile reality capture device, namely wherein the lateral surface is circumferentially arranged around the standing axis, and the panoramic camera unit is configured to provide for image data which cover a visual field of at least 120° around the standing axis, particularly at least 180° or 360°, wherein the panoramic camera unit comprises multiple cameras circumferentially arranged on the lateral surface and the mobile reality capture device is configured to generate from the image data a panoramic image, namely wherein individual images of the multiple cameras are stitched together to form an image having a wider field of view than the individual images.

9 . The mobile reality capture device according to claim 8 , wherein the localization unit is configured to determine the trajectory with six degrees of freedom, namely involving position and orientation of the mobile reality capture device,
particularly wherein the mobile reality capture device is configured for simultaneous localization and mapping (SLAM) to generate a three-dimensional map by involving at least one of:
data of the IMU,
image data of the camera unit for visual simultaneous localization and mapping (VSLAM), and
LIDAR data for LIDAR based simultaneous localization and mapping (LIDAR-SLAM).

10 . The mobile reality capture device according to claim 1 , further comprising a cover being mounted on the base such that the cover and the base encase all moving parts of the laser scanner, such that from the outside no moving parts are touchable,
in particular wherein the cover is opaque for visible light.

11 . A mobile reality capture device configured to be carried and moved by a mobile carrier, a person or a robot or a vehicle, and to be moved during a measuring process for generating a digital representation of an environment, with:
a housing enclosing an internal space, wherein the internal space has:
a first area free of rotating parts, and
a second area, comprising rotating parts configured to provide a scanning movement of a later measurement beam for generating light detection and ranging (LIDAR) data,
and
a cooling system having a fan unit, an air entrance to let in external air into the first area, and an air passage to forward air from the first area, namely the air that entered over the air entrance, into the second area.

12 . The mobile reality capture device according to claim 11 , wherein the cooling system comprises a two-stage filtering system, with:
a first filter, particularly at least a rainproof filter, which is arranged at the air entrance and separates the internal space from the ambiance, and a second filter, which is arranged in the internal space and separates the internal space in a dirty inner zone lying upstream of the second filter between the first filter and the second filter and a clean inner zone lying downstream of the second filter between the second filter and an air outlet for releasing air into the ambiance.

13 . The mobile reality capture device according to claim 12 , wherein the first filter has coarser filter fineness than the second filter.

14 . The mobile reality capture device according to claim 12 , wherein:
the two-stage filtering system is of modular design, which provides modular removal of the first and/or the second filter, wherein the first and/or the second filter is configured to be water-washable and/or vacuum cleaner cleanable.

15 . The mobile reality capture device according to claim 11 , wherein the mobile reality capture device has a filter monitoring system configured to monitor a contamination level of the two-stage filtering system, based on a determination of the air resistance of air flowing through the two-stage filtering system.

16 . The mobile reality capture device according to claim 11 , wherein the mobile reality capture device comprises a fan controlling unit, configured to control a

Assignees

• Leica Geosystems Ag

Inventors

• Dold Jürgen
• Böckem Burkhard
• Steffen Roman
• Heinzle Lukas
• Harti Ralph Patrick
• Deschout Hendrik
• Graf Roland
• Michels Mattheus Henricus Maria
• Dietschi Michael
• Baijric Adam
• Bonfanti Andrea
• Morin Kristian Walker
• Mark Simon
• Bereuter Klaus
• Ribi Markus
• Portentoso Michele
• Wieser Matthias

Classifications

• H04N2013/0088

  Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title

• G01S7/4817

  relating to scanning · CPC title

• H04N13/275

  from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals · CPC title

• H04N13/243 Primary

  using three or more two-dimensional [2D] image sensors · CPC title