Extraction of extraction information from scanning information of a surface for use with a database

Patent metadata

Field	Value
Publication number	US-12293595-B2
Application number	US-202318311444-A
Country	US
Kind code	B2
Filing date	May 3, 2023
Priority date	Nov 8, 2020
Publication date	May 6, 2025
Grant date	May 6, 2025

Abstract

An apparatus having a processing unit configured to obtain scanning information, provided by a detection unit, from a scan of a surface, wherein the scanning information have information on an inherent feature of the surface. Furthermore, the processing unit is configured to extract extraction information for the inherent feature from the scanning information and to perform matching with a database based on the extraction information, wherein extraction information for a plurality of inherent features of the surface are stored in the database. Furthermore, the processing unit is configured to determine the position of the detection unit based on the matching.

First claim

The invention claimed is:

1. An apparatus comprising:
a processing unit configured to
acquire scanning information, provided by a detection unit, from a scan of a surface, the scanning information comprising information on an inherent feature of the surface, wherein the inherent feature of the surface comprises a plurality of sub-features; and
extract extraction information for the inherent feature from the scanning information, wherein the processing unit is configured to extract a set of sub-extraction information for each sub-feature of the plurality of sub-features and to determine a descriptor as part of the set of sub-extraction information for each sub-feature; and
determine a value from each set of sub-extraction information, the value being associated to an information content of the sub-feature associated with the set of sub-extraction information; and
compare each value to a threshold value; and
select those sets of sub-extraction information for whose associated sub-feature the determined value at least reaches the threshold value; and
perform matching with a database based on determined descriptors of the selected sets of sub-extraction information, wherein the database stores extraction information for a plurality of inherent features of the surface whose positions are known, and wherein the database stored descriptors for the plurality of sub-features; and
determine the position of the detection unit based on the matching.

2. The apparatus according to claim 1 , the apparatus comprising the detection unit configured to provide the scanning information.

3. The apparatus according to claim 1 , wherein the processing unit is configured to determine, based on the matching with the database, the location of the detection unit in space with respect to the inherent feature of the surface.

4. The apparatus according to claim 1 , wherein the processing unit is configured to extract the extraction information for the inherent feature from the scanning information taking into account optical properties of the detection unit.

5. The apparatus according to claim 1 , wherein the processing unit is configured to select a selected part of extraction information of the database based on coarse information on the position of the detection unit in space, at the time of detecting the scanning information, and to use the selected part for matching.

6. The apparatus according to claim 1 , wherein the processing unit is configured to determine a rotation-invariant descriptor as part of the extraction information which is based on the inherent feature of the surface.

7. The apparatus according to claim 1 , wherein the inherent feature of the surface is a stochastically distributed feature comprising stochastic properties.

8. The apparatus according to claim 7 , wherein the information specifies a description of a random geometry of the stochastically distributed feature.

9. The apparatus according to claim 7 , wherein the stochastically distributed feature comprises a contiguous surface comprising random area and random external shape; and
wherein the processing unit is configured to extract the extraction information comprising information on the contiguous area comprising random area and random external shape.

10. The apparatus according to claim 1 , wherein the processing unit comprises a stochastic filter, and wherein the processing unit is configured to perform filtering of the determined position of the detection unit by means of the stochastic filter to determine a filtered position of the detection unit.

11. The apparatus according to claim 1 , wherein the processing unit is configured to select the sets of sub-extraction information based on the probability of occurrence of the associated sub-features.

12. The apparatus according to claim 1 , wherein the processing unit is configured to determine from each set of sub-extraction information a probability of occurrence of the associated sub-feature as a value for the information content.

13. The apparatus according to claim 1 , wherein the processing unit is configured to determine a point cloud from the selected sets of sub-extraction information and to perform matching with the database based on a point cloud matching algorithm.

14. The apparatus according to claim 1 , wherein the processing unit is configured to
acquire the scanning information as an image from a camera as a detection unit, wherein the image is a scan of a ground surface, and wherein the image comprises information on an image background and an image foreground, the image foreground comprising information on a plurality of color speckles of the ground; and
extract the information on the image foreground from the image; and
for each color speckle of the plurality of color speckles, extract a set of sub-extraction information from the extracted information of the image foreground and determine a descriptor as part of the set of sub-extraction information, the set of sub-extraction information comprising information on a position and at least one of a shape, a color and an area parameter of the associated color speckle; and
determine a value from each set of sub-extraction information, the value being associated to a probability of occurrence of the color speckle associated to the set of sub-extraction information; and
compare each value to a threshold value; and
select those sets of sub-extraction information for whose associated color speckle the determined value at least reaches the threshold value; and
determine a point cloud from the selected sets of sub-extraction information which comprise information on the positions of the associated color speckles; and
perform matching with a database based on the point cloud and the selected sets of sub-extraction information, wherein the database stores a predetermined point cloud of positions of color speckles of the ground surface and corresponding sets of sub-extraction information, and wherein the database stores descriptors for the plurality of color speckles; and
determine the position of the camera based on the matching.

15. The apparatus according to claim 1 , the apparatus being an automatically moving vehicle, and wherein the processing unit is configured to locate the automatically moving vehicle.

16. The apparatus according to claim 1 ,
wherein the inherent feature comprises an optically recognizable, distinguishable or varying over the surface feature in the form of a difference in contrast, a difference in color and/or a height profile of the surface.

17. The apparatus according to claim 1 ,
wherein the inherent feature of the surface is a difference in contrast, a difference in color and/or a height profile of the surface.

18. The apparatus according to claim 1 ,
wherein the inherent feature of the surface is a stochastically distributed feature with stochastic properties;
wherein the feature is a pattern of the surface with different sizes, shapes, colors or structures and/or a height profile.

19. A system comprising:
an apparatus according to claim 1 ; and
the surface comprising the inherent feature, the apparatus being arranged to be movable with respect to the surface and configured to determine a position of the detection unit with respect to the surface; and
the database.

20. A method for storing extraction information in a database for use with an apparatus according to claim 1 , comprising:
acquiring scanning information, wherein the scanning information are a scan of a surface, and wherein the scanning

Assignees

• Fraunhofer Ges Forschung

Inventors

• Behling Jan
• Rotgeri Mathias
• Emmerich Jan Sören
• Höning Dirk
• Klokowski Patrick
• Hammermeister Christian

Classifications

• G06V20/56

  exterior to a vehicle by using sensors mounted on the vehicle · CPC title

• G06V10/771

  Feature selection, e.g. selecting representative features from a multi-dimensional feature space · CPC title

• G05D1/0246

  using a video camera in combination with image processing means · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06V20/80 Primary

  Recognising image objects characterised by unique random patterns · CPC title