System and method for determining 3D surface features and irregularities on an object

Patent metadata

Field	Value
Publication number	US-12079978-B2
Application number	US-202117526865-A
Country	US
Kind code	B2
Filing date	Nov 15, 2021
Priority date	Jan 27, 2014
Publication date	Sep 3, 2024
Grant date	Sep 3, 2024

Abstract

This invention provides a system and method for determining the location and characteristics of certain surface features that comprises elevated or depressed regions with respect to a smooth surrounding surface on an object. A filter acts on a range image of the scene. A filter defines an annulus or other perimeter shape around each pixel in which a best-fit surface is established. A normal to the pixel allows derivation of local displacement height. The displacement height is used to establish a height deviation image of the object, with which bumps, dents or other height-displacement features can be determined. The bump filter can be used to locate regions on a surface with minimal irregularities by mapping such irregularities to a grid and then thresholding the grid to generate a cost function. Regions with a minimal cost are acceptable candidates for application of labels and other items in which a smooth surface is desirable.

First claim

What is claimed is:

1. A system for determining a region on a surface having low surface irregularity comprising:
a vision system tool that locates the surface and acquires a 3D image of at least a portion of the surface;
a filter that determines a relative height displacement for an area about each of a selected group of pixels on the 3D image; and
a location element that cost-values the height displacement for each region based upon results provided by the filter and that determines a minimal cost region that accommodates a predetermined area.

2. The system as set forth in claim 1 wherein the predetermined area is sized to accommodate a label, printing or other embellishment.

3. The system as set forth in claim 1 further comprising a mapping element that resolves the height displacement for each of a plurality of regions on the image into a grid element with a height value.

4. The system as set forth in claim 1 further comprising a thresholding element that resolves each height value respectively into a binary value based upon whether a height value is above or below at least one predetermined parameter.

5. The system as set forth in claim 4 , wherein the predetermined parameter is at least one of (a) height displacement above or below a surrounding surface in the region and (b) area of a differing height displacement relative to the surrounding surface in the region.

6. The system as set forth in claim 1 wherein the filter (a) generates a best-fit surface of average height about each of selected pixels in the range image, (b) establishes a normal to the best-fit surface, respectively for each of the pixels, to (c) determine the height displacement of the about each of the pixels relative to the best-fit surface.

7. The system as set forth in claim 6 wherein the filter includes a background region about each of the selected pixels from which the best-fit surface is established.

8. The system as set forth in claim 7 wherein the filter includes a foreground region, located proximate to the background region and including at least one of the selected pixels in which the relative height displacement is determined.

9. The system as set forth in claim 8 wherein at least one of a size and a shape of at least one of the background region and the foreground region is user-defined based upon at least one of a size and a shape of the object.

10. The system as set forth in claim 6 wherein the best-fit surface comprises a best-fit plane.

11. The system as set forth in 1 wherein the camera assembly comprises a displacement sensor that projects a line of light on the object and receives light from the projected line at an imager in a manner that defines a plurality of displacement values in a height direction.

12. The system as set forth in claim 1 wherein the location element determines if a suitable minimal cost region exists.

13. The system as set forth in claim 1 wherein each grid element comprises part of a regular grid of predetermined density on the image.

14. The system as set forth in claim 1 wherein the image includes at least one exclusionary zone thereon that is omitted from the minimal cost region.

15. The system as set forth in claim 14 wherein the exclusionary zone includes at least one of labels, printing and embellishments on the surface.

16. The system as set forth in claim 15 wherein the surface comprises at least part of a package and the minimal cost region is adapted to receive at least one of an applied label and printing.

17. The system as set forth in claim 1 wherein the surface comprises at least part of a package and the minimal cost region is adapted to receive at least one of an applied label and printing.

18. A method for determining a region on a surface having low surface irregularity comprising:
locating the surface;
acquiring a 3D image of at least a portion of the surface;
determining, via a filter, a relative height displacement for an area about each of a selected group of pixels on the 3D image;
determining a cost-value of the height displacement for each region based upon results provided by the filter; and
determining a minimal cost region that accommodates a predetermined area.

Assignees

• Cognex Corp

Inventors

• Akopyan Mikhail
• Jacobson Lowell D
• Wolff Robert A

Classifications

• G06T2207/30224

  Ball; Puck · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G01S17/89

  for mapping or imaging · CPC title

• G01S17/48

  Active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves · CPC title

• G01S17/42

  Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46) · CPC title