Hybrid 3D optical scanning system

Patent metadata

Field	Value
Publication number	US-10921118-B2
Application number	US-201716350844-A
Country	US
Kind code	B2
Filing date	Jul 27, 2017
Priority date	Jul 27, 2016
Publication date	Feb 16, 2021
Grant date	Feb 16, 2021

Abstract

A hybrid 3D optical scanning system combining methodologies of active stereo 3D reconstruction and deflectometry to provide accurate 3D surface measurements of an object under inspection. In a preferred embodiment, the present system comprises a calibrated digital camera stereo pair and first digital projector for active stereo 3D reconstruction metrology positioned at selected distance apart on the same horizontal plane facing the inspection object at an optimal incidence angle relative to the object surface. A secondary digital projector for deflectometry is directed to project a pattern sequence across the optical projection path of the first digital projector and onto a nonplanar deflection screen extended between the digital camera and the inspection object at a selected angle relative thereto, the selected angle being chosen so that that the pattern projected onto the deflection screen by the secondary digital projector reflects from the surface of the inspection object towards the digital camera. Calibrated active stereo 3D reconstruction is used to derive global shape and the uncalibrated nonplanar deflected light acquires curvature of local fine deformations and surface imperfections along the object surface. The calibrated camera allows per pixel correlations to be defined between the separate acquisition methods and produces accurate absolute measurements of both shape and local features of specular, glossy, metallic curved surfaces.

First claim

What is claimed is:

1. An optical scanning system for acquiring three-dimensional (3D) measurements of an object surface under inspection, the optical scanning system comprising:
a first digital projector for projecting a sequence of multi-scale patterns along a first optical path directed upon the object surface at a predetermined incident angle;
a second digital projector for projecting a sequence of light patterns along a second optical path for deflection onto the object surface, the second optical path being angled with respect to the first optical path;
a deflection screen positioned in the second optical path and angled with respect to the object surface to deflect the sequence of light patterns from the second digital projector onto the object surface; and
at least one digital camera disposed facing the object surface and configured to capture both images of the sequence of multi-scale patterns reflected from the object surface and images of the sequence of light patterns deflected by the deflection screen and reflected from the object surface to generate three-dimensional reconstruction data of the object surface.

2. The optical scanning system according to claim 1 , further comprising:
a computing device coupled to the at least one digital camera and configured to
process the captured images of the sequence of multi-scale patterns reflected from the object surface to provide a three-dimensional reconstruction of the object surface and
process the captured images of the sequence of light patterns deflected by the deflection screen and reflected from the object surface to provide measurements of dents, deformations and scratches.

3. The hybrid optical scanning system according to claim 1 , wherein:
the second digital projector is positioned forwardly facing the deflection screen so that the sequence of light patterns is deflected onto the object surface.

4. The hybrid optical scanning system according to claim 1 , wherein:
the second digital projector is positioned rearwardly facing the deflection screen so that the sequence of light patterns is projected through the deflection screen and onto the object surface.

5. The hybrid optical scanning system according to claim 4 , comprising:
a plurality of active stereo 3D camera pairs each arranged to face the object surface from different respective directions; and
a plurality of second digital projectors configured to illuminate the deflection screen from separate directions;
wherein the plurality of active stereo 3D camera pairs are arranged so that optical paths of the plurality of active stereo 3D camera pairs overlap sufficiently to reconstruct and measure expanded areas of the object surface with the plurality of active stereo 3D camera pairs after being calibrated using at least one of a multi-scale calibration pattern or a multi-scale random pattern.

6. The hybrid optical scanning system according to claim 1 , further comprising:
a nonplanar optical path folding mirror positioned along the second optical path for redirecting the sequence of light patterns from the second digital projector onto the deflection screen to rectify and optimize deflections of the sequence of light patterns onto the object surface.

7. The hybrid optical scanning system according to claim 1 , wherein:
the sequence of multi-scale patterns projected onto the object surface from the first digital projector include gray code patterns, sinusoidal fringe patterns, or a combination thereof; and
the sequence of light patterns projected from the second digital projector onto the object surface include stripe or fringe pattern sequences.

8. The hybrid optical scanning system according to claim 7 , wherein the sequence of light patterns comprises a combination of lower frequency and higher frequency multi-directional patterns of light that are projected onto the object surface via the deflection screen to detect and measure dents and deformations and linear scratches and abrasions on the object surface.

9. The optical scanning system of claim 1 , wherein the at least one digital camera and the first digital projector are calibrated together using a calibration pattern.

10. The optical scanning system of claim 1 , wherein the sequence of light patterns is non-calibrated.

11. The optical scanning system of claim 1 , wherein the deflection screen is nonplanar.

12. The optical scanning system of claim 1 , wherein the at least one digital camera is disposed in a direction substantially parallel to the first optical path.

13. The optical scanning system of claim 12 , wherein the at least one digital camera comprises a pair of cameras disposed on opposite sides of the first digital projector.

14. The optical scanning system of claim 13 , wherein a disparity between an optical path of a digital camera of the pair and the first optical path is about one third of a distance from the pair to the object surface.

15. The optical scanning system of claim 1 , wherein at least one of the first incident angle or the second incident angle is determined based on a curvature of the object surface.

16. The optical scanning system of claim 1 , wherein at least one of the first incident angle or the second incident angle is in a range from 15° to 40°.

17. An optical scanning system for acquiring three-dimensional (3D) measurements of an object surface under inspection, the optical scanning system comprising:
a digital projector for projecting a sequence of multi-scale patterns along a direct optical path projected upon the object surface at a predetermined incident angle;
a light path deflector disposed for selectively redirecting the sequence of multi-scale patterns from the direct optical path and along a deflection path;
a deflection screen angled with respect to the object surface to deflect redirected multi-scale patterns along the deflection path onto the object surface; and
at least one digital camera disposed facing the object surface and configured to capture both images of the sequence of multi-scale patterns projected directly onto the object surface and reflected from the object surface and images of the redirected multi-scale patterns deflected by the deflection screen on the object surface and reflected from the object surface to generate three-dimensional reconstruction data of the object surface.

18. The hybrid optical scanning system according to claim 17 , further comprising:
a computing device coupled to the at least one digital camera and configured to
process the captured images of the multi-scale patterns projected directly onto the object surface and reflected from the object surface to provide a three-dimensional reconstruction of the object surface and
process the captured images of the redirected multi-scale patterns projected and deflected by the deflection screen on the object surface and reflected from the object surface to provide measurements of dents, deformations and scratches.

19. The hybrid optical scanning system according to claim 17 , wherein the light path deflector comprises:
a curved optical path-splitting mirror disposed in a stationary position along the direct optical path.

20. The hybrid optical scanning system according to claim 17 , wherein the light path deflector comprises:
an active mirror pivotally disposed for rotation into and out of the direct optical path.

21. An optical scanning method of acquiring three-dimensional (3D) measurements of an object surface under inspection, the optical scanning method comprisi

Assignees

• Vehicle Service Group Llc

Inventors

• Grauzinis Aivaras Alfonsas
• Willems Geert

Classifications

• G01B11/2518

  Projection by scanning of the object · CPC title

• G01B11/2513 Primary

  with several lines being projected in more than one direction, e.g. grids, patterns · CPC title