Controlled illumination for improved 3D model reconstruction

Patent metadata

Field	Value
Publication number	US-12586298-B2
Application number	US-202318105941-A
Country	US
Kind code	B2
Filing date	Feb 6, 2023
Priority date	Feb 6, 2023
Publication date	Mar 24, 2026
Grant date	Mar 24, 2026

Abstract

Disclosed herein is a method of improving computation of a 3 dimensional (3D) model of an object, comprising adjusting one or more illumination parameter of one or more light sources illuminating a target object having one or more high reflection surfaces, and operating one or more image sensors to capture a plurality of images depicting the target object from a plurality of different viewpoints while the object is illuminated by the one or more light sources. Wherein the plurality of images are used by one or more processors to compute a 3D model of the target object based on a plurality of features extracted from the plurality of images.

First claim

What is claimed is:

1 . A method of improving computation of a 3 dimensional (3D) model of an object, comprising:
using at least one processor for:
analyzing one or more preliminary images depicting a target object to detect regions exhibiting high reflection characteristics;
identifying, through said analysis, at least one high reflection surface that produces reflection effects that interfere with computation of said 3D model;
adjusting, based on said analysis, at least one illumination parameter of at least one light source illuminating said target object, so as to reduce or eliminate said reflection effects from said at least one high reflection surface, prior to capturing final modelling images, when illuminated by said at least one light source, wherein the at least one illumination parameter defines at least one lighting parameter of the at least one light source adapted to illuminate the target object in at least one illumination spectral range, the at least one lighting spectral range is characterized by low reflection from the at least one high reflection surface;
operating at least one image sensor to capture a plurality of images depicting the target object from a plurality of different viewpoints while the object is illuminated by the adjusted at least one light source; and
using the plurality of images to compute, by said at least one processor, a 3D model of the target object based on a plurality of features extracted from the plurality of images.

2 . The method of claim 1 , wherein said reflection effects are identified in at least one of the plurality of images.

3 . The method of claim 1 , wherein the at least one illumination parameter defines at least one filtering parameter of at least one spectral filter deployed to filter out at least one reflecting spectral range of light illuminating the target object, the at least one reflecting spectral range is characterized by high reflection from the at least one high reflection surface.

4 . The method of claim 1 , wherein the at least one illumination spectral range deviates by more than a certain value from a background illumination of the target object.

5 . The method of claim 1 , wherein the at least one image sensor is adapted to operate in the at least one illumination spectral range.

6 . The method of claim 1 , wherein the at least one illumination spectral range is in Infrared (IR) spectral region.

7 . The method of claim 1 , wherein the at least one illumination spectral range is in Ultraviolet (UV) spectral region.

8 . The method of claim 1 , wherein the at least one illumination parameter defines at least one timing parameter for the at least one light source adapted to illuminate the target object in a plurality of short light flashes having a time duration interval defined by the at least one timing parameter.

9 . The method of claim 1 , wherein the at least one illumination parameter defines a lighting intensity of the at least one light source illuminating the target object.

10 . The method of claim 1 , further comprising operating at least one coherent light source to illuminate the target object.

11 . The method of claim 1 , further comprising adjusting the at least one illumination parameter of at least one of a plurality of light sources illuminating the target object from a plurality of viewpoints according to a position of the at least one light source with respect to the at least one image sensor.

12 . The method of claim 1 , wherein said reflection effects interfere with extraction of said plurality of features from said plurality of images, and wherein reducing or eliminating said reflection effects improves accuracy of said feature extraction.

13 . The method of claim 1 , wherein said adjusting occurs during capture of said plurality of images to improve said computation of said 3D model.

14 . The method of claim 1 , wherein said reflection effects interfere with matching of corresponding features between different images of said plurality of images, and wherein reducing or eliminating said reflection effects improves said matching to enhance accuracy of said 3D model computation.

15 . The method of claim 14 , wherein said adjusting occurs during capture of said plurality of images to prevent said reflection effects from degrading said feature matching.

16 . The method of claim 1 , wherein said at least one high reflection surface comprises a surface that reflects visible light spectrum illumination in a manner that obscures object features needed for said 3D model computation.

17 . A system for improving computation of a 3 dimensional (3D) model of an object, comprising:
at least one processor configured to execute a code, the code comprising:
code instructions to analyze one or more preliminary images depicting a target object to detect regions exhibiting high reflection characteristics;
code instructions to identify, through said analysis, at least one high reflection surface that produces reflection effects that interfere with computation of said 3D model;
code instruction to adjust, based on said analysis, at least one illumination parameter of at least one light source illuminating said target object, so as to reduce or eliminate said reflection effects from said at least one high reflection surface, prior to capturing final modelling images, when illuminated by said at least one light source, wherein the at least one illumination parameter defines at least one lighting parameter of the at least one light source adapted to illuminate the target object in at least one illumination spectral range, the at least one lighting spectral range is characterized by low reflection from the at least one high reflection surface;
code instruction to operate at least one image sensor to capture a plurality of images depicting the target object from a plurality of different viewpoints while the object is illuminated by the adjusted at least one light source; and
code instruction to use the plurality of images to compute, by said at least one processor, a 3D model of the target object based on a plurality of features extracted from the plurality of images.

18 . A computer program product for improving computation of a 3 dimensional (3D) model of an object, comprising a non-transitory medium storing thereon computer program instructions which, when executed by at least one hardware processor cause the at least one hardware processor to:
analyze one or more preliminary images depicting a target object to detect regions exhibiting high reflection characteristics; identify, through said analysis, at least one high reflection surface that produces reflection effects that interfere with computation of said 3D model; adjust, based on said analysis, at least one illumination parameter of said at least one light source illuminating said target object, so as to reduce or eliminate said reflection effects from said at least one high reflection surface, prior to capturing final modelling images, when illuminated by said at least one light source, wherein the at least one illumination parameter defines at least one lighting parameter of the at least one light source adapted to illuminate the target object in at least one illumination spectral range, the at least one lighting spectral range is characterized by low reflection from the at least one high reflection surface; operate at least one image sensor to capture a plurality of images depicting the target object from a plurality of different viewpoints while the object is illuminated by the adjusted at

Assignees

• Nec Corp America

Inventors

• Lev Tsvi

Classifications

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06V10/60 Primary

  relating to illumination properties, e.g. using a reflectance or lighting model · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• G06T7/55

  from multiple images · CPC title

• G06T2207/10152

  Varying illumination · CPC title