Method and system for projecting image with differing exposure times

Patent metadata

Field	Value
Publication number	US-10115034-B2
Application number	US-201615294667-A
Country	US
Kind code	B2
Filing date	Oct 14, 2016
Priority date	May 1, 2013
Publication date	Oct 30, 2018
Grant date	Oct 30, 2018

Abstract

Systems and methods generate a projected image at an optimal exposure time. Images are captured different exposure times. Pixels that satisfy an intensity threshold percentage for each image are selected. The intensity values of the selected pixels are then evaluated to determine whether the selected pixels are distributed above a lower intensity threshold and below an upper intensity threshold. The linear relationship is projected to determine an optimal exposure time that has an optimal exposure time duration that exceeds each exposure time duration associated with each of the captured images when the linear relationship exists between each of the captured images. A projected image associated with the optimal exposure time is generated from one or more of the captured images.

First claim

What is claimed is:

1. A computer implemented method for generating a projected image at an optimal exposure time, comprising:
capturing a plurality of images with each image captured at a different exposure time;
assessing each image of the plurality of images and selecting pixels that have intensity values that satisfy an intensity threshold percentage for each image, wherein the intensity threshold percentage is a percentage of pixels included in the image with each pixel included in the percentage of pixels having an intensity value that is higher than an intensity value for each pixel that is excluded from the percentage of pixels;
evaluating whether the intensity values of the selected pixels are distributed above a lower intensity threshold and below an upper intensity threshold;
determining whether a linear relationship exists for the intensity values between each of the captured images for which the intensity values of the selected pixels are above the lower intensity threshold and below the upper intensity threshold, wherein the determining whether the linear relationship exists comprises:
determining a theoretical linear relationship between a first image with a first exposure time duration and a second image with a second exposure time duration, wherein the first exposure time duration is shorter than the second exposure time duration;
projecting the linear relationship to determine an optimal exposure time that has an exposure time duration that exceeds each exposure time duration associated with each of the captured images when the linear relationship exists between each of the captured images, wherein the optimal exposure time is based upon a pixel intensity saturation level threshold; and
generating a projected image associated with the optimal exposure time from one or more of the captured images; and
determining whether each image that has an exposure time duration that is between the first exposure time duration of the first image and the second exposure time duration of the second image is within a threshold distance of the theoretical linear relationship.

2. The computer implemented method of claim 1 , wherein at least three images are captured with each of images captured at different exposure times.

3. The computer implemented method of claim 1 , wherein the projecting comprises:
projecting the linear relationship to determine the optimal exposure time when each image that has the exposure time duration that is between the first exposure time duration of the first image and the second exposure time duration of the second image is within the threshold distance of the theoretical linear relationship.

4. The computer implemented method of claim 1 , further comprising:
capturing an additional image with an exposure time that has an exposure time duration that exceeds each of the exposure time durations for each of the previously captured images when one or more images that have the exposure time duration that is between the first exposure time duration of the first image and the second exposure time duration of the second image is beyond the threshold distance of the linear relationship.

5. The computer implemented method of claim 4 , further comprising:
determining an adjusted theoretical linear relationship between the first image with the first exposure time duration and the one or more additional images with the exposure time duration that exceeds each of the exposure time durations for each of the previously captured images.

6. The computer implemented method of claim 5 , further comprising:
determining whether each image that has the exposure time duration that is between the first exposure time duration of the first image and the second exposure time duration of the second image is within the threshold distance of the adjusted theoretical linear relationship.

7. The computer implemented method of claim 6 , further comprising:
projecting the adjusted theoretical linear relationship to determine the optimal exposure time when each image that has the exposure time duration that is between the first exposure time duration of the first image and the second exposure time duration of the second image is within the threshold distance of the adjusted theoretical linear relationship.

8. The computer implemented method of claim 7 , wherein the first exposure time duration is a shortest time duration of each of the captured images and the second time duration is a longest time duration of each of the captured images.

9. A system for generating a projected image with an optimal exposure time, comprising:
an image capturing device configured to capture a plurality of images with each image captured at a different exposure time;
at least one processor; and
a memory coupled with the processor, the memory including instructions that, when executed by the processor cause the processor to:
assess each image of the plurality of images and select pixels that have intensity values that satisfy an intensity threshold percentage for each image, wherein the intensity threshold percentage is a percentage of pixels included in the image with each pixel included in the percentage of pixels having an intensity value that is higher than an intensity value for each pixel that is excluded from the percentage of pixels,
evaluate whether the intensity values of the selected pixels are distributed over a lower intensity threshold and below an upper intensity threshold,

determine whether a linear relationship exists for the intensity values between each of the captured images for which the intensity values of the selected pixels are above the lower intensity threshold and below the upper intensity threshold between each of the captured images,
project the linear relationship to determine an optimal exposure time that has an exposure time duration that exceeds each exposure time duration associated with each of the captured images when the linear relationship exists between each of the captured images, wherein the optimal exposure time is based upon a pixel intensity saturation level threshold, and
generate a projected image associated with the optimal exposure time from one or more of the captured images,

wherein the instructions when executed by the processor further cause the processor to determine a theoretical linear relationship between a first image with a first exposure time duration and a second image with a second exposure time duration, wherein the first exposure time duration is shorter than the second exposure time duration and wherein the instructions when executed by the processor further cause the processor to determine whether each image that has an exposure time duration that is between the first exposure time duration of the first image and the second exposure time duration of the second image is within a threshold distance of the theoretical linear relationship.

10. The system of claim 9 , wherein at least three images are captured with each of the images captured at different exposure times.

11. The system of claim 10 , wherein the instructions when executed by the processor further cause the processor to capture an additional image with an exposure time that has an exposure time duration that exceeds each of the exposure time durations for each of the previously captured images when one or more images that have the exposure time duration that is between the first exposure time duration of the first image and the second exposure time duration of the second image is beyond the threshold distance of the linear relationship.

12. The system of claim 11 , wherein the instructions when executed by the processor further cause the processor to determine a

Assignees

• Life Tech Holdings Pte Limited
• Pierce Biotechnology Inc

Inventors

• HONG Suk
• Jarrett Nikki
• Hommema Eric
• Aravich Jason
• Cao Yanpeng
• Shi Benyong
• Teo Kok Siong

Classifications

• H04N23/71 Primary

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• H04N5/2353

  Electricity · mapped topic

• G06K9/4647 Primary

  Physics · mapped topic

• G06T7/0002

  Inspection of images, e.g. flaw detection · CPC title