On-board light source calibration

Patent metadata

Field	Value
Publication number	US-11297255-B1
Application number	US-202017024901-A
Country	US
Kind code	B1
Filing date	Sep 18, 2020
Priority date	Sep 18, 2020
Publication date	Apr 5, 2022
Grant date	Apr 5, 2022

Abstract

An example method includes recording dark images on an image sensor on-board an orbital vehicle during flight, which include a first image recorded before the orbital vehicle is over a predefined location on the Earth and a second image recorded after the orbital vehicle is over the predefined location; and recording third and fourth images on the image sensor during flight based on illumination from a light source that is on-board, with the third image being recorded before the orbital vehicle is over the predefined location and the fourth image being recorded after the orbital vehicle is over the predefined location. A fifth image is recorded on the image sensor during flight while the predefined location on the Earth is visible to the image sensor. The fifth image is based on light from a ground-based calibration system. The light source is calibrated during flight based on the five images.

First claim

What is claimed is:

1. A method of calibrating a light source that is on-board an orbital vehicle during flight, the method comprising:
recording dark images on an image sensor on-board the orbital vehicle during flight, the dark images including a first image recorded before the orbital vehicle is over a predefined location on the Earth and a second image recorded after the orbital vehicle is over the predefined location on the Earth;
recording a third image and a fourth image on the image sensor during flight based on illumination from the light source that is on-board the orbital vehicle, the third image being recorded before the orbital vehicle is over the predefined location on the Earth and the fourth image being recorded after the orbital vehicle is over the predefined location on the Earth;
recording a fifth image on the image sensor during flight while the predefined location on the Earth is visible to the image sensor, the fifth image being based on light from a ground-based calibration system; and
calibrating the light source during flight based on the first image, the second image, the third image, the fourth image, and the fifth image.

2. The method of claim 1 , further comprising:
generating a radiance map for a state of the light source based on the first image, the second image, the third image, the fourth image, and the fifth image.

3. The method of claim 1 , further comprising:
controlling operation of the light source to calibrate the image sensor.

4. The method of claim 1 , wherein the orbital vehicle comprises a shutter to open to the environment and wherein the light source and the image sensor are behind the shutter; and
wherein recording the dark images, the third and fourth images, and the fifth image comprises:
closing the shutter to restrict environmental light from reaching the image sensor;
recording the first image on the image sensor when the shutter is closed and the light source is off;
turning the light source on to illuminate the image sensor when the shutter is closed;
recording the third on the image sensors when the shutter is closed and the light source is illuminated;
turning the light source off;
opening the shutter to allow light from a ground-based calibration system to illuminate the image sensor;
recording the fifth image on the image sensor based on the light from the ground-based calibration system;
closing the shutter to restrict environmental light from reaching the image sensor;
turning the light source on to illuminate the image sensor when the shutter is closed;
recording the fourth image on the image sensor when the shutter is closed and the light source is illuminated;
turning the light source off; and
recording the second image on the image sensors when the shutter is closed and the light source is off.

5. The method of claim 1 , wherein the light source is among multiple light sources included on the orbital vehicle, where different combinations of the multiple light sources comprise different states; and
wherein the method comprises performing the calibrating for different states that include the light source based on the first image, the second image, the third image, the fourth image, and the fifth image.

6. The method of claim 1 , wherein calibrating comprises:
obtaining a dark bias of the light source based on the first and second images;
removing the dark bias from the third, fourth, and fifth images;
performing a calibration analysis of the image sensor based on the fifth image having the dark bias removed to obtain gain coefficients for pixels in the sensor, each gain coefficient for converting a digital number for a pixel into a radiance value;
determining average digital numbers for pixels in the image sensor based on the third and fourth images having the dark bias removed; and
applying the gain coefficients to the average digital numbers.

7. The method of claim 6 , wherein applying comprises multiplying the gain coefficients by the average digital numbers.

8. The method of claim 1 , wherein the dark bias comprises an average dark bias for multiple images.

9. The method of claim 1 , further comprising, repeating the following operations for two or more different spectral bands of the light:
recording the dark images on the image sensor on-board the orbital vehicle during flight, the dark images including the first and second images;
recording the third and fourth images during flight;
recording the fifth image on the image sensor during flight while the orbital vehicle is over the predefined location on the Earth; and
generating the radiance map.

10. The method of claim 1 , wherein the ground-based calibration system comprises a plurality of spherical mirrors disposed upon a uniform background as at least one array of reflective points, at least two points of the array reflecting an intensity of directly incident sunlight.

11. A system on an orbital vehicle, the system comprising:
an image sensor for capturing images based on incident light;
a light source to illuminate the image sensor;
a shutter that is controllable to allow environmental light to reach the image sensor to prevent the environmental light from reaching the image sensor; and
a control system to perform operations comprising:
controlling the shutter to record dark images on the image sensor on-board the orbital vehicle during flight, the dark images including a first image recorded before the orbital vehicle is over a predefined location on the Earth and a second image recorded after the orbital vehicle is over the predefined location on the Earth;
controlling the shutter to record a third image and a fourth image on the image sensor during flight based on illumination from the light source that is on-board the orbital vehicle, the third image being recorded before the orbital vehicle is over the predefined location on the Earth and the fourth image being recorded after the orbital vehicle is over the predefined location on the Earth;
controlling the shutter to record a fifth image on the image sensor during flight while the predefined location on the Earth is visible to the image sensor, the fifth image being based on light from a ground-based calibration system; and
calibrating the light source during flight based on the first image, the second image, the third image, the fourth image, and the fifth image.

12. The system of claim 11 , wherein the operations comprise:
generating a radiance map for a state of the light source based on the first image, the second image, the third image, the fourth image, and the fifth image.

13. The system of claim 12 , wherein operation of the light source is controlled to calibrate the image sensor.

14. The system of claim 11 , wherein the orbital vehicle comprises a shutter to open to the environment, and where the light source and the image sensor are behind the shutter; and
wherein recording the dark images, the third and fourth images, and the fifth image comprises:
controlling the shutter to close to restrict environmental light from reaching the image sensor;
recording the first image on the image sensor when the shutter is closed and the light source is off;
turning the light source on to illuminate the image sensor when the shutter is closed;
recording the third on the image sensors when the shutter is closed and the light source is illuminated;
turning the light source off;
controlling the shutter to open to allow light from a ground-based calibration system to illuminate the image sensor;
recording the fifth image on the image sensor based on the light from the ground-based calibration system;

Assignees

• Raytheon Co

Inventors

• Schiller Stephen J

Classifications

• H04N23/74 Primary

  by influencing the scene brightness using illuminating means · CPC title

• G01J3/501

  Colorimeters using spectrally-selective light sources, e.g. LEDs · CPC title

• B64G1/66

  Arrangements or adaptations of apparatus or instruments, not otherwise provided for · CPC title

• G01J2003/102

  Plural sources · CPC title

• G06T2207/30181

  Earth observation · CPC title