Techniques for atmospheric and solar correction of aerial images

Patent metadata

Field	Value
Publication number	US-9576349-B2
Application number	US-97368910-A
Country	US
Kind code	B2
Filing date	Dec 20, 2010
Priority date	Dec 20, 2010
Publication date	Feb 21, 2017
Grant date	Feb 21, 2017

Abstract

Techniques for atmospheric and solar correction of aerial images are described. An apparatus may comprise an atmospheric and solar component arranged for execution by a logic device and operative to correct solar and atmosphere artifacts from an aerial image. The atmospheric and solar component may comprise an image information component operative to generate an image record for each aerial image of a group of aerial images, the image record comprising statistical information and image context information for each aerial image, a filter generation component operative to generate an atmospheric filter and a solar filter from the statistical information and the image context information stored in the image records, and an image correction component operative to correct atmospheric and solar artifacts from the aerial image using the respective atmospheric filter and solar filter. Other embodiments are described and claimed.

First claim

The invention claimed is:

1. A computer-implemented method, comprising:
receiving multiple aerial images;
grouping a set of aerial images based on image context information for each aerial image;
dividing each aerial image of the set of aerial images into grids;
generating statistical information for each aerial image, including aggregating statistics of the grids;
creating an atmospheric filter insensitive to scene content from the statistical information and the image context information, wherein the atmospheric filter filters atmospheric effects from light scattering and atmospheric absorption due to aerosols; and
correcting atmosphere artifacts of an aerial image using the atmospheric filter.

2. The computer-implemented method of claim 1 , comprising:
dividing an aerial image into multiple grids;
calculating a shadow percentile value for each grid;
calculating a standard deviation value for each grid;
storing the shadow percentile values and the standard deviation values in an image record for the aerial image; and
storing image context information associated with the aerial image in the image record.

3. The computer-implemented method of claim 1 , comprising:
identifying an image window of a subset of aerial images from the group;
generating a grid atmospheric haze additive term value for each grid of a target aerial image using shadow percentile values from aerial images in the image window;
generating a grid atmospheric correction gain term value for each grid of the target aerial image using standard deviation values from aerial images in the image window; and
storing the grid atmospheric haze additive term values and grid atmospheric correction gain term values for the target aerial image in a filter image record.

4. The computer-implemented method of claim 1 , comprising correcting atmosphere additive haze and multiplicative attenuation for a target aerial image using grid atmospheric haze additive term values and grid atmospheric correction gain term values stored in a filter image record associated with the target aerial image.

5. The computer-implemented method of claim 1 , comprising calculating a pixel atmospheric haze additive term value for a pixel of a target aerial image using grid atmospheric haze additive term values stored in a filter image record associated with the target aerial image.

6. The computer-implemented method of claim 1 , comprising calculating a pixel atmospheric correction gain term value for a pixel of a target aerial image using grid atmospheric correction gain term values stored in a filter image record associated with the target aerial image.

7. The computer-implemented method of claim 1 , comprising correcting a pixel of a target aerial image using a pixel atmospheric haze additive term value calculated for the pixel.

8. The computer-implemented method of claim 1 , comprising correcting a pixel of a target aerial image using a pixel atmospheric correction gain term value calculated for the pixel.

9. A system comprising at least one processor in communication with computer-readable storage media, the computer readable storage media storing instructions, that, when executed cause the at least one processor to:
receive multiple aerial images spanning multiple days along and having a difference in solar irradiance in at least two flight lines;
receive image context information for each aerial image, the image context information to comprise camera location information for that aerial image;
create a solar filter from the image context information;
correct solar artifacts of an aerial image using the solar filter; and
scale at least one aerial image to a mean brightness level using the solar filter.

10. The system of claim 9 , further comprising instructions that when executed enable the system to calculate a sun elevation angle value for each aerial image.

11. The system of claim 9 , further comprising instructions that when executed enable the system to calculate an average sun elevation angle value from multiple sun elevation angle values for a group of aerial images.

12. The system of claim 9 , further comprising instructions that when executed enable the system to calculate a solar flux factor value for a target aerial image from an average sun elevation angle value for a group of aerial images.

13. The system of claim 9 , further comprising instructions that when executed enable the system to calculate an average exposure time value and average aperture value for a group of aerial images.

14. The system of claim 9 , further comprising instructions that when executed enable the system to calculate an exposure normalization factor value for a target aerial image from an average exposure time value and an average aperture value for a group of aerial images.

15. The system of claim 9 , further comprising instructions that when executed enable the system to calculate a total normalization factor value for a target aerial image from a solar flux factor value and exposure normalization factor value for the target aerial image.

16. An apparatus, comprising:
a logic device; and
a plurality of components executing on the logic device, the plurality of components comprising:
an atmospheric and solar component to correct solar and atmosphere artifacts from an aerial image, the atmospheric and solar component comprising:
an image information component to generate an image record for each aerial image of a group of aerial images, wherein the image information component models atmospheric effects from light scattering and atmospheric absorption due to aerosols, and further wherein the image record comprising statistical information and image context information for each aerial image, the statistical information to model atmospheric effects from light scattering and atmospheric absorption and solar irradiance;
a filter generation component to generate an atmospheric filter and a solar filter from the statistical information and the image context information stored in the image records; and
an image correction component to correct atmospheric and solar artifacts from the aerial image using the respective atmospheric filter and solar filter.

17. The apparatus of claim 16 , the image information component to retrieve image context information associated with the group of aerial images, the image context information comprising at least one of image information, camera information or camera platform information.

18. The apparatus of claim 16 , the image correction component to correct brightness differences due to solar irradiance differences between at least two aerial images in the group of aerial images.

19. The apparatus of claim 16 , comprising a large format aerial camera used to acquire the group of aerial images, the large format aerial camera comprising a multi-resolution large format aerial camera with multiple detector arrays.

20. The apparatus of claim 16 , the image correction component to correct atmosphere additive haze and multiplicative attenuation for a target aerial image using grid atmospheric haze additive term values and grid atmospheric correction gain term values stored in a filter image record associated with the target aerial image.

Assignees

• Omer Ido
• Liu Yuxiang
• Schickler Wolfgang
• Ledner Robert
• Rosenshein Leon
• Simons David
• Microsoft Technology Licensing Llc

Inventors

• Omer Ido
• Liu Yuxiang
• Schickler Wolfgang
• Ledner Robert
• Rosenshein Leon
• Simons David

Classifications

• G06T5/20 Primary

  using local operators · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G01C15/002

  Active optical surveying means (optical plumbing G01C15/105) · CPC title

• G01C11/00

  Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying · CPC title

• G06T2207/10032

  Satellite or aerial image; Remote sensing · CPC title