Method for generating an augmented set of images

Patent metadata

Field	Value
Publication number	US-11062525-B1
Application number	US-202017105700-A
Country	US
Kind code	B1
Filing date	Nov 27, 2020
Priority date	Jan 28, 2020
Publication date	Jul 13, 2021
Grant date	Jul 13, 2021

Abstract

A method for generating an augmented set of images involves data collection, data processing, and data augmentation processing performed to merge images. The data collection comprises the steps of choosing objects as selected objects, choosing configurations for imaging of the selected objects, and taking pictures with a second camera to create a set of raw object images. The data processing comprises the steps of performing dynamic range adjustment on the raw object image, performing color correction for corrected images, and removing uniform background from the corrected images to result in object images. The data augmentation processing performed to merge images comprises the steps of performing range simulation or magnification for resampled images, adding blur to the resampled images, adding noise to create final object images, and merging the final object images to the field images of a first camera to create a set of augmented images.

First claim

What is claimed is:

1. A method for generating an augmented set of images, the method comprising the steps of:
data collection, comprising the steps of:
choosing objects as selected objects,
choosing configurations for imaging of the selected objects, and
taking pictures with a second camera to create a set of raw object images;

data processing performed on the raw object images, comprising the steps of:
performing dynamic range adjustment on the raw object image,
performing color correction for corrected images, and
removing uniform background from the corrected images to result in object images; and

data augmentation processing performed to merge the object images of the second camera into field images of a first camera, comprising the steps of:
performing range simulation or magnification for resampled images,
adding blur to the resampled images,
adding noise to create final object images, and
merging the final object images to the field images of a first camera to create a set of augmented images.

2. The method for generating an augmented set of images according to claim 1 , wherein the field images of the first camera are linearized for performing color correction.

3. The method for generating an augmented set of images according to claim 1 , wherein a mask is used to remove the uniform background.

4. The method for generating an augmented set of images according to claim 1 , wherein the resampled images are resampled using integer-based magnification.

5. The method for generating an augmented set of images according to claim 1 , wherein said configurations for imaging of the selected objects are chosen from a group comprising a view angle of a camera with respect to nadirs, aspect or rotational angles of the object, lighting conditions, and aperture sizes.

6. A method for generating an augmented set of infrared images, the method comprising the processes of:
data collection, comprising the steps of:
choosing objects as selected objects,
choosing configurations for imaging of the selected objects, and
taking infrared images with a second infrared sensor to create a set of raw object images;

data processing performed on the raw object images, comprising the steps of:
performing dynamic range adjustment on the raw object image,
performing correction of apparent temperature for pixel intensity balanced images, and
removing uniform background from the pixel intensity balanced images to result in object images; and

data augmentation processing performed to merge the object images of the second infrared sensor into field images of a first infrared sensor, comprising the steps of:
performing range simulation or magnification for resampled images,
adding blur to the resampled images,
adding noise to create final object images, and
merging the final object images to the field images of a first infrared sensor to create an augmented set of infrared images.

7. The method for generating an augmented set of infrared images according to claim 6 , wherein taking infrared images with a second infrared sensor comprises the steps of:
placing an object on a turntable,
locating the turntable against a uniform temperature background, and
generating a raw object images at a variety of rotational angles of the turntable against the uniform temperature background.

8. A method for generating an augmented set of images, the method comprising the steps of:
measuring optical and electronic characteristics of a first camera as image characteristics of the first camera;
generating a set of raw object images for a plurality of objects and a plurality of configurations with a second camera, wherein a raw object image is generated based on the steps of:
placing an object on a turntable,
locating the turntable against a uniform background such as a green screen, and
generating a raw object image at a respective rotational angle of the turntable against the uniform background;

performing data processing on the raw object images to match image characteristics of the raw object images to image characteristics of the first camera to create final object images as a basis for the augmented set of images.

9. The method for generating an augmented set of images according to claim 8 , further comprising:
creating the augmented set of images by adding the final object images to field images collected with the first camera.

10. The method for generating an augmented set of images according to claim 8 , wherein a set of final object images are the augmented set of images.

11. The method for generating an augmented set of images according to claim 8 , wherein the optical and electronic characteristics of a first camera are chosen from the group comprising pixel pitch, pixel count, f/#, and FOV.

12. The method for generating an augmented set of images according to claim 8 , wherein the step of performing data processing includes modifying the raw object images to match a pixel intensity balance of the first camera.

13. The method for generating an augmented set of images according to claim 8 , wherein the step of performing data processing includes removing a background in the raw object images.

14. The method for generating an augmented set of images according to claim 13 , wherein the step of performing data processing further includes adding a replacement background in the raw object images after the background is removed.

15. The method for generating an augmented set of images according to claim 8 , wherein the step of performing data processing includes modifying the raw object images to simulate different ranges.

Assignees

• Us Army

Inventors

• Manser Kimberly E
• Simingalam Sina
• Reynolds Joseph P
• Willis Jason A
• Hodgkin Van A
• Thompson Jr Roger W

Classifications

• G06T2207/10024

  Color image · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T5/003

  Physics · mapped topic