Unmanned aerial system based thermal imaging systems and methods

Patent metadata

Field	Value
Publication number	US-11029211-B2
Application number	US-201815987819-A
Country	US
Kind code	B2
Filing date	May 23, 2018
Priority date	Dec 9, 2015
Publication date	Jun 8, 2021
Grant date	Jun 8, 2021

Abstract

Flight based infrared imaging systems and related techniques, and in particular UAS based thermal imaging systems, are provided to improve the monitoring capabilities of such systems over conventional infrared monitoring systems. An infrared imaging system is configured to compensate for various environmental effects (e.g., position and/or strength of the sun, atmospheric effects) to provide high resolution and accuracy radiometric measurements of targets imaged by the infrared imaging system. An infrared imaging system is alternatively configured to monitor and determine environmental conditions, modify data received from infrared imaging systems and other systems, modify flight paths and other commands, and/or create a representation of the environment.

First claim

We claim:

1. A system comprising:
a flight platform;
an infrared imager coupled to the flight platform and configured to capture infrared images of a scene in view of the flight platform and output infrared data associated with the infrared images and/or the scene;
an environmental sensor configured to measure environmental data associated with the flight platform, the infrared imager, and/or the scene; and
a logic device configured to:
receive the infrared data from the infrared imager, wherein the infrared data is configured to measure an aspect of at least a portion of the scene,
receive the environmental data from the environmental sensor,
determine a range between a target in the scene and a source corresponding to the target, the range being a distance between the target and the source, the logic device being configured to determine the range regardless of whether or not the target is directly below the flight platform, and
correct the infrared data received from the infrared imager based, at least in part, on the environmental data and the range, to determine corrected infrared data, wherein the range is used to determine an amount of correction of the infrared data based on the environmental data.

2. The system of claim 1 , wherein the environmental sensor comprises at least one of a barometric pressure sensor, a visible irradiance data sensor, a temperature sensor, a humidity sensor, a thermopile, a nephelometer, an ozone sensor, a carbon monoxide sensor, a carbon dioxide sensor, a wind strength sensor, a wind speed sensor, a wind direction sensor, a visible spectrum imaging device, an anemometer and/or a high dynamic range (HDR) imaging device.

3. The system of claim 1 , wherein the logic device is further configured to:
detect a gas leak in the scene based, at least in part, on the environmental data from the environmental sensor.

4. A system comprising:
a flight platform;
an infrared imager coupled to the flight platform and configured to capture infrared images of a scene in view of the flight platform and output infrared data associated with the infrared images and/or the scene;
an environmental sensor configured to measure environmental data associated with the flight platform, the infrared imager, and/or the scene; and
a logic device configured to:
receive the infrared data from the infrared imager, wherein the infrared data is configured to measure an aspect of at least a portion of the scene,
receive the environmental data from the environmental sensor, and
determine corrected infrared data based, at least in part, on the infrared data and the environmental data;

wherein the logic device is further configured to:
determine a particulate count associated with the scene based, at least in part, on the environmental data from the environmental sensor, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined particulate count.

5. The system of claim 4 , wherein the logic device is further configured to:
determine a wind condition based, at least in part, on the environmental data from the environmental sensor, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined wind condition.

6. The system of claim 1 , wherein the environmental sensor comprises a visible spectrum imaging device and the logic device is further configured to:
receive visible spectrum data from the visible spectrum imaging device; and
determine a solar feature based, at least in part, on the visible spectrum data from the visible spectrum imaging device, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined solar feature.

7. The system of claim 1 , wherein the logic device is further configured to:
determine an environmental condition based, at least in part, on the environmental data from the environmental sensor; and
adjust a flight path of the flight platform responsive to the determined environmental condition.

8. The system of claim 1 , wherein the logic device is further configured to:
determine a solar position and/or a solar intensity, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the determined solar position and/or solar intensity.

9. The system of claim 1 , further comprising a blackbody coupled to the flight platform and viewable by the infrared imager, wherein the thermal imager is configured to output calibration data associated with a thermal image of the blackbody, and wherein the logic device is further configured to:
receive the calibration data; and
compare the calibration data to a known temperature of the blackbody, wherein the corrected infrared data is determined based, at least in part, on the infrared data, the calibration data, and/or the comparison.

10. The system of claim 1 , wherein the logic device is further configured to:
detect a blackbody and/or greybody within the scene;
receive known and/or estimated temperatures of the blackbody and/or the greybody;
determine measured temperatures of the blackbody and/or the greybody based, at least in part, on the received infrared data of the scene; and
compare the known and/or estimated temperatures to the measured temperatures, wherein the corrected infrared data is determined based, at least in part, on the infrared data and the comparison.

11. The system of claim 1 , wherein the logic device is configured to:
receive an image of the target in the scene;
determine the source position corresponding to the received image;
determine an altitude corresponding to the source position;
determine a directional target vector to the imaged target; and
determine the range from the source position to the imaged target based, at least in part, on the source position, the altitude, and the directional target vector.

12. The system of claim 1 , further comprising a base station configured to communicate via one or more communications modules with the flight platform and/or the infrared imager, wherein the logic device is configured to:
determine a flight path for the flight platform to image the scene; and
modify the flight path based, at least in part, on the infrared data, the environmental data, and/or the corrected infrared data.

13. A method of using the system of claim 1 , the method comprising:
positioning the flight platform in view of the scene;
capturing at least one of the infrared images of the scene;
measuring the environmental data; and
transmitting the at least one of the infrared images, corresponding infrared data, the environmental data, and/or the corrected infrared data to a user interface.

14. A method comprising:
receiving infrared data from an infrared imager coupled to a flight platform, wherein the infrared imager is configured to capture infrared images of a scene in view of the flight platform and output infrared data associated with the infrared images and/or the scene, and wherein the infrared data is configured to measure an aspect of at least a portion of the scene;
receiving environmental data from an environmental sensor configured to measure environmental data associated with the flight platform, the infrared imager, and/or the scene;
determining a range between a target in the scene and a source corresponding to the target, using a process operable to determine the range regardless of whether or not the target is directly below the flight platform, the range being a distance between the target and the source, and
correcting the infrared data received from the infr

Assignees

• Flir Systems

Inventors

• Frank Jeffrey D
• Hoelter Theodore R
• Högasten Nicholas
• Richards Austin A
• Kent Michael
• Moreira Julie R
• Boulanger Pierre
• Valdes Raymond
• Li Jonathan

Classifications

• H04N23/76

  by influencing the image signals · CPC title

• B64U2201/20

  Remote controls · CPC title

• B64U2201/10

  autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS] · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title