Infrared and visible imaging system for monitoring equipment

Patent metadata

Field	Value
Publication number	US-11902655-B2
Application number	US-202318161588-A
Country	US
Kind code	B2
Filing date	Jan 30, 2023
Priority date	Feb 27, 2019
Publication date	Feb 13, 2024
Grant date	Feb 13, 2024

Abstract

Methods, systems, and apparatus for an infrared and visible imaging system. In some implementations, Image data from a visible-light camera is obtained. A position of a device is determined based at least in part on the image data from the visible-light camera. An infrared camera is positioned so that the device is in a field of view of the infrared camera, with the field of view of the infrared camera being narrower than the field of view of the visible-light camera. Infrared image data from the infrared camera that includes regions representing the device is obtained. Infrared image data from the infrared camera that represents the device is recorded. Position data is also recorded that indicates the location and pose of the infrared camera when the infrared image data is acquired by the infrared camera.

First claim

What is claimed is:

1. A method comprising:
operating a camera system coupled to a vehicle, the camera system comprising a visible-light camera and an infrared camera;
while the vehicle is moving, tracking a position of a device with respect to the camera system based at least in part on image data captured using the visible-light camera;
repeatedly adjusting a position of the infrared camera based on the tracked position of the device to maintain the device in a field of view of the infrared camera as the vehicle with the camera system moves with respect to the device;
recording image data generated by the infrared camera that indicates properties of the device;
determining a temperature of the device based on the image data generated by the infrared camera; and
determining a level of wear of the device based on the determined temperature.

2. The method of claim 1 , further comprising determining an identifier for the device; and
wherein recording the image data from the infrared camera comprises associating the recorded image data with the identifier for the device.

3. The method of claim 1 , wherein the visible-light camera has a first field of view; and
wherein the infrared camera has a second field of view that is narrower than the first field of view of the visible-light camera.

4. The method of claim 3 , wherein the first field of view of the visible-light camera is in a range of 120-180 degrees diagonal; and
wherein the second field of view of the infrared camera is in a range of 6-24 degrees diagonal.

5. The method of claim 1 , further comprising:
obtaining location data and a travel direction of the vehicle from one or more sensors coupled to the vehicle, wherein the visible-light camera and the infrared camera are mounted to the vehicle;
accessing map data indicating locations of devices to be monitored;
selecting one of the devices to be monitored based on the map data, the location data, and the travel direction of the vehicle; and
positioning the visible-light camera toward an anticipated location of the selected device that is determined using the map data.

6. The method of claim 1 , wherein the visible-light camera and the infrared camera are stabilized by a stabilization module that uses one or more sensors and one or more motors or actuators to compensate for movement of the vehicle.

7. The method of claim 1 , wherein determining the temperature of the device comprises determining a normalized temperature of the device, including:
receiving data indicating ambient conditions for the device; and
calculating the normalized temperature of the device based on the ambient conditions.

8. The method of claim 1 , wherein determining the temperature of the device comprises determining a normalized temperature of the device, including:
receiving load data indicating an electrical load for the device; and
calculating the normalized temperature of the device based on the load data to adjust for changes in temperature caused by load conditions at a time the image data was generated by the infrared camera.

9. The method of claim 1 , wherein determining the level of wear of the device comprises:
comparing the temperature of the device with one or more predetermined temperature thresholds; and
determining if the temperature of the device exceeds the one or more predetermined temperature thresholds.

10. A system comprising:
one or more computers; and
one or more computer-readable media storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
operating a camera system coupled to a vehicle, the camera system comprising a visible-light camera and an infrared camera;
while the vehicle is moving, tracking a position of a device with respect to the camera system based at least in part on image data captured using the visible-light camera;
repeatedly adjusting a position of the infrared camera based on the tracked position of the device to maintain the device in a field of view of the infrared camera as the vehicle with the camera system moves with respect to the device;
recording image data generated by the infrared camera that indicates properties of the device;
determining a temperature of the device based on the image data generated by the infrared camera; and
determining a level of wear of the device based on the determined temperature.

11. The system of claim 10 , wherein the operations comprise determining an identifier for the device; and
wherein recording the image data from the infrared camera comprises associating the recorded image data with the identifier for the device.

12. The system of claim 10 , wherein the visible-light camera has a first field of view; and
wherein the infrared camera has a second field of view that is narrower than the first field of view of the visible-light camera.

13. The system of claim 12 , wherein the first field of view of the visible-light camera is in a range of 120-180 degrees diagonal; and
wherein the second field of view of the infrared camera is in a range of 6-24 degrees diagonal.

14. The system of claim 10 , wherein the operations comprise:
obtaining location data and a travel direction of the vehicle from one or more sensors coupled to the vehicle, wherein the visible-light camera and the infrared camera are mounted to the vehicle;
accessing map data indicating locations of devices to be monitored;
selecting one of the devices to be monitored based on the map data, the location data, and the travel direction of the vehicle; and
positioning the visible-light camera toward an anticipated location of the selected device that is determined using the map data.

15. The system of claim 10 , wherein the visible-light camera and the infrared camera are stabilized by a stabilization module that uses one or more sensors and one or more motors or actuators to compensate for movement of the vehicle.

16. The system of claim 10 , wherein determining the temperature of the device comprises determining a normalized temperature of the device, including:
receiving data indicating ambient conditions for the device; and
calculating the normalized temperature of the device based on the ambient conditions.

17. The system of claim 10 , wherein determining the temperature of the device comprises determining a normalized temperature of the device, including:
receiving load data indicating an electrical load for the device; and
calculating the normalized temperature of the device based on the load data to adjust for changes in temperature caused by load conditions at a time the image data was generated by the infrared camera.

18. The system of claim 10 , wherein determining the level of wear of the device comprises:
comparing the temperature of the device with one or more predetermined temperature thresholds; and
determining if the temperature of the device exceeds the one or more predetermined temperature thresholds.

19. One or more non-transitory computer-readable media storing instructions that are operable, when executed by one or more processors, to cause the one or more processors to perform operations comprising:
operating a camera system coupled to a vehicle, the camera system comprising a visible-light camera and an infrared camera;
while the vehicle is moving, tracking a position of a device with respect to the camera system based at least in part on image data captured using the visible-light camera;
repeatedly adjusting a position of the inf

Assignees

• X Dev Llc

Inventors

• Casey Leo Francis
• Light Peter
• Atwater Joel Fraser
• Winston Crystal Elayna
• Roosta Mehrdad
• Xin Siyuan
• Mahadeswaraswamy Chetan

Classifications

• H04N23/11

  for generating image signals from visible and infrared light wavelengths · CPC title

• H04N23/661 Primary

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• B60R11/04

  Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle · CPC title

• G01C19/56

  Turn-sensitive devices using vibrating masses, e.g. vibratory angular rate sensors based on Coriolis forces · CPC title

• G01J5/025

  Interfacing a pyrometer to an external device or network; User interface · CPC title