Infrared and visible imaging system for monitoring equipment

Patent metadata

Field	Value
Publication number	US-2024259678-A1
Application number	US-202318391499-A
Country	US
Kind code	A1
Filing date	Dec 20, 2023
Priority date	Feb 27, 2019
Publication date	Aug 1, 2024
Grant date	—

Abstract

Methods, systems, and apparatus for an infrared and visible imaging system. In some implementations, Image data from a visible-light camera is obtained. A position of a device is determined based at least in part on the image data from the visible-light camera. An infrared camera is positioned so that the device is in a field of view of the infrared camera, with the field of view of the infrared camera being narrower than the field of view of the visible-light camera. Infrared image data from the infrared camera that includes regions representing the device is obtained. Infrared image data from the infrared camera that represents the device is recorded. Position data is also recorded that indicates the location and pose of the infrared camera when the infrared image data is acquired by the infrared camera.

First claim

What is claimed is:

1 . (canceled)

2 . A method comprising:
operating a camera system coupled to a vehicle, the camera system comprising a visible-light camera and an infrared camera; obtaining location data and a travel direction of the vehicle from one or more sensors coupled to the vehicle, wherein the visible-light camera and the infrared camera are mounted to the vehicle; accessing map data indicating locations of devices to be monitored; selecting one of the devices to be monitored based on the map data, the location data, and the travel direction of the vehicle; positioning the visible-light camera toward an anticipated location of the selected device that is determined using the map data; and recording image data generated by the infrared camera that indicates properties of the selected device.

3 . The method of claim 2 , further comprising:
while the vehicle is moving, tracking a position of the selected device with respect to the camera system based at least in part on image data captured using the visible-light camera; and repeatedly adjusting a position of the infrared camera based on the tracked position of the selected device to maintain the selected device in a field of view of the infrared camera as the vehicle with the camera system moves with respect to the device.

4 . The method of claim 2 , further comprising determining an identifier for the selected device; and
wherein recording the image data from the infrared camera comprises associating the recorded image data with the identifier for the selected device.

5 . The method of claim 2 , wherein the visible-light camera has a first field of view; and
wherein the infrared camera has a second field of view that is narrower than the first field of view of the visible-light camera.

6 . The method of claim 5 , wherein the first field of view of the visible-light camera is in a range of 120-180 degrees diagonal; and
wherein the second field of view of the infrared camera is in a range of 6-24 degrees diagonal.

7 . The method of claim 2 , further comprising:
determining a temperature of the selected device based on the image data generated by the infrared camera; and determining a level of wear of the selected device based on the determined temperature.

8 . The method of claim 2 , wherein the visible-light camera and the infrared camera are stabilized by a stabilization module that uses one or more sensors and one or more motors or actuators to compensate for movement of the vehicle.

9 . The method of claim 2 , wherein the map data comprises, for each of the devices, any one or more of: an identifier for the device, a location for the device, an elevation for the device, or information that indicates where the device is located with respect to navigable roadways.

10 . The method of claim 2 , wherein accessing map data indicating locations of devices to be monitored comprises accessing map data for devices that are upcoming along a path of the vehicle.

11 . The method of claim 2 , wherein accessing map data indicating locations of devices to be monitored comprises accessing map data for devices that are nearby the vehicle.

12 . The method of claim 2 , wherein positioning the visible-light camera toward an anticipated location of the selected device that is determined using the map data further comprises positioning the visible-light camera based on a speed and a linear acceleration of the vehicle.

13 . A system comprising:
one or more computers; and one or more computer-readable media storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
operating a camera system coupled to a vehicle, the camera system comprising a visible-light camera and an infrared camera;
obtaining location data and a travel direction of the vehicle from one or more sensors coupled to the vehicle, wherein the visible-light camera and the infrared camera are mounted to the vehicle;
accessing map data indicating locations of devices to be monitored;
selecting one of the devices to be monitored based on the map data, the location data, and the travel direction of the vehicle;
positioning the visible-light camera toward an anticipated location of the selected device that is determined using the map data; and
recording image data generated by the infrared camera that indicates properties of the selected device.

14 . The system of claim 13 , wherein the operations further comprise:
while the vehicle is moving, tracking a position of the selected device with respect to the camera system based at least in part on image data captured using the visible-light camera; and repeatedly adjusting a position of the infrared camera based on the tracked position of the selected device to maintain the selected device in a field of view of the infrared camera as the vehicle with the camera system moves with respect to the device.

15 . The system of claim 13 , wherein the operations further comprise determining an identifier for the selected device; and
wherein recording the image data from the infrared camera comprises associating the recorded image data with the identifier for the selected device.

16 . The system of claim 13 , wherein the visible-light camera has a first field of view; and
wherein the infrared camera has a second field of view that is narrower than the first field of view of the visible-light camera.

17 . The system of claim 16 , wherein the first field of view of the visible-light camera is in a range of 120-180 degrees diagonal; and
wherein the second field of view of the infrared camera is in a range of 6-24 degrees diagonal.

18 . The system of claim 13 , wherein the operations further comprise:
determining a temperature of the selected device based on the image data generated by the infrared camera; and determining a level of wear of the selected device based on the determined temperature.

19 . The system of claim 13 , wherein the visible-light camera and the infrared camera are stabilized by a stabilization module that uses one or more sensors and one or more motors or actuators to compensate for movement of the vehicle.

20 . The system of claim 13 , wherein the map data comprises, for each of the devices, any one or more of: an identifier for the device, a location for the device, an elevation for the device, or information that indicates where the device is located with respect to navigable roadways.

21 . One or more non-transitory computer-readable media storing instructions that are operable, when executed by one or more processors, to cause the one or more processors to perform operations comprising:
operating a camera system coupled to a vehicle, the camera system comprising a visible-light camera and an infrared camera; obtaining location data and a travel direction of the vehicle from one or more sensors coupled to the vehicle, wherein the visible-light camera and the infrared camera are mounted to the vehicle; accessing map data indicating locations of devices to be monitored; selecting one of the devices to be monitored based on the map data, the location data, and the travel direction of the vehicle; positioning the visible-light camera toward an anticipated location of the selected device that is determined using the map data; and recording image data generated by the infrared camera that indicates properties of the selected device.

Assignees

• X Dev Llc

Inventors

• Casey Leo Francis
• Light Peter
• Atwater Joel Fraser
• Winston Crystal Elayna
• Roosta Mehrdad
• Xin Siyuan
• Mahadeswaraswamy Chetan

Classifications

• H04N23/11

  for generating image signals from visible and infrared light wavelengths · CPC title

• G01J5/07

  Arrangements for adjusting the solid angle of collected radiation, e.g. adjusting or orienting field of view, tracking position or encoding angular position (optical collimating elements G01J5/0806) · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• G01S19/13

  Receivers · CPC title

• G01J2005/0077

  Imaging · CPC title