Integrity monitoring systems and methods for image sensors

Patent metadata

Field	Value
Publication number	US-11530918-B2
Application number	US-202117164441-A
Country	US
Kind code	B2
Filing date	Feb 1, 2021
Priority date	Jan 29, 2018
Publication date	Dec 20, 2022
Grant date	Dec 20, 2022

Abstract

An integrity monitoring system for a first image sensor includes an electronic processor configured to receive sensor data for the provision of image data associated with an environment of the avionic sensor. The electronic processor is configured to monitor the avionic sensor for integrity. The electronic processor is configured to perform at least one of: determining a presence of an optical feature associated with optics of the first image sensor, comparing overlap information derived from the sensor data and other sensor data, comparing characteristics of a digital output stream of the sensor data to expected characteristics, or comparing a first motion derived from the image data and a second motion derived from avionic position equipment.

First claim

What is claimed is:

1. An integrity monitoring system, comprised of:
optics having at least one optical feature;
a first image sensor for producing first sensor data;
a second image sensor for producing second senor data; and
an electronic processor configured to receive said first and second sensor data as a digital stream and to:
a. compare the presence of an optical feature associated with the optics of the first image sensor in said sensor data and comparing the location or shape of the optical feature with the expected location to determine the integrity of the first image sensor;
b. compare overlap information derived from the sensor data and from said second image sensor to determine the integrity of the first image sensor; and
c. compare the characteristics of said digital stream of the sensor data to the expected characteristics to determine the integrity of the first image sensor.

2. The integrity monitoring system of claim 1 , further comprising avionic position equipment for determining a second motion, wherein said electronic processor compares a first motion derived from image data and the second motion derived from the avionic position equipment to determine the integrity of the first image sensor.

3. The integrity monitoring system of claim 1 , wherein the second image sensor is an infrared camera and the first image sensor is a visible light camera.

4. The integrity monitoring system of claim 2 , wherein the electronic processor is configured to compare the first motion derived from the image data and the second motion derived from the avionic position equipment to determine the integrity of the first image sensor, and the first motion is a flight path vector.

5. The integrity monitoring system of claim 2 , wherein the electronic processor is configured to compare the first motion derived from the image data and the second motion derived from the avionic position equipment after the image data is fused with data from the second image sensor.

6. The integrity monitoring system of claim 2 , wherein the electronic processor compares the first motion derived from the image data and the second motion derived from avionic position equipment to determine the integrity and the avionic position equipment comprises an inertial reference system or a global positioning system receiver.

7. The integrity monitoring system of claim 2 , wherein an image is provided on an avionic display by displaying the image data received from the first image sensor.

8. The integrity monitoring system of claim 7 , wherein the display is a head worn display (HWD), fixed heads up display (HUD), near eye display, a glass frame worn display, or a helmet mounted display (HMD).

9. The integrity monitoring system of claim 2 , wherein the electronic processor compares the first motion derived from the image data and the second motion derived from the avionic position equipment to determine the integrity, wherein the first motion is determined utilizing an image flow technique.

10. The integrity monitoring system of claim 2 , wherein the electronic processor uses a block flow estimation to determine a flight path angle to compare to a flight path angle from the position equipment.

11. The integrity monitoring system of claim 2 , wherein the electronic processor compares the first motion derived from the image data and the second motion derived from the avionic position equipment to determine the integrity, wherein the first motion is determined after de-noising the image data and a flight path vector is determined.

12. The integrity monitoring system of claim 1 , wherein a sensor is inductively coupled to the first image sensor to detect a digital output stream, and wherein the electronic processor compares the characteristics of the digital output stream of the sensor data to expected characteristics to determine the integrity of the first image sensor.

13. The integrity monitoring system of claim 1 , wherein the electronic processor is configured to perform at least two of:
a. determining the presence of the optical feature associated with the optics of the first image sensor in the sensor data and comparing the location or shape of the optical feature with the expected location to determine the integrity of the first image sensor;
b. comparing overlap information derived from the sensor data and from a second image sensor to determine the integrity of the first image sensor;
c. comparing the characteristics of the digital output stream of the sensor data to the expected characteristics to determine the integrity of the first image sensor; and
d. comparing the first motion derived from the image data and the second motion derived from the avionic position equipment to determine the integrity of the first image sensor.

Assignees

• Rockwell Collins Inc

Inventors

• Tiana Carlo L
• Brown Robert D
• Lahr Weston J
• Chiew Daniel
• Barnes Elisabeth
• Murthy Yashaswi M Narasimha
• Wilson Brandon E
• Wood Robert W

Classifications

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/6811

  based on the image signal · CPC title

• H04N23/6812

  based on additional sensors, e.g. acceleration sensors · CPC title

• H04N25/68

  applied to defects · CPC title