Video image recovery from transient blockage or corruption artifacts

Patent metadata

Field	Value
Publication number	US-2016112647-A1
Application number	US-201514918096-A
Country	US
Kind code	A1
Filing date	Oct 20, 2015
Priority date	Oct 21, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

Methods, systems, and computer readable media for video image recovery from transient blockage or corruption artifacts include receiving first and second data captures from an image sensor having first and second pluralities of pixel intensity values corresponding to pixel locations of the first and second data captures. The methods, systems, and computer readable media also include identifying in the second data capture, one or more of the second pixel intensity values exceeding a contrast threshold to detect a transient blockage. The methods, systems, and computer readable media also include replacing the one or more of the second pixel intensity values exceeding the contrast threshold with one or more of the first pixel intensity values to generate a corrected data capture.

First claim

What is claimed is:

1 . A method for detection of transient blockage of images comprising the steps of:
receiving, at a computing device, a first data capture from an image sensor, the first data capture including a plurality of first pixel intensity values corresponding to each of a plurality of pixel locations of the first data capture; receiving, at the computing device, a second data capture from the image sensor, the second data capture including a plurality of second pixel intensity values corresponding to each of a plurality of pixel locations of the second data capture; and identifying, in the second data capture by a processing component of the computing device, one or more of the second pixel intensity values exceeding a contrast threshold stored in a memory component of the computing device to detect a transient blockage.

2 . The method of claim 1 , further comprising the step of replacing, by the processing component of the computing device, the one or more of the second pixel intensity values exceeding the contrast threshold with one or more of the first pixel intensity values to generate a corrected data capture, each of the one or more first pixel intensity values corresponding to one of the plurality of pixel locations of the first data capture corresponding to one of the plurality of pixel locations of the second data capture corresponding to one of the one or more second pixel intensity values exceeding the contrast threshold.

3 . The method of claim 2 , further comprising the step of receiving, at the computing device, a third data capture from the image sensor, the third data capture including a plurality of third pixel intensity values corresponding to each of a plurality of pixel locations of the third data capture.

4 . The method of claim 3 , wherein the first data capture, the second data capture, and the third data capture comprise consecutive frames of a raw image feed received from the image sensor.

5 . The method of claim 4 , further comprising the step of replacing the second data capture of the raw image feed with the corrected data capture to generate a corrected image feed.

6 . The method of claim 1 , wherein the image sensor and the computing device are installed on a common mobile host platform.

7 . The method of claim 1 , wherein the computing device is located remotely from the image sensor and the image sensor and the computing device are in electronic communication via a communications network.

8 . An imaging system comprising:
an image sensor configured to capture image data; and a computing device in electronic communication with the image sensor having a memory component and a processing component, the memory component including instructions that, when executed by the processing component, cause the computing device to:
receive a first data capture from an image sensor, the first data capture including a plurality of first pixel intensity values corresponding to each of a plurality of pixel locations of the first data capture;
receive a second data capture from the image sensor, the second data capture including a plurality of second pixel intensity values corresponding to each of a plurality of pixel locations of the second data capture; and
identify, in the second data capture, one or more of the second pixel intensity values exceeding a contrast threshold stored in a memory component of the computing device to detect a transient blockage.

9 . The system of claim 8 , the memory component further including instructions that, when executed by the processing component, cause the computing device to replace the one or more of the second pixel intensity values exceeding the contrast threshold with one or more of the first pixel intensity values to generate a corrected data capture, each of the one or more first pixel intensity values corresponding to one of the plurality of pixel locations of the first data capture corresponding to one of the plurality of pixel locations of the second data capture corresponding to one of the one or more second pixel intensity values exceeding the contrast threshold.

10 . The system of claim 9 , the memory component further including instructions that, when executed by the processing component, cause the computing device to receive a third data capture from the image sensor, the third data capture including a plurality of third pixel intensity values corresponding to each of a plurality of pixel locations of the third data capture.

11 . The system of claim 10 , wherein the first data capture, the second data capture, and the third data capture comprise consecutive frames of a raw image feed received from the image sensor.

12 . The system of claim 11 , the memory component further including instructions that, when executed by the processing component, cause the computing device to replace the second data capture of the raw image feed with the corrected data capture to generate a corrected image feed.

13 . The system of claim 8 , wherein the image sensor and the computing device are installed on a common mobile host platform.

14 . The system of claim 8 , wherein the computing device is located remotely from the image sensor and the image sensor and the computing device are in electronic communication via a communications network.

15 . The system of claim 8 , wherein:
the image sensor is one of a plurality of image sensors installed on a common host platform, each of the image sensors configured to capture image data; and the computing device is one of a plurality of dedicated computing devices installed on the common host platform, each of the dedicated computing devices in electronic communication with a corresponding one of the image sensors and having a dedicated memory component and a dedicated processing component.

16 . A non-transitory computer-readable medium including instructions stored thereon that, when executed by a processing component, cause a computing device of a system for detection of transient blockage of images to:
receive, at the computing device, a first data capture from an image sensor, the first data capture including a plurality of first pixel intensity values corresponding to each of a plurality of pixel locations of the first data capture; receive, at the computing device, a second data capture from the image sensor, the second data capture including a plurality of second pixel intensity values corresponding to each of a plurality of pixel locations of the second data capture; and identify, in the second data capture by the processing component of the computing device, one or more of the second pixel intensity values exceeding a contrast threshold stored in a memory component of the computing device to detect a transient blockage.

17 . The non-transitory computer-readable medium of claim 16 , further including instructions stored thereon that, when executed by a processing component, cause the computing device of the system for detection of transient blockage of images to replace, by the processing component of the computing device, the one or more of the second pixel intensity values exceeding the contrast threshold with one or more of the first pixel intensity values to generate a corrected data capture, each of the one or more first pixel intensity values corresponding to one of the plurality of pixel locations of the first data capture corresponding to one of the plurality of pixel locations of the second data capture corresponding to one of the one or more second pixel intensity values exceeding the contrast threshold.

18

Assignees

• Bae Sys Inf & Elect Sys Integ

Inventors

• Mercier Michael N
• Schlupf Joseph M

Classifications

• G06T5/50 Primary

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T2207/30232

  Surveillance · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N5/243 Primary

  Electricity · mapped topic