Spatial isolation of energy associated with a scene

Patent metadata

Field	Value
Publication number	US-9568802-B1
Application number	US-201414210679-A
Country	US
Kind code	B1
Filing date	Mar 14, 2014
Priority date	Mar 15, 2013
Publication date	Feb 14, 2017
Grant date	Feb 14, 2017

Abstract

Mechanisms for spatially isolating a region of interest (ROI) in a scene are disclosed. A first sensor generates sensor data that quantifies energy received from a scene within a field of view (FOV) of the first sensor to generate a real-time FOV full motion video. A processor analyzes the sensor data to identify a first ROI during a wait period of a frame period of the first sensor. A first subset of micromirrors in a micromirror array that is directed toward the scene is identified. The first subset of micromirrors receives energy from the first ROI. At least one micromirror in the first subset is controlled to move from a primary position of the at least one micromirror to a first tilt position of the at least one micromirror to reflect the energy from the first ROI toward a second sensor, the first ROI being spatially isolated from the real-time FOV full motion video.

First claim

What is claimed is:

1. A method, comprising:
generating, by a first sensor, sensor data that quantifies energy received from a scene within a field of view (FOV) of the first sensor to generate an image;
analyzing, by a processor, the sensor data to identify a first region of interest (ROI);
identifying, in a micromirror array comprising a plurality of micromirrors that is directed toward the scene, during a wait period of a frame period of the first sensor, the frame period comprising an integration period and the wait period, a first subset of the plurality of micromirrors that receive energy from the first ROI; and
controlling at least one micromirror in the first subset to move from a primary position of the at least one micromirror to a first tilt position of the at least one micromirror to reflect the energy from the first ROI toward a second sensor, the first ROI being spatially isolated from the image,
wherein the first sensor generates new sensor data during each frame period of a plurality of frame periods to generate a plurality of images, the each frame period comprising the integration period and the wait period, wherein controlling the at least one micromirror further comprises:
controlling the at least one micromirror in the first subset to move from the primary position of the at least one micromirror to the first tilt position of the at least one micromirror to reflect the energy toward the second sensor during the wait period of a first frame period.

2. The method of claim 1 , further comprising controlling the at least one micromirror to return to the primary position of the at least one micromirror prior to a next frame period that immediately follows the first frame period.

3. The method of claim 2 , further comprising:
iteratively, for each frame period of a plurality of successive frame periods:
controlling the at least one micromirror in the subset of micromirrors to move from the primary position of the at least one micromirror to the first tilt position of the at least one micromirror to reflect the energy toward the second sensor during the wait period of the each frame period; and
controlling the at least one micromirror to return to the primary position of the at least one micromirror prior to the next frame period.

4. The method of claim 1 , further comprising:
analyzing, by the processor, the sensor data to identify a second ROI;
identifying, in the micromirror array, a second subset of the plurality of micromirrors that receive energy from the second ROI, the second subset comprising a different subset from the first subset; and
controlling at least one micromirror in the second subset to move from a primary position of the at least one micromirror in the second subset to a first tilt position of the at least one micromirror in the second subset to reflect the energy from the second ROI toward a third sensor.

5. The method of claim 1 , wherein the first sensor comprises an image sensor, and the second sensor comprises one of a spectral sensor, a ranging sensor, a Doppler sensor, a polarization sensor, and a vibration sensor.

6. The method of claim 1 , wherein the first sensor comprises an image sensor configured to detect electromagnetic radiation in a visible spectrum, and the second sensor comprises a focal plane array configured to detect the electromagnetic radiation in an infrared spectrum.

7. The method of claim 1 , wherein the first subset of the plurality of micromirrors comprises a plurality of columns of micromirrors, and wherein controlling the at least one micromirror in the first subset to move from the primary position of the at least one micromirror to the first tilt position of the at least one micromirror to reflect the energy from the first ROI toward the second sensor further comprises:
for each column of micromirrors of the plurality of columns of micromirrors, successively:
controlling only the micromirrors in the each column of micromirrors to concurrently move from the respective primary positions of the micromirrors in the each column to the respective first tilt positions of the micromirrors in the each column to reflect the energy from the first ROI toward the second sensor.

8. The method of claim 7 , wherein the first sensor generates new sensor data during each frame period of a plurality of frame periods, each frame period comprising an integration period and the wait period, wherein the plurality of columns of micromirrors are successively controlled to concurrently move from the respective primary positions of the micromirrors to the respective first tilt positions of the micromirrors in the each column to reflect the energy from the first ROI toward the second sensor during a same wait period of a first frame period.

9. The method of claim 7 , wherein the first sensor generates new sensor data during each frame period of a plurality of frame periods, each frame period comprising the integration period and the wait period, wherein each column of micromirrors of the plurality of columns of micromirrors are successively controlled to concurrently move from the respective primary positions of the column of micromirrors to the respective first tilt positions of the column of micromirrors in different wait periods of different frame periods.

10. The method of claim 1 , wherein the micromirror array comprises a digital micromirror device.

11. The method of claim 1 , further comprising:
controlling the at least one micromirror in the first subset to move to a second tilt position of the at least one micromirror to reflect the energy from the ROI toward a third sensor.

12. The method of claim 11 , wherein the first sensor generates new sensor data during each frame period of a plurality of frame periods, each frame period comprising the integration period and the wait period, wherein the at least one micromirror in the first subset of micromirrors is controlled to move from the primary position of the at least one micromirror to the first tilt position of the at least one micromirror to reflect the energy from the first ROI toward the second sensor during a wait period of a first frame period, and the at least one micromirror in the first subset of micromirrors is subsequently controlled to move to the second tilt position of the at least one micromirror to reflect the energy from the first ROI toward the third sensor during the wait period of the first frame period.

13. A system, comprising:
a first sensor configured to generate sensor data that quantifies energy received from a scene within a field of view (FOV) of the first sensor to generate an image;
a micromirror array comprising a plurality of micromirrors that is directed toward the scene;
a processor configured to:
analyze the sensor data to identify a first region of interest (ROI);
identify a first subset of micromirrors of the plurality of micromirrors that receive energy from the first ROI during a wait period of a frame period of the first sensor, the frame period comprising an integration period and the wait period; and
control at least one micromirror in the first subset to move from a primary position of the at least one micromirror to a first tilt position of the at least one micromirror to reflect the energy from the first ROI toward a second sensor, the first ROI being spatially isolated from the image,

wherein the first sensor is further configured to generate new sensor data during each frame period of a plurality of frame periods, each frame period comprising the integration period and the wait period, and wherein the processor is further configured to control the at least one micromirror in the first subset of

Assignees

• Lockheed Corp

Inventors

• Powell Calvin L
• Myers Mark T
• Fish Trisha

Classifications

• G02B26/0833 Primary

  the reflecting element being a micromechanical device, e.g. a MEMS mirror, DMD (G02B26/0825 takes precedence; micromechanical devices in general B81B) · CPC title

• H04N23/58

  Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors · CPC title

• H04N23/54

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• G06V10/25

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title