Smart surveillance camera systems and methods

Patent metadata

Field	Value
Publication number	US-9674458-B2
Application number	US-201414246006-A
Country	US
Kind code	B2
Filing date	Apr 4, 2014
Priority date	Jun 3, 2009
Publication date	Jun 6, 2017
Grant date	Jun 6, 2017

Abstract

Various techniques are disclosed for smart surveillance camera systems and methods using thermal imaging to intelligently control illumination and monitoring of a surveillance scene. For example, a smart camera system may include a thermal imager, an IR illuminator, a visible light illuminator, a visible/near IR (NIR) light camera, and a processor. The camera system may capture thermal images of the scene using the thermal imager, and analyze the thermal images to detect a presence and an attribute of an object in the scene. In response to the detection, various light sources may be selectively operated to illuminate the object only when needed or desired, with a suitable type of light source, with a suitable beam angle and width, or in otherwise desirable manner. The visible/NIR light camera may also be selectively operated based on the detection to capture or record surveillance images containing objects of interest.

First claim

What is claimed is:

1. A system comprising:
a thermal imager comprising a focal plane array (FPA) configured to capture thermal images of a scene;
a light source configured to illuminate the scene;
a camera configured to capture additional images of the scene; and
a processor configured to:
determine a presence of an object in the scene based on the thermal images,
in response to the determined presence of the object, identify the object from among a desired object and a spurious object by analyzing temperature distribution captured in the thermal images to determine geometric characteristics and thermal characteristics of the object, and
selectively operate the light source and the camera in response to identifying the desired object in the scene and according to a predefined association between the identified desired object and corresponding operations to be triggered for the light source and the camera.

2. The system of claim 1 , wherein the light source comprises a visible light source and an infrared (IR) light source, wherein the processor is configured to selectively operate either the visible light source or the IR light source in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association.

3. The system of claim 1 , wherein the processor is further configured to:
analyze the thermal images to determine a position of the desired object in the scene; and
selectively direct the light source toward the desired object in response to a change of the position of the desired object in the scene.

4. The system of claim 1 , wherein the processor is further configured to:
analyze the thermal images to determine a size of the desired object in the scene; and
selectively adjust a beam width of the light source based on the size of the desired object in the scene.

5. The system of claim 1 , wherein:
the camera is a non-thermal camera configured to captured the additional images of the scene in a visible light (VL) and/or near-infrared (NIR) spectrum; and
the light source is configured to illuminate the scene with light having wavelengths that overlap at least a portion of the VL and/or NIR spectrum associated with the additional images captured by the non-thermal camera in response to control signals from the processor.

6. The system of claim 5 , wherein the processor is configured to combine the thermal images and the additional images to generate blended images of the scene.

7. The system of claim 1 , wherein:
the desired object comprises a person or a vehicle; and
the predefined association between the identified desired object and the corresponding operations to be triggered for the light source and the camera comprises deactivating the light source and/or the camera as a corresponding operation triggered in response to the identifying that the object is the spurious object.

8. The system of claim 1 , wherein the processor is configured to selectively start and stop a recording of the thermal images and/or the additional images in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association, the system further comprising a storage device positioned at a remote location relative to the thermal imager and configured to record the thermal images and/or the additional images in response to the processor.

9. The system of claim 1 , wherein:
the camera is a first camera having a first field of view (FOV);
the system further comprises a second camera configured to capture other additional images of the scene and having a second FOV; and
the processor is further configured to:
analyze the thermal images to determine a position of the desired object;
determine whether to record the additional images and/or the other additional images based on the position of the desired object relative to the first and second FOVs, and
selectively start and stop a recording of the additional images and/or the other additional images based on the determination of whether to record the additional images and/or the other additional images.

10. The system of claim 1 , wherein the processor is further configured to selectively operate an external device in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association.

11. The system of claim 1 , further comprising a memory communicatively coupled to the processor, wherein the processor is further configured to:
update the predefined association between the identified desired object and corresponding operations to be triggered for the light source and the camera based on a user definition; and
store in the memory the updated predefined association.

12. A method comprising:
capturing, at a focal plane array (FPA) of a thermal imager, thermal images of a scene;
determining a presence of an object in the scene based on the thermal images;
in response to the determined presence of the object, identifying the object from among a desired object and a spurious object by analyzing temperature distribution captured in the thermal images to determine geometric characteristics and thermal characteristics of the object; and
selectively operating a light source and a camera in response to identifying the desired object in the scene and according to a predefined association between the identified desired object and corresponding operations to be triggered for the light source and the camera, wherein:
the light source is configured to illuminate the scene, and
the camera is configured to capture additional images of the scene.

13. The method of claim 12 , wherein the light source comprises a visible light source and an infrared (IR) light source configured to illuminate the scene, the method further comprising selectively operating either the visible light source or the IR light source in response to the determined presence of the object and the identification of the desired object in the scene and according to the predefined association.

14. The method of claim 12 , further comprising analyzing the thermal images to determine a position and a size of the desired object in the scene, wherein:
the selectively operating the light source comprises:
selectively directing the light source toward the desired object in response to a change of the position of the desired object in the scene, and
selectively adjusting a beam width of the light source based on the size of the desired object in the scene.

15. The method of claim 12 , wherein:
the desired object comprises a person or a vehicle; and
the predefined association between the identified desired object and the corresponding operations to be triggered for the light source and the camera comprises deactivating the light source and/or the camera as a corresponding operation triggered in response to the identifying that the object is the spurious object.

16. The method of claim 12 , further comprising
combining the thermal images and the additional images to generate blended images of the scene, wherein:
the camera is a non-thermal camera, and
the light source is configured to provide illumination over at least a portion a spectrum associated with the additional images.

17. The method of claim 12 , wherein the selectively operating the camera comprises selectively starting and stopping a recording of the thermal images and/or the additional images in response to the determined presence of the object and

Assignees

• Flir Systems

Inventors

• Teich Andrew C
• Högasten Nicholas
• Hoelter Theodore R
• Strandemar Katrin

Classifications

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/57

  Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• H04N23/11

  for generating image signals from visible and infrared light wavelengths · CPC title

• H04N23/74 Primary

  by influencing the scene brightness using illuminating means · CPC title