Modification of at least one parameter used by a video processing algorithm for monitoring of a scene

Patent metadata

Field	Value
Publication number	US-10032283-B2
Application number	US-201514880416-A
Country	US
Kind code	B2
Filing date	Oct 12, 2015
Priority date	Oct 23, 2014
Publication date	Jul 24, 2018
Grant date	Jul 24, 2018

Abstract

There is provided a method, a device and a system for modifying at least one parameter used by a video processing algorithm, such as a motion detection algorithm, an object detection algorithm, or an object tracking algorithm, for monitoring of a scene (102). The method comprises: receiving a first (105a) and a second (105b) video sequence of the scene (102), wherein the first video sequence (105a) is captured using a thermal camera (104a) such that the first video sequence (105a) comprises thermal information being indicative of temperatures in the scene (102), and applying the video processing algorithm to the second video sequence (105b), wherein at least one parameter used by the video processing algorithm is modified based on the thermal information comprised in the first video sequence (105a).

First claim

The invention claimed is:

1. A method for modifying at least one parameter used by a video processing algorithm, such as a motion detection algorithm, an object detection algorithm, or an object tracking algorithm, for monitoring of a scene, the method comprising: receiving a first and a second video sequence of the scene, wherein the first video sequence is captured using a thermal camera such that the first video sequence includes thermal information being indicative of temperatures in the scene; and applying, via processing circuitry, the video processing algorithm to the second video sequence, wherein at least one parameter used by the video processing algorithm is modified based on the thermal information included in the first video sequence, such that said at least one parameter of the video processing algorithm is made temperature dependent, wherein the processing circuitry determines in which regions of the second video sequence said at least one parameter is modified and how much the at least one parameter is modified in said regions based on the thermal information; wherein the thermal information comprises intensity values of images in the first video sequence, the intensity values being indicative of temperatures in the scene, and wherein the at least one parameter used by the video processing algorithm is modified based on the intensity values of images in the first video sequence; and identifying, in images of the first video sequence captured by the thermal camera, pixels having an intensity value indicating a temperature in one or more predetermined temperature ranges of interest, wherein the at least one parameter used by the video processing algorithm is modified with respect to regions of the images of the second video sequence that correspond to the pixels that were identified in the images of the first video sequence.

2. The method of claim 1 , wherein the at least one parameter used by the video processing algorithm is modified with respect to regions in images of the second video sequence based on thermal information of corresponding regions in images of the first video sequence.

3. The method of claim 1 , wherein the one or more predetermined temperature ranges of interest comprise a temperature range corresponding to the body temperature of a human.

4. The method of claim 1 , wherein the at least one parameter used by the video processing algorithm is modified based on the intensity values of the images of the first video sequence such that the at least one parameter vary across images of the second video sequence as a function of the intensity values of the images of the first video sequence.

5. The method of claim 1 , wherein the video processing algorithm comprises comparing differences in intensity values between subsequent images in the second video sequence to a threshold, wherein the threshold is modified based on the thermal information in the first video sequence.

6. The method of claim 1 , wherein the video processing algorithm comprises smoothing filtering, wherein at least one parameter of said smoothing filtering is modified based on the thermal information in the first video sequence.

7. The method according to claim 6 , wherein said smoothing filtering comprises morphologic filtering of images of the second video sequence using a structuring element, wherein the structuring element is modified based on the thermal information in the first video sequence.

8. The method of claim 1 , wherein the thermal camera comprises a long wave infrared (LWIR) sensor.

9. The method of claim 1 , wherein the second video sequence is captured by a visual light camera.

10. The method of claim 1 , wherein the second video sequence is captured by the thermal camera.

11. A non-transitory computer-readable medium having stored thereon computer-readable instructions which when executed by a computer cause the computer to perform the method of claim 1 .

12. A processing device for modifying at least one parameter used by a video processing algorithm, such as a motion detection algorithm, an object detection algorithm, or an object tracking algorithm, for monitoring of a scene, the processing device comprising: a receiver that receives a first and a second video sequence of the scene, wherein the first video sequence is captured using a thermal camera such that the first video sequence includes thermal information being indicative of temperatures in the scene; and processing circuitry that applies the video processing algorithm to the second video sequence in order to monitor the scene, modifies at least one parameter used by the video processing algorithm based on the thermal information included in the first video sequence, such that the at least one parameter of the video processing algorithm is made temperature dependent, and determines in which regions of the second video sequence said at least one parameter is modified and how much the at least one parameter is modified in said regions based on the thermal information; wherein the thermal information comprises intensity values of images in the first video sequence, the intensity values being indicative of temperatures in the scene, and wherein the at least one parameter used by the video processing algorithm is modified based on the intensity values of images in the first video sequence; and identifying, in images of the first video sequence captured by the thermal camera, pixels having an intensity value indicating a temperature in one or more predetermined temperature ranges of interest, wherein the at least one parameter used by the video processing algorithm is modified with respect to regions of the images of the second video sequence that correspond to the pixels that were identified in the images of the first video sequence.

13. A system for modifying at least one parameter used by a video processing algorithm, such as a motion detection algorithm, an object detection algorithm, or an object tracking algorithm, for monitoring of a scene, the system comprising: one or more cameras that capture a first and a second video sequence of the scene, wherein the one or more cameras include a thermal camera adapted to capture the first video sequence such that the first video sequence includes thermal information being indicative of temperatures in the scene; and processing circuitry that applies the video processing algorithm to the second video sequence in order to monitor the scene, modifies at least one parameter used by the video processing algorithm based on the thermal information included in the first video sequence, such that the at least one parameter of the video processing algorithm is made temperature dependent, and determines in which regions of the second video sequence said at least one parameter is modified and how much the at least one parameter is modified in said regions based on the thermal information; wherein the thermal information comprises intensity values of images in the first video sequence, the intensity values being indicative of temperatures in the scene, and wherein the at least one parameter used by the video processing algorithm is modified based on the intensity values of images in the first video sequence; and identifying, in images of the first video sequence captured by the thermal camera, pixels having an intensity value indicating a temperature in one or more predetermined temperature ranges of interest, wherein the at least one parameter used by the video processing algorithm is modified with respect to regions of the images of the second video sequence that correspond to the pixels that were identified in the images of the first video sequence.

Assignees

• Axis Ab

Inventors

• Baltsen Joakim
• Bylander Mats

Classifications

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06V10/22

  by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition · CPC title

• G06V10/143

  Sensing or illuminating at different wavelengths · CPC title

• G06T5/20

  using local operators · CPC title