Method, system and computer program product for interactively identifying same individuals or objects present in video recordings

Patent metadata

Field	Value
Publication number	US-10529381-B2
Application number	US-201816160882-A
Country	US
Kind code	B2
Filing date	Oct 15, 2018
Priority date	Jun 6, 2016
Publication date	Jan 7, 2020
Grant date	Jan 7, 2020

Abstract

A method, system and computer program product for interactively identifying same individuals or objects present in video recordings is disclosed. When a thumbnail in a set of thumbnails is selected, new information is obtained. The new information may be that an individual or object is present in the portion of the video recording associated with the thumbnail. A search can be carried out for the individual or object based on the new information. The search generates new match likelihoods for each of displayed thumbnails within a user interface page. The displayed thumbnails are re-ordered based on the new match likelihoods.

First claim

The invention claimed is:

1. A method comprising:
providing a user interface which includes a video player for displaying video frames of a video, the video frames including a number of frame regions selectable for receiving user input;
receiving search-requesting input through the user interface to carry out a forwards-in-time or backwards-in-time search for an individual present in a selected frame region of the frame regions, and the individual being shown in the selected frame region with a lost object for the forwards-in-time search or without the lost object for the backwards-in-time search;
generating or re-computing a plurality of match likelihoods assigned to a plurality of individuals present in video recordings, the match likelihoods being likelihoods of there being an appearance of the individual;
populating or updating a user interface page of the user interface to display information corresponding to the generated or re-computed match likelihoods; and
building a timeline to show when or around when the individual lost the object.

2. The method as claimed in claim 1 wherein the method is carried out by a surveillance system that includes a computer terminal in communication with a server system, and the generating or re-computing is carried out by the server system.

3. The method as claimed in claim 2 wherein the populating or updating of the user interface page is carried out by the computer terminal.

4. The method as claimed in claim 2 wherein the frame regions are bounding boxes.

5. The method as claimed in claim 1 wherein the frame regions are bounding boxes.

6. The method as claimed in claim 1 wherein the user interface is configured to provide a selection list to facilitate the receiving of the search-requesting input.

7. At least one tangible, non-transitory, computer-readable storage medium having instructions encoded therein, wherein the instructions, when executed by at least one processor, cause a carrying out of a method comprising:
providing a user interface which includes a video player for displaying video frames of a video, the video frames including a number of frame regions selectable for receiving user input;
carrying out, using search-requesting input received through the user interface, a forwards-in-time or backwards-in-time search for an individual present in a selected frame region of the frame regions, wherein the individual is shown in the selected frame region with a lost object for the forwards-in-time search or without the lost object for the backwards-in-time search;
generating or re-computing a plurality of match likelihoods assigned to a plurality of individuals present in video recordings, the match likelihoods being likelihoods of there being an appearance of the individual;
populating or updating a user interface page of the user interface to display information corresponding to the generated or re-computed match likelihoods; and
building a timeline to show when or around when the individual lost the object.

8. The at least one tangible, non-transitory, computer-readable storage medium as claimed in claim 7 wherein the frame regions are bounding boxes.

9. The at least one tangible, non-transitory, computer-readable storage medium as claimed in claim 7 wherein the user interface is configured to provide a selection list to facilitate receipt of the search-requesting input.

Assignees

• Avigilon Corp

Inventors

• Doumbouya Moussa
• Saptharishi Mahesh
• Sjue Eric
• Valbonesi Hannah

Classifications

• G06T2207/30232

  Surveillance · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G11B27/22 Primary

  Means responsive to presence or absence of recorded information signals · CPC title

• G06T7/292

  Multi-camera tracking · CPC title

• G06T2207/20076

  Probabilistic image processing · CPC title