Method, system and computer program product for interactively identifying same individuals or objects present in video recordings

Patent metadata

Field	Value
Publication number	US-10121515-B2
Application number	US-201615368357-A
Country	US
Kind code	B2
Filing date	Dec 2, 2016
Priority date	Jun 6, 2016
Publication date	Nov 6, 2018
Grant date	Nov 6, 2018

Abstract

A method, system and computer program product for interactively identifying same individuals or objects present in video recordings is disclosed. When a thumbnail in a set of thumbnails is selected, new information is obtained. The new information may be that an individual or object is present in the portion of the video recording associated with the thumbnail. A search can be carried out for the individual or object based on the new information. The search generates new match likelihoods for each of displayed thumbnails within a user interface page. The displayed thumbnails are re-ordered based on the new match likelihoods.

First claim

The invention claimed is:

1. A method comprising:
displaying a plurality of sets of thumbnails, each set of thumbnails including one or more thumbnails positioned in a respective row or column which, along with the set of thumbnails, are defined by a unique time interval of a plurality of time intervals, and each thumbnail of each set of thumbnails being visually representative of an associated portion of a video recording taken at the defined time interval for the thumbnail, and the one or more thumbnails in each set of thumbnails being organized in a descending order arrangement starting at one end of the respective row or column with a thumbnail corresponding to a highest likelihood, as compared to any other thumbnails of the set, of appearance of an individual or object having been identified as being of interest, and any remaining thumbnails in the set are displayed, in descending order, extending away from the thumbnail corresponding to the highest likelihood;
allowing selection of a first thumbnail in one of the sets of thumbnails to obtain new information that the individual or object is present in the portion of the video recording associated with the first thumbnail;
carrying out a search for the individual or object based on the new information, wherein the search generates new match likelihoods for each of the displayed thumbnails;
re-ordering the displayed thumbnails based on the new match likelihoods so as to maintain the descending order arrangement in each of the sets of thumbnails.

2. The method as claimed in claim 1 further comprising displaying new thumbnails interspersed with remaining pre-search thumbnails.

3. The method as claimed in claim 1 wherein the re-ordering the displayed thumbnails includes re-ordering only a sub-set of pre-search thumbnails with other pre-search thumbnails being no longer displayed due to respectively lowered match likelihoods.

4. The method as claimed in claim 1 wherein, after the selection of the first thumbnail, the first thumbnail is moved to a user interface space separate from another user interface space within which the plurality of sets of thumbnails are displayed.

5. The method as claimed in claim 1 wherein the plurality of sets of thumbnails are displayed within a user interface page, and the user interface page includes an interactive tool for changing the plurality of time intervals.

6. A tangible, non-transitory, computer-readable storage medium having instructions encoded therein, wherein the instructions, when executed by at least one processor, cause a carrying out of a method comprising:
displaying a plurality of sets of thumbnails, each set of thumbnails including one or more thumbnails positioned in a respective row or column which, along with the set of thumbnails, are defined by a unique time interval of a plurality of time intervals, and each thumbnail of each set of thumbnails being visually representative of an associated portion of a video recording taken at the defined time interval for the thumbnail, and the one or more thumbnails in each set of thumbnails being organized in a descending order arrangement starting at one end of the respective row or column with a thumbnail corresponding to a highest likelihood, as compared to any other thumbnails of the set, of appearance of an individual or object having been identified as being of interest, and any remaining thumbnails in the set are displayed, in descending order, extending away from the thumbnail corresponding to the highest likelihood;
allowing selection of a first thumbnail in one of the sets of thumbnails to obtain new information that the individual or object is present in the portion of the video recording associated with the first thumbnail;
sending a request to a server to search for the individual or object based on the new information, wherein the search generates new match likelihoods for each of the displayed thumbnails;
re-ordering the displayed thumbnails based on the new match likelihoods so as to maintain the descending order arrangement in each of the sets of thumbnails.

7. The tangible, non-transitory, computer-readable storage medium as claimed in claim 6 wherein the method further comprises displaying new thumbnails interspersed with remaining pre-search thumbnails.

8. The tangible, non-transitory, computer-readable storage medium as claimed in claim 6 wherein the re-ordering the displayed thumbnails includes re-ordering only a sub-set of pre-search thumbnails with other pre-search thumbnails being no longer displayed due to respectively lowered match likelihoods.

9. The tangible, non-transitory, computer-readable storage medium as claimed in claim 6 wherein, after the selection of the first thumbnail, the first thumbnail is moved to a user interface space separate from another user interface space within which the plurality of sets of thumbnails are displayed.

10. The tangible, non-transitory, computer-readable storage medium as claimed in claim 6 wherein the plurality of sets of thumbnails are displayed within a user interface page, and the user interface page includes an interactive tool for changing the plurality of time intervals.

Assignees

• Avigilon Corp

Inventors

• Doumbouya Moussa
• Saptharishi Mahesh
• Sjue Eric
• Valbonesi Hannah

Classifications

• G06T2207/30232

  Surveillance · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G11B27/22 Primary

  Means responsive to presence or absence of recorded information signals · CPC title

• G11B27/34

  Indicating arrangements  {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} · CPC title

• G06T2207/30196

  Human being; Person · CPC title