Systems and methods for coherent monitoring

Patent metadata

Field	Value
Publication number	US-10867178-B2
Application number	US-201916565256-A
Country	US
Kind code	B2
Filing date	Sep 9, 2019
Priority date	Jan 31, 2019
Publication date	Dec 15, 2020
Grant date	Dec 15, 2020

Abstract

Systems and methods are provided for intelligently monitoring environments, classifying objects within such environments, detecting events within such environments, receiving and propagating input concerning image information from multiple users in a collaborative environment, identifying and responding to situational abnormalities or situations of interest based on such detections and/or user inputs.

First claim

The invention claimed is:

1. A system for intelligently monitoring an environment, comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the system to:
obtain image information representing an environment, the image information comprising a plurality of image frames;
provide the image information for display on at least one device;
identify, based on the image information, one or more discrete objects observed within the environment;
track a path of the one or more discrete objects within the environment across the plurality of image frames of the image information;
generate a graphic representing the path of the one or more discrete objects across the plurality of image frames of the image information; and
display the graphic as an overlay on top of the displayed image information, wherein the graphic is provided over a portion of the displayed image information corresponding to a set of locations of the discrete object within the environment at a time the image information was captured.

2. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:
determine, based on the tracking, that an event condition associated with the discrete object has been satisfied; and
modify the graphic based on the satisfaction of the event condition.

3. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:
determine that a notification condition associated with the discrete object has been satisfied; and
modify the graphic based the satisfaction of the notification condition.

4. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:
provide, responsive to a user selection of the graphic, a modified view of a portion of the image information corresponding to a cropped zone within the environment surrounding the identified discrete object.

5. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:
estimate a real-world dimensions of a portion of at least one of the identified discrete objects.

6. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:
provide, responsive to a user selection of at least two points corresponding to locations within the image information provided for display on a device, an estimated real-world distance between the at least two points.

7. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:
provide the image information for display on at least two devices operated by two different users;
receive, from one of the at least two devices, a tagging command corresponding to at least one of the discrete objects identified in the image information;
provide, at the others of the at least to devices, an indication of the tagging command.

8. The system of claim 1 , wherein the memory stored instructions that, when executed by the one or more processors, further causes the system to:
compute a number of discrete objects identified within a portion of the image information.

9. The system of claim 1 , wherein the graphic represents a classification of the one or more discrete objects observed within the environment.

10. The system of claim 1 , wherein the graphic comprises a visual attribute providing an indication of a confidence score associated with the identified discrete object.

11. A method being implemented by a computing system including one or more physical processors and storage media storing machine-readable instructions, the method comprising:
obtaining image information representing an environment, the image information comprising a plurality of image frames;
providing the image information for display on at least one device;
identifying, based on the image information, one or more discrete objects observed within the environment;
tracking a path of the one or more discrete objects within the environment across the plurality of image frames of the image information;
generating a graphic representing the path of the one or more discrete objects across the plurality of image frames of the image information; and
displaying the graphic as an overlay on top of the displayed image information, wherein the graphic is provided over a portion of the displayed image information corresponding to a set of locations of the discrete object within the environment at a time the image information was captured.

12. The method of claim 11 , further comprising:
determining, based on the tracking, that an event condition associated with the discrete object has been satisfied; and
modifying the graphic based on the satisfaction of the event condition.

13. The method of claim 11 , further comprising:
determining that a notification condition associated with the discrete object has been satisfied; and
modifying the graphic based the satisfaction of the notification condition.

14. The method of claim 11 , further comprising:
providing, responsive to a user selection of the graphic, a modified view of a portion of the image information corresponding to a cropped zone within the environment surrounding the identified discrete object.

15. The method of claim 11 further comprising:
estimating a real-world dimensions of a portion of at least one of the identified discrete objects.

16. The method of claim 11 , further comprising:
providing, responsive to a user selection of at least two points corresponding to locations within the image information provided for display on a device, an estimated real-world distance between the at least two points.

17. The method of claim 11 , further comprising:
providing the image information for display on at least two devices operated by two different users;
receiving, from one of the at least two devices, a tagging command corresponding to at least one of the discrete objects identified in the image information;
providing, at the others of the at least to devices, an indication of the tagging command.

18. The method of claim 11 , further comprising:
computing a number of discrete objects identified within a portion of the image information.

19. The method of claim 11 , wherein the graphic represents a classification of the one or more discrete objects observed within the environment.

20. The method of claim 11 , wherein the graphic comprises a visual attribute providing an indication of a confidence score associated with the identified discrete object.

Assignees

• Palantir Technologies Inc

Inventors

• Cervelli Daniel
• Gupta Anand
• Elder Andrew
• Imig Robert
• Ramalingam Praveen Kumar
• Glidden Reese
• Fedderly Matthew

Classifications

• G06Q10/00 Primary

  Administration; Management · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06F18/24

  Classification techniques · CPC title

• G06V20/64

  Three-dimensional [3D] objects · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title