Systems and methods for building surveillance re-identification based on a building graph

Patent metadata

Field	Value
Publication number	US-12579874-B2
Application number	US-202217991166-A
Country	US
Kind code	B2
Filing date	Nov 21, 2022
Priority date	Nov 23, 2021
Publication date	Mar 17, 2026
Grant date	Mar 17, 2026

Abstract

A building system can operate to receive a request to generate a video tracking movement of an entity throughout the building. The building system can operate to search, based on a building graph, a database for a set of images or videos of cameras of the building that track the entity throughout the building. The building graph can include nodes indicating spaces of the building and the cameras of the building. The building graph can include building graph including edges between the nodes representing relationships between the spaces and the cameras. The building system can operate to join the set of images or videos together to create the video.

First claim

What is claimed:

1 . A building system of a building comprising one or more memory devices storing instructions thereon that, when executed by one or more processors, cause the one or more processors to:
receive a request to generate a video tracking movement of an entity throughout the building; search, based on a graph database for the building, a video database for a set of images or videos of a plurality of cameras of the building that track the entity throughout the building, the graph database for the building comprising a plurality of nodes indicating a plurality of spaces of the building and the plurality of cameras of the building, the graph database for the building comprising a plurality of edges between the plurality of nodes representing semantic relationships between the plurality of spaces and the plurality of cameras; identify a set of cameras of the plurality of cameras associated with the set of images or videos; identify a set of nodes of the graph database for the building representing the set of cameras; identify camera characteristics of the set of cameras by identifying edges of the plurality of edges linking the set of nodes to nodes representing the camera characteristics; normalize the set of images or videos based on the camera characteristics of the set of cameras; and join the set of images or videos together to create the video.

2 . The building system of claim 1 , wherein at least some of the plurality of nodes indicate equipment, people, or events of the building;
wherein at least some of the plurality of edges represent relationships between the equipment, the people, or the events of the building.

3 . The building system of claim 1 , wherein the instructions cause the one or more processors to:
generate a trajectory graph based on the graph database for the building and a plurality of images or videos of the video database, the trajectory graph indicating a path of the entity through the building, the trajectory graph including a plurality of nodes and a plurality of edges, wherein the plurality of nodes represent the plurality of cameras that captured pictures of the entity or filmed the entity, the plurality of edges indicating an order in which the plurality of cameras captured the pictures of the entity or filmed the entity; and search the video database for the set of images or videos based on the trajectory graph.

4 . The building system of claim 1 , wherein the request to generate the video tracking movement of the entity throughout the building is at least one of:
a user request of a user device requesting the video tracking movement of the entity throughout the building be generated; or a request generated responsive to a security event involving the entity occurring within the building.

5 . The building system of claim 1 , wherein the instructions cause the one or more processors to:
search the video database for the set of images or videos of the plurality of cameras of the building by:
identifying one or more first videos or images of a first camera of the plurality of cameras stored in the video database, the one or more first videos or images including the entity, the first camera surveilling a first space of the building;
identifying a second space of the building connected to the first space based on the graph database for the building;
identifying a second camera of the plurality of cameras surveilling the second space of the building based on the graph database for the building;
selecting one or more second videos or images of the second camera stored in the video database responsive to identifying the second camera; and
identifying the entity within the one or more second videos or images of the second camera indicating that the entity moved from the first space to the second space; and
join the one or more first videos or images and the one or more second videos or images to create the video.

6 . The building system of claim 5 , wherein the instructions cause the one or more processors to:
generate a trajectory graph by:
causing the trajectory graph to include a first node representing the first camera of the plurality of cameras in response to identifying the one or more first videos or images of the first camera of the plurality of cameras including the entity; and
causing the trajectory graph to include a second node and an edge between the first node and the second node indicating that the entity has moved from a field of view of the first camera to a field of view of the second camera in response identifying the entity is within the one or more second videos or images of the second camera.

7 . The building system of claim 6 , wherein the instructions cause the one or more processors to:
identify, based on the graph database for the building, a camera not represented in the trajectory graph that includes a field of view that captures a portion of a path the entity traveled on; update the trajectory graph to include a node representing the camera; and join the set of images or videos together with images or videos of the camera to create the video.

8 . The building system of claim 7 , wherein the instructions cause the one or more processors to:
determine at least one of a starting time or an ending time for the images or videos by:
identifying a speed of the entity based on a length of time the entity takes to move across at least a portion of the field of view of the first camera; and
determining at least one of the starting time or the ending time based on the speed of the entity.

9 . A method, comprising:
receiving, by one or more processing circuits, a request to generate a video tracking movement of an entity throughout a building; searching, by the one or more processing circuits, based on a graph database for the building, a video database for a set of images or videos of a plurality of cameras of the building that track the entity throughout the building, the graph database for the building comprising a plurality of nodes indicating a plurality of spaces of the building and the plurality of cameras of the building, the graph database for the building comprising a plurality of edges between the plurality of nodes representing semantic relationships between the plurality of spaces and the plurality of cameras; identifying, by the one or more processing circuits, a set of cameras of the plurality of cameras associated with the set of images or videos; identifying, by the one or more processing circuits, a set of nodes of the graph database for the building representing the set of cameras; identifying, by the one or more processing circuits, camera characteristics of the set of cameras by identifying edges of the plurality of edges linking the set of nodes to nodes representing the camera characteristics; normalizing, by the one or more processing circuits, the set of images or videos based on the camera characteristics of the set of cameras; and joining, by the one or more processing circuits, the set of images or videos together to create the video.

10 . The method of claim 9 , wherein at least some of the plurality of nodes indicate equipment, people, or events of the building;
wherein at least some of the plurality of edges represent relationships between the equipment, the people, or the events of the building.

11 . The method of claim 9 , comprising:
generating, by the one or more processing circuits, a trajectory graph based on the graph database for the building and a plurality of images or videos of the video database, the trajectory graph indicating a path of the entity through the building, the trajectory graph including a plurality of nodes and a plur

Assignees

• Tycore Fire & Security GmbH
• Tyco Fire & Security Gmbh

Inventors

• Ramanasankaran Rajiv
• Kulandai Samy Santle Camilus
• Shatdal Ambuj
• Paulson Erik S
• Adam Lipphei

Classifications

• G05B15/02

  electric · CPC title

• G08B13/19604

  involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change · CPC title

• G08B13/19645 Primary

  Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over · CPC title

• G08B13/19641

  Multiple cameras having overlapping views on a single scene · CPC title

• G08B13/19608 Primary

  Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position · CPC title