Smart infrastructures and first-responder network for security and safety hazards

Patent metadata

Field	Value
Publication number	US-12024201-B2
Application number	US-202117392376-A
Country	US
Kind code	B2
Filing date	Aug 3, 2021
Priority date	Aug 5, 2020
Publication date	Jul 2, 2024
Grant date	Jul 2, 2024

Abstract

Disclosed are various embodiments related to coordinated monitoring and responding to an emergency situation at a building structure as a supplement to a traditional emergency response. In some embodiments, a system comprises a computing device that is configured to receive sensor data from a sensor network. The sensor network includes monitoring units that monitor various locations of an infrastructure. The computing device determines an occurrence of an emergency event at a location in the infrastructure using an anomaly detector model based at least in part on the sensor data. A hybrid mobile unit is instructed by the computing device to navigate to the location of the emergency event. The hybrid mobile unit is configured to provide mobile sensor data associated with the location to confirm the emergency event.

First claim

Therefore, the following is claimed:

1. A system, comprising:
a computing device;
a memory in communication with the computing device, wherein the memory comprises a plurality of machine instructions that, when executed, cause the computing device to at least:
generate a sensor network for a building infrastructure based at least in part on communication from a plurality of a monitoring devices, the sensor network indicating a plurality of static device locations for the plurality of monitoring devices related to the building infrastructure, generating the sensor network includes indicating a plurality of neighboring locational relationships between the plurality of monitoring device with respect to building infrastructure;
receive sensor data from the sensor network of the building infrastructure;
determine an occurrence of an emergency event at a location in the building infrastructure using an anomaly detector model based at least in part on the sensor data;
determine an emergency threat type associated with the emergency event based at least in part on the sensor data and an object detection technique;
instruct a hybrid mobile device to navigate to the location of the emergency event, wherein the hybrid mobile device comprises a second sensor and a clamp, the second sensor providing mobile sensor data associated with the location to confirm the emergency event, the clamp being manipulated by a motor for delivering a payload;
receive a confirmation of the emergency event from the hybrid mobile device;
determine a threat level for the emergency event based at least in part on the confirmation and mobile sensor data provided by the hybrid mobile device from the location;
identify an order of priorities for mitigating the emergency event based at least in part on a first optimization goal having a higher priority than a second optimization goal for mitigating the emergency event;
select a mitigation action for the emergency event based at least in part on the order of priorities, the emergency threat type, and the threat level; and
instruct the hybrid mobile device to perform the mitigation action by activating the clamp to deliver the payload at the location of the building infrastructure associated with the emergency event.

2. The system of claim 1 , wherein generating the sensor network further comprises generating a graph data structure of the plurality of monitoring devices on the building infrastructure based at least in part on plurality of static device locations of the plurality of monitoring devices, wherein the graph data structure is used by the anomaly detector model to determine the occurrence of the emergency event.

3. The system of claim 1 , wherein the hybrid mobile device is an aerial vehicle that comprises at least one of a gas sensor or a camera.

4. The system of claim 1 , wherein the confirmation is based at least in part on the mobile sensor data captured by the hybrid mobile device and the plurality of machine instructions that, when executed, cause the computing device to at least:
transmit emergency information associated with the emergency event to a remote system associated with a first-responder organization, wherein the emergency information comprises at least a portion of the mobile sensor data.

5. The system of claim 1 , wherein the confirmation is further based at least in part on the mobile sensor data captured by the hybrid mobile device and the plurality of machine instructions that, when executed, cause the computing device to at least:
determine to raise a threat level for the emergency event based at least in part on the sensor data and the mobile sensor data.

6. The system of claim 5 , wherein the mitigation action for the emergency event is further determined based at least in part on the threat level.

7. The system of claim 5 , wherein the plurality of machine instructions that, when executed, cause the computing device to at least:
receive the mobile sensor data from the hybrid mobile device, wherein the mobile sensor data is associated with the location of the emergency event and captured by an onboard sensor of the hybrid mobile device; and
determine to lower the threat level for the emergency event based at least in part on the sensor data and the mobile sensor data.

8. The system of claim 1 , wherein the emergency event comprises at least one of a fire event associated with the building infrastructure or a criminal event associated with the building infrastructure.

9. The system of claim 1 , wherein the anomaly detector model comprises historical sensor data representing a plurality of scenarios of a normal state for the building infrastructure, and determining the occurrence of the emergency event at the location in the building infrastructure further comprises comparing the sensor data associated with the emergency event and the historical sensor data.

10. A method, comprising:
generating, by a computing device, a sensor network for a building infrastructure based at least in part on communication from a plurality of a monitoring devices, the sensor network indicating a plurality of static device locations for the plurality of a monitoring devices related to the building infrastructure, generating the sensor network includes indicating a plurality of neighboring locational relationships between the plurality of monitoring device with respect to building infrastructure;
receiving, by the computing device, sensor data from the sensor network;
determining, by the computing device, an occurrence of an emergency event at a location in the building infrastructure using an anomaly detector model based at least in part on the sensor data;
determining, by the computing device, an emergency threat type associated with the emergency event based at least in part on the sensor data and an object detection technique;
instructing, by the computing device, a hybrid mobile device to navigate to the location of the emergency event, wherein the hybrid mobile device is configured to provide mobile sensor data associated with the location to confirm the emergency event;
receiving, by the computing device, a confirmation of the emergency event from the hybrid mobile device;
determining, by the computing device, a threat level for the emergency event based at least in part on the confirmation and the mobile sensor data provided by the hybrid mobile device from the location;
identifying, by the computing device, an order of priorities for mitigating the emergency event based at least in part on a first optimization goal having a higher priority than a second optimization goal for mitigating the emergency event;
determining, by the computing device, a mitigation action for the emergency event based at least in part on the order of priorities, the emergency threat type, and the threat level; and
instructing, by the computing device, the hybrid mobile device to perform the mitigation action.

11. The method of claim 10 , wherein generating the sensor network further comprises generating a graph data structure of the plurality of monitoring devices on the building infrastructure based at least in part on plurality of static device locations of the plurality of monitoring devices, wherein the graph data structure is used by the anomaly detector model to determine the occurrence of the emergency event.

12. The method of claim 10 , wherein the hybrid mobile device comprises at least one of an unmanned aerial vehicle or an autonomous robot.

13. The method of claim 12 , wherein instructing the hybrid mobile device to perform the mitigation action further comprises instructing a plurality of hybrid mobile devices to pe

Assignees

• Univ Florida

Inventors

• Chakraborty Prabuddha
• Dizon Reiner
• Vega Christopher
• Harley Joel B
• Ray Sandip
• Bhunia Swarup
• Sristi Lakshmiprasanna Sriramakumara Patanjali

Classifications

• B64U2201/104

  using satellite radio beacon positioning systems, e.g. GPS · CPC title

• B64U2101/24

  for use as flying displays, e.g. advertising or billboards · CPC title

• B64U10/13

  Flying platforms · CPC title

• B64U2101/57

  for bringing emergency supplies to persons or animals in danger, e.g. ropes or life vests · CPC title

• B64U2101/31

  for surveillance · CPC title