Systems and methods for providing augmented reality emergency response solutions

Patent metadata

Field	Value
Publication number	US-12333629-B2
Application number	US-202318470227-A
Country	US
Kind code	B2
Filing date	Sep 19, 2023
Priority date	Jan 2, 2018
Publication date	Jun 17, 2025
Grant date	Jun 17, 2025

Abstract

An emergency response system (ERS) configured to acquire equipment location data, target terminal location data, and emergency responder terminal location data; determine a horizontal distance measure between the emergency responder terminal and a select unit of equipment, determine a vertical distance measure between the emergency responder terminal and a select unit of equipment, engage a camera component of the emergency responder terminal to capture images of at least a portion of the surrounding real-world scene, providing such images for display on the touchscreen display of the emergency responder terminal, and/or providing an equipment display object for display on the touchscreen of the emergency responder terminal such that, when an image provided for display spans a region of the real-world scene within which the equipment is located, the equipment display object dynamically overlays a segment of the image associated with the acquired equipment location data.

First claim

We claim:

1. An emergency response system (ERS) comprising:
a non-transitory computer readable medium storing machine readable instructions which when executed cause the ERS to:
acquire equipment location data for one or more units of equipment located in a zone of interest;
acquire emergency responder terminal location data for at least one emergency responder terminal;
determine a horizontal distance measure between the emergency responder terminal and each of the one or more units of equipment;
determine a vertical distance measure between the emergency responder terminal and one or more of the units of equipment;
engage a camera component of the emergency responder terminal to capture images of at least a portion of a real-world scene surrounding at least one of the one or more units of equipment, and provide such images for display on a touchscreen display of the emergency responder terminal;
provide an equipment display object for display on the touchscreen display of the emergency responder terminal such that, when an image provided for display spans a region of the real-world scene within which a unit of the one or more units of equipment is located, the equipment display object overlays a segment of the image associated with the acquired equipment location data, wherein a size of the equipment display object is based on the horizontal distance measure and the vertical distance measure; and
provide a route display object for display on the touchscreen display of the emergency responder terminal delineating a path of travel between the emergency responder terminal and the one or more units of equipment based on the horizontal distance measure and the vertical distance measure.

2. The ERS of claim 1 , wherein the route display object is generated by an emergency management entity communicatively coupled with but physically detached from the emergency responder terminal.

3. The ERS of claim 1 , wherein selection of the equipment display object causes one or more equipment details to be displayed on the touchscreen display, wherein the equipment details associated with at least one of the one or more units of equipment includes one or more of: equipment type, equipment quantity, equipment operation status, an equipment use instruction.

4. The ERS of claim 1 , wherein the route display object includes an indication of an estimated time it will take an emergency responder to travel along the delineated a path of travel.

5. The ERS of claim 1 , wherein the non-transitory computer readable medium further stores machine readable instructions that, when executed, cause the ERS to:
obtain updated equipment location data and emergency terminal location data on a continual basis, and correspondingly adjust a position of the equipment display object on the touchscreen display of the emergency responder terminal based on: changes to the equipment location data, changes to the emergency responder terminal location data, and changes in orientation of the camera component of the emergency responder terminal.

6. The ERS of claim 1 , wherein the non-transitory computer readable medium further stores machine readable instructions that, when executed, cause the ERS to:
obtain updated equipment location data and emergency terminal location data on a periodic basis at predefined intervals, and correspondingly adjust a position of a target terminal display object on the touchscreen display of the emergency responder terminal based on: changes to the equipment location data, changes to the emergency responder terminal location data, and changes in orientation of the camera component of the emergency responder terminal.

7. The ERS of claim 1 , wherein the non-transitory computer readable medium further stores machine readable instructions that, when executed, cause the ERS to:
obtain updated equipment location data and emergency terminal location data upon manual request by a user, and correspondingly adjust a position of a target terminal display object on the touchscreen display of the emergency responder terminal based on: changes to the equipment location data, changes to the emergency responder terminal location data, and changes in orientation of the camera component of the emergency responder terminal.

8. The ERS of claim 1 , wherein the equipment location data is obtained from one or more of: components at least partially internal to a housing of each of the one or more units of equipment, and components at least partially external to the housing of each of the one or more units of equipment.

9. The ERS of claim 8 , wherein the components at least partially internal to the housing of each of the one or more units of equipment include one or more of a GPS sensor, an altimeter, a Bluetooth beacon, and RFID tag, and a pressure sensor.

10. The ERS of claim 8 , wherein the components at least partially external to the housing of each of the one or more units of equipment include one or more emergency vicinity components located in a vicinity of an ongoing emergency.

11. The ERS of claim 8 , wherein the components at least partially external to the housing of each of the one or more units of equipment include one or more target vicinity components located in a vicinity of an ongoing emergency, wherein the target vicinity components include a plurality of proximity beacons configured to communicate with target terminals.

12. The ERS of claim 1 , wherein the horizontal distance measure between the emergency responder terminal and a first one of the one or more units of equipment is given as an estimate of the shortest horizontal distance between the emergency responder terminal and the first one of the one or more units of equipment.

13. The ERS of claim 12 , wherein the horizontal distance measure between the emergency responder terminal and the first one of the one or more units of equipment is given as an estimate of the total horizontal distance a emergency responder associated with the emergency responder terminal must travel to get to the first one of the one or more units of equipment when traveling along the delineated path of travel.

14. The ERS of claim 1 , wherein the vertical distance measure is an estimate of an altitude of the one or more units of equipment.

15. The ERS of claim 1 , wherein the vertical distance measure is an estimate of a difference between an altitude of the one or more units of equipment and the altitude of the emergency responder terminal.

16. The ERS of claim 1 , wherein the route display object is provided upon selection of the equipment display object.

17. The ERS of claim 1 , wherein one or more of a shape, color, and size of the equipment display object is defined based on one or more of a latitude measure, a longitude measure, an altitude measure, a route, an equipment detail, and an indication of a status associated with one or more corresponding units of equipment.

18. The ERS of claim 1 , wherein each of the one or more units of equipment is coupled with a GPS circuit, an altimeter, and a communications circuit.

19. The ERS of claim 1 , wherein the horizontal distance measure and the vertical distance measure are computed based on the equipment location data and the emergency responder terminal location data.

Assignees

• Titan Health & Security Tech Inc

Inventors

• Merjanian Vic
• Khalili Ryan
• Juarez Eduardo
• Merjanian Ed
• Nasser Serene
• Wallengren Daniel

Classifications

• G06Q30/0278

  Product appraisal · CPC title

• G06V10/17

  using hand-held instruments · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• H04W64/006

  with additional information processing, e.g. for direction or speed determination · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title