Systems and methods for providing augmented reality emergency response solutions

Patent metadata

Field	Value
Publication number	US-11798200-B2
Application number	US-202117168666-A
Country	US
Kind code	B2
Filing date	Feb 5, 2021
Priority date	Jan 2, 2018
Publication date	Oct 24, 2023
Grant date	Oct 24, 2023

Abstract

An emergency response system (ERS) configured to acquire equipment location data, target terminal location data, and emergency responder terminal location data; determine a horizontal distance measure between the emergency responder terminal and a select unit of equipment, determine a vertical distance measure between the emergency responder terminal and a select unit of equipment, engage a camera component of the emergency responder terminal to capture images of at least a portion of the surrounding real-world scene, providing such images for display on the touchscreen display of the emergency responder terminal, and/or providing an equipment display object for display on the touchscreen of the emergency responder terminal such that, when an image provided for display spans a region of the real-world scene within which the equipment is located, the equipment display object dynamically overlays a segment of the image associated with the acquired equipment location data.

First claim

We claim:

1. An emergency response system (ERS) comprising:
a non-transitory computer readable medium storing machine readable instructions which when executed cause the ERS to:
acquire equipment location data for one or more units of equipment located in a zone of interest, wherein each of the one or more units of equipment is operatively coupled with: a first GPS circuit, a first altimeter circuit, and a first communications circuit;
acquire emergency responder terminal location data for an emergency responder terminal, wherein the emergency responder terminal is operatively coupled with: a second GPS circuit, a second altimeter circuit, a camera component, a touchscreen display, a second communication circuit, a processing engine, and a memory;
determine a horizontal distance measure between the emergency responder terminal and each of the one or more units of equipment, the horizontal distance measure computed from the acquired equipment location data and the acquired emergency responder terminal location data;
determine a vertical distance measure between the emergency responder terminal and the one or more units of equipment, the vertical distance measure computed from the acquired equipment location data and the acquired emergency responder terminal location data;
engage the camera component of the emergency responder terminal to capture video of at least a portion of the surrounding real-world scene, and stream such video for display on the touchscreen display of the emergency responder terminal;
provide an equipment display object for display on the touchscreen of the emergency responder terminal such that, when video content streamed for display on the touchscreen display spans a region of the real-world scene within which a unit of equipment of the one or more units of equipment is located, the equipment display object is displayed as an overlay on top of a segment of the video display associated with the acquired equipment location data; whereupon selection of the equipment display object causes one or more equipment details to be displayed on the touchscreen display, the equipment details including an equipment type;
obtain updated equipment location data and updated emergency responder terminal location data on a periodic basis, and correspondingly adjust a position of the equipment display object on the touchscreen display of the emergency responder terminal based on (a) the updated equipment location data, (b) updated emergency responder terminal location data, and (c) and changes in facing direction of the camera component of the emergency responder terminal.

2. The ERS of claim 1 , wherein the non-transitory computer readable medium further stores machine readable instructions that, when executed, cause the ERS to:
provide for display on the touchscreen display a route display object representing a suggested path of travel between the emergency responder terminal and the unit of equipment associated with a selected equipment display object.

3. The ERS of claim 2 , wherein the route display object is generated by an emergency management entity communicatively coupled with but physically detached from the emergency responder terminal.

4. The ERS of claim 1 , wherein the equipment details associated with the unit of equipment further includes: an equipment status.

5. The ERS of claim 2 , wherein the route display object is associated with an indication of an estimated amount of time it will take to travel along the route from a current location of the emergency responder terminal to a current location current location of the unit of equipment associated with the selected equipment display object.

6. The ERS of claim 1 , wherein the non-transitory computer readable medium further stores machine readable instructions that, when executed, cause the ERS to:
obtain updated equipment location data and updated emergency responder terminal location data on a continuous basis, and correspondingly adjust a position of the equipment display object on the touchscreen display of the emergency responder terminal based on (a) the updated equipment location data, (b) updated emergency responder terminal location data, and (c) and changes in facing direction of the camera component of the emergency responder terminal.

7. The ERS of claim 1 , wherein the non-transitory computer readable medium further stores machine readable instructions that, when executed, cause the ERS to:
obtain updated equipment location data and updated emergency responder terminal location data upon identifying a manual selection by a user, and correspondingly adjust a position of the equipment display object on the touchscreen display of the emergency responder terminal based on (a) the updated equipment location data, (b) updated emergency responder terminal location data, and (c) and changes in facing direction of the camera component of the emergency responder terminal.

8. The ERS of claim 1 , wherein the equipment location data is obtained from one or more of: components located inside a housing of a unit of equipment of the one or more units of equipment, and components located outside a housing of a unit of equipment of the one or more units of equipment.

9. The ERS of claim 8 , wherein the components located inside the housing of the unit of equipment of the one or more units of equipment include one or more of a GPS sensor, an altimeter, a Bluetooth beacon, and RFID tag, and a pressure sensor.

10. The ERS of claim 8 , wherein the components located outside the housing of the unit of equipment of the one or more units of equipment include one or more emergency vicinity components located in the vicinity of the scene of an ongoing emergency.

11. The ERS of claim 8 , wherein the components located outside the housing of the unit of equipment of the one or more units of equipment include one or more target vicinity components located in the vicinity of a scene of an ongoing emergency, wherein the target vicinity components include a proximity beacon configured to communicate with a target terminal.

12. The ERS of claim 1 , wherein the horizontal distance measure between the emergency responder terminal and a given unit of equipment comprises an estimate of the shortest horizontal distance between the emergency responder terminal and the given unit of equipment.

13. The ERS of claim 2 , wherein the horizontal distance measure between the emergency responder terminal and a specified unit of equipment comprises an estimate of the total travel distance along preestablished paths to reach the unit of equipment.

14. The ERS of claim 1 , wherein the vertical distance measure is based on an estimate of an altitude of the target terminal.

15. The ERS of claim 1 , wherein the vertical distance measure is an estimate of the relative difference between an altitude measure of the unit of equipment of the one or more units of equipment and an altitude measure of the emergency responder terminal.

16. The ERS of claim 2 , wherein the route display object is provided upon selection of the equipment display object.

17. The ERS of claim 1 , wherein one or more of a shape, a color, and a size of each of a plurality of equipment display objects is defined based on one or more of a latitude measure, a longitude measure, an altitude measure, a route, an equipment detail, and an indication of a status associated with each corresponding unit of equipment of the one or more units of equipment.

Assignees

• Titan Health & Security Tech Inc

Inventors

• Merjanian Vic
• Khalili Ryan
• Juarez Eduardo
• Merjanian Ed
• Nasser Serene
• Wallengren Daniel

Classifications

• G06Q30/0278

  Product appraisal · CPC title

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G01C21/3632

  Guidance using simplified or iconic instructions, e.g. using arrows (G01C21/365 takes precedence) · CPC title

• G01C21/3661

  Guidance output on an external device, e.g. car radio · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title