Contextualized augmented reality display system

Patent metadata

Field	Value
Publication number	US-11127282-B2
Application number	US-201816205194-A
Country	US
Kind code	B2
Filing date	Nov 29, 2018
Priority date	Nov 29, 2018
Publication date	Sep 21, 2021
Grant date	Sep 21, 2021

Abstract

Systems and methods for an emergency response system (ERS) to provide an augmented reality overlay on a real-world scene through the heads-up display (HUD) of an emergency responder. In addition to displaying information known to the ERS, an emergency responder terminal of the ERS can detect propagated signals from devices not registered with the ERS. The source and location of the propagated signal can be determined, and a generic display object can be generated representing the location of the propagated signal. The generic display object can be displayed on the HUD when the location of the source of the propagated signal falls within the field of view of a camera component of the emergency responder terminal.

First claim

What is claimed is:

1. A method, comprising:
detecting, by a detector circuit of an emergency response system, a propagated signal from a device;
determining, by a processor, a location of a source of the propagated signal, the location comprising a longitude measure, a latitude measure, and an altitude measure;
comparing, by the processor, the location of the source of the propagated signal of the device with one or more known real-time locations of registered non-responder terminals of the emergency response system;
determining, by the processor, if the device is associated with a registered non-responder terminal of the emergency response system, wherein the determination is based on the comparing;
in response to determining the device is not associated with a registered non-responder terminal of the emergency response system, generating, by the processor of the emergency response system, a generic display object visually representing the location of the source of the propagated signal;
capturing, by a camera component of the emergency response system, a real-world scene;
displaying, on a heads-up display of an emergency responder terminal, the real-world scene captured by the camera component; and
displaying, on the heads-up display, the generic display object visually representing the location of the source of the propagated signal when the source of the propagated signal falls within a field of view of the camera component,
wherein visually representing the location of the source of the propagated signal comprises the generic display object being displayed in a physical position within the field of view with respect to a position of the emergency responder terminal.

2. The method of claim 1 , wherein generating the generic display object comprises generating the generic display object such that the generic display object provides an indication of a distance from the location of the source of the propagated signal to the emergency responder terminal.

3. The method of claim 2 , wherein the indication of the distance may comprise a variation in a size of the generic display object based on the distance.

4. The method of claim 2 , wherein the indication of the distance may comprise a variation in the color of the generic display object based on the distance.

5. The method of claim 1 , wherein determining the location of the source of the propagated signal is based on a signal strength of the propagated signal.

6. The method of claim 1 , wherein determining the location of the source of the propagated signal comprises:
obtaining, from a plurality of non-terminal identification components of the emergency response system, a signal strength value of the propagated signal detected by a detector circuit of each of the non-terminal identification components; and
analyzing, by the processor, the obtained signal strength values of the plurality of non-terminal identification components;
wherein the location is a position within a space defined by the plurality of non-terminal identification components determined based on the analysis.

7. The method of claim 1 , wherein the processor is one or more processors of the emergency responder terminal.

8. The method of claim 1 , wherein the processor is one or more processors of an emergency response system entity.

9. An emergency response system, comprising:
an emergency responder terminal;
a heads-up display communicatively coupled to the emergency responder terminal; and
a non-transitory machine readable medium storing machine readable instructions that, when executed by a processor, cause the emergency response system to:
detect, by a detector circuit of the emergency response system, a propagated signal from a device;
determine, by a processor, a location of a source of the propagated signal, the location comprising a longitude measure, a latitude measure, and an altitude measure;
compare, by the processor, the location of the source of the propagated signal of the device with one or more known real-time locations of registered non-responder terminals of the emergency response system;
determine, by the processor, if the device is associated with a registered non-responder terminal of the emergency response system, wherein the determination is based on the comparing;
in response to determining the device is not associated with a registered non-responder terminal of the emergency response system, generate, by the processor of the emergency response system, a generic display object visually representing the location of the source of the propagated signal;
capture, by a camera component of the emergency response system, a real-world scene;
display, on a heads-up display of the emergency responder terminal, the real-world scene captured by the camera component; and
display, on the heads-up display, the generic display object visually representing the location of the source of the propagated signal when the source of the propagated signal falls within a field of view of the camera component,
wherein visually representing the location of the source of the propagated signal comprises the generic display object being displayed in a physical position within the field of view with respect to a position of the emergency responder terminal.

10. The emergency response system of claim 9 , wherein the instruction to generate the generic display object further includes sub-instructions to generate the generic display object such that the generic display object provides an indication of a distance from the location of the source of the propagated signal to the emergency responder terminal.

11. The emergency response system of claim 10 , wherein the indication of the distance may comprise a variation in a size of the generic display object based on the distance.

12. The emergency response system of claim 10 , wherein the indication of the distance may comprise a variation in the color of the generic display object based on the distance.

13. The emergency response system of claim 9 , further comprising a plurality of non-terminal identification components, and the non-transitory machine readable medium storing machine readable instructions that, when executor by the processor, cause the emergency response system to further:
obtain, from the plurality of non-terminal identification components of the emergency response system, a signal strength value of the propagated signal detected by a detector circuit of each of the non-terminal identification components; and
analyze, by the processor, the obtained signal strength values of the plurality of non-terminal identification components;
wherein the location is a position within a space defined by the plurality of non-terminal identification components determined based on the analysis.

14. The emergency response system of claim 9 , wherein the camera component is affixed to a piece of emergency responder equipment such that the field of view of the camera component changes as an emergency responder changes a field of view of the emergency responder, the camera component being communicatively coupled to the emergency responder terminal.

Assignees

• Titan Health & Security Tech Inc

Inventors

• Merjanian Vic A
• Beaudoin Michael
• Khalili Ryan
• Juarez Eduardo
• Merjanian Ed

Classifications

• G08B27/001 Primary

  Signalling to an emergency team, e.g. firemen · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title