Contextualized augmented reality display system

Patent metadata

Field	Value
Publication number	US-12548431-B2
Application number	US-202117404364-A
Country	US
Kind code	B2
Filing date	Aug 17, 2021
Priority date	Nov 29, 2018
Publication date	Feb 10, 2026
Grant date	Feb 10, 2026

Abstract

Systems and methods for an emergency response system (ERS) to provide an augmented reality overlay on a real-world scene through the heads-up display (HUD) of an emergency responder. In addition to displaying information known to the ERS, an emergency responder terminal of the ERS can detect propagated signals from devices not registered with the ERS. The source and location of the propagated signal can be determined, and a generic display object can be generated representing the location of the propagated signal. The generic display object can be displayed on the HUD when the location of the source of the propagated signal falls within the field of view of a camera component of the emergency responder terminal.

First claim

What is claimed is:

1 . A method, comprising:
detecting, by a detector circuit of an emergency response system, a propagated signal from a device; determining, by a processor, a location of a source of the propagated signal; comparing, by the processor, the location of the source of the propagated signal with one or more known real-time locations of registered non-responder terminals of the emergency response system; generating, by the processor of the emergency response system and in response to a determination that the device is not a registered non-responder terminal of the emergency response system, a generic display object representing the source of the propagated signal, wherein the determination that the device is not a registered non-responder terminal of the emergency response system is based on a distance between the source of the propagated signal and at least one of the registered non-responder terminals exceeding a threshold; capturing, by a camera component of the emergency response system, a live real-world scene; displaying, on a display of an emergency responder terminal, the live real-world scene captured by the camera component; and displaying, on the display when the source of the propagated signal falls within a field of view of the camera component, the generic display object representing the source of the propagated signal, wherein a size and position of the generic display object displayed on the display is based on its distance from and orientation relative to the location of the source and orientation of the emergency responder terminal, and wherein the generic display object comprises an icon overlaid onto the captured live real-world scene, wherein the icon is different from icons used to illustrate other landmarks.

2 . The method of claim 1 , wherein generating the generic display object comprises generating the generic display object such that the generic display object provides a color coded indication of a distance from the location of the source of the propagated signal to the emergency responder terminal.

3 . The method of claim 2 , further comprising: providing, based on a selection of the generic display object, situational status information.

4 . The method of claim 1 , further comprising determining, by the processor, if the source of the propagated signal is associated with a registered non-responder terminal of the emergency response system.

5 . The method of claim 4 , further comprising ignoring the propagated signal when the source of the propagated signal is associated with a registered non-responder terminal of the emergency response system.

6 . The method of claim 1 , wherein determining the location of the source of the propagated signal is based on a signal strength of the propagated signal.

7 . The method of claim 1 , wherein determining the location of the source of the propagated signal comprises:
obtaining, from a plurality of non-terminal identification components of the emergency response system, a signal strength value of the propagated signal detected by a detector circuit of each of the non-terminal identification components; and analyzing, by the processor, the obtained signal strength values of the plurality of non-terminal identification components; wherein the location is a position within a space defined by the plurality of non-terminal identification components determined based on the analysis.

8 . The method of claim 1 , wherein the processor is one or more processors of the emergency responder terminal.

9 . The method of claim 1 , wherein the processor is one or more processors of an emergency response system entity.

10 . An emergency response system, comprising:
an emergency responder terminal; a display communicatively coupled to the emergency responder terminal; and a non-transitory machine readable medium storing machine readable instructions that, when executed by a processor, cause the emergency response system to:
detect, by a detector circuit of the emergency response system, a propagated signal from a device;
determine, by the processor, a location of a source of the propagated signal;
compare, by the processor, the location of the source of the propagated signal with one or more known real-time locations of registered non-responder terminals of the emergency response system;
generate, by the processor of the emergency response system and in response to a determination that the device is not a registered non-responder terminal of the emergency response system, a generic display object representing the source of the propagated signal, wherein the determination that the device is not a registered non-responder terminal of the emergency response system is based on a distance between the source of the propagated signal and at least one of the registered non-responder terminals exceeding a threshold;
capture, by a camera component of the emergency response system, a live real-world scene;
display, on the display of the emergency responder terminal, the live real-world scene captured by the camera component; and
display, on the display when the source of the propagated signal falls within a field of view of the camera component, the generic display object representing the source of the propagated signal, wherein a size and position of the generic display object displayed on the display is based on its distance from and orientation relative to the real-time location and orientation of the emergency responder terminal, and wherein the generic display object comprises an icon overlaid onto the captured live real-world scene, wherein the icon is different from icons used to illustrate other landmarks.

11 . The emergency response system of claim 10 , wherein the instruction to generate the generic display object further includes sub-instructions to generate the generic display object such that the generic display object provides a color-coded indication of a distance from the location of the source of the propagated signal to the emergency responder terminal.

12 . The emergency response system of claim 11 , wherein the non-transitory machine readable medium further stores machine readable instructions that, when executed by a processor, cause the emergency response system to: provide, based on a selection of the generic display object, situational status information.

13 . The emergency response system of claim 10 , further comprising a plurality of non-terminal identification components, and the non-transitory machine readable medium storing machine readable instructions that, when executor by the processor, cause the emergency response system to further:
obtain, from the plurality of non-terminal identification components of the emergency response system, a signal strength value of the propagated signal detected by a detector circuit of each of the non-terminal identification components; and analyze, by the processor, the obtained signal strength values of the plurality of non-terminal identification components; wherein the location is a position within a space defined by the plurality of non-terminal identification components determined based on the analysis.

14 . The emergency response system of claim 10 , the non-transitory machine readable medium storing machine readable instructions that, when executor by the processor, cause the emergency response system to further:
determine, by the processor, if the source of the propagated signal is associated with a registered non-responder terminal of the emergency response system.

15 . The emergency response system of claim 10 , wherein the camera component

Assignees

• Titan Health & Security Tech Inc

Inventors

• Merjanian Vic A
• Beaudoin Michael
• Khalili Ryan
• Juarez Eduardo
• Merjanian Ed

Classifications

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G08B27/001 Primary

  Signalling to an emergency team, e.g. firemen · CPC title