Fire/security service system with augmented reality

Patent metadata

Field	Value
Publication number	US-10297129-B2
Application number	US-201514863674-A
Country	US
Kind code	B2
Filing date	Sep 24, 2015
Priority date	Sep 24, 2015
Publication date	May 21, 2019
Grant date	May 21, 2019

Abstract

An augmented reality system for use with security systems comprises an augmented reality engine that provides information concerning devices of a security system and a display device that combines the security system information from the augmented reality engine onto a representation or view of the surrounding physical, real-world environment. The system can be used for inspection, installation and/or servicing, for example. In application, it can be used to facilitate inspection including periodic testing to ensure that a fire detection and alarm system, for example, is in compliance with building and safety codes.

First claim

What is claimed is:

1. An augmented reality system for use with fire detection and alarm systems of a building, the system comprising:
an augmented reality engine that provides information concerning devices of a fire detection and alarm system; and
a display device that combines the fire detection and alarm system information from the augmented reality engine onto a representation or view of the surrounding physical, real-world environment;
wherein the fire detection and alarm system information displayed on the display device includes: 1) directions to the fire detection and alarm system devices; 2) real time event data that is being received by fire alarm control units from fire sensors via a data network; and 3) overlay symbols indicating devices that need to be tested and different overlay symbols for devices that have been tested in the past.

2. The system as claimed in claim 1 , further comprising a portable system that receives the fire detection and alarm system information from the augmented reality engine and forwards the fire detection and alarm system information to the display device.

3. The system as claimed in claim 2 , wherein the portable system determines a position of the display device and a view through the display device and selects fire detection and alarm system information for display on the display device.

4. The system as claimed in claim 1 , wherein the fire detection and alarm system devices are smoke detectors.

5. The system as claimed in claim 1 , wherein the fire detection and alarm system devices are fire panels.

6. The system as claimed in claim 1 , wherein the fire detection and alarm system information displayed on the display device includes manuals for the fire detection and alarm system devices.

7. The system as claimed in claim 1 , wherein the fire detection and alarm system information displayed on the display device includes event data from the fire detection and alarm system devices.

8. The system as claimed in claim 1 , wherein the information provided by the augmented reality engine includes prior inspection history for the devices; and the display device displays the prior inspection history for the devices.

9. The system as claimed in claim 1 , further comprising a camera that captures images from a field of view of an operator and an operator system performing pattern matching on the images from the camera to identify specific devices of the fire detection and alarm system within the field of view of the operator, the display device displaying information for the specific devices for the operator.

10. The system as claimed in claim 1 , wherein the display device displays indications of locations of devices of the fire detection and alarm system that are hidden from a view of an operator.

11. The system as claimed in claim 1 , wherein the display device displays directions to an operator by displaying arrows indicating a suggested path through the building for the operator to follow to perform an inspection and/or service of the fire detection and alarm system.

12. The system as claimed in claim 1 , wherein the directions are displayed by the display device projecting synthetic arrows within the field of view of an operator.

13. The system as claimed in claim 1 , wherein the fire detection and alarm system information displayed on the display device includes schematic representations of devices that are hidden from a view of an operator.

14. A fire detection and alarm system inspection, installation and/or servicing method, comprising:
providing information concerning devices of a fire detection and alarm system;
receiving the fire detection and alarm system information from an augmented reality server and forwarding the fire detection and alarm system information to a display device;
combining the fire detection and alarm system information onto a view of the surrounding physical, real-world environment using the display device;
displaying the fire detection and alarm system information on the display device along with directions to the fire detection and alarm system devices;
displaying real time event data that is being received by fire alarm control units from fire sensors via a data network; and
displaying overlay symbols indicating devices that need to be tested and different overlay symbols for devices that have been tested in the past.

15. The method as claimed in claim 14 , further comprising determining a position of the display device and a view through the display device and selecting fire detection and alarm system information for display on the display device based on the position and/or view.

16. The method as claimed in claim 14 , wherein the fire detection and alarm system information includes information concerning the fire detection and alarm system devices.

17. The method as claimed in claim 14 , wherein the fire detection and alarm system devices are smoke detectors.

18. The method as claimed in claim 14 , wherein the fire detection and alarm system devices are fire panels.

19. The method as claimed in claim 14 , wherein the fire detection and alarm system information displayed on the display device includes reference materials including manuals for the fire detection and alarm system devices.

20. The method as claimed in claim 14 , wherein the fire detection and alarm system information displayed on the display device includes event data from the fire detection and alarm system devices.

21. The method as claimed in claim 14 , further comprising:
a camera capturing images from a field of view of an operator;
performing pattern matching on the images to identify the specific devices of the fire detection and alarm system within a field of view of the operator; and
displaying information for the specific devices for the operator.

22. The method as claimed in claim 14 , wherein the directions are displayed by the display device by projecting synthetic arrows within a field of view of an operator.

23. An augmented reality system for use with fire detection and alarm systems of buildings, the system comprising:
a camera that captures images from a field of view of an operator;
an operator system performing pattern matching on the images from the camera to identify smoke detectors and fire panels of the fire detection and alarm system within the field of view of the operator;
an augmented reality engine that provides contemporaneous or historical realtime event data concerning the smoke detectors and fire panels; and
a display device that displays: 1) the contemporaneous or historical event data in overlays adjacent to the smoke detectors and fire panels in the images from the camera including displaying a time of a last fire alarm adjacent to the fire panel in the field of view of the operator; and 2) schematic representations of devices that are hidden from a view of the operator; 3) arrows that indicate a suggested path for the operator to follow to perform inspection and/or service of the fire detection and alarm systems; 4) real time event data that is being received by fire alarm control units from fire sensors via a data network; 5) overlay symbols indicating devices that need to be tested and different overlay symbols for devices that have been tested in the past; 6) model number information in overlays adjacent to the fire alarm control unit; and 7) battery state information in overlays adjacent to the smoke detectors.

24. The system as claimed in claim 23

Assignees

• Tyco Fire & Security Gmbh

Inventors

• Piccolo Iii Joseph

Classifications

• G06F3/147 Primary

  using display panels · CPC title

• G08B17/10 Primary

  Actuation by presence of smoke or gases {, e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means} · CPC title

• G06Q10/00

  Administration; Management · CPC title

• G08B13/00

  Burglar, theft or intruder alarms · CPC title

• G09G2340/12

  Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels · CPC title