Methods of presenting as built data relative to an agent position in an augmented virtual model

Patent metadata

Field	Value
Publication number	US-12032875-B2
Application number	US-202318123727-A
Country	US
Kind code	B2
Filing date	Mar 20, 2023
Priority date	Feb 22, 2017
Publication date	Jul 9, 2024
Grant date	Jul 9, 2024

Abstract

Methods for presenting an augmented virtual model of a physical building. A headgear on an Agent is used to scan a physical building and capture aspects of the building at respective locations. The aspects are stored a As Built Data. A portion of the As Built Data is associated with a location in the physical building. A user interface includes a representation of an agent position and presents the portion of the As Built Data in a position relative to the agent location.

First claim

What is claimed is:

1. A method for presenting an augmented virtual model of a physical building, the method comprising the steps of:
a) supporting a headgear worn on a head of an agent, the headgear comprising a scanning device;
b) with the scanning device, scanning a physical building site to capture respective locations of aspects of the physical building site as image data thereby creating As Built Data while the headgear is supported on the head of the agent;
c) associating a portion of the As Built Data with an As Built Data location in the physical building;
d) generating the augmented virtual model in parallel to the physical building, the augmented virtual model comprising the As Built data representative of aspects of the physical building;
e) generating a user interface, in the headgear, comprising a human readable representation of a location of the agent wearing the headgear within the augmented virtual model;
f) presenting in the user interface a relative position of the portion of the As Built Data relative to the human readable representation of the location of the agent wearing the headgear within the augmented virtual model, wherein the relative position representing a directional indication from the human readable representation of the location of the agent wearing the headgear to the portion of the As Built Data;
g) comparing the As Built Data with a database or a technical library; and
h) presenting in the user interface, based on the comparison in step g, at least one of: an additional information and a predictive information related to the portion of the As Built Data.

2. The method of claim 1 , wherein the augmented virtual model comprises a two-dimensional representation of the physical building.

3. The method of claim 1 , wherein the augmented virtual model comprises a three-dimensional representation of the physical building.

4. The method of claim 2 , additionally comprising the step of making a technical library specific to the As built Data location accessible via the user interface comprising the human readable representation of the location within the augmented virtual model, the technical library comprising information specific to the physical building and the As Built Data location within the physical building.

5. The method of claim 4 , additionally comprising including in the technical library an equipment manual or machinery manual.

6. The method of claim 4 , additionally comprising including in the technical library a part to be ordered.

7. The method of claim 4 , additionally comprising including in the technical library a virtual demonstration of a part ordered in use.

8. The method of claim 4 , additionally comprising including in the technical library a virtual demonstration of procedures for replacing a part of a machine.

9. The method of claim 2 , additionally comprising linking a unique identifier to a location in the augmented virtual model and linking the As Built Data with date and time designation.

10. The method of claim 9 , additionally comprising the step of providing onsite guidance during a service call.

11. The method of claim 9 , additionally comprising the step of providing access to remote experts that guide onsite technicians.

12. The method of claim 9 , additionally comprising the step of providing a correct consumable for a machine included in the As Built Data.

13. The method of claim 9 , additionally comprising the step of providing a replacement part for a machine included in the As Built Data.

14. The method of claim 9 , wherein the user interface is presented on a virtual reality environment via a virtual reality headset.

15. The method of claim 9 , wherein the user interface is presented on a virtual reality environment of a tablet device.

16. The method of claim 9 , wherein the As Built Data comprises a structural component including one or more of a: beams, headers, doorways, windows, and rafter.

17. The method of claim 9 , wherein the As Built Data comprises a structural component including heating ventilation air conditioning components.

18. The method of claim 9 , wherein the As Built Data comprises a structural component including plumbing.

19. The method of claim 9 , wherein the As Built Data comprises a structural component including electrical aspects.

Assignees

• Middle Chart Llc

Inventors

• Duff Jason E
• Santarone Michael S
• Wodrich Michael A
• Pugh Randall

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T7/00

  Image analysis · CPC title

• G06T2210/04

  Architectural design, interior design · CPC title

• G06Q10/06 Primary

  Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling · CPC title

• G02B27/017

  Head mounted · CPC title