Layout workflow with augmented reality and optical prism

Patent metadata

Field	Value
Publication number	US-2022011103-A1
Application number	US-202016924650-A
Country	US
Kind code	A1
Filing date	Jul 9, 2020
Priority date	Jul 9, 2020
Publication date	Jan 13, 2022
Grant date	—

Abstract

An augmented-reality system is combined with a surveying system to make measurement and/or layout at a construction site more efficient. A reflector can be mounted to a wearable device having an augmented-reality system. A total station can be used to track a reflector, and truth can be transferred to the wearable device while an obstruction is between the total station and the reflector. Further, a target can be used to orient a local map of a wearable device to an environment based on a distance between the target and the wearable device.

First claim

What is claimed is:

1 . A system for using augmented reality for building layout, the system comprising:
a surveying pole; a base station; a wearable device comprising a camera; and one or more memory device containing instructions that, when executed, cause one or more processors to perform the following steps:
determining a position of the surveying pole with respect to the base station, wherein a location of the base station is calibrated with respect to an environment;
measuring a location of a first point using the surveying pole based on the position of the surveying pole with respect to the base station;
determining that the surveying pole is out of a line of sight of the base station;
generating a local map based on images acquired by the camera of the wearable device;
determining an offset of the surveying pole with respect to the local map based on images of the surveying pole acquired by the camera, wherein the offset is determined after determining that the surveying pole is out of the line of sight of the base station; and
measuring a location of a second point based on the offset of the surveying pole with respect to the wearable device.

2 . The system of claim 1 , wherein:
the offset is a second offset; the instructions, when executed, further cause the one or more processors to determine a first offset of the surveying pole with respect to the local map based on images of the surveying pole acquired by the camera; the first offset is determined before determining that the surveying pole is out of the line of sight of the base station; and the instructions, when executed, further cause the one or more processors to orient the local map to the environment based on the position of the surveying pole with respect to the base station and the first offset of the surveying pole with respect to the local map.

3 . The system of claim 1 , wherein the instructions, when executed, further cause the one or more processors perform the following steps:
calculating cumulative errors over a duration of time while the surveying pole is out of the line of sight of the base station; determining the cumulative errors have exceeded a threshold value; and indicating to a user of the wearable device that the cumulative errors have exceeded the threshold value.

4 . The system of claim 1 , wherein the instructions, when executed, further cause the one or more processors perform the following steps:
estimating coordinates of the surveying pole with respect to the environment, based on images from the camera while the surveying pole is out of the line of sight of the base station; and sending estimated coordinates of the surveying pole to the base station.

5 . The system of claim 1 , wherein the base station is a robotic total station.

6 . The system of claim 1 , wherein the base station is configured to not move relative to the environment during measurements.

7 . The system of claim 1 , wherein the surveying pole comprises a reflector.

8 . The system of claim 1 , wherein the surveying pole comprises a prism.

9 . A method for using augmented reality for building layout, the method comprising:
determining a position of a surveying pole with respect to a base station, wherein a location of the base station is calibrated with respect to an environment; measuring a location of a first point using the surveying pole based on the position of the surveying pole with respect to the base station; determining that the surveying pole is out of a line of sight of the base station; generating a local map based on images acquired by a camera of a wearable device; calculating an offset of the surveying pole with respect to the local map based on images of the surveying pole acquired by the camera, wherein:
the surveying pole can move independently from the camera of the wearable device; and
the offset is determined after determining that the surveying pole is out of the line of sight of the base station; and
measuring a location of a second point using the surveying pole based on the offset of the surveying pole with respect to the wearable device.

10 . The method of claim 9 , further comprising calibrating the location of the base station with respect to the environment.

11 . The method of claim 9 , wherein:
the offset is a second offset; the method further comprises determining a first offset of the surveying pole with respect to the local map based on images of the surveying pole acquired by the camera; the first offset is determined before determining that the surveying pole is out of the line of sight of the base station; and the method further comprises orienting the local map to the environment based on the position of the surveying pole with respect to the base station and the first offset of the surveying pole with respect to the local map.

12 . The method of claim 9 , further comprising:
calculating cumulative errors over a duration of time while the surveying pole is out of the line of sight of the base station; determining the cumulative errors have exceeded a threshold value; and indicating to a user of the wearable device that the cumulative errors have exceeded the threshold value.

13 . The method of claim 9 , further comprising:
estimating coordinates of the surveying pole with respect to the environment, based on images from the camera while the surveying pole is out of the line of sight of the base station; and sending estimated coordinates of the surveying pole to the base station.

14 . The method of claim 9 , wherein the surveying pole comprises a prism.

15 . The method of claim 9 , wherein:
the camera is one of a plurality of cameras of the wearable device; and images from the plurality of cameras are used to generate the local map and/or determine the offset of the surveying pole with respect to the local map.

16 . The method of claim 9 , further comprising:
identifying a computer-readable code in the environment using one or more images acquired by the camera; and transmit data about the computer-readable code from the wearable device to the base station.

17 . A wearable device comprising:
a frame; a camera coupled with the frame; and one or more memory devices containing instructions that, when executed, cause one or more processors to perform the following steps:
determining that a surveying pole is out of a line of sight of a base station;
generating a local map based on images acquired by the camera;
determining an offset of the surveying pole with respect to the local map based on images of the surveying pole acquired by the camera, wherein the offset is determined after determining that the surveying pole is out of the line of sight of the base station; and
measuring a location of a point based on the offset of the surveying pole with respect to the wearable device.

18 . The wearable device of claim 17 , wherein:
the offset is a second offset; the instructions, when executed, further cause the one or more processors to determine a first offset of the surveying pole with respect to the local map based on images of the surveying pole acquired by the camera; the first offset is determined before determining that the surveying pole is out of the line of sight of the base station; and the instructions, when executed, further cause the one or more processors to orient the local map to an environment based on a position of the surveying pole with respect to the base station and the first offset of the surveying pole with respect to the local

Assignees

• Trimble Inc

Inventors

• Kahle Kent
• Hyland David
• Atkins Benedict Jg
• Jones Eliot
• Howell Marc
• Ostrowski Steven

Classifications

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• G01C15/002 Primary

  Active optical surveying means (optical plumbing G01C15/105) · CPC title

• G01S17/42

  Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46) · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06K7/1413

  1D bar codes · CPC title