Augmented reality sensor

Patent metadata

Field	Value
Publication number	US-10733799-B2
Application number	US-201715660642-A
Country	US
Kind code	B2
Filing date	Jul 26, 2017
Priority date	Jul 26, 2017
Publication date	Aug 4, 2020
Grant date	Aug 4, 2020

Abstract

An augmented-reality (AR) device comprises a physical sensor and a display. The AR device identifies, using the physical sensor, a location and orientation of the AR device within a physical environment. A selection of a type of a virtual sensor and a placement location of the virtual sensor within the physical environment is received at the AR device. The placement location of the virtual sensor is determined relative to the location and orientation of the AR device within the physical environment. The AR device provides the type of the virtual sensor and the placement location of the virtual sensor to a server that generates virtual content for the virtual sensor. The AR device displays the virtual content at the placement location of the virtual sensor in the display.

First claim

What is claimed is:

1. An augmented-reality (AR) device comprising:
one or more hardware processors; and
a memory storing an AR application that, when executed by the one or more hardware processors, causes the AR device to perform operations comprising:
receiving a first input selecting a first type of physical sensor to be presented as a virtual sensor, the first type of physical sensor having been selected from a plurality of types of physical sensors and being configured to present a first type of sensor data, wherein a second type of physical sensor from the plurality of types of physical sensors is configured to present a second type of sensor data that is different than the first type of sensor data;
receiving a second input selecting a first physical sensor as a data source for the virtual sensor, the first physical sensor being located at a first geographic location within a physical environment and configured to capture the first type of sensor data;
receiving a third input selecting a placement location of the virtual sensor, the placement location being a second geographic location within the physical environment that is different than the first geographic location;
transmitting a request to a remote server to generate virtual content based on the first type of physical sensor to be presented as the virtual sensor, the data source for the virtual sensor, and the placement location of the virtual sensor;
after transmitting the request to the remote server, monitoring a current geographic location of the AR device in relation to the second geographic location that was selected as the placement location of the virtual sensor;
in response to determining that the current geographic location of the AR device is within a threshold distance of the second geographic location, transmitting a notification to the remote server to provide the virtual content for the virtual sensor;
receiving, the virtual content from the remote server, the remote server having generated the virtual content based on sensor data gathered from the first physical sensor selected as the data source; and
presenting the virtual content on a transparent display of the AR device, the virtual content being a virtual representation of a physical sensor of the first type, a position at which the virtual content is presented on the transparent display being based on the placement location of the virtual sensor such that the virtual representation of the physical sensor appears to be located at the second geographic location in the physical environment to a user viewing the second geographic location through the transparent display, wherein the virtual representation of the physical sensor displays an output representing the sensor data gathered from the first physical sensor located at the first geographic location in the physical environment.

2. The AR device of claim 1 , the operations further comprising:
receiving updated virtual content from the remote server, the updated virtual content generated by the remote server based on updated sensor data gathered from the first physical sensor selected as the data source; and
presenting the updated virtual content on a transparent display of the AR device.

3. The AR device of claim 1 , the operations further comprising:
receiving a third input selecting a second physical sensor as a second data source for the virtual sensor, the second physical sensor being located at a third geographic location within the physical environment, wherein the virtual content generated by the remote server is generated based on the sensor data gathered from the first physical sensor and sensor data gathered form the second physical sensor.

4. The AR device of claim 1 , the operations further comprising:
receiving, from the remote server, second virtual content related to a second virtual sensor, the second virtual content generated by remote server based on the second type of physical sensor, a second data source, and a second placement location provided to the remote server by a second AR device.

5. The AR device of claim 4 , the operation further comprising:
presenting the second virtual content on the transparent display of the AR device, the second virtual content being a virtual representation of a physical sensor of the second type, a position at which the second virtual content is presented on the transparent display being based on the second placement location of the second virtual sensor such that the virtual representation of the physical sensor of the second type appears to be located at a third geographic location in the physical environment to the user viewing the third geographic location through the transparent display.

6. The AR device of claim 1 , wherein the first type of physical sensor is a thermometer, the first type of sensor data is temperature data, and the virtual representation of the physical sensor is a virtual representation of the thermometer presenting temperature data.

7. The AR device of claim 6 , wherein the first physical sensor is first thermometer physically located at the second geographic location.

8. A method comprising:
receiving, by an augmented-reality (AR) device, a first input selecting a first type of physical sensor to be presented as a virtual sensor, the first type of physical sensor having been selected from a plurality of types of physical sensors and being configured to present a first type of sensor data, wherein a second type of physical sensor from the plurality of types of physical sensors is configured to present a second type of sensor data that is different than the first type of sensor data;
receiving a second input selecting a first physical sensor as a data source for the virtual sensor, the first physical sensor being located at a first geographic location within a physical environment and configured to capture the first type of sensor data;
receiving a third input selecting a placement location of the virtual sensor, the placement location being a second geographic location within the physical environment that is different than the first geographic location;
transmitting a request to a remote server to generate virtual content based on the first type of physical sensor to be presented as the virtual sensor, the data source for the virtual sensor, and the placement location of the virtual sensor;
after transmitting the request to the remote server, monitoring a current geographic location of the AR device in relation to the second geographic location that was selected as the placement location of the virtual sensor;
in response to determining that the current geographic location of the AR device is within a threshold distance of the second geographic location, transmitting a notification to the remote server to provide the virtual content for the virtual sensor;
receiving, the virtual content from the remote server, the remote server having generated the virtual content based on sensor data gathered from the first physical sensor selected as the data source; and
presenting the virtual content on a transparent display of the AR device, the virtual content being a virtual representation of a physical sensor of the first type, a position at which the virtual content is presented on the transparent display being based on the placement location of the virtual sensor such that the virtual representation of the physical sensor appears to be located at the second geographic location in the physical environment to a user viewing the second geographic location through the transparent display, wherein the virtual representation of the physical sensor displays an output representing the sensor data gathered from the first physical sensor located at the first geographic location in the physical en

Assignees

• Daqri Llc

Inventors

• Kazansky Lucas

Classifications

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• H04L67/52

  specially adapted for the location of the user terminal · CPC title

• H04L67/01

  Protocols · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F16/252

  between a Database Management System and a front-end application · CPC title