Remote sensor access and queuing

Patent metadata

Field	Value
Publication number	US-9978174-B2
Application number	US-201615393257-A
Country	US
Kind code	B2
Filing date	Dec 29, 2016
Priority date	Aug 25, 2014
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

An application generates instructions to a wearable device to remotely activate a sensor in the wearable device and to receive sensor data from the sensor. A query related to a physical object is received. Instructions to wearable devices are generated to remotely activate at least one sensor of the wearable devices in response to the query. Sensor data is received from at least one of the wearable devices in response to that wearable device being within a range of the physical object.

First claim

What is claimed is:

1. A device comprising:
one or more hardware processors;
a memory storing instructions that, when executed by the one or more hardware processors, configure the device to perform operations comprising:
receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;
identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;
generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;
receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and
building a three-dimensional model of the physical object based on the sensor data.

2. The device of claim 1 , wherein the first wearable device comprises a camera, a depth sensor, an inertial sensor, and a transparent display that displays augmented reality content based on the sensor data.

3. The device of claim 2 , wherein the operations further comprise:
remotely activating the camera, the depth sensor, and the inertial sensor of the first wearable device.

4. The device of claim 1 , wherein the sensor data further comprises a video feed from the first wearable device, depth sensor data from the first wearable device, an orientation of the first wearable device, and a location of the first wearable device.

5. The device of claim 1 , wherein the query further identifies a location of the physical object.

6. The device of claim 1 , wherein the operations further comprise:
generating analytics data processed by a server to provide an information including one of a location of the physical object being detected, a location of the three-dimensional model of the physical object being detected, a location of the physical object being triggered, a location of the three-dimensional model of the physical object being triggered, a duration of the physical object being detected, a duration of the three-dimensional model of the physical object being detected and a combination thereof.

7. The device of claim 1 , wherein the operations further comprise:
determining whether the first wearable device is within the detection range of the physical object based on a distance between the first wearable device and the physical object.

8. The device of claim 7 , wherein the detection range corresponds to a threshold range within where the three-dimensional model of the physical object is built based on the sensor data.

9. The device of claim 1 , wherein the sensor data from the first wearable device is generated at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

10. The device of claim 9 , wherein the rate increases in response to the distance between the first wearable device and the physical object decreasing.

11. A method comprising:
receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;
identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;
generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;
receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and
building a three-dimensional model of the physical object based on the sensor data.

12. The method of claim 11 , wherein the first wearable device comprises a camera, a depth sensor, an inertial sensor, and a transparent display that displays augmented reality content based on the sensor data.

13. The method of claim 12 , further comprising:
remotely activating the camera, the depth sensor, and the inertial sensor of the first wearable device.

14. The method of claim 11 , wherein the sensor data further comprises a video feed from the first wearable device, depth sensor data from the first wearable device, an orientation of the first wearable device, and a location of the first wearable device.

15. The method of claim 11 , wherein the query further identifies a location of the physical object.

16. The method of claim 11 , further comprising:
generating analytics data processed by a server to provide an information including one of a location of the physical object being detected, a location of the three-dimensional model of the physical object being detected, a location of the physical object being triggered, a location of the three-dimensional model of the physical object being triggered, a duration of the physical object being detected, a duration of the three-dimensional model of the physical object being detected and a combination thereof.

17. The method of claim 11 , further comprising:
determining whether the first wearable device is within the detection range of the physical object based on a distance between the first wearable device and the physical object.

18. The method of claim 17 , wherein the detection range corresponds to a threshold range within where the three-dimensional model of the physical object is built based on the sensor data.

19. The method of claim 11 , wherein the sensor data from the first wearable device is generated at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
receiving a query to identify a physical object and a sensor reading from a sensor of the physical object;
identifying a first wearable device from a plurality of wearable devices, the first wearable device being within a detection range of the physical object in response to the query;
generating instructions to the first wearable device to extract the sensor reading from the sensor of the physical object;
receiving sensor data from the first wearable device in response to the instructions, the sensor data comprising the sensor reading; and
building a three-dimensional model of the physical object based on the sensor data.

Assignees

• Daqri Llc

Inventors

• Mullins Brian
• Kammerait Matthew
• Broaddus Christopher

Classifications

• H04Q2209/84

  Measuring functions · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04Q9/00

  Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom · CPC title

• G06T17/00 Primary

  Three-dimensional [3D] modelling for computer graphics · CPC title