Remote sensor access and queuing

Patent metadata

Field	Value
Publication number	US-9578399-B2
Application number	US-201414467700-A
Country	US
Kind code	B2
Filing date	Aug 25, 2014
Priority date	Aug 25, 2014
Publication date	Feb 21, 2017
Grant date	Feb 21, 2017

Abstract

An application generates instructions to a wearable device to remotely activate a sensor in the wearable device and to receive sensor data from the sensor. A query related to a physical object is received. Instructions to wearable devices are generated to remotely activate at least one sensor of the wearable devices in response to the query. Sensor data is received from at least one of the wearable devices in response to that wearable device being within a range of the physical object.

First claim

What is claimed is:

1. A server comprising:
a hardware processor comprising a remote sensor application, the remote sensor application comprising:
a queuing module configured to receive a query to identify a physical object, a location of the physical object, a three-dimensional model of the physical object, and a sensor reading from a sensor of the physical object, to generate instructions to a plurality of wearable devices to remotely activate at least one sensor of the plurality of wearable devices in response to the query, and to receive sensor data from at least one of the plurality of wearable devices in response to the at least one of the plurality of wearable devices being within a range of the physical object;
an object recognition module configured to build the three-dimensional model of the physical object based on the sensor data; and
a data extraction module configured to optically extract the sensor reading of the sensor of the physical object in response to the query.

2. The server of claim 1 , wherein the at least one wearable device comprises a helmet comprising at least one camera, at least one depth sensor, at least one inertial sensor, and a visor comprising a transparent display that displays augmented reality content based on the sensor data.

3. The server of claim 2 , wherein the remote access module is further configured to remotely activate at least one of the camera, depth sensor, and inertial sensor of the at least one wearable device.

4. The server of claim 1 , wherein the sensor data comprise a video feed from a corresponding wearable device, depth sensor data from the corresponding wearable device, an orientation of the corresponding wearable device, and a location of the corresponding wearable device.

5. The server of claim 1 , wherein the queuing module is configured to determine whether at least one of the wearable devices is within the range of the physical object based on at least one of the identification of the physical object and the location of the physical object.

6. The server of claim 5 , wherein the range corresponds to a threshold sensor range within which a three-dimensional model of the physical object is built based on the sensor data.

7. The server of claim 1 , wherein the at least one sensor is configured to generate sensor data at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

8. The server of claim 1 , wherein the hardware processor further comprises:
a remote access module configured to generate instructions to remotely activate at least one sensor of at least one wearable device and to receive sensor data from the at least one sensor of the at least one wearable device.

9. A method comprising:
receiving a query to identify a physical object, a location of the physical object, a three-dimensional model of the physical object, and a sensor reading from a sensor of the physical object;
generating, implemented by a hardware processor, instructions to the plurality of wearable devices to remotely activate at least one sensor of the plurality of wearable devices in response to the query;
receiving sensor data from at least one of the plurality of wearable devices in response to the at least one of the plurality of the wearable devices being within a range of the physical object;
building the three-dimensional model of the physical object based on the sensor data; and
optically extracting the sensor reading of the sensor of the physical object in response to the query.

10. The method of claim 9 , wherein the at least one wearable device comprises a helmet comprising at least one camera, at least one depth sensor, at least one inertial sensor, and a visor comprising a transparent display that displays augmented reality content based on the sensor data.

11. The method of claim 10 , further comprising:
remotely activating at least one of the camera, depth sensor, and inertial sensor of the at least one wearable device.

12. The method of claim 9 , wherein the sensor data comprise a video feed from a corresponding wearable device, depth sensor data from the corresponding wearable device, an orientation of the corresponding wearable device, and a location of the corresponding wearable device.

13. The method of claim 9 , further comprising:
determining whether at least one of the wearable devices is within the range of the physical object based on at least one of the identification of the physical object and the location of the physical object.

14. The method of claim 13 , wherein the range corresponds to a threshold sensor range within which a three-dimensional model of the physical object is built based on the sensor data.

15. The method of claim 9 ,
wherein the at least one sensor is configured to generate sensor data at a rate that is based on at least the relative distance between the plurality of wearable devices or the distances between each of the wearable devices and the physical object.

16. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
receiving a query to identify a physical object, a location of the physical object, a three-dimensional model of the physical object, and a sensor reading from a sensor of the physical object;
generating instructions to the plurality of wearable devices to remotely activate at least one sensor of the plurality of wearable devices in response to the query;
receiving sensor data from at least one of the plurality of wearable devices in response to the at least one of the plurality of the wearable devices being within a range of the physical object;
building the three-dimensional model of the physical object based on the sensor data; and
optically extracting the sensor reading of the sensor of the physical object in response to the query.

Assignees

• Daqri Llc

Inventors

• Mullins Brian
• Kammerait Matthew
• Broaddus Christopher

Classifications

• H04Q2209/47

  using RFID associated with sensors · CPC title

• G02B27/017 Primary

  Head mounted · CPC title

• G08C17/00

  Arrangements for transmitting signals characterised by the use of a wireless electrical link · CPC title

• H04Q9/00 Primary

  Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title