System and method for using millimeter wave in a wearable device

Patent metadata

Field	Value
Publication number	US-2016248995-A1
Application number	US-201615047818-A
Country	US
Kind code	A1
Filing date	Feb 19, 2016
Priority date	Feb 19, 2015
Publication date	Aug 25, 2016
Grant date	—

Abstract

A head mounted device includes different types of sensors for obtaining sensor data of objects in a physical environment near the head mounted device. The sensors include millimeter wave sensors disposed with the head mounted device that are automatically or manually engageable. The millimeter wave sensors may be automatically engaged based on the location of the head mounted device or when the head mounted device receives sensor data indicating an abnormality. The millimeter wave sensors may further be manually engaged based on an instruction received from a user of the head mounted device via an input device, such as a wearable device, or audio command, such as a command received from a microphone coupled with the head mounted device. The millimeter wave sensors provide millimeter wave sensor data that the head mounted device uses to construct millimeter wave sensor images.

First claim

We claim:

1 . A wearable system for acquiring images using different types of imaging sensors, the system comprising:
a machine-readable memory storing computer-executable instructions; and at least one hardware processor in communication with the machine-readable memory that, when the computer-executable instructions are executed, configures the system to: obtain first sensor data using a first type of imaging sensor; determine whether the first sensor data satisfies at least one conditional context selected from a plurality of conditional contexts, the at least one conditional context comprising a condition that is satisfiable by the first sensor data and an outcome indicating an action the at least one hardware processor is to take; in response to the at least one conditional context being satisfied, engage at least one millimeter wave sensor communicatively coupled to the at least one hardware processor; obtain second sensor data using the at least one millimeter wave sensor; and generate an augmented reality image on a display communicatively coupled to the at least one hardware processor, the augmented reality image comprising a millimeter wave image based on the obtained second sensor data.

2 . The wearable system of claim 1 , wherein the at least one conditional context corresponds to image recognition being performed on the first sensor data.

3 . The wearable system of claim 1 , wherein the at least one conditional context corresponds to temperature analysis being performed on the first sensor data.

4 . The wearable system of claim 1 , wherein the at least one hardware processor further configures the system to:
orient the at least one millimeter wave sensor towards an object corresponding to the first sensor data that satisfied the at least one conditional context.

5 . The wearable system of claim 1 , wherein the at least one hardware processor further configures the system to determine whether a potential threat is present by comparing the second sensor data with organic characteristic data, the organic characteristic data comprising at least one characteristic of an organic object in how it responds to exposure of millimeter wave energy.

6 . The wearable system of claim 1 , wherein the at least one hardware processor further configures the system to determine whether a potential threat is present by comparing the second sensor data with inorganic characteristic data, the inorganic characteristic data comprising at least one characteristic of an inorganic object in how it responds to exposure of millimeter wave energy

7 . The wearable system of claim 6 , wherein the augmented reality image further comprises an identification of the potential threat based on the comparison of the second sensor data with the inorganic characteristic data and a location of the potential threat.

8 . A method for acquiring images using different types of imaging sensors, the method comprising:
obtaining first sensor data using a first type of imaging sensor; determining, by at least one hardware processor, whether the first sensor data satisfies at least one conditional context selected from a plurality of conditional contexts, the at least one conditional context comprising a condition that is satisfiable by the first sensor data and an outcome indicating an action the at least one hardware processor is to take; in response to the at least one conditional context being satisfied, engaging at least one millimeter wave sensor communicatively coupled to the at least one hardware processor; obtaining second sensor data using the at least one millimeter wave sensor; and generating, by at least one hardware processor, an augmented reality image on a display communicatively coupled to the at least one hardware processor, the augmented reality image comprising a millimeter wave image based on the obtained second sensor data.

9 . The method of claim 8 , wherein the at least one conditional context corresponds to image recognition being performed on the first sensor data.

10 . The method of claim 8 , wherein the at least one conditional context corresponds to temperature analysis being performed on the first sensor data.

11 . The method of claim 8 , further comprising:
orienting the at least one millimeter wave sensor towards an object corresponding to the first sensor data that satisfied the at least one conditional context.

12 . The method of claim 8 , further comprising:
determining whether a potential threat is present by comparing the second sensor data with organic characteristic data, the organic characteristic data comprising at least one characteristic of an organic object in how it responds to exposure of millimeter wave energy.

13 . The method of claim 8 , further comprising:
determining whether a potential threat is present by comparing the second sensor data with inorganic characteristic data, the inorganic characteristic data comprising at least one characteristic of an inorganic object in how it responds to exposure of millimeter wave energy

14 . The method of claim 13 , wherein the augmented reality image further comprises an identification of the potential threat based on the comparison of the second sensor data with the inorganic characteristic data and a location of the potential threat.

15 . A machine-readable medium having computer-executable instructions stored thereon that, when executed by at least one hardware processor, causes the at least one hardware processor to configure a system to perform a plurality of operations, the plurality of operations comprising:
obtaining first sensor data using a first type of imaging sensor; determining, by at least one hardware processor, whether the first sensor data satisfies at least one conditional context selected from a plurality of conditional contexts, the at least one conditional context comprising a condition that is satisfiable by the first sensor data and an outcome indicating an action the at least one hardware processor is to take; in response to the at least one conditional context being satisfied, engaging at least one millimeter wave sensor communicatively coupled to the at least one hardware processor; obtaining second sensor data using the at least one millimeter wave sensor; and generating, by at least one hardware processor, an augmented reality image on a display communicatively coupled to the at least one hardware processor, the augmented reality image comprising a millimeter wave image based on the obtained second sensor data.

16 . The machine-readable medium of claim 15 , wherein the at least one conditional context corresponds to image recognition being performed on the first sensor data.

17 . The machine-readable medium of claim 15 , wherein the at least one conditional context corresponds to temperature analysis being performed on the first sensor data.

18 . The machine-readable medium of claim 15 , wherein the plurality of operations further comprise:
orienting the at least one millimeter wave sensor towards an object corresponding to the first sensor data that satisfied the at least one conditional context.

19 . The machine-readable medium of claim 15 , wherein the plurality of operations further comprise:
determining whether a potential threat is present by comparing the second sensor data with inorganic characteristic data, the inorganic characteristic data comprising at least one characteristic of an inorganic object in how it responds to exposure of millimeter wave energy

20 . Th

Assignees

• Daqri Llc

Inventors

• Mullins Brian
• Kammerait Matthew

Classifications

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• H04N23/13

  with multiple sensors · CPC title

• G06K9/00671

  Physics · mapped topic

• H04N5/332 Primary

  Electricity · mapped topic

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title