Hybrid device location determination system

Patent metadata

Field	Value
Publication number	US-10082584-B2
Application number	US-201213726458-A
Country	US
Kind code	B2
Filing date	Dec 24, 2012
Priority date	Jun 21, 2012
Publication date	Sep 25, 2018
Grant date	Sep 25, 2018

Abstract

Various different techniques are used to determine a location of a device, including 3-dimensional (3D) mapping techniques as well as one or more of Global Navigation Satellite System (GNSS) techniques, wireless signal detection techniques, and inertial sensor techniques. The locations determined by these various techniques are combined to determine the location of the device and/or user of the device. In addition to the location of the device, an orientation or direction of view of the device and/or user of the device can optionally be determined as well.

First claim

What is claimed is:

1. A method of conserving power when determining a location of a device, the method comprising:
generating, at the device using one or more sensors and techniques, a 3D depth map of an environment in which the device is located;
obtaining a first location of the device at a first particular time interval based on the 3D depth map, the first location of the device obtained based on tracking movement of the device within the environment via the one or more sensors and techniques and using a previously determined location within the environment;
obtaining a second location of the device at a second particular time interval based on a wireless signal determined location of the device, an inertial sensor determined location of the device, or a GNSS determined location of the device, the second particular time interval being different than the first particular time interval;
increasing, to conserve power of the device, the first particular time interval at which the first location is obtained in response to the second location being determined with at least a threshold accuracy; and
determining, by the device and based on both the first location and the second location, the location of the device.

2. A method as recited in claim 1 , further comprising determining an orientation of the device at the particular time.

3. A method as recited in claim 1 , the obtaining the first location of the device comprising:
obtaining a known 3D depth map of the environment; and
determining the first location based on both the generated 3D depth map and the known 3D depth map.

4. A method as recited in claim 3 , the obtaining the known 3D depth map comprising obtaining the known 3D depth map from a remote map data store, the known 3D depth map having been generated by an additional device and provided to the remote map data store by the additional device, the additional device having generated the known 3D depth map in determining a location of the additional device.

5. A method as recited in claim 3 , the known 3D depth map having been generated by an operator of the environment.

6. A method as recited in claim 3 , further comprising replacing the known 3D depth map with the generated 3D depth map in response to detecting a change in the environment.

7. A method as recited in claim 1 , the determining comprising:
applying a first weighting to the first location to obtain a weighted first location;
applying a second weighting to the second location to obtain a weighted second location; and
combining the weighted first location and the weighted second location.

8. A method as recited in claim 7 , the first weighting being dependent on an accuracy of the first location, and the second weighting being dependent on an accuracy of the second location.

9. A method as recited in claim 1 , the first location being based at least in part on tracking the device in the environment using the 3D depth map.

10. A method as recited in claim 1 , further comprising providing the location of the device and the 3D depth map of the environment to a remote map data store.

11. A method as recited in claim 1 , the 3D depth map being generated by a 3D depth mapping module using one or more 2D or 3D sensors.

12. A system comprising:
a receiver; and
a processor in communication with the receiver, the processor configured to perform acts as follows:
obtaining a 3D depth mapping determined location of a computing device at a first particular time interval based on a 3D depth map of an environment in which the computing device is located, the 3D depth map of the environment generated at the computing device via one or more sensors and techniques, the 3D depth mapping determined location of the computing device obtained based on tracking movement of the computing device within the environment via the one or more sensors and techniques and using a previously determined location within the environment;
obtaining a wireless signal determined location of the computing device, an inertial sensor determined location of the computing device, or a GNSS determined location of the computing device at a second particular time interval, the second particular time interval being different than the first particular time interval;
conserving power in the system by increasing the first particular time interval at which the 3D depth mapping determined location is obtained in response to the wireless signal determination location, the inertial sensor determined location, or the GNSS determined location being determined with at least a threshold accuracy; and
determining, based on the obtained locations, a location of the computing device.

13. A system as recited in claim 12 , the acts further comprising determining a direction of view of the computing device at the first particular time interval.

14. A system as recited in claim 12 , the obtaining the 3D depth mapping determined location comprising:
obtaining a known 3D depth map of the environment; and
determining the 3D depth mapping determined location based on both the generated 3D depth map and the known 3D depth map.

15. A system recited in claim 14 , the acts further comprising replacing the known 3D depth map with the generated 3D depth map in response to detecting a change in the environment.

16. A system as recited in claim 12 , the determining the location comprising:
applying a first weighting to the 3D depth mapping determined location to obtain a weighted first location;
applying a second weighting to the wireless signal determined location, the inertial sensor determined location, or the GNSS determined location to obtain a weighted second location; and
combining the weighted first location and the weighted second location.

17. A system as recited in claim 16 , the first weighting being dependent on an accuracy of the 3D depth mapping determined location, and the second weighting being dependent on an accuracy of the wireless signal determined location, the inertial sensor determined location, or the GNSS determined location to obtain a second weighted location.

18. A computing device comprising:
one or more processors; and
one or more memories having stored thereon multiple instructions that, when executed by the one or more processors, cause the one or more processors to:
generate, at the computing device using one or more sensors and techniques, a 3D depth map of an environment in which the computing device is located;
obtain a first location of the computing device at a first particular time interval based on the 3D depth map, the first location of the computing device obtained based on tracking movement of the computing device within the environment via the one or more sensors and techniques and using a previously determined location within the environment;
obtain a second location of the computing device at a second particular time interval based on a wireless signal determined location of the device, an inertial sensor determined location of the device, or a GNSS determined location of the device, the second particular time interval being different than the first particular time interval;
increase, to conserve power of the computing device, the first particular time interval at which the first location is obtained in response to the second location being determined with at least a threshold accuracy; and
determine, based on both the first location and the second location, the location of the computing device.

19. A computing device as recited in claim 18 , the instructions causing t

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Hoang Peter S
• Perry Jedd A
• Fleck Rod G

Classifications

• G01S19/49

  whereby the further system is an inertial position system, e.g. loosely-coupled · CPC title

• G01S19/48 Primary

  by combining or switching between position solutions derived from the satellite radio beacon positioning system and position solutions derived from a further system · CPC title

• G01S5/0263

  by combining or switching between positions derived from two or more separate positioning systems · CPC title

• G01S5/0264 Primary

  at least one of the systems being a non-radio wave positioning system · CPC title

• G01S5/019

  Energy consumption · CPC title