Position calibration for intelligent assistant computing device

Patent metadata

Field	Value
Publication number	US-10824921-B2
Application number	US-201715832672-A
Country	US
Kind code	B2
Filing date	Dec 5, 2017
Priority date	Feb 14, 2017
Publication date	Nov 3, 2020
Grant date	Nov 3, 2020

Abstract

A first intelligent assistant computing device configured to receive and respond to natural language inputs provided by human users syncs to a reference clock of a wireless computer network. The first intelligent assistant computing device receives a communication sent by a second intelligent assistant computing device indicating a signal emission time at which the second intelligent assistant computing device emitted a position calibration signal. The first intelligent assistant computing device records a signal detection time at which the position calibration signal was detected. Based on a difference between 1) the signal emission time and the signal detection time, and 2) a known propagation speed of the position calibration signal, a distance between the first and second intelligent assistant computing devices is calculated.

First claim

The invention claimed is:

1. A method, comprising:
at a first intelligent assistant computing device configured to receive and respond to natural language inputs provided by human users, syncing to a reference clock of a wireless computer network, the reference clock being supported by a second intelligent assistant computing device communicatively coupled to the first intelligent assistant computing device via the wireless computer network;
receiving a communication sent by the second intelligent assistant computing device over the wireless computer network, the communication indicating a signal emission time at which the second intelligent assistant computing device emitted a position calibration signal, the signal emission time being defined relative to the reference clock;
recording a signal detection time at which the position calibration signal was detected by the first intelligent assistant computing device, the signal detection time being defined relative to the reference clock; and
based at least on a difference between the signal emission time and the signal detection time and a known propagation speed of the position calibration signal, calculating a distance between the first intelligent assistant computing device and the second intelligent assistant computing device.

2. The method of claim 1 , where the position calibration signal is an emission of sound.

3. The method of claim 2 , where the emission of sound includes a plurality of different frequencies, one or more of the plurality of frequencies being an ultrasonic frequency.

4. The method of claim 2 , further comprising recording an amplitude of the detected position calibration signal, and where calculating the distance further includes comparing the recorded amplitude to a known emission amplitude of the position calibration signal.

5. The method of claim 2 , where the first intelligent assistant computing device detects the emission of sound via a beamforming microphone array, the method further comprises recording a direction from which the emission of sound was detected.

6. The method of claim 2 , where recording the signal detection time includes recording a first signal detection time of a first detection of the emission of sound and a second signal detection time of a second detection of the emission of sound, the second detection of the emission of sound corresponding to a reflection of the emission of sound off a reflection surface in an environment of the first intelligent assistant computing device, the method further comprises calculating a cumulative distance between a) the second intelligent assistant computing device and the reflection surface, and b) the reflection surface and the first intelligent assistant computing device.

7. The method of claim 6 , further comprising calculating a plurality of distances between the first intelligent assistant computing device and a plurality of reflection surfaces in the environment based on a plurality of detections of the emission of sound, and estimating a layout of the environment based on the plurality of distances.

8. The method of claim 1 , further comprising, upon detecting a change in position of the first intelligent assistant computing device, calculating an updated distance between the first and second intelligent assistant computing devices.

9. The method of claim 8 , where the change in position of the first intelligent assistant computing device is detected by one or more motion sensors of the first intelligent assistant computing device, and the updated distance is calculated based on data output by the one or more motion sensors.

10. The method of claim 8 , where the first intelligent assistant computing device includes a camera, detecting the change in position of the first intelligent assistant computing device includes detecting a change in images captured by the camera, and the updated distance is calculated based on the detected change.

11. The method of claim 8 , further comprising, upon detecting the change in position of the first intelligent assistant computing device, instructing the second intelligent assistant computing device to emit a new position calibration signal.

12. The method of claim 1 , further comprising:
detecting a natural language input provided by a human user;
based on the distance between the first and second intelligent assistant computing devices, determining which of the first and second intelligent assistant computing devices is closer to a position of the human user; and
responding to the natural language input via the closer intelligent assistant computing device.

13. A method, comprising:
at a first intelligent assistant computing device, emitting a position calibration signal via a signal emitter, the position calibration signal being an emission of light;
at a second intelligent assistant computing device, via one or more cameras, recording a set of parameters describing a detection of the position calibration signal;
based on the set of parameters describing the detection, estimating relative positions of the first and second intelligent assistant computing devices;
receiving a natural language input from a human user in an environment of the first and second intelligent assistant computing devices;
based on the relative positions of the first and second intelligent assistant computing devices, determining which of the first and second intelligent assistant computing devices is closer to a position of the human user; and
responding to the natural language input via the closer intelligent assistant computing device.

14. The method of claim 13 , where the signal emitter is an infrared (IR) light emitter, and the emission of light is an emission of IR light.

15. The method of claim 13 , where the first intelligent assistant computing device includes a set of signal emitters having a known spatial relationship, emitting the position calibration signal includes emitting a separate instance of the position calibration signal from each of the set of signal emitters and the second intelligent assistant computing device records multiple detections of the position calibration signal corresponding to separate instances of the position calibration signal, the method further comprises, based on comparing a spatial relationship of the multiple detections to the known spatial relationship of the set of signal emitters, calculating an orientation of the first intelligent assistant computing device relative to the second intelligent assistant computing device.

16. The method of claim 15 , where emitting the position calibration signal includes emitting at least one instance of the position calibration signal differently from other instances of the position calibration signal.

17. The method of claim 13 , further comprising recording a set of parameters describing a second detection of the position calibration signal corresponding to a reflection of the position calibration signal off a reflection surface in the environment, the method further comprises, based on the set of parameters describing the second detection, estimating a relative position of the reflection surface.

18. A method, comprising:
at a first intelligent assistant computing device, detecting presence of a human user at a first detection position within a field-of-detection (FOD) of the first intelligent assistant computing device;
localizing the human user to a real-world position relative to an environment of the first intelligent assistant computing device corresponding to the first detection position;
via a wireless computer

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Bathiche Steven Nabil
• Ribeiro Flavio Protasio
• Pradeep Vivek

Classifications

• G06F18/28

  Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries · CPC title

• G06F18/251

  of input or preprocessed data · CPC title

• G06F18/29

  Graphical models, e.g. Bayesian networks · CPC title

• G06F18/41

  Interactive pattern learning with a human teacher · CPC title

• G06N3/044

  Recurrent networks, e.g. Hopfield networks · CPC title