Smart-home device placement and installation using augmented-reality visualizations

Patent metadata

Field	Value
Publication number	US-12033288-B2
Application number	US-202318115510-A
Country	US
Kind code	B2
Filing date	Feb 28, 2023
Priority date	Jun 15, 2018
Publication date	Jul 9, 2024
Grant date	Jul 9, 2024

Abstract

A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with the operation or installation of the smart-home device; and displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.

First claim

What is claimed is:

1. A method for optimizing placement of smart-home devices, the method comprising:
capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device, wherein the mobile computing device comprises a display;
rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with operation or installation of the smart-home device; and
displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.

2. The method of claim 1 , wherein the real-world obstruction comprises a stud inside of a wall behind the installation location for the smart-home device.

3. The method of claim 1 , wherein the real-world obstruction comprises a pipe inside of a wall behind the installation location for the smart-home device.

4. The method of claim 1 , wherein the real-world obstruction comprises an electrical wire inside of a wall behind the installation location for the smart-home device.

5. The method of claim 1 , further comprising receiving a location of the real-world obstruction from a scanning device configured to sense solid objects within a wall behind the installation location for the smart-home device, wherein the scanning device records locations of real-world obstructions as the scanning device is moved across the wall.

6. The method of claim 1 , further comprising receiving a location of the real-world obstruction from an architecture plan of an enclosure.

7. The method of claim 1 , further comprising determining a location of the real-world obstruction based on a predetermined spacing between studs in a wall behind the installation location for the smart-home device.

8. A mobile computing device comprising:
one or more processors;
one or more memory devices storing instructions that, when executed by the one or more processors, cause the mobile computing device to perform operations comprising:
capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device, wherein the mobile computing device comprises a display;
rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with the operation or installation of the smart-home device; and
displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.

9. The mobile computing device of claim 8 , wherein the mobile computing device comprises a smart phone.

10. The mobile computing device of claim 8 , wherein the real-world obstruction comprises a plume of air generated from a vent.

11. The mobile computing device of claim 10 , wherein the virtual object comprises an effect object representing turbulent air.

12. The mobile computing device of claim 8 , wherein the operations further comprise:
receiving, by the mobile computing device, a selection by a user of an object in the view of the installation location; and
generating the view of the virtual object in response to the selection by the user, wherein the virtual object is associated with the object in the view of the installation location.

13. The mobile computing device of claim 8 , wherein the view of the installation location comprises a window, and the real-world obstruction comprises sunlight incident on the smart-home device.

14. The mobile computing device of claim 8 , wherein the operations further comprise:
determining a new installation location that avoids the real-world obstruction; and
displaying an indication of the new installation location on the display of the mobile computing device.

15. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device, wherein the mobile computing device comprises a display;
rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with the operation or installation of the smart-home device; and
displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.

16. The non-transitory computer-readable medium of claim 15 , wherein the smart-home device comprises a thermostat.

17. The non-transitory computer-readable medium of claim 15 , wherein the virtual object is rendered as part of a virtual 3-D scene from a perspective of a virtual camera that corresponds to a position of the mobile computing device in the 3-D virtual scene.

18. The non-transitory computer-readable medium of claim 15 , wherein rendering the view of the virtual object comprises clipping a portion of the view of the virtual object based on an object within a field-of-view of the smart-home device.

19. The non-transitory computer-readable medium of claim 15 , wherein the real-world obstruction comprises an obstruction to a field-of-view of the smart-home device.

20. The non-transitory computer-readable medium of claim 19 , wherein the smart-home device comprises a motion sensor, the field-of-view of the smart-home device comprises an area in which the motion sensor can detect motion, and the real-world obstruction comprises an object that blocks the field-of-view of the motion sensor.

Assignees

• Google Llc

Inventors

• Mittleman Adam
• Chamberlain Jason
• Grillo Jacobi
• Biran Daniel
• Kraz Mark
• Chanen Lauren
• Foran Daniel
• Fichou David
• Dong William
• Nguyen Bao-Tram Phan
• Silverstein Brian
• Modi Yash
• Finlayson Alex
• Shin Dongeek

Classifications

• G06T2210/04

  Architectural design, interior design · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title