Lighting and internet of things design using augmented reality

Patent metadata

Field	Value
Publication number	US-11847677-B2
Application number	US-202217878989-A
Country	US
Kind code	B2
Filing date	Aug 2, 2022
Priority date	Dec 20, 2017
Publication date	Dec 19, 2023
Grant date	Dec 19, 2023

Abstract

An augmented reality-based lighting design method includes displaying, by an augmented reality device, a real-time image of a target physical area on a display screen. The method further includes displaying, by the augmented reality device, a lighting fixture 3-D model on the display screen in response to a user input, where the lighting fixture 3-D model is overlaid on the real-time image of the target physical area. The method also includes displaying, by the augmented reality device, a lighting pattern on the display screen overlaid on the real-time image of the target physical area, wherein the lighting pattern is generated based on at least photometric data associated with the lighting fixture 3-D model.

First claim

What is claimed is:

1. An augmented reality-based lighting design method, comprising:
detecting, by an augmented reality device, an existing light fixture installed in an area displayed on a touch sensitive display screen;
determining, by the augmented reality device, one or more surfaces and one or more of physical locations in the area using image or sensor data;
determining, by the augmented reality device, one or more replacement light fixtures based, at least in part, on the one or more determined surfaces, the one or more determined physical locations and at least one performance characteristic of the one or more replacement light fixtures;
displaying, on the touch sensitive display screen of the augmented reality device, at least one lighting fixture model associated with the one or more replacement light fixtures determined;
receiving, via the touch sensitive display screen of the augmented reality device, a user selection of one or more of the light fixture models; and
displaying, on the touch sensitive display screen of the augmented reality device, the user selected one or more lighting fixture models overlaid on a real-time image of the area displayed on the touch sensitive display screen at one or more of the determined physical locations.

2. The method of claim 1 , further comprising:
determining, by the augmented reality device, a recommended number of replacement light fixtures based on the at least one performance characteristic of the replacement light fixtures and the determined surfaces or physical locations detected; and
displaying copies of replacement light fixture models on the touch sensitive display screen, wherein the number of copies displayed corresponds to the determined recommended number.

3. The method of claim 1 , further comprising displaying illuminance values overlaid on the one or more surfaces of the area in the real-time image of the area, wherein one or more of the illuminance values are determined based on at least photometric data associated with the lighting fixture model of the replacement light fixture and spatial relationship between the one or more surfaces and the replacement light fixture model.

4. The method of claim 1 , wherein the selected lighting fixture model of the replacement light fixture is overlaid on the real-time image at a location of the existing light fixture in response to the selection.

5. The method of claim 1 , wherein determining the one or more replacement light fixtures is performed further based on a spatial relationship between the existing light fixture and the one or more surfaces.

6. The method of claim 1 , further comprising:
determining, by the augmented reality device, a second one or more replacement light fixtures; and
displaying, overlaid on the real-time image of the area displayed on the touch sensitive display screen, a second lighting fixture model.

7. The method of claim 6 , further comprising displaying illuminance values overlaid on the one or more surfaces of the area displayed on the touch sensitive display screen, wherein the illuminance values are determined based on combining at least photometric data associated with the lighting fixture model and photometric data associated with the second lighting fixture model, and spatial relationships of the light fixture model and the second light fixture model with the one or more surfaces.

8. The method of claim 1 , further comprising, determining, by the augmented reality device, a type of the existing light fixture based on at least the image data, wherein a type of the replacement light fixture is same as the type of the existing light fixture.

9. The method of claim 1 , further comprising, determining, by the augmented reality device, a type of the existing light fixture based on at least the image data, wherein a type of the replacement light fixture is different than the type of the existing light fixture.

10. The method of claim 1 , further comprising, measuring, by a sensor included on the AR device, an illuminance value observed in the area.

11. The method of claim 1 , further comprising, generating a bill of material that includes an identifier of the replacement light fixture.

12. The method of claim 1 , wherein displaying the user selected replacement light fixture model at one of the determined physical locations is based, at least in part, on the at least one performance characteristics of the one or more replacement light fixtures.

13. An augmented reality (AR) device, comprising:
a camera to capture a real-time image of an area;
a sensor;
a touch sensitive display screen;
a memory device storing a software code; and
a controller configured to execute the software code to:
detect an existing light fixture installed in the area using image data from the camera;
determine one or more surfaces and one or more physical locations in the area using the sensor or the image data from the camera;
determine one or more replacement light fixtures based, at least in part, on the determined one or more surfaces, the one or more determined physical locations and at least one performance characteristic of the one or more replacement light fixtures;
display, overlaid on the real-time image of the area displayed on the touch sensitive display screen, at least one lighting fixture model associated with the one or more replacement light fixtures determined;
receive, via a user interface of the augmented reality device, a user selection of one or more of the light fixture models; and
display the user selected one or more lighting fixture models overlaid on a real-time image of the area displayed on the touch sensitive display screen at one or more of the determined physical locations.

14. The AR device of claim 13 , wherein the controller is further configured to display illuminance values overlaid on the one or more surfaces displayed on the touch sensitive display screen.

15. The AR device of claim 14 , wherein the controller is further configured to determine the one or more of the illuminance values based on at least photometric data associated with the replacement light fixture and spatial relationship between the replacement light fixture and the one or more surfaces.

16. The AR device of claim 13 , wherein the controller is further configured to determine a type of the existing light fixture based on at least the image data from the camera, and wherein a type of the determined one or more replacement light fixtures is same as the type of the existing light fixture.

17. The AR device of claim 13 , wherein the controller is further configured to: display, on the touch sensitive display screen, the user selected replacement light fixture model at a one of the determined physical locations based, at least in part, on the at least one performance characteristics of the one or more replacement light fixtures.

18. The AR device of claim 13 , wherein the controller is further configured to:
determine a recommended number of replacement light fixtures based on the at least one performance characteristic of the replacement light fixtures and the determined surfaces or physical locations detected, and
display copies of replacement light fixture models on the touch sensitive display screen, wherein the number of copies displayed corresponds to the determined recommended number.

19. The AR device of claim 13 , wherein the at least a portion of the memory or software code is remotely located from the AR device and accessible by the controller via wireless communication with the AR device.

Assignees

• Signify Holding Bv

Inventors

• Cho Nam Chin
• Joshi Parth
• Cook William Thomas

Classifications

• H05B47/1985

  Creation of lighting zones or scenes · CPC title

• H05B47/1965

  using handheld communication devices · CPC title

• G06Q30/0621 Primary

  by configuring or customising goods or services · CPC title

• G02B27/017

  Head mounted · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title