Light fixture commissioning using depth sensing device

Patent metadata

Field	Value
Publication number	US-10371504-B2
Application number	US-201715720633-A
Country	US
Kind code	B2
Filing date	Sep 29, 2017
Priority date	Sep 29, 2017
Publication date	Aug 6, 2019
Grant date	Aug 6, 2019

Abstract

A system includes a depth sensing device that includes a depth sensor. The depth sensor includes an infrared projector and an infrared camera. The system includes a processor coupled to the depth sensor and a memory accessible to the processor, and programming in the memory. Execution of the programming by the processor configures the system to perform functions, including functions to project, via the infrared projector, a pattern of infrared light on a plurality of objects located in a space that are reached by the projected infrared light. The plurality of objects includes objects of interest and light fixtures in the space. The execution of the programming by the processor further configures the system to determine light fixture location coordinates for each of the light fixtures based on computed distances between the objects of interest and each of the light fixtures based on distortions of the projected infrared light.

First claim

What is claimed is:

1. A system comprising:
a depth sensing device comprising a depth sensor, wherein the depth sensor includes:
an infrared projector; and
an infrared camera;

a processor coupled to the depth sensor;
a memory accessible to the processor; and
programming in the memory, wherein execution of the programming by the processor configures the system to perform functions, including functions to:
project, via the infrared projector, a pattern of infrared light on a plurality of objects located in a space that are reached by the projected infrared light, the plurality of objects including objects of interest and light fixtures in the space;
capture, via the infrared camera, distortions of the pattern in the projected infrared light on the plurality of objects;
uniquely identify each of the light fixtures in the space;
compute distance between the objects of interest and each of the uniquely identified light fixtures in the space based on the distortions, wherein the function to compute distance includes:
measuring distance between a first light fixture and a first known object of interest in the space for which location coordinates are known based on a distortion pattern on the first light fixture and the first known object of interest relative to the depth sensing device;

determine light fixture location coordinates for each of the light fixtures based on the computed distances between the objects of interest and each of the light fixtures, wherein the function to determine light fixture location coordinates includes:
correlating the light fixture location coordinates of the first light fixture based on the known location coordinates of the first known object of interest and the measured distance between the first light fixture and the first known object of interest; and

build a map of the space that includes the determined light fixture location coordinates for each of the light fixtures.

2. The system, of claim 1 , wherein execution of the programming by the processor further configures the system to uniquely identify each of the light fixtures in the space simultaneously with the infrared light being projected or captured.

3. The system of claim 2 , wherein:
the function to uniquely identify each of the plurality of light fixtures in the space includes:
capturing, via the infrared camera, infrared light reflected off of each of the plurality of light fixtures; and
decoding the reflected infrared light of each respective one of the light fixtures into a respective quick response (QR) code that uniquely identifies the respective light fixture.

4. The system of claim 1 , wherein:
the distortions of the pattern in the projected infrared light are captured by the infrared camera in a first field of view;
the depth sensing device further comprises: a second camera to capture one or more images including modulated visible light from at least one of the light fixtures in a second field of view;
the processor is coupled to the second camera; and
the function to uniquely identify each of the light fixtures in the space includes: demodulating the modulated visible light in the second field of view from the captured one or more images to identify a respective visible light communication (VLC) identifier of each of the light fixtures.

5. The system of claim 4 , wherein the depth sensor and the second camera are operated simultaneously to allow the projecting and capturing of the infrared light to occur at a same time as unique identification of light fixtures.

6. The system of claim 1 , wherein:
the depth sensing device further comprises: a network communication interface configured for wireless communication with the light fixtures over a wireless lighting commissioning network; and
the function to uniquely identify each of the light fixtures in the space includes: receiving, via the wireless communication interface, a respective light fixture identifier to uniquely identify a respective light fixture.

7. The system of claim 6 , wherein the respective light fixture identifier to uniquely identify the respective light fixture is received simultaneously with the infrared light being projected or captured.

8. The system of claim 1 , wherein:
the depth sensing device further comprises:
a touch screen located on a front-facing side of the depth sensing device; and
at least one of a red, green, and blue (RGB) camera or a black and white (BW) camera; and

the infrared projector and the infrared camera of the depth sensor are rear-facing relative to the touch screen located on the front-facing side of the depth sensing device.

9. The system of claim 8 : wherein:
the depth sensing device further comprises a second depth sensor including a second infrared projector and a second infrared camera; and
the second infrared projector and the second infrared camera are front-facing.

10. The system of claim 9 , wherein measuring distance between the first light fixture and the first known object of interest includes:
measuring an object of interest distance between the depth sensing device and the first known object of interest in the space for which location coordinates are known based on a first distortion pattern on the first object of interest captured by the rear-facing infrared camera of the depth sensor; and
measuring a light fixture distance between the first light fixture and the depth sensing device based on a second distortion pattern on the first light fixture captured by the front-facing infrared camera of the second depth sensor.

11. The system of claim 10 , wherein:
the function to determine light fixture location coordinates for each of the light fixtures includes: correlating the light fixture location coordinates of the first light fixture based on the known coordinates of the first known object of interest, the light fixture distance, and the object of interest distance.

12. The system of claim 1 , wherein:
the depth sensing device further comprises an accelerometer;
the processor is coupled to the accelerometer;
the execution of the programming by the processor configures the system to perform further functions to:
identify a known object of interest for which location coordinates are known; and
in response to identifying the known object of interest for which location coordinates are known, track, via an accelerometer, an object of interest distance between the known object of interest and a first light fixture; and

the function to determine light fixture location coordinates for each of the light fixtures includes: determining the light fixture location coordinates of the first light fixture further based on the known object of interest distance.

13. The system of claim 1 , wherein:
the depth sensing device further comprises an accelerometer;
the processor is coupled to the accelerometer;
the execution of the programming by the processor configures the system to perform further functions to:
in response to uniquely identifying each light fixture in the space, repeat the functions to project, capture, and compute distance; and
track, via an accelerometer, a discovery distance between where a new light fixture is uniquely identified in the space and where a prior light fixture is uniquely identified in the space; and

the function to determine light fixture location coordinates for each of the light fixtures includes: determining the light fixture location coordinates further based on the discovery distance.

14. The system of claim 1 , wherein:
the function to computing distance between the objects of interest and each of the light fixtures in the space based on

Assignees

• Abl Ip Holding Llc

Inventors

• White Sean P
• Megginson Daniel M
• Kastee Jenish S
• Ramer David P

Classifications

• G01B11/26

  for measuring angles or tapers; for testing the alignment of axes · CPC title

• H04N5/33

  Transforming infrared radiation (cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20) · CPC title

• G01B11/14 Primary

  for measuring distance or clearance between spaced objects or spaced apertures (G01B11/26 takes precedence; rangefinders G01C3/00) · CPC title

• G06T7/00

  Image analysis · CPC title

• G01P15/00

  Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration · CPC title