Image-based occupancy detector

Patent metadata

Field	Value
Publication number	US-11657637-B2
Application number	US-202117542921-A
Country	US
Kind code	B2
Filing date	Dec 6, 2021
Priority date	Aug 22, 2018
Publication date	May 23, 2023
Grant date	May 23, 2023

Abstract

An image sensor includes an active pixel array including a number of pixels and image sensor control circuitry configured to perform a read operation only on a subset of the pixels of the active pixel array such that pixels not in the subset remain inactive. By reading out only the subset of pixels in the active pixel array and keeping the remaining pixels inactive, the temperature of the active pixel array may be reduced compared to a conventional read out process, thereby reducing thermal noise in the resulting pixel data.

First claim

What is claimed is:

1. An intelligent lighting module, comprising:
an image sensor comprising:
an active pixel array comprising a plurality of pixels; and
image sensor control circuitry configured to:
operate in a first mode of operation wherein the image sensor control circuitry is configured to perform read operations only on a subset of the plurality of pixels such that the plurality of pixels that are not in the subset of the plurality of pixels remain inactive; and
operate in a second mode of operation wherein the image sensor control circuitry is configured to perform a read operation on all of the plurality of pixels; and

control circuitry configured to:
when the image senor control circuitry operates in the first mode of operation, obtain pixel data for the subset of the plurality of pixels from the image sensor;
analyze the pixel data to classify an object detected by the image sensor as an occupant or a non-occupant; and
in response to classifying the object as an occupant, cause the image sensor control circuitry to operate in the second mode of operation.

2. The intelligent lighting module of claim 1 wherein the subset of the plurality of pixels comprises a first region of interest and a second region of interest that is noncontiguous with the first region of interest.

3. The intelligent lighting module of claim 1 wherein the control circuitry is further configured to analyze the pixel data to track the object within an environment captured by the image sensor.

4. The intelligent lighting module of claim 3 wherein the control circuitry is further configured to communicate with a neighboring intelligent lighting module in response to classifying the object as the occupant.

5. The intelligent lighting module of claim 4 wherein the control circuitry is further configured to handoff tracking to the neighboring intelligent lighting module in response to determining the occupant has entered a field of view of the neighboring intelligent lighting module.

6. The intelligent lighting module of claim 1 wherein the subset of the plurality of pixels is defined by a rectangular area along one or more outside edges of the active pixel array.

7. The intelligent lighting module of claim 6 wherein the subset of the plurality of pixels forms a frame around the one or more outside edges of the active pixel array such that the plurality of pixels that are not in the subset of the plurality of pixels form a rectangle that is inset within the subset of the plurality of pixels.

8. The intelligent lighting module of claim 1 wherein each one of the plurality of pixels comprises:
a light detecting element configured to transform light into an analog signal; and
supporting circuitry configured to:
during a read operation, process the analog signal from the light detecting element to provide a processed analog signal and provide the processed analog signal to downstream circuitry in the image sensor; and
remain inactive when a read operation is not occurring.

9. The intelligent lighting module of claim 1 wherein each one of the plurality of pixels generates more heat during a read operation than when a read operation is not occurring.

10. The intelligent lighting module of claim 1 wherein each one of the plurality of pixels consumes more power during a read operation than when a read operation is not occurring.

11. The intelligent lighting module of claim 1 wherein noise within the subset of the plurality of pixels is lower in the first mode of operation than in the second mode of operation.

12. The intelligent lighting module of claim 1 wherein the image sensor control circuitry is configured to capture and store pixel data from the subset of the plurality of pixels in a sparse data structure such that only the pixel data from the subset of the plurality of pixels is included in the sparse data structure.

13. The intelligent lighting module of claim 12 wherein the image sensor control circuitry is configured to facilitate a transfer of the sparse data structure to a remote device.

14. The intelligent lighting module of claim 1 wherein the image sensor control circuitry is further configured to:
in the first mode of operation, analyze the pixel data to determine if a person has entered a field of view of the image sensor; and
transition to the second mode of operation when the person has entered the field of view of the image sensor.

15. A method for detecting occupancy, the method comprising:
obtaining pixel data from an image sensor by performing read operations only on a subset of pixels in an active pixel array of the image sensor such that pixels in the active pixel array that are not in the subset of pixels remain inactive; and
analyzing the pixel data to classify an object detected by the image sensor as an occupant or a non-occupant; and
in response to classifying the object as an occupant, obtaining additional pixel data from the image sensor by performing a read operation on all pixels in the active pixel array of the image sensor.

16. The method of claim 15 further comprising analyzing the additional pixel data to verify that an area within a field of view of the image sensor is occupied.

17. The method of claim 15 further comprising analyzing the additional pixel data to determine if an area within a field of view of the image sensor remains occupied.

18. The method of claim 15 wherein:
each one of the pixels generates more heat during a read operation than when a read operation is not occurring; and
each one of the pixels consumes more power during a read operation than when a read operation is not occurring.

19. The method of claim 15 wherein the subset of pixels in the active pixel array forms a frame around one or more outside edges of the active pixel array such that the pixels in the active pixel array that are not in the subset of pixels form a rectangle that is inset within the subset of pixels.

20. The method of claim 15 wherein:
a field of view of the image sensor includes one of an ingress point and an egress point to a space in which the image sensor is located; and
the subset of pixels is located in the active pixel array such that a person entering or leaving the space via one of the ingress point and egress point will be detected by the subset of pixels.

Assignees

• Ideal Ind Lighting Llc

Inventors

• Roberts John
• Bessems Ronald W
• Bowser Robert

Classifications

• H04N25/75

  Circuitry for providing, modifying or processing image signals from the pixel array · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N25/40

  Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled · CPC title

• H04N25/00

  Circuitry of solid-state image sensors [SSIS]; Control thereof · CPC title

• H04N25/707

  Pixels for event detection · CPC title