More efficient automatic door sensing

Patent metadata

Field	Value
Publication number	US-12159415-B2
Application number	US-202217650460-A
Country	US
Kind code	B2
Filing date	Feb 9, 2022
Priority date	Feb 9, 2022
Publication date	Dec 3, 2024
Grant date	Dec 3, 2024

Abstract

In some implementations, a processing device may receive, from an optical sensor, a plurality of frames encoding images of an environment of a door. The processing device may estimate, using the plurality of frames, a direction and a speed associated with at least one person included in the plurality of frames. Accordingly, the processing device may transmit a command to a controller associated with the door based on the direction and the speed.

First claim

What is claimed is:

1. A system for automatic door sensing, the system comprising:
one or more memories; and
one or more processors, communicatively coupled to the one or more memories, configured to:
receive, from an optical sensor, a plurality of frames encoding images of an environment of a door;
classify the plurality of frames as including at least one person;
estimate, using the plurality of frames, a direction and a speed associated with the at least one person;
identify a first orientation associated with the at least one person in at least one first frame of the plurality of frames;
identify at least one article of clothing associated with the at least one person in at least one of the plurality of frames; and
transmit a command to a controller associated with the door based on the direction, the speed, the first orientation and the at least one article of clothing,
wherein the one or more processors, when transmitting the command, are to:
transmit a command to open the door based on the at least one article of clothing satisfying a type of clothing, or
transmit a command to keep the door closed based on the at least one article of clothing not satisfying a type of clothing.

2. The system of claim 1 , wherein the one or more processors are further configured to:
identify a change from the first orientation in the at least one first frame to a second orientation in at least one second frame of the plurality of frames,
wherein the command is based on the change from the first orientation to the second orientation.

3. The system of claim 1 , wherein the one or more processors are further configured to:
discard the plurality of frames after transmitting the command.

4. The system of claim 1 , wherein the one or more processors are further configured to:
receive input associated with a time period; and
transmit a command to disable the optical sensor during the time period.

5. The system of claim 4 , wherein the one or more processors are further configured to:
transmit a command, to the controller associated with the door, to maintain the door in a closed position during the time period.

6. The system of claim 1 , wherein the one or more processors are further configured to:
estimate a distance from the at least one person to the door,
wherein the command is based on whether the distance satisfies a threshold.

7. The system of claim 6 , wherein the threshold is selected, from a plurality of thresholds, based on the speed.

8. The system of claim 1 , wherein the one or more processors are further configured to:
receive, from the optical sensor, an additional plurality of frames encoding images of the environment of the door; and
discard the additional plurality of frames based on classifying the additional plurality of frames as not including any persons.

9. A method of automatic door sensing, comprising:
receiving, from an optical sensor, a plurality of frames encoding images of an environment of a door;
estimating, using the plurality of frames, a direction and a speed associated with at least one person included in the plurality of frames;
identify at least one article of clothing associated with the at least one person in at least one of the plurality of frames; and

transmitting a command to a controller associated with the door based on the direction, the speed, and the at least one article of clothing,
wherein transmitting the command comprises:
transmitting a command to open the door based on the at least one article of clothing satisfying a clothing threshold, or
transmitting a command to keep the door closed based on the at least one article of clothing not satisfying a clothing threshold.

10. The method of claim 9 , wherein estimating the direction and the speed comprises:
applying a classifier to the plurality of frames to detect a portion of the plurality of frames including at least one person; and
applying a motion model to the portion of the plurality of frames to estimate the direction and the speed.

11. The method of claim 9 , wherein transmitting the command to open the door further comprises:
transmitting the command to open the door based on the direction satisfying a direction threshold and the speed satisfying a speed threshold.

12. The method of claim 9 , wherein the environment of the door includes an exterior volume associated with people entering a structure through the door and an interior volume associated with people exiting the structure through the door.

13. The method of claim 9 , further comprising:
receiving input associated with maintaining the door in an open position; and
transmitting a command to disable the optical sensor based on the input.

14. The method of claim 13 , further comprising:
transmitting a command, to the controller associated with the door, to maintain the door in the open position based on the input.

15. A non-transitory computer-readable medium storing a set of instructions for automatic door sensing, the set of instructions comprising:
one or more instructions that, when executed by one or more processors of a device, cause the device to:
receive, from an optical sensor, a plurality of frames encoding images of an environment of a door;
classify the plurality of frames as including at least one person;
estimate, using the plurality of frames, a direction associated with the at least one person;
identify at least one article of clothing associated with the at least one person in at least one of the plurality of frames; and
transmit a command to a controller associated with the door based on the direction and the at least one article of clothing,
wherein the one or more instructions, that cause the device to transmit the command, cause the device to:
transmit a command to open the door based on the at least one article of clothing satisfying a clothing threshold, or
transmit a command to keep the door closed based on the at least one article of clothing not satisfying a clothing threshold.

16. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, when executed by the one or more processors, further cause the device to:
identify an orientation associated with the at least one person in at least one frame of the plurality of frames,
wherein the command is further based on the orientation.

17. The non-transitory computer-readable medium of claim 15 , wherein the one or more instructions, that cause the device to identify the at least one article of clothing, cause the device to:
apply a clothing classifier to a portion of the plurality of frames, wherein the portion is based on output from a person classifier that classified the plurality of frames as including the at least one person.

18. The non-transitory computer-readable medium of claim 15 , wherein the plurality of frames are encoded as separate image files.

19. The non-transitory computer-readable medium of claim 15 , wherein the clothing threshold is a type of clothing.

20. The non-transitory computer-readable medium of claim 15 , wherein the clothing threshold is satisfied when the at least one person is wearing required attire.

Assignees

• Capital One Services Llc

Inventors

• Edwards Joshua
• Mossoba Michael
• Benkreira Abdelkader M'Hamed

Classifications

• E05Y2400/44

  Sensors not directly associated with the wing movement · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• E05Y2400/45

  Control modes · CPC title

• E05F2015/765

  using optical sensors · CPC title

• G06T2207/30196

  Human being; Person · CPC title