Methods and systems for identifying the crossing of a virtual barrier

Patent metadata

Field	Value
Publication number	US-11544953-B2
Application number	US-202117318521-A
Country	US
Kind code	B2
Filing date	May 12, 2021
Priority date	Dec 29, 2017
Publication date	Jan 3, 2023
Grant date	Jan 3, 2023

Abstract

Systems, methods and media are disclosed for identifying the crossing of a virtual barrier. A person in a 3D image of a room may be circumscribed by a bounding box. The position of the bounding box may be monitored over time, relative to the virtual barrier. If the bounding box touches or crosses the virtual barrier, an alert may be sent to the person being monitored, a caregiver or a clinician. Bounding box tracking may be used in addition to or instead of an initial tracking process, such as skeletal tracking.

First claim

What is claimed is:

1. A computerized method of monitoring an individual, the computerized method being performed by a computerized monitoring system and comprising:
receiving, from one or more 3D motion sensors, image data of a room to be monitored;
configuring a virtual barrier within the room;
utilizing skeletal tracking to initially track a position of a person detected within the room to determine whether the person touches or crosses the virtual barrier; and
switching from skeletal tracking to bounding box tracking to track the position of the person to determine whether the person touches or crosses the virtual barrier, wherein bounding box tracking includes monitoring a position of a bounding box circumscribing at least a portion of the person relative to the virtual barrier.

2. The computerized method of claim 1 , wherein switching from skeletal tracking to bounding box tracking occurs upon determining that no crossings of the virtual barrier have been detected for the person within a threshold period of time.

3. The computerized method of claim 1 , wherein switching from skeletal tracking to bounding box tracking occurs upon detecting one or more of low-lighting conditions and an object obstructing skeletal tracking from the image data.

4. The computerized method of claim 1 , wherein the bounding box is configured to circumscribe an entire body of the person.

5. The computerized method of claim 1 further comprising sending an alert to a computerized communication system upon detecting that the bounding box touches or crosses the virtual barrier.

6. The computerized method of claim 5 , wherein, upon receiving the alert, the computerized communication system notifies the person, a caregiver, or clinician that the virtual barrier has been crossed.

7. The computerized method of claim 1 further comprising determining that a minimum portion of the bounding box touches or crosses the virtual barrier.

8. The computerized method of claim 1 further comprising determining the identity of the person.

9. A system for monitoring an individual, the system comprising:
a computerized monitoring system in communication with one or more 3D motion sensors; and
a computerized communication system;
wherein the computerized monitoring system is configured to:
receive, from one or more 3D motion sensors, image data of a room to be monitored;
configure a virtual barrier within the room;
utilize skeletal tracking to initially track a position of a person detected within the room to determine whether the person touches or crosses the virtual barrier; and
switch from skeletal tracking to bounding box tracking to track the position of the person to determine whether the person touches or crosses the virtual barrier, wherein bounding box tracking includes monitoring a position of a bounding box circumscribing at least a portion of the person relative to the virtual barrier.

10. The system of claim 9 , wherein switching from skeletal tracking to bounding box tracking occurs upon determining that no crossings of the virtual barrier have been detected for the person within a threshold period of time.

11. The system of claim 9 , wherein switching from skeletal tracking to bounding box tracking occurs upon detecting one or more of low-lighting conditions and an object obstructing skeletal tracking from the image data.

12. The system of claim 9 , wherein the bounding box is configured to circumscribe an entire body of the person.

13. The system of claim 9 , wherein the computerized monitoring system is configured to send an alert to the computerized communication system upon detecting that the bounding box touches or crosses the virtual barrier.

14. The system of claim 13 , wherein the computerized communication system is configured to, upon receiving the alert from the computerized monitoring system, notify the person, a caregiver, or clinician that the virtual barrier has been crossed.

15. Non-transitory computer-readable media having embodied thereon instructions that, when executed by a computer processor, cause the computer processor to:
receive, from one or more 3D motion sensors, image data of a room to be monitored;
configure a virtual barrier within the room;
utilize skeletal tracking to initially track a position of a person detected within the room to determine whether the person touches or crosses the virtual barrier; and
switch from skeletal tracking to bounding box tracking to track the position of the person to determine whether the person touches or crosses the virtual barrier, wherein bounding box tracking includes monitoring a position of a bounding box circumscribing at least a portion of the person relative to the virtual barrier.

16. The non-transitory computer-readable media of claim 15 , wherein switching from skeletal tracking to bounding box tracking occurs upon determining that no crossings of the virtual barrier have been detected for the person within a threshold period of time.

17. The non-transitory computer-readable media of claim 15 , wherein switching from skeletal tracking to bounding box tracking occurs upon detecting one or more of low-lighting conditions and an object obstructing skeletal tracking from the image data.

18. The non-transitory computer-readable media of claim 15 , wherein the bounding box is configured to circumscribe an entire body of the person.

19. The non-transitory computer-readable media of claim 15 , wherein the instructions further cause the computer processor to send an alert to a computerized communication system upon detecting that the bounding box touches or crosses the virtual barrier.

20. The non-transitory computer-readable media of claim 19 , wherein the instructions further cause the computer processor to send another alert to the computerized communication system upon detecting that all of the virtual bounding box crosses the virtual barrier.

Assignees

• Cerner Innovation Inc

Inventors

• Kusens Michael

Classifications

• G06V40/103 Primary

  Static body considered as a whole, e.g. static pedestrian or occupant recognition · CPC title

• G06T2207/30196

  Human being; Person · CPC title

• A61B5/1115

  Monitoring leaving of a patient support, e.g. a bed or a wheelchair · CPC title

• G06V30/224

  of printed characters having additional code marks or containing code marks · CPC title

• G06T7/73

  using feature-based methods · CPC title