Methods and systems for detecting prohibited objects

Patent metadata

Field	Value
Publication number	US-11443602-B2
Application number	US-202117152403-A
Country	US
Kind code	B2
Filing date	Jan 19, 2021
Priority date	Nov 6, 2018
Publication date	Sep 13, 2022
Grant date	Sep 13, 2022

Abstract

A prohibited object detection system detects improper use of an object in an area being monitored. An image of an object detected in an area associated with a monitored individual, such as a patient room, is collected, and the system identifies reference points on the object. The system may compare the reference points to reference points of known improper uses of the object. The system may determine whether the detected object in the improper use position is in proximity to at least a portion of the monitored individual or other person within the monitored area. One or more designated recipients may be alerted if the object is in a position consistent with an improper use.

First claim

What is claimed is:

1. One or more non-transitory computer storage media having embodied thereon instructions that, when executed by one or more computer processors, causes the one or more computer processors to perform a method comprising:
receiving image data from one or more 3D motion sensors located to provide the one or more 3D motion sensors with a view of an individual to be monitored in a monitored area;
based on the image data received from the one or more 3D motion sensors, detecting an object within the monitored area, wherein detecting the object comprises identifying the object using a plurality of reference points of the object;
determining that a position of the object within the image data is consistent with an improper use by comparing a known position of the improper use of the object to the position of the object within the image data; and
initiating an alert protocol upon determining that the position of the object is consistent with the improper use.

2. The computer storage media of claim 1 , wherein the method performed by the one or more computer processors further comprises, upon detecting the object within the monitored area, detecting that the object is within a threshold proximity of one or more hands of a person within the monitored area.

3. The computer storage media of claim 2 , wherein the person within the monitored area is the individual to be monitored, a caregiver, or a visitor.

4. The computer storage media of claim 1 , wherein identifying the object comprises comparing the plurality of reference points of the object to reference points of known objects stored within a database and identifying a match with a known object.

5. The computer storage media of claim 1 , wherein the improper use is a use that poses a safety, security, or health concern.

6. The computer storage media of claim 5 , wherein the known position of the improper use of the object and a known position of a proper use of the object are stored in a database.

7. The computer storage media of claim 1 , further comprising receiving information corresponding to an action taken in response to the alert protocol and storing the information in a database.

8. The computer storage media of claim 1 , wherein determining that the position of the object is consistent with the improper use comprises determining relative locations of at least two or more reference points of the object and comparing the relative locations with known relative locations associated with the improper use of the object.

9. The computer storage media of claim 8 , wherein determining the relative locations of the at least two or more reference points of the object comprises determining locations of at least two or more reference points of the object relative to each other.

10. A computerized method for detecting objects, the method comprising:
receiving image data from one or more 3D motion sensors located to provide the one or more 3D motion sensors with a view of an individual to be monitored in a monitored area;
based on image data received from the one or more 3D motion sensors, detecting an object that is within the monitored area, wherein detecting the object comprises identifying the object using a plurality of reference points of the object;
detecting that a position of the object within the image data is consistent with an improper use by comparing a known position of the improper use of the object to the position of the object within the image data; and
initiating an alert protocol upon determining that the position of the object is consistent with the improper use.

11. The computerized method of claim 10 further comprising, upon detecting the object within the monitored area, detecting that the object is within a threshold proximity of a person within the monitored area.

12. The computerized method of claim 11 , wherein the threshold proximity of the person is determined based on reference points on a skeletal outline for the person.

13. The computerized method of claim 12 , wherein detecting that the position of the object within the image data is consistent with the improper use further comprises determining whether a hand of the person is touching a particular portion of the object.

14. The computerized method of claim 11 , wherein the threshold proximity is based on an identification zone automatically established based on a predetermined distance from the person within the monitored area, wherein the person within the monitored area comprises one of the individual to be monitored, a visitor, or a caregiver.

15. A system for detecting an object within a monitored area, the system comprising:
one or more 3D motion sensors located to provide the one or more 3D motion sensors with a view of an individual to be monitored, the one or more 3D motion sensors configured to capture image data of the monitored area;
a computerized monitoring system communicatively coupled to the one or more 3D motion sensors, a processor of the computerized monitoring system configured to utilize the image data received from the one or more 3D motion sensors to:
detect the object in the monitored area using one or more reference points of the object;
determine that a position of the object within the image data is consistent with an improper use by comparing a known position of the object to the position of the object within the image data; and
initiate an alert protocol upon determining that the position of the object is consistent with the improper use.

16. The system of claim 15 further comprising a computerized communication system communicatively coupled to the computerized monitoring system, the computerized communication system configured to:
receive a determination from the computerized monitoring system that the position of the object detected is consistent with the improper use; and
transmit one or more alerts indicating at least that the object has been detected.

17. The system of claim 16 , wherein the computerized monitoring system is configured to transmit an alert to the individual to be monitored.

18. The system of claim 17 , wherein the computerized monitoring system is further configured to, after the alert has been transmitted to the individual to be monitored, determine whether a response indicating corrective action has been given based on information subsequently received from the one or more 3D motion sensors.

19. The system of claim 18 , wherein the response indicating corrective action includes one or more of an audible response from the individual to be monitored, a gesture indicative of compliance, and the object being moved out of the position consistent with the improper use.

20. The system of claim 15 , further comprising a central monitoring system, wherein the alert protocol comprises the central monitoring system receiving the image data captured by the one or more 3D motion sensors and displaying the image data.

Assignees

• Cerner Innovation Inc

Inventors

• Kusens Michael
• Kusens Neil

Classifications

• G08B21/043 Primary

  detecting an emergency event, e.g. a fall · CPC title

• G06V10/70

  using pattern recognition or machine learning (optical pattern recognition or electronic computations therefor G06V10/88) · CPC title

• G08B13/19602 Primary

  Image analysis to detect motion of the intruder, e.g. by frame subtraction · CPC title

• G06F18/21

  Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title