Image based monitoring of the state of a device

Patent metadata

Field	Value
Publication number	US-10973720-B2
Application number	US-201715668226-A
Country	US
Kind code	B2
Filing date	Aug 3, 2017
Priority date	Apr 7, 2017
Publication date	Apr 13, 2021
Grant date	Apr 13, 2021

Abstract

A method of determining information about a device includes the steps of 1) acquiring an image of at least a portion of the device, 2) comparing the information content of the image to the information content of at least one record of a library, and, 3) if the comparison is positive, reporting that the device is in the possible state represented by the library record. A method which depends on calculations based on the acquired image rather than on comparison of the information content of the image to the information content of one or more library records is also disclosed. A system for determining the state of the device is also disclosed.

First claim

We claim:

1. A method of determining information about a device, the method comprising:
acquiring an image of at least a portion of the device, the image having an information content;
comparing the information content of the image to the information content of at least one record of a library, the information content of any given record of the library representing a possible state of the device;
if the comparison is positive, reporting that the device is in the possible state represented by the library record; and
interpolating between library records whose information content most closely matches that of the acquired image and wherein the step of reporting reports that the device is in the possible state represented by the interpolation.

2. The method of claim 1 wherein if the comparison is negative for a complement S 1 of a possible state S 2 , reporting that the device in the possible state S 2 .

3. The method of claim 1 wherein if the comparison is negative for all but a remaining one of multiple states which are in a counterstate relationship with each other, reporting that the device is in the remaining one state.

4. The method of 1 wherein the device is a bed and the possible states represented by the library records include at least one of:
status of a brake control;
status of a brake/steer control;
elevation state of a siderail;
deployed or stowed state of a siderail;
elevation state of an elevatable frame;
orientation state of an elevatable frame;
orientation state of an orientation adjustable deck section;
chair status;
extension panel deployment status;
maintenance needed status;
lockout status; and
nurse call requirement.

5. The method of claim 1 wherein:
the step of acquiring an image of at least a portion of the device includes capturing information about the surroundings of the device, the captured information being contained in either of:
A) the image of at least a portion of the device; and
B) an image other than the image of at least a portion of the device; and

the comparing step includes comparing the information content of the image or images to a library record whose information content reveals a relationship between the device and the surroundings.

6. The method of claim 5 wherein the step which includes capturing information about the surroundings includes capturing an image of an electrical outlet, and the library record whose information content reveals a relationship between the device and the surroundings is one of:
A) a library record whose information content represents a power cord of the device plugged into the outlet; and
B) a library record whose information content represents a power cord of the device not plugged into the outlet.

7. The method of claim 1 wherein the information content of the image is compared to the information content of exactly one record of the library.

8. The method of claim 1 wherein the information content of the acquired image is compared to the information content of a set of records which is a proper subset of the records of the library.

9. The method of claim 1 including a step of determining whether or not the device is present, and carrying out the acquiring step only if the device is present.

10. The method of claim 1 including a step of determining a model of the device.

11. The method of claim 10 wherein the at least one record of the library to which the information content of the image is compared is a record specific to the model.

12. The method of claim 1 wherein the device is a bed and the step of establishing the information content of the image includes distinguishing between an orientation adjustable section of the bed and an occupant of the bed.

13. The method of claim 12 wherein the angular orientation of the orientation adjustable section of the bed is established from a visible spectrum image and angular orientation of the occupant is established from an infrared spectrum image.

14. The method of claim 1 comprising:
a) recording the result of comparing the information content of the image to the information content of a first candidate library record;
b) repeating the comparing and recording steps for one or more additional candidate library records until the acquired image has been compared to all candidate library members; and
c) determining if the comparison is positive by interpreting the recorded results.

15. A method of determining information about a device, the method comprising:
acquiring an image of at least a portion of the device, the image having an information content;
comparing the information content of the image to the information content of at least one record of a library, the information content of any given record of the library representing a possible state of the device;
if the comparison is positive, reporting that the device is in the possible state represented by the library record; and
accepting the closest of one of two records as a positive comparison for the state of the device in the acquired image, wherein the closest of the two records is the record whose information content most resembles the information content of the image, and wherein the step of reporting reports that the device is in the possible state represented by that closest record.

16. A method of determining information about a device, the method comprising:
acquiring an image of at least a portion of the device, the image having an information content;
assessing a spatial relationship or relationships from the information content of the acquired image;
calculating the state of the device using the assessed spatial relationship or relationships;
accepting the closest of one of two records as a positive comparison for the state of the device in the acquired image, wherein the closest of the two records is the record whose information content most resembles the information content of the image; and
reporting that the device is in the possible state represented by that closest record.

17. A system for determining the state of a device, the system comprising:
an imaging device;
a processor;
instructions which are executable by the processor such that the system: a) acquires an image of the device, the image having information content; and b) determines the state of the device from the information content based on interpolating between a library of records whose information content most closely matches that of the acquired image.

18. The system of claim 17 wherein the system determines the state of the device by comparing the information content of the acquired image to information representing one or more possible states of the device and, if the comparison is positive for one of the one or more states, determining that the device is in the possible state represented by the positive comparison.

19. The system of claim 18 wherein the information representing the one or more possible states of the device is contained in the library of records.

20. The system of claim 18 wherein the system determines the state of the device by A) assessing a spatial relationship from the information content of the acquired image and B) calculating the state of the device using the assessed spatial relationship.

Assignees

• Hill Rom Services Inc

Inventors

• Benz Eric D
• Christie John D
• Frondorf Michael M
• Monson Gavin M
• Seim Douglas A
• Shah Arpit S
• Tallent Dan R
• Voll James D

Classifications

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• A61G12/00

  Accommodation for nursing, e.g. in hospitals, not covered by groups A61G1/00 - A61G11/00, e.g. trolleys for transport of medicaments or food {(service or tea-tables, trolleys or wagons A47B31/00)}; Prescription lists · CPC title

• A61G7/1073

  Parts, details or accessories · CPC title

• A61G7/1065 Primary

  with electronic monitoring · CPC title

• A61G7/018

  Control or drive mechanisms · CPC title