Systems and methods for assessing a facility based on audio/visual delta analysis

Patent metadata

Field	Value
Publication number	US-2016284073-A1
Application number	US-201514870937-A
Country	US
Kind code	A1
Filing date	Sep 30, 2015
Priority date	Mar 27, 2015
Publication date	Sep 29, 2016
Grant date	—

Abstract

In one embodiment, a system may include a multi-purpose sensor coupled to a machine operating in an industrial environment. The multi-purpose sensor may include a camera that obtains a first and second set of image data including images of the machine and an environment surrounding the machine. The first set of image data is associated with a baseline of the machine and the environment, and the second set of image data is acquired subsequent to when the first set is acquired. The system may include a computing device that may include a processor to receive the first and second set of image data, determine baseline positions of objects in the first set, determine subsequent positions of the objects in the second set, determine whether the subsequent positions vary from the baseline positions, and perform an action when the subsequent positions vary from the baseline positions.

First claim

1 . A system comprising:
a multi-purpose sensor configured to couple to a machine operating in an industrial environment, comprising:
a camera configured to obtain a first set of image data and a second set of image data comprising images of the machine and an environment surrounding the machine, wherein the first set of image data is associated with a baseline of the machine and the environment, and wherein the second set of image data is acquired subsequent to when the first set of image data is acquired; and
a computing device configured to communicatively couple to the multi-purpose sensor, wherein the computing device comprises:
a processor configured to:
receive the first set of image data and the second set of image data from the multi-purpose sensor;
determine one or more baseline positions of one or more objects in the first set of image data;
determine one or more subsequent positions of the one or more objects in the second set of image data;
determine whether the subsequent positions vary from the baseline positions; and
perform an action when the subsequent positions vary from the baseline positions.

2 . The system of claim 1 , wherein the first set of image data is acquired by the camera when the machine is operating normally.

3 . The system of claim 1 , wherein:
the processor is configured to determine whether a hazard is present within a proximity of the machine based on the first set of image data and the second set of image data; and perform a second action when the hazard is present.

4 . The system of claim 1 , wherein the multi-purpose sensor comprises a plurality of sensors disposed within the multi-purpose sensor and configured to acquire a plurality of different types of sets of data associated with the machine or the environment surrounding the machine, wherein:
a first portion of the plurality of different types of sets of data comprises historical sensor measurements over time when the machine is operating normally for each of the plurality of sensors; and a second portion of the plurality of different types of sets of data comprises sensor measurements subsequent to when the first portion is acquired for each of the plurality of sensors.

5 . The system of claim 1 , wherein the first set of image data and the second set of image data are taken within a visible light range or outside the visible light range.

6 . The system of claim 5 , wherein the first set of image data and the second set of image data are taken within an infrared light range.

7 . The system of claim 6 , wherein the first set of image data and the second set of image data are taken within an ultraviolet light range.

8 . The system of claim 4 , wherein the multi-purpose sensor comprises a second processor configured to:
determine a baseline individual measurement signature for each of the plurality of sensors based on the first portion of the plurality of different types of sets of data; determine a subsequent individual measurement signature based on the second portion of the plurality of different types of sets of data; determine whether the subsequent individual measurement signature varies from the respective baseline individual measurement signature; generate one or more signals when the subsequent individual collective measurement signature varies from the respective baseline individual measurement signature, wherein the one or more signals are configured to cause the computing device, a cloud-based computing system, a control/monitoring device, or some combination thereof to perform a preventative action, diagnostic, predictive operation, or some combination thereof; and transmit the one or more signals to the computing device, the cloud-based computing system, the control/monitoring device, or some combination thereof

9 . The system of claim 1 , wherein the multi-purpose sensor comprises:
a plurality of sensors disposed within the multi-purpose sensor and configured to acquire a plurality of different types of sets of data associated with the machine or the environment surrounding the machine, wherein the plurality of different types of sets of data comprises historical sensor measurements for each of the plurality of sensors over time when the machine is operating efficiently; and a second processor configured to:
determine a baseline individual measurement signature for each of the plurality of sensors based on the plurality of different types of sets of data, a collective measurement signature for the plurality of sensors based on the plurality of different types of sets of data, or both, wherein the baseline individual measurement signature and the collective measurement signature are associated with when the machine is operating efficiently; and
determine one or more baseline machine settings, one or more baseline machine operational parameters, or both associated with the baseline individual measurement signature, the collective measurement signature, or both.

10 . The system of claim 9 , wherein the second processor is configured to operate the machine efficiently by monitoring and modifying one or more current machine settings, one or more current machine operational parameters, or both to match the baseline machine settings, the baseline machine operational parameters, or both.

11 . The system of claim 9 , wherein:
determine one or more subsequent individual measurement signatures for each of the plurality of sensors, a subsequent collective measurement signature, or both; determine when any of the subsequent individual measurement signatures, the subsequent collective measurement signature, or both deviate from the baseline individual measurement signature, the collective measurement signature, or both; and modify one or more current machine settings, one or more current machine operational parameters, or both to cause the subsequent individual measurement signatures, the subsequent collective measurement signature, or both to converge to the respective baseline individual measurement signatures, the collective measurement signature, or both.

12 . The system of claim 1 , wherein the multi-purpose sensing device comprises a second processor configured to determine one or more baseline machine settings, one or more baseline machine operational parameters, or both when the machine is producing a desired quantity of products with a certain level of quality based on a first set of data acquired by a plurality of sensors disposed within the multi-purpose sensing device.

13 . The system of claim 12 , wherein the second processor is configured to modify one or more current machine settings, one or more current machine operational parameters, or both when a second set of data acquired after the first set of data deviates from the first set of data.

14 . A tangible, non-transitory computer readable medium storing instructions that, when executed by a processor, are configured to cause the processor to:
receive a first set of image data and a second set of image data from a multi-purpose sensor, wherein the first and second sets of image data is obtained by a camera of the multi-purpose sensor, wherein the first and second sets of image data comprise an image of a machine in an industrial automation application, an image of an environment surrounding the machine, or both, and wherein the second set of image data is acquired subsequent to when the first set of image data is acquired; determine one or more baseline positions of one or more objects in the first set of image data; determine one or more subsequent positions of the one or more objects in the second set of image data; determine whet

Assignees

• Rockwell Automation Tech Inc

Inventors

• Michalscheck Jimi R
• Michalscheck Kelly A
• Korpela Jessica L
• Reissner Kyle K
• Vasko David A
• Fordenwalt Matthew W
• Jauquet John J
• Ericsson Matthew R
• Wilber Andrew

Classifications

• G06T7/001 Primary

  using an image reference approach · CPC title

• G06T2207/30164

  Workpiece; Machine component · CPC title

• G05B23/0216 Primary

  Human interface functionality, e.g. monitoring system providing help to the user in the selection of tests or in its configuration · CPC title

• G05B23/0224

  Process history based detection method, e.g. whereby history implies the availability of large amounts of data · CPC title

• G05B2219/24097

  Camera monitors controlled machine · CPC title