Analyzing video streams in an industrial environment to identify potential problems and select recipients for a display of video streams related to the potential problems

Patent metadata

Field	Value
Publication number	US-10796156-B2
Application number	US-201916403770-A
Country	US
Kind code	B2
Filing date	May 6, 2019
Priority date	Apr 19, 2016
Publication date	Oct 6, 2020
Grant date	Oct 6, 2020

Abstract

The subject matter disclosed herein relates generally to industrial automation systems, and, more particularly, to collecting video streams from a variety of video devices in an industrial environment, identifying and analyzing potential problems in the industrial environment using the video streams, and presenting the video streams and data associated with the potential problem to appropriate recipients.

First claim

What is claimed is:

1. A system, comprising:
a processor; and
a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, comprising:
a video historian component configured to:
store video streams captured by cameras in an industrial environment, and
learn a normal operating procedure for an industrial process in the industrial environment based on a first analysis of the video streams; and

a data identification component configured to identify a deviation from the normal operating procedure based on a second analysis of a new video stream captured by a camera of the cameras in the industrial environment, the new video stream depicting execution of a current operating procedure being performed for the industrial process.

2. The system of claim 1 , further comprising:
a data recipient identification component configured to select a recipient for the new video stream from a plurality of recipients according to a selection criterion associated with the deviation; and
a video presentation component configured to present a display comprising the new video stream to a display device associated with the recipient.

3. The system of claim 2 , further comprising a data monitoring component configured to identify data produced in the industrial environment associated with the deviation,
wherein the display further comprises the data.

4. The system of claim 3 , wherein the data comprises potential instigator data indicating a possible cause of the deviation.

5. The system of claim 2 , wherein
the data identification component is further configured to identify at least one other video stream of the video streams that is indicative of a potential instigator of the deviation, and
the display further comprises the at least one other video stream.

6. The system of claim 2 , wherein the selection criterion comprises an ability of the recipient to resolve the deviation.

7. A method, comprising:
accessing, by a system comprising a processor, video streams captured by cameras in an industrial environment;
learning, by the system, a normal operating procedure for an industrial process in the industrial environment based on a first analysis of the video streams; and
identifying, by the system, a deviation from the normal operating procedure based on a second analysis of a new video stream captured by a camera of the cameras in the industrial environment, the new video stream depicting execution of a current operating procedure being performed for the industrial process.

8. The method of claim 7 , further comprising:
selecting, by the system, a recipient for the new video stream from a plurality of recipients according to a selection criterion associated with the deviation; and
presenting, by the system, a display comprising the new video stream to a display device associated with the recipient.

9. The method of claim 8 , further comprising identifying, by the system, data produced in the industrial environment associated with the deviation; and
wherein the display further comprises the data.

10. The method of claim 9 , wherein the data comprises potential instigator data indicating a possible cause of the deviation.

11. The method of claim 8 , further comprising identifying, by the system, at least one other video stream of the video streams that is indicative of a potential instigator of the deviation;
wherein the display further comprises the at least one other video stream.

12. The method of claim 8 , wherein the selection criterion comprises a determination that the recipient is capable of resolving the deviation.

13. A non-transitory computer-readable medium having stored thereon instructions that, in response to execution, cause a system comprising a processor to perform operations, the operations comprising:
accessing video streams captured by cameras in an industrial environment;
learning a normal operating procedure for an industrial process in the industrial environment based on a first analysis of the video streams; and
identifying a deviation from the normal operating procedure based on a second analysis of a new video stream captured by a camera of the cameras in the industrial environment, wherein the new video stream records execution of a current operating procedure being performed for the industrial process.

14. The non-transitory computer-readable medium of claim 13 , the operations further comprising selecting a recipient for the new video stream from a plurality of recipients according to a selection criterion associated with the deviation.

15. The non-transitory computer-readable medium of claim 14 , the operations further comprising presenting a display comprising the new video stream to a display device associated with the recipient.

16. The non-transitory computer-readable medium of claim 15 , the operations further comprising identifying data produced in the industrial environment associated with the deviation; and
wherein the display further comprises the data.

17. The non-transitory computer-readable medium of claim 16 , wherein the data comprises potential instigator data indicating a possible cause of the deviation.

18. The non-transitory computer-readable medium of claim 15 , the operations further comprising identifying at least one other video stream of the video streams that is indicative of a potential instigator of the deviation; and
wherein the display further comprises the at least one other video stream.

19. The system of claim 1 , wherein the data identification component is configured to identify the deviation based on a comparison between a stored video stream depicting execution of the normal operating procedure for the industrial process and the new video stream depicting the execution of the current operating procedure being performed for the industrial process.

20. The method of claim 7 , wherein the identifying the deviation comprises:
comparing a stored video stream depicting execution of the normal operating procedure for the industrial process with the new video stream depicting the execution of the current operating procedure being performed for the industrial process; and
identifying the deviation based on a result of the comparing.

Assignees

• Rockwell Automation Tech Inc

Inventors

• Billi Sharon M
• Como Christopher Wayne
• Gray Edward A
• Reissner Kyle
• Walter Jonathan D
• Singhai Mohit
• Reichard Douglas J
• Sandler Scott N
• Bliss Ronald E
• Pantaleano Michael John
• Cahalane Ryan
• Korpela Jessica L
• Mccleave Bruce T

Classifications

• G06V10/764 Primary

  using classification, e.g. of video objects · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• G06F18/2411

  based on the proximity to a decision surface, e.g. support vector machines · CPC title

• G06V2201/06

  Recognition of objects for industrial automation · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title