Analyzing video streams in an industrial environment to identify potential problems and select recipients for a display of video streams related to the potential problems

Patent metadata

Field	Value
Publication number	US-2019258863-A1
Application number	US-201916403770-A
Country	US
Kind code	A1
Filing date	May 6, 2019
Priority date	Apr 19, 2016
Publication date	Aug 22, 2019
Grant date	—

Abstract

The subject matter disclosed herein relates generally to industrial automation systems, and, more particularly, to collecting video streams from a variety of video devices in an industrial environment, identifying and analyzing potential problems in the industrial environment using the video streams, and presenting the video streams and data associated with the potential problem to appropriate recipients.

First claim

What is claimed is:

1 . A system, comprising:
a processor; and a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, comprising:
a video historian component configured to:
store video streams captured by cameras in an industrial environment, and
learn normal operating procedures for an industrial process in the industrial environment based on a first analysis of the video streams; and

a data identification component configured identify a deviation from a learned normal operating procedure of the learned normal operating procedures based on a second analysis of a new video stream captured by a camera of the cameras in the industrial environment.

2 . The system of claim 1 , further comprising data recipient identification component configured to select a recipient for the new video stream from a plurality of recipients according to a selection criteria associated with the deviation.

3 . The system of claim 2 , a video presentation component configured to present a display comprising the new video stream to a display device associated with the recipient.

4 . The system of claim 3 , further comprising a data monitoring component that identifies data produced in the industrial environment associated with the deviation; and
wherein the display further comprises the identified data.

5 . The system of claim 4 , wherein the identified data comprises potential instigator data indicating a possible cause of the deviation.

6 . The system of claim 3 , wherein the data identification component is further configured to identify at least one other video stream of the video streams that is indicative of a potential instigator of the deviation; and
wherein the display further comprises the at least one other video stream.

7 . The system of claim 2 , wherein the selection criteria comprises an ability of the recipient to resolve the deviation.

8 . A method, comprising:
accessing, by a system comprising a processor, video streams captured by cameras in an industrial environment; learning, by the system, normal operating procedures for an industrial process in the industrial environment based on a first analysis of the video streams; and identifying, by the system, a deviation from a learned normal operating procedure of the learned normal operating procedures based on a second analysis of a new video stream captured by a camera of the cameras in the industrial environment.

9 . The method of claim 8 , further comprising selecting, by the system, a recipient for the new video stream from a plurality of recipients according to a selection criteria associated with the deviation.

10 . The method of claim 9 , further comprising presenting, by the system, a display comprising the new video stream to a display device associated with the recipient.

11 . The method of claim 10 , further comprising identifying, by the system, data produced in the industrial environment associated with the deviation; and
wherein the display further comprises the identified data.

12 . The method of claim 11 , wherein the identified data comprises potential instigator data indicating a possible cause of the deviation.

13 . The method of claim 10 , further comprising identifying, by the system, at least one other video stream of the video streams that is indicative of a potential instigator of the deviation; and
wherein the display further comprises the at least one other video stream.

14 . The method of claim 9 , wherein the selection criteria comprises an ability of the recipient to resolve the deviation.

15 . A non-transitory computer-readable medium having stored thereon instructions that, in response to execution, cause a system comprising a processor to perform operations, the operations comprising:
accessing video streams captured by cameras in an industrial environment; learning normal operating procedures for an industrial process in the industrial environment based on a first analysis of the video streams; and identifying a deviation from a learned normal operating procedure of the learned normal operating procedures based on a second analysis of a new video stream captured by a camera of the cameras in the industrial environment.

16 . The non-transitory computer-readable medium of claim 15 , the operations further comprising selecting a recipient for the new video stream from a plurality of recipients according to a selection criteria associated with the deviation.

17 . The non-transitory computer-readable medium of claim 16 , the operations further comprising presenting a display comprising the new video stream to a display device associated with the recipient.

18 . The non-transitory computer-readable medium of claim 17 , the operations further comprising identifying data produced in the industrial environment associated with the deviation; and
wherein the display further comprises the identified data.

19 . The non-transitory computer-readable medium of claim 18 , wherein the identified data comprises potential instigator data indicating a possible cause of the deviation.

20 . The non-transitory computer-readable medium of claim 17 , the operations further comprising identifying at least one other video stream of the video streams that is indicative of a potential instigator of the deviation; and
wherein the display further comprises the at least one other video stream.

Assignees

• Rockwell Automation Tech Inc

Inventors

• Billi Sharon M
• Como Christopher Wayne
• Gray Edward A
• Reissner Kyle
• Walter Jonathan D
• Singhai Mohit
• Reichard Douglas J
• Sandler Scott N
• Bliss Ronald E
• Pantaleano Michael John
• Cahalane Ryan
• Korpela Jessica L
• Mccleave Bruce T

Classifications

• G06V10/764 Primary

  using classification, e.g. of video objects · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• G06F18/2411

  based on the proximity to a decision surface, e.g. support vector machines · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• H04N5/765

  Interface circuits between an apparatus for recording and another apparatus · CPC title