Analyzing video streams in an industrial environment to identify potential problems and select recipients for a display of video streams related to the potential problems

Patent metadata

Field	Value
Publication number	US-10325155-B2
Application number	US-201615132376-A
Country	US
Kind code	B2
Filing date	Apr 19, 2016
Priority date	Apr 19, 2016
Publication date	Jun 18, 2019
Grant date	Jun 18, 2019

Abstract

The subject matter disclosed herein relates generally to industrial automation systems, and, more particularly, to collecting video streams from a variety of video devices in an industrial environment, identifying and analyzing potential problems in the industrial environment using the video streams, and presenting the video streams and data associated with the potential problem to appropriate recipients.

First claim

What is claimed is:

1. A system, comprising:
a processor; and
a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, comprising:
a video receiving component configured to obtain video streams captured by cameras in an industrial environment;
a video monitoring component configured to employ at least one video recognition technique to analyze a first video content of a first video stream of the video streams and identify a potential problem in the industrial environment based on a portion of the first video content;
a recipient identification component configured to select a recipient for the first portion of the first video content of the first video stream from a plurality of recipients according to a selection criteria associated with the potential problem; and
a video presentation component configured to transmit a message to a display device associated with the selected recipient that initiates the display device to present a display comprising at least the first portion of the first video content of the first video stream.

2. The system of claim 1 , further comprising a data monitoring component that identifies data produced in the industrial environment associated with the potential problem; and
wherein the display further comprises the identified data.

3. The system of claim 2 , wherein the identified data comprises potential instigator data indicating a possible cause of the potential problem.

4. The system of claim 1 , wherein the video monitoring component is further configured to employ the at least one video recognition technique to analyze a second video content of a second video stream of the video streams and identify a potential instigator of the potential problem based on a second portion of the second video content; and
wherein the display further comprises the second portion of the second video content of the second video stream.

5. The system of claim 1 , wherein the selection criteria comprises an ability of the recipient to resolve the potential problem.

6. The system of claim 1 , further comprising a display device identification component configured to select the display device out of a plurality of display devices associated with the recipient based upon respective availability of the display devices to the recipient.

7. The system of claim 1 , further comprising a video tagging component configured to tag at least the first portion of the first video content of the first video stream with a unique identifier associated with the potential problem.

8. The system of claim 2 , further comprising a data tagging component configured to tag the identified data with the unique identifier associated with the potential problem.

9. The system of claim 2 , further comprising a video/data synchronization component configured to time synchronize the first video stream with the identified data; and
wherein the display is configured to present a playback of the first video stream in time synchronization with the identified data.

10. The system of claim 4 , further comprising a video/data synchronization component configured to time synchronize the first video stream with the second video stream; and
wherein the display is configured to present a playback of the first video stream in time synchronization with the second video stream.

11. A method, comprising:
receiving, by a system comprising a processor, video streams captured by cameras in an industrial environment;
employing, by the system, at least one video recognition technique to analyze a first video content of a first video stream of the video streams and identify a potential problem in the industrial environment based on a portion of the first video content;
selecting, by the system, a recipient from a plurality of recipients for the first portion of the first video content of the first video stream according to a selection criteria associated with the potential problem; and
transmitting, by the system, a message to a display device associated with the selected recipient that initiates the display device to present a display comprising at least the first portion of the first video content of the first video stream.

12. The method of claim 11 , further comprising identifying, by the system, data produced in the industrial environment associated with the potential problem; and
wherein the display further comprises the identified data.

13. The method of claim 12 , wherein the identified data comprises potential instigator data indicating a possible cause of the potential problem.

14. The method of claim 12 , further comprising tagging, by the system, at least the first portion of the first video content of the first video stream and the identified data with a unique identifier associated with the potential problem.

15. The method of claim 11 , further comprising employing, by the system, the at least one video recognition technique to analyze a second video content of a second video stream of the video streams and identify a potential instigator of the potential problem based on a second portion of the second video content; and
wherein the display further comprises the second portion of the second video content of the second video stream.

16. A non-transitory computer-readable medium having stored thereon instructions that, in response to execution, cause a system comprising a processor to perform operations, the operations comprising:
accessing video streams captured by cameras in an industrial environment;
employing at least one video recognition technique to analyze a first video content of a first video stream of the video streams and identify a potential problem in the industrial environment based on a portion of the first video content; and
selecting at least one recipient from a plurality of recipients for the first portion of the first video content of the first video stream according to a selection criteria associated with the potential problem; and
sending a transmission to at least one display device associated with the at least one selected recipient that initiates the at least one display device to present a display comprising at least the first portion of the first video content of the first video stream.

17. The non-transitory computer-readable medium of claim 16 , the operations further comprising identifying, by the system, data produced in the industrial environment associated with the potential problem; and
wherein the display further comprises the identified data.

18. The non-transitory computer-readable medium of claim 16 , wherein the selection criteria comprises a maintenance history of a recipient with a machine involved in the potential problem.

19. The non-transitory computer-readable medium of claim 16 , wherein the selection criteria comprises a physical proximity of a recipient to a location of the potential problem.

20. The non-transitory computer-readable medium of claim 16 , wherein the selection criteria comprises an availability of particular display device to a recipient.

Assignees

• Rockwell Automation Tech Inc

Inventors

• Billi Sharon M
• Como Christopher Wayne
• Gray Edward A
• Reissner Kyle
• Walter Jonathan D
• Singhai Mohit
• Reichard Douglas J
• Sandler Scott N
• Bliss Ronald E
• Pantaleano Michael John
• Cahalane Ryan
• Korpela Jessica L
• Mccleave Bruce T

Classifications

• G06V10/764 Primary

  using classification, e.g. of video objects · CPC title

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• G06F18/2411

  based on the proximity to a decision surface, e.g. support vector machines · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• H04N5/765

  Interface circuits between an apparatus for recording and another apparatus · CPC title