Live streaming visualizations of industrial equipment operation

Patent metadata

Field	Value
Publication number	US-12339636-B2
Application number	US-202217828935-A
Country	US
Kind code	B2
Filing date	May 31, 2022
Priority date	May 31, 2022
Publication date	Jun 24, 2025
Grant date	Jun 24, 2025

Abstract

A method may include generating visualizations each representative of operational parameters associated with industrial devices in an industrial system via a control system that controls operations of the industrial devices. The control system is communicatively connected to a first computing system and a second computing system. The method may also include receiving a request including credentials associated with a requester from the second computing system and determining rights to each of the visualizations. Additionally, the method may include identifying one or more of the visualizations based on the access rights and receiving a selection of the one or more of the visualizations from the second computing system. Moreover, the method may include transmitting the one or more of the visualizations to the first computing system that live streams the one or more of the visualizations to the second computing system.

First claim

The invention claimed is:

1. A system, comprising:
a first computing system configured to stream data accessible to a second computing system; and
a control system configured to control one or more operations of one or more industrial devices in an industrial system, wherein the control system is configured to:
receive real-time data indicative of one or more real-time operational parameters from one or more sensors associated with the one or more industrial devices;
generate a plurality of visualizations based on the real-time data, wherein each visualization of the plurality of visualizations is representative of the one or more real-time operational parameters associated with the one or more industrial devices;
receive a request from the second computing system, wherein the request comprises one or more credentials associated with a requester;
authenticate the one or more credentials by querying a database to determine whether the one or more credentials match user authentication data stored in the database;
determine one or more access rights to each of the plurality of visualizations based on the one or more credentials matching the user authentication data;
identify one or more of the plurality of visualizations based on the one or more access rights;
receive a selection of the one or more of the plurality of visualizations via the second computing system;
broadcast unstructured image data representative of the one or more of the plurality of visualizations to the first computing system, wherein the unstructured image data excludes digital data comprising the real-time data and is presented by the second computing system as a live-streaming broadcast; and
receive one or more commands from the second computing system after broadcasting the unstructured image data, wherein the one or more commands are configured to adjust the one or more operations of the one or more industrial devices in the industrial system.

2. The system of claim 1 , wherein the first computing system is configured to broadcast the unstructured image data via a network.

3. The system of claim 1 , wherein the one or more of the plurality of visualizations corresponds to a graphical user interface, a dashboard visualization, image data of the one or more industrial devices, or any combination thereof.

4. The system of claim 1 , wherein the one or more credentials comprise one or more usernames, one or more passwords, one or more biometric identifiers, or any combination thereof.

5. The system of claim 1 , wherein the second computing system is configured to extract one or more portions of the unstructured image data associated with the one or more of the plurality of visualizations and detect one or more data field values from the one or more extracted portions of the unstructured image data based on reference data associated with the one or more industrial devices.

6. The system of claim 1 , wherein the one or more industrial devices comprise one or more industrial robots, one or more conveyors, one or more input/output (I/O) modules, motors, one or more human machine interfaces (HMIs), one or more operator interfaces, one or more contactors, one or more starters, one or more actuators, one or more drives, one or more relays, one or more protection devices, one or more network switches, or any combination thereof.

7. The system of claim 1 , wherein the control system is configured to broadcast the unstructured image data to the first computing system via one or more High-Definition Multimedia Interface (HDMI) ports.

8. A method, comprising:
receiving, via a control system, real-time data indicative of one or more real-time operational parameters from one or more sensors associated with one or more industrial devices in an industrial system, wherein the control system is configured to control one or more operations of the one or more industrial devices;
generating, via the control system, a plurality of visualizations based on the real-time data, wherein each visualization of the plurality of visualizations is representative of the one or more real-time operational parameters associated with the one or more industrial devices, wherein the control system is communicatively connected to a first computing system and a second computing system;
receiving a request for access to the plurality of visualizations from the second computing system, wherein the request comprises one or more credentials associated with a requester;
authenticating the one or more credentials by querying a database to determine whether the one or more credentials match user authentication data stored in the database;
determining one or more access rights to each of the plurality of visualizations based on the one or more credentials matching the user authentication data;
identifying one or more of the plurality of visualizations based on the one or more access rights;
receiving a selection of the one or more of the plurality of visualizations from the second computing system;
broadcasting unstructured image data representative of the one or more of the plurality of visualizations to the first computing system configured to live stream the unstructured image data to the second computing system, wherein the unstructured image data excludes digital data comprising the real-time data and is presented by the second computing system as a live-streaming broadcast; and
receiving, via the control system, one or more commands from the second computing system after the unstructured image data is presented via the live-streaming broadcast, wherein the one or more commands are configured to adjust the one or more operations of the one or more industrial devices in the industrial system.

9. The method of claim 8 , wherein the first computing system is configured to live stream the unstructured image data via a network accessible to the second computing system.

10. The method of claim 8 , wherein the one or more of the plurality of visualizations corresponds to a graphical user interface, a dashboard visualization, image data of the one or more industrial devices, or any combination thereof.

11. The method of claim 8 , wherein the first computing system is configured to broadcast the unstructured image data to the second computing system and a plurality of computing devices.

12. The method of claim 8 , wherein the one or more credentials comprise one or more usernames, one or more passwords, one or more biometric identifiers, or any combination thereof.

13. The method of claim 8 , wherein the second computing system is configured to extract one or more portions of the unstructured image associated with the one or more of the plurality of visualizations and detect one or more data field values from the one or more extracted portions of the unstructured image data based on reference data associated with the one or more industrial devices.

14. The method of claim 8 , wherein broadcasting the unstructured image data comprises continuously streaming the unstructured image data to the first computing system via one or more High-Definition Multimedia Interface (HDMI) ports.

15. Non-transitory, computer-readable medium storing instructions that, when executed by one or more processors, are configured to cause the one or more processors to:
receive real-time data indicative of one or more real-time operational parameters from one or more sensors associated with one or more industrial devices in an industrial system, wherein the one or more processors are configured to control one or more operations of the one or more industrial devices;
generate a plurality of visualizations based on t

Assignees

• Rockwell Automation Tech Inc

Inventors

• Hickox Stephen L
• Barnett Bryan W
• Mehrotra Abhishek

Classifications

• G05B19/0426

  Programming the control sequence · CPC title

• G05B2219/40161

  Visual display of machining, operation, remote viewing · CPC title

• G05B2219/32351

  Visual, graphical animation of process · CPC title

• G05B19/0425 Primary

  Safety, monitoring · CPC title

• G05B19/042 Primary

  using digital processors (G05B19/05 takes precedence) · CPC title