Semantic zoom of graphical visualizations in industrial HMI systems

Patent metadata

Field	Value
Publication number	US-9383890-B2
Application number	US-201313830475-A
Country	US
Kind code	B2
Filing date	Mar 14, 2013
Priority date	Mar 14, 2013
Publication date	Jul 5, 2016
Grant date	Jul 5, 2016

Abstract

A system includes a processor configured to cause a display to display a graphical visualization of an industrial system, detect a user input corresponding to an area of the display, perform a semantic zoom of the area of the display, and to display a first level of information based on a first level of the semantic zoom. The first level of information includes a data that was not previously displayed on the area of the display. The processor is configured to perform a semantic zoom of a graphical visualization of a graphical device during the first level of the semantic zoom. The processor is configured to cause the display to transition to a concurrent display of the graphical device and a second level of information during a second level of the semantic zoom.

First claim

The invention claimed is:

1. A system, comprising:
an industrial controller comprising processor configured to:
receive sensor signals from at least one hardware sensor;
control a turbine system via a physical actuator based on the sensor signals;
cause a display to display a graphical visualization of an industrial system;
detect a user input corresponding to an area of the display;
perform a semantic zoom of the area of the display;
display a first level of information based on a first level of the semantic zoom, wherein the first level of information comprises a data that was not previously displayed on the area of the display;
perform a semantic zoom of a graphical visualization of a graphical device during the first level of the semantic zoom upon detection of a first industrial controller event, wherein the first level of the semantic zoom comprises a first context;
cause the display to transition to a concurrent display of the graphical device and a second level of information associated with the graphical device during a second level of the semantic zoom upon detection of a second industrial controller event, wherein the second level of information comprises a second data that was not previously displayed during the first level of the semantic zoom, wherein the second level of the semantic zoom comprises a second context different from the first context, and wherein the graphical device displayed during the first level of the semantic zoom comprises the same graphical device displayed during the second level of the semantic zoom; and
detect a second user input corresponding to a command to change an operating parameter of the graphical device after the display transitions to the second level of the semantic zoom, wherein the graphical device comprises a turbine graphics, a generator graphics, an industrial component graphics, or a combination thereof, and wherein changing the operating parameter comprises changing a pressure, a flow rate, a temperature, a speed, a vibration, or a combination thereof, associated with the graphical device.

2. The system of claim 1 , wherein the data comprises a text displaying an operational data, a configuration data, a maintenance log, a maintenance schedule, an equipment list, an operator list, a supervisor list, an alarm, an alert, or a combination thereof.

3. The system of claim 1 , wherein the user input comprises a touch gesture, a scroll of a wheel of a computer mouse, a body movement, an eye movement, a depressing of a keypad, or a combination thereof.

4. The system of claim 3 , wherein the touch gesture comprises a tap gesture, a double tap gesture, a two-finger tap gesture, a drag gesture, a flick gesture, a rotate gesture, a pinch gesture, an expand gesture, a pan gesture, or a combination thereof.

5. The system of claim 1 , wherein the display comprises a touch sensitive display, a motion-tracking display, an eye-tracking display, or a combination thereof.

6. The system of claim 1 , wherein the processor is configured to detect a first touch and a second touch of the display concurrently, and configured to cause the display to transition to the second level of the semantic zoom based on a relative distance between the first touch and the second touch.

7. The system of claim 1 , wherein the processor is configured to detect a first touch and a second touch of the display concurrently, and configured to cause the display to transition between the first level of the semantic zoom, the second level of the semantic zoom, and a third level of the semantic zoom as a distance between the first touch and the second touch increases or decreases.

8. The system of claim 1 , wherein the graphical visualization of the industrial system comprises a graphical visualization of a gasification system, a gas turbine system, a hydroturbine system, a steam turbine system, a gas treatment system, a power generation system, or a combination thereof.

9. The system of claim 8 , wherein the graphical device comprises a graphical visualization of a pump, a valve, a level transmitter, a pressure transmitter, a temperature transmitter, a flow transmitter, an actuator, a relay, or a combination thereof, communicatively coupled to one of the gasification system, the gas turbine system, the hydroturbine system, the steam turbine system, the gas treatment system, or the power generation system.

10. The system of claim 1 , wherein the first industrial controller event comprises a first transition rule, and wherein the second industrial controller event comprises a second transition rule.

11. A non-transitory computer-readable medium having computer executable code stored thereon, the code comprising instructions to:
cause a display communicatively coupled to an industrial controller configured to control a turbine system via a physical actuator based on the sensor signals to display a graphical visualization of an industrial system;
detect a user input corresponding to an area of the display;
perform a semantic zoom of the area of the display;
display a first level of information based on a first level of the semantic zoom, wherein the first level of information comprises a data that was not previously displayed on the area of the display;
perform a semantic zoom of a graphical visualization of a industrial device during the first level of the semantic zoom upon detection of a first industrial controller event, wherein the first level of the semantic zoom comprises a first context;
cause the display to transition to a concurrent display of the industrial device and a second level of information associated with the industrial device during a second level of the semantic zoom upon detection of a second industrial controller event, wherein the second level of information comprises a second data that was not previously displayed during the first level of the semantic zoom, wherein the second level of the semantic zoom comprises a second context different from the first context, and wherein the industrial device displayed during the first level of the semantic zoom comprises the same industrial device displayed during the second level of the semantic zoom; and
detect a second user input corresponding to a command to change an operating parameter of the industrial device after the display transitions to the second level of the semantic zoom, wherein the industrial device comprises a gas turbine, a hydroturbine, a steam turbine, a generator, a power production system, a gasification system, or a combination thereof, and wherein changing the operating parameter comprises changing a pressure, a flow rate, a temperature, a speed, a vibration, or a combination thereof, associated with the graphical device.

12. The non-transitory computer-readable medium of claim 11 , wherein the code comprises instructions to perform a semantic zoom of a graphical visualization of a portion of the industrial device during the first level of the semantic zoom, and configured to cause the display to transition to a concurrent display of the industrial device and the second data associated with the industrial device during the second level of the semantic zoom.

13. The non-transitory computer-readable medium of claim 11 , wherein the code comprises instructions to detect a first touch and a second touch of the display concurrently, and to cause the display to transition to the second level of the semantic zoom based on a relative distance between the first touch and the second touch.

14. The non-transitory computer-readable medium of claim 11 , wherein the code comprises instructions to detect a first touch and a second touch of the area of the

Assignees

• Gen Electric

Inventors

• Grubbs Robert William
• John Justin Varkey

Classifications

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title

• G06F2203/04808

  Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title