System and method for communicating with an operator of the system

Patent metadata

Field	Value
Publication number	US-9799198-B2
Application number	US-201615058368-A
Country	US
Kind code	B2
Filing date	Mar 2, 2016
Priority date	Dec 18, 2015
Publication date	Oct 24, 2017
Grant date	Oct 24, 2017

Abstract

Method includes executing a dynamic decision-making process that includes (a) receiving environmental data and (b) determining a fused ensemble based on the environmental data and a state parameters of a current state of a machine assembly. The fused ensemble includes communications from a system interface to the operator for the state parameters. The communications inform an operator about the state parameters and includes at least one of a visual signal, an audible signal, or a tactile signal from the system interface. The decision-making process also includes (c) communicating the fused ensemble to the operator through the system interface and (d) repeating (a)-(c) while the machine assembly is in the current state. The fused ensemble is configured to change based on changes in the environmental data.

First claim

What is claimed is:

1. A method comprising:
determining a designated task to perform using a machine assembly of a control system, the control system including a system interface for communicating with an operator,
receiving a current state of the machine assembly while the designated task is being performed by the machine assembly, the current state being associated with plural pre-defined state parameters;
executing a dynamic decision-making process comprising:
(a) receiving environmental data;
(b) determining a fused ensemble based on the environmental data and the state parameters of the current state, the fused ensemble including communications for the state parameters from the system interface to the operator, the communications informing the operator about the state parameters and including at least one of a visual signal, an audible signal, or a tactile signal from the system interface;
(c) communicating the fused ensemble to the operator through the system interface;
(d) repeating (a)-(c) while the machine assembly is in the current state, the fused ensemble configured to change based on changes in the environmental data.

2. The method of claim 1 , wherein the fused ensemble changes by modifying a degree of at least one of the communications, replacing at least one of the communications with a different communication, or adding a communication to the fused ensemble that redundantly informs the operator about one of the state parameters.

3. The method of claim 1 , wherein the fused ensemble changes by at least one of: (1) changing a frequency at which a series of audible signals is communicated to the operator; (2) changing a volume of an audible signal; (3) replacing an audible signal with at least a visual signal; (4) replacing a visual signal with at least an audible signal; (5) changing an amount of illuminance from a light source; (6) changing a frequency at which a series of flashes is visually communicated to the operator; (7) changing a color of light that is visually communicated to the operator; or (8) communicating another type of signal to the operator in addition to the original signal for a state parameter.

4. The method of claim 1 , wherein determining the fused ensemble includes re-prioritizing the state parameters based on the environmental data.

5. The method of claim 1 , wherein at least some of the state parameters are assigned weights that are based on the environmental data, the state parameters being assigned new weights when the environmental data changes, wherein a subsequent determining the fused ensemble is based on the new weights.

6. The method of claim 1 , wherein determining the fused ensemble may be superseded by a pre-defined urgent interaction based on the environmental data.

7. The method of claim 6 , wherein the pre-defined urgent interaction includes warning the operator of possible danger to the operator or the machine assembly.

8. The method of claim 6 , wherein the machine assembly automatically pauses or aborts the designated task in response to the pre-defined urgent interaction.

9. The method of claim 1 , wherein the system interface includes at least two of a user display, a light source, or an audio-generating instrument.

10. The method of claim 1 , further comprising, after determining the designated task, planning plural sub-operations to perform the designated task, wherein the machine assembly is in the current state for at least one of the sub-operations.

11. The method of claim 1 , further comprising receiving a new current state of the machine assembly and repeating the dynamic decision-making process with the new current state, the new current state having a different grouping of state parameters.

12. The method of claim 1 , wherein the method is performed in a rail yard.

13. The method of claim 1 , wherein the designated task is a brake-bleeding task.

14. The method of claim 1 , wherein at least one of the state parameters is communicated to the operator with multiple different communications.

15. A system comprising:
a machine assembly;
a control system configured to control the machine assembly to perform a designated task, the control system including a system interface for communicating with an operator, wherein the control system includes one or more processors that are configured to:
receive a current state of the machine assembly while the designated task is being performed by the machine assembly, the current state being associated with plural pre-defined state parameters;
execute a dynamic decision-making process comprising:
(a) receiving environmental data;
(b) determining a fused ensemble based on the environmental data and the state parameters of the current state, the fused ensemble including communications for the state parameters from the system interface to the operator, the communications informing the operator about the state parameters and including at least one of a visual signal, an audible signal, or a tactile signal from the system interface;
(c) communicating the fused ensemble to the operator through the system interface;
(d) repeating (a)-(c) while the machine assembly is in the current state, the fused ensemble configured to change based on changes in the environmental data.

16. The system of claim 15 , wherein the fused ensemble is changed by modifying a degree of at least one of the communications, replacing at least one of the communications with a different communication, or adding a communication to the fused ensemble that redundantly informs the operator about one of the state parameters.

17. The system of claim 15 , wherein the fused ensemble changes by at least one of: (1) changing a frequency at which a series of audible signals is communicated to the operator; (2) changing a volume of an audible signal; (3) replacing an audible signal with at least a visual signal; (4) replacing a visual signal with at least an audible signal; (5) changing an amount of illuminance from a light source; (6) changing a frequency at which a series of flashes is visually communicated to the operator; (7) changing a color of light that is visually communicated to the operator; or (8) communicating another type of signal to the operator in addition to the original signal for a state parameter.

18. The system of claim 15 , wherein determining the fused ensemble includes re-prioritizing the state parameters based on the environmental data.

19. The system of claim 15 , wherein at least some of the state parameters are assigned weights that are based on the environmental data, the state parameters being assigned new weights when the environmental data changes, wherein a subsequent determining the fused ensemble is based on the new weights.

Assignees

• Gen Electric

Inventors

• Tan Huan
• Lizzi John Michael
• Forman Douglas
• Theurer Charles Burton
• Al Assad Omar
• Patrick Romano
• Holovashchenko Viktor
• Kannan Balajee
• Gefen Yonatan

Classifications

• G05B19/048 Primary

  Monitoring; Safety · CPC title

• G05B15/02

  electric · CPC title

• G08B21/18 Primary

  Status alarms (G08B21/02 takes precedence) · CPC title

• G05B2219/14006

  Safety, monitoring in general · CPC title

• G08B7/06

  using electric transmission {, e.g. involving audible and visible signalling through the use of sound and light sources} · CPC title