Optimization of human supervisors and cyber-physical systems

Patent metadata

Field	Value
Publication number	US-9778628-B2
Application number	US-201414454301-A
Country	US
Kind code	B2
Filing date	Aug 7, 2014
Priority date	Aug 7, 2014
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

A method and system for optimizing a human supervised cyber-physical system determines a state of the human operator based on data from multiple psycho physiological sensors, determines a state of each of multiple cyber-physical systems in the human supervised cyber-physical system based on data provided by the cyber-physical systems, and fuses the state of the human operator and the state of each of the plurality of cyber-physical systems into a single state of the human supervised cyber-physical system. The single state is then used to generate recommendations for optimizing a user interface and to generate high level control signals for the cyber-physical systems.

First claim

The invention claimed is:

1. A human supervised cyber-physical system comprising:
an adaptive user interface;
at least one psycho physiological sensor operable to sense at least one characteristic of human operator and communicate the at least one characteristic to a computerized computational element;
a plurality of cyber physical systems, each of said cyber-physical systems in communication with the computerized computational element, wherein each of said plurality of cyber physical systems includes at least one cyber-physical system sensor operable to sense a characteristic of the corresponding cyber-physical system;
the computerized computational element comprising at least one processor and a memory, wherein the memory stores:
a cyber-physical systems state estimator module operable to estimate a state of a cyber-physical system based on an output of the at least one cyber-physical system sensor,
a human state estimator module operable to estimate a state of at least one human operator based on said at least one characteristic of the human operator,
a data fusion module operable to merge the state of the human operator and the state of each of said cyber-physical systems into a single human supervised cyber-physical system state,
a high level cyber-physical systems controller operable to generate high level control commands for each of said cyber-physical systems in response to said single human supervised cyber-physical system state; and
a recommender optimizer module operable to cause said adaptive user interface to adapt in response to said single human supervised cyber-physical system state by at least displaying an optimization recommendation to the human operator and allowing the human operator to manually enact the optimization recommendation.

2. The human supervised cyber-physical system of claim 1 , wherein the computerized computational element further comprises a human effectiveness models module, and wherein the human effectiveness models module is operable to apply said psycho physiological sensor data to at least one human effectiveness model to determine a current state of the operator.

3. The human supervised cyber-physical system of claim 2 , wherein the at least one human effectiveness model is one of a generic human model, a specific type of human model, and a specific human model.

4. The human supervised cyber-physical system of claim 3 , wherein the at least one human effectiveness model includes a structure and a plurality of parameters, and wherein the structure comprises a plurality of mathematical equations describing the human effectiveness model and the parameters comprise a plurality of variables within the structure.

5. The human supervised system of claim 1 , wherein the adaptive user interface comprises at least an operator screen and a user interface, and wherein the adaptive user interface is operable to alter a display visible to an operator in response to recommendations from the recommender optimizer.

6. The human supervised system of claim 1 , wherein each of the plurality of cyber-physical systems includes a controller operable to convert high level control instructions received from the high level controller to specific control instructions for the cyber-physical system.

7. The human supervised system of claim 1 , wherein each of said cyber-physical systems is remote from said operator.

8. A method for optimizing a human supervised cyber-physical system comprising:
determining a state of a human operator based on data from a plurality of psycho physiological sensors using a plurality of computational elements;
determining a state of each of a plurality of cyber-physical systems in the human supervised cyber-physical system based on data provided by the plurality of cyber-physical systems using the plurality of computational elements;
fusing the state of the human operator and the state of each of the plurality of cyber-physical systems thereby generating a single state of the human supervised cyber-physical system using the plurality of computational elements; and
adapting a user interface corresponding to the human operator in response to the generated single state of the human supervised cyber-physical system by at least displaying an optimization recommendation to the human operator and allowing the human operator to manually decline to enact the optimization recommendation.

9. The method of claim 8 , wherein adapting a user interface corresponding to the human operator in response to the generated single state of the human supervised cyber-physical system comprises altering a display of the adaptive user interface such that a recommendation from an optimizer module is automatically followed by said human operator.

10. The method of claim 9 , further comprising providing high level control instructions to at least one of said cyber-physical systems, thereby reducing a number of decisions required from the human operator.

11. The method of claim 8 , wherein determining a state of a human operator based on data from a plurality of psycho physiological sensors comprises applying at least one human effectiveness model to the data from the plurality of psycho physiological sensors, thereby determining a current state of the operator.

12. The method of claim 8 , wherein the human effectiveness model includes a structure and a plurality of parameters, and wherein the structure comprises a plurality of mathematical equations describing the human effectiveness model and the parameters comprise a plurality of variables within the structure.

13. The method of claim 8 , wherein the computation elements include
a cyber-physical systems state estimator module operable to estimate a state of the cyber-physical system based on an output of at least one cyber-physical system sensor,
a human state estimator module operable to estimate a state of the human operator based on data from the plurality of psycho physiological sensors,
a data fusion module operable to merge the state of the operator and the state of each of said cyber-physical systems into a single human supervised cyber-physical system state,
a high level cyber-physical systems controller operable to generate high level control commands for each of said cyber-physical systems in response to said single human supervised cyber-physical system state; and
a recommender optimizer module operable to cause said adaptive user interface to adapt in response to said single human supervised cyber-physical system state.

Assignees

• Goodrich Corp

Inventors

• Leonardi Francesco
• Bertuccelli Luca F
• Surana Amit

Classifications

• G05B13/04 Primary

  involving the use of models or simulators · CPC title

• G05B23/0267 Primary

  Fault communication, e.g. human machine interface [HMI] · CPC title

• G05B13/048

  using a predictor · CPC title