Contextual monitoring perspective selection during training session

Patent metadata

Field	Value
Publication number	US-11398162-B2
Application number	US-201715476955-A
Country	US
Kind code	B2
Filing date	Mar 31, 2017
Priority date	Feb 15, 2017
Publication date	Jul 26, 2022
Grant date	Jul 26, 2022

Abstract

Monitoring a training session from a trainee in an interactive computer simulation system. During the training session, while the trainee performs actions in an interactive computer simulation station on one or more tangible instruments thereof for controlling a virtual simulated element, dynamic data is logged related to the actions of the trainee. At a monitoring station of the interactive computer simulation system and during the training session, a graphical user interface is displayed depicting a contextual scene related to the interactive computer simulation from a first point of view and detecting a predetermined event in the dynamic data during the training session. At the monitoring station, a second point of view is defined different from the first point of view and the contextual scene is generated in the graphical user interface after the predetermined event detection from the second point of view.

First claim

What is claimed is:

1. A method for monitoring a training session completed by a trainee on an interactive computer simulation system having a simulation station and a monitoring station, the method comprising performing, during the training session:
logging dynamic data related to the actions performed by the trainee on one or more tangible instruments of the simulation station, the actions controlling a virtual simulated element within a computer-generated environment;
displaying at a monitoring station of the interactive computer simulation system a graphical user interface depicting a contextual scene related to the computer-generated environment from a first point of view in space;
detecting a predetermined event in the dynamic data;
statistically defining a second point of view in space different from the first point of view upon detecting the predetermined event as a function of a plurality of past point of view decisions made from the monitoring station for the predetermined event, wherein the predetermined event is an event triggered by the movement of the one or more tangible instruments by the actions performed by the trainee, or an event involving the virtual simulated element; and
displaying at the monitoring station the contextual scene being generated in the graphical user interface from the second point of view.

2. The method of claim 1 , wherein detecting the predetermined event comprises receiving the predetermined event from the monitoring station and the plurality of past point of view decisions comprise a selection of the second point of view received from the monitoring station.

3. The method of claim 1 , wherein the interactive computer simulation station is a flight simulator training station related to a simulated aircraft, the one or more tangible instruments comprise elements of a replicated aircraft cockpit and the virtual simulated element is a simulated aircraft.

4. The method of claim 1 , further comprising:
recording one or more image feeds in the interactive computer simulation station; and
rendering one or more image feeds from the computer-generated environment; and
wherein the contextual scene from the first and second points of view is generated from at least one of: the one or more image feeds recorded, and the one or more image feeds rendered.

5. The method of claim 1 , further comprising, in non-real-time priority processing and after completion of the session, associating each of a plurality of predetermined events in the dynamic data with one or more image feeds along the session timeline for subsequent debriefing of the session.

6. The method of claim 1 , wherein statistically defining the second point of view is performed considering an identity of at least one of a decision-maker at the monitoring station and an identify of the trainee.

7. The method of claim 1 , wherein detecting the predetermined event in the dynamic data is performed in real-time priority processing at the monitoring station.

8. The method of claim 1 , wherein after defining the second point of view, a transition contextual scene from the first point of view towards the second point of view is generated.

9. The method of claim 1 , further comprising loading a session plan for the training session, wherein the predetermined event is further detected from the session plan.

10. A monitoring station for monitoring a training session completed by a trainee on an interactive computer simulation system, the monitoring station comprising:
a tracking module configured to, during the training session and while the trainee performs actions in an interactive computer simulation station on one or more tangible instruments thereof for controlling a virtual simulated element, log dynamic data related to the actions of the trainee;
a display module configured to, during the training session, display a graphical user interface depicting a contextual scene related to the interactive computer simulation from a first point of view in space; and
a processing module configured to:
detect a predetermined event in the dynamic data during the training session, wherein the predetermined event is an event triggered by the movement of the one or more tangible instruments by the actions performed by the trainee, or an event involving the virtual simulated element; and
statistically define a second point of view in space different from the first point of view as a function of a plurality of past point of view decisions made from the monitoring station for the predetermined event,

wherein the display module is configured to generate the contextual scene in the graphical user interface after the predetermined event detection from the second point of view.

11. The monitoring station of claim 10 , wherein the interactive computer simulation station is a flight simulator training station related to a simulated aircraft and the one or more tangible instruments comprise elements of a replicated aircraft cockpit and the virtual simulated element is a simulated aircraft.

12. An interactive computer simulation system comprising:
an interactive computer simulation station in which a trainee performs actions on one or more tangible instruments thereof for controlling a virtual simulated element in a computer-generated environment; and
the monitoring station of claim 10 .

13. The interactive computer simulation system of claim 12 , wherein the interactive computer simulation station is a flight simulator training station related to a simulated aircraft and the one or more tangible instruments comprise elements of a replicated aircraft cockpit and the virtual simulated element is a simulated aircraft.

14. The interactive computer simulation system of claim 12 , wherein the processing module is configured to record one or more image feeds in the interactive computer simulation station, the display module is further configured to generate the contextual scene from the recorded one or more image feeds during the training session.

15. The interactive computer simulation system of claim 14 wherein the display module is further configured to generate the contextual scene by rendering images from the computer-generated environment in addition to the one or more image feeds.

16. The interactive computer simulation system of claim 12 , wherein the tracking module is configured to, in non-real-time priority processing and after completion of the session, associate each of a plurality of predetermined events in the dynamic data with one or more image feeds.

17. A non-transitory computer-readable memory having computer-readable instructions stored thereon, which when executed by a processing module of an interactive computer simulation system configure the processing unit, to perform during a training session completed by a trainee on the interactive computer simulation system the steps of:
causing a tracking module to log dynamic data related to the actions performed by the trainee on one or more tangible instruments of a simulation station of the interactive computer simulation system, the actions controlling a virtual simulated element within a computer-generated environment;
causing a display module to display at a monitoring station of the interactive computer simulation system a graphical user interface depicting a contextual scene related to the computer-generated environment from a first point of view in space;
detecting a predetermined event in the dynamic data, wherein the predetermined event is an event triggered by the movement of the one or more tangible instruments by the actions performed by

Assignees

• Cae Inc

Inventors

• Delisle Jean-François

Classifications

• G09B9/20

  Simulation or indication of aircraft attitude · CPC title

• G06F30/20

  Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) · CPC title

• G09B9/08

  for teaching control of aircraft, e.g. Link trainer · CPC title

• G06F30/15

  Vehicle, aircraft or watercraft design · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title