Perspective selection for a debriefing scene

Patent metadata

Field	Value
Publication number	US-11508256-B2
Application number	US-201715476952-A
Country	US
Kind code	B2
Filing date	Mar 31, 2017
Priority date	Feb 15, 2017
Publication date	Nov 22, 2022
Grant date	Nov 22, 2022

Abstract

Debriefing a session from a user in a system. During the session, while the user performs actions on one or more tangible instruments of the system, dynamic data is logged in relation to the system along a session timeline. The dynamic data covers the actions of the user on tangible instrument(s). A graphical user interface depicting a debriefing scene, related to the session, is displayed from a first point of view starting at a first time within the session timeline. The debriefing scene is generated starting at the first time from at least a first image feed. Upon detection of a predetermined event in the dynamic data at a second time along the session timeline, a second point of view different from the first point of view is defined and the debriefing scene is generated therefrom after the second time using at least a second image feed.

First claim

What is claimed is:

1. A method for generating a context-sensitive debriefing scene from two distinct image feeds of a training session completed on an interactive simulation system having a tangible instrument, the method comprising:
during the session, logging dynamic data generated by actions performed by a trainee on the tangible instrument to control a virtual simulated element in a computer-generated environment of the interactive simulation system, wherein the interactive simulation system is an interactive computer simulation station and wherein the interactive computer simulation station is a flight simulator training station related to a simulated aircraft and the tangible instrument comprises elements of a replicated aircraft cockpit and the virtual simulated element is a simulated aircraft;
processing the dynamic data to detect the occurrence of a predetermined event separating a first and second period of the session;
selecting a perspective as a function of the event;
processing the image feeds as a function of the selected perspective to generate the debriefing scene, wherein the debriefing scene presents:
a view of at least one of the trainee and the interactive simulation system during the first period from a perspective different from the selected perspective; and
a view of at least one of the trainee and the interactive simulation system during the second period from the selected perspective; and

providing the generated debriefing scene for display within a graphical user interface.

2. The method of claim 1 , further comprising generating two distinct image feeds from at least one of rendered images of the computer-generated environment of the interactive simulation system and one or more image feed recordings made during the session.

3. The method of claim 1 , further comprising recording at least one image feed from multiple perspectives during the session along the session timeline, the selected perspective is one of the multiple perspectives.

4. The method of claim 1 , further comprising receiving the predetermined event.

5. The method of claim 1 , further comprising, prior to displaying and after completion of the session, loading the dynamic data at a debriefing station.

6. The method of claim 5 , wherein detection of the predetermined event in the dynamic data is performed after completion of the session in real-time priority processing at the debriefing station.

7. The method of claim 1 , further comprising, prior to displaying, in non-real-time priority processing and after completion of the session and, associating each of a plurality of predetermined events in the dynamic data with multiple image feeds along the session timeline, the plurality of predetermined events comprising the predetermined event.

8. The method of claim 1 , further comprising generating a transition debriefing scene between the first period and the second period.

9. The method of claim 8 , wherein the transition debriefing scene comprises rendered images from a virtual representation of the system.

10. A debriefing system for generating a context-sensitive debriefing scene from two distinct image feeds of a training session completed on an interactive simulation system having a tangible instrument, the debriefing system comprising:
one or more tracking devices configured to, during the session:
log dynamic data generated by actions performed by a trainee on the tangible instrument to control a virtual simulated element in a computer-generated environment of the interactive simulation system, wherein the interactive simulation system is a flight simulator training station, wherein the tangible instrument comprises elements of a replicated aircraft cockpit and wherein the virtual simulated element is a simulated aircraft; and
record a plurality of image feeds from multiple perspectives related to the session along a session timeline; and

a processing unit configured to:
process the dynamic data to detect the occurrence of a predetermined event separating a first and second period of the session;
select a perspective from the multiple perspectives as a function of the event;
process the image feeds as a function of the selected perspective to generate the debriefing scene, wherein the debriefing scene presents:
a view of at least one of the trainee and the interactive simulation system during the first period from a perspective different from the selected perspective; and
a view of at least one of the trainee and the interactive simulation system during the second period from the selected perspective; and

provide the generated debriefing scene for display within a graphical user interface.

11. A non-transitory memory having computer-readable instructions stored thereon for generating a context-sensitive debriefing scene from two distinct image feeds of a training session completed on an interactive simulation system having a tangible instrument, which when executed by a processing unit of the interactive simulation system configure the processing unit to:
during the session, log dynamic data generated by actions performed by a trainee on the tangible instrument to control a virtual simulated element in a computer-generated environment of the interactive simulation system, wherein the interactive simulation system is a flight simulator training station, wherein the tangible instrument comprises elements of a replicated aircraft cockpit and wherein the virtual simulated element is a simulated aircraft;
process the dynamic data to detect the occurrence of a predetermined event separating a first and second period of the session;
select a perspective as a function of the event;
process the image feeds as a function of the selected perspective to generate the debriefing scene, wherein the debriefing scene presents:
a view of at least one of the trainee and the interactive simulation system during the first period from a perspective different from the selected perspective; and
a view of at least one of the trainee and the interactive simulation system during the second period from the selected perspective; and

provide the generated debriefing scene for display within a graphical user interface.

Assignees

• Cae Inc

Inventors

• Delisle Jean-François

Classifications

• G09B9/24

  including display or recording of simulated flight path · CPC title

• G06F30/20

  Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) · CPC title

• G09B9/302

  the image being transformed by computer processing, e.g. updating the image to correspond to the changing point of view · CPC title

• G09B9/10

  with simulated flight- or engine-generated force being applied to aircraft occupant (G09B9/28 takes precedence) · CPC title

• G09B9/301 Primary

  by computer-processed or -generated image · CPC title