Visualizing sub-systems of a virtual simulated element in an interactive computer simulation system

Patent metadata

Field	Value
Publication number	US-11462121-B2
Application number	US-201715432988-A
Country	US
Kind code	B2
Filing date	Feb 15, 2017
Priority date	Feb 15, 2017
Publication date	Oct 4, 2022
Grant date	Oct 4, 2022

Abstract

Method and system for visualizing dynamic virtual sub-systems of a virtual simulated element in an interactive computer simulation system comprising a computer generated environment. One or more tangible instruments control the virtual simulated element in the computer generated environment. A graphical user interface comprising an interactive display portion depicting a rendered view of the virtual simulated element. While an interactive computer simulation of the virtual simulated element is performed in the interactive computer simulation system, a storage system logs dynamic data in relation to the dynamic virtual sub-systems. At least one of the dynamic virtual sub-systems of the virtual simulated element is selected and a subset of dynamic data related to the selected virtual sub-system is loaded from the storage system. The selected virtual sub-system is displayed together with the related dynamic data on the graphical user interface.

First claim

What is claimed is:

1. A method for visualizing dynamic virtual sub-systems of at least one virtual simulated element in an interactive computer simulation system, the simulation system comprising a computer-generated environment, wherein the virtual simulated element is a simulated aircraft system, and wherein one or more tangible instruments are provided for enabling a user to control the virtual simulated element in the computer-generated environment, the method comprising the steps of:
providing for display a graphical user interface comprising an interactive display portion depicting a rendered view of the virtual simulated element;
while a user controls the virtual simulated element in the interactive computer simulation system using at least one of the one or more tangible instruments during an interactive computer simulation, logging in real-time dynamic data of the virtual simulated element generated in response to the user using the at least one of the one or more tangible instruments during the interactive computer simulation, the dynamic data defining an operational state of the dynamic virtual sub-systems and being logged in relation to the dynamic virtual sub-systems in a storage system of the interactive computer simulation system;
selecting for display a dynamic virtual sub-system of the virtual simulated element;
loading a subset of dynamic data related to the selected virtual sub-system from the storage system; and
providing for display the selected virtual sub-system together with the related dynamic data on the graphical user interface.

2. The method of claim 1 , wherein: the step of selecting a virtual sub-system is performed after the interactive computer simulation is completed; and the subset of dynamic data is related to a period of time covering simulated events from the interactive computer simulation, the simulated events being related to the selected virtual sub-system.

3. The method of claim 2 , further comprising receiving the period of time from the graphical user interface.

4. The method of claim 1 , wherein the step of selecting a virtual sub system takes place during the interactive computer simulation; and the steps of loading a subset of dynamic data related to the selected virtual sub-system and logging dynamic data in relation to the selected virtual sub-system are performed concurrently.

5. The method of claim 4 , further comprising the step of triggering a malfunction event in relation to the selected virtual sub-system.

6. The method of claim 5 , further comprising the step of loading a simulation plan for the interactive computer simulation from the storage system, wherein the malfunction event is triggered from the simulation plan for the interactive computer simulation.

7. The method of claim 5 , further comprising the step of receiving the malfunction event in a malfunction selection from the graphical user interface before triggering the malfunction event.

8. The method of claim 1 , further comprising the step of receiving a view-type selection from the graphical user interface before displaying the selected virtual sub-system together with the related dynamic data, the view-type selection being used for selecting from at least two of:
a realistic view-type in which the virtual simulated element and the selected virtual sub-system are depicted using realistic rendering;
a logical view-type in which the virtual simulated element and the selected virtual sub-system are depicted using logical rendering;
a hybrid view-type in which one of the virtual simulated element or the selected virtual sub-system is depicted using logical rendering while the other one is depicted using realistic rendering; and
a multi-hybrid view-type in which at least one of the virtual simulated element and the selected virtual sub-system is depicted using logical rendering and realistic rendering; wherein the step of displaying is performed according to the selected view-type.

9. The method of claim 1 , further comprising the step of receiving a perspective selection from the graphical user interface for displaying the selected virtual sub-system together with the related dynamic data, the perspective selection being used for selecting from at least two of:
one of a set of preset perspectives triggered when a trigger event occurs in the interactive computer simulation;
one of the set of preset perspectives selected from the graphical user interface; and
a floating perspective in which at least one of a relative distance from the virtual simulated element and a relative position to the virtual simulated element is dynamically adjusted through the graphical user interface.

10. The method of claim 1 , wherein the step of selecting the virtual sub-system comprises, receiving from the graphical user interface a virtual sub-system selection of at least one of the dynamic virtual sub-systems, the virtual sub-system selection being received between:
a menu selection from a menu portion of the graphical user interface; and
an interactive selection from the interactive display portion of the graphical user interface that displays the virtual simulated element.

11. The method of claim 1 , wherein the interactive computer simulation comprises a second virtual simulated element comprising a second set of dynamic virtual sub-systems, the method further comprising, the step of logging dynamic data in relation to the second set of dynamic virtual sub-systems in the storage system while the interactive computer simulation is performed in the interactive computer simulation system and further comprising the step of receiving a simulated element-selection for selecting one or more of the virtual simulated element and the second virtual simulated element for display.

12. The method of claim 11 , further comprising the step of processing corresponding dynamic data in relation to the virtual simulated element and corresponding dynamic data in relation to the second virtual simulated element for detecting trends therein.

13. The method of claim 1 , wherein the step of logging is performed for two simulations and further comprising the step of processing the logged data to detect trends therein.

14. An interactive computer simulation system comprising a computer-generated environment comprising a virtual simulated element, the interactive computer simulation system comprising:
one or more tangible instruments for controlling the virtual simulated element in the computer-generated environment, wherein the virtual simulated element is a simulated aircraft system, and the virtual simulated element comprises a plurality of dynamic virtual sub-systems;
a storage system for logging dynamic data of the virtual simulated element in real-time, the dynamic data being generated in response to the user using at least one of the one or more tangible instruments to control the virtual simulated element during an interactive computer simulation performed in the interactive computer simulation system, the dynamic data defining an operational state of the dynamic virtual sub-systems and being logged in relation to the dynamic virtual sub-systems;
a processor module configured for selecting for display a dynamic virtual sub-system of the virtual simulated element and for loading a subset of dynamic data related to the selected virtual sub-system from the storage system; and
a graphical user interface configured for displaying an interactive display portion depicting a rendered view of the virtual simulated element and for displaying the selected virtual sub-system together with the related dynamic data thereon.

15. The interactive

Assignees

• Cae Inc

Inventors

• Delisle Jean-François

Classifications

• G09B9/12

  Motion systems for aircraft simulators · CPC title

• G06F3/01

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G09B9/08

  for teaching control of aircraft, e.g. Link trainer · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F30/15

  Vehicle, aircraft or watercraft design · CPC title