Virtual reality with virtualization in trainers and test environments

Patent metadata

Field	Value
Publication number	US-12027072-B2
Application number	US-202318299389-A
Country	US
Kind code	B2
Filing date	Apr 12, 2023
Priority date	Nov 19, 2018
Publication date	Jul 2, 2024
Grant date	Jul 2, 2024

Abstract

Systems and methods are disclosed for virtual reality (VR) aircraft test and training environments that simultaneously leverage a high quality immersive environment engine and an operational flight program (OFP) running on a virtual flight management computer (FMC) by using a communication channels that couples the immersive VR environment engine with the virtual FMC. Existing investment in flight simulators, test environment core components, and any of navigation simulation, data link simulation, air traffic control simulation, and flight visualization modules can be advantageously employed to provide high-quality, realistic testing and training capability.

First claim

What is claimed is:

1. A virtual reality (VR) environment platform comprising:
one or more virtual machines (VMs);
a host server, wherein each of the one or more VMs are operable on the host server to emulate other systems;
a virtualization system operable on one of the one or more VMs, the virtualization system having a hardware device including one or more computer storage devices including computer-executable instructions stored thereon for operating the VR environment platform, which, on execution by the hardware device, cause the device to:
provide an immersive VR environment of an aircraft;
run, via a virtual flight management computer (FMC), an operational flight program (OFP); and
couple the immersive VR environment with the virtual FMC to permit the immersive VR environment to interact with the virtual FMC using actual packed input/output (I/O) of the aircraft.

2. The VR environment platform of claim 1 , wherein the immersive VR environment and the virtual FMC are to be coupled via a protocol buffer.

3. The VR environment platform of claim 1 , further comprising:
simulating one or more line replaceable units (LRUs) that represent specialized hardware units used in an aircraft, wherein each of the LRUs is to be simulated via a different one of the one or more VMs.

4. The VR environment platform of claim 3 , wherein simulating the one or more LRUs is to permit other components of an aircraft to be virtualized to be used with the VR environment platform.

5. The VR environment platform of claim 1 , further comprising:
a head mounted display (HMD) for displaying a view of an immersive VR environment.

6. The VR environment platform of claim 1 , further comprising:
virtual interaction points providing aircraft flight deck control inputs for the immersive VR environment.

7. The VR environment platform of claim 1 , further comprising:
a physical interaction point simulating an aircraft control and providing physical feedback to a user of the VR environment platform.

8. The VR environment platform of claim 1 , further comprising:
a flight simulator component interfacing with the immersive VR environment engine and the virtual FMC.

9. A method of operating an immersive virtual reality (VR) environment platform, the method comprising:
provide an immersive VR environment of an aircraft;
run, via a virtual flight management computer (FMC), an operational flight program (OFP); and
couple the immersive VR environment with the virtual FMC to permit the immersive VR environment to interact with the virtual FMC using actual packed input/output (I/O) of the aircraft.

10. The method of claim 9 , wherein the immersive VR environment and the virtual FMC are to be coupled via a protocol buffer.

11. The method of claim 9 , further comprising:
simulating one or more line replaceable units (LRUs) that represent specialized hardware units used in an aircraft, wherein each of the LRUs is to be simulated via a different one of the one or more VMs.

12. The method of claim 11 , wherein simulating the one or more LRUs is to permit other components of an aircraft to be virtualized to be used with the VR environment platform.

13. The method of claim 9 , further comprising:
displaying a view of an immersive VR environment on a head mounted display (HMD).

14. The method of claim 9 , further comprising:
receiving aircraft flight deck control inputs for the immersive VR environment through virtual interaction points.

15. The method of claim 9 , further comprising:
providing physical feedback to a user of the VR environment platform through a physical interaction point simulating an aircraft control.

16. The method of claim 9 , further comprising:
operating a flight simulator component interfacing with the immersive VR environment and the virtual FMC.

17. One or more computer storage devices having computer- executable instructions stored thereon for operating an immersive virtual reality (VR) environment platform, which, on execution by a computer, cause the computer to perform operations comprising:
provide an immersive VR environment of an aircraft;
run, via a virtual flight management computer (FMC), an operational flight program (OFP); and
couple the immersive VR environment with the virtual FMC to permit the immersive VR environment to interact with the virtual FMC using actual packed input/output (I/O) of the aircraft.

18. The one or more computer storage devices of claim 17 , wherein the immersive VR environment and the virtual FMC are to be coupled via a protocol buffer.

19. The one or more computer storage devices of claim 17 , simulating one or more line replaceable units (LRUs) that represent specialized hardware units used in an aircraft, wherein each of the LRUs is to be simulated via a different one of the one or more VMs.

20. The one or more computer storage devices of claim 19 , wherein simulating the one or more LRUs is to permit other components of an aircraft to be virtualized to be used with the VR environment platform.

Assignees

• Boeing Co

Inventors

• Hotra Jonathan N
• Carr Leighton J
• Hunt Antony R

Classifications

• G09B9/28

  Simulation of stick forces or the like · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06Q50/10

  Services · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G09B9/307 Primary

  by helmet-mounted projector or display (G09B9/36 takes precedence; optical parts of head-up displays G02B27/01) · CPC title