In-flight training simulation displaying a virtual environment

Patent metadata

Field	Value
Publication number	US-11189189-B2
Application number	US-201917260050-A
Country	US
Kind code	B2
Filing date	Jul 29, 2019
Priority date	Aug 2, 2018
Publication date	Nov 30, 2021
Grant date	Nov 30, 2021

Abstract

Method and system for displaying virtual environment during in-flight simulation. A simulation environment is selected for a training simulation of an airborne platform operating in flight within a real environment. The position and orientation of a display viewable by an operator of the airborne platform is determined with respect to the selected simulation environment. The display displays at least one simulation image comprising a view from a virtual altitude of simulation environmental terrain in the selected simulation environment, while the airborne platform is in flight at a real altitude above the real environmental terrain in the real environment, the virtual altitude above the simulation environmental terrain being a lower altitude than the real altitude above the real environmental terrain. The simulation image is displayed in accordance with the determined position and orientation of the display, such that the simulation environment is adaptive to operator manipulations of the airborne platform.

First claim

The invention claimed is:

1. A method for displaying a virtual environment during an in-flight simulation, the method comprising the procedures of:
selecting a simulation environment for a training simulation of an airborne platform;
operating the airborne platform in a flight within a real environment;
determining the position and orientation with respect to the selected simulation environment of a display viewable by an operator of the airborne platform;
displaying at least one simulation image on the display, in accordance with the determined position and orientation, the simulation image comprising a view from a virtual altitude of simulation environmental terrain in the selected simulation environment, while the airborne platform is in flight at a real altitude above real environmental terrain in the real environment, the virtual altitude above the simulation environmental terrain being a lower altitude than the real altitude above the real environmental terrain; and
displaying the simulation image such that the simulation environment is adaptive to operator manipulations of the airborne platform.

2. The method of claim 1 , wherein the airborne platform is subject to physical constraints associated with the simulation environment.

3. The method of claim 1 , wherein the display is configured to display at least one virtual element or supplementary image associated with the simulation environment.

4. The method of claim 1 , wherein the simulation environment is selected from the group consisting of:
a search and rescue scenario;
an urban combat scenario;
a mountainous terrain;
a nautical terrain;
a low altitude flight;
a nap-of-the-earth (NOE) flight;
an engagement with aerial threats;
a flight formation with other airborne platforms;
a ground troops coordination scenario;
an obstacle avoidance scenario; and
any combination of the above.

5. The method of claim 1 , further comprising the procedure of ensuring that the airborne platform does not exceed at least one safety threshold.

6. The method of claim 1 , wherein the airborne platform is a helicopter.

7. The method of claim 1 , wherein the display is a see-through display, and wherein the simulation image is displayed overlaid onto the external scene.

8. The method of claim 1 , further comprising the procedure of performing a statistical analysis of at least one training simulation using a machine learning process.

9. The method of claim 8 , wherein the training simulation is customized for the operator, based on information learned about the operator from a statistical analysis using the machine learning process.

10. A system for displaying a virtual environment during an in-flight simulation, the system comprising:
a display, viewable by an operator of an airborne platform;
a detector, configured to detect the position and orientation of the display with respect to a selected simulation environment of a training simulation of the airborne platform; and
a processor, configured to retrieve at least one simulation image comprising a view from a virtual altitude of simulation environmental terrain in the selected simulation environment, while the airborne platform is in flight at a real altitude above the real environmental terrain in the real environment, the virtual altitude above the simulation environmental terrain being a lower altitude than the real altitude above the real environmental terrain;
wherein the display is configured to display the simulation image in accordance with the detected position and orientation, such that the simulation environment is adaptive to operator manipulations of the airborne platform.

11. The system of claim 10 , wherein the airborne platform is subject to physical constraints associated with the simulation environment.

12. The system of claim 10 , wherein the display is configured to display at least one virtual element or supplementary image associated with the simulation environment.

13. The system of claim 10 , wherein the simulation environment is selected from the group consisting of:
a search and rescue scenario;
an urban combat scenario;
a mountainous terrain;
a nautical terrain;
a low altitude flight;
a nap-of-the-earth (NOE) flight;
an engagement with aerial threats;
a flight formation with other airborne platforms;
a ground troops coordination scenario;
an obstacle avoidance scenario; and
any combination of the above.

14. The system of claim 10 , wherein the airborne platform is a helicopter.

15. The system of claim 10 , further comprising at least one element selected from the group consisting of:
an image sensor, configured to capture at least one image of the real environment;
flight instruments, configured to provide real-time flight parameters of the airborne platform;
a database, comprising images of simulation environments and information relating to training simulations;
a digital elevation map, comprising terrain information; and
a geographic information source, configured to provide real-time information relating to the real environment or simulation environment.

16. The system of claim 10 , wherein the display is a see-through display and wherein the simulation image is displayed overlaid onto the external scene.

17. The system of claim 10 , wherein the display is selected from the group consisting of:
a head-up display (HUD) of the airborne platform; and
a head-mounted display (HMD) worn by the operator of the airborne platform.

18. The system of claim 10 , wherein the processor is further configured to perform a statistical analysis of at least one training simulation using a machine learning process.

19. The system of claim 18 , wherein the training simulation is customized for the operator, based on information learned about the operator from a statistical analysis using the machine learning process.

Assignees

• Elbit Systems Ltd

Inventors

• Rosolio Beery
• Bachar Lior Marcus

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G09B9/24 Primary

  including display or recording of simulated flight path · CPC title

• G09B9/307

  by helmet-mounted projector or display (G09B9/36 takes precedence; optical parts of head-up displays G02B27/01) · CPC title

• G06N20/00

  Machine learning · CPC title

• G09B9/46

  the aircraft being a helicopter · CPC title