Augmented reality system for pilot and passengers

Patent metadata

Field	Value
Publication number	US-11760503-B2
Application number	US-202017039081-A
Country	US
Kind code	B2
Filing date	Sep 30, 2020
Priority date	Mar 6, 2017
Publication date	Sep 19, 2023
Grant date	Sep 19, 2023

Abstract

An aircraft having an augmented reality flight control system integrated with and operable from the pilot seat and an associated pilot headgear unit, wherein the flight control system is supplemented by flight-assisting artificial intelligence and geo-location systems is presented. The present disclosure includes an augmented reality flight control system incorporating real-world objects with virtual elements to provide relevant data to a pilot during aircraft flight. A translucent substrate is disposed in the pilot's field of view such that the pilot can see therethrough, and observe virtual elements displayed on the substrate. The system includes a headgear that is worn by the pilot. A flight assistance module is configured to receive data related to the aircraft and provide predictive assistance to the pilot during flight based on the received data based in part on a pilot profile having preferences related to the pilot.

First claim

What is claimed is:

1. An augmented reality flight control system, comprising:
a virtual flight control device operably coupled to a translucent substrate disposed in a pilot's field of view and configured to generate and display one or more virtual elements on the substrate;
a flight assistance module configured to receive data related to the aircraft and provide predictive assistance to the pilot during flight;
a flight-assisting artificial intelligence system operably coupled to the pilot headgear system, wherein the artificial intelligence system is adapted to:
control, by one or more processors, the aircraft as necessary to implement corrective action during flight; and
perform, by one or more processors, a flight maneuver.

2. The augmented reality flight control system of claim 1 , further comprising a plurality of speakers, positioned to provide directional sound related to a location of objects and virtual elements inside and outside of an aircraft such that the pilot perceives a sound emanating from a direction of the location.

3. The augmented reality flight control system of claim 1 , further comprising a camera configured to receive visual input related to the pilot.

4. The augmented reality flight control system of claim 1 , further comprising a microphone configured to receive audible input from the pilot.

5. The augmented reality flight control system of claim 1 , further comprising a plurality of accelerometers coupled to the headgear and configured to determine the position of the pilot's head in three-dimensional space.

6. The augmented reality flight control system of claim 1 , wherein the flight assistance module auto-tunes a radio's frequency based on the location of the aircraft.

7. The augmented reality flight control system of claim 6 , wherein the flight assistance module awaits pilot authorization to change radio frequencies.

8. The augmented reality flight control system of claim 1 , further comprising a sensory feedback module configured to provide sensory alerts to the pilot related to the received data.

9. The augmented reality flight control system of claim 1 , wherein the artificial intelligence system is further adapted to:
prioritize, by one or more processors, information supplied to a pilot; and
filter, by one or more processors, information received by the pilot to ensure accuracy and timeliness.

10. An aircraft, comprising:
a pilot headgear system including an accelerometer that generates head position data, a helmet, and a transparent visor attached to the helmet, wherein the visor provides a virtual display of at least a portion of an instrument panel on the visor, dependent on the head position data; and
an augmented reality flight control system integrated with and operable from the pilot headgear system, wherein the flight control system includes a flight-assisting artificial intelligence system integrated with and operable from the pilot headgear system, wherein the artificial intelligence system is adapted to:
notify, by one or more processors, the pilot of changing conditions; and
control, by one or more processors, the aircraft as necessary to implement corrective action during flight.

11. The aircraft of claim 10 , wherein the pilot headgear system includes a camera for capturing data related to objects and gestures.

12. The aircraft of claim 11 , wherein the augmented reality flight control system can determine locations of hand gestures and correlate the gesture location with the virtual display to determine one or more functions related to the portion of an instrument panel.

13. The aircraft of claim 12 , wherein the augmented reality flight control system can display the one or more functions on the visor.

14. The aircraft of claim 10 , further comprising a communications headset including microphone and loudspeakers embedded within the pilot headgear.

15. The aircraft of claim 10 , further comprising a virtual display system configurable to display computer-generated images, via one or more processors, for presenting and manipulating at least flight information, flight plans, maps, spatial representations and symbolic overlays of landing sites, and topographical features.

16. The aircraft of claim 10 , further comprising a configuration for representing geospatial space including defined quadrants for projecting flight vectors, glide paths, or radio frequencies.

17. The aircraft of claim 10 , wherein the pilot headgear system further comprises:
a predictive reality module for assisting the pilot with anticipated conditions along a flight path; and
an automated flight path control system that updates pertinent data thereof to the pilot in real time.

18. The aircraft of claim 10 , wherein the pilot headgear system further comprises a voice recognition system.

19. The aircraft of claim 10 , wherein the artificial intelligence system is further adapted to:
prioritize, by one or more processors, information supplied to a pilot; and
filter, by one or more processors, information received by the pilot to ensure accuracy and timeliness.

20. The aircraft of claim 10 , wherein the artificial intelligence system is further adapted to:
calculate, by one or more processors, an alternate flight path; and
perform, by one or more processors, a flight maneuver.

Assignees

• Textron Innovations Inc

Inventors

• Chavez Jeremy Robert
• Bilbrey Levi
• Williamson James R

Classifications

• G08G5/76

  for monitoring atmospheric conditions · CPC title

• G08G5/55

  for a single aircraft · CPC title

• G08G5/50

  Navigation or guidance aids · CPC title

• G08G5/34

  for flight plan modification · CPC title

• G08G5/21

  located onboard the aircraft · CPC title