System and methodology to provide an augmented view of an environment below an obstructing structure of an aircraft

Patent metadata

Field	Value
Publication number	US-11912429-B2
Application number	US-202217658067-A
Country	US
Kind code	B2
Filing date	Apr 5, 2022
Priority date	Apr 5, 2022
Publication date	Feb 27, 2024
Grant date	Feb 27, 2024

Abstract

A display system is provided for a vehicle having a windshield and vehicle structure outside the windshield. The vehicle structure is visible within a field of view defined by the windshield. Certain embodiments of the display system include: a camera to capture image data for a visually obstructed portion of an environment outside the vehicle, wherein the visually obstructed portion of the environment is hidden by the vehicle structure; a controller configured to process the image data captured by the camera into a head-up display (HUD) image that represents the visually obstructed portion of the environment; a HUD element configured to present projected images that are visible to an occupant of the vehicle; and a projector coupled to the controller and configured to project the HUD image toward the HUD element, such that the HUD image is visible overlying the vehicle structure.

First claim

What is claimed is:

1. An aircraft comprising:
a cockpit to accommodate an occupant;
a windshield that defines a field of view for viewing an environment outside the cockpit;
an aircraft structure outside the cockpit and visible within the field of view, wherein the aircraft structure visually obstructs a portion of the environment;
an imaging system mounted to exterior structure of the aircraft and having a clear line of sight to the portion of the environment that is visually obstructed by the aircraft structure, the imaging system configured and operated to capture image data corresponding to the obstructed portion of the environment;
a controller configured to process the image data captured by the imaging system into a head-up display (HUD) image that represents the obstructed portion of the environment;
a HUD element configured to present projected images that are visible to the occupant; and
a projector coupled to the controller and configured to project the HUD image toward the HUD element, such that the HUD image is visible overlying the aircraft structure;
wherein the controller is configured to adjust an image capture angle of the imaging system based on an eye or head location of the occupant, such that image data captured by the imaging system during flight of the aircraft is processed into the HUD image to register the HUD image with an unobstructed view of the environment outside the cockpit, and such that the HUD image appears to accurately merge with visible surroundings when perceived by the occupant; and
wherein the controller reactively adjusts the image capture angle of the imaging system in response to changes in the eye or head location of the occupant.

2. The aircraft of claim 1 , wherein the aircraft structure comprises a nose cone of the aircraft.

3. The aircraft of claim 2 , wherein the imaging system comprises a camera having a captured field of view located below the nose cone.

4. The aircraft of claim 1 , wherein the HUD element comprises a transparent combiner.

5. The aircraft of claim 4 , wherein the HUD element is deployable on demand into the field of view defined by the windshield.

6. The aircraft of claim 1 , wherein the HUD element is integrated into the windshield.

7. The aircraft of claim 1 , wherein:
the imaging system comprises a left camera and a right camera; and
the controller processes image data captured by the left camera and image data captured by the right camera into a stereoscopic image.

8. A display system for a vehicle having a windshield and vehicle structure outside the windshield, wherein the vehicle structure is visible within a field of view defined by the windshield, the display system comprising:
a camera mounted to exterior structure of the vehicle and having a clear line of sight to capture image data for a visually obstructed portion of an environment outside the vehicle, wherein the visually obstructed portion of the environment is hidden by the vehicle structure;
a controller configured to process the image data captured by the camera into a head-up display (HUD) image that represents the visually obstructed portion of the environment;
a HUD element configured to present projected images that are visible to an occupant of the vehicle; and
a projector coupled to the controller and configured to project the HUD image toward the HUD element, such that the HUD image is visible overlying the vehicle structure;
wherein the controller is configured to adjust an image capture angle of the camera based on an eye or head location of the occupant, such that image data captured by the camera during operation of the vehicle is processed into the HUD image to register the HUD image with an unobstructed view of the environment outside the vehicle, and such that the HUD image appears to accurately merge with visible surroundings when perceived by the occupant; and
wherein the controller reactively adjusts the image capture angle of the camera in response to changes in the eye or head location of the occupant.

9. The display system of claim 8 , wherein the HUD element comprises a transparent combiner.

10. The display system of claim 9 , wherein the HUD element is deployable on demand into the field of view defined by the windshield.

11. The display system of claim 8 , wherein the HUD element is integrated into the windshield.

12. A head-up display (HUD) system for a vehicle having a windshield and visually obstructing vehicle structure outside the windshield, wherein the vehicle structure is visible within a field of view defined by the windshield, the HUD system comprising:
a transparent combiner that is deployable into the field of view defined by the windshield, the transparent combiner configured to present projected images that are visible to an occupant of the vehicle;
a controller configured to process image data into a HUD image that represents a visually obstructed portion of an environment outside the vehicle, the image data captured by an imaging system mounted to exterior structure of the vehicle and having a clear line of sight to a captured field of view that is unobstructed by the visually obstructing vehicle structure; and
a projector coupled to the controller and configured to project the HUD image toward the transparent combiner, such that the HUD image is visible overlying the visually obstructing vehicle structure;
wherein the controller is configured to adjust an image capture angle of the imaging system based on an eye or head location of the occupant, such that image data captured by the imaging system during operation of the vehicle is processed into the HUD image to register the HUD image with an unobstructed view of the environment outside the vehicle, and such that the HUD image appears to accurately merge with visible surroundings when perceived by the occupant; and
wherein the controller reactively adjusts the image capture angle of the camera in response to changes in the eye or head location of the occupant.

13. The HUD system of claim 12 , wherein:
the vehicle is an aircraft; and
the visually obstructing vehicle structure comprises a nose cone of the aircraft.

Assignees

• Gulfstream Aerospace Corp

Inventors

• Toler Brian

Classifications

• B64D43/00 Primary

  Arrangements or adaptations of instruments · CPC title

• B64D47/08

  Arrangements of cameras · CPC title

• G02B27/0101

  characterised by optical features (G02B27/0172 takes precedence) · CPC title

• H04N13/239

  using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) · CPC title

• H04N13/302

  for viewing without the aid of special glasses, i.e. using autostereoscopic displays · CPC title