Head tracking with virtual avionics training products

Patent metadata

Field	Value
Publication number	US-12148322-B2
Application number	US-202117232375-A
Country	US
Kind code	B2
Filing date	Apr 16, 2021
Priority date	Apr 17, 2020
Publication date	Nov 19, 2024
Grant date	Nov 19, 2024

Abstract

A simulator is disclosed. The simulator includes a display configured to display a 3D simulated environment and a tracking system configured to track a target. The tracking system also includes a projection configured to illuminate the target and a sensor configured to obtain a depth-image of the target. The tracking system also includes a processor configured to determine the distance of the target and/or an angle of the face of a target from the tracking system and/or display. The simulator also includes a computing unit communicatively coupled to the display and the tracking system. The computing unit is configured to send the 3D simulated environment signal to the display and to perform an adjustment of the 3D simulated environment based on at least one of the distance of the target or an angle of a face of the target relative to at least one of the display or tracking system.

First claim

What is claimed is:

1. A simulator comprising:
a display configured to display a 3D simulated environment;
a tracking system configured to track a target, comprising:
a projector configured to illuminate the target;
a sensor configured to obtain a depth image of the target; one or more processors;
a memory communicatively coupled to the one or more processors and having instructions stored upon, which when executed by the one or more processors, cause the one or more processors to determine at least one of a distance of the target or an angle of a face of the target relative the display;

a computing unit communicatively coupled to the display and the tracking system configured to:
send a 3D simulated environment signal to the display; and
perform an adjustment of the 3D simulated environment based on at least one of the distance of the target or the angle of the face of the target relative to the display,
wherein the adjustment of the 3D simulated environment is configured to be an adjustment of a virtualized component within the 3D simulated environment and as a global adjustment, wherein the global adjustment excludes any adjustment of the display of the 3D virtualized component based on at least one of the distance of the target or the angle of the face of the target relative to at least one of the display or tracking system;
wherein the adjustment of the virtualized component is transiently tracked on the display using a mark that follows a path of movement and thereby indicates the movement of the virtualized component, wherein the virtualized component is configured as an instrument,
wherein the instrument is configured as a floor instrument, wherein the instrument is configured as a throttle quadrant,
wherein the instrument is configured as an avionic instrument panel,
wherein the display is configured as a touch sensitive display, wherein the instrument is operated via a touch upon the touch sensitive display.

2. The simulator of claim 1 , further comprising a haptic device.

3. The simulator of claim 1 , further comprising a head-mounted display.

4. The simulator of claim 1 , wherein the sensor further comprises an infrared camera.

5. The simulator of claim 1 , wherein the target comprises a head tracking device.

6. The simulator of claim 1 , further comprising a non-virtual instrument.

7. The simulator of claim 1 , wherein the display is further configured to present a virtualized window-view of a vehicle.

8. The simulator of claim 1 , further comprising a seat.

Assignees

• Rockwell Collins Inc

Inventors

• Heyd Paul
• Owen Spencer
• Loschiavo Vincent

Classifications

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06T2207/10048

  Infrared image · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G09B9/307

  by helmet-mounted projector or display (G09B9/36 takes precedence; optical parts of head-up displays G02B27/01) · CPC title

• G06T7/521

  from laser ranging, e.g. using interferometry; from the projection of structured light · CPC title