Augmented reality system for assessing an affected area of an aircraft

Patent metadata

Field	Value
Publication number	US-9646431-B2
Application number	US-201414520642-A
Country	US
Kind code	B2
Filing date	Oct 22, 2014
Priority date	Oct 22, 2014
Publication date	May 9, 2017
Grant date	May 9, 2017

Abstract

A system for assessing an affected area of an aircraft is disclosed. A reference marker having a known size is placed along an exterior of the aircraft. The system includes a portable electronic device including a processor in communication with a structural database. The structural database includes a template that defines a maximum allowable size of damage to the aircraft. The processor executes an instruction for determining an actual size of the affected area based on the known size of the reference marker. The processor executes an instruction for comparing the actual size of the affected area of the aircraft with the maximum allowable size of damage to the aircraft. The processor executes an instruction for determining if the actual size of the affected area exceeds the maximum allowable size of damage to the aircraft. The processor executes an instruction for determining a further action.

First claim

What is claimed is:

1. A system for assessing an affected area of an aircraft, wherein a reference marker having a known size is placed along an exterior of the aircraft, the system comprising:
a portable electronic device including a processor in communication with a structural database, wherein the structural database includes a template that defines a maximum allowable size of damage to the exterior of the aircraft, the processor executing instructions for:
determining an actual size of the affected area based on the known size of the reference marker;
comparing the actual size of the affected area with the maximum allowable size of damage to the exterior of the aircraft;
determining if the actual size of the affected area exceeds the maximum allowable size of damage to the aircraft; and
determining a further action based on the actual size of the affected area exceeding the maximum allowable size of the damage.

2. The augmented reality system as recited in claim 1 , wherein the structural database includes positional information of exterior features of the aircraft.

3. The augmented reality system as recited in claim 2 , wherein the processor executes an instruction for determining if the affected area is located within a reduced vertical separation minimum (RVSM) critical area of the aircraft based on the positional information stored in the structural database.

4. The augmented reality system as recited in claim 3 , wherein the processor executes an instruction for generating a general image of the aircraft upon a display of the portable electronic device.

5. The augmented reality system as recited in claim 4 , wherein the processor executes an instruction for generating a high resolution image of the aircraft upon the display, wherein the high resolution image is an enlarged view of the affected area of the aircraft and the reference marker.

6. The augmented reality system as recited in claim 5 , wherein the further action is sending the high resolution image of the aircraft and the actual size of the affected area to a computing device of a maintenance engineer if the affected area is within the RVSM critical area.

7. The augmented reality system as recited in claim 5 , wherein the further action is sending the high resolution image of the aircraft and the actual size of the affected area to a computing device of a maintenance engineer if the actual size of the affected area exceeds the maximum allowable size of the damage.

8. The augmented reality system as recited in claim 5 , wherein the further action is allowing the aircraft to fly if the actual size of the affected area is less than the maximum allowable size of damage and the affected area is not within the RVSM critical area.

9. The augmented reality system as recited in claim 1 , wherein the processor executes an instruction for generating an user prompt upon a display of the portable electronic device prompting an individual to select a central area of the affected area.

10. The augmented reality system as recited in claim 1 , wherein the processor executes an instruction for calculating the position of the reference marker placed upon the exterior of the aircraft.

11. The augmented reality system as recited in claim 1 , wherein the portable electronic device includes an imaging device.

12. The augmented reality system as recited in claim 11 , wherein the imaging device is one of a stereoscopic camera, a digital camera and a video recorder.

13. The augmented reality system as recited in claim 11 , wherein the imaging device is a stereoscopic camera, and wherein the processor determines if the size of the affected area exceeds the maximum allowable size of the damage based on a three-dimensional coordinate system.

14. The augmented reality system as recited in claim 1 , wherein the processor is communication with a flight maintenance and dispatch database of an airline.

15. The augmented reality system as recited in claim 14 , wherein the flight maintenance and dispatch database is located at an airline's main maintenance hub, and wherein the aircraft and the portable electronic device are located at an airline outstation.

16. The augmented reality system as recited in claim 1 , wherein the portable electronic device is selected from the group consisting of: a smartphone, tablet computer, laptop computer, and a pair of augmented reality glasses.

17. A method of assessing an affected area located at an exterior of the aircraft using a portable electronic device, the method comprising:
placing a reference marker adjacent the affected area of the aircraft, wherein the aircraft has a reduced vertical separation minimum (RVSM) critical area;
calculating a position of the reference marker based on aircraft coordinates by a processor of the portable electronic device;
determining, by the processor, an actual size of the affected area based on a known size of the reference marker;
comparing, by the processor, the actual size of the affected area with a maximum allowable size of damage to the exterior of the aircraft, wherein a structural database in communication with the processor includes a template that defines the maximum allowable size of damage to the aircraft;
determining, by the processor, if the actual size of the affected area exceeds the maximum allowable size of damage;
determining, by the processor, whether the affected area is located within the RVSM critical area based on positional information of exterior features of the aircraft stored in the structural database and the position of the reference marker; and
determining further action by the processor based on at least one of the actual size of the affected area and if the affected area is located within the RVSM critical area.

18. The method of claim 17 , comprising inputting a specific model of the aircraft into the portable electronic device using a user interface of the portable electronic device.

19. The method of claim 18 , comprising generating a general image of the aircraft upon a display of the portable electronic device.

20. The method of claim 19 , comprising generating a high resolution image of the aircraft upon a display of the portable electronic device, wherein the high resolution image is an enlarged view of the affected area of the aircraft and the reference marker.

Assignees

• Boeing Co

Inventors

• Schwartz Samantha A
• Lutz Andre
• Douglas Rex Bryon
• Boecher Nicolas

Classifications

• G07C2205/02

  using a vehicle scan tool · CPC title

• G07C5/008 Primary

  communicating information to a remotely located station (transmission systems for measured values G08C) · CPC title

• B64F5/60 Primary

  Testing or inspecting aircraft components or systems · CPC title

• G07C5/0825 Primary

  using optical means · CPC title

• G07C5/0808

  Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005) · CPC title