Helicopter landing system using a camera for obstacle detection

Patent metadata

Field	Value
Publication number	US-9911344-B2
Application number	US-201514808947-A
Country	US
Kind code	B2
Filing date	Jul 24, 2015
Priority date	Jul 24, 2015
Publication date	Mar 6, 2018
Grant date	Mar 6, 2018

Abstract

A camera-based obstacle detection system includes a first camera, a second camera, and one or more processors configured to acquire a first image from the first camera, acquire a second image from the second camera, determine a depth of an object based on a location of the object in the first image relative to a location of the object in the second image, and in response to the depth exceeding a threshold depth value, generate an alert.

First claim

What is claimed is:

1. A helicopter alert system comprising:
a first camera;
a second camera; and
one or more processors configured to:
acquire a first image from the first camera,
acquire a second image from the second camera,
determine a depth value of a first object based on a disparity between a location of the first object in the first image and a location of the first object in the second image;
determine a depth value of a second object based on a disparity between a location of the second object in the first image and a location of the second object in the second image;
determine a difference between the depth value of the first object and the depth value of the second object, wherein the difference between the depth value of the first object and the depth value of the second object comprises a depth variance; and
in response to the difference between the depth value of the first object and the depth value of the second object exceeding a depth variance threshold value, generate an alert.

2. The helicopter alert system of claim 1 , wherein the one or more processors are configured to determine the depth value of the first object by:
identifying a first group of pixels in the first image, wherein the first group of pixels corresponds to at least a portion of the first object,
identifying a second group of pixels in the second image, wherein the second group of pixels corresponds to the first group of pixels in the first image,
determining a disparity between a location of the first group of pixels in the first image and a location of the second group of pixels in the second image, and
based on the disparity between the location of the first group of pixels in the first image and the location of the second group of pixels in the second image, determining the depth value of the first object.

3. The helicopter alert system of claim 1 , wherein the one or more processors are further configured to:
determine a rate at which the helicopter is ascending or descending;
adjust the depth variance threshold based in part on the rate at which the helicopter is ascending or descending.

4. The helicopter alert system of claim 1 , wherein the first camera and the second camera comprise a stereo camera.

5. The helicopter alert system of claim 1 , wherein the first camera and the second camera each comprise one or more thermographic cameras.

6. The helicopter alert system of claim 1 , wherein the first camera and the second camera each comprise one or more monochromatic cameras.

7. The helicopter alert system of claim 1 , wherein the alert comprises an audio alert.

8. The helicopter alert system of claim 1 , wherein the alert comprises a visual alert.

9. The helicopter alert system of claim 1 , further comprising a smartphone, a tablet computer, or a laptop computer comprising the one or more processors.

10. The helicopter alert system of claim 1 , wherein the one or more processors are configured to wirelessly communicate with the first camera and the second camera.

11. A method comprising:
acquiring a first image from a first camera;
acquiring a second image from a second camera;
determining a depth value of a first object based on a disparity between a location of the first object in the first image and a location of the first object in the second image; and
determining a depth value of a second object based on a disparity between a location of the second object in the first image and a location of the second object in the second image;
determining a difference between the depth value of the first object and the depth value of the second object, wherein the difference between the depth value of the first object and the depth value of the second object comprises a depth variance; and
in response to the difference between the depth value of the first object and the depth value of the second object exceeding a depth variance threshold value, generating an alert.

12. The method of claim 11 , wherein determining the depth value of the first object comprises:
identifying a first group of pixels in the first image, wherein the first group of pixels corresponds to at least a portion of the first object;
identifying a second group of pixels in the second image; wherein the second group of pixels corresponds to the first group of pixels in the first image;
determining a disparity between a location of the first group of pixels in the first image and a location of the second group of pixels in the second image; and
based on the disparity between the location of the first group of pixels in the first image and the location of the second group of pixels in the second image, determining the depth value of the first object.

13. The method of claim 11 , further comprising:
determining a rate at which the helicopter is ascending or descending;
adjusting the depth variance threshold based in part on a rate at which the helicopter is ascending or descending.

14. The method of claim 11 , wherein the first camera and the second camera each comprise a stereo camera.

15. The method of claim 11 , wherein the first camera and the second camera each comprise one or more thermographic cameras.

16. The method of claim 11 , wherein the first camera and the second camera each comprise one or more monochromatic cameras.

17. The method of claim 11 , wherein the alert comprises an audio alert.

18. The method of claim 11 , wherein the alert comprises a visual alert.

19. The helicopter alert system of claim 1 , wherein the one or more processors are further configured to:
wherein to determine the difference between the depth value of the first object and the depth value of the second object, the one or more processors are configured to compare the disparity between the location of the first object in the first image and the location of the first object in the second image to the disparity between the location of the second object in the first image and the location of the second object in the second image.

20. The method of claim 11 ,
wherein determining the difference between the depth value of the first object and the depth value of the second object comprises comparing the disparity between the location of the first object in the first image and the location of the first object in the second image to the disparity between the location of the second object in the first image and the location of the second object in the second image.

Assignees

• Honeywell Int Inc

Inventors

• Kabrt Tomas
• Papageorgiou George
• Derouineau Jean Luc
• Marczi Tomas
• Orlita Michal

Classifications

• G06V20/17 Primary

  taken from planes or by drones · CPC title

• G06V10/143

  Sensing or illuminating at different wavelengths · CPC title

• G06T2207/10021

  Stereoscopic video; Stereoscopic image sequence · CPC title

• G08G5/04 Primary

  Physics · mapped topic

• G06K9/00624

  Physics · mapped topic