Multi-camera system and method of use

Patent metadata

Field	Value
Publication number	US-2018210465-A1
Application number	US-201815875967-A
Country	US
Kind code	A1
Filing date	Jan 19, 2018
Priority date	Jan 23, 2017
Publication date	Jul 26, 2018
Grant date	—

Abstract

A method for operating a system including a plurality of cameras, the method including: selecting a subset of the cameras, determining a subset of pixels captured by the camera subset, determining a pixel depth associated with each pixel of the pixel subset, and controlling system operation based on the pixel depth.

First claim

We claim:

1 . A method for aircraft operation comprising, at an aircraft comprising a set of cameras:selecting a first camera group from the set of cameras, the first camera group comprising a lateral camera and a first upward-facing camera, wherein a lateral camera view region and a first upward-facing camera view region each comprise a first overlapped subset;
selecting a second camera group from the set of cameras, the second camera group comprising the first upward-facing camera and a second upward-facing camera, wherein the first upward-facing camera view region and a second upward-facing camera view region each comprise a second overlapped subset; sampling a set of images, comprising:
at the first upward-facing camera, sampling a first image at a first time;
at the second upward-facing camera, sampling a second image substantially at the first time; and
at the lateral camera, sampling a third image substantially at the first time;
based on the first camera group, selecting a first dataset comprising a first region of the first image and a region of the third image, wherein the first region of the first image and the region of the third image are each representative of a first obstacle within the first overlapped subset; based on the first dataset, determining a lateral clearance between the aircraft and the first obstacle; based on the second camera group, selecting a second dataset comprising a second region of the first image and a region of the second image, wherein the second region of the first image and the region of the second image are each representative of a second obstacle within the second overlapped subset; based on the second dataset, determining an upward clearance between the aircraft and the second obstacle; and based on the lateral clearance and the upward clearance, controlling flight of the aircraft.

2 . The method of claim 1 , wherein:
a first angle between a lateral camera central view axis and a first upward-facing camera central view axis is greater than a threshold angle; and a second angle between the lateral camera central view axis and a second upward-facing camera central view axis is greater than the threshold angle.

3 . The method of claim 2 , wherein the threshold angle is 60 degrees.

4 . The method of claim 1 , wherein selecting the second dataset comprises selecting the second region of the first image and the region of the second image based on an orientation of the aircraft.

5 . The method of claim 4 , wherein, at the first time, the aircraft and the second obstacle both intersect a vertical axis, the vertical axis parallel a gravity vector.

6 . The method of claim 1 , further comprising, based on the lateral clearance and an aircraft velocity, determining a potential collision with the first obstacle, wherein controlling flight of the aircraft comprises changing the aircraft velocity to avoid the potential collision.

7 . The method of claim 1 , wherein:
the second obstacle is a ceiling of a room containing the aircraft; and controlling flight of the aircraft comprises substantially maintaining the upward clearance at a target ceiling clearance value.

8 . The method of claim 1 , wherein the first upward-facing camera comprises a fisheye lens.

9 . The method of claim 8 , wherein the second upward-facing camera comprises a second fisheye lens and the lateral camera comprises a substantially rectilinear lens.

10 . The method of claim 1 , wherein selecting the first camera group comprises selecting the lateral camera based on an aircraft velocity vector, wherein a lateral camera view vector within the lateral camera view region is parallel the aircraft velocity vector.

11 . The method of claim 10 , further comprising, after the first time:
controlling the aircraft to change velocity to a second aircraft velocity vector substantially non-parallel the aircraft velocity vector; selecting a third camera group from the set of cameras based on the second aircraft velocity vector, the third camera group comprising a second lateral camera and the second upward-facing camera, wherein a second lateral camera view region and the second upward-facing camera view region each comprise a third overlapped subset; sampling a second set of images, comprising:
at the second upward-facing camera, sampling a fourth image at a second time; and
at the second lateral camera, sampling a fifth image substantially at the second time;
based on the third camera group, selecting a third dataset comprising a region of the fourth image and a region of the fifth image, wherein the region of the fourth image and the region of the fifth image are each representative of a third obstacle within the third overlapped subset; based on the third dataset, determining a second lateral clearance between the aircraft and the third obstacle; and based on the second lateral clearance, controlling flight of the aircraft.

12 . The method of claim 1 , wherein:
the first camera group further comprises a second lateral camera, wherein a second lateral camera view region comprises the first overlapped subset; sampling the set of images further comprises, at the second lateral camera, sampling a fourth image substantially at the first time; and the first dataset further comprises a region of the fourth image representative of the first obstacle.

13 . A method for aircraft operation comprising, at an aircraft comprising a set of cameras:
based on an aircraft traversal vector, selecting a camera group from the set of cameras, the camera group comprising: a first camera, a second camera, and a third camera, wherein:
a first camera view region, a second camera view region, and a third camera view region each comprise an overlapped subset;
a first angle between a first camera central view axis and a third camera central view axis is greater than a threshold angle; and
a second angle between a second camera central view axis and the third camera central view axis is greater than the threshold angle;
sampling a set of images, comprising:
at the first camera, sampling a first image;
substantially concurrent with sampling the first image, at the second camera, sampling a second image; and
substantially concurrent with sampling the first image, at the third camera, sampling a third image;
based on the camera group, selecting a first dataset comprising a region of the first image, a region of the second image, and a first region of the third image, wherein the region of the first image, the region of the second image, and the first region of the third image are each representative of a first obstacle within the overlapped subset; based on the first dataset, determining a first obstacle clearance between the aircraft and the first obstacle; selecting a second dataset comprising a second region of the third image, wherein the second region of the third image is representative of a second obstacle outside the overlapped subset; based on the second dataset, determining a second obstacle clearance between the aircraft and the second obstacle; and based on the first obstacle clearance and the second obstacle clearance, controlling flight of the aircraft.

14 . The method of claim 13 , wherein the threshold angle is 75 degrees.

15 . The method of claim 13 , wherein a first camera view vector within the first camera view region is parallel the aircraft traversal vector and a second camera view vector within the second camera view region is parallel the aircraft velocity vector.

16 . The method of claim 13 , further comprising:
selecting a second

Assignees

• Hangzhou Zero Zero Tech Co Ltd

Inventors

• Qu Zheng
• Jin Pengxiang
• Zhang Tong

Classifications

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/74

  by influencing the scene brightness using illuminating means · CPC title

• H04N23/11

  for generating image signals from visible and infrared light wavelengths · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title