System and method for utilization of multiple-camera network to capture static and/or motion scenes

Patent metadata

Field	Value
Publication number	US-10416667-B2
Application number	US-201615014743-A
Country	US
Kind code	B2
Filing date	Feb 3, 2016
Priority date	Feb 3, 2016
Publication date	Sep 17, 2019
Grant date	Sep 17, 2019

Abstract

Various aspects of a system and method for utilization of multiple-camera network to capture static and/or motion scenes are disclosed herein. The system comprises a plurality of unmanned aerial vehicles (UAVs). Each of the plurality of UAVs is associated with an imaging device configured to capture a plurality of images. A first UAV of the plurality of UAVs comprises a first imaging device configured to capture a first set of images of one or more static and/or moving objects. The first UAV is configured to receive focal lens information, current location and current orientation from one or more imaging devices. A target location and a target orientation of each of the one or more imaging devices are determined. Control information is communicated to the one or more other UAVs to modify the current location and current orientation to the determined target location and orientation of each of the one or more imaging devices.

First claim

What is claimed is:

1. A system, comprising:
a plurality of imaging devices; and
a network comprising a plurality of unmanned aerial vehicles (UAVs), wherein
each of said plurality of UAVs is associated with an imaging device of said plurality of imaging devices,
said imaging device is configured to capture a plurality of images, and
a first UAV of said plurality of UAVs comprises:
a first imaging device of said plurality of imaging devices, wherein said first imaging device is configured to capture a first set of images of at least one of at least one static object or at least one moving object; and
at least one circuit configured to:
receive, from at least one imaging device of said plurality of imaging devices, focal lens information, a current location and a current orientation of said at least one imaging device,
wherein said at least one imaging device is associated with at least one second UAV of said plurality of UAVs, and said at least one second UAV is different from said first UAV;
determine a target location and a target orientation of said at least one imaging device based on said received focal lens information, said received current location, said received current orientation, and a current location of said at least one of said at least one static object or said at least one moving object;
determine calibration information based on said received focal lens information and at least one image of a specific calibration object;
communicate control information and said calibration information to said at least one second UAV;
modify said current location and said current orientation of said at least one imaging device to said determined target location and said determined target orientation based on said communicated control information; and
enable calibration of said at least one imaging device of said at least one second UAV based on said communicated calibration information.

2. The system according to claim 1 , wherein
said communicated control information further comprises capture information,
said at least one imaging device is configured to capture, based on said capture information, a second set of images of said at least one of said at least one static object or said at least one moving object, and
said second set of images is captured at said determined target location and said determined target orientation.

3. The system according to claim 2 , wherein said at least one circuit is further configured to reconstruct a three dimensional (3D) structure from said captured first set of images and said captured second set of images.

4. The system according to claim 3 , wherein said at least one circuit is further configured to dynamically synchronize said captured first set of images and said captured second set of images to reconstruct said 3D structure.

5. The system according to claim 1 , wherein
said at least one imaging device is configured to capture said at least one image of said specific calibration object.

6. The system according to claim 1 , wherein said at least one circuit is further configured to adjust at least one of intrinsic parameters or extrinsic parameters of said at least one imaging device based on said calibration.

7. A server, comprising:
at least one circuit configured to:
receive, from a plurality of imaging devices, focal lens information, a current location and a current orientation of said plurality of imaging devices, wherein
said plurality of imaging devices are associated with a plurality of unmanned aerial vehicles (UAVs),
said plurality of imaging devices capture a plurality of images, and
said plurality of UAVs are communicatively coupled with said server;

determine a target location and a target orientation of said plurality of imaging devices based on said received focal lens information, said received current location, said received current orientation and a current location of at least one of at least one static object or at least one moving object;
determine calibration information based on said received focal lens information and at least one image of a specific calibration object;
communicate control information and said calibration information to said plurality of UAVs;
modify said current location and said current orientation of said plurality of imaging devices to said determined target location and said determined target orientation of said plurality of imaging devices based on said communicated control information; and
enable calibration of said plurality of imaging devices based on said communicated calibration information.

8. The server according to claim 7 , wherein
said communicated control information further comprises capture information,
and a set of images of said at least one of said at least one static object or said at least one moving object is captured by said plurality of imaging devices based on said capture information, and
said set of images is captured at said determined target location and said determined target orientation.

9. The server according to claim 8 , wherein said at least one circuit is further configured to reconstruct a three dimensional (3D) structure from said captured set of images.

10. The server according to claim 9 , wherein said at least one circuit is further configured to dynamically synchronize said captured set of images to reconstruct said 3D structure.

11. The server according to claim 7 ,
wherein said at least one image of said specific calibration object is captured by said plurality of imaging devices.

12. A system, comprising:
a plurality of imaging devices; and
a first network comprising a first set of unmanned aerial vehicles (UAVs) and a second network comprising a second set of UAVs, wherein
each of said first set of UAVs and said second set of UAVs is associated with an imaging device of said plurality of imaging devices,
said imaging device is configured to capture a plurality of images, and
a first UAV of said first set of UAVs comprises:
a first imaging device of said plurality of imaging devices, wherein said first imaging device is configured to capture a first set of images of at least one of at least one static object or at least one moving object; and
at least one first circuit configured to:
receive, from a first set of imaging devices of said plurality of imaging devices, focal lens information, a current location and a current orientation of said first set of imaging devices,
said first set of imaging devices are associated with said first set of UAVs;
determine a target location and a target orientation of said first set of imaging devices based on said received focal lens information, said received current location, said received current orientation and a current location of said at least one of said at least one static object or said at least one moving object;
determine calibration information based on said received focal lens information and at least one image of a specific calibration object;
communicate control information and said calibration information to said first set of UAVs;
modify said current location and said current orientation of said first set of imaging devices to said determined target location and said determined target orientation of said first set of imaging devices based on said communicated control information; and
enable calibration of said at least one imaging device of said first set of UAVs based on said communicated calibration information.

13. The system according to claim 12 , wherein a second UAV of said second set of UAVs comprises:
a second imaging device of said plurality of imaging devices, said second imaging device is con

Assignees

• Sony Corp

Inventors

• Berestov Alexander
• Liu Ming-Chang
• Lee Chuen-Chien

Classifications

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T15/205

  Image-based rendering · CPC title

• H04N23/66

  Remote control of cameras or camera parts, e.g. by remote control devices · CPC title

• B64U2201/102

  adapted for flying in formations · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title