Multi-gimbal assembly

Patent metadata

Field	Value
Publication number	US-11233943-B2
Application number	US-201916540457-A
Country	US
Kind code	B2
Filing date	Aug 14, 2019
Priority date	Feb 24, 2017
Publication date	Jan 25, 2022
Grant date	Jan 25, 2022

Abstract

A method includes showing a plurality of regions on a display each associated with a respective gimbal of a plurality of gimbals carried by a movable object and configured to depict data captured by a payload carried by the respective gimbal. The plurality of regions include a first region and a second region, and the plurality of gimbals include a first gimbal associated with the first region and a second gimbal associated with the second region. The method further includes, in response to a user interaction with the first region, controlling operation of the first gimbal and not operation of the second gimbal based on the user interaction with the first region when the movable object is operating in an independent mode, and simultaneously controlling the operation of the first gimbal and at least the operation of the second gimbal in a synchronized manner based on the user interaction with the first region when the movable object is operating in a simultaneous mode.

First claim

What is claimed is:

1. A method of controlling operation of a plurality of gimbals carried by a movable object, comprising:
showing, on a display, a plurality of regions, each region associated with a respective gimbal of the plurality of gimbals and configured to depict data captured by a payload carried by the respective gimbal; and
in response to a user interaction with a first region of the plurality of regions, the first region associated with a first gimbal of the plurality of gimbals:
controlling operation of the first gimbal and not operation of a second gimbal of the plurality of gimbals based on the user interaction with the first region when the movable object is operating in an independent mode; and
simultaneously controlling the operation of the first gimbal and at least the operation of the second gimbal in a synchronized manner based on the user interaction with the first region when the movable object is operating in a simultaneous mode.

2. The method of claim 1 , further comprising switching between the independent mode and the simultaneous mode in response to a user input via a control interface remote to the movable object.

3. The method of claim 1 , further comprising identifying the first gimbal and the second gimbal for simultaneous control based on selection of regions associated with the first gimbal and the second gimbal.

4. The method of claim 1 , wherein:
in the independent mode, the operation of the first gimbal is controlled by the user touching and dragging the data in the first region and the operation of the second gimbal is controlled by the user touching and dragging the data in a second region associated with the second gimbal; and
in the simultaneous mode, the operation of the first gimbal and the operation of the second gimbal are controlled in a synchronized manner by the user touching and dragging a selected region of the plurality of regions.

5. The method of claim 4 , wherein a non-selected region is within the selected region and smaller than the selected region.

6. The method of claim 4 , wherein the data in the first region includes a first image captured by a first imaging device carried by the first gimbal, and the data in the second region includes a second image captured by a second imaging device carried by the second gimbal.

7. The method of claim 6 , wherein controlling the operation of the first gimbal comprises adjusting an orientation of the first gimbal relative to the movable object, and controlling the operation of the second gimbal comprises adjusting an orientation of the second gimbal relative to the movable object.

8. The method of claim 7 , wherein:
adjusting the orientation of the first gimbal includes at least one of:
adjusting the orientation of the first gimbal for a first rotation angle directly correlated to a degree of dragging the first image;
adjusting the orientation of the first gimbal at a first speed directly correlated to a speed of dragging the first image; or
adjusting the orientation of the first gimbal in a first direction directly correlated to a direction of dragging the first image; or

adjusting the orientation of the second gimbal includes at least one of:
adjusting the orientation of the second gimbal for a second rotation angle directly correlated to a degree of dragging the second image;
adjusting the orientation of the second gimbal at a second speed directly correlated to a speed of dragging the second image; or
adjusting the orientation of the second gimbal in a second direction directly correlated to a direction of dragging the second image.

9. The method of claim 1 ,
wherein:
a second region of the plurality of regions that is associated with the second gimbal is within the first region;
the data in the first region includes a first image captured by a first imaging device carried by the first gimbal; and
the data in the second region includes a second image captured by a second imaging device carried by the second gimbal;

the method further comprising:
in response to a touch of the second image in the second region, causing the second image to occupy the first region and the first image to occupy the second region.

10. The method of claim 9 , wherein:
the operation of the first gimbal is controlled by touching and dragging the first image when the first image is within the first region; and
the operation of the second gimbal is controlled by touching and dragging the second image when the second image is within the first region.

11. A controller for controlling operation of a plurality of gimbals carried by a movable object, comprising:
a display configured to show a plurality of regions, each region associated with a respective gimbal of the plurality of gimbals and depicting data captured by a payload carried by the respective gimbal; and
one or more processors configured to, in response to a user interaction with a first region of the plurality of regions, the first region associated with a first gimbal of the plurality of gimbals:
control operation of the first gimbal and not operation of a second gimbal of the plurality of gimbals based on the user interaction with the first region when the movable object is operating in an independent mode; and
simultaneously control the operation of the first gimbal and at least the operation of the second gimbal in a synchronized manner based on the user interaction with the first region when the movable object is operating in a simultaneous mode.

12. The controller of claim 11 , wherein the one or more processors are further configured to switch between the independent mode and the simultaneous mode in response to a user input via a control interface remote to the movable object.

13. The controller of claim 11 , wherein the one or more processors are further configured to identify the first gimbal and the second gimbal for simultaneous control based on selection of regions associated with the first gimbal and the second gimbal.

14. The controller of claim 11 , wherein:
in the independent mode, the operation of the first gimbal is controlled by the user touching and dragging the data in the first region and the operation of the second gimbal is controlled by the user touching and dragging the data in a second region associated with the second gimbal; and
in the simultaneous mode, the operation of the first gimbal and the operation of the second gimbal are controlled in a synchronized manner by the user touching and dragging a selected region of the plurality of regions.

15. The controller of claim 14 , wherein a non-selected region is within the selected region and smaller than the selected region.

16. The controller of claim 14 , wherein the data in the first region includes a first image captured by a first imaging device carried by the first gimbal, and the data in the second region includes a second image captured by a second imaging device carried by the second gimbal.

17. The controller of claim 16 , wherein the one or more processors are configured to control the operation of the first gimbal by adjusting an orientation of the first gimbal relative to the movable object, and to control the operation of the second gimbal by adjusting an orientation of the second gimbal relative to the movable object.

18. The controller of claim 17 , wherein:
adjusting the orientation of the first gimbal includes at least one of:
adjusting the orientation of the first gimbal for a first rotation angle directly correlated to a degree of dragging the first image;
adjusting the orientation of the

Assignees

• Sz Dji Technology Co Ltd

Inventors

• Wang Mingxi
• Zhou Qi
• Chen Hanping

Classifications

• H04N23/661

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• H04N23/695

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/45

  for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title