Method and system for controlling gimbal

Patent metadata

Field	Value
Publication number	US-10871258-B2
Application number	US-201916265595-A
Country	US
Kind code	B2
Filing date	Feb 1, 2019
Priority date	Aug 3, 2016
Publication date	Dec 22, 2020
Grant date	Dec 22, 2020

Abstract

A method for controlling a gimbal includes obtaining an image recorded by an image sensor that is carried by the gimbal, extracting a reference object from the image, determining an offset attitude angle of the image sensor according to position information of the reference object in a preset coordinate system, and adjusting the attitude of the image sensor by the gimbal according to the offset attitude angle.

First claim

What is claimed is:

1. A method for controlling a gimbal comprising:
obtaining an image recorded by an image sensor that is carried by the gimbal;
performing a distortion correction on the image to generate a corrected image;
extracting a reference object from the corrected image;
determining an offset attitude angle of the image sensor according to position information of the reference object in a preset coordinate system; and
adjusting the attitude of the image sensor by the gimbal according to the offset attitude angle.

2. The method according to claim 1 , wherein extracting the reference object from the corrected image comprises:
extracting features in the corrected image;
determining characteristic values of the features; and
determining, according to the characteristic values of the features, a feature whose characteristic value satisfies a preset selection rule from the features as the reference object.

3. The method according to claim 2 , wherein the features comprise at least one of a straight line, a regular curve, or a point.

4. The method according to claim 3 , wherein when the features include straight lines, determining the characteristic values of the features comprises:
determining at least one of a grayscale of regions on two sides of one of the straight lines, a color of the regions on two sides of the one of the straight lines, a uniformity of the one of the straight lines, or an angle of the one of the straight lines.

5. The method according to claim 4 , wherein determining, according to the characteristic values of the features, the feature whose characteristic value satisfies the preset selection rule from the features as the reference object, comprises:
selecting, from the straight lines, a straight line whose characteristic value is greater than a preset threshold as the reference object.

6. The method according to claim 5 , wherein selecting the straight line whose characteristic value is greater than the preset threshold as the reference object, comprises:
identifying, using a least square method, a straight line having a smallest error when being simultaneously parallel or perpendicular to each of straight lines having characteristic values greater than the preset threshold as the reference object.

7. The method according to claim 1 , wherein before extracting the reference object from the corrected image, the method further comprises:
performing a projection transformation on the corrected image according to an attitude angle of the image sensor when the image sensor is recording the image.

8. The method according to claim 7 , wherein:
the attitude angle comprises a pitch angle and a roll angle; and
performing the projection transformation on the corrected image according to the attitude angle of the image sensor when the image sensor is recording the image, comprises:
calculating a first rotation matrix according to the pitch angle of the image sensor when the image sensor is recording the image and a second rotation matrix according to the roll angle of the image sensor when the image sensor is recording the image;
multiplying the first rotation matrix and the second rotation matrix to obtain an overall rotation matrix; and
performing a coordinate transformation on coordinates of pixels on the image, according to the overall rotation matrix.

9. The method according to claim 1 , wherein determining the offset attitude angle of the image sensor, according to the position information of the reference object in the preset coordinate system, comprises:
calculating a rotation matrix of the reference object in the preset coordinate system with respect to a specific direction; and
decomposing the rotation matrix to obtain the offset attitude angle of the image sensor.

10. The method according to claim 9 , wherein the specific direction comprises at least one of a horizontal direction, a vertical direction, or a preset direction detected by the attitude sensor.

11. The method according to claim 9 , wherein before calculating the rotation matrix of the reference object in the preset coordinate system with respect to the specific direction, the method further comprises:
performing an inverse projection transformation on the reference object according to the attitude angle of the image sensor when the image sensor is recording the image.

12. The method according to claim 9 , wherein adjusting the attitude of the image sensor by the gimbal, according to the offset attitude angle, comprises:
controlling a power apparatus of the gimbal to adjust the attitude of the image sensor, such that the reference object in the image recorded by the adjusted image sensor coincides with the specific direction.

13. A method for controlling an electronic image stabilization system comprising:
obtaining an image in a capture area on an image sensor;
performing a distortion correction on the image to generate a corrected image;
extracting a reference object from the corrected image;
determining an offset attitude angle of a view angle corresponding to the capture area, according to position information of the reference object in a preset coordinate system; and
adjusting a position of the capture area, according to the offset attitude angle.

14. The method according to claim 13 , wherein extracting the reference object from the corrected image comprises:
extracting features in the corrected image;
determining characteristic values of the features; and
determining, according to the characteristic values of the features, the feature whose characteristic value satisfies a preset selection rule from the features as the reference object.

15. The method according to claim 13 , wherein before extracting the reference object from the corrected image, the method further comprises:
performing a projection transformation on the corrected image, according to the attitude angle of the view angle corresponding to the capture area when the capture area is capturing the image.

Assignees

• Sz Dji Osmo Technology Co Ltd

Inventors

• Mao Chenglin
• Bao Linchao
• Hu Pan
• Cao Zisheng

Classifications

• H04N23/611 Primary

  where the recognised objects include parts of the human body · CPC title

• F16M11/123 Primary

  the axis of rotation intersecting in a single point, e.g. by using gimbals · CPC title

• H04N23/695

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• H04N23/68

  for stable pick-up of the scene, e.g. compensating for camera body vibrations · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title