Systems and methods for controlling an image captured by an imaging device

Patent metadata

Field	Value
Publication number	US-10897567-B2
Application number	US-201916391610-A
Country	US
Kind code	B2
Filing date	Apr 23, 2019
Priority date	Oct 24, 2016
Publication date	Jan 19, 2021
Grant date	Jan 19, 2021

Abstract

A control device includes a display configured to show an image captured by an imaging device supported by a movable object and one or more processors configured to obtain information about a user input indicative of a target shown within the image, and generate data, based on the information about the user input indicative of the target, to effectuate an automatic control of a zoom level of the imaging device and an attitude of the imaging device relative to the target.

First claim

What is claimed is:

1. A control device, comprising: a touchscreen configured to display an image captured by an imaging device supported by a movable object, and receive a user input provided by a single user action and indicative of (1) selection of a target shown within the image and (2) selection of a zoom factor for zooming in or out of the target; and one or more processors configured to: process information about the user input, received by the touchscreen; generate control data, based on the information about the user input, the control data comprising instructions for the imaging device, a carrier supporting the imaging device, or the movable object to automatically control (1) a zoom level of the imaging device according to the user selected zoom factor and (2) an attitude of the imaging device relative to the target for positioning the target at a predetermined location within the image; and wherein the single user action comprises a deep touch or a long touch on the target, wherein the zoom factor is determined based on a degree of pressure or a period of time applied to the touchscreen or a multi-point touch and the zoom factor is determined based on user selection of one or more zoom controls shown on the touchscreen.

2. The control device of claim 1 , wherein: the user input includes a touch of a region of the touchscreen that shows the target.

3. The control device of claim 1 , wherein the information about the user input comprises a location within the touchscreen where the target is shown.

4. The control device of claim 1 , wherein the touchscreen further shows one or more zoom controls for controlling the zoom level of the imaging device, the one or more zoom controls comprising at least one of: a zoom-in control configured to increase the zoom level of the imaging device; or a zoom-out control configured to decrease the zoom level of the imaging device.

5. The control device of claim 1 , wherein the touchscreen further shows a menu which allows user selection of a predetermined zoom factor by which to automatically adjust the zoom level of the imaging device.

6. The control device of claim 1 , wherein the control data to automatically control the zoom level and the attitude comprises coordinates within the touchscreen that shows the target, to be transmitted to at least one of the imaging device, the carrier supporting the imaging device, or the movable object.

7. The control device of claim 6 , wherein the coordinates are used to generate control commands for one or more actuators of at least one of the carrier or the movable object.

8. The control device of claim 1 , wherein the control data to automatically control the zoom level and the attitude further comprises a predetermined zoom factor by which to automatically adjust the zoom level of the imaging device, to be transmitted to at least one of the imaging device, the carrier supporting the imaging device, or the movable object.

9. The control device of claim 1 , wherein the zoom level of the imaging device is further automatically controlled by automatically adjusting the zoom level of the imaging device by a predetermined zoom factor.

10. The control device of claim 1 , wherein the attitude of the imaging device relative to the target is automatically adjusted by adjusting an attitude of the imaging device relative to the movable object, an attitude of the movable object relative to the target, or both.

11. The control device of claim 1 , wherein the attitude of the imaging device relative to the target is automatically controlled so as to cause the target to be displayed at or near the predetermined location within the image.

12. The control device of claim 1 , wherein the control data is configured to automatically control the zoom level and the attitude substantially concurrently.

13. The control device of claim 1 , further comprising a communication unit configured to communicate with at least one of the imaging device, a carrier supporting the imaging device, or the movable object.

14. The control device of claim 1 , wherein the imaging device is movable relative to the movable object.

15. The control device of claim 1 , wherein the imaging device is supported by the movable object with aid of a carrier configured to permit the imaging device to rotate relative to the movable object about at least two axes.

16. The control device of claim 1 , wherein the movable object is an unmanned aerial vehicle (UAV).

17. A non-transitory computer readable medium comprising program instructions executable by one or more processors for capturing an image, the program instructions comprising: displaying, on a touchscreen, the image captured by an imaging device supported by a movable object; receiving, via the touchscreen, a user input provided by a single user action and indicative of (1) selection of a target shown within image and (2) selection of a zoom factor zooming in or out of the target; processing information about the received user input; generating control data, based on the information about the user input, control data comprising instructions for the imaging device, a carrier supporting the imaging device, or the movable object to automatically control (1) a zoom level of the imaging device according to the user selected zoom factor and (2) an attitude of the imaging device relative to the target for positioning the target at a predetermined location within the image; and wherein the single user action comprises a deep touch or a long touch on the target, wherein the zoom factor is determined based on a degree of pressure or a period of time applied to the touchscreen or a multi-point touch and the zoom factor is determined based on user selection of one or more zoom controls shown on the touchscreen.

18. A method of capturing an image, comprising: displaying, on a touchscreen, the image captured by an imaging device supported by a movable object; receiving, via the touchscreen, a user input provided by a single user action and indicative of (1) selection of a target shown within image and (2) selection of a zoom factor zooming in or out of the target; processing information about the received user input; generating control data, based on the information about the user input, control data comprising instructions for the imaging device, a carrier supporting the imaging device, or the movable object to automatically control (1) a zoom level of the imaging device according to the user selected zoom factor and (2) an attitude of the imaging device relative to the target for positioning the target at a predetermined location within the image; and wherein the single user action comprises a deep touch or a long touch on the target wherein the zoom factor is determined based on a degree of pressure or a period of time applied to the touchscreen or a multi-point touch and the zoom factor is determined based on user selection of one or more zoom controls shown on the touchscreen.

19. The control device of claim 1 , wherein the touchscreen further shows one or more zoom controls for controlling the zoom level of the imaging device, the one or more zoom controls comprising: a default zoom control for setting the zoom level of the imaging device to the user selected zoom factor or a pre-set zoom level.

20. The control device of claim 1 , wherein the touchscreen further shows one or more zoom controls for controlling the zoom level of the imaging device, wherein the one or more zoom controls are configured to be switched from a hidden state to a view state when the user input i

Assignees

• Sz Dji Technology Co Ltd

Inventors

• Wang Mingxi
• Chen Hanping
• Wang Jiadi
• Zhou Qi
• Weng Chao

Classifications

• H04N23/66

  Remote control of cameras or camera parts, e.g. by remote control devices · CPC title

• H04N23/62 Primary

  Control of parameters via user interfaces · CPC title

• H04N23/695

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• B64U2101/30

  for imaging, photography or videography · CPC title

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title