Method and device for controlling flight, control terminal, flight system and processor

Patent metadata

Field	Value
Publication number	US-11613354-B2
Application number	US-202117456740-A
Country	US
Kind code	B2
Filing date	Nov 29, 2021
Priority date	Mar 1, 2016
Publication date	Mar 28, 2023
Grant date	Mar 28, 2023

Abstract

A method for controlling flight includes displaying, in a real-time manner, a picture photographed and sent by a photographing device carried by an aerial vehicle; determining a no-clicking area in the picture based on a position of an obstacle or a no-fly zone; receiving a click operation of a user on the picture; and controlling a flight of the aerial vehicle based on the click operation. Controlling the flight of the aerial vehicle based on the click operation includes invalidating the click operation in response to determining a click location of the click operation being in the no-clicking area; and controlling the flight of the aerial vehicle based on a position of the click location in response to determining the click location being not in the no-clicking area.

First claim

What is claimed is:

1. A method for controlling flight comprising:
displaying, in a real-time manner, a picture photographed and sent by a photographing device carried by an aerial vehicle;
determining a no-clicking area in the picture based on a position of an obstacle or a no-fly zone;
receiving a click operation of a user on the picture; and
controlling a flight of the aerial vehicle based on the click operation, including:
invalidating the click operation in response to determining a click location of the click operation being in the no-clicking area; and
controlling the flight of the aerial vehicle based on a position of the click location in response to determining the click location being not in the no-clicking area.

2. The method of claim 1 , further comprising:
displaying the no-clicking area in the picture by at least one of:
covering the no-clicking area with a color or shadow; or
displaying a prompt sign in the no-clicking area.

3. The method of claim 1 , further comprising:
determining at least one base line in the picture based on attitude information of the photographing device for photographing the picture;
wherein determining the no-clicking area includes determining the no-clicking area in the picture based on the position of the obstacle or the no-fly zone relative to the at least one base line.

4. The method of claim 3 , wherein controlling the flight of the aerial vehicle based on the position of the click location includes:
controlling the flight of the aerial vehicle based on the position of the click location relative to the at least one base line, in response to determining the click location being not in the no-clicking area.

5. The method of claim 3 , further comprising:
determining the attitude information of the photographing device based on a state of the photographing device determined based on a reference line, a reference plane, or a reference coordinate system.

6. The method of claim 5 , wherein the attitude information of the photographing device is same as or different from a flight attitude of the aerial vehicle.

7. The method of claim 3 , further comprising:
displaying the at least one base line in the picture.

8. The method of claim 7 , wherein the at least one base line includes at least one of a straight line or a curve line.

9. The method of claim 7 , wherein the at least one base line includes at least one of a horizontal line, a plumb line, or an oblique line.

10. The method of claim 1 , wherein determining the no-clicking area in the picture includes:
determining whether the obstacle or the no-fly zone is detected within a preset distance from the aerial vehicle; and
in response to the obstacle or the no-fly zone is detected within the preset distance from the aerial vehicle, determining the no-clicking area in the picture.

11. The method of claim 10 , wherein determining the no-clicking area in the picture further includes:
determining a range of the obstacle or the no-fly zone through at least one of:
a detection device including a radar; or
imaging analyzing and processing; and

determining the no-clicking area in the picture further based on the range.

12. The method of claim 10 , wherein the range of the obstacle or the no-fly zone includes:
a volume of the obstacle or the no-fly zone;
a sectional area of the obstacle or the no-fly zone; or
a projection area of the obstacle or the no-fly zone in a flight direction of the aerial vehicle.

13. The method of claim 1 , further comprising:
sending, in response to determining the click location being in the no-clicking area, a reminder message to the user to remind the user that the click location is in the no-clicking area.

14. The method of claim 13 , wherein the reminder message includes at least one of text, image, video, or audio.

15. The method of claim 1 , further comprising:
determining at least one base line in the picture based on attitude information of the photographing device capturing the picture;
determining prompt information based on the at least one base line; and
displaying prompt information in the picture.

16. The method of claim 15 , wherein:
the at least one base line divides the picture into a plurality of portions; and
the prompt information is configured to represent a relative position relationship between each of the plurality of portions of the picture and the at least one base line.

17. The method of claim 16 , wherein the prompt information is configured to indicate different flight directions for different ones of the plurality of portions of the picture.

18. The method of claim 17 , wherein the prompt information includes at least one of:
color information added to each of the plurality of portions of the picture, different color information representing different flight directions; or
markup information provided in each of the plurality of portions of the picture, different markup information representing different flight directions, and the markup information including an arrow or a character.

19. The method of claim 16 , wherein determining the at least one base line in the picture based on attitude information of the photographing device includes at least one of:
determining a first oblique line in the picture based on the attitude information of the photographing device, an angle between the first oblique line and a plumb line being 45 degrees, and the prompt information being configured to represent a relative position relationship between each of the plurality of portions of the picture and the first oblique line;
determining the first oblique line and a second oblique line in the picture based on the attitude information of the photographing device, an angle between the second oblique line and the plumb line being 45 degrees, and the prompt information being configured to represent a relative position relationship between each portion of the picture and the first oblique line and/or between each of the plurality of portions of the picture and the second oblique line; or
determining a horizontal line and the plumb line of the picture based on the attitude information of the photographing device, the prompt information being configured to represent a relative position relationship between each portion of the picture and the horizontal line and/or between each of the plurality of portions of the picture and the plumb line.

20. A control terminal for controlling an aerial vehicle, comprising:
a touch screen; and
a controller electrically connected to the touch screen and configured to:
control the touch screen to display, in a real-time manner, a picture photographed and sent by a photographing device carried by the aerial vehicle;
determine a no-clicking area in the picture based on a position of an obstacle or a no-fly zone;
receive a click operation of a user on the picture; and
control a flight of the aerial vehicle based on the click operation, including:
invalidating the click operation in response to determining a click location of the click operation being in the no-clicking area; and
controlling the flight of the aerial vehicle based on a position of the click location in response to determining the click location being not in the no-clicking area.

Assignees

• Sz Dji Technology Co Ltd

Inventors

• Zhao Tao
• Zhou Guyue
• Liu Ang
• Hu Xiao
• Zhang Litian

Classifications

• G08G5/59

  in accordance with predefined flight zones, e.g. to avoid prohibited zones · CPC title

• G08G5/57

  for unmanned aircraft · CPC title

• G08G5/55

  for a single aircraft · CPC title

• G08G5/80 Primary

  Anti-collision systems · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title