Query response by a gimbal mounted camera

Patent metadata

Field	Value
Publication number	US-10965875-B2
Application number	US-201916519564-A
Country	US
Kind code	B2
Filing date	Jul 23, 2019
Priority date	Jan 24, 2017
Publication date	Mar 30, 2021
Grant date	Mar 30, 2021

Abstract

A method includes, at an electronic gimbal device having one or more processors and memory storing instructions for execution by the one or more processors, receiving a user-provided query, determining a gimbal response to the user-provided query in response to receiving the user-provided query, and controlling the electronic gimbal device to indicate the determined gimbal response.

First claim

What is claimed is:

1. A method, comprising:
at an electronic gimbal device having one or more processors and memory storing instructions for execution by the one or more processors:
receiving a user-provided query;
in response to receiving the user-provided query, determining a gimbal response to the user-provided query; and
controlling the electronic gimbal device to indicate the determined gimbal response;

wherein determining the gimbal response to the user-provided query includes:
analyzing the user-provided query to detect at least one instruction segment within the user-provided query; and
using the at least one instruction segment to determine the gimbal response by:
accessing a stored set of multiple gimbal response options, wherein each respective gimbal response option of the stored set of multiple gimbal response options corresponds to a respective set of one or more stored instruction segments, and
determining the gimbal response by selecting a gimbal response option of the stored set of multiple gimbal response options that corresponds to the at least one instruction segment.

2. The method of claim 1 , wherein the user-provided query is a question and the gimbal response includes information that is responsive to the question.

3. The method of claim 1 , wherein determining the gimbal response to the user-provided query includes randomly or pseudorandomly selecting the gimbal response from a stored set of multiple gimbal response options.

4. The method of claim 1 , wherein:
receiving the user-provided query comprises receiving, by a microphone that is communicatively coupled to the one or more processors, the user-provided query by capturing an audio signal; and
detecting the at least one instruction segment within the user-provided query comprises detecting one or more predefined keywords within the audio signal.

5. The method of claim 1 , wherein controlling the electronic gimbal device comprises rotating a gimbal-mounted camera of the electronic gimbal device about at least one of a pan axis, a tilt axis, or a roll axis.

6. The method of claim 1 , further comprising:
capturing, by a gimbal-mounted camera or by a camera of a user device, two or more images;
detecting a movement pattern of a target within the two or more images; and
determining the gimbal response using information that includes the detected movement pattern.

7. The method of claim 6 , wherein controlling the electronic gimbal device includes directing the gimbal-mounted camera toward the target.

8. The method of claim 1 , wherein the gimbal response to the user-provided query is related to an operational status of the electronic gimbal device.

9. A system comprising:
an electronic gimbal device that includes one or more processors configured to:
acquire, via a gimbal-mounted camera or a camera of a user mobile device, two or more images;
detect a movement pattern of a target within the two or more images;
receive a user-provided query;
in response to receiving the user-provided query, determine a gimbal response using information that includes the detected movement pattern; and
control the electronic gimbal device to indicate the determined gimbal response, wherein determining the gimbal response comprises:
analyzing the user-provided query to detect at least one instruction segment within the user-provided query; and
using the at least one instruction segment to determine the gimbal response by:
accessing a stored set of multiple gimbal response options, wherein each respective gimbal response option of the stored set of multiple gimbal response options corresponds to a respective set of one or more stored instruction segments, and
determining the gimbal response by selecting a gimbal response option of the stored set of multiple gimbal response options that corresponds to the at least one instruction segment.

10. The system of claim 9 , wherein the user-provided query is a question and the gimbal response includes information that is responsive to the question.

11. The system of claim 9 , wherein determining the gimbal response to the user-provided query includes randomly or pseudorandomly selecting the gimbal response from a stored set of multiple gimbal response options.

12. The system of claim 9 , further comprising:
a microphone that is communicatively coupled to the one or more processors;
wherein:
receiving the user-provided query comprises receiving, by the microphone, the user-provided query by capturing an audio signal; and
detecting the at least one instruction segment within the user-provided query comprises detecting one or more predefined keywords within the audio signal.

13. The system of claim 9 , wherein:
the electronic gimbal device comprises one or more actuators that are communicatively coupled to the one or more processors and configured to adjust a position of the electronic gimbal device, and
controlling the electronic gimbal device to indicate the determined gimbal response comprises rotating, by the one or more actuators, a gimbal-mounted camera of the electronic gimbal device about at least one of a pan axis, a tilt axis, or a roll axis.

14. The system of claim 9 , further comprising:
the user mobile device, wherein the user mobile device is detachably coupled to the electronic gimbal device.

15. The system of claim 9 , wherein controlling the electronic gimbal to indicate the determined gimbal response includes directing the gimbal-mounted camera toward the target.

16. The system of claim 9 , wherein the gimbal response to the user-provided query is related to an operational status of the electronic gimbal device.

17. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed, cause an electronic gimbal device to:
receive a user-provided query;
in response to receiving the user-provided query, determine a gimbal response using information from the user-provided query; and
control the electronic gimbal device to indicate the determined gimbal response;
wherein determining the gimbal response to the user-provided query includes:
analyzing the user-provided query to detect at least one instruction segment within the user-provided query; and
using the at least one instruction segment to determine the gimbal response by:
accessing a stored set of multiple gimbal response options, wherein each respective gimbal response option of the stored set of multiple gimbal response options corresponds to a respective set of one or more stored instruction segments, and
determining the gimbal response by selecting a gimbal response option of the stored set of multiple gimbal response options that corresponds to the at least one instruction segment.

Assignees

• Sz Dji Osmo Technology Co Ltd

Inventors

• Guo Zhuo
• Pan Paul

Classifications

• H04N23/695 Primary

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• H04N23/54

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• F16M11/041 Primary

  Allowing quick release of the apparatus · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06F16/24575

  using context · CPC title