Tracker assisted image capture

Patent metadata

Field	Value
Publication number	US-11538232-B2
Application number	US-201916583041-A
Country	US
Kind code	B2
Filing date	Sep 25, 2019
Priority date	Jun 14, 2013
Publication date	Dec 27, 2022
Grant date	Dec 27, 2022

Abstract

A method for picture processing is described. A first tracking area is obtained. A second tracking area is also obtained. The method includes beginning to track the first tracking area and the second tracking area. Picture processing is performed once a portion of the first tracking area overlapping the second tracking area passes a threshold.

First claim

What is claimed is:

1. A method, comprising:
tracking a first tracking area corresponding to a first object associated with at least a first frame of a video sequence;
identifying a second area corresponding to a second object associated with at least the first frame of the video sequence;
determining, in the first frame, an amount of overlap between the first tracking area in the first frame and the second area in the first frame; and
replacing, in one or more frames of the video sequence, at least a portion of the first object within the first tracking area with at least a portion of the second object in response to determining that the amount of overlap between the first tracking area and the second area passes a threshold.

2. The method of claim 1 , wherein at least the portion of the first object is replaced with at least the portion of the second object once the amount of overlap becomes greater than the threshold.

3. The method of claim 1 , wherein at least the portion of the first object is replaced with at least the portion of the second object once the amount of overlap becomes less than the threshold.

4. The method of claim 1 , wherein determining the amount of overlap is based on whether the first tracking area is larger than the second area.

5. The method of claim 1 , further comprising capturing a photograph in response to determining that the amount of overlap passes the threshold.

6. The method of claim 1 , further comprising:
selecting a second frame of the video sequence, wherein the first tracking area does not overlap a corresponding replacement area in the second frame;
wherein replacing at least the portion of the first object with at least the portion of the second object includes replacing the first tracking area in the first frame with the corresponding replacement area from the second frame.

7. The method of claim 6 , wherein the second frame occurs later in time than the first frame.

8. The method of claim 6 , wherein the second frame occurs earlier in time than the first frame.

9. The method of claim 1 , further comprising:
storing the first frame as part of an edited video sequence.

10. The method of claim 1 , further comprising receiving a first user selection of the first tracking area.

11. The method of claim 10 , further comprising receiving a second user selection of the second area.

12. The method of claim 10 , wherein the first user selection is based on a shape.

13. The method of claim 12 , wherein the shape is selected by a user.

14. The method of claim 10 , wherein the first user selection is based on a selection of an object.

15. The method of claim 1 , wherein a shape associated with at least one of the first tracking area and the second area is changed based on a state of at least one of the first tracking area and the second area.

16. The method of claim 1 , wherein the second area comprises an action line, wherein the amount of overlap passes the threshold upon the first tracking area crossing the action line.

17. The method of claim 16 , wherein the action line is set by a user.

18. The method of claim 1 , wherein the second object tracked within the second area is not removed from the video sequence in response to determining that the amount of overlap between the first tracking area in the first frame and the second area in the first frame passes the threshold.

19. The method of claim 1 , wherein tracking the first tracking area includes tracking the first object, and wherein identifying the second area includes tracking the second object.

20. A device, comprising:
a memory; and
a processor coupled to the memory, the processor configured to:
track a first tracking area corresponding to a first object associated with at least a first frame of a video sequence;
identify a second area corresponding to a second object associated with at least the first frame of the video sequence;
determine, in a first frame, an amount of overlap between the first tracking area in the first frame and the second area in the first frame; and
replacing, in one or more frames of the video sequence, at least a portion of the first object within the first tracking area with at least a portion of the second object in response to determining that the amount of overlap between the first tracking area and the second area passes a threshold.

21. The device of claim 20 , wherein the processor is configured to replace at least the portion of the first object with at least the portion of the second object once the amount of overlap becomes greater than the threshold.

22. The device of claim 20 , wherein the processor is configured to replace at least the portion of the first object with at least the portion of the second object once the amount of overlap becomes less than the threshold.

23. The device of claim 20 , wherein the processor is configured to determine the amount of overlap based on whether the first tracking area is larger than the second area.

24. The device of claim 20 , wherein the processor is configured to capture a photograph in response to determining that the amount of overlap passes the threshold.

25. The device of claim 20 , wherein the processor is further configured to:
select a second frame of the video sequence, wherein the first tracking area does not overlap a corresponding replacement area in the second frame;
wherein replacing at least the portion of the first object with at least the portion of the second object includes replace the first tracking area in the first frame with the corresponding replacement area from the second frame.

26. The device of claim 25 , wherein the second frame occurs later in time than the first frame.

27. The device of claim 25 , wherein the second frame occurs earlier in time than the first frame.

28. The device of claim 20 , wherein the processor is further configured to:
store the first frame as part of an edited video sequence.

29. The device of claim 20 , wherein the processor is further configured to:
receive a first user selection of the first tracking area.

30. The device of claim 29 , wherein the processor is further configured to:
receive a second user selection of the second area.

31. The device of claim 29 , wherein the first user selection is based on a shape.

32. The device of claim 31 , wherein the shape is selected by a user.

33. The device of claim 29 , wherein the first user selection is based on a selection of an object.

34. The device of claim 20 , wherein a shape associated with at least one of the first tracking area and the second area is changed based on a state of at least one of the first tracking area and the second area.

35. The device of claim 20 , wherein the second area comprises an action line, wherein the amount of overlap passes the threshold upon the first tracking area crossing the action line.

36. The device of claim 35 , wherein the action line is set by a user.

37. The device of claim 20 , wherein the second object tracked within the second area is not removed from the video sequence in response to determining that the amount of overlap between the first tracking area in the first frame and the second area in the first frame passes the thresho

Assignees

• Qualcomm Inc

Inventors

• Zhong Xin
• Gao Dashan
• Bi Ning
• Laver Steven Douglas
• Beith Scott David
• Maccormack Diarmuid

Classifications

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G11B27/02

  Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers · CPC title

• H04N23/635

  Region indicators; Field of view indicators · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/6811

  based on the image signal · CPC title