Creative camera

Patent metadata

Field	Value
Publication number	US-11722764-B2
Application number	US-202117525664-A
Country	US
Kind code	B2
Filing date	Nov 12, 2021
Priority date	May 7, 2018
Publication date	Aug 8, 2023
Grant date	Aug 8, 2023

Abstract

The present disclosure generally relates to displaying visual effects in image data. In some examples, visual effects include an avatar displayed on a user's face. In some examples, visual effects include stickers applied to image data. In some examples, visual effects include screen effects. In some examples, visual effects are modified based on depth data in the image data.

First claim

What is claimed is:

1. An electronic device, comprising:
a display apparatus;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display apparatus, a media user interface, the media user interface including:
a media display region including a representation of a media item; and
an effects affordance;

detecting a gesture directed to the effects affordance; and
in response to detecting the gesture directed to the effects affordance, displaying a plurality of effects options for applying effects to the media item concurrently with a representation of the media item, including:
in accordance with a determination that the media item is associated with corresponding depth data, the plurality of effects options include a respective effects option for applying effects based on the depth data; and
in accordance with a determination that the media item is not associated with corresponding depth data, the respective effects option is not available for activation in the plurality of effects options to apply one or more effects based on the depth data.

2. The electronic device of claim 1 , wherein the respective effects option corresponds to an effect for displaying an avatar in the media item.

3. The electronic device of claim 1 , wherein the respective effects option corresponds to an effect for displaying a plurality of virtual objects moving in the media item.

4. The electronic device of claim 3 , wherein a trajectory of the plurality of virtual objects moving in the media item are modified based on a presence of at least one of an object in the media item or a visual effect applied to the media item.

5. The electronic device of claim 1 , wherein the respective effects option corresponds to an effect for displaying one or more selectable graphical icons in the media item.

6. The electronic device of claim 1 , wherein the plurality of effects options includes an option for adding labels to the media item.

7. The electronic device of claim 1 , wherein the plurality of effects options includes an option for applying one or more image filters to the media item.

8. The electronic device of claim 1 , wherein the depth data corresponding to the media item is obtained by a camera of the electronic device after detecting a prior selection of the effects affordance.

9. The electronic device of claim 1 , wherein the media item is a recorded image or video, and wherein the effects are applied based on the depth data after the media item is recorded.

10. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device that is in communication with a display apparatus, the one or more programs including instructions for:
displaying, via the display apparatus, a media user interface, the media user interface including:
a media display region including a representation of a media item; and
an effects affordance;

detecting a gesture directed to the effects affordance; and
in response to detecting the gesture directed to the effects affordance, displaying a plurality of effects options for applying effects to the media item concurrently with a representation of the media item, including:
in accordance with a determination that the media item is associated with corresponding depth data, the plurality of effects options include a respective effects option for applying effects based on the depth data; and
in accordance with a determination that the media item is not associated with corresponding depth data, the respective effects option is not available for activation in the plurality of effects options to apply one or more effects based on the depth data.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the respective effects option corresponds to an effect for displaying an avatar in the media item.

12. The non-transitory computer-readable storage medium of claim 10 , wherein the respective effects option corresponds to an effect for displaying a plurality of virtual objects moving in the media item.

13. The non-transitory computer-readable storage medium of claim 12 , wherein a trajectory of the plurality of virtual objects moving in the media item is modified based on a presence of at least one of an object in the media item or a visual effect applied to the media item.

14. The non-transitory computer-readable storage medium of claim 10 , wherein the respective effects option corresponds to an effect for displaying one or more selectable graphical icons in the media item.

15. The non-transitory computer-readable storage medium of claim 10 , wherein the plurality of effects options includes an option for adding labels to the media item.

16. The non-transitory computer-readable storage medium of claim 10 , wherein the plurality of effects options includes an option for applying one or more image filters to the media item.

17. The non-transitory computer-readable storage medium of claim 10 , wherein the depth data corresponding to the media item is obtained by a camera of the electronic device after detecting a prior selection of the effects affordance.

18. The non-transitory computer-readable storage medium of claim 10 , wherein the media item is a recorded image or video, and wherein the effects are applied based on the depth data after the media item is recorded.

19. A method comprising:
at an electronic device having a display apparatus:
displaying, via the display apparatus, a media user interface, the media user interface including:
a media display region including a representation of a media item; and

an effects affordance;
detecting a gesture directed to the effects affordance; and
in response to detecting the gesture directed to the effects affordance, displaying a plurality of effects options for applying effects to the media item concurrently with a representation of the media item, including:
in accordance with a determination that the media item is associated with corresponding depth data, the plurality of effects options include a respective effects option for applying effects based on the depth data; and
in accordance with a determination that the media item is not associated with corresponding depth data, the respective effects option is not available for activation in the plurality of effects options to apply one or more effects based on the depth data.

20. The method of claim 19 , wherein the respective effects option corresponds to an effect for displaying an avatar in the media item.

21. The method of claim 19 , wherein the respective effects option corresponds to an effect for displaying a plurality of virtual objects moving in the media item.

22. The method of claim 21 , wherein a trajectory of the plurality of virtual objects moving in the media item is modified based on a presence of at least one of an object in the media item or a visual effect applied to the media item.

23. The method of claim 19 , wherein the respective effects option corresponds to an effect for displaying one or more selectable graphical icons in the media item.

24. The method of claim 19 , wherein the plurality of effects options includes an option for adding labels to the media item.

25. The method of claim 19 , wherein the plurality of effects options incl

Assignees

• Apple Inc

Inventors

• Van Os Marcel
• Aboukasm Jessica L
• Albouze Jean-Francois M
• Black David R
• Chang Jae Woo
• Chinn Robert M
• Dudey Gregory L
• Ernst Katherine K
• Guzman Aurelio
• Moulios Christopher J
• Newman Joanna M
• Paul Grant
• Scapel Nicolas
• Sorrentino Iii William A
• Walsh Brian E
• Weil Joseph-Alexander P
• Wilson Christopher

Classifications

• H04N5/2226

  Determination of depth image, e.g. for foreground/background separation (determining depth by image analysis in general G06T7/50; segmentation by image analysis in general G06T7/10) · CPC title

• G06T13/20

  Three-dimensional [3D] animation · CPC title

• H04N23/631 Primary

  Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title