Creative camera

Patent metadata

Field	Value
Publication number	US-10375313-B1
Application number	US-201816110514-A
Country	US
Kind code	B1
Filing date	Aug 23, 2018
Priority date	May 7, 2018
Publication date	Aug 6, 2019
Grant date	Aug 6, 2019

Abstract

The present disclosure generally relates to displaying visual effects in image data. In some examples, visual effects include an avatar displayed on a user's face. In some examples, visual effects include stickers applied to image data. In some examples, visual effects include screen effects. In some examples, visual effects are modified based on depth data in the image data.

First claim

What is claimed is:

1. An electronic device, comprising:
a camera;
a display apparatus;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display apparatus, a camera user interface, the camera user interface including:
a camera display region including a representation of image data captured via the camera, wherein the representation includes a representation of a subject and a representation of a background, and the image data corresponds to depth data for the subject; and
a first affordance associated with a first camera display mode;

identifying the subject based on the depth data;
while the subject is positioned within a field of view of the camera and the representation of the subject and the representation of the background are displayed in the camera display region, detecting a gesture directed to the first affordance;
in response to detecting the gesture directed to the first affordance, activating the first camera display mode, wherein activating the first camera display mode includes:
displaying an avatar selection region including a plurality of avatar options; and
in response to detecting a selection of one of the plurality of avatar options, displaying a representation of the selected avatar option over a first portion of the representation of the identified subject in the camera display region and while maintaining display of at least a second portion of the representation of the identified subject;

while the first camera display mode is active, detecting a change in pose of the subject;
in response to detecting the change in pose of the subject, changing an appearance of the displayed representation of the selected avatar option based on the detected change in pose of the subject while maintaining display of the second portion of the representation of the identified subject and at least a portion of the representation of the background;
while displaying the representation of the selected avatar option over the first portion of the representation of the identified subject in the camera display region and while maintaining display of at least the second portion of the representation of the identified subject, detecting a gesture directed to a filter affordance that is concurrently displayed on the display with the representation of the selected avatar; and
in response to detecting the gesture directed to the filter affordance, activating a filter mode, wherein activating the filter mode includes:
changing an appearance of the displayed representation of the selected avatar option based on the selected filter; and
changing an appearance of at least a portion of the representation of the background based on the selected filter.

2. The electronic device of claim 1 , wherein activating the first camera display mode further includes:
prior to displaying the representation of the selected avatar option over the first portion of the representation of the subject in the camera display region:
displaying the representation of the subject in the camera display region without displaying the representation of the selected avatar option over the first portion of the representation of the subject.

3. The electronic device of claim 1 , wherein the avatar selection region further includes an option for ceasing to display the representation of the selected avatar option over the first portion of the representation of the subject in the camera display, the one or more programs further including instructions for:
receiving a user input corresponding to selection of the option for ceasing to display the representation of the selected avatar option over the first portion of the representation of the subject in the camera display region; and
in response to receiving a user input corresponding to selection of the option for ceasing to display the representation of the selected avatar option over the first portion of the representation of the subject in the camera display region, ceasing to display the representation of the selected avatar option over the first portion of the representation of the subject in the camera display region.

4. The electronic device of claim 1 , the one or more programs further including instructions for:
detecting a horizontal swipe gesture on the avatar selection region; and
in response to detecting the horizontal swipe gesture, displaying an avatar creation affordance associated with a function for adding a new avatar option to the plurality of avatar options.

5. The electronic device of claim 1 , the one or more programs further including instructions for:
while the first camera display mode is active, detecting a swipe gesture on the avatar selection region; and
in response to detecting the swipe gesture on the avatar selection region, changing an appearance of the displayed representation of the selected avatar option in the camera display region from a first appearance to a second appearance, wherein the second appearance corresponds to a different one of the plurality of avatar options.

6. The electronic device of claim 1 , wherein the representation of image data captured via the camera is a live camera preview.

7. The electronic device of claim 6 , the one or more programs further including instructions for:
while the first camera display mode is active, detecting a swipe gesture on the camera display region; and
in response to detecting the swipe gesture on the camera display region, changing an appearance of the displayed representation of the selected avatar option in the camera display region from a first appearance to a second appearance, wherein the second appearance corresponds to a different one of the plurality of avatar options.

8. The electronic device of claim 1 , wherein activating the first camera display mode further includes:
displaying the selected avatar option with a static appearance in the avatar selection region;
updating the selected avatar option to have a dynamic appearance that changes based on the detected change in pose of the subject; and
displaying an animation of the selected avatar having the dynamic appearance moving from the avatar selection region to the first portion of the representation of the subject in the camera display region.

9. The electronic device of claim 1 , the one or more programs further including instructions for:
while the first camera display mode is active:
in response to a determination that the subject is no longer positioned in the field of view of the camera, displaying an animation of the representation of the selected avatar option moving to a center location in the camera display region.

10. The electronic device of claim 1 , the one or more programs further including instructions for:
while the first camera display mode is active:
in response to a determination that the subject is no longer positioned in the field of view of the camera, modifying the visual appearance of the background displayed in the camera display region.

11. The electronic device of claim 1 , wherein the camera user interface further includes a second affordance associated with a second camera display mode, the one or more programs further including instructions for:
while the subject is positioned within the field of view of the camera and the representation of the subject and the representation of the background are displayed in the camera display region, detecting a gesture directed to the second affordance;
in response to detecting the gesture directed to the second affordance, activating the second camera display mode, wherein activatin

Assignees

• Apple Inc

Inventors

• Van Os Marcel
• Aboukasm Jessica
• Black David R
• Chinn Robert
• Dudey Gregory L
• Ernst Katherine K
• Paul Grant
• Sorrentino Iii William A
• Walsh Brian E
• Albouze Jean-Francois
• Chang Jae Woo
• Guzman Aurelio
• Moulios Christopher J
• Newman Joanna M
• Scapel Nicolas
• Weil Joseph-Alexander P
• Wilson Christopher

Classifications

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/632 Primary

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title