Creative camera

Patent metadata

Field	Value
Publication number	US-10270983-B1
Application number	US-201816143201-A
Country	US
Kind code	B1
Filing date	Sep 26, 2018
Priority date	May 7, 2018
Publication date	Apr 23, 2019
Grant date	Apr 23, 2019

Abstract

The present disclosure generally relates to displaying visual effects in image data. In some examples, visual effects include an avatar displayed on a user's face. In some examples, visual effects include stickers applied to image data. In some examples, visual effects include screen effects. In some examples, visual effects are modified based on depth data in the image data.

First claim

What is claimed is:

1. An electronic device, comprising:
a display apparatus;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display apparatus, a live video communication user interface of a live video communication application, the live video communication user interface including concurrently displaying on the display:
a representation of a first participant in a live video communication session displayed at a first size;
a representation of a subject participating in the live video communication session with the first participant, wherein the representation of the subject is displayed at a second size that is smaller than the first size; and
a first affordance that is associated with a camera effects mode, wherein the first affordance is separate from the representation of the subject;

while concurrently displaying the representation of the first participant, the representation of the subject, and the first affordance, detecting a gesture directed to the first affordance; and
in response to detecting the gesture directed to the first affordance:
activating the camera effects mode; and
increasing a size of the representation of the subject participating in the live video communication session to a third size that is larger than the second size and occupies at least a portion of the display that was occupied by the representation of the first participant prior to detecting the gesture directed to the first affordance.

2. The electronic device of claim 1 , the one or more programs further including instructions for:
prior to displaying the first affordance, detecting a first input on the live video communication user interface, the first input corresponding to a request to display one or more options associated with the live video communication session;
in response to detecting the first input:
displaying the one or more options associated with the live video communication session; and
displaying the first affordance.

3. The electronic device of claim 1 , the one or more programs further including instructions for:
while the camera effects mode is activated:
detecting a selection of an effects option affordance; and
in response to detecting selection of the effects option affordance, modifying an appearance of the representation of the subject participating in the live video communication session based on a visual effect associated with the selected effects option affordance.

4. The electronic device of claim 3 , the one or more programs further including instructions for:
detecting a second input on the live video communication user interface, the second input corresponding to a request to reduce the size of the representation of the subject participating in the live video communication session; and
in response to detecting the second input, concurrently displaying:
the representation of the subject participating in the live video communication session having the modified appearance based on the visual effect associated with the selected effects option affordance; and
one or more representations of respective participants in the live video communication session.

5. The electronic device of claim 3 , wherein a plurality of participants are participating in the live video communication session, the plurality of participants including the subject and the first participant, wherein the first participant is a first remote participant, and wherein the representation of the subject is a live preview of a field of view of a camera of the electronic device, the one or more programs further including instructions for:
after modifying the appearance of the representation of the subject participating in the live video communication session based on a visual effect associated with the selected effects option affordance, transmitting data corresponding to the modified appearance of the representation of the subject participating in the live video communication session to at least the first remote participant of the plurality of participants.

6. The electronic device of claim 1 , wherein the representation of the subject participating in the live video communication session includes image data captured by a camera associated with the electronic device.

7. The electronic device of claim 1 , wherein the representation of the subject participating in the live video communication session includes image data transmitted to the electronic device from a second electronic device.

8. The electronic device of claim 1 , the one or more programs further including instructions for:
in response to detecting the gesture directed to the first affordance, displaying a first visual-effect affordance associated with a first type of visual effect and a second visual-effect affordance associated with a second type of visual effect that is different from the first type of visual effect.

9. The electronic device of claim 8 , the one or more programs further including instructions for:
detecting a selection of one of the affordances associated with a type of visual effect; and
in response to detecting the selection of the affordance associated with the visual effect, displaying a plurality of visual effect options corresponding to the visual effect.

10. The electronic device of claim 1 , the one or more programs further including instructions for:
while the camera effects mode is activated:
modifying an appearance of the representation of the subject participating in the live video communication session to display one or more visual effects.

11. The electronic device of claim 1 , the one or more programs further including instructions for:
while the camera effects mode is activated:
modifying an appearance of the representation of the subject participating in the live video communication session to display a virtual avatar;
detecting a change in a face in a field of view of one or more cameras of the electronic device; and
changing an appearance of the virtual avatar based on the detected change in the face.

12. The electronic device of claim 1 , wherein the live video communication user interface further includes:
a representation of a second participant in the live video communication session; and
a representation of a third participant in the live video communication session.

13. The electronic device of claim 1 , wherein a plurality of participants are participating in the live video communication session, the plurality of participants including the subject and the first participant, wherein the first participant is a first remote participant, and wherein the live video communication user interface further includes a representation of the first remote participant, the one or more programs further including instructions for:
further in response to detecting the gesture directed to the first affordance, reducing a size of the representation of the first remote participant.

14. The electronic device of claim 1 , the one or more programs further including instructions for:
while the camera effects mode is activated:
displaying a first visual effect in the representation of the subject participating in the live video communication session;
detecting an input corresponding to the first visual effect; and
in response to detecting the input corresponding to the first visual effect:
in accordance with a determination that the input is a first type, modifying a location of the first visual effect in the representation of the subject participating in the live video communi

Assignees

• Apple Inc

Inventors

• Van Os Marcel
• Aboukasm Jessica
• Black David R
• Chinn Robert
• Dudey Gregory L
• Ernst Katherine K
• Paul Grant
• Walsh Brian E
• Chang Jae Woo
• Guzman Aurelio
• Scapel Nicolas

Classifications

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N23/632 Primary

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title