User interface camera effects

Patent metadata

Field	Value
Publication number	US-10528243-B2
Application number	US-201715728147-A
Country	US
Kind code	B2
Filing date	Oct 9, 2017
Priority date	Jun 4, 2017
Publication date	Jan 7, 2020
Grant date	Jan 7, 2020

Abstract

The present disclosure generally relates to user interfaces. In some examples, the electronic device provides for transitioning between simulated lighting effects. In some examples, the electronic device applies a simulated lighting effect to an image. In some examples, the electronic device provides user interfaces for applying a filter to an image. In some examples, the electronic device provides for a reduced filter interface. In some examples, the electronic device provides a visual aid displayed in a viewfinder.

First claim

What is claimed is:

1. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with one or more input devices and a display, the one or more programs including instructions for:
displaying, on the display, a representation of image data obtained by one or more cameras from a physical environment, wherein the image data is associated with depth map information determined based on one or more sensor measurements of the physical environment at a time corresponding to when the image data was obtained by the one or more cameras and a filter picker user interface, wherein the filter picker user interface includes a first representation of a first lighting effect and a second representation of a second light effect, wherein the first lighting effect simulates at least one light source positioned at a first location relative to a subject within the representation of image data and is based on the depth map information, and wherein the second lighting effect simulates at least one light source positioned at a second location relative to the subject within the representation of image data different from the first location and is based on the depth map information;
while displaying, on the display, the representation of the image data:
detecting at a first area on the display corresponding to the first representation of the first lighting effect within the filter picker user interface, via the one or more input devices, a first input;
in accordance with detecting the first input at the first area on the display corresponding to the first representation of the first lighting effect within the filter picker user interface, applying the first lighting effect to the representation of image data;
detecting at a second area on the display corresponding to the second representation of the second lighting effect within the filter picker user interface, via the one or more input devices, a second input; and
in accordance with detecting the second input at the second area on the display corresponding to the second representation of the second lighting effect within the filter picker user interface, applying the second lighting effect different than the first lighting effect to the representation of image data, and ceasing to apply the first lighting effect to the representation of image data.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the electronic device further includes the one or more cameras and wherein the representation of the image data is a live preview of image data captured within a field of view of the one or more cameras displayed in a digital viewfinder.

3. The non-transitory computer-readable storage medium of claim 2 , wherein the first input is an input received while first criteria are met, wherein the first criteria include a requirement that the subject is detected in the field of view within a predetermined distance from the electronic device.

4. The non-transitory computer-readable storage medium of claim 3 , wherein applying the first lighting effect includes:
applying, to the representation of the image data displayed in the viewfinder, a placeholder filter, wherein the placeholder filter is based on the first lighting effect and is applied without regard to whether or not the first criteria are met.

5. The non-transitory computer-readable storage medium of claim 4 , further including instructions for, while the first lighting effect is being applied:
determining that the first criteria are not met; and
in response to the determination that the first criteria are not met:
ceasing to apply the first lighting effect to the representation of image data;
displaying, on the display, the representation of image data without a first lighting effect applied; and
displaying, on the display, a graphical indication of the first criteria that are not met.

6. The non-transitory computer-readable storage medium of claim 3 , further including instructions for:
in response to the first input, applying, to the live preview, a placeholder filter without applying the first lighting effect to the live preview; and
in response to detecting that the first criteria have been met, applying the first lighting effect to the live preview while continuing to apply the placeholder filter to the live preview.

7. The non-transitory computer-readable storage medium of claim 2 , wherein:
the first input is an input received while first criteria are not met, wherein the first criteria include a requirement that the subject is detected in the field of view within a predetermined distance from the electronic device; and
the non-transitory computer-readable storage medium further includes instructions for:
after displaying the live preview without applying the first lighting effect to the live preview, detecting that the first criteria have been met; and
in response to detecting that the first criteria have been met, applying the first lighting effect to the live preview.

8. The non-transitory computer-readable storage medium of claim 1 , wherein the representation of image data is previously captured image data.

9. The non-transitory computer-readable storage medium of claim 1 , further including instructions for:
prior to displaying the representation of image data, receiving, at the device, the image data and the depth map information associated with the representation of image data.

10. The non-transitory computer-readable storage medium of claim 9 , further including instructions for:
while displaying the representation of image data, displaying, on the display, a visual indication that the image data includes depth map information.

11. The non-transitory computer-readable storage medium of claim 1 , wherein the depth map information associated with the image data includes information corresponding to at least three different depth levels.

12. The non-transitory computer-readable storage medium of claim 1 , wherein the depth map information associated with the image data includes information identifying depth contours of an object in the representation of the image data; and
the lighting effects change an appearance of the representation of the image data based on a location and curvature of the contours of the object.

13. The non-transitory computer-readable storage medium of claim 2 , wherein applying the first lighting effect or the second lighting effect includes:
applying, to the representation of the image data displayed in the digital viewfinder, a simulation of one or more point-of-light sources in space based on the depth map information associated with the image data.

14. The non-transitory computer-readable storage medium of claim 1 , further including instructions for:
while the first lighting effect is applied, maintaining at least one value of a previously applied visual effect.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the previously applied visual effect is a color filter.

16. The non-transitory computer-readable storage medium of claim 1 , wherein the second input is an input received while the first lighting effect is being applied to the representation of image data and wherein applying the second lighting effect includes:
gradually transitioning between the first lighting effect and application of the second lighting effect.

17. A method, comprising:
at an electronic device with one or more input devices and a display:
displaying, on the display, a representation of image data obtained b

Assignees

• Apple Inc

Inventors

• Manzari Behkish J
• Bereza Marek
• Brasket Jeffrey A
• Cao Frederic
• Dye Alan C
• Harris Elliott
• Irani Cyrus Daniel
• Ive Jonathan P
• Johnson Garrett
• Kim Emilie
• Malia Joseph A
• Paul Grant
• Pivonka Pavel
• Sorrentino Iii Billy
• Souza Dos Santos Andre

Classifications

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/651

  for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera · CPC title

• H04N23/69 Primary

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title

• H04N23/632 Primary

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title