Computational photography features with depth

Patent metadata

Field	Value
Publication number	US-12488434-B2
Application number	US-202017756700-A
Country	US
Kind code	B2
Filing date	May 26, 2020
Priority date	May 26, 2020
Publication date	Dec 2, 2025
Grant date	Dec 2, 2025

Abstract

A method including receiving an image as a portion of a real-world space, placing an anchor on the image, determining a position of the anchor, determine a depth associated with the position of the anchor, applying an image editing algorithm based on the depth to the captured image, and rendering the edited image.

First claim

What is claimed is:

1 . A method comprising:
receiving an image as a portion of a real-world space at a device; placing an anchor on the image through operation of an interface of the device, the anchor being a virtual element; determining a position of the anchor on a display of the device, the position of the anchor being associated with a real-world location within a live image of the real-world space; determining a depth associated with the position of the anchor, the depth being based on a distance between a reference point and on a position of the device; generating an edited image by applying an algorithm configured to edit the image, the image editing algorithm being based on the depth; and rendering the edited image on a display of the device.

2 . The method of claim 1 , wherein the live image is continually modified using the algorithm.

3 . The method of claim 1 , wherein
the anchor places a focus at a depth in the image, a perspective of the image is changed, and the focus remains on the depth.

4 . The method of claim 1 , wherein the applying of the algorithm to the image includes:
applying a first algorithm to a first portion of pixels including pixels of the image within a threshold distance of the depth, and applying a second algorithm to a second portion of pixels including the remaining pixels of the image.

5 . The method of claim 1 , wherein the applying of the algorithm to the image includes:
determining an object associated with the image, determine an edge of the object based on the depth, applying a first algorithm to a first portion of pixels including pixels of the image associated with the edge of the object, and applying a second algorithm to a second portion of pixels including the remaining pixels of the image.

6 . The method of claim 1 , wherein the determining of the depth associated with the position of the anchor includes acquiring a depth map associated with the image.

7 . The method of claim 1 , wherein the determining of the depth associated with the position of the anchor includes:
acquiring a depth map associated with the image, determining a minimum depth value associated with the image, determining a maximum depth value associated with the image, normalizing the depth map based on the minimum depth value and the maximum depth value, and determining the depth associated with the position as a normalized depth value.

8 . The method of claim 1 , wherein the determining of the depth associated with the position of the anchor includes:
acquiring layered depth associated with the image, and the depth of the anchor has a depth index number.

9 . The method of claim 1 , further comprising selecting an image editing tool, wherein the image editing tool corresponds to the algorithm.

10 . A system comprising:
a memory storing a set of instructions; and a processor configured to execute the set of instructions to cause the system to: receive an image as a portion of a real-world space; place an anchor on the image through operation of an interface of the device, the anchor being a virtual element; determine a position of the anchor on a display of the device, the position of the anchor being associated with a real-world location within a live image of the real-world space; determine a depth associated with the position of the anchor, the depth being based on a distance between a reference point and on a position of the system; generate an edited image by applying an algorithm configured to edit the image, the image editing algorithm being based on the depth; and render the edited image on a display of the device.

11 . The system of claim 10 , wherein the live image is continually modified using the algorithm.

12 . The system of claim 10 , wherein
the anchor places a focus at a depth in the image, a perspective of the image is changed, and the focus remains on the depth.

13 . The system of claim 10 , wherein
applying the algorithm to the image includes:
applying a first algorithm to a first portion of pixels including pixels of the image within a threshold distance of the depth, and
applying a second algorithm to a second portion of pixels including the remaining pixels of the image.

14 . The system of claim 10 , wherein
applying the algorithm to the image includes:
determining an object associated with the image,
determine an edge of the object based on the depth,
applying a first algorithm to a first portion of pixels including pixels of the image associated with the edge of the object, and
applying a second algorithm to a second portion of pixels including the remaining pixels of the image.

15 . The system of claim 10 , wherein the determining of the depth associated with the position of the anchor includes acquiring a depth map associated with the image.

16 . The system of claim 10 , wherein the determining of the depth associated with the position of the anchor includes:
acquiring a depth map associated with the image, determining a minimum depth value associated with the image, determining a maximum depth value associated with the image, normalizing the depth map based on the minimum depth value and the maximum depth value, and determining the depth associated with the position as a normalized depth value.

17 . The system of claim 10 , wherein the determining of the depth associated with the position of the anchor includes:
acquiring layered depth associated with the image, and the depth of the anchor has a depth index number.

18 . The system of claim 10 , further comprising selecting an image editing tool, wherein the image editing tool corresponds to the image editing algorithm.

19 . A device comprising:
a sensor configured to determine a real-world position of the device; and a processor configured to execute a set of instructions to cause the device to:
render an image as a portion of a real-world space on a display of the device;
place an anchor on the image through operation of an interface of the device, the anchor being a virtual element;
determine a position of the anchor on the display of the device, the position of the anchor being associated with a real-world location within a live image of the real-world space;
determine a depth associated with the position of the anchor, the depth being based on a distance between a reference point and on a position of the device;
generate an edited image by applying an image editing algorithm to the image, the image editing algorithm being based on the depth; and
render the edited image on the display.

20 . The device of claim 19 wherein the applying of the image editing algorithm to the image includes:
applying a first algorithm to a first portion of pixels including pixels of the image within a threshold distance of the depth, and
applying a second algorithm to a second portion of pixels including the remaining pixels of the image.

Assignees

• Google Llc

Inventors

• Du Ruofei
• Kim David

Classifications

• G06T7/13

  Edge detection · CPC title

• G06T7/50

  Depth or shape recovery · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title