Flow-based color transfer from source graphic to target graphic

Patent metadata

Field	Value
Publication number	US-11043012-B2
Application number	US-201916533308-A
Country	US
Kind code	B2
Filing date	Aug 6, 2019
Priority date	Aug 6, 2019
Publication date	Jun 22, 2021
Grant date	Jun 22, 2021

Abstract

Certain embodiments involve flow-based color transfers from a source graphic to target graphic. For instance, a palette flow is computed that maps colors of a target color palette to colors of the source color palette (e.g., by minimizing an earth-mover distance with respect to the source and target color palettes). In some embodiments, such color palettes are extracted from vector graphics using path and shape data. To modify the target graphic, the target color from the target graphic is mapped, via the palette flow, to a modified target color using color information of the source color palette. A modification to the target graphic is performed (e.g., responsive to a preview function or recoloring command) by recoloring an object in the target color with the modified target color.

First claim

The invention claimed is:

1. A method comprising:
extracting a target color palette for a target graphic, wherein the target graphic is a vector graphic having path data identifying shapes and colors, wherein extracting the target color palette comprises, for each target color in the target color palette:
(a) determining a shape from the path data;
(b) identifying the target color that is associated with the shape via the path data; and
(c) performing one or more of:
(i) adding the target color to the target color palette, and
(ii) increasing a respective weight for the target color within the target color palette based on the shape;

computing a palette flow that maps colors of the target color palette to colors of a source color palette for a source graphic, wherein the palette flow includes at least a set of flows between the colors of the source color palette and a target color of the target color palette, wherein the set of flows is computed based on an amount of work required to transform a target color distribution of the target color palette into a source color distribution of the source color palette;
mapping, via the palette flow, the target color from the target graphic to a modified target color that is a weighted combination of source colors from the source color palette, wherein weights of the weighted combination are a function of the set of flows between the colors of the source color palette and the target color; and
performing a modification to the target graphic by recoloring an object in the target color with the modified target color.

2. The method of claim 1 , further comprising computing the weighted combination of source colors by dividing a summation of the target color multiplied by the set of flows by a summation of the set of flows.

3. The method of claim 1 , further comprising:
retrieving, with a recoloring tool of a graphics manipulation application, a set of source graphics that includes the source graphic;
displaying, via the recoloring tool, the target graphic and the set of source graphics;
receiving a selection of the source graphic within the recoloring tool;
generating, responsive to the selection, with the recoloring tool, a preview of a recolored target graphic that is generated from the modification to the target graphic;
receiving a recoloring command via the recoloring tool; and
applying, responsive to the recoloring command, color information from the source color palette to the target graphic.

4. The method of claim 1 , further comprising:
presenting, in a recoloring tool of a graphics manipulation application, a weight modification
interface element for controlling one or more weights of the source color palette;
modifying, responsive to user input to the weight-modification interface element, the one or more weights of the source color palette, wherein the palette flow is computed with the one or more weights of the source color palette as modified; and
generating, with the recoloring tool, a recolored target graphic that is generated from the modification to the target graphic.

5. The method of claim 1 , wherein colors of the source graphic are represented as color vectors having a luminance vector element, the luminance vector element identifying a luminance value, the method further comprising:
presenting, in a recoloring tool of a graphics manipulation application, a luminance control interface element;
modifying, responsive to user input to the luminance-control interface element, a luminance control setting to exclude luminance values from a palette-extraction process; and
obtaining the source color palette from the source graphic by applying the palette extraction process to the color vectors, wherein the applied palette-extraction process excludes the luminance vector element.

6. The method of claim 1 , wherein computing the palette flow comprises minimizing an earth-mover distance between the target color distribution and the source color distribution.

7. The method of claim 6 , wherein minimizing the earth-mover distance comprises:
computing a total target weight that is a sum of weights of the colors in the target color palette;
computing a total source weight that is a sum of weights of the colors in the source color palette;
selecting a total flow constraint that is a minimum of the total target weight and the total source weight;
accessing an objective function that includes a weighted summation, wherein each term of the weighted summation comprises a respective distance weighted by a respective flow, wherein the respective distance is a distance in a color space between a respective pair of colors from the target color palette and the source color palette, wherein the respective flow applies to the respective pair of colors from the target color palette and the source color palette; and
determining, subject to a set of constraints, flows between the target color palette and the source color palette that minimize the objective function, the set of constraints comprising:
a respective sum of flows for each target color in the target color palette being less than or equal to a respective weight of each target color in the target color distribution,
a respective sum of flows for each source color in the source color palette being less than or equal to a respective weight of each source color in the source color distribution, and
a sum of the flows with respect to the colors of the target color palette and the colors of the source color palette being equal to the total flow constraint.

8. The method of claim 1 , further comprising computing the source color palette by performing operations comprising:
presenting, in a recoloring tool of a graphics manipulation application, a background control interface element;
modifying, responsive to user input to the background-control interface element, a background control setting to exclude one or more background colors from one or more initial source color palettes;
accessing an initial source color palette of the source graphic; and
obtaining the source color palette from the initial source color palette by removing a background color from the initial source color palette.

9. The method of claim 8 , further comprising identifying the background color in the initial source color palette by performing additional operations comprising:
accessing weights associated with colors of the initial source color palette and indicating respective densities, within the source graphic, of the colors of the initial source color palette; and
identifying the background color based on a corresponding weight for the background color being greater than one or more other weights associated with one or more other colors of the initial source color palette.

10. A method comprising:
accessing (i) a target vector graphic having path data identifying shapes and colors and (ii) a source color palette for a source graphic;
extracting a target color palette by performing operations comprising, for each target color in the target color palette:
determining a shape from the path data,
identifying the target color that is associated with the shape via the path data, and
computing a respective weight for the target color within the target color palette based on the shape;

computing a palette flow that maps colors of the target color palette to colors of the source color palette;
mapping, via the palette flow, one or more target colors included in the target vector graphic to one or more colors from the source color palette; and
modifying the target vector graphic by changing the one or more target colors based on the mapping.

11. The method of claim 10 , wherein the pa

Assignees

• Adobe Inc

Inventors

• Phogat Ankit
• Batra Vineet
• Ghosh Sayan
• Diverdi Stephen
• Cohen Scott

Classifications

• G06V10/56

  relating to colour · CPC title

• G06V10/763

  Non-hierarchical techniques, e.g. based on statistics of modelling distributions · CPC title

• G06F2218/08

  Feature extraction · CPC title

• G06T11/10 Primary

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06F18/23213

  with fixed number of clusters, e.g. K-means clustering · CPC title