Two-dimensional compositing

Patent metadata

Field	Value
Publication number	US-11670207-B2
Application number	US-202016861133-A
Country	US
Kind code	B2
Filing date	Apr 28, 2020
Priority date	Aug 10, 2017
Publication date	Jun 6, 2023
Grant date	Jun 6, 2023

Abstract

Two-dimensional compositing that preserves the curvatures of non-flat surfaces is disclosed. In some embodiments, a mapping is associated with a two-dimensional rendering that maps a potentially variable portion of the two-dimensional rendering to a canvas. The mapping is generated from a three-dimensional model of the potentially variable portion of the two-dimensional rendering. The potentially variable portion of the two-dimensional rendering is dynamically modified according to the mapping to reflect content comprising the canvas or edits received with respect to the canvas.

First claim

What is claimed is:

1. A method, comprising:
generating a mapping that maps a modifiable portion of an image to a canvas, wherein the image is rendered from one or more three-dimensional polygon mesh models corresponding to objects comprising the image, wherein a plurality of perspectives of objects is rendered from the one or more corresponding three-dimensional polygon mesh models including object perspectives comprising the image, and wherein the mapping is generated from a three-dimensional polygon mesh model of the modifiable portion of the image; and
storing the generated mapping with the image;
wherein the image and the mapping are provided from a server to a client and the canvas is composited client-side on the modifiable portion of the image according to the mapping and in a manner that preserves surface curvatures in the modifiable portion of the image.

2. The method of claim 1 , wherein edits on the canvas are composited in real time to dynamically modify the modifiable portion of the image.

3. The method of claim 1 , wherein empty portions of the canvas that do not include any content comprise transparent pixels that do not modify corresponding original pixels of the modifiable portion of the image.

4. The method of claim 1 , wherein the mapping comprises UV mapping.

5. The method of claim 1 , wherein the canvas comprises a textured image.

6. The method of claim 1 , wherein the canvas is editable and is used to specify or generate custom content.

7. The method of claim 1 , wherein generating the mapping comprises encoding the mapping.

8. The method of claim 1 , wherein generating the mapping comprises rendering an encoded version of the mapping.

9. A method, comprising:
receiving from a server an image and a mapping that maps a modifiable portion of the image to a canvas, wherein the image is rendered from one or more three-dimensional polygon mesh models corresponding to objects comprising the image, wherein a plurality of perspectives of objects is rendered from the one or more corresponding three-dimensional polygon mesh models including object perspectives comprising the image, and wherein the mapping is generated from a three-dimensional polygon mesh model of the modifiable portion of the image; and
modifying the received image client-side by compositing the canvas on the modifiable portion of the image according to the mapping and in a manner that preserves surface curvatures in the modifiable portion of the image.

10. The method of claim 9 , wherein edits on the canvas are composited in real time to dynamically modify the modifiable portion of the image.

11. The method of claim 9 , wherein empty portions of the canvas that do not include any content comprise transparent pixels that do not modify corresponding original pixels of the modifiable portion of the image.

12. The method of claim 9 , wherein the mapping comprises UV mapping.

13. The method of claim 9 , wherein the canvas is editable and is used to specify or generate custom content.

14. The method of claim 9 , wherein the canvas comprises a textured image.

15. The method of claim 9 , wherein the mapping is encoded.

16. The method of claim 9 , wherein the mapping comprises a rendering of pixel values encoding spatial coordinates.

17. A system, comprising:
a processor configured to:
generate a mapping that maps a modifiable portion of an image to a canvas, wherein the image is rendered from one or more three-dimensional polygon mesh models corresponding to objects comprising the image, wherein a plurality of perspectives of objects is rendered from the one or more corresponding three-dimensional polygon mesh models including object perspectives comprising the image, and wherein the mapping is generated from a three-dimensional polygon mesh model of the modifiable portion of the image; and
store the generated mapping with the image;
wherein the image and the mapping are provided from a server to a client and the canvas is composited client-side on the modifiable portion of the image according to the mapping and in a manner that preserves surface curvatures in the modifiable portion of the image; and

a memory coupled to the processor and configured to provide the processor with instructions.

18. The system of claim 17 , wherein edits on the canvas are composited in real time to dynamically modify the modifiable portion of the image.

19. The system of claim 17 , wherein empty portions of the canvas that do not include any content comprise transparent pixels that do not modify corresponding original pixels of the modifiable portion of the image.

20. The system of claim 17 , wherein the mapping comprises UV mapping.

21. The system of claim 17 , wherein the canvas is editable and is used to specify or generate custom content.

22. The system of claim 17 , wherein the canvas comprises a textured image.

23. The system of claim 17 , wherein to generate the mapping comprises to encode the mapping.

24. The system of claim 17 , wherein to generate the mapping comprises to render an encoded version of the mapping.

25. A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
generating a mapping that maps a modifiable portion of an image to a canvas, wherein the image is rendered from one or more three-dimensional polygon mesh models corresponding to objects comprising the image, wherein a plurality of perspectives of objects is rendered from the one or more corresponding three-dimensional polygon mesh models including object perspectives comprising the image, and wherein the mapping is generated from a three-dimensional polygon mesh model of the modifiable portion of the image; and
storing the generated mapping with the image;
wherein the image and the mapping are provided from a server to a client and the canvas is composited client-side on the modifiable portion of the image according to the mapping and in a manner that preserves surface curvatures in the modifiable portion of the image.

26. The computer program product of claim 25 , wherein edits on the canvas are composited in real time to dynamically modify the modifiable portion of the image.

27. The computer program product of claim 25 , wherein empty portions of the canvas that do not include any content comprise transparent pixels that do not modify corresponding original pixels of the modifiable portion of the image.

28. The computer program product of claim 25 , wherein the mapping comprises UV mapping.

29. The computer program product of claim 25 , wherein the canvas is editable and is used to specify or generate custom content.

30. The computer program product of claim 25 , wherein the canvas comprises a textured image.

31. The computer program product of claim 25 , wherein generating the mapping comprises encoding the mapping.

32. The computer program product of claim 25 , wherein generating the mapping comprises rendering an encoded version of the mapping.

33. A system, comprising:
a processor configured to:
receive from a server an image and a mapping that maps a modifiable portion of the image to a canvas, wherein the image is rendered from one or more three-dimensional polygon mesh models corresponding to objects comprising the image, wherein a pluralit

Assignees

• Outward Inc

Inventors

• Chui Clarence
• Murphy Christopher

Classifications

• G09G5/363

  Graphics controllers · CPC title

• G09G3/20 Primary

  for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters} · CPC title

• G06T15/04

  Texture mapping · CPC title

• G06T11/40

  Filling planar surfaces by adding surface attributes, e.g. adding colours or textures · CPC title

• G09G2370/022

  Centralised management of display operation, e.g. in a server instead of locally · CPC title