3D paint effects in a messaging system

Patent metadata

Field	Value
Publication number	US-11908082-B2
Application number	US-202318110128-A
Country	US
Kind code	B2
Filing date	Feb 15, 2023
Priority date	Mar 27, 2020
Publication date	Feb 20, 2024
Grant date	Feb 20, 2024

Abstract

Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.

First claim

What is claimed is:

1. A method comprising:
associating a generated three-dimensional (3D) paint object with an object in a camera view on a first computing device;
causing, by the first computing device, display of the generated 3D paint object to move as the object in the camera view moves;
capturing, by a camera of the first computing device, an image or video of the displayed 3D paint object associated with the object in the camera view;
generating, by the first computing device, a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and
sending, by the first computing device, the message to a second computing device.

2. The method of claim 1 , wherein the generated 3D paint object is generated in real time based on movement of the first computing device.

3. The method of claim 1 , wherein the method further comprises:
receiving a request to send the generated 3D paint object to a third computing device; and
sending the generated 3D paint object to the third computing device, wherein the generated 3D paint object is overlaid on an image or video captured by the third computing device.

4. The method of claim 1 , wherein the generated 3D paint object is generated by tapering at least one of a beginning or an ending of a 3D paint line of the generated 3D paint object.

5. The method of claim 1 , wherein the generated 3D paint object comprises a cylindrical or polygon shape causing a 3D paint line of the generated 3D paint object to be in a cylindrical or polygon shape.

6. The method of claim 1 , wherein the generated 3D paint object comprises 3D particles along a path of movement of the generated 3D paint object.

7. The method of claim 1 , wherein the generated 3D paint object is generated using more than one shape.

8. The method of claim 7 , wherein each shape of the more than one shape comprises a color and texture type.

9. The method of claim 1 , further comprising:
applying a smoothing algorithm to a path of the generated 3D paint object following movement of the first computing device.

10. The method of claim 1 , wherein the generated 3D paint object is displayed on the second computing device as the generated 3D paint object is caused to move on the first computing device as the object in the camera view moves.

11. The method of claim 1 , wherein the object in the camera view is a face or body part.

12. The method of claim 1 , further comprising:
receiving data for a second 3D paint object being drawn on the second computing device, the second 3D paint object being drawn in a same space as the generated 3D paint object; and
causing display on the first computing device of the second 3D paint object being drawn on the second computing device during display of the generated 3D paint object.

13. The method of claim 1 , wherein the generated 3D paint object is generated by performing operations comprising:
generating a 3D mesh along a path following movement of the first computing device using multiple X, Y, and Z coordinates calculated based on the movement of the first computing device; and
populating the 3D mesh with a selected color and texture type to generate the generated 3D paint object.

14. A computing device comprising:
a camera;
a memory that stores instructions; and
one or more processors configured by the instructions to perform operations comprising:
associating a generated three-dimensional (3D) paint object with an object in a camera view on the computing device;
causing display of the generated 3D paint object to move as the object in the camera view moves;
capturing, by the camera, an image or video of the displayed 3D paint object associated with the object in the camera view;
generating a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and
sending the message to a second computing device.

15. The computing device of claim 14 , wherein the operations further comprise:
receiving a request to send the generated 3D paint object to a third computing device; and
sending the generated 3D paint object to the third computing device, wherein the generated 3D paint object is overlaid on an image or video captured by the third computing device.

16. The computing device of claim 14 , wherein the generated 3D paint object comprises a cylindrical or polygon shape causing a 3D paint line of the generated 3D paint object to be in a cylindrical or polygon shape.

17. The computing device of claim 14 , wherein the generated 3D paint object comprises 3D particles along a path of movement of the generated 3D paint object.

18. The computing device of claim 14 , wherein the generated 3D paint object is displayed on the second computing device as the generated 3D paint object is caused to move on the computing device as the object in the camera view moves.

19. The computing device of claim 14 , further comprising:
receiving data for a second 3D paint object being drawn on the second computing device, the second 3D paint object being drawn in a same space as the generated 3D paint object; and
causing display on the computing device of the second 3D paint object being drawn on the second computing device during display of the generated 3D paint object.

20. A non-transitory computer-readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:
associating a generated three-dimensional (3D) paint object with an object in a camera view on the computing device;
causing display of the generated 3D paint object to move as the object in the camera view moves;
capturing, by a camera of the computing device, an image or video of the displayed 3D paint object associated with the object in the camera view;
generating a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and
sending the message to a second computing device.

Assignees

• Snap Inc

Inventors

• Cowburn Piers George
• Goodrich Kyle
• Hare Samuel Edward
• Lazarov Maxim Maximov
• Li David
• Mathew Tony
• McPhee Andrew James
• Moreno Daniel
• Müller Sandvik Isac Andreas
• Shang Wentao

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06T17/20 Primary

  Finite element generation, e.g. wire-frame surface description, {tesselation} · CPC title

• G06T11/203

  Physics · mapped topic

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title