3D paint effects in a messaging system

Patent metadata

Field	Value
Publication number	US-11625895-B2
Application number	US-202117386998-A
Country	US
Kind code	B2
Filing date	Jul 28, 2021
Priority date	Mar 27, 2020
Publication date	Apr 11, 2023
Grant date	Apr 11, 2023

Abstract

Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.

First claim

What is claimed is:

1. A method comprising:
generating, by a first computing device, a three-dimensional (3D) mesh along a path following movement of the first computing device using multiple X, Y, and Z coordinates calculated based on the movement of the first computing device;
populating, by the first computing device, the 3D mesh with a selected color and texture type to generate a 3D paint object in a camera view of the first computing device;
associating the generated 3D paint object with an object in the camera view;
causing, by the first computing device, display of the generated 3D paint object to move as the object in the camera view moves;
capturing, by a camera of the first computing device, an image or video of the displayed 3D paint object associated with the object in the camera view;
generating, by the first computing device, a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and
sending, by the first computing device, the message to a second computing device.

2. The method of claim 1 , wherein the 3D paint object is generated in real time based on the movement of the first computing device.

3. The method of claim 1 , wherein the method further comprises:
receiving a request to send the generated 3D paint object to a third computing device; and
sending the 3D paint object to the third computing device, wherein the 3D paint object is overlaid on an image or video captured by the third computing device.

4. The method of claim 1 , wherein generating the 3D paint object further comprises tapering at least one of a beginning or an ending of a 3D paint line of the 3D paint object.

5. The method of claim 1 , wherein the 3D mesh comprises a cylindrical or polygon shape causing a 3D paint line of the 3D paint object to be in a cylindrical or polygon shape.

6. The method of claim 1 , wherein the texture type is a type particle and the 3D paint object comprises 3D particles along the path.

7. The method of claim 1 , wherein the 3D mesh comprises more than one shape and the 3D paint object is generated using more than one shape.

8. The method of claim 7 , wherein each shape of the more than one shape comprises a color and texture type.

9. The method of claim 1 , further comprising:
applying a smoothing algorithm to the path.

10. The method of claim 1 , wherein the 3D paint object is displayed on the second computing device as the generated 3D paint object is caused to move on the first computing device as the object in the camera view moves.

11. The method of claim 1 , wherein the object in the camera view is a face or body part.

12. The method of claim 1 , further comprising:
causing display on the first computing device of a second 3D paint object being drawn on a second computing device.

13. A computing device comprising:
a memory that stores instructions; and
one or more processors configured by the instructions to perform operations comprising:
generating a three-dimensional (3D) mesh along a path following movement of the computing device using multiple X, Y, and Z coordinates calculated based on the movement of the computing device;
populating the 3D mesh with a selected color and texture type to generate a 3D paint object in a camera view of the computing device;
associating the generated 3D paint object with an object in the camera view;
causing display of the generated 3D paint object to move as the object in the camera view moves;
capturing, by a camera of the computing device, an image or video of the displayed 3D paint object associated with the object in the camera view;
generating a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and
sending the message to a second computing device.

14. The computing device of claim 13 , wherein the 3D paint object is generated in real time based on the movement of the first computing device.

15. The computing device of claim 13 , the operations further comprising:
receiving a request to send the generated 3D paint object to a third computing device; and
sending the 3D paint object to the third computing device, wherein the 3D paint object is overlaid on an image or video captured by the third computing device.

16. The computing device of claim 13 , wherein generating the 3D paint object further comprises tapering at least one of a beginning or an ending of a 3D paint line of the 3D paint object.

17. The computing device of claim 13 , wherein the 3D mesh comprises a cylindrical or polygon shape causing a 3D paint line of the 3D paint object to be in a cylindrical or polygon shape.

18. The computing device of claim 13 , wherein the texture type is a type particle and the 3D paint object comprises 3D particles along the path.

19. The computing device of claim 13 , wherein the 3D mesh comprises more than one shape and the 3D paint object is generated using more than one shape.

20. A non-transitory computer-readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:
generating a three-dimensional (3D) mesh along a path following movement of the computing device using multiple X, Y, and Z coordinates calculated based on the movement of the computing device;
populating the 3D mesh with a selected color and texture type to generate a 3D paint object in a camera view of the computing device;
associating the generated 3D paint object with an object in the camera view;
causing display of the generated 3D paint object to move as the object in the camera view moves;
capturing, by a camera of the computing device, an image or video of the displayed 3D paint object associated with the object in the camera view;
generating a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and
sending the message to a second computing device.

Assignees

• Snap Inc

Inventors

• Cowburn Piers George
• Goodrich Kyle
• Hare Samuel Edward
• Lazarov Maxim Maximov
• Li David
• Mathew Tony
• McPhee Andrew James
• Moreno Daniel
• Müller Sandvik Isac Andreas
• Shang Wentao

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T2219/2021

  Shape modification · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title