Stroke operation prediction for three-dimensional digital content

Patent metadata

Field	Value
Publication number	US-11048335-B2
Application number	US-202016846895-A
Country	US
Kind code	B2
Filing date	Apr 13, 2020
Priority date	Feb 21, 2017
Publication date	Jun 29, 2021
Grant date	Jun 29, 2021

Abstract

Stroke operation prediction techniques and systems for three-dimensional digital content are described. In one example, stroke operation data is received that describes a stroke operation input via a user interface as part of the three-dimensional digital content. A cycle is generated that defines a closed path within the three-dimensional digital content based on the input stroke operation and at least one other stroke operation in the user interface. A surface is constructed based on the generated cycle. A predicted stroke operation is generated based at least in part on the constructed surface. The predicted stroke operation is then output in real time in the user interface as part of the three-dimensional digital content as the stroke operation data is received.

First claim

What is claimed is:

1. In a digital medium environment to predict stroke operations in an augmented or virtual reality environment, a method implemented by a computing device, the method comprising:
receiving, by the computing device, stroke operation data describing an input stroke operation received with respect to three-dimensional digital content in the augmented or virtual reality environment;
generating, by the computing device, a predicted stroke operation based on the input stroke operation and at least one constraint used to identify an existing stroke operation with respect to the three-dimensional digital content; and
outputting, by an output device associated with the computing device, the predicted stroke operation in a user interface as being selectable within a set amount of time to be included as part of the three-dimensional digital content.

2. The method as described in claim 1 , wherein generating the predicted stroke operation includes constructing a surface based on the input stroke operation and the existing stroke operation.

3. The method as described in claim 2 , wherein the surface is constructed using bilinear interpolation.

4. The method as described in claim 2 , wherein the surface is constructed based on a cycle that defines a closed path within the three-dimensional digital content in the augmented or virtual reality environment.

5. The method as described in claim 1 , wherein the at least one constraint is a threshold spatial distance between the input stroke operation and the existing stroke operation.

6. The method as described in claim 1 , wherein the at least one constraint defines a direction between the input stroke operation and the existing stroke operation.

7. The method as described in claim 6 , wherein the direction is defined based on a relationship of a surface normal to the input stroke operation and a surface normal to the existing stroke operation.

8. The method as described in claim 1 , wherein the computing device is configured to be worn by a user.

9. The method as described in claim 1 , wherein the existing stroke operation does not intersect the input stroke operation.

10. A system comprising:
a digital experience manager module implemented at least partially in hardware of a computing device to:
receive stroke operation data describing an input stroke operation received with respect to three-dimensional digital content in the augmented or virtual reality environment;
generate a predicted stroke operation based on the input stroke operation and at least one constraint used to identify an existing stroke operation with respect to the three-dimensional digital content; and
output, by an output device associated with the computing device, the predicted stroke operation in a user interface as being selectable within a set amount of time to be included as part of the three-dimensional digital content.

11. The system as described in claim 10 , wherein the computing device is configured to be worn by a user.

12. The system as described in claim 10 , wherein generating the predicted stroke operation includes constructing a surface based on the input stroke operation and the existing stroke operation.

13. The system as described in claim 12 , wherein the surface is constructed based on a cycle that defines a closed path within the three-dimensional digital content in the augmented or virtual reality environment.

14. The system as described in claim 12 , wherein the surface is constructed using bilinear interpolation.

15. The system as described in claim 10 , wherein the existing stroke operation does not intersect the input stroke operation.

16. The system as described in claim 10 , wherein the at least one constraint defines a direction between the input stroke operation and the existing stroke operation.

17. One or more non-transitory computer-readable storage media comprising instructions stored thereon that, responsive to execution by a computing device in a digital medium environment, cause operations of the computing device including:
receiving stroke operation data describing an input stroke operation received with respect to three-dimensional digital content in the augmented or virtual reality environment;
generating a predicted stroke operation based on the input stroke operation and at least one constraint used to identify an existing stroke operation with respect to the three-dimensional digital content; and
outputting the predicted stroke operation in a user interface as being selectable within a set amount of time to be included as part of the three-dimensional digital content.

18. The one or more non-transitory computer-readable storage media as described in claim 17 , wherein the at least one constraint is a threshold spatial distance between the input stroke operation and the existing stroke operation.

19. The one or more non-transitory computer-readable storage media as described in claim 17 , wherein the existing stroke operation does not intersect the input stroke operation.

20. The one or more non-transitory computer-readable storage media as described in claim 17 , wherein the computing device is configured to be worn by a user.

Assignees

• Adobe Inc

Inventors

• Lu Jingwan
• Diverdi Stephen J
• Kim Byungmoon
• Xing Jun

Classifications

• G06T11/23

  using straight lines or curves · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06T15/02

  Non-photorealistic rendering · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title