Conversion of 2D diagrams to 3D rich immersive content

Patent metadata

Field	Value
Publication number	US-10535172-B2
Application number	US-201816216531-A
Country	US
Kind code	B2
Filing date	Dec 11, 2018
Priority date	Jul 21, 2017
Publication date	Jan 14, 2020
Grant date	Jan 14, 2020

Abstract

Implementations are directed to methods, systems, apparatus, and computer programs for generation of a three-dimensional (3D) animation by receiving a user input defining a two-dimensional (2D) representation of a plurality of elements, processing, by the one or more processors, the 2D representation to classify the plurality of elements in symbolic elements and action elements, generating, by the one or more processors, based on the symbolic elements, the action elements, and a set of rules a 3D animation corresponding to the 2D representation, and transmitting, by the one or more processors, the 3D animation to an extended reality device for display.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving a user input of a 2D representation of (i) one or more symbolic elements that are to be visualized as one or more objects in a desired 3D animation, and (ii) one or more action elements that each represent a respective trajectory of one or more of the objects in the desired 3D animation, and that are to not be visualized as an object in the desired 3D animation;
determining that a particular trajectory associated with a particular action element would cause two or more particular objects to collide in the desired 3D animation;
in response to determining that the particular trajectory associated with a particular action element would cause two or more particular objects to collide in the desired 3D animation, determining an alternative trajectory that will not cause the two or more particular objects to collide in the desired 3D animation; and
generating the desired 3D animation based on the 2D representation, comprising animating the two or more particular objects based on the alternative trajectory in lieu of the particular trajectory that is associated with the particular action element in the 2D representation.

2. The method of claim 1 , comprising classifying the elements in the 2D representation as either symbolic element or action elements.

3. The method of claim 1 , comprising obtaining animation characteristics for each of the symbolic elements.

4. The method of claim 1 , wherein each of the action elements comprises a vector that indicates a direction and speed of displacement of an associated object.

5. The method of claim 1 , comprising transmitting the generated 3D animation to an extended reality device, for output.

6. The method of claim 1 , comprising adjusting a visual perspective associated with the generated 3D animation based on a user input at an extended reality device.

7. The method of claim 1 , wherein the two-dimensional representation comprises a sketch overlaid on a sports playing field, including a sketched objects of a particular shape that each correspond to a symbolic element, and arrows emanating from the sketched objects that each correspond to an action element.

8. A non-transitory computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving a user input of a 2D representation of (i) one or more symbolic elements that are to be visualized as one or more objects in a desired 3D animation, and (ii) one or more action elements that each represent a respective trajectory of one or more of the objects in the desired 3D animation, and that are to not be visualized as an object in the desired 3D animation;
determining that a particular trajectory associated with a particular action element would cause two or more particular objects to collide in the desired 3D animation;
in response to determining that the particular trajectory associated with a particular action element would cause two or more particular objects to collide in the desired 3D animation, determining an alternative trajectory that will not cause the two or more particular objects to collide in the desired 3D animation; and
generating the desired 3D animation based on the 2D representation, comprising animating the two or more particular objects based on the alternative trajectory in lieu of the particular trajectory that is associated with the particular action element in the 2D representation.

9. The medium of claim 8 , wherein the operations comprise classifying the elements in the 2D representation as either symbolic element or action elements.

10. The medium of claim 8 , wherein the operations comprise obtaining animation characteristics for each of the symbolic elements.

11. The medium of claim 8 , wherein each of the action elements comprises a vector that indicates a direction and speed of displacement of an associated object.

12. The medium of claim 8 , wherein the operations comprise transmitting the generated 3D animation to an extended reality device, for output.

13. The medium of claim 8 , wherein the operations comprise adjusting a visual perspective associated with the generated 3D animation based on a user input at an extended reality device.

14. The medium of claim 8 , wherein the two-dimensional representation comprises a sketch overlaid on a sports playing field, including a sketched objects of a particular shape that each correspond to a symbolic element, and arrows emanating from the sketched objects that each correspond to an action element.

15. A system comprising:
one or more processors; and
a computer-readable storage device coupled to the one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving a user input of a 2D representation of (i) one or more symbolic elements that are to be visualized as one or more objects in a desired 3D animation, and (ii) one or more action elements that each represent a respective trajectory of one or more of the objects in the desired 3D animation, and that are to not be visualized as an object in the desired 3D animation;
determining that a particular trajectory associated with a particular action element would cause two or more particular objects to collide in the desired 3D animation;
in response to determining that the particular trajectory associated with a particular action element would cause two or more particular objects to collide in the desired 3D animation, determining an alternative trajectory that will not cause the two or more particular objects to collide in the desired 3D animation; and
generating the desired 3D animation based on the 2D representation, comprising animating the two or more particular objects based on the alternative trajectory in lieu of the particular trajectory that is associated with the particular action element in the 2D representation.

16. The system of claim 15 , wherein the operations comprise classifying the elements in the 2D representation as either symbolic element or action elements.

17. The system of claim 15 , wherein the operations comprise obtaining animation characteristics for each of the symbolic elements.

18. The system of claim 15 , wherein each of the action elements comprises a vector that indicates a direction and speed of displacement of an associated object.

19. The system of claim 15 , wherein the operations comprise transmitting the generated 3D animation to an extended reality device, for output.

20. The system of claim 15 , wherein the operations comprise adjusting a visual perspective associated with the generated 3D animation based on a user input at an extended reality device.

Assignees

• Accenture Global Solutions Ltd

Inventors

• Short Matthew Thomas
• Dooley Robert
• Cheng Grace T
• Webb Sunny
• Hamilton Mary Elizabeth

Classifications

• G06F18/24

  Classification techniques · CPC title

• G06T13/20 Primary

  Three-dimensional [3D] animation · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T15/20

  Perspective computation · CPC title