Method and system for transitioning between a 2d video and 3d environment

Patent metadata

Field	Value
Publication number	US-2016286208-A1
Application number	US-201615080536-A
Country	US
Kind code	A1
Filing date	Mar 24, 2016
Priority date	Mar 24, 2015
Publication date	Sep 29, 2016
Grant date	—

Abstract

A system includes one or more hardware processors, a display device, a memory storing 2-dimensional (2D) content and 3-dimensional (3D) content associated with a content item, and a playback engine. The playback engine is configured to receive the 2D content, the 2D content including one or more reference identifiers (IDs), display the 2D content on the display device for a user and, during display of the 2D content, receive an indication of a transition event. The playback engine is also configured to determine a transition reference identifier (ID) from the one or more reference IDs, identify the 3D content based on the transition reference ID, render a 3D environment based on the 3D content, and transition the display device from the displaying the 2D content to the 3D environment.

First claim

1 . A system comprising:
one or more hardware processors; a display device; a memory storing 2-dimensional (2D) content and 3-dimensional (3D) content associated with a content item; and a playback engine, executable by the one or more hardware processors, configured to perform operations comprising:
receiving the 2D content, the 2D content including one or more reference identifiers (IDs);
displaying the 2D content on the display device for a user;
during the displaying the 2D content, receiving an indication of a transition event;
determining a transition reference identifier (ID) from the one or more reference IDs;
identifying the 3D content based on the transition reference ID;
rendering a 3D environment based on the 3D content; and
transitioning the display device from the displaying the 2D content to the 3D environment.

2 . The system of claim 1 , wherein the transition event is initiated at a transition time during the displaying of the 2D content, wherein the 3D environment is an approximate 3D representation of the 2D content at the transition time.

3 . The system of claim 1 , wherein identifying the 3D content further includes:
transmitting a transition initiation message to a 3D content engine, the transition initiation message including the transition reference ID; and receiving the 3D content from the 3D content engine, the 3D content being determined based on the transition reference ID.

4 . The system of claim 1 , further comprising:
an input device; and a user interface engine, executable by the one or more hardware processors, configured to perform operations comprising:
providing user interface controls to the user within the 3D environment, the user interface controls being responsive to the input device, the user interface controls including navigation controls associated with one or more of a position and an orientation of a virtual camera within the 3D environment, thereby enabling the user to alter one or more of the position and orientation of the virtual camera within the 3D environment.

5 . The system of claim 1 , wherein the 2D content includes a 2D video having a plurality of frames, wherein one or more of the plurality of frames are associated with a single transition reference ID of the one or more reference IDs.

6 . The system of claim 5 , wherein the transition reference ID is associated with a transition frame, wherein the transition event is initiated at a transition time during the displaying of the 2D content, wherein determining the transition reference ID further includes:
determining the transition frame based on a transition time; and determining the transition reference ID based on the determining the transition frame and the association between the transition frame and the transition reference ID.

7 . The system of claim 1 , further comprising:
a 3D content engine, executable by the one or more hardware processors, configured to perform operations comprising:
generating the one or more reference IDs;
associating the one or more reference IDs with the 3D data; and
associating the one or more reference IDs with the 2D data,
wherein the identifying the 3D content further includes the 3D content engine providing the 3D data to the playback engine in response to the transition event.

8 . A computer-implemented method comprising:
receiving 2D content, the 2D content including one or more reference identifiers (IDs); displaying the 2D content on a display device for a user; during the displaying the 2D content, receiving an indication of a transition event; determining a transition reference identifier (ID) from the one or more reference IDs; identifying the 3D content based on the transition reference ID; rendering a 3D environment based on the 3D content; and transitioning the display device from the displaying the 2D content to the 3D environment.

9 . The method of claim 8 , wherein the transition event is initiated at a transition time during the displaying of the 2D content, wherein the 3D environment is an approximate 3D representation of the 2D content at the transition time.

10 . The method of claim 8 , wherein identifying the 3D content further includes:
transmitting a transition initiation message to a 3D content engine, the transition initiation message including the transition reference ID; and receiving the 3D content from the 3D content engine, the 3D content being determined based on the transition reference ID.

11 . The method of claim 8 , further comprising:
providing user interface controls to the user within the 3D environment, the user interface controls being responsive to an input device, the user interface controls including navigation controls associated with one or more of a position and an orientation of a virtual camera within the 3D environment, thereby enabling the user to alter one or more of the position and orientation of the virtual camera within the 3D environment.

12 . The method of claim 8 , wherein the 2D content includes a 2D video having a plurality of frames, wherein one or more of the plurality of frames are associated with a single transition reference ID of the one or more reference IDs.

13 . The method of claim 12 , wherein the transition reference ID is associated with a transition frame, wherein the transition event is initiated at a transition time during the displaying of the 2D content, wherein determining the transition reference ID further includes:
determining the transition frame based on a transition time; and determining the transition reference ID based on the determining the transition frame and the association between the transition frame and the transition reference ID.

14 . The method of claim 8 , further comprising:
generating the one or more reference IDs; associating the one or more reference IDs with the 3D data; and associating the one or more reference IDs with the 2D data, wherein the identifying the 3D content further includes providing the 3D data in response to the transition event.

15 . A non-transitory machine-readable medium storing processor-executable instructions which, when executed by a processor, cause the processor to perform operations comprising:
receiving 2D content, the 2D content including one or more reference identifiers (IDs); displaying the 2D content on a display device for a user; during the displaying the 2D content, receiving an indication of a transition event; determining a transition reference identifier (ID) from the one or more reference IDs; identifying the 3D content based on the transition reference ID; rendering a 3D environment based on the 3D content; and transitioning the display device from the displaying the 2D content to the 3D environment.

16 . The machine-readable medium of claim 15 , wherein the transition event is initiated at a transition time during the displaying of the 2D content, wherein the 3D environment is an approximate 3D representation of the 2D content at the transition time.

17 . The machine-readable medium of claim 15 , wherein identifying the 3D content further includes:
transmitting a transition initiation message to a 3D content engine, the transition initiation message including the transition reference ID; and receiving the 3D content from the 3D content engine, the 3D content being determined based on the transition reference ID.

18 . The machine-readable medium of claim 15 , wherein the processor-executable instructions further cause the processor to perform operations comprising:
providing u

Assignees

• Unity IPR ApS

Inventors

• Drouin Sylvio Herve

Classifications

• H04N13/0454 Primary

  Electricity · mapped topic

• H04N13/0497

  Electricity · mapped topic

• H04N13/0402

  Electricity · mapped topic

• H04N21/43072 Primary

  of multiple content streams on the same device · CPC title

• H04N21/816 Primary

  involving special video data, e.g 3D video · CPC title