Visualisation and navigation of transmedia content data

Patent metadata

Field	Value
Publication number	US-10229215-B2
Application number	US-201615276535-A
Country	US
Kind code	B2
Filing date	Sep 26, 2016
Priority date	Sep 26, 2016
Publication date	Mar 12, 2019
Grant date	Mar 12, 2019

Abstract

A method of rendering content items on a display via an electronic device involves mapping linked content items to a three-dimensional object defined by layout data. The layout data is then transmitted to an electronic device for display.

First claim

The invention claimed is:

1. A computer-implemented method of rendering content items on a display of an electronic device, the method comprising:
mapping, by a server device, linked content items to a three-dimensional object defined by layout data, wherein mapping the linked transnnedia content items comprises generating the layout data, the layout data defining a position of each linked transmedia content item to a position on the three-dimensional object based on a hierarchical tree structure of the linked content items;
modelling the linked content items as a mass-spring system in which each linked content item is a mass and each content item is linked to each adjacent content item by a spring
transmitting, by the server device, the layout data to the electronic device;
generating, by the electronic device, a two-dimensional representation of the three-dimensional object for display on the electronic device, wherein the step of generating the two-dimensional representation comprises generating a distance field map for the three- dimensional object based on the layout data; and
outputting the two-dimensional representation on the display associated with the electronic device.

2. The method of claim 1 , wherein the position of each linked content item on the surface of the three-dimensional object is defined as an equilibrium position for the modelled forces in the mass-spring system.

3. The method of claim 2 , wherein the mass-spring system comprises one or more of: a potential force, a spring force, a pressure force and a joint force.

4. The method of claim 1 , further comprising storing the generated distance field map in a memory of the electronic device as a stored distance field map.

5. The method of claim 4 , wherein the step of generating the two-dimensional representation comprises rendering a two-dimensional representation of the three-dimensional object by sampling the distance field map on the surface of the surface of the three-dimensional object.

6. The method of claim 5 , wherein the step of rendering is performed utilizing spherical ray casting techniques applied to the distance field map.

7. The method of claim 5 , wherein the step of rendering comprises perturbing the height of the surface of the three-dimensional object above or below a normal level based on characteristics of the linked content items.

8. The method of claim 7 , wherein the characteristics of the linked content items comprise one or more of:
the number of linked content items adjacent each other in the layout data; and
similarity of characters depicted in the linked content items;
similarity of location of scenes depicted in the linked content items; and
mood and/or genre attributes of the linked content items.

9. The method of claim 7 , wherein the step of perturbing the height is custom for each user of the system based on a user profile for each user associated with the electronic device.

10. The method of claim 7 , wherein the step of rendering further comprises assigning color to the surface of the three-dimensional object according to a height of each item below or above the normal level, and/or a gradient of the surface of the three-dimensional object.

11. The method of claim 7 , wherein the step of rendering further comprises assigning color to the surface of the three-dimensional object according to proximity of each linked content item to adjacent linked content items on the surface of the three-dimensional object.

12. The method of claim 1 , wherein the step of generating a distance field further comprises generating a low-distortion, seamless spherical mapping based on the hierarchical tree structure to generate the distance field map.

13. The method of claim 1 , further comprising:
generating updated layout data based on at least one change to the linked content items or the links therebetween, wherein the updated layout data contains one or more delta updates with respect to the previously transmitted layout data; and
transmitting the updated layout data to the electronic device for display.

14. The method of claim 13 , further comprising the following steps:
receiving at the electronic device, updated layout data, wherein the updated layout data contains delta updates with respect to the previously received layout data;
rendering an updated two-dimensional representation based on the updated layout data; and
outputting the updated two-dimensional representation on the display associated with the electronic device.

15. The method of claim 14 , further comprising, prior to rendering the updated two-dimensional representation:
generating updated distance field points based on the updated layout data;
generating an updated distance field map by composing the updated distance field points with the stored distance field; and
storing the updated distance field map in the memory of the electronic device.

16. The method of claim 15 , further comprising the following steps:
interpolating a state of the layout data based on previously received layout data and/or updated layout data to generate interpolated layout data;
rendering an interpolated two-dimensional representation based on the interpolated layout data; and
outputting the interpolated two-dimensional representation on the display associated with the electronic device.

17. The method of claim 16 , further comprising, prior to rendering the interpolated two-dimensional representation:
generating interpolated distance field points based on the interpolated layout data;
generating an interpolated distance field by composing the interpolated distance field points with the stored distance field map.

18. The method of claim 16 , wherein the interpolated layout data comprises two-dimensional layout points of the layout data that are changed from the previously received layout data and/or updated layout data that corresponds to the stored distance field map.

19. The method of claim 17 , wherein the step of rendering an interpolated two dimensional representation comprises sampling the interpolated distance field points to produce an animated transition between the previously output two-dimensional representation and the interpolated two-dimensional representation.

20. The method of claim 1 , wherein the step of rendering a two-dimensional representation further comprises rendering effects on a surface of the three-dimensional object.

21. The method of claim 20 , wherein the effects rendered on the surface of the three-dimensional object comprise a cloud fluid simulation.

22. The method of claim 21 , wherein the cloud fluid simulation is rendered such that the pattern of clouds is based on properties of the data contained in the hierarchical tree structure.

23. The method of claim 1 , wherein the step of rendering a two-dimensional representation comprises perturbing the height of the surface of the three-dimensional object from a normal level based on naturalistic fractal noise patterns.

24. The method of claim 23 , wherein color and/or texture is applied to the surface of the three-dimensional object based on the height of the surface of the three-dimensional object above or below the normal level.

25. The method of claim 1 , wherein the linked content items are transmedia content data items, and the links are time-ordered content links.

26. A computer-readable medium containing computer readable instructions which, when exec

Assignees

• Disney Entpr Inc
• Eth Zuerich Eidgenoessische Technische Hochschulze Zuerich

Inventors

• Solenthaler Barbara
• JEONG Sohyeon
• Grosse Max
• Schriber Sasha
• Sinclair David
• Cabral Maria
• Gross Markus
• Mitchell Kenneth J

Classifications

• G06F17/30873 Primary

  Physics · mapped topic

• G06F17/3089

  Physics · mapped topic

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06T15/04

  Texture mapping · CPC title

• H04N21/00

  Selective content distribution, e.g. interactive television or video on demand [VOD] (real-time bi-directional transmission of motion video data H04N7/14 {; broadcast or conference over packet switching networks H04L12/18}) · CPC title