View-driven consumption of frameless media

Patent metadata

Field	Value
Publication number	US-9779480-B2
Application number	US-201414335833-A
Country	US
Kind code	B2
Filing date	Jul 18, 2014
Priority date	Jul 19, 2013
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

This document describes techniques and apparatuses enabling view-driven consumption of frameless media. These techniques and apparatuses provide frameless media and enable a user to engage with the frameless media by orienting a viewing device within the world created by that frameless media. This orienting by the user drives what the user sees in this world and when the user sees it.

First claim

What is claimed is:

1. A method comprising:
receiving an orientation of a mobile display on which frameless media is currently presented, the orientation different from an immediately previous orientation of the mobile display, the frameless media capable of telling a story, the story including an authored series of story events representing an authored storyline of the story;
presenting, in response to the received orientation, images of the frameless media corresponding to the received orientation;
determining that the images of the frameless media corresponding to the received orientation include or do not include storyline image elements, the storyline image elements presenting at least a portion of one story event of the authored series of story events included within the frameless media;
responsive to determining that the images include the storyline image elements, presenting the storyline image elements on the mobile display effective to progress through the authored series of story events; and
responsive to determining that the images do not include the storyline image elements, ceasing to progress through the authored series of story events.

2. The method as recited in claim 1 , wherein the received orientation indicates one of a moving or tilting the display up, down, left, or right relative to the immediately previous orientation.

3. The method as recited in claim 1 , wherein the frameless media is a spherical media environment having no frame in a horizontal or vertical direction and enabling 360-degree viewing in the horizontal direction and the vertical direction from a point at or near a center of the spherical media environment to an interior surface of the spherical media environment on which the frameless media resides.

4. The method as recited in claim 1 , wherein the step of determining that the images of the frameless media corresponding to the received orientation include or do not include storyline image elements includes mapping the images to portions of a three-dimensional surface on which the frameless media is represented.

5. The method as recited in claim 1 , wherein the frameless media is capable of being presented in three dimensions and the mobile display presents the frameless media in three dimensions within each of the images.

6. The method as recited in claim 5 , wherein the mobile display includes stereoscopic eyeglasses and the received orientations are received through movement of a viewer's head or eyes on or over which the stereoscopic eyeglasses reside.

7. The method as recited in claim 1 , wherein the presenting images presents the images in two dimensions and the frameless media is capable of being fully viewed non-contemporaneously through the images in two dimensions.

8. The method as recited in claim 1 , wherein the frameless media is a live-action movie filmed with a 360-degree perspective in a horizontal direction.

9. The method as recited in claim 1 , wherein the frameless media is an animated motion picture having images viewable from a 360-degree perspective in a horizontal direction and a 270-degree or greater perspective in a vertical direction.

10. The method as recited in claim 1 , wherein the determining that the images of the frameless media include or do not include storyline image elements is based on metadata for the frameless media.

11. The method as recited in claim 1 , wherein the determining that the images of the frameless media include or do not include storyline image elements is based on the images mapping to sectors identified as having storyline image elements.

12. The method as recited in claim 1 , wherein the determining that the images of the frameless media include or do not include storyline image elements is based on facial recognition or object recognition.

13. The method as recited in claim 1 , wherein the determining that the images do not include the storyline image elements includes the images having non-storyline image elements, and the method further comprises presenting the non-storyline image elements.

14. The method as recited in claim 13 , wherein the non-storyline image elements are presented with movement.

15. The method as recited in claim 13 , wherein the story further includes a subordinate story event different than the authored series of story events and wherein the presenting of the non-storyline image elements includes presenting the non-storyline image elements on the mobile display effective to progress through the subordinate story event.

16. The method as recited in claim 1 , further comprising:
receiving another orientation after ceasing to progress through the authored series of story events;
determining that the images of the frameless media corresponding to the another received orientation includes the storyline image elements; and
resuming the progression through the authored series of story events from a point at which the progression through the authored series of story events ceased.

17. An apparatus comprising:
a mobile display;
orientation sensors associated with the mobile display;
one or more computer processors;
one or more computer-readable storage devices comprising processor-executable instructions that, responsive to execution by the one or more computer processors, perform a method comprising:
receiving real-time orientation data from the orientation sensors, the orientation data indicating orientations of the mobile display;
in real-time and responsive to the real-time orientation data indicating orientations of the mobile display, presenting images of frameless media corresponding to the orientations, the frameless media having no frame in at least one direction, the frameless media capable of telling a story, the story including an authored series of story events representing an authored storyline of the story; and
when the presented images include storyline image elements representing at least a portion of one story event of the authored series of story events of the frameless media, presenting the storyline image elements at or near a point in the one story event, the one story event previously presented prior to presenting images that do not include the storyline image elements.

18. The apparatus of claim 17 , further comprising mapping the images to sectors of a three-dimensional surface corresponding to the frameless media, the mapping indicating, based on the images being within a portion of the sectors, that the images include the storyline image elements.

19. The apparatus of claim 17 , wherein the presenting of the storyline image elements at or near the point in the one story event includes repeating the one story event.

20. The apparatus of claim 17 , wherein the presenting of the storyline image elements at or near the point in the one story event resumes the progression through the authored series of story events.

Assignees

• Google Technology Holdings LLC

Inventors

• Austin Darren Mark
• Elmieh Baback
• Sweetland Douglas Paul
• Collins Brian M
• Pinkava Jan J

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N21/21805 Primary

  enabling multiple viewpoints, e.g. using a plurality of cameras · CPC title

• G06T3/60 Primary

  Rotation of whole images or parts thereof · CPC title

• H04N21/8541

  involving branching, e.g. to different story endings · CPC title

• H04N21/41407

  embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57) · CPC title