Systems and methods for content streaming

Patent metadata

Field	Value
Publication number	US-10657702-B2
Application number	US-201715847184-A
Country	US
Kind code	B2
Filing date	Dec 19, 2017
Priority date	Sep 22, 2015
Publication date	May 19, 2020
Grant date	May 19, 2020

Abstract

Systems, methods, and non-transitory computer-readable media can obtain a spherical media content item that captures at least one scene from a plurality of different positions. A three-dimensional shape having a plurality of faces is determined, each face being associated with a respective set of original boundaries. A respective set of expanded boundaries for one or more of the plurality of faces is determined. Respective portions of the spherical media content item are mapped to each of the one or more faces, wherein a first portion of the spherical media content item is mapped to a first face having a set of expanded boundaries.

First claim

What is claimed is:

1. A computer-implemented method comprising:
determining, by a computing device, a viewport interface for accessing a content item, the content item being composed using a set of content streams that capture at least one scene from a plurality of different positions;
predicting, by the computing device, at least one change in a direction of the viewport interface while accessing the content item, wherein the predicted change in the direction corresponds to a second viewport interface for accessing at least one different content stream of the content item, the predicting further comprising:
determining, by the computing device, the change in the direction to correspond to the second viewport interface for accessing the at least one different content stream based at least in part on aggregated user data indicating playback times at which viewport interfaces of different users transitioned to the at least one different content stream while accessing the content item; and

buffering, by the computing device, the at least one different content stream corresponding to the second viewport interface prior to the viewport interface transitioning to the second viewport interface.

2. The computer-implemented method of claim 1 , wherein the viewport interface presents one or more content streams from the set of content streams, the one or more content streams being determined based at least in part on the direction of the viewport interface.

3. The computer-implemented method of claim 1 , wherein the at least one change in the direction is predicted based at least in part on aggregated user viewing patterns associated with the content item.

4. The computer-implemented method of claim 1 , wherein the at least one change in the direction is predicted based at least in part on aggregated user data that measures one or more changes to respective directions of user viewport interfaces while accessing the content item.

5. The computer-implemented method of claim 4 , wherein the aggregated user data indicates at least one playback time at which a viewport interface of a given user transitioned from a first direction to a second direction.

6. The computer-implemented method of claim 1 , wherein the prediction is based at least in part on a probability transition map that provides respective likelihoods of a direction of a viewport interface transitioning from a first direction to a second direction at a given playback time.

7. The computer-implemented method of claim 6 , wherein the probability transition map is implemented as a Markov model.

8. The computer-implemented method of claim 1 , wherein the computing device is a mobile device or virtual reality apparatus.

9. The computer-implemented method of claim 1 , wherein the plurality of content streams collectively capture a 360-degree view of the at least one scene.

10. A system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, cause the system to perform:
determining a viewport interface for accessing a content item, the content item being composed using a set of content streams that capture at least one scene from a plurality of different positions;
predicting at least one change in a direction of the viewport interface while accessing the content item, wherein the predicted change in the direction corresponds to a second viewport interface for accessing at least one different content stream of the content item, the predicting further comprising:
determining the change in the direction to correspond to the second viewport interface for accessing the at least one different content stream based at least in part on aggregated user data indicating playback times at which viewport interfaces of different users transitioned to the at least one different content stream while accessing the content item; and

buffering the at least one different content stream corresponding to the second viewport interface prior to the viewport interface transitioning to the second viewport interface.

11. The system of claim 10 , wherein the viewport interface presents one or more content streams from the set of content streams, the one or more content streams being determined based at least in part on the direction of the viewport interface.

12. The system of claim 10 , wherein the at least one change in the direction is predicted based at least in part on aggregated user viewing patterns associated with the content item.

13. The system of claim 10 , wherein the at least one change in the direction is predicted based at least in part on aggregated user data that measures one or more changes to respective directions of user viewport interfaces while accessing the content item.

14. The system of claim 13 , wherein the aggregated user data indicates at least one playback time at which a viewport interface of a given user transitioned from a first direction to a second direction.

15. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform:
determining a viewport interface for accessing a content item, the content item being composed using a set of content streams that capture at least one scene from a plurality of different positions;
predicting at least one change in a direction of the viewport interface while accessing the content item, wherein the predicted change in the direction corresponds to a second viewport interface for accessing at least one different content stream of the content item, the predicting further comprising:
determining the change in the direction to correspond to the second viewport interface for accessing the at least one different content stream based at least in part on aggregated user data indicating playback times at which viewport interfaces of different users transitioned to the at least one different content stream while accessing the content item; and

buffering the at least one different content stream corresponding to the second viewport interface prior to the viewport interface transitioning to the second viewport interface.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the viewport interface presents one or more content streams from the set of content streams, the one or more content streams being determined based at least in part on the direction of the viewport interface.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the at least one change in the direction is predicted based at least in part on aggregated user viewing patterns associated with the content item.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the at least one change in the direction is predicted based at least in part on aggregated user data that measures one or more changes to respective directions of user viewport interfaces while accessing the content item.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the aggregated user data indicates at least one playback time at which a viewport interface of a given user transitioned from a first direction to a second direction.

Assignees

• Facebook Inc

Inventors

• Pio David Young Joon
• Kuzyakov Evgeny V
• Chen Chien-Nan

Classifications

• G06T15/20 Primary

  Perspective computation · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• H04N21/6125

  involving transmission via Internet (transmission by internet of broadcast information H04H60/82) · CPC title

• G06T2200/04

  involving 3D image data · CPC title

• H04N21/816 Primary

  involving special video data, e.g 3D video · CPC title