Method and apparatus to reduce spherical video bandwidth to user headset

Patent metadata

Field	Value
Publication number	US-2016353146-A1
Application number	US-201615167206-A
Country	US
Kind code	A1
Filing date	May 27, 2016
Priority date	May 27, 2015
Publication date	Dec 1, 2016
Grant date	—

Abstract

A method includes determining at least one preferred view perspective associated with a three dimensional (3D) video, encoding a first portion of the 3D video corresponding to the at least one preferred view perspective at a first quality, and encoding a second portion of the 3D video at a second quality, the first quality being a higher quality as compared to the second quality.

First claim

What is claimed is:

1 . A method comprising:
determining at least one preferred view perspective associated with a three dimensional (3D) video; encoding a first portion of the 3D video corresponding to the at least one preferred view perspective at a first quality; and encoding a second portion of the 3D video at a second quality, the first quality being a higher quality as compared to the second quality.

2 . The method of claim 1 , further comprising:
storing the first portion of the 3D video in a datastore; storing the second portion of the 3D video in the datastore; receiving a request for a streaming video; and streaming the first portion of the 3D video and the second portion of the 3D video from the datastore as the streaming video.

3 . The method of claim 1 , further comprising:
receiving a request for a streaming video, the request including an indication of a user view perspective; selecting 3D video corresponding to the user view perspective as the encoded first portion of the 3D video; and streaming the selected first portion of the 3D video and the second portion of the 3D video as the streaming video.

4 . The method of claim 1 , further comprising:
receiving a request for a streaming video, the request including an indication of a user view perspective associated with the 3D video; determining whether the user view perspective is stored in a view perspective datastore; upon determining the user view perspective is stored in the view perspective datastore, increment a counter associated with the user view perspective; and upon determining the user view perspective is not stored in the view perspective datastore, add the user view perspective to the view perspective datastore and set the counter associated with the user view perspective to one (1).

5 . The method of claim 1 , wherein
encoding the second portion of the 3D video includes using at least one first Quality of Service QoS parameter in a first pass encoding operation, and encoding the first portion of the 3D video includes using at least one second Quality of Service QoS parameter in a second pass encoding operation.

6 . The method of claim 1 , wherein the determining of the at least one preferred view perspective associated with the 3D video is based on at least one of a historically viewed point of reference and a historically viewed view perspective.

7 . The method of claim 1 , wherein the at least one preferred view perspective associated with the 3D video is based on at least one of an orientation of a viewer of the 3D video, a position of a viewer of the 3D video, point of a viewer of the 3D video and focal point of a viewer of the 3D video.

8 . The method of claim 1 , wherein
the determining of the at least one preferred view perspective associated with the 3D video is based on a default view perspective, and the default view perspective based on at least one of:
a characteristic of a user of a display device,
a characteristic of a group associated with the user of the display device,
a directors cut, and
a characteristic of the 3D video.

9 . The method of claim 1 , further comprising:
iteratively encoding at least one portion of the second portion of the 3D video at the first quality; and streaming the least one portion of the second portion of the 3D video.

10 . A streaming server comprising:
a controller configured to determine at least one preferred view perspective associated with a three dimensional (3D) video; and an encoder configured to:
encode a first portion of the 3D video corresponding to the at least one preferred view perspective at a first quality, and
encode a second portion of the 3D video at a second quality, the first quality being a higher quality as compared to the second quality.

11 . The streaming server of claim 10 , wherein the controller is further configured to cause the:
storing of the first portion of the 3D video in a datastore, storing of the second portion of the 3D video in the datastore, receiving of a request for a streaming video, and streaming of the first portion of the 3D video and the second portion of the 3D video from the datastore as the streaming video.

12 . The streaming server of claim 10 , wherein the controller is further configured to cause the:
receiving of a request for a streaming video, the request including an indication of a user view perspective, selecting of 3D video corresponding to the user view perspective as the encoded first portion of 3D video, and streaming of the selected first portion of the 3D video and the second portion of the 3D video as the streaming video.

13 . The streaming server of claim 10 , wherein the controller is further configured to cause the:
receiving of a request for a streaming video, the request including an indication of a user view perspective associated with the 3D video, determining of whether the user view perspective is stored in a view perspective datastore, upon determining the user view perspective is stored in the view perspective datastore, increment a counter associated with the user view perspective, and upon determining the user view perspective is not stored in the view perspective datastore, add the user view perspective to the view perspective datastore and set the counter associated with the user view perspective to one (1).

14 . The streaming server of claim 10 , wherein
encoding the second portion of the 3D video includes using at least one first Quality of Service QoS parameter in a first pass encoding operation, and encoding the first portion of the 3D video includes using at least one second Quality of Service QoS parameter in a second pass encoding operation.

15 . The streaming server of claim 10 , wherein the determining of the at least one preferred view perspective associated with the 3D video is based on at least one of a historically viewed point of reference and a historically viewed view perspective.

16 . The streaming server of claim 10 , wherein the at least one preferred view perspective associated with the 3D video is based on at least one of an orientation of a viewer of the 3D video, a position of a viewer of the 3D video, point of a viewer of the 3D video and focal point of a viewer of the 3D video.

17 . The streaming server of claim 10 , wherein
the determining of the at least one preferred view perspective associated with the 3D video is based on a default view perspective, and the default view perspective based on at least one of:
a characteristic of a user of a display device,
a characteristic of a group associated with the user of the display device,
a directors cut, and
a characteristic of the 3D video.

18 . The streaming server of claim 10 , wherein the controller is further configured to cause the:
iteratively encoding of at least one portion of the second portion of the 3D video at the first quality, and streaming of the least one portion of the second portion of the 3D video.

19 . A method comprising:
receiving a request for a streaming video, the request including an indication of a user view perspective associated with a three dimensional (3D) video; determining whether the user view perspective is stored in a view perspective datastore; upon determining the user view perspective is stored in the view perspective datastore, increment a ranking value associated with the user view perspective; and upon determining the user view perspective is not stored in the view perspective datastore, add the u

Assignees

• Google Inc

Inventors

• Weaver Joshua
• GEFEN Noam
• Bengali Husain
• Adams Riley

Classifications

• H04N13/189

  Recording image signals; Reproducing recorded image signals · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/161

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N13/117

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title