Technology to assign asynchronous space warp frames and encoded frames to temporal scalability layers having different priorities

Patent metadata

Field	Value
Publication number	US-11218633-B2
Application number	US-202016808626-A
Country	US
Kind code	B2
Filing date	Mar 4, 2020
Priority date	Apr 10, 2017
Publication date	Jan 4, 2022
Grant date	Jan 4, 2022

Abstract

Systems, apparatuses and methods may determine, on a per camera basis, an interest level with respect to panoramic video content, identify a subset of cameras in a plurality of cameras for which the interest level is below a threshold, and reduce power consumption in the subset of cameras. Additionally, technology may determine a projection format associated with panoramic video content, identify one or more discontinuous boundaries in the projection format, and modify an encoding scheme associated with the panoramic video content based on the discontinuous boundaries. Moreover, an encoded frame may be assigned to a temporal scalability layer that has a higher priority than a layer to which an asynchronous space warp frame is assigned. Additionally, technology may reduce the encoding complexity of a boundary between an active region and an inactive region in fisheye content.

First claim

What is claimed is:

1. A system comprising:
a substrate; and
logic coupled to the substrate, wherein the logic is implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic to:
receive a rendered frame including a buffer region of the current view,
assign an encoded frame to a first temporal scalability layer, wherein the encoded frame is based on the current view,
generate an asynchronous space warp (ASW) frame based on the rendered frame and the buffer region, wherein the asynchronous space warp frame is generated to shift a rendered scene to match a shifted view of a user and is generated asynchronously with respect to the rendered frame of the current view, and
assign the asynchronous space warp frame to a second temporal scalability layer, wherein the first temporal scalability layer has a higher priority than the second temporal scalability layer.

2. The system of claim 1 , wherein the logic is to allocate more bits to the encoded frame than the asynchronous space warp frame.

3. The system of claim 1 , further including a network controller to transmit the encoded frame and the asynchronous space warp frame over a wireless link.

4. A method comprising:
receiving a rendered frame including a buffer region of the current view;
assigning an encoded frame to a first temporal scalability layer, wherein the encoded frame is based on the current view;
generating an asynchronous space warp (ASW) frame based on the rendered frame and the buffer region, wherein the asynchronous space warp frame is generated to shift a rendered scene to match a shifted view of a user and is generated asynchronously with respect to the rendered frame of the current view; and
assigning the asynchronous space warp frame to a second temporal scalability layer, wherein the first temporal scalability layer has a higher priority than the second temporal scalability layer.

5. The method of claim 4 , further comprising allocating more bits to the encoded frame than the asynchronous space warp frame.

6. The method of claim 4 , further comprising transmitting, via a network controller, the encoded frame and the asynchronous space warp frame over a wireless link.

7. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
receive a rendered frame including a buffer region of the current view;
assign an encoded frame to a first temporal scalability layer, wherein the encoded frame is based on the current view;
generate an asynchronous space warp (ASW) frame based on the rendered frame and the buffer region, wherein the asynchronous space warp frame is generated to shift a rendered scene to match a shifted view of a user and is generated asynchronously with respect to the rendered frame of the current view; and
assign the asynchronous space warp frame to a second temporal scalability layer, wherein the first temporal scalability layer has a higher priority than the second temporal scalability layer.

8. The non-transitory computer readable storage medium of claim 7 , further comprising cause the computing system to: allocate more bits to the encoded frame than the asynchronous space warp frame.

9. The non-transitory computer readable storage medium of claim 7 , further comprising cause the computing system to: transmit, via a network controller, the encoded frame and the asynchronous space warp frame over a wireless link.

Assignees

• Intel Corp

Inventors

• Boyce Jill M
• Baran Stanley J
• Mohan Sumit
• Chiu Yi-Jen
• Tanner Jason
• Mohammed Atthar H
• Hicks Richmond
• Das Barnan

Classifications

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/65

  Control of camera operation in relation to power supply · CPC title

• H04L65/613

  for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637) · CPC title