Method and apparatus for creating, streaming, and rendering HDR images

Patent metadata

Field	Value
Publication number	US-10192297-B2
Application number	US-201615255125-A
Country	US
Kind code	B2
Filing date	Sep 1, 2016
Priority date	Feb 12, 2016
Publication date	Jan 29, 2019
Grant date	Jan 29, 2019

Abstract

A user equipment includes a modem receives a compressed bitstream and metadata. The UE also includes a decoder that decodes the compressed bitstream to generate an HDR image, an inertial measurement unit that determines viewpoint information based on an orientation of the UE, and a graphics processing unit (GPU). The GPU maps the HDR image onto a surface and renders a portion of the HDR image based on the metadata and the viewpoint information. A display displays the portion of the HDR image.

First claim

What is claimed is:

1. A user equipment (UE) for rendering a high dynamic range (HDR) image comprising:
a modem configured to receive a compressed bitstream and metadata, wherein the compressed bitstream includes a first standard dynamic range (SDR) image and a second SDR image and wherein the metadata includes a plurality of blend factors corresponding to view directions;
a decoder configured to decode the compressed bitstream to generate the first SDR image and the second SDR image;
an inertial measurement unit configured to determine viewpoint information based on an orientation of the UE;
a graphics processing unit (GPU) configured to:
combine the first SDR image and the second SDR image to generate a view dependent HDR image based on the blend factors and the viewpoint information;
map the HDR image onto a surface; and
render a portion of the mapped HDR image based on the metadata and the viewpoint information; and

a display configured to display the portion of the mapped HDR image.

2. The UE of claim 1 , wherein the plurality of blend factors further correspond to weights applied to the first SDR image and the second SDR image.

3. The UE of claim 1 , wherein the first SDR image is a low exposure image and the second SDR image is a high exposure image.

4. The UE of claim 1 , wherein the first SDR image and the second SDR image included in the compressed bitstream are included in a frame packed image.

5. A method for rendering a high dynamic range (HDR) image in a user equipment (UE), the method comprising:
receiving a compressed bitstream and metadata, wherein the compressed bitstream includes a first standard dynamic range (SDR) image and a second SDR image and wherein the metadata includes a plurality of blend factors corresponding to view directions;
decoding the compressed bitstream to generate the first SDR image and the second SDR image;
determining viewpoint information based on an orientation of the UE;
combining the first SDR image and the second SDR image to generate a view dependent HDR image based on the blend factors and the viewpoint information;
mapping the HDR image onto a surface;
rendering a portion of the mapped HDR image based on the metadata and the viewpoint information; and
displaying the portion of the mapped HDR image.

6. The method of claim 5 , wherein the surface is at least one of a spherical surface or a cylindrical surface.

7. The method of claim 5 , wherein the first SDR image and the second SDR image included in the compressed bitstream are included in a frame packed image.

8. The method of claim 5 , wherein the first SDR image is a low exposure image and the second SDR image is a high exposure image.

9. The method of claim 5 , wherein the plurality of blend factors further correspond to weights applied to the first SDR image and the second SDR image.

10. The method of claim 5 , wherein the viewpoint information includes pitch and yaw information.

11. The method of claim 7 , wherein the frame packed image is packed in a top-bottom method or a left-right method.

12. The method of claim 11 , further comprising unpacking the first SDR image and the second SDR image from the frame packed image.

13. The UE of claim 1 , wherein the surface is at least one of a spherical surface or a cylindrical surface.

14. The UE of claim 1 , wherein the viewpoint information includes pitch and yaw information.

15. The UE of claim 4 , wherein the frame packed image is packed in a top-bottom method or a left-right method.

16. The UE of claim 15 , wherein the GPU is further configured to unpack the first SDR image and the second SDR image from the frame packed image.

Assignees

• Samsung Electronics Co Ltd
• Samsung Electronics Co Ltd

Inventors

• Budagavi Madhukar
• Najaf-Zadeh Hossein
• Faramarzi Esmaeil
• Saxena Ankur

Classifications

• H04N19/85

  using pre-processing or post-processing specially adapted for video compression · CPC title

• G06T5/50 Primary

  using two or more images, e.g. averaging or subtraction · CPC title

• H04N19/597

  specially adapted for multi-view video sequence encoding · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• H04N21/2356

  by altering the spatial resolution · CPC title