Advanced raw conversion to produce high dynamic range, wide color gamut output

Patent metadata

Field	Value
Publication number	US-10148871-B2
Application number	US-201615372089-A
Country	US
Kind code	B2
Filing date	Dec 7, 2016
Priority date	Dec 7, 2016
Publication date	Dec 4, 2018
Grant date	Dec 4, 2018

Abstract

Described are examples for generating high dynamic range (HDR)/wide color gamut (WCG) output from an image sensor. A raw red, green, blue (RGB) image obtained by the image sensor can be received. A plurality of color transform operations can be applied to the raw RGB image to generate a HDR/WCG image. The HDR/WCG image can be stored in a memory, displayed on a display, transmitted to another device, etc.

First claim

What is claimed is:

1. A method for generating high dynamic range (HDR)/wide color gamut (WCG) output from an image sensor, comprising:
receiving a raw red, green, blue (RGB) image obtained by the image sensor;
applying, by a processor, a plurality of color transform operations to the raw RGB image to generate a HDR/WCG image, wherein applying the plurality of color transform operations comprises:
applying a wide-gamut RGB color space transform operation to the raw RGB image to produce a wide-gamut RGB image;
applying a BT.2020 transform operation to hop the wide-gamut RGB image to a second wide-gamut RGB image; and
converting the second wide-gamut RGB image to the HDR/WCG image in a YCbCr color space using a linear conversion matrix; and

storing, by the processor, the HDR/WCG image in a memory.

2. The method of claim 1 , further comprising at least one of scaling the wide-gamut RGB image before applying the second color space transform operation, or scaling the second wide-gamut RGB image before converting to the HDR/WCG image.

3. The method of claim 1 , wherein the wide-gamut RGB color space transform operation is a ProPhoto RGB transform operation.

4. The method of claim 1 , wherein the wide-gamut RGB color space transform operation outputs a 10-bit image, the second color space transform operation outputs a 10-bit image, and the HDR/WCG image is a 10-bit image.

5. The method of claim 1 , wherein the wide-gamut RGB color space transform operation outputs a 12-bit image, the second color space transform operation outputs a 12-bit image, and the HDR/WCG image is a 12-bit image.

6. The method of claim 1 , further comprising applying a gamma correction operation to the HDR/WCG image after applying one or more of a sharpening operation, a color noise (or other types of noise) reduction operation, or a scaling operation to the HDR/WCG image.

7. The method of claim 1 , wherein receiving the raw RGB image comprises receiving a digital negative (DNG) container including the raw RGB image.

8. The method of claim 1 , further comprising at least one of displaying, on a display, or transmitting, to another device, the HDR/WCG image from the memory.

9. A device for generating high dynamic range (HDR) and wide color gamut (WCG) output, comprising:
an image sensor configured to capture one or more raw red, green, blue (RGB) images;
a memory for storing one or more parameters or instructions for converting the one or more raw RGB images to HDR/WCG images; and
at least one processor coupled to the memory, wherein the at least one processor is configured to:
receive a raw RGB image obtained by the image sensor;
apply a plurality of color transform operations to the raw RGB image to generate a HDR/WCG image, wherein applying the plurality of color transform operations comprises:
applying a wide-gamut RGB color space transform operation to the raw RGB image to produce a wide-gamut RGB image;
applying a BT.2020 transform operation to hop the wide-gamut RGB image to a second wide-gamut RGB image; and
converting the second wide-gamut RGB image to the HDR/WCG image in a YCbCr color space using a linear conversion matrix; and

store the HDR/WCG image in the memory.

10. The device of claim 9 , wherein the at least one processor is further configured to at least one of scale the wide-gamut RGB image before applying the second color space transform operation, or scale the second wide-gamut RGB image before converting to the HDR/WCG image.

11. The device of claim 9 , wherein the wide-gamut RGB color space transform operation is a ProPhoto RGB transform operation.

12. The device of claim 9 , wherein the wide-gamut RGB color space transform operation outputs a 10-bit image, the second color space transform operation outputs a 10-bit image, and the HDR/WCG image is a 10-bit image.

13. The device of claim 9 , wherein the wide-gamut RGB color space transform operation outputs a 12-bit image, the second color space transform operation outputs a 12-bit image, and the HDR/WCG image is a 12-bit image.

14. The device of claim 9 , wherein the at least one processor is further configured to apply a gamma correction operation to the HDR/WCG image after applying one or more of a sharpening operation, a color noise (or other types of noise) reduction operation, or a scaling operation to the HDR/WCG image.

15. The device of claim 9 , wherein the at least one processor is configured to receive the raw RGB image as a digital negative (DNG) container including the raw RGB image.

16. The device of claim 9 , further comprising at least one of a display for displaying the HDR/WCG image from the memory, or a transceiver for transmitting, to another device, the HDR/WCG image from the memory.

17. A non-transitory computer-readable medium, comprising code executable by one or more processors for generating high dynamic range (HDR)/wide color gamut (WCG) output from an image sensor, the code comprising code for:
receiving a raw red, green, blue (RGB) image obtained by the image sensor;
applying a plurality of color transform operations to the raw RGB image to generate a HDR/WCG image, wherein applying the plurality of color transform operations comprises:
applying a wide-gamut RGB color space transform operation to the raw RGB image to produce a wide-gamut RGB image;
applying a BT.2020 transform operation to hop the wide-gamut RGB image to a second wide-gamut RGB image; and
converting the second wide-gamut RGB image to the HDR/WCG image in a YCbCr color space using a linear conversion matrix; and

storing the HDR/WCG image in a memory.

18. The non-transitory computer-readable medium of claim 17 , further comprising code for at least one of scaling the wide-gamut RGB image before applying the second color space transform operation, or scaling the second wide-gamut RGB image before converting to the HDR/WCG image.

19. The non-transitory computer-readable medium of claim 17 , wherein the wide-gamut RGB color space transform operation is a ProPhoto RGB transform operation.

20. The non-transitory computer-readable medium of claim 17 , wherein the wide-gamut RGB color space transform operation outputs a 10-bit image, the second color space transform operation outputs a 10-bit image, and the HDR/WCG image is a 10-bit image.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Thumpudi Naveen
• Kanumuri Sandeep
• Hakanen Jesse
• Wozniak Matthew R

Classifications

• H04N1/6008 Primary

  with primary colour signals, e.g. RGB or CMY(K) · CPC title

• H04N23/81

  for suppressing or minimising disturbance in the image signal generation · CPC title

• H04N1/648 Primary

  Transmitting or storing the primary (additive or subtractive) colour signals; Compression thereof (H04N1/642 - H04N1/646 take precedence) · CPC title

• H04N23/741

  by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors · CPC title

• H04N23/841

  to modify gamut · CPC title