Color balancing based on reference points

Patent metadata

Field	Value
Publication number	US-10171785-B2
Application number	US-201615345240-A
Country	US
Kind code	B2
Filing date	Nov 7, 2016
Priority date	Apr 29, 2013
Publication date	Jan 1, 2019
Grant date	Jan 1, 2019

Abstract

Embodiments provide techniques for adjusting coloration of an image. A first selection of first one or more reference points within a first image is received. A second selection of a second one or more reference points within a second image is also received. Embodiments determine a coloration difference between a coloration of the first one or more reference points within the first image and a coloration of the second one or more reference points within the second image. The coloration of at least a portion of the first image is then adjusted, based on the determined coloration difference.

First claim

What is claimed is:

1. A computer-implemented method of adjusting coloration, the computer-implemented comprising:
receiving a selection of one or more source reference points within a source image depicting a source lighting condition;
receiving a selection of one or more target reference points within a target image depicting a target lighting condition distinct from the source lighting condition;
determining a coloration difference between a coloration of the one or more source reference points within the source image and a coloration of the one or more target reference points within the target image; and
normalizing the distinct, depicted source and target lighting conditions by adjusting, by operation of one or more computer processors, the coloration of at least a portion of the source image based on the determined coloration difference and to correspond more closely to the coloration of the target image, whereafter the source image is output.

2. The computer-implemented method of claim 1 , wherein the source image comprises one of a plurality of frames of a first video stream.

3. The computer-implemented method of claim 2 , wherein the target image comprises one of a plurality of frames of a second video stream, distinct from the first video stream.

4. The computer-implemented method of claim 1 , wherein the selection of the one or more source reference points specifies a plurality of source reference points within the source image, inclusive of the one or more source reference points, wherein the selection of the one or more target reference points specifies a plurality of target reference points within the target image, inclusive of the one or more target reference points, wherein each of the plurality of source reference points corresponds to a respective one of the plurality of target reference points.

5. The computer-implemented method of claim 4 , wherein determining the coloration difference further comprises:
for each of the plurality of source reference points within the source image, determining a coloration difference between the source reference point and a corresponding target reference point from the plurality of target reference points.

6. The computer-implemented method of claim 1 , further comprising:
providing an interface depicting the source and target images in order to facilitate the selections, wherein the source image comprises one of a plurality of frames of a first video stream, wherein the target image comprises one of a plurality of frames of a second video stream, distinct from the first video stream.

7. The computer-implemented method of claim 6 , wherein the selection of the one or more source reference points specifies a plurality of source reference points within the source image, inclusive of the one or more source reference points, wherein the selection of the one or more target reference points specifies a plurality of target reference points within the target image, inclusive of the one or more target reference points, wherein each of the plurality of source reference points corresponds to a respective one of the plurality of target reference points, wherein determining the coloration difference comprises:
for each of the plurality of source reference points within the source image, determining a coloration difference between the source reference point and a corresponding target reference point from the plurality of target reference points.

8. The computer-implemented method of claim 7 , wherein the coloration of the portion of the source image is adjusted based further on profile information corresponding to the one or more source reference points or the one or more target reference points, wherein the profile information describes coloration under predefined conditions.

9. The computer-implemented method of claim 8 , wherein the profile information is retrieved from a non-transitory memory device, wherein the one or more source reference points and the one or more target reference points are of a visual scene depicted in the source and target images, wherein the portion of the source image corresponds to an object depicted in the source and target images.

10. The computer-implemented method of claim 9 , wherein determining the coloration difference further comprises:
determining an aggregate coloration difference for the visual scene, based on a plurality of coloration differences, the plurality of coloration differences including, for each of the plurality of source reference points within the source image, the coloration difference determined for the respective source reference point.

11. A non-transitory computer-readable medium containing computer program code executable to perform an operation for adjusting coloration, the operation comprising:
receiving a selection of one or more source reference points within a source image depicting a source lighting condition;
receiving a selection of one or more target reference points within a target image depicting a target lighting condition distinct from the source lighting condition;
determining a coloration difference between a coloration of the one or more source reference points within the source image and a coloration of the one or more target reference points within the target image; and
normalizing the distinct, depicted source and target lighting conditions by adjusting, by operation of one or more computer processors when executing the computer program code, the coloration of at least a portion of the source image based on the determined coloration difference and to correspond more closely to the coloration of the target image, whereafter the source image is output.

12. The non-transitory computer-readable medium of claim 11 , wherein the source image comprises one of a plurality of frames of a first video stream.

13. The non-transitory computer-readable medium of claim 12 , wherein the target image comprises one of a plurality of frames of a second video stream, distinct from the first video stream.

14. The non-transitory computer-readable medium of claim 11 , wherein the selection of the one or more source reference points specifies a plurality of source reference points within the source image, inclusive of the one or more source reference points, wherein the selection of the one or more target reference points specifies a plurality of target reference points within the target image, inclusive of the one or more target reference points, wherein each of the plurality of source reference points corresponds to a respective one of the plurality of target reference points.

15. The non-transitory computer-readable medium of claim 14 , wherein determining the coloration difference further comprises:
for each of the plurality of source reference points within the source image, determining a coloration difference between the source reference point and a corresponding target reference point from the plurality of target reference points.

16. A system of adjusting coloration, the system comprising:
one or more computer processors; and
a memory containing computer program code that, when executed by the one or more computer processors, performs an operation comprising:
receiving a selection of one or more source reference points within a source image depicting a source lighting condition;
receiving a selection of one or more target reference points within a target image depicting a target lighting condition distinct from the source lighting condition;
determining a coloration difference between a coloration of the one or more source reference points within the source image and a coloration of the

Assignees

• Disney Entpr Inc

Inventors

• Sorkine Hornung Alexander
• Oskam Thomas
• Sumner Robert Walker

Classifications

• H04N1/6077 Primary

  Colour balance, e.g. colour cast correction · CPC title

• H04N9/73 Primary

  Colour balance circuits, e.g. white balance circuits or colour temperature control (camera processing pipelines for colour balance H04N23/88) · CPC title

• H04N1/603

  controlled by characteristics of the picture signal generator or the picture reproducer · CPC title

• H04N23/88

  for colour balance, e.g. white-balance circuits or colour temperature control · CPC title