Method and apparatus for reducing color fringing in composite images

Patent metadata

Field	Value
Publication number	US-9554107-B2
Application number	US-201414378579-A
Country	US
Kind code	B2
Filing date	Feb 7, 2014
Priority date	Feb 7, 2014
Publication date	Jan 24, 2017
Grant date	Jan 24, 2017

Abstract

A method and apparatus for recording a composite image from a lens array are disclosed. A first composite image is recorded using a first lens providing imaging data in a first color, a second lens providing imaging data in a second color, and a third lens providing imaging data in a third color, wherein the first, second, and third colors are different colors. A second composite image is recorded using the first lens, a fourth lens providing imaging data in the second color, and a fifth lens providing imaging data in the third color. The first and second composite images are compared to identify color fringed areas. Based on the relative size and location of the color fringed areas in the first and second composite images, a de-fringing algorithm is applied to at least one of the composite images to mitigate the color fringing in the color fringed areas.

First claim

What is claimed is:

1. A method of recording a composite image using a lens array comprising a plurality of monochromatic lenses, each of which provides imaging data in shades of a single color, the method comprising:
recording a first composite image using a first lens that provides imaging data in a first color, a second lens that provides imaging data in a second color, and a third lens that provides imaging data in a third color, wherein the first, second, and third colors are different colors;
recording a second composite image using the first lens, a fourth lens that provides imaging data in the second color, and a fifth lens that provides imaging data in the third color;
identifying color fringed areas in the first and second composite images; and
based on the relative size and location of the color fringed areas in the first and second composite images, applying a de-fringing algorithm to at least one of the composite images to mitigate the color fringing in the color fringed areas;
wherein the second and fourth lens are situated on opposite sides of the first lens; and
wherein the third and fifth lens are also situated on opposite sides of the first lens.

2. The method of claim 1 , wherein applying a de-fringing algorithm to at least one of the composite images to mitigate the color fringing in the color fringed areas comprises:
overlaying at least the color fringed portions of the first and second composite images;
for areas that are color fringed in the first composite image but are not color fringed in the second composite image, replacing imaging data for those areas of the first composite image with imaging data from those areas of the second composite image to form a modified first composite image; and
for areas that are color fringed in the second composite image but are not color fringed in the first composite image, replacing imaging data for those areas of the second composite image with imaging data from those areas of the first composite image to form a modified second composite image.

3. The method of claim 2 :
wherein recording the first composite image comprises:
recording imaging data from the first, second, and third lenses;
aligning the imaging data from the first, second, and third lenses according to a first alignment; and
recording the first composite image based on the first alignment; and

wherein recording the second composite image comprises:
recording imaging data from the first, fourth, and fifth lenses;
aligning the imaging data from the first, fourth, and fifth lenses according to a second alignment; and
recording the second composite image based on the second alignment.

4. The method of claim 3 , further comprising:
based on a width of color fringed areas from the first alignment, re-aligning the imaging data from the first, second, and third lenses according to a third alignment that is different from the first and second alignments;
recording a third composite image based on the third alignment;
based on a width of color fringed areas from the second alignment, re-aligning the imaging data from the first, fourth, and fifth lenses according to a fourth alignment that is different from the first, second, and third alignments;
recording a fourth composite image based on the fourth alignment;
for areas that are color fringed in the modified first composite image but are not color fringed in the third composite image, replacing imaging data for those areas of the modified first composite image with imaging data from those areas of the third composite image; and
for areas that are color fringed in the modified first composite image but are not color fringed in the fourth composite image, replacing imaging data for those areas of the modified first composite image with imaging data from those areas of the fourth composite image.

5. The method of claim 1 , wherein the lens array is an N×N lens array comprising:
a first type of row in which the first and second lenses are interleaved; and
a second type of row in which the first and third lenses are interleaved;
wherein the first and second types of rows are interleaved in the N×N array; and
wherein the first lenses in rows of the first type are offset from first lenses in adjacent rows of the second type.

6. The method of claim 1 , wherein the first lens is adjacent to each of the second lens, the third lens, the fourth lens, and the fifth lens.

7. A camera comprising:
a lens array comprising a plurality of monochromatic lenses, each of which is configured to provide imaging data in shades of a single color; and
a processor circuit configured to:
record a first composite image using a first lens that provides imaging data in a first color, a second lens that provides imaging data in a second color, and a third lens that records imaging data in a third color, wherein the first, second, and third colors are different colors;
record a second composite image using the first lens, a fourth lens that provides imaging data in the second color, and a fifth lens that provides imaging data in the third color;
identify color fringed areas in the first and second composite images; and
based on the relative size and location of the identified color fringed areas in the first and second composite images, apply a de-fringing algorithm to at least one of the composite images to mitigate the color fringing in the color fringed areas;

wherein the second and fourth lenses are situated on opposite sides of the first lens; and
wherein the third and fifth lenses are also situated on opposite sides of the first lens.

8. The camera of claim 7 , wherein to apply a de-fringing algorithm to at least one of the composite images to mitigate the color fringing in the color fringed areas, the processor circuit is configured to:
overlay at least the color fringed portions of the first and second composite images;
for areas that are color fringed in the first composite image but are not color fringed in the second composite image, replace the imaging data for those areas of the first composite image with the imaging data from those areas of the second composite image to form a modified first composite image; and
for areas that are color fringed in the second composite image but are not color fringed in the first composite image, replace the imaging data for those areas of the second composite image with the imaging data from those areas of the first composite image to form a modified second composite image.

9. The camera of claim 8 :
wherein to record the first composite image, the processor circuit is configured to:
record imaging data from the first, second, and third lenses;
align the imaging data from the first, second, and third lenses according to a first alignment; and
record the first composite image based on the first alignment; and

wherein to record the second composite image, the processor circuit is configured to:
record imaging data from the first, fourth, and fifth lenses;
align the imaging data from the first, fourth, and fifth lenses according to a second alignment; and
record the second composite image based on the second alignment.

10. The camera of claim 9 , wherein the processor circuit is further configured to:
based on a width of color fringed areas from the first alignment, re-align the imaging data from the first, second, and third lenses according to a third alignment that is different from the first and second alignments;
record a third composite image based on the third alignment;
based on a width of color fringed areas from the second alignment, re-align the imaging data from the first, fourth, and fifth lenses according to a fourth alignment that is different from t

Assignees

• Sony Corp

Inventors

• Elg Johannes
• Linåker Daniel
• Gustavsson Jonas
• Wernersson Mats
• Johansson Allan

Classifications

• H04N23/84

  for processing colour signals · CPC title

• H04N25/134

  based on three different wavelength filter elements · CPC title

• H04N23/10

  for generating image signals from different wavelengths · CPC title

• G02B27/005

  for correction of secondary colour or higher-order chromatic aberrations · CPC title

• H04N9/646 Primary

  for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters · CPC title