Lens flare detection circuit using raw image

Patent metadata

Field	Value
Publication number	US-12267601-B2
Application number	US-202318114602-A
Country	US
Kind code	B2
Filing date	Feb 27, 2023
Priority date	Feb 27, 2023
Publication date	Apr 1, 2025
Grant date	Apr 1, 2025

Abstract

Embodiments relate to identifying locations in an image where a green ghost is likely to occur by processing a raw version of the image. A block of pixels in the raw image is extracted and then each pixel value in the block is compared with a threshold value of a corresponding color channel. The compared results are then processed to generate bright light information for the block, indicating whether the green ghost is likely to be present at a location of the image diagonally opposed to the location of the block in the image relative to an optical center of an image sensor. By processing the raw image without subsequent processing prone to introducing artifacts and creating false positive, a likely location of the green orb or green ghost may be more accurately identified.

First claim

What is claimed is:

1. A circuit, comprising:
a threshold circuit configured to:
receive a block of pixels corresponding to a first location of an image in a raw image format, wherein the block of pixels comprises a plurality of mosaiced color channels, and
for each pixel of the block of pixels, compare a value of the pixel of the block of pixels with a threshold value corresponding to a mosaiced color channel of the plurality of mosaiced color channels to generate a comparison result; and

a logic circuit coupled to the threshold circuit, and configured to generate light information by processing the comparison result generated for each pixel of the block of pixels, the light information indicating whether an artifact is likely to be present at a second location of the image that is diagonally opposite to the first location relative to an optical center of an image sensor that captured the image.

2. The circuit of claim 1 , wherein the raw image format is a Bayer image format.

3. The circuit of claim 1 , wherein the comparison result has a first value or a second value, the first value indicating that the value of the pixel of the block of pixels exceeds the threshold value and the second value indicating that the value of the pixel of the block of pixels does not exceed the threshold value.

4. The circuit of claim 3 , wherein the light information has the first value or the second value, the first value of the light information indicating that the artifact is likely to be present at the second location, and the second value of the light information indicating that the artifact is unlikely to be present at the second location.

5. The circuit of claim 1 , further comprising a scaler circuit configured to downscale the image in the raw image format to generate the block of pixels.

6. The circuit of claim 1 , wherein the circuit is upstream of at least a correction circuit or a gain circuit, the correction circuit configured to perform lens shade correction on the image and the gain circuit configured to apply white balancing gain on the image.

7. The circuit of claim 1 , wherein a first value of a first pixel of the block of pixels is compared to a first threshold value corresponding to a first mosaiced color channel of the plurality of mosaiced color channels, and wherein a second value of a second pixel of the block of pixels is compared to a second threshold value corresponding to a second mosaiced color channel of the plurality of mosaiced color channels, wherein the first threshold value is different from the second threshold value.

8. A method, comprising:
receiving a block of pixels corresponding to a first location of an image in a raw image format, wherein the block of pixels comprises a plurality of mosaiced color channels;
for each pixel of the block of pixels, comparing a value of the pixel of the block of pixels with a threshold value corresponding to a mosaiced color channel of the plurality of mosaiced color channels to generate a comparison result; and
generating light information by processing the comparison result generated for each pixel of the block of pixels, the light information indicating whether an artifact is likely to be present at a second location of the image that is diagonally opposite to the first location relative to an optical center of an image sensor that captured the image.

9. The method of claim 8 , wherein the raw image format is a Bayer image format.

10. The method of claim 8 , wherein each of the comparison result has a first value or a second value, the first value indicating that the value of the pixel of the block of pixels exceeds the threshold value and the second value indicating that the value of the pixel of the block of pixels does not exceed the threshold value.

11. The method of claim 10 , wherein the light information has the first value or the second value, the first value of the light information indicating that the artifact is likely to be present at the second location, and the second value of the light information indicating that the artifact is unlikely to be present at the second location.

12. The method of claim 8 , further comprising downscaling the image in the raw image format to generate the block of pixels.

13. The method of claim 8 , further comprising at least one of performing lens shade correction or applying white balancing gain on the image after generating the light information.

14. The method of claim 8 , wherein a first value of a first pixel of the block of pixels is compared to a first threshold value corresponding to a first mosaiced color channel of the plurality of mosaiced color channels, and wherein a second value of a second pixel of the block of pixels is compared to a second threshold value corresponding to a second mosaiced color channel of the plurality of mosaiced color channels, wherein the first threshold value is different from the second threshold value.

15. An electronic device, comprising:
an image sensor; and
an image signal processor coupled to the image sensor and configured to receive a raw image from the image sensor, the image signal processor comprising:
a comparison circuit, comprising:
a threshold circuit configured to:
receive a block of pixels corresponding to a first location of an image in a raw image format, wherein the block of pixels comprises a plurality of mosaiced color channels, and
for each pixel of the block of pixels, compare a value of the pixel of the block of pixels with a threshold value corresponding to a mosaiced color channel of the plurality of mosaiced color channels to generate a comparison result; and

a logic circuit coupled to the comparison circuit and configured to generate light information by processing the comparison result generated for each pixel of the block of pixels, the light information indicating whether an artifact is likely to be present at a second location of the image that is diagonally opposite to the first location relative to an optical center of the image sensor.

16. The electronic device of claim 15 , wherein the comparison result has a first value or a second value, the first value indicating that the value of the pixel of the block of pixels exceeds the threshold value and the second value indicating that the value of the pixel of the block of pixels does not exceed the threshold value.

17. The electronic device of claim 16 , wherein the light information has the first value or the second value, the first value of the light information indicating that the artifact is likely to be present at the second location, and the second value of the light information indicating that the artifact is unlikely to be present at the second location.

18. The electronic device of claim 15 , wherein the image signal processor further comprises a correction circuit configured to perform lens shade correction on the image and a gain circuit configured to apply white balancing gain on the image, the correction circuit and the gain circuit located downstream relative to the comparison circuit in the image signal processor.

19. The electronic device of claim 15 , further comprising a central processor unit configured to execute software for removing the artifact from the image based on the light information.

20. The electronic device of claim 15 , wherein a first value of a first pixel of the block of pixels is compared to a first threshold value corresponding to a first mosaiced color channel of the plurality of mosaiced color channels, and wherein a second value of a second pixel of

Assignees

• Apple Inc

Inventors

• Wang Muge

Classifications

• H04N25/61

  the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4" · CPC title

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/76 Primary

  by influencing the image signals · CPC title

• H04N25/703

  SSIS architectures incorporating pixels for producing signals other than image signals · CPC title

• G06T7/0002

  Inspection of images, e.g. flaw detection · CPC title