Method and system for processing an image

Patent metadata

Field	Value
Publication number	US-11257229-B2
Application number	US-201916701257-A
Country	US
Kind code	B2
Filing date	Dec 3, 2019
Priority date	Jun 10, 2014
Publication date	Feb 22, 2022
Grant date	Feb 22, 2022

Abstract

A method of processing an image is disclosed. The method comprises decomposing the image into a plurality of channels, each being characterized by a different depth-of-field, and accessing a computer readable medium storing an in-focus dictionary defined over a plurality of dictionary atoms, and an out-of-focus dictionary defined over a plurality of sets of dictionary atoms, each set corresponding to a different out-of-focus condition. The method also comprises computing one or more sparse representations of the decomposed image over the dictionaries.

First claim

What is claimed is:

1. A method of processing an image, comprising:
decomposing the image into a plurality of channels, each being characterized by a different depth-of-field;
accessing a computer readable medium storing an in-focus dictionary defined over a plurality of dictionary atoms, and an out-of-focus dictionary defined over a plurality of sets of dictionary atoms, each set corresponding to a different out-of-focus condition;
computing a representation of said decomposed image over said out-of-focus dictionary; and
using said computed representation and atoms of said in-focus dictionary for sharpening the image.

2. The method of claim 1 , wherein said decomposing is done optically at the time of image capture.

3. The method of claim 1 , wherein said decomposing is done by digital image processing.

4. The method according to claim 1 , wherein said representation is computed such that different region of said image have different defocus conditions.

5. The method according to claim 4 , further comprising constructing a depth map of the scene, based on said representation.

6. The method according to claim 5 , wherein said depth map is constructed based on a single image frame.

7. The method according to claim 1 , wherein said plurality of channels is a plurality of color channels.

8. The method according to claim 1 , comprising dividing said image into a plurality of patches, wherein said expressing is executed for each patch separately.

9. The method according to claim 1 , wherein each atom of at least a portion of said atoms of said in-focus dictionary is characterized by a spatial frequency which is at most a floor value of half a length of said atom.

10. A method of imaging, comprising:
capturing an image of a scene using an imaging device having an optical mask selected to optically decompose said image into a plurality of channels, each being characterized by a different depth-dependence of a spatial frequency response of said imaging device;
accessing a computer readable medium storing an in-focus dictionary defined over a plurality of dictionary atoms, and an out-of-focus dictionary defined over a plurality of sets of dictionary atoms, each set corresponding to a different out-of-focus condition;
computing a representation of said decomposed image over said out-of-focus dictionary; and
using said computed representation and atoms of said in-focus dictionary for sharpening the image.

11. The method according to claim 10 , further comprising constructing a depth map of the scene, based on said representation.

12. The method according to claim 11 , further comprising generating a three-dimensional image based on said depth map.

13. The method according to claim 11 , wherein said depth map is constructed based on a single image frame.

14. The method according to claim 10 , wherein each atom of at least a portion of said atoms of said in-focus dictionary is characterized by a spatial frequency which is at most a floor value of half a length of said atom.

15. An imaging system, comprise:
an imaging device having an optical mask and being configured for capturing an image of a scene, wherein said optical mask is selected to optically decompose said image into a plurality of channels, each being characterized by a different depth-dependence of a spatial frequency response of said imaging device;
a computer readable medium storing an in-focus dictionary defined over a plurality of dictionary atoms, and an out-of-focus dictionary defined over a plurality of sets of dictionary atoms, each set corresponding to a different out-of-focus condition; and
a data processor configured for accessing said computer readable medium, for computing a representation of said decomposed image over said out-of-focus dictionary, and for using said computed representation and atoms of said in-focus dictionary for sharpening the image.

16. A portable device, comprising the imaging system of claim 15 .

17. The portable device of claim 16 , being selected from the group consisting of a cellular phone, a smartphone, a tablet device, a mobile digital camera, a wearable camera, a personal computer, a laptop, a portable media player, a portable gaming device, a portable digital assistant device, and a portable navigation device.

18. The imaging system according to claim 15 , wherein said data processor is configured for constructing a depth map of the scene, based on said representation.

19. The imaging system according to claim 18 , wherein said data processor is configured for generating a three-dimensional image based on said depth map.

20. The imaging system according to claim 18 , wherein said depth map is constructed based on a single image frame.

Assignees

• Univ Ramot

Inventors

• Haim Harel
• Marom Emanuel
• Bronstein Alexander

Classifications

• G06T2207/10024

  Color image · CPC title

• G06T2200/21

  involving computational photography · CPC title

• G06T7/571

  from focus · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T7/50 Primary

  Depth or shape recovery · CPC title