Device and method for processing spectrum data of image sensor

Patent metadata

Field	Value
Publication number	US-11962921-B2
Application number	US-202217845582-A
Country	US
Kind code	B2
Filing date	Jun 21, 2022
Priority date	Oct 22, 2021
Publication date	Apr 16, 2024
Grant date	Apr 16, 2024

Abstract

Provided are a method and a device, for processing spectrum data of an image sensor. The method includes obtaining spectrum response signals corresponding to channels of spectrum data of light, the spectrum data being obtained from an object by an image sensor; determining a set of bases corresponding to the obtained spectrum response signals; performing, based on the determined set of bases, a change of basis on at least one basis included in the determined set of bases; and generating, by using a pseudo inverse, reconstructed spectrum data from the spectrum response signals on which the change of basis has been performed.

First claim

What is claimed is:

1. A method of processing spectrum data, the method comprising:
obtaining spectrum response signals corresponding to channels of spectrum data of light, the spectrum data being obtained from an object by an image sensor;
determining a set of bases corresponding to the obtained spectrum response signals;
performing, based on the determined set of bases, a change of basis on at least one basis included in the determined set of bases; and
generating, by using a pseudo inverse, reconstructed spectrum data from the spectrum response signals on which the change of basis has been performed,
wherein the performing the change of basis comprises:
determining at least one basis having a singular value, which is less than a threshold value, among the bases corresponding to the obtained spectrum response signals; and
replacing the singular value of the determined at least one basis with a certain singular value.

2. The method of claim 1 , wherein the determining the set of bases comprises obtaining a principal component with respect to a spectrum response signal of each channel by using a principal component analysis (PCA) algorithm.

3. The method of claim 1 , wherein the set of bases comprises bases, a number of which is less than or equal to a number of the channels.

4. The method of claim 1 , wherein the certain singular value is the threshold value or a lowest value among singular values of other bases, in the bases corresponding to the obtained spectrum response signals, each having a singular value greater than or equal to the threshold value.

5. The method of claim 1 , further comprising generating a hyperspectral image, based on the generated reconstructed spectrum data.

6. The method of claim 5 , wherein the generating the hyperspectral image comprises generating an RGB image, which is color-converted from the reconstructed spectrum data by using a color matching function.

7. The method of claim 1 , wherein the channels of spectrum data comprises three or more channels.

8. The method of claim 1 , wherein the threshold value is determined based on a singular value of an n-th singular value, among singular values of the bases corresponding to the obtained spectrum response signals in an order from smallest to greatest, n being a natural number.

9. A device for processing spectrum data, the device comprising:
a light source configured to irradiate light toward an object;
an image sensor configured to obtain spectrum response signals corresponding to channels of spectrum data of light, the spectrum data being obtained from the object by the image sensor; and
a processor configured to:
determine a set of bases corresponding to the obtained spectrum response signals;
perform, based on the determined set of bases, a change of basis on at least one basis included in the determined set of bases; and
generate, by using a pseudo inverse, reconstructed spectrum data from the spectrum response signals on which the change of basis has been performed,

wherein the processor is further configured to determine at least one basis having a singular value less than a threshold value among the bases corresponding to the obtained spectrum response signals, and replace the singular value of the determined at least one basis with a certain singular value.

10. The device of claim 9 , wherein the set of bases is determined by obtaining a principal component with respect to a spectrum response signal of each channel by using a principal component analysis (PCA) algorithm.

11. The device of claim 9 , wherein the set of bases comprises bases, a number of which is less than or equal to a number of the channels.

12. The device of claim 9 , wherein the certain singular value is the threshold value or a lowest value among singular values of other bases, in the bases corresponding to the obtained spectrum response signals, each having a singular value greater than or equal to the threshold value.

13. The device of claim 9 , wherein the processor is further configured to generate a hyperspectral image, based on the generated reconstructed spectrum data.

14. The device of claim 13 , wherein the processor is further configured to generate the hyperspectral image by generating an RGB image, which is color-converted from the reconstructed spectrum data by using a color matching function.

15. The device of claim 9 , wherein the image sensor comprises a multispectral image sensor configured to obtain spectrum data of three or more channels.

16. The device of claim 9 , wherein the threshold value is determined based on a singular value of an n-th singular value, among singular values of the bases corresponding to the obtained spectrum response signals in an order from smallest to greatest, n being a natural number.

17. A non-transitory computer-readable recording medium having recorded thereon a program for executing a method of processing spectrum data, the method including:
obtaining spectrum response signals corresponding to channels of spectrum data of light, the spectrum data being obtained from an object by an image sensor;
determining a set of bases corresponding to the obtained spectrum response signals;
performing, based on the determined set of bases, a change of basis on at least one basis included in the determined set of bases; and
generating, by using a pseudo inverse, reconstructed spectrum data from the spectrum response signals on which the change of basis has been performed,
wherein the performing the change of basis comprises:
determining at least one basis having a singular value, which is less than a threshold value, among the bases corresponding to the obtained spectrum response signals; and
replacing the singular value of the determined at least one basis with a certain singular value.

Assignees

• Samsung Electronics Co Ltd
• Univ Korea Res & Bus Found

Inventors

• Lee Suyeon
• Park Q-Han
• Kim Unjeong
• Ma Hyunjun

Classifications

• H04N25/62 Primary

  Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels · CPC title

• H04N9/67

  for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85) · CPC title

• G01J3/2823 Primary

  Imaging spectrometer · CPC title

• G01J3/0275 Primary

  making use of sensor-related data, e.g. for identification of sensor parts or optical elements · CPC title

• G01J2003/2826

  Multispectral imaging, e.g. filter imaging · CPC title