Device and method for processing spectrum data of image sensor

Patent metadata

Field	Value
Publication number	US-12212864-B2
Application number	US-202418602787-A
Country	US
Kind code	B2
Filing date	Mar 12, 2024
Priority date	Oct 22, 2021
Publication date	Jan 28, 2025
Grant date	Jan 28, 2025

Abstract

Provided are a method and a device, for processing spectrum data of an image sensor. The method includes obtaining spectrum response signals corresponding to channels of spectrum data of light, the spectrum data being obtained from an object by an image sensor; determining a set of bases corresponding to the obtained spectrum response signals; performing, based on the determined set of bases, a change of basis on at least one basis included in the determined set of bases; and generating, by using a pseudo inverse, reconstructed spectrum data from the spectrum response signals on which the change of basis has been performed.

First claim

What is claimed is:

1. A method of processing spectrum data obtained by a hyperspectral imaging device, the method comprising:
obtaining spectrum response signals corresponding to channels of spectrum data of a hyperspectral image, the spectrum data of the hyperspectral image being obtained from an object by the hyperspectral imaging device;
obtaining bases corresponding to the obtained spectrum response signals of the channels;
determining a basis set based on a number of bases that have a preset threshold value or greater and singular values of the bases among the obtained bases;
performing a change of basis on the determined basis set; and
generating, by using a pseudo inverse, a reconstructed hyperspectral image from the spectrum response signals on which the change of basis has been performed.

2. The method of claim 1 , wherein the determined basis set comprises bases, a number of which is less than or equal to a number of the channels.

3. The method of claim 1 , wherein the channels of the spectrum data correspond to a plurality of different wavelength bands of a light irradiated toward the object.

4. The method of claim 1 , further comprising:
obtaining first information about the object based on a visible image obtained by an image sensor of the hyperspectral imaging device; and
obtaining second information about the object based on the obtained first information and the reconstructed hyperspectral image obtained by the image sensor;
wherein the first information comprises information about an appearance of the object and the second information may comprises information about material parameters of the object.

5. The method of claim 1 , wherein the spectrum response signals on which the change of basis has been performed have orthogonality.

6. The method of claim 1 , wherein the determining the basis set comprises determining the basis set using a truncation matrix to remove small singular values being less than or equal to a preset magnitude.

7. The method of claim 1 , wherein the determined basis set comprises at least one basis, a singular value of which is replaced with a certain singular value, and
wherein the certain singular value comprises the preset threshold value or a lowest value among singular values of other bases, in the bases corresponding to the obtained spectrum response signals, each having a singular value greater than or equal to the preset threshold value.

8. The method of claim 1 , wherein the preset threshold value is determined based on a singular value of an n-th singular value, among singular values of the bases corresponding to the obtained spectrum response signals in an order from smallest to greatest, n being a natural number.

9. A hyperspectral imaging device for processing spectrum data, the device comprising:
a light source configured to irradiate a light toward an object;
an image sensor configured to obtain spectrum response signals corresponding to channels of spectrum data of a hyperspectral image, the spectrum data of the hyperspectral image being obtained from the object;
a processor configured to:
obtain bases corresponding to the obtained spectrum response signals of the channels;
determine a basis set based on a number of bases that have a preset threshold value or greater and singular values of the bases among the obtained bases;
perform a change of basis on the determined basis set; and
generate, by using a pseudo inverse, a reconstructed hyperspectral image from the spectrum response signals on which the change of basis has been performed.

10. The hyperspectral imaging device of claim 9 , wherein the determined basis set comprises bases, a number of which is less than or equal to a number of the channels.

11. The hyperspectral imaging device of claim 9 , wherein the channels of the spectrum data correspond to a plurality of different wavelength bands of the light irradiated toward the object.

12. The hyperspectral imaging device of claim 9 , wherein the processor is further configured to:
obtain first information about the object based on a visible image obtained by the image sensor; and
obtain second information about the object based on the obtained first information and the reconstructed hyperspectral image obtained by the image sensor, and
wherein the first information comprises information about an appearance of the object and the second information may comprises information about material parameters of the object.

13. The hyperspectral imaging device of claim 9 , wherein the spectrum response signals on which the change of basis has been performed have orthogonality.

14. The hyperspectral imaging device of claim 9 , wherein the processor is further configured to determine the basis set using a truncation matrix to remove small singular values being less than or equal to a preset magnitude.

15. The hyperspectral imaging device of claim 9 , wherein the determined basis set comprises at least one basis, a singular value of which is replaced with a certain singular value, and
wherein the certain singular value comprises the preset threshold value or a lowest value among singular values of other bases, in the bases corresponding to the obtained spectrum response signals, each having a singular value greater than or equal to the preset threshold value.

16. The hyperspectral imaging device of claim 9 , the preset threshold value is determined based on a singular value of an n-th singular value, among singular values of the bases corresponding to the obtained spectrum response signals in an order from smallest to greatest, n being a natural number.

Assignees

• Samsung Electronics Co Ltd
• Univ Korea Res & Bus Found

Inventors

• Lee Suyeon
• Park Q-Han
• Kim Unjeong
• Ma Hyunjun

Classifications

• H04N9/67

  for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85) · CPC title

• G01J2003/284

  Spectral construction · CPC title

• G01J2003/2826

  Multispectral imaging, e.g. filter imaging · CPC title

• G01J3/2823 Primary

  Imaging spectrometer · CPC title

• G01J3/0297

  Constructional arrangements for removing other types of optical noise or for performing calibration · CPC title