Imaging system and imaging method

Patent metadata

Field	Value
Publication number	US-2024296569-A1
Application number	US-202418661356-A
Country	US
Kind code	A1
Filing date	May 10, 2024
Priority date	Dec 3, 2021
Publication date	Sep 5, 2024
Grant date	—

Abstract

An imaging system includes an imaging apparatus that repeatedly acquires a compressed image in which information regarding light of four or more wavelength bands from a target is compressed, and a processing apparatus. The processing apparatus extracts a partial region including a region of the target from the compressed image so as to compensate for a relative motion between the target and the imaging apparatus, and generates spectral images corresponding to wavelength bands, based on data of the partial region of the compressed image.

First claim

What is claimed is:

1 . An imaging system comprising:
an imaging apparatus that acquires a compressed image in which information regarding light of four or more wavelength bands from a target is compressed; and a processing apparatus, wherein the processing apparatus extracts a partial region including a region of the target from the compressed image so as to compensate for a relative motion between the target and the imaging apparatus, and generates spectral images corresponding to wavelength bands, based on data of the partial region of the compressed image.

2 . The imaging system according to claim 1 , wherein
the imaging apparatus repeatedly acquires the compressed image, and the processing apparatus detects, based on temporal changes of the compressed images, the relative motion between the target and the imaging apparatus and determines, based on the relative motion, the partial region.

3 . The imaging system according to claim 1 , wherein
the imaging apparatus includes a filter array including filters that have different spectral transmittances from each other, and an image sensor that detects light that has passed through the filter array and outputs a signal representing the compressed image.

4 . The imaging system according to claim 3 , further comprising:
a storage device that stores matrix data corresponding to the spectral transmittance of the filter array, wherein the processing apparatus generates the spectral images, based on a portion of the matrix data corresponding to the partial region.

5 . The imaging system according to claim 2 , wherein
by performing a matching process based on a signal representing a first compressed image output at a first time from the image apparatus and a signal representing a second compressed image output at a second time after the first time from the image apparatus, the processing apparatus extracts the partial region from the second compressed image.

6 . The imaging system according to claim 5 , wherein
the processing apparatus generates the spectral images from data of the partial region, based on matrix data corresponding to the spectral transmittance of part of the filter array corresponding to the partial region of the second compressed image.

7 . The imaging system according to claim 1 , further comprising:
a sensor that detects the relative motion between the target and the imaging apparatus, wherein the processing apparatus determines the partial region, based on a signal output from the sensor.

8 . The imaging system according to claim 7 , wherein
the sensor includes at least one of an acceleration sensor or an angular rate sensor, and the processing apparatus determines, based on the signal output from the sensor, a motion vector of the imaging apparatus and determines, based on the motion vector, the partial region.

9 . The imaging system according to claim 1 , wherein
the processing apparatus causes a display to display the compressed image, and causes the display to display a graphical user interface for allowing a user to specify the target to be subjected to motion compensation in the compressed image.

10 . The imaging system according to claim 1 , wherein
the processing apparatus acquires a signal representing the compressed image from the imaging apparatus, extracts the partial region, and repeatedly generates the spectral images, and generates video data of each of the spectral images.

11 . A method executed by a computer, the method comprising:
acquiring, from an imaging apparatus that acquires a compressed image in which information regarding light of four or more wavelength bands from a target is compressed, a signal representing the compressed image; extracting a partial region including a region of the target from the compressed image so as to compensate for a relative motion between the target and the imaging apparatus; and generating, based on data of the partial region of the compressed image, spectral images corresponding to wavelength bands.

12 . A non-transitory computer readable medium storing a program that causes a computer to perform processing, the processing comprising:
acquiring, from an imaging apparatus that acquires a compressed image in which information regarding light of four or more wavelength bands from a target is compressed, a signal representing the compressed image; extracting a partial region including a region of the target from the compressed image so as to compensate for a relative motion between the target and the imaging apparatus; and generating, based on data of the partial region of the compressed image, spectral images corresponding to wavelength bands.

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Kato Yumiko
• Yako Motoki
• Yasugi Shunsuke

Classifications

• G06T7/215 Primary

  Motion-based segmentation · CPC title

• G01J3/2823 Primary

  Imaging spectrometer · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title

• G01J2003/2826

  Multispectral imaging, e.g. filter imaging · CPC title

• G01J2003/2806

  Array and filter array · CPC title