Imaging data processing apparatus and imaging data processing program to perform image alignment by deforming images such that imaged observation target sites coincide

Patent metadata

Field	Value
Publication number	US-11636598-B2
Application number	US-201816964522-A
Country	US
Kind code	B2
Filing date	Mar 30, 2018
Priority date	Mar 30, 2018
Publication date	Apr 25, 2023
Grant date	Apr 25, 2023

Abstract

In a data processing unit, alignment is performed by appropriately deforming one image among MS imaging images acquired from different samples so that positions and sizes on the MS imaging image are matched (S 1 to S 5 ). When the aligned image is displayed on a screen of a display unit and a user sets a region of interest on the image serving as a reference (S 6 ), a micro region including a center point within a range of the set region of interest is extracted in each of an image serving as the reference and an image not serving as the reference (S 7 ). In the image subjected to image deformation, although the shape of each micro region is distorted and micro regions are not arranged in an orderly grid manner, by assuming that the micro regions in which the center point is included within the range of the region of interest is included in the range of the region of interest, it is possible to perform a comparative analysis based on the data value within an appropriate micro region corresponding to the region of interest regardless of the image deformation.

First claim

The invention claimed is:

1. An imaging data processing apparatus for processing imaging data sets, each processing imaging data set forming a corresponding first image of the sample and comprising a set of data acquired by performing a predetermined analysis or observation in each of a plurality of micro regions within a two-dimensional measurement region on a corresponding sample, wherein the imaging data sets are acquired for each of a plurality of samples in which from observation target sites of the sample, or acquired by different analyses or observation methods or under different parameters for an observation target site of one sample, the imaging data processing apparatus comprising:
a) an image alignment processing unit configured to obtain image deformation information by performing deformation processing of one or more optical images corresponding to the first images to generate one or more corresponding deformed optical images, so that observation target sites represented in the optical images coincide with each other, and perform deformation processing of the one or more of the first images to generate one or more corresponding second images by using the image deformation information obtained by the optical image corresponding to the first image, each second image providing a shift of a position of one or more of the micro regions with respect to their position in the corresponding first image;
b) a region of interest setting unit configured to obtain a user input to set a region of interest on a reference image, the reference image comprising one of the first images or one of the second images and to set a region of interest on each of the second images that is not the reference image based on the setting of the region of interest on the reference image; and
c) a region of interest correspondence determination unit configured to determine which micro regions of the second images are included in the region of interest of each second image by determining if a center point of each micro region of the second image exists within the region of interest of the second image.

2. An imaging data processing apparatus for processing imaging data sets, each processing imaging data set forming a corresponding first image of the sample and comprising a set of data acquired by performing a predetermined analysis or observation in each of a plurality of micro regions within a two-dimensional measurement region on a corresponding sample, wherein the imaging data sets are acquired for each of a plurality of samples from observation target sites of the sample, or acquired by different analyses or observation methods or under different parameters for an observation target site of one sample, the imaging data processing apparatus comprising:
a) an image alignment processing unit configured to perform deformation processing of one or more of the first images to generate one or more corresponding deformed images, each deformed image providing shift of a position of one or more of the micro regions with respect to their position in the corresponding first image so that observation target sites represented in the first images coincide with each other;
b) a region of interest setting unit configured to obtain a user input to set a region of interest on a reference image, the reference image comprising one of the first images or one of the deformed images and to set a region of interest on each of the deformed images that is not the reference image based on the setting of the region of interest on the reference image; and
c) a data value within region of interest operation unit configured to calculate, for each deformed image, data values at positions corresponding to center points of a plurality of virtual micro regions existing within the region of interest set by the region of interest setting unit on the deformed image, each data value being calculated by interpolation processing using data values at center points of at least some the micro regions as shifted in the deformed image due to the processing by the image alignment processing unit, and configured to adopt the calculated data values as the data value of each virtual micro region included in the region of interest set on the deformed image.

3. An imaging data processing apparatus for processing imaging data sets, each processing imaging data set forming a corresponding first image of the sample and comprising a set of data acquired by performing a predetermined analysis or observation in each of a plurality of micro regions within a two-dimensional measurement region on a corresponding sample, wherein the imaging data sets are acquired for each of a plurality of samples from observation target sites of the sample, or acquired by different analyses or observation methods or under different parameters for an observation target site of one sample, the imaging data processing apparatus comprising:
a) an image alignment processing unit configured to perform deformation processing of one or more of the first images to generate one or more corresponding deformed images, each deformed image providing a shift of a position of one or more of the micro regions with respect to their position in the corresponding first image so that observation target sites represented in the first images coincide with each other;
b) a region of interest setting unit configured to divide a selected deformed image selected by a user among the deformed images into predetermined micro regions, and for each of the predetermined micro regions, obtain a corresponding data value corresponding to a center point of the predetermined micro region by an interpolation processing using data values at center points of at least some of the micro regions as shifted in the selected deformed image due to the deformation processing by the image alignment processing unit, and display the image based on the data value calculated by the interpolation processing to allow the user to set a region of interest on the selected deformed image;
c) a data value within region of interest operation unit configured to calculate, for each deformed image, data values at positions corresponding to center points of a plurality of virtual micro regions existing within a region of interest set by the region of interest setting on the deformed image, each data value being calculated by interpolation processing using data values at center points of at least some the micro regions as shifted in the deformed image due to the processing by the image alignment processing unit, and configured to adopt the calculated data values as the data value of each virtual micro region included in the region of interest set on the deformed image.

4. A non-transitory computer-readable recording medium storing an imaging data processing program for processing imaging data sets, each processing imaging data set forming a corresponding first image of the sample and comprising a set of data acquired by performing a predetermined analysis or observation in each of a plurality of micro regions within a two-dimensional measurement region on a corresponding sample, wherein the imaging data sets are acquired for each of a plurality of samples from observation target sites of the sample, or acquired by different analyses or observation methods or under different parameters for an observation target site of one sample, the imaging data processing program causing a computer to function as:
a) an image alignment processing function part configured to obtain image deformation information by performing deformation processing of one or more optical images corresponding to the first images to generate one or more corresponding deformed optical images, so that observation target sites represented in the optical images coincide with each other, and perform deformation processing of the one or more of the first i

Assignees

• Shimadzu Corp

Inventors

• Ikegami Masahiro

Classifications

• G06T2207/10056

  Microscopic image · CPC title

• H01J49/0004

  Imaging particle spectrometry · CPC title

• G06T2207/20104

  Interactive definition of region of interest [ROI] · CPC title

• G06T7/0014 Primary

  using an image reference approach · CPC title

• H01J49/004

  Combinations of spectrometers, tandem spectrometers, e.g. MS/MS, MSn · CPC title