Image processing apparatus, image processing method, and storage medium

Patent metadata

Field	Value
Publication number	US-10846892-B2
Application number	US-201816121429-A
Country	US
Kind code	B2
Filing date	Sep 4, 2018
Priority date	Sep 7, 2017
Publication date	Nov 24, 2020
Grant date	Nov 24, 2020

Abstract

An apparatus includes: an acquisition unit configured to acquire pieces of three-dimensional data of a subject eye obtained at different times, the three-dimensional data including pieces of two-dimensional data obtained at different positions; a first planar alignment unit configured to perform first planar alignment including alignment between the pieces of three-dimensional data in a plane orthogonal to a depth direction of the subject eye; a first depth alignment unit configured to perform first depth alignment including alignment between pieces of two-dimensional data in at least one piece of three-dimensional data among the pieces of three-dimensional data and further including alignment between the pieces of three-dimensional data in the depth direction; and a generation unit configured to generate interpolation data of at least one piece of three-dimensional data among the pieces of three-dimensional data by using a result of the first planar alignment and a result of the first depth alignment.

First claim

What is claimed is:

1. An image processing apparatus, comprising:
a first planar alignment unit configured to perform first planar alignment including alignment between pieces of three-dimensional data of a subject eye in a plane orthogonal to a depth direction of the subject eye, the pieces of three-dimensional data being obtained at different times, the three-dimensional data including pieces of two-dimensional data obtained at different positions;
a first depth alignment unit configured to perform first depth alignment including alignment between pieces of two-dimensional data in at least one piece of three-dimensional data among the pieces of three-dimensional data and further including alignment between pieces of three-dimensional data in the depth direction; and
a generation unit configured to generate interpolation data of at least one piece of three-dimensional data among the pieces of three-dimensional data by using a result of the first planar alignment and a result of the first depth alignment.

2. The image processing apparatus according to claim 1 , further comprising: an image generation unit configured to generate new three-dimensional data by using the pieces of three-dimensional data and the interpolation data.

3. The image processing apparatus according to claim 1 ,
wherein the first planar alignment unit performs the first planar alignment by using an En-face image of the subject eye generated from at least a part of a piece of the three-dimensional data in the depth direction, and wherein the first depth alignment is performed after the first planar alignment.

4. The image processing apparatus according to claim 3 , further comprising: a selection unit configured to select, from among the pieces of three-dimensional data, a piece of three-dimensional data to be taken as a reference for the alignment between the pieces of three-dimensional data by using at least one of an evaluation value regarding the En-face image, an evaluation value regarding the first planar alignment, an evaluation value regarding an artifact of the En-face image, and an evaluation value regarding layer detection of the pieces of three-dimensional data.

5. The image processing apparatus according to claim 4 , further comprising: a second planar alignment unit configured to perform second planar alignment for each main scan line of the En-face mage corresponding to other three-dimensional data in relation to the En-face image corresponding to the piece of three-dimensional data taken as the reference in a direction of a main scan.

6. The image processing apparatus according to claim 5 , wherein, in the second planar alignment, an artifact area in the other three-dimensional data is detected by using a degree of similarity calculated for each main scan line, and the detected artifact area is not used for generating new three-dimensional data.

7. The image processing apparatus according to claim 3 , wherein the first planar alignment unit performs the first planar alignment including alignment regarding rotation of the subject eye by using the En-face image.

8. The image processing apparatus according to claim 1 , further comprising: a determination unit configured to determine, by using a degree of similarity of at least a part of other three-dimensional data to three-dimensional data taken as a reference for the alignment between the pieces of three-dimensional data, whether to use at least a part of data for generating new three-dimensional data or not.

9. The image processing apparatus according to claim 1 , further comprising: a second depth alignment unit configured to perform second depth alignment between pieces of interpolation data in the depth direction in a case where the pieces of interpolation data are generated for the pieces of three-dimensional data and configured to perform, in a case where no interpolation data is generated for at least one of the pieces of three-dimensional data, second depth alignment between the three-dimensional data and the interpolation data in the depth direction.

10. The image processing apparatus according to claim 9 , wherein the second depth alignment unit performs the second depth alignment for each A scan.

11. The image processing apparatus according to claim 1 , wherein the three-dimensional data includes three-dimensional tomographic data of luminance or three-dimensional motion contrast data.

12. The image processing apparatus according to claim 11 ,
wherein the three-dimensional data is the three-dimensional motion contrast data, wherein the first planar alignment unit performs the first planar alignment by using an En-face image of the subject eye generated from at least a part of the three-dimensional motion contrast data in the depth direction, and
wherein the first depth alignment unit performs the first depth alignment including alignment regarding slope between the pieces of two-dimensional data arranged along a direction of sub scan by using a layer detection result of three-dimensional tomographic data of luminance corresponding to the three-dimensional motion contrast data.

13. The image processing apparatus according to claim 1 , wherein the pieces of three-dimensional data are data obtained using a scan method based on the same direction of main scan.

14. An image processing method, comprising:
performing first planar alignment including alignment between pieces of three-dimensional data of a subject eye in a plane orthogonal to a depth direction of the subject eye, the pieces of three-dimensional data being obtained at different times, the three-dimensional data including pieces of two-dimensional data obtained at different positions;
performing first depth alignment including alignment between pieces of two-dimensional data in at least one piece of three-dimensional data among the pieces of three-dimensional data and further including alignment between pieces of three-dimensional data in the depth direction; and
generating interpolation data of at least one piece of three-dimensional data among the pieces of three-dimensional data by using a result of the first planar alignment and a result of the first depth alignment.

15. A non-transitory computer-readable storage medium storing a program for causing a computer to execute the method according to claim 14 .

Assignees

• Canon Kk

Inventors

• Iwase Yoshihiko
• Uchida Hiroki

Classifications

• G06T12/30 Primary

  Image post-processing, e.g. metal artefact correction · CPC title

• A61B3/102 Primary

  for optical coherence tomography [OCT] · CPC title

• G06T7/33

  using feature-based methods · CPC title

• G06T7/337

  involving reference images or patches · CPC title

• G06T2207/10101

  Optical tomography; Optical coherence tomography [OCT] · CPC title