Image processing device, image processing system, and image processing method

Patent metadata

Field	Value
Publication number	US-10594909-B2
Application number	US-201816129913-A
Country	US
Kind code	B2
Filing date	Sep 13, 2018
Priority date	Mar 17, 2016
Publication date	Mar 17, 2020
Grant date	Mar 17, 2020

Abstract

An image processing device, an image processing system, and an image processing method capable of easily correcting image deterioration caused by nonuniform optical characteristics around an optical axis of a lens according to a position in a rotational direction of a lens barrel are provided. An image processing device includes a communication unit ( 42 ) that inputs a first image indicating a correction reference position in a rotation direction of a lens barrel ( 24 ) and a second image that is a correction target, the first image and the second image being obtained by imaging of the imaging device ( 10 ), a rotation position recognition unit ( 62 ) that recognizes the correction reference position in the rotational direction on the basis of the first image, a correction information acquisition unit ( 66 ) that acquires correction information on the basis of the correction reference position in the rotation direction, and an image correction unit ( 68 ) that corrects the second image on the basis of the correction information.

First claim

What is claimed is:

1. An image processing device, comprising:
an image input unit that inputs a first image indicating a correction reference position in a rotation direction of a lens barrel mounted on an imaging device and a second image that is a correction target, the first image and the second image being obtained by imaging of the imaging device;
a rotation position recognition unit that recognizes the correction reference position in the rotational direction on the basis of the first image;
a correction information acquisition unit that acquires correction information corresponding to nonuniform optical characteristics around an optical axis of a lens held in the lens barrel on the basis of the correction reference position in the rotation direction; and
an image correction unit that corrects the second image on the basis of the correction information.

2. The image processing device according to claim 1 ,
wherein the first image includes a marker indicating the correction reference position, and
the rotation position recognition unit measures a slope of the marker within a screen of the first image and recognizes the correction reference position on the basis of the slope.

3. The image processing device according to claim 2 , wherein the marker is a one-dimensional or two-dimensional barcode.

4. The image processing device according to claim 3 ,
wherein the barcode includes at least one of the correction information or the identification information, and
the correction information acquisition unit acquires the correction information according to the correction reference position on the basis of a decoding result of the barcode and a slope of the barcode within the screen of the first image.

5. The image processing device according to claim 2 , wherein the marker is a marker displayed on an image display device or a marker printed on an object.

6. The image processing device according to claim 1 ,
wherein the first image includes correction reference position information acquired by the image display device, and
the rotation position recognition unit recognizes the correction reference position by extracting the correction reference position information from the first image.

7. The image processing device according to claim 6 ,
wherein the correction reference position information is posture information indicating a posture of the image display device detected by the image display device, and
the correction information acquisition unit acquires the correction information on the basis of the posture information.

8. The image processing device according to claim 6 ,
wherein the correction reference position information is user input information received by the image display device, and
the correction information acquisition unit acquires the correction information on the basis of the user input information.

9. The image processing device according to claim 1 ,
wherein the first image includes a light image due to light emission of a light source, and
the rotation position recognition unit detects a light intensity distribution within the screen of the first image and recognizes the correction reference position on the basis of the light intensity distribution.

10. The image processing device according to claim 9 , wherein the rotation position recognition unit recognizes the correction reference position on the basis of the position of the light image within the screen of the first image.

11. The image processing device according to claim 9 ,
wherein the light source is a point light source, and
the rotation position recognition unit recognizes the correction reference position in the rotational direction on the basis of the position of the light image of the point light source in the first image.

12. The image processing device according to claim 9 ,
wherein the light intensity distribution is caused by a light intensity difference between a light transmission region and a light shielding region in the first image, and
the rotation position recognition unit recognizes the correction reference position by detecting at least one of the light transmission region or the light-shielding region in the first image.

13. The image processing device according to claim 9 , wherein the rotation position recognition unit recognizes the correction reference position in the rotational direction on the basis of a temporal change in a light intensity in the first image.

14. The image processing device according to claim 1 , wherein the correction information acquisition unit acquires the correction information according to another correction reference position by converting correction information according to a single correction reference position.

15. The image processing device according to claim 1 , wherein the correction information acquisition unit selects the correction information according to the correction reference position recognized by the rotation position recognition unit from a plurality of pieces of the correction information.

16. The image processing device according to claim 1 , wherein the correction information includes correction information for a point image restoration process.

17. An image processing system comprising: a lens device including the lens and the lens barrel; the imaging device; and the image processing device according to claim 1 .

18. An image processing method, comprising processes of:
inputting a first image indicating a correction reference position in a rotation direction of a lens barrel mounted on an imaging device and a second image that is a correction target, the first image and the second image being obtained by imaging of the imaging device;
recognizing the correction reference position in the rotational direction on the basis of the first image;
acquiring correction information corresponding to nonuniform optical characteristics around an optical axis of a lens held in the lens barrel on the basis of the correction reference position in the rotation direction; and
correcting the second image on the basis of the correction information.

Assignees

• Fujifilm Corp

Inventors

• Naruse Yousuke
• Kunugise Takashi
• Hayashi Kenkichi

Classifications

• G03B43/00

  Testing correct operation of photographic apparatus or parts thereof · CPC title

• G06T2207/30204

  Marker · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• G03B17/14 Primary

  interchangeably · CPC title

• G06K9/18

  Physics · mapped topic