Information processing apparatus, information processing method, and calibration apparatus

Patent metadata

Field	Value
Publication number	US-11637967-B2
Application number	US-201917044533-A
Country	US
Kind code	B2
Filing date	Jan 15, 2019
Priority date	Apr 9, 2018
Publication date	Apr 25, 2023
Grant date	Apr 25, 2023

Abstract

Provided is a polarization imaging unit that acquires a polarization image using a lens. In a parameter storage unit of an information processing unit, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit of the information processing unit corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit.

First claim

The invention claimed is:

1. An information processing apparatus, comprising:
a memory configured to store a plurality of parameters; and
a processor configured to:
acquire, from an image sensor that images a light source using a lens, a polarization image;
generate polarization state information based on the polarization image, wherein the polarization state information indicates a polarization state of light from the light source; and
correct a change in the polarization state of the light in the polarization image, wherein
the change in the polarization state of the light is due to the lens,
the correction of the change in the polarization state is based on the stored plurality of parameters, and
the stored plurality of parameters is related to the change in the polarization state of the light due to the lens.

2. The information processing apparatus according to claim 1 , wherein the plurality of parameters includes one of change parameters representing the change in the polarization state or correction parameters to correct the change in the polarization state.

3. The information processing apparatus according to claim 1 , wherein
the polarization state information includes a Stokes vector obtained from a plurality of pixel values with different polarization directions, and
the plurality of parameters correspond to component values of a matrix representing an amount of change of the polarization state information.

4. The information processing apparatus according to claim 1 , wherein
the polarization state information includes a plurality of pixel values with different polarization directions, and
the plurality of parameters correspond to component values of a matrix calculated using a matrix representing a relationship between the plurality of pixel values with the different polarization directions and a Stokes vector,
the Stokes vector is obtained from the plurality of pixel values with the different polarization directions, and
the matrix represents an amount of change of the polarization state information in a case where the polarization state information indicates the Stokes vector.

5. The information processing apparatus according to claim 1 , wherein
the polarization state information includes an azimuth angle, a degree of polarization, and an average intensity, and
the plurality of parameters correspond to component values of a matrix representing an amount of change of the polarization state information.

6. The information processing apparatus according to claim 1 , wherein the plurality of parameters are stored on a pixel-by-pixel basis of the polarization image.

7. The information processing apparatus according to claim 1 , wherein the polarization image includes at least three or more polarization components.

8. The information processing apparatus according to claim 1 , wherein the processor is further configured to:
perform one of defect correction or sensitivity correction of the polarization image; and
generate the polarization state information based on the polarization image that has been corrected.

9. The information processing apparatus according to claim 1 , further comprising the image sensor configured to acquire the polarization image by imaging using the lens.

10. An information processing method, comprising:
storing, by a memory, a plurality of parameters;
acquiring, by a processor, a polarization image from an image sensor that images a light source using a lens;
generating, by the processor, polarization state information based on the polarization image, wherein the polarization state information indicates a polarization state of light from the light source; and
correcting, by the processor, a change in the polarization state of the light in the polarization image, wherein
the change in the polarization state of the light is due to the lens,
the correction of the change in the polarization state is based on the stored plurality of parameters, and
the stored plurality of parameters is related to the change in the polarization state of the light due to the lens.

11. A non-transitory computer-readable medium having stored thereon, computer-executable instructions that, when executed by a processor, cause the processor to execute operations, the operations comprising:
storing a plurality of parameters is stored in a memory;
acquiring, from an image sensor that images a light source using a lens, a polarization image;
generating polarization state information based on the polarization image, wherein the polarization state information indicates a polarization state of light from the light source; and
correcting a change in the polarization state of the light in the polarization image, wherein
the change in the polarization state of the light is due to the lens,
the correction of the change in the polarization state is based on the stored plurality of parameters, and
the stored plurality of parameters is related to the change in the polarization state of the light due to the lens.

Assignees

• Sony Corp

Inventors

• Lu Ying
• Hirasawa Yasutaka
• Kondo Yuhi
• Zhuang Tuo
• Sun Legong

Classifications

• G06T7/80

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G01J4/04 Primary

  Polarimeters using electric detection means (G01J4/02 takes precedence) · CPC title

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/75

  by influencing optical camera components · CPC title

• H04N23/76 Primary

  by influencing the image signals · CPC title