Information processing apparatus, imaging apparatus, information processing method, control method for imaging apparatus, and storage medium for notifying of a subject blur occuring in a captured image

Patent metadata

Field	Value
Publication number	US-11477384-B2
Application number	US-201916719652-A
Country	US
Kind code	B2
Filing date	Dec 18, 2019
Priority date	Dec 28, 2018
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

An information processing apparatus includes an acquisition unit configured to acquire a plurality of first captured images acquired in a plurality of first image capturing operations based on a first imaging parameter, and motion information for a subject in the plurality of first captured images, a setting unit configured to set a second imaging parameter, an estimation unit configured to estimate, based on the motion information and the second imaging parameter, a motion blur of a subject in a second captured image acquired when a second image capturing is performed based on the second imaging parameter and a notification unit configured to notify of the motion blur. The motion blur is a statistic of a motion blur in each of the plurality of first captured images.

First claim

What is claimed is:

1. An information processing apparatus comprising:
one or more processors; and
a memory storing instructions which, when executed by the one or more processors, cause the information processing apparatus to function as:
an acquisition unit configured to acquire a plurality of first captured images acquired in a plurality of first image capturing operations based on a first imaging parameter, and motion information for a subject in the plurality of first captured images;
a setting unit configured to set a second imaging parameter;
an estimation unit configured to estimate a motion blur of a subject in a second captured image acquired if a second image capturing is performed based on the second imaging parameter, based on the motion information and the second imaging parameter; and
a notification unit configured to notify of the motion blur,

wherein the motion blur is estimated based on motion blurs in the plurality of first captured images; and
wherein a number of the first captured images used to estimate the motion blur is determined (1) based on an exposure time in the second image capturing or (2) by a user operation for inputting the number.

2. The information processing apparatus according to claim 1 , wherein the estimation unit is configured to estimate the motion blur of the subject in the second captured image based on the motion information and the first and the second imaging parameters.

3. The information processing apparatus according to claim 1 , wherein the acquisition unit is configured to calculate and acquire the motion information by performing image comparison between the plurality of first captured images.

4. The information processing apparatus according to claim 1 , wherein the estimation unit is configured to estimate the motion blur in the second captured image, by converting a motion blur of the subject in the first captured image calculated based on the motion information into the motion blur in the second captured image, based on a difference between the first and the second imaging parameters.

5. The information processing apparatus according to claim 1 , wherein the estimation unit is configured to estimate the motion blur in the second captured image, based on the motion information, an inter-image time interval in the plurality of first image capturing operations, and an exposure time set as the second imaging parameter.

6. The information processing apparatus according to claim 1 , wherein the notification unit is configured to notify of the motion blur in the second captured image by displaying information corresponding to the motion blur on a display unit.

7. The information processing apparatus according to claim 1 , wherein the notification unit is configured to notify of the motion blur in the second captured image by superimposing information corresponding to the motion blur on the first captured image and displaying the first captured image on a display unit.

8. The information processing apparatus according to claim 1 , wherein the acquisition unit is configured to acquire motion information corresponding to a plurality of areas in the first captured image, wherein the estimation unit is configured to estimate the motion blur in a plurality of areas in the second captured image based on the motion information corresponding to the plurality of areas, and wherein the notification unit is configured to notify of the motion blur in the second captured image for each of the plurality of corresponding areas.

9. The information processing apparatus according to claim 8 , wherein the notification unit is configured to notify of the motion blur in the second captured image by displaying a frame for each area in the second captured image where an estimated motion blur amount is larger than or equal to a predetermined value, in the first captured image.

10. The information processing apparatus according to claim 8 , wherein the notification unit is configured to notify of the motion blur in the second captured image by displaying an edge area for each area in the second captured image where an estimated motion blur amount is larger than or equal to a predetermined value, in the first captured image.

11. The information processing apparatus according to claim 1 , wherein the first image capturing operation is performed before the second image capturing, and wherein the notification unit is configured to notify of the motion blur in the second captured image while the acquisition unit is consecutively acquiring the first captured images.

12. The information processing apparatus according to claim 1 , wherein the estimation unit is configured to estimate the motion blur again when an imaging parameter for the second image capturing is changed by the setting unit, and wherein the notification unit is configured to notify of the motion blur in the second captured image estimated again by the estimation unit.

13. The information processing apparatus according to claim 1 , wherein the setting unit is configured to set the second imaging parameter based on the first captured image.

14. The information processing apparatus according to claim 1 , wherein the motion blur is estimated based on a statistic of motion blurs in the plurality of first captured images.

15. The information processing apparatus according to claim 1 , wherein the motion blur is estimated based on a maximum value of motion blurs in the plurality of first captured images.

16. An imaging apparatus comprising:
an imager configured to capture a first image; and
an information processing apparatus comprising:
one or more processors; and
a memory storing instructions which, when executed by the one or more processors, cause the information processing apparatus to function as:
an acquisition unit configured to acquire a plurality of first captured images acquired in a plurality of first image capturing operations based on a first imaging parameter from the imager, and motion information for a subject in the plurality of first captured images;
a setting unit configured to set a second imaging parameter;
an estimation unit configured to estimate a motion blur of a subject in a second captured image acquired if a second image capturing is performed based on the second imaging parameter, and based on the motion information and the second imaging parameter; and
a notification unit configured to notify of the motion blur,

wherein the motion blur is estimated based on motion blurs in the plurality of first captured images; and
wherein a number of the first captured images used to estimate the motion blur is determined (1) based on an exposure time in the second image capturing or (2) by a user operation for inputting the number.

17. An imaging apparatus comprising:
one or more processors; and
a memory storing instructions which, when executed by the one or more processors, cause the imaging apparatus to function as:
an imaging unit configured to, upon issuance of an imaging instruction by a user during a sequential output of a plurality of first captured images acquired in a plurality of first image capturing operations based on a first imaging parameter, output a second captured image in a second image capturing based on a second imaging parameter based on the imaging instruction;
a calculation unit configured to calculate motion information based on the plurality of first captured images output from the imaging unit;
a setting unit configured to set the second imaging parameter;
an estimation unit configured to estimate a motion blur in the second captured im

Assignees

• Canon Kk

Inventors

• Yamaguchi Shota
• Kimura Naoto

Classifications

• G06T7/238 Primary

  using non-full search, e.g. three-step search · CPC title

• H04N23/634 Primary

  Warning indications · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/6811

  based on the image signal · CPC title