Image processing apparatus, control method thereof, and storage medium

Patent metadata

Field	Value
Publication number	US-10713757-B2
Application number	US-201816127367-A
Country	US
Kind code	B2
Filing date	Sep 11, 2018
Priority date	Mar 18, 2016
Publication date	Jul 14, 2020
Grant date	Jul 14, 2020

Abstract

An image processing apparatus including an input unit configured to input image data of a target frame, a first processing unit configured to perform a first processing for output image data of a reference frame related to the target frame, which is stored in the memory, to change positions of pixels in the output image data, an image processing unit configured to perform image processing for the image data of the target frame input by the input unit based on the output image data of the reference frame processed by the first processing unit, and a second processing unit configured to perform a second processing, the second processing being according to the first processing, for the image data of the target frame for which image processing has been performed by the image processing unit and to store the processed image data in the memory as output image data of the target frame.

First claim

The invention claimed is:

1. An image processing apparatus comprising a memory being capable of storing output image data obtained by converting image data in units of frames, the image processing apparatus comprising:
an input unit configured to input image data of a target frame;
a first processing unit configured to perform a first processing for output image data of a reference frame related to the target frame, which is stored in the memory, to change positions of pixels in the output image data;
an image processing unit configured to perform image processing for the image data of the target frame input by the input unit based on the output image data of the reference frame processed by the first processing unit; and
a second processing unit configured to perform a second processing, the second processing being according to the first processing, for the image data of the target frame for which image processing has been performed by the image processing unit and to store the processed image data in the memory as output image data of the target frame.

2. The image processing apparatus according to claim 1 , wherein
the first processing unit converts the output image data of the reference frame to the state before being subjected to the second processing by the second processing unit.

3. The image processing apparatus according to claim 1 , wherein
the first processing by the first processing unit and the second processing by the second processing unit are inversion processing.

4. The image processing apparatus according to claim 3 , wherein
the input unit inputs image data in a first pixel order,
the first processing unit inverts image data in a second pixel order different from the first pixel order into image data in the first pixel order, and
the second processing unit inverts the image data in the first pixel order into the image data in the second pixel order.

5. The image processing apparatus according to claim 3 , wherein
the first processing unit performs inversion processing by performing at least one of changing a write order to the memory and changing a top address of a write destination to the memory.

6. The image processing apparatus according to claim 5 , wherein
the second processing unit performs inversion processing by performing at least one of changing a read order from the memory and changing a read top address from the memory.

7. The image processing apparatus according to claim 3 , further comprising a setting unit configured to perform setting to switch whether or not to perform inversion processing in units of frames for the first processing unit and the second processing unit.

8. The image processing apparatus according to claim 1 , wherein the first processing by the first processing unit and the second processing by the second processing unit are geometrical conversion.

9. The image processing apparatus according to claim 8 , wherein
the input unit inputs image data with a first rotation angle,
the first processing unit performs geometrical conversion for image data with a second rotation angle different from the first rotation angle into the image data with the first rotation angle, and
the second processing unit performs geometrical conversion for the image data with the first rotation angle into the image data with the second rotation angle.

10. The image processing apparatus according to claim 8 , wherein
the input unit inputs image data with a first magnification,
the first processing unit performs geometrical conversion for image data with a second magnification different from the first magnification into the image data with the first magnification, and
the second processing unit performs geometrical conversion for the image data with the first magnification into the image data with the second magnification.

11. The image processing apparatus according to claim 8 , wherein
the first processing unit performs the geometrical conversion by performing geometrical conversion for read-target coordinate data indicating coordinates to be read of a pixel of the image data stored in the memory and by outputting a pixel corresponding to the read-target coordinate data, and
the second processing unit performs the geometrical conversion by performing geometrical conversion for output coordinate data indicating output coordinates of a pixel of the image data and by storing a pixel corresponding to the output coordinate data in a corresponding area of the memory.

12. The image processing apparatus according to claim 11 , wherein
the first processing unit performs geometrical conversion for the read-target coordinate data in accordance with set parameters, and
the second processing unit performs geometrical conversion for the output coordinate data in accordance with the set parameters.

13. The image processing apparatus according to claim 11 , wherein
the first processing unit performs geometrical conversion for the read-target coordinate data by referring to an Look Up Table (LUT),
the second processing unit performs geometrical conversion for the output coordinate data by referring to an LUT.

14. The image processing apparatus according to claim 8 , further comprising a setting unit configured to perform setting to switch whether or not to perform the geometrical conversion in units of frames for the first processing unit and the second processing unit.

15. The image processing apparatus according to claim 1 , wherein
the reference frame is a frame before the target frame, and
wherein the image processing unit performs cyclic noise reduction processing as the image processing.

16. The image processing apparatus according to claim 1 , wherein
the image data of the reference frame is image data captured at the same timing under an exposure condition different from that of the target frame, or image data obtained by composing image data captured under different exposure conditions,
wherein the image processing unit performs HDR processing, which is composing at least two image data under different exposure conditions as the image processing.

17. A control method in an image processing apparatus comprising a memory being capable of storing output image data obtained by converting image data in units of frames, the method comprising the steps of:
inputting image data of a target frame;
performing a first processing for output image data of a reference frame related to the target frame, which is stored in the memory, to change positions of pixels in the output image data;
performing image processing for the input image data of the target frame based on the output image data of the reference frame processed the first processing; and
performing a second processing, the second processing being according to the first processing, for the image data of the target frame for which the image processing has been performed and to store the processed image data in the memory as output image data of the target frame.

18. A non-transitory computer readable storage medium storing a program for causing a computer to perform a control method in an image processing apparatus comprising a memory being capable of storing output image data obtained by converting image data in units of frames, the method comprising the steps of:
inputting image data of a target frame;
performing a first processing to output image data of a reference frame related to the target frame, which is stored in the memory, to change positions of pixels in the output image data;
performing image processing for the input image data of the

Assignees

• Canon Kk

Inventors

• Niwa Masashi
• Motoyama Masanao

Classifications

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/741

  by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors · CPC title

• H04N25/589

  with different integration times, e.g. short and long exposures · CPC title

• G06T2207/20208

  High dynamic range [HDR] image processing · CPC title

• G06T2207/10144

  Varying exposure · CPC title