Image processing apparatus, control method for same, and program

Patent metadata

Field	Value
Publication number	US-9380281-B2
Application number	US-201313953968-A
Country	US
Kind code	B2
Filing date	Jul 30, 2013
Priority date	Aug 13, 2012
Publication date	Jun 28, 2016
Grant date	Jun 28, 2016

Abstract

An image processing apparatus replays moving image data and includes a control unit configured to carry out control that replays the moving image data; and a generating unit configured to generate images in the case of different depths of field based on the moving image data depending on a replay speed of the moving image data.

First claim

What is claimed is:

1. An image processing apparatus that replays light-field moving image data, comprising
an operation unit configured to specify focus information of the moving image including a focal distance and a depth of field;
a control unit configured to carry out control that replays the light-field moving image data; and
a generating unit configured to obtain the focal distance and the depth of field of the focus information specified by the operation unit and light ray information that shows the intensity of the light for each frame of the light-field moving image data and direction information for the light rays, and to generate an image having a depth of field and a focal distance depending on a replay speed of the light-field moving image data by reconstructing the image using obtained light ray information,
wherein the generating unit generates a first image having a shallow depth of field based on the light-field moving image data in a case where the replay speed is less than a threshold value, and generates a second image having a deeper depth of field than the first image based on the light-field moving image data in a case where the replay speed is equal to or greater than the threshold value, and
wherein a narrower depth range of a subject is in focus in the first image and the second image is a pan-focus image.

2. The image processing apparatus according to claim 1 , wherein the control unit is configured to carry out control in which the first image and the second image are generated by the generating unit and replayed in the case in which the replay speed is equal to or greater than the threshold value.

3. The image processing apparatus according to claim 1 , wherein the control unit is configured to analyze additional information for an image signal to obtain focus information, and
wherein the generating unit generates the first image data according to focus information obtained by analyzing the additional information.

4. The image processing apparatus according to claim 1 , further comprising:
an operation unit configured to specify the replay speed,
wherein the control unit compares the replay speed specified by the operation unit with the threshold value.

5. The image processing apparatus according to claim 1 , wherein the control unit is configured to analyze a replay speed based on frame information of an image signal and compare the result of the analysis with the threshold value.

6. The image processing apparatus according to claim 1 , wherein the control unit is configured to carry out control in which, during an operation of fast forward replay, rewind replay, or scene searching, the second image is generated by the generating unit and replayed.

7. The image processing unit according to claim 1 , wherein the control unit is configured to carry out control such that the first image is generated by the generating unit and replayed in the case where a frame number of a skipped image signals during scene searching is less than a threshold value, and to carry out control such that the second image is generated by the generating unit and replayed in the case where the frame number is equal to or greater than the threshold value.

8. A control method that is executed on an image processing apparatus that replays light-field moving image data, the method comprising:
controlling to replay the light-field moving image data;
specifying focus information of the moving image including a focal distance and a depth of field:
obtaining the focal distance and the depth of field of the focus information specified by an operation unit and light ray information that shows the intensity of the light for each frame of the light-field moving image data and direction information for the light rays;
generating an image having a depth of field and a focal distance depending on a replay speed of the light-field moving image data by reconstructing the image using obtained light ray information; and
generating a first image having a shallow depth of focus based on the light-field moving image data in a generating unit in the case where the replay speed is less than a threshold value, and generating a second image having a deeper depth of field than the first image based on the light-field moving image data by the generating unit in the case where the replay speed is equal to or greater than the threshold value,
wherein a narrower depth range of a subject is in focus in the first image and in focus in the second image is a pan-focus image.

9. The control method for an image processing apparatus according to claim 8 , further comprising:
generating the first image data and the second image data by the generating unit and replaying in the case where the replay speed is equal to or greater than the threshold value.

10. The control method for an image processing apparatus according to claim 8 , further comprising:
obtaining a focal distance and a depth of field as focus information specified by an operation unit, and generating the moving image data by the generating unit.

11. The control method for an image processing apparatus according to claim 8 , further comprising:
analyzing additional information for an image signal to obtain focus information; and
generating the first image data by the generating unit according to the focus information obtained by analyzing the additional information.

12. The control method for an image processing apparatus disclosed in claim 8 , further comprising:
comparing the replay speed specified by an operation unit with the threshold value.

13. The control method for an image processing apparatus according to claim 8 , further comprising:
analyzing the replay speed based on frame information for an image signal; and
comparing the replay speed obtained by the analysis with the threshold value.

14. The control method for an image processing apparatus according to claim 8 , further comprising:
generating the second image data by the generating unit and replaying the second image data during the operation of fast forward replay, rewind replay, or scene searching.

15. The control method for an image processing apparatus according to claim 8 , further comprising:
controlling to generate the first image by the generating unit and to replay in the case where a frame number of a skipped image signal during scene searching is less than the threshold value, and
controlling to generate the second image by the generating unit and to replay the second image in the case where the frame number is equal to or greater than the threshold value.

16. A non-transitory computer-readable storage medium storing a program for causing a computer to execute the control method in an image processing apparatus that replays light-field moving image data, the method comprising:
controlling to replay the light-field moving image data;
specifying focus information of the moving image including a focal distance and a depth of field;
obtaining the focal distance and the depth of field of the focus information specified by an operation unit and light ray information that shows the intensity of the light for each frame of the light-field moving image data and direction information for the light rays;
generating an image having a depth of field and a focal distance depending on a replay speed of the light-field moving image data by reconstructing the image using obtained light ray information;
generating a first image having a shallow depth of focus based on the light-field moving image data in a case where the replay speed is less than a threshold value; and
genera

Assignees

• Canon Kk

Inventors

• Kagaya Sosuke

Classifications

• H04N9/87 Primary

  Regeneration of colour television signals (H04N9/80 takes precedence) · CPC title

• H04N13/0022

  Electricity · mapped topic

• H04N5/783 Primary

  Adaptations for reproducing at a rate different from the recording rate · CPC title

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title

• H04N21/47217

  for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312) · CPC title