Image processing apparatus, method for controlling image processing apparatus and storage medium

Patent metadata

Field	Value
Publication number	US-9609206-B2
Application number	US-201514673741-A
Country	US
Kind code	B2
Filing date	Mar 30, 2015
Priority date	Mar 31, 2014
Publication date	Mar 28, 2017
Grant date	Mar 28, 2017

Abstract

An image processing apparatus includes an identification unit configured to identify an object in image data, an acquisition unit configured to acquire position information indicating a position of the object, a setting unit configured to set, based on the position information of the object, a movable range in which a position of the virtual illumination can be set, a specified position acquisition unit configured to acquire a specified position input by a user on a display screen, a determination unit configured to determine the position of the virtual illumination based on the movable range and the specified position, and a lighting processing unit configured to execute lighting processing on the object in the image data based on the position of the virtual illumination determined by the determination unit.

First claim

What is claimed is:

1. An image processing apparatus for using virtual illumination to perform lighting processing on image data displayed on a display screen, the image processing apparatus comprising:
a memory for storing data; and
at least one processor coupled to the memory, the at least one processor operating to:
identify an object in the image data;
acquire position information indicating a position of the object in a three-dimensional space;
set, based on the position information of the object, a movable range in the three-dimensional space in which a position of the virtual illumination can be set;
acquire a specified position input by a user on the display screen;
determine the position of the virtual illumination based on the movable range and the specified position; and
perform lighting processing on the object in the image data based on the position of the virtual illumination determined by the at least one processor.

2. The image processing apparatus according to claim 1 , wherein the at least one processor sets a size of the movable range based on shape information of the object.

3. The image processing apparatus according to claim 2 , wherein the at least one processor sets, as the movable range of the virtual illumination, an ellipsoid centered about a coordinate position corresponding to the position information of the object and having radiuses set based on the shape information of the object.

4. The image processing apparatus according to claim 1 , wherein a moving amount from a first position of the virtual illumination corresponding to a first specified position acquired by the at least one processor to a second position of the virtual illumination corresponding to a second specified position in the three-dimensional space different from the first specified position varies depending on the position of the object.

5. The image processing apparatus according to claim 1 , wherein the at least one processor sets a size of the movable range of the virtual illumination based on a size of the object.

6. The image processing apparatus according to claim 1 , wherein the at least one processor further determines an orientation of the virtual illumination based on the specified position.

7. The image processing apparatus according to claim 1 , wherein the at least one processor receives a drag operation from the user and acquires an end position of the drag operation as the specified position.

8. The image processing apparatus according to claim 1 , wherein the at least one processor receives a drag operation from the user, and acquires as the specified position a result of periodically detecting a position touched by a user.

9. An image processing method for using virtual illumination to perform lighting processing on image data displayed on a display screen, the image processing method comprising:
identifying an object in the image data;
acquiring position information indicating a position of the object in a three-dimensional space;
setting, based on the position information of the object, a movable range in the three-dimensional space in which a position of the virtual illumination can be set;
acquiring a specified position input by a user on the display screen;
determining the position of the virtual illumination based on the movable range and the specified position; and
performing lighting processing on the object in the image data based on the determined position of the virtual illumination.

10. A non-transitory computer-readable storage medium storing a program that is read and executed by a computer to cause the computer to perform a method, the method comprising:
identifying an object in the image data;
acquiring position information indicating a position of the object in a three-dimensional space;
setting, based on the position information of the object, a movable range in the three-dimensional space in which a position of the virtual illumination can be set;
acquiring a specified position input by a user on the display screen;
determining the position of the virtual illumination based on the movable range and the specified position; and
performing lighting processing on the object in the image data based on the determined position of the virtual illumination.

Assignees

• Canon Kk

Inventors

• Nakada Yuichi

Classifications

• H04N5/2621

  Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• H04N9/646

  for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters · CPC title

• G06T15/50 Primary

  Lighting effects · CPC title