Image processing apparatus and method with selection of image including first and second objects more preferentially than image including first but not second object

Patent metadata

Field	Value
Publication number	US-10740641-B2
Application number	US-201715828698-A
Country	US
Kind code	B2
Filing date	Dec 1, 2017
Priority date	Dec 9, 2016
Publication date	Aug 11, 2020
Grant date	Aug 11, 2020

Abstract

At least one apparatus recognizes a first object and a second object associated with the first object in a plurality of images, calculates a score for each of the plurality of images based on a result of the recognition of the first object and the second object, and selects an image concerning the first object from the plurality of images based on the score for each of the plurality of images.

First claim

What is claimed is:

1. An image processing apparatus comprising:
an obtaining unit configured to obtain an image;
an acceptance unit configured to accept a designation of a predetermined mode by a user operation;
a determination unit configured to determine whether or not a first object and a second object associated with the first object are included in the obtained image in a case where the designation of the predetermined mode is accepted;
a selection unit configured to perform, in a case where it is determined that the first object and the second object are included in the obtained image, selection of an image such that an image including the first object and the second object is selected more preferentially than an image that includes the first object but does not include the second object; and
a layout unit configured to lay out the selected image,
wherein the obtaining unit, the acceptance unit, the determination unit, the selection unit, and the layout unit are implemented by at least one processor of the image processing apparatus.

2. The apparatus according to claim 1 , wherein, in a case where it is determined in the determination unit that the second object is included in the obtained image, the selection unit (a) determines a score for the obtained image based on the first object and the second object, and (b) selects an image based on the score.

3. The apparatus according to claim 2 , wherein, in a case where it is determined in the determination unit that the second object is included in the obtained image, the selection unit determines the score based on a positional relationship in the obtained image between the first object and the second object.

4. The apparatus according to claim 2 , wherein, in a case where it is determined in the determination unit that the second object is included in the obtained image, the selection unit determines the score based on an edge amount detected in each of the first object and the second object.

5. The apparatus according to claim 4 , wherein the score for an image with a higher edge amount for the first object and a lower edge amount for the second object is increased.

6. The apparatus according to claim 2 , wherein, in a case where it is determined in the determination unit that the second object is included in the obtained image, the selection unit determines the score based on a direction of each of the first object and the second object.

7. The apparatus according to claim 6 , wherein the selection unit determines the score such that an image, in which a direction of a face of the first object and a direction of a face of the second object face each other, is preferentially selected.

8. The apparatus according to claim 1 , further comprising an output unit configured to output an area for printing in which the selected image is laid out, wherein the output unit is implemented by the at least one processor of the image processing apparatus.

9. The apparatus according to claim 1 , wherein the selected image is assigned to a double page spread area in an album.

10. The apparatus according to claim 1 , wherein the predetermined mode is a pet priority mode.

11. A method comprising:
obtaining an image;
accepting a designation of a predetermined mode by a user operation;
determining whether a first object and a second object associated with the first object are included in the obtained image in a case where the designation of the predetermined mode is accepted;
performing, in a case where it is determined that the first object and the second object are included in the obtained image, selection of an image such that an image including the first object and the second object is selected more preferentially than an image that includes the first object but does not include the second object; and
laying out the selected image.

12. The method according to claim 11 , wherein, in a case where it is determined that the second object is included in the obtained image, (a) a score for the obtained image is determined based on an edge amount detected in each of the first object and the second object, and (b) an image is selected based on the score, and
wherein the score for an image with a higher edge amount for the first object and a lower edge amount for the second object is increased.

13. The method according to claim 11 , wherein, in a case where it is determined that the second object is included in the obtained image, (a) a score for the obtained image is determined based on a direction of each of the first object and the second object, and (b) an image is selected based on the score, and
wherein the score is determined such that an image, in which a direction of a face of the first object and a direction of a face of the second object face each other, is preferentially selected.

14. The method according to claim 11 , wherein the selected image is assigned to a double page spread area in an album.

15. The method according to claim 11 , wherein the predetermined mode is a pet priority mode.

Assignees

• Canon Kk

Inventors

• Iguchi Ryosuke
• Hori Shinjiro
• Kunieda Hiroyasu
• Obayashi Masaaki

Classifications

• G06V20/35 Primary

  Categorising the entire scene, e.g. birthday party or wedding scene · CPC title

• G06V10/768

  using context analysis, e.g. recognition aided by known co-occurring patterns · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06T7/136

  involving thresholding · CPC title

• G06T7/13

  Edge detection · CPC title