Image processing apparatus, method, and program product for embedding corresponding information in an area overlapping a recognized object

Patent metadata

Field	Value
Publication number	US-11245810-B2
Application number	US-202017111054-A
Country	US
Kind code	B2
Filing date	Dec 3, 2020
Priority date	Dec 9, 2019
Publication date	Feb 8, 2022
Grant date	Feb 8, 2022

Abstract

An object of the present disclosure is to reduce the load of a user in a case where multiplexed information is embedded in an image. One embodiment of the present invention is an image processing apparatus having: a recognition unit configured to recognize an object within an image; a selection unit configured to select additional information corresponding to an object recognized by the recognition unit from among additional information stored in a storage unit; and a layout unit configured to lay out the additional information so that at least a part of an area in which additional information selected by the selection unit is embedded overlaps an area of an object recognized by the recognition unit.

First claim

What is claimed is:

1. An image processing apparatus comprising:
a recognition unit configured to recognize an object within an image;
a selection unit configured to select additional information corresponding to an object recognized by the recognition unit from among additional information stored in a storage unit; and
a layout unit configured to lay out the additional information so that at least a part of an area in which additional information selected by the selection unit is embedded overlaps an area of an object recognized by the recognition unit.

2. The image processing apparatus according to claim 1 , wherein
in the storage unit, association information for associating recognition results by the recognition unit and additional information with each other is stored.

3. The image processing apparatus according to claim 1 , wherein
in a case where additional information corresponding to an object recognized by the recognition unit is not stored in the storage unit, selection of additional information by the selection unit is not performed.

4. The image processing apparatus according to claim 1 , wherein
the selection unit selects the additional information based on recognition results of a kind of object by the recognition unit and information relating to the object other than information on the kind of object.

5. The image processing apparatus according to claim 4 , wherein
information relating to the object other than information on the kind of object includes at least one of a kind of object, a number of objects, an object size, and an object position.

6. The image processing apparatus according to claim 1 , wherein
in a case of laying out additional information in a plurality of areas, the layout unit adjusts a position at which additional information is laid out so that an overlap of additional information does not occur.

7. The image processing apparatus according to claim 1 , further comprising:
a presentation unit configured to present one or a plurality of additional information candidates corresponding to an object recognized by the recognition unit to a user, wherein
the selection unit selects additional information in accordance with an input of the user.

8. The image processing apparatus according to claim 1 , further comprising:
a presentation unit configured to present results of being laid out by the layout unit to a user, wherein
it is possible for the user to select again an additional information embedding position or perform adjustment manually.

9. The image processing apparatus according to claim 1 , further comprising:
a generation unit configured to automatically generate information to be stored in the storage unit based on information including an image, a kind of object, and information corresponding to the additional information in a set.

10. An image processing method comprising:
recognizing an object within an image;
selecting additional information corresponding to the recognized object from among additional information stored in a storage unit; and
laying out the additional information so that at least a part of an area in which the selected additional information is embedded overlaps an area of the recognized object.

11. The image processing method according to claim 10 , wherein
association information for associating the recognized results and additional information with each other is stored.

12. The image processing method according to claim 10 , wherein
in a case where additional information corresponding to the recognized object is not stored, selection of the additional information is not performed.

13. The image processing method according to claim 10 , wherein
the additional information is selected based on recognition results of the kind of object and information relating to the object other than information on the kind of object.

14. The image processing method according to claim 13 , wherein
information relating to the object other than information on the kind of object includes at least one of a kind of object, a number of objects, an object size, and an object position.

15. The image processing method according to claim 10 , wherein
in a case where additional information is laid out in a plurality of areas, a position at which additional information is laid out is adjusted so that an overlap of additional information does not occur.

16. The image processing method according to claim 10 , further comprising:
presenting one or a plurality of additional information candidates corresponding to the recognized object to a user, wherein
additional information in accordance with an input of the user is selected.

17. The image processing method according to claim 10 , further comprising:
presenting results of being laid out to a user, wherein
it is possible for the user to select again an additional information embedding position or perform adjustment manually.

18. The image processing method according to claim 10 , further comprising:
automatically generating the information to be stored based on information including an image, a kind of object, and information corresponding to the additional information in a set.

19. A non-transitory computer readable storage medium storing a program for causing a computer to perform an image processing method comprising:
recognizing an object within an image;
selecting additional information corresponding to a recognized object from among additional information stored in a storage unit; and
laying out the additional information so that at least a part of an area in which selected additional information is embedded overlaps an area of a recognized object.

Assignees

• Canon Kk

Inventors

• Mizoguchi Yoshinori
• Ogawa Hiroaki
• Goto Fumitaka
• Sakai Hiroyuki
• Yamaguchi Hiromitsu
• Doi Tsukasa
• Sasaki Takeru

Classifications

• H04N1/3871

  the composed originals being of different kinds, e.g. low- and high-resolution originals · CPC title

• H04N1/32219 Primary

  involving changing the position of selected pixels, e.g. word shifting, or involving modulating the size of image components, e.g. of characters (H04N1/32224 takes precedence) · CPC title

• H04N1/32229

  with selective or adaptive application of the additional information, e.g. in selected regions of the image (H04N1/32213 takes precedence) · CPC title

• H04N1/32352 Primary

  Controlling detectability or arrangements to facilitate detection or retrieval of the embedded information, e.g. using markers (for decoding, detection or retrieval operations H04N1/32149 and subgroups take precedence) · CPC title

• H04N2201/3225

  of data relating to an image, a page or a document · CPC title