Image section navigation from multiple images

Patent metadata

Field	Value
Publication number	US-2018300046-A1
Application number	US-201715486034-A
Country	US
Kind code	A1
Filing date	Apr 12, 2017
Priority date	Apr 12, 2017
Publication date	Oct 18, 2018
Grant date	—

Abstract

A cognitive system and method and computer program product for recommending editing recommendations to a digital image. The computer implemented method includes receiving data representing a user's selection of an object of interest within the current digital image, and a user's preference relating to editing and replacing the selected image object within a current digital image. The method cognitively maps the user's object of interest selection within the current image and the received user editing and replacing preferences to historical user editing selections and user actions associated with user selected objects of interest within digital images taken in the past. Responsive to the mapping, the methods identify a plurality of candidate digital images having similar and/or relevant objects of interest therein. One or more identified candidate digital image section having a relevant object of interest therein are identified for overlay display within the digital image.

First claim

1 . A cognitive method for editing a digital image comprising:
receiving, at a processor device, data representing a user's selection of an object of interest within a current digital image; receiving, at a processor device, data representing the user's preference relating to editing or replacing the selected object of interest within the current digital image; mapping, at said processor device, said user's object of interest selection within said current digital image and said received user editing and replacing preferences to historical user editing selections and user actions associated with user selected objects of interest within digital images taken in the past; responsive to said mapping, identifying, by said processor, a plurality of candidate digital images having similar and/or relevant objects of interest therein; and generating, for display within said digital image, one or more identified candidate digital image section having a relevant object of interest therein, each said one or more candidate digital image sections being overlayed at a location corresponding to said user selected object of interest within said current digital image.

2 . The method as claimed in claim 1 , further comprising:
generating, for display with the displayed candidate digital image, an associated navigational tool bar, said navigational tool bar embedded within a portion of the candidate digital image, said processor receiving user selections, entered via the tool bar, for navigating through the plurality of candidate digital images having similar object of interest, wherein a user can visualize and compare different candidate digital images having an object of interest for selection without having to change the underlying current digital image.

3 . The method of claim 2 , further comprising:
during said navigating, receiving, at said processor device, user commands for selecting a candidate digital image having an object image selection for replacement, and replacing, using the processor device, the user selected object of interest within said current digital image with the image of an object of interest from the selected candidate digital image to form a new composite image.

4 . The method as claimed in claim 1 , wherein said identifying comprises:
implementing, using said processor, image object analysis to identify a user's object of interest selection within the current digital image, and conducting a search for candidate digital images having a similar object of interest as specified by the user.

5 . The method as claimed in claim 1 , wherein said identifying comprises:
implementing, by said processor, facial recognition to identify a subject within the current digital image, and conducting a search for candidate digital images having said identified subject.

6 . The method as claimed in claim 1 , wherein a user preference comprises a specification of a scope of breadth search for object similarity, said identifying further comprising:
identifying, by said processor, a plurality of candidate digital images from a source of image content having similar and/or relevant objects of interest therein, said source of image content being located in a memory local to said processor or at a storage location accessible over a network.

7 . The method as claimed in claim 1 , wherein said mapping comprises:
running a model trained to correlate received user editing preferences and object of interest selection for a digital image with past selected image objects taken by that user historically with corresponding user's preferences and actions taken with respect to similar selected image objects stored in a knowledgebase; and conducting a search using the trained model for generating, by said processor, said identified said plurality of candidate digital images having a similar and/or relevant object of interest therein for display.

8 . A cognitive system for editing a digital image comprising:
a processing unit; a memory coupled to the processing unit, wherein the memory stores program instructions which, when executed by the processing unit, cause the processing unit to: receive data representing a user's selection of an object of interest within a current digital image; receive data representing the user's preference relating to editing or replacing the selected object of interest within the current digital image; map said user's object of interest selection within said current digital image and said received user editing and replacing preferences to historical user editing selections and user actions associated with user selected objects of interest within digital images taken in the past; identify, in response to said mapping, a plurality of candidate digital image images having similar and/or relevant objects of interest therein; and generate, for display within said digital image, one or more identified candidate digital image section having a relevant object of interest therein, each said one or more candidate digital image sections being overlayed at a location corresponding to said user selected object of interest within said current digital image.

9 . The cognitive system as claimed in claim 8 , wherein the program instructions, when executed by the processing unit, further cause the processing unit to:
generate for display with the displayed candidate digital image, an associated navigational tool bar, said navigational tool bar embedded within a portion of the candidate digital image, and receive user selections, entered via the tool bar, for navigating through the plurality of candidate digital photograph images having similar object of interest, wherein a user can visualize and compare different candidate digital images having an object of interest for selection without having to change the underlying current digital image.

10 . The cognitive system of claim 9 , wherein the program instructions, when executed by the processing unit, further cause the processing unit to:
during said navigating, receive user commands for selecting a candidate digital image having an object image selection for replacement, and replace the user selected object of interest within said current digital image with the image of an object of interest from the selected candidate digital image to form a new composite image.

11 . The cognitive system as claimed in claim 8 , wherein to identify, the program instructions, when executed by the processing unit, further cause the processing unit to:
implement image object analysis to identify a user's object of interest selection within the current digital image, and conduct a search for candidate digital images having a similar object of interest as specified by the user.

12 . The cognitive system as claimed in claim 8 , wherein to identify, the program instructions, when executed by the processing unit, further cause the processing unit to:
implement facial recognition to identify a subject within the current digital image, and conduct a search for candidate digital images having said identified subject.

13 . The cognitive system as claimed in claim 8 , wherein a user preference comprises a specification of a scope of breadth search for object similarity, wherein to identify, the program instructions, when executed by the processing unit, further cause the processing unit to:
identify a plurality of candidate digital images from a source of image content having similar and/or relevant objects of interest therein, said source of image content being located in a memory local to said processor or at a storage location accessible over a network.

14 . The cognitive syste

Assignees

• IBM

Inventors

• Goyal Munish
• Leung Wing L
• Rakshit Sarbajit K
• Greene Starks Kimberly

Classifications

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06N20/00 Primary

  Machine learning · CPC title

• G06F16/532

  Query formulation, e.g. graphical querying · CPC title

• G06F3/04847 Primary

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title

• G11B27/034

  on discs (G11B27/036, G11B27/038 take precedence) · CPC title