System for associating tag information with images supporting image feature search

Patent metadata

Field	Value
Publication number	US-9563818-B2
Application number	US-201314083773-A
Country	US
Kind code	B2
Filing date	Nov 19, 2013
Priority date	Nov 20, 2012
Publication date	Feb 7, 2017
Grant date	Feb 7, 2017

Abstract

A system derives and associates tag information with an image supporting image feature search. The system receives arrangement search information used for searching for one or more images including a target object associated with a specific arrangement of tag information. The system analyzes the tag information of the images, and searches for an image having the arrangement information which satisfies the arrangement search information.

First claim

What is claimed is:

1. An image searching method, comprising:
storing tag information for a plurality of images, the tag information including arrangements of target names and target areas, the target names identifying target objects and the target areas indicating regions of respective images in which the target objects are disposed;
before displaying any of the plurality of images, displaying a grid on a display, the grid partitioning a screen of the display into a plurality of display areas;
before executing any searching, receiving inputs defining a target arrangement for candidate images, the inputs including:
a search area designated by selection of one or more display areas of the grid, the selected one or more display areas indicating by disposition in the grid a region where a searched-for object is disposed within the candidate images, and
a search word indicating a name of the searched-for object disposed in the search area; and

searching, by a processor, for the candidate images from among the plurality of images having tag information in which a corresponding arrangement matches the target arrangement, including a target name matching the search word disposed in a target area matching the search area; and
providing the candidate images.

2. The method of claim 1 ,
wherein displaying the grid comprises lines visually demarcating the plurality of display areas.

3. The method of claim 2 , wherein the selected at least one of the plurality of display areas is defined using two sets of coordinates identifying two vertices bounding the selected at least one of the plurality of display areas, and
wherein display of the selected one or more display areas is visually altered in response to the selection to indicate the selection.

4. The method of claim 1 , wherein receiving the input further includes selection of multiple display areas of the plurality of display areas.

5. An image and image metadata searching apparatus, comprising:
an input unit;
a memory storing tag information for a plurality of images, the tag information including arrangements of target names and target areas, the target names identifying target objects, and the target areas indicating regions of respective images in which the target objects are disposed;
a display; and
at least one processor operatively coupled to the memory, configured to:
before displaying any of the plurality of images, control the display to display a grid partitioning a screen of the display into a plurality of display areas,
before executing any searching, receiving, by the input unit, inputs defining a target arrangement for candidate images, the inputs including:
a search area designated by selection of one or more display areas of the grid indicating by disposition in the grid a region where a searched-for object is disposed within the candidate images, and
a search word indicating a name of the searched-for object disposed in the search area,

searching for candidate images from among the plurality of images having tag information in which a corresponding arrangement matches the target arrangement, including a target name matching the search word disposed in a target area matches the search area, and
control the display to display search results identifying the candidate images.

6. The apparatus of claim 5 ,
wherein the grid comprises lines visually demarcating the plurality of display areas.

7. The apparatus of claim 6 , wherein the selected at least one of the plurality of display areas is defined using two sets of coordinates identifying two vertices bounding the selected at least one of the plurality of display areas, and
wherein the one or more display areas is visually altered in response to the selection to indicate the selection.

8. The apparatus of claim 5 , wherein receiving the input further includes selection of multiple display areas of the plurality of display areas as the search area.

9. An image searching method, comprising:
storing tag information for a plurality of images, the tag information including arrangements of target names and target areas, the target names identifying target objects, and the target areas indicating regions of respective images in which the target objects are disposed;
before displaying any of the plurality of images, displaying, by a display, a grid partitioning a screen of the display into a plurality of display areas;
before executing any searching, receiving, by an input unit, inputs defining a target arrangement including:
a search area designated by selection of one or more display areas of the grid, the selected one or more display areas indicating by disposition in the grid where a searched-for object is disposed within candidate images, and
a search word indicating a name of the searched-for object disposed in the search area; and

searching, via at least one processor, for the candidate images from among the plurality of images having tag information in which a corresponding arrangement matches the target arrangement including a target name matching the search word disposed in a target area matching the search area.

10. An image and image metadata searching apparatus, comprising:
an input unit;
a memory storing tag information for a plurality of images, the tag information including arrangements of target names and target areas, the target names identifying target objects, and the target areas indicating regions of respective images in which the target objects are disposed;
a display; and
at least one processor operatively coupled to the memory, configured to:
before displaying any of the plurality of images, control the display to display a grid partitioning a screen of the display into a plurality of display areas that are uniform and of a predetermined number, and receive, by the input unit, inputs defining a target arrangement including a search area indicated by selection of one or more display areas of the grid, and a search word for the search area,
searching, by a processor, for candidate images from among the plurality of images having particular tag information in which a corresponding arrangement matches the target arrangement including a target name matching the search word and the target area matching the search area, and
control the display to display search results identifying the candidate images.

11. An image searching method, comprising:
storing tag information for a plurality of images, the tag information including arrangements of target names and target areas, the target names identifying target objects, and the target areas indicating regions of respective images in which the target objects are disposed;
before displaying any of the plurality of images, displaying, by a display, a grid partitioning a screen of the display into a plurality of display areas;
before executing any searching, receiving inputs defining a target arrangement for candidate images, including:
a search area indicated by selection of one or more display areas of the grid, the selected one or more display areas indicating by disposition in the grid a region where a searched-for object is disposed within the candidate images, and
a search word indicating a name of the searched-for object disposed in the search area;

searching, via a processor, for the candidate images from among the plurality of images having particular tag information in which a corresponding arrangement matches the target arrangement including a target name matching the search word disposed in a target area matching the search area; and
displaying at least one candidate image identified by the searching as a search result.

12. The method of claim 11 , whe

Assignees

• Samsung Electronics Co Ltd

Inventors

• Hwang Min-Kyung
• Kang Doo-Suk
• Yim Sae-Mee
• Jung Eui-Chang
• Choi Bo-Kun

Classifications

• G06F16/58 Primary

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F16/5838

  using colour · CPC title

• G06F17/30265

  Physics · mapped topic

• G06K9/6202 Primary

  Physics · mapped topic

• G06F17/30256

  Physics · mapped topic