Drawing based search queries

Patent metadata

Field	Value
Publication number	US-9507805-B1
Application number	US-201514684603-A
Country	US
Kind code	B1
Filing date	Apr 13, 2015
Priority date	Jun 12, 2012
Publication date	Nov 29, 2016
Grant date	Nov 29, 2016

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing drawing-based search queries. In one aspect, a method includes receiving search request data specifying a search request, the search request comprising a drawing represented by a set of line strokes, each line stroke representing a trace of a moving input point; identifying line segments from the line strokes; comparing the identified line segments to reference line segments, each of the reference line segments representing a portion of a corresponding reference drawing; identifying a candidate reference drawing based on the comparison of the identified line segments with reference line segments; identifying a keyword for the candidate reference drawing, the keyword being a term determined to be relevant to a subject matter of the candidate reference drawing; and in response to receiving the search request, providing search results data specifying search results responsive to the keyword.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
receiving, by a computing system, a search request that identifies an image;
comparing, by the computing system, the image that is identified by the search request to multiple candidate images in order to identify a particular image of the multiple candidate images that matches the image that is identified by the search request;
identifying, by the computing system, a keyword that has been determined to be relevant to the particular image of the multiple candidate images; and
providing, by the computing system in response to the computing system having received the search request that identifies the image, multiple search results that are responsive to the keyword, wherein providing the multiple search results that are responsive to the keyword is performed by the computing system without user intervention after the computing system receives the search request.

2. The computer-implemented method of claim 1 , wherein the image that is identified by the search request is a photograph.

3. The computer-implemented method of claim 1 , wherein:
the image that is identified by the search request includes information that identifies a drawing that was sketched by user input at a computing device, and
providing the multiple search results includes providing the multiple search results to the computing device.

4. The computer-implemented method of claim 1 , wherein:
the search request was specified by user input at a computing device, and
providing the multiple search results includes providing the multiple search results to the computing device.

5. The computer-implemented method of claim 1 , wherein comparing the image that is identified by the search request to the multiple candidate images includes generating, for each of the multiple candidate images, a score that represents similarity between the respective candidate image and the image that is identified by the search request.

6. The computer-implemented method of claim 1 , wherein the multiple search results include textual search results that each identify a title of a web page and a portion of text extracted from the web page.

7. The computer-implemented method of claim 1 , wherein identifying the keyword includes identifying the keyword in anchor text from a web page that links to the particular image of the multiple candidate images.

8. A computer-implemented method, comprising:
receiving, by a computing system, a search request that identifies an image;
comparing, by the computing system, the image that is identified by the search request to multiple candidate images in order to identify a particular image of the multiple candidate images that matches the image that is identified by the search request;
identifying, by the computing system, a first keyword that has been determined to be relevant to the particular image of the multiple candidate images;
identifying, by the computing system, a second keyword that has been determined to be relevant to the particular image of the multiple candidate images;
providing, by the computing system in response to the computing system having received the search request that identifies the image, multiple search results that are responsive to the first keyword;
providing, by the computing system, the second keyword for selection on a search results page on which the multiple search results are presented;
receiving, by the computing system, an indication that user input selected the second keyword that was presented on the search results page; and
providing, by the computing system in response to receiving the indication that user input selected the second keyword, multiple second search results that are responsive to the second keyword.

9. A computer-implemented method, comprising:
receiving, by a computing system, a search request that identifies an image;
comparing, by the computing system, the image that is identified by the search request to multiple candidate images in order to identify a particular image of the multiple candidate images that matches the image that is identified by the search request;
identifying, by the computing system, a keyword that has been determined to be relevant to the particular image of the multiple candidate images,
wherein identifying the keyword that has been determined to be relevant to the particular image of the multiple candidate images includes identifying a keyword that was assigned to the particular image of the multiple candidate images because the keyword was used as a term in a search query for which the particular image of the multiple candidate images was (i) presented as a search result that was responsive to submission of the search query and (ii) selected by user input upon presentation as the search result; and
providing, by the computing system in response to the computing system having received the search request that identifies the image, multiple search results that are responsive to the keyword.

10. A system comprising:
one or more data processors; and
a computer storage apparatus comprising instructions executable by the one or more data processors which, upon such execution, cause the one or more data processors to perform operations comprising:
receiving, by a computing system, a search request that identifies an image;
comparing, by the computing system, the image that is identified by the search request to multiple candidate images in order to identify a particular image of the multiple candidate images that matches the image that is identified by the search request;
identifying, by the computing system, a keyword that has been determined to be relevant to the particular image of the multiple candidate images; and
providing, by the computing system in response to the computing system having received the search request that identifies the image, multiple search results that are responsive to the keyword, wherein providing the multiple search results that are responsive to the keyword is performed by the computing system without user intervention after the computing system receives the search request.

11. The system of claim 10 , wherein the image that is identified by the search request is a photograph.

12. The system of claim 10 , wherein:
the image that is identified by the search request includes information that identifies a drawing that was sketched by user input at a computing device, and
providing the multiple search results includes providing the multiple search results to the computing device.

13. The system of claim 10 , wherein:
the search request was specified by user input at a computing device, and
providing the multiple search results includes providing the multiple search results to the computing device.

14. The system of claim 10 , wherein comparing the image that is identified by the search request to the multiple candidate images includes generating, for each of the multiple candidate images, a score that represents similarity between the respective candidate image and the image that is identified by the search request.

15. The system of claim 10 , wherein the multiple search results include textual search results that each identify a title of a web page and a portion of text extracted from the web page.

16. The system of claim 10 , wherein identifying the keyword includes identifying the keyword in anchor text from a web page that links to the particular image of the multiple candidate images.

17. A system comprising:
one or more data processors; and
a computer storage apparatus comprising instructions e

Assignees

• Google Inc

Inventors

• Chechik Gal

Classifications

• G06F17/30047

  Physics · mapped topic

• G06F17/3053

  Physics · mapped topic

• G06F17/30277 Primary

  Physics · mapped topic

• G06F17/30247

  Physics · mapped topic

• G06F16/434

  using image data, e.g. images, photos, pictures taken by a user · CPC title