Establishment anchoring with geolocated imagery

Patent metadata

Field	Value
Publication number	US-11232149-B2
Application number	US-201916520998-A
Country	US
Kind code	B2
Filing date	Jul 24, 2019
Priority date	Aug 3, 2015
Publication date	Jan 25, 2022
Grant date	Jan 25, 2022

Abstract

The technology relates to determining an establishment's presence at a geolocation. A computing device may receive a first image including location data associated with the first image's capture. A set of images, which include location information and one or more identification marks associated with one or more establishments may also be received. The computing device may compare the first image to the set of images to determine whether the first image contains one of the one or more identification marks, and determine that one of the one or more establishments, associated with the one of the one or more identification marks contained in the first image, is currently located within a set proximity of the first image location. The computing device may also update a location database by associating the one of the one or more establishments with a location within a set proximity of the first image location.

First claim

The invention claimed is:

1. A computer implemented method for determining and updating an establishment's presence at a geographic location, the method comprising:
receiving, with one or more processing devices, a first image including location data, wherein the location data includes a first image location;
generating, with the one or more processing devices, one or more variants of the first image;
receiving a collection of images;
assigning a label to each image in the collection of images which contain at least one identification mark;
receiving, with the one or more processing devices, a set of one or more images from the collection of images, wherein each image of the set of images includes one or more identification marks and at least one label, wherein each identification mark is associated with one or more establishments;
performing an image-in-image search for a matching identification mark between the first image and at least one of the one or more variants, and at least one image in the set of images;
determining, by the one or more processing devices, based on the image-in-image search that the first image or at least one of the one or more variants contains at least one matching identification mark with an image in the set of images;
determining, by the one or more processing devices, that the first image location is within a set proximity of a listed location retrieved from an authoritative webpage, wherein the authoritative webpage is the webpage of the one or more establishments associated with the at least one matching identification mark; and
updating, by the one or more processing devices, a location database by associating the one or more establishments associated with the matching identification mark with the first image location upon determining that the first image location is within the set proximity of the listed location on the authoritative webpage.

2. The method of claim 1 , wherein the one or more variants of the first image include:
a high-contrast version of the first images;
a color inverted version of the first images;
a black and white version of the first images; and/or
a black and white inverted version of the first images.

3. The method of claim 1 , wherein the listed location retrieved from the authoritative webpage includes an address.

4. The method of claim 1 , wherein the first image geographic location information includes a longitude and latitude reading corresponding to a location the first image was captured.

5. The method of claim 1 , wherein determining that the first image location is within the set proximity of the listed location includes determining the first image location is within a set radius of the listed location.

6. A system for determining and updating an establishment's presence at a geographic location, the system comprising:
one or more computing devices having one or more processors; and
memory storing instructions, the instructions executable by the one or more processors;
wherein the instructions comprise:
receiving a first image including location data, wherein the location data includes a first image location;
generating one or more variants of the first image;
receiving a collection of images;
assigning a label to each image in the collection of images which contain at least one identification mark;
receiving a set of one or more images from the collection of images, wherein each image of the set of images includes one or more identification marks and at least one label, wherein each identification mark is associated with one or more establishments;
performing an image-in-image search for a matching identification mark between the first image and at least one of the one or more variants, and at least one image in the set of images;
determining based on the image-in-image search that the first image or at least one of the one or more variants contains at least one matching identification mark with an image in the set of images;
determining that the first image location is within a set proximity of a listed location retrieved from an authoritative webpage, wherein the authoritative webpage is the webpage of the one or more establishments associated with the at least one matching identification mark; and
updating a location database by associating the one or more establishments associated with the matching identification mark with the first image location upon determining that the first image location is within the set proximity of the listed location on the authoritative webpage.

7. The system of claim 6 , wherein the one or more variants of the first image include:
a high-contrast version of the first images;
a color inverted version of the first images;
a black and white version of the first images; and/or
a black and white inverted version of the first images.

8. The system of claim 6 , wherein the listed location retrieved from the authoritative webpage includes an address.

9. The system of claim 6 , wherein the first image geographic location information includes a longitude and latitude reading corresponding to a location the first image was captured.

10. The system of claim 6 , wherein determining that the first image location is within the set proximity of the listed location includes determining the first image location is within a set radius of the listed location.

11. A non-transitory computer-readable medium storing instructions, which when executed by one or more processors, cause the one or more processors to:
receive a first image including location data, wherein the location data includes a first image location;
generate one or more variants of the first image;
receive a collection of images;
assign a label to each image in the collection of images which contain at least one identification mark;
receive a set of one or more images from the collection of images, wherein each image of the set of images includes one or more identification marks and at least one label, wherein each identification mark is associated with one or more establishments;
perform an image-in-image search for a matching identification mark between the first image and at least one of the one or more variants, and at least one image in the set of images;
determine based on the image-in-image search that the first image or at least one of the one or more variants contains at least one matching identification mark with an image in the set of images;
determine that the first image location is within a set proximity of a listed location retrieved from an authoritative webpage, wherein the authoritative webpage is the webpage of the one or more establishments associated with the at least one matching identification mark; and
update a location database by associating the one or more establishments associated with the matching identification mark with the first image location upon determining that the first image location is within the set proximity of the listed location on the authoritative webpage.

12. The non-transitory computer-readable medium of claim 11 , wherein the one or more variants of the first image include:
a high-contrast version of the first images;
a color inverted version of the first images;
a black and white version of the first images; and/or
a black and white inverted version of the first images.

13. The non-transitory computer-readable medium of claim 11 , wherein the listed location retrieved from the authoritative webpage includes an address.

14. The non-transitory computer-readable medium of claim 11 , wherein determining that the first image location is within the set proximity of the listed location include

Assignees

• Google Llc

Inventors

• Brewington Brian Edmond
• Johnson Kirk

Classifications

• G06F16/951

  Indexing; Web crawling techniques · CPC title

• G06V20/10 Primary

  Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) · CPC title

• G06V2201/10

  Recognition assisted with metadata · CPC title

• G06V2201/09

  Recognition of logos · CPC title

• G06F16/29

  Geographical information databases · CPC title