Identifying items in images

Patent metadata

Field	Value
Publication number	US-10223732-B2
Application number	US-201615256048-A
Country	US
Kind code	B2
Filing date	Sep 2, 2016
Priority date	Sep 4, 2015
Publication date	Mar 5, 2019
Grant date	Mar 5, 2019

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using location data to identify and provide services in association with items appearing in captured images. One of the methods includes receiving, from a device, an image and location data representing the device's physical location, determining, based on the location data, that a particular set of one or more locations are within a threshold distance of the device's physical location, accessing, for each of the one or more locations in the particular set, item information that indicates one or more items that are associated with the location, determining, based on the accessed item information, that the image likely shows a particular item that is associated with one or more locations in the particular set, and providing, to the device, instructions for presentation of information about (i) the particular item and (ii) one or more locations in the particular set that are associated with the particular item.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving, from a device, (i) an image, and (ii) device location data;
determining, based on the device location data, that a particular set of one or more store locations are within a threshold distance of the device;
accessing, for each of the one or more store locations in the particular set, item information that indicates one or more items that are designated as being eligible for retrieval at the store location;
determining, based on the accessed item information, that the image likely shows a particular item that is designated as being eligible for retrieval at one or more store locations in the particular set;
determining, for each of the one or more store locations at which the particular item is designated as being eligible for retrieval, a predicted amount of time that a task of retrieving one or more items at the store location would take;
ranking the one or more store locations based at least on the predicted amounts of time;
generating a set of instructions for presentation of information about (i) the particular item and (ii) one or more store locations in the particular set, ordered based on the ranking, at which the particular item is designated as being eligible for retrieval; and
providing, to the device, the generated set of instructions for presentation of information about (i) the particular item and (ii) the one or more store locations in the particular set at which the particular item is designated as being eligible for retrieval.

2. The method of claim 1 ,
wherein determining, for each of the one or more store locations, a predicted amount of time that a task of retrieving one or more items at the store location would take comprises:
determining, for a first store location associated with the particular item, a first predicted amount of time that a task of retrieving one or more items at the first store location is predicted to take;
determining, for a second store location associated with the particular item, a second predicted amount of time that a task of retrieving one or more items at the second store location is predicted to take;

wherein the method further comprises:
determining that the first predicted amount of time is less than the second predicted amount of time; and

wherein ranking the one or more store locations associated with the particular item based on the predicted amounts of time comprises:
ranking the one or more store locations based on determining that the first predicted amount of time is less than the second predicted amount of time.

3. The method of claim 2 , wherein ranking the one or more store locations based on determining that the first predicted amount of time is less than the second predicted amount of time comprises:
based on determining that the first predicted amount of time is less than the second predicted amount of time, assigning the first store location a higher ranking than the second store location.

4. The method of claim 2 , further comprising:
determining, based on the device location data, that the device is located a first distance away from the first store location;
determining, based on the device location data, that the device is located a second distance away from the second store location;
determining that the first distance is greater than the second distance;
based on determining that the first predicted amount of time is less than the second predicted amount of time and determining that the first distance is greater than the second distance, determining an incentive that is to be provided for retrieving the particular item at the first store location; and
wherein providing the generated set of instructions to the device comprises:
providing, to the device, additional instructions for presentation of information about (a) the particular item, (b) the first store location, (c) the second store location, and (d) the determined incentive.

5. The method of claim 4 , further comprising:
at a particular time after providing the instructions for presentation of information to the device, receiving, from the device, updated device location data;
determining, based on the updated device location data, that the device is at the first store location; and
in response to providing the additional instructions for presentation of information to the device and determining that the device is at the first store location, providing, to the device, further instructions for presentation of one or more graphical or textual elements indicating an offer to redeem the determined incentive.

6. The method of claim 1 , further comprising:
determining, based on the device location data, that a first set of one or more store locations are within a first threshold distance of a physical location that is associated with the device;
accessing, for each of the one or more store locations in the first set, item information that indicates one or more items that are designated as being eligible for retrieval at the store location;
determining, based on the accessed item information for the one or more store locations in the first set, that the image does not satisfy a threshold likelihood for any of the one or more items that are designated as being eligible for retrieval at the one or more store locations in the first set; and
in response to determining that the image does not show any of the one or more items that are designated as being eligible for retrieval at the one or more store locations in the first set, identifying a second threshold distance that is greater than the first threshold distance, wherein determining, based on the device location data, that the particular set of one or more store locations are within the threshold distance of the device's physical location comprises:
after identifying the second threshold distance, determining, based on the device location data, that a second set of one or more store locations are within the second threshold distance of the physical location of the device, the second set of one or more store locations being different from the first set of one or more store locations.

7. The method of claim 1 , further comprising:
determining, based on the device location data, that the device is located within a geographic region that is occupied by a particular venue or park, wherein determining, based on the device location data, that the particular set of one or more store locations are within the threshold distance of a physical location of the device comprises:
determining, based on the device location data, that the particular set of one or more store locations are (i) within the threshold distance of the device's physical location, and (ii) positioned within the geographic region that is occupied by the particular venue or park.

8. The method of claim 7 , further comprising:
determining that the device is associated with a particular user; and
accessing user information indicating one or more characteristics of the particular user and a visit to the particular venue or park by the particular user.

9. The method of claim 1 , further comprising:
for each item that is associated with one or more store locations in the particular set, accessing, based on the accessed item information, imaging data that is associated with the item; and
evaluating the image against the accessed imaging data.

10. The method of claim 1 , further comprising:
after providing, to the device, instructions for presentation of information about (i) the particular item and (ii) one or more store locations in the particular set, receiving, from the device, data indicating a user selection of a particular one of the one or more store locations in

Assignees

• Accenture Global Solutions Ltd

Inventors

• Short Matthew Thomas
• Hamilton Mary Elizabeth
• Dooley Robert
• Nguyen David T
• Dang Leeann Chau Tuyet

Classifications

• G06V10/80

  Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level (multimodal speaker identification or verification G10L17/10) · CPC title

• G06F18/25

  Fusion techniques · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F16/29

  Geographical information databases · CPC title