Provide a recommendation for garden items

Patent metadata

Field	Value
Publication number	US-9779442-B1
Application number	US-201414303445-A
Country	US
Kind code	B1
Filing date	Jun 12, 2014
Priority date	Jun 12, 2014
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

Techniques for identifying and recommending garden items may be provided. For example, image and non-image data about a garden may be received and analyzed. Identifications of garden items from the garden and related constraints may be determined accordingly. The identifications and the constraints may be used to recommend uses of the garden items and/or to recommend additional garden items that may be ordered and used in conjunction with the garden items.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
receiving, by a computer system from a computing device of a user, an image and cardinal directions of the image associated with a gardening space;
identifying, by the computer system, a plant and an object in the gardening space based at least in part on the image, wherein the plant and the object are identified by at least:
classifying content of the image between a plant classification and an object classification,
for first content of the image classified under the plant classification and corresponding to at least a portion the plant, identifying a type of the plant based at least in part on an application of an image recognition algorithm to the first content and on a result of a query to a database that stores information about plants, the application of the image recognition algorithm comprising:
identifying a factor associated with the type of the plant based at least in part on a frequency of the factor appearing in the first content, and
determining a weight of the factor based at least in part on a confidence measure of the image recognition algorithm,

the query to the database generated based at least in part on the factor, and the result of the query weighted based at least in part on the weight of the factor; and

querying, by the computer system, the database based at least in part on the type of the plant to determine a gardening parameter;
determining, by the computer system, a constraint associated with the plant based at least in part on the gardening parameter and the object, the constraint limiting recommendations of items for use in association with a use of the plant;
generating, by the computer system, an interactive virtual space that corresponds to the gardening space by at least:
assembling and orienting the image with other images of the gardening space based at least in part on the cardinal directions of the image,
adding, to the interactive virtual space, an interactive first tag corresponding to the plant and an interactive second tag corresponding to the object, and
adding, to the interactive virtual space, a visual effect that corresponds to the constraint;

providing, by the computer system to the computing device of the user, instructions to present the interactive virtual space and a recommendation to order an item from an electronic marketplace based at least in part on the constraint and the plant, the recommendation identifying the item and an association of the item with the plant, the instructions causing the computing device to present the interactive virtual space and the recommendation and to provide a drag and drop operation to add the item to the interactive virtual space; and
updating, by the computer system, the interactive virtual space based at least in part on a use of the drag and drop operation to add the item, the updating comprising adding, to the interactive virtual space, the first interactive tag that corresponds to the item.

2. The computer-implemented method of claim 1 , wherein the recommendation further identifies a plurality of items associated with a recipe, the recipe including at least a portion of the plant as an ingredient.

3. The computer-implemented of claim 1 , further comprising: for second content of the image classified under the object classification and corresponding to at least a portion of the object, recognizing the object based at least in part on an application of a different image recognition algorithm to the second content.

4. The computer-implemented of claim 1 , further comprising: updating, by the computer system, a record in a database associated with recommendations, the record updated based at least in part on the use of the drag and drop operation, the record tracking a selection of the item from the recommendations.

5. A system, comprising:
a memory configured to store computer-executable instructions; and
a processor configured to access the memory and execute the computer-executable instructions to collectively at least:
receive, from a computing device of a user, information about a physical space for growing items, the information comprises an image of the physical space and cardinal directions of the image;
identify a garden item growing in the physical space by at least:
identifying a type of the garden item based at least in part on an application of an image recognition algorithm to content of the image and on a result of a query to a database that stores information about garden items, the application of the image recognition algorithm comprising:
identifying a factor associated with the type of the garden item based at least in part on a frequency of the factor appearing in the content, and
determining a weight of the factor based at least in part on a confidence measure of the image recognition algorithm,
the query to the database generated based at least in part on the factor, and the result of the query weighted based at least in part on the weight of the factor; and

querying the database based at least in part on the type of the garden item to determine a gardening parameter;

determine a constraint associated with the garden item based at least in part on the gardening parameter, the constraint limiting recommendations of items for use in association with a use of the garden item;
generate an interactive virtual space that corresponds to the physical space by at least:
assembling and orienting the image with a plurality of images of the physical space based at least in part on the cardinal directions of the image,
adding, to the interactive virtual space, an interactive tag corresponding to the garden item, and
adding, to the interactive virtual space, a visual effect that corresponds to the constraint;

provide, the computing device, instructions to present the interactive virtual space, a recommendation to order an item from an electronic marketplace based at least in part on the garden item and the constraint, and a selection operation to add the item to the interactive virtual space, the interactive virtual space comprising a second interactive tag that corresponds to the item; and
update the interactive virtual space based at least in part on a use of the selection operation to add the item, the updating comprising adding, to the interactive virtual space, the second interactive tag that corresponds to the item.

6. The system of claim 5 , wherein the information about the physical space comprises the plurality of images of the physical space.

7. The system of claim 6 , wherein identifying the garden item and the constraint comprises:
determining the factor associated with the type of the garden item based at least in part on analyzing the plurality of images.

8. The system of claim 7 , wherein the information further comprises cardinal directions associated with the plurality of images and a location of the physical space, and wherein determining the constraint further comprises:
determining an object in the physical space based at least in part on analyzing the plurality of images;
determining a sunlight condition and a shade zone based at least in part on the object, the location, and the cardinal directions associated with the plurality of images; and
setting the constraint as at least one of the sunlight condition or the shade zone.

9. The system of claim 5 , wherein the constraint is further associated with at least one of the space or the user, wherein a garden item constraint limits the recommendation to order the item based at least in part on a compatibility between the garden item and the item, wherein a space constraint limits the recommendation to order the item based at least in part on an attribute of the p

Assignees

• Amazon Tech Inc

Inventors

• Cimic Senad
• Chinta Sairam

Classifications

• G06F17/30873

  Physics · mapped topic

• G06Q30/0643

  graphically representing goods, e.g. 3D product representation · CPC title

• G06Q30/0631 Primary

  Recommending goods or services · CPC title

• G06K9/0014

  Physics · mapped topic

• G06Q30/0641

  utilising user interfaces specially adapted for shopping · CPC title