Computer vision and image characteristic search

Patent metadata

Field	Value
Publication number	US-11250487-B2
Application number	US-201916388473-A
Country	US
Kind code	B2
Filing date	Apr 18, 2019
Priority date	Dec 29, 2017
Publication date	Feb 15, 2022
Grant date	Feb 15, 2022

Abstract

Computer vision and image characteristic search is described. The described system leverages visual search techniques by determining visual characteristics of objects depicted in images and comparing the determined characteristics to visual characteristics of other images, e.g., to identify similar visual characteristics in the other images. In some aspects, the described system performs searches that leverage a digital image as part of a search query to locate digital content of interest. In some aspects, the described system surfaces multiple user interface instrumentalities that include images of patterns, textures, or materials and that are selectable to initiate a visual search of digital content having a similar pattern, texture, or material. The described aspects also include pattern-based authentication in which the system determines authenticity of an item in an image based on a similarity of its visual characteristics to visual characteristics of known authentic items.

First claim

What is claimed is:

1. A method implemented by at least one computing device, the method comprising:
displaying, by the at least one computing device, a prompt via a user interface providing authentication instructions for providing digital visual content depicting one or more visual characteristics of an item being listed on a listing service, the authentication instructions instructing a user to provide the digital visual content of a specified portion of the item being listed depicting movement of the item being listed;
receiving, by the at least one computing device, user selection of the digital visual content from a live feed of digital visual content via the user interface that depicts the one or more visual characteristics of the item being listed on the listing service;
generating, by the at least one computing device, non-textual data indicative of the one or more visual characteristics of the item from the digital visual content, wherein the non-textual data is at least one feature vector;
comparing, by the at least one computing device, the non-textual data to additional non-textual data indicative of visual characteristics of known authentic items generated from additional digital visual content depicting the known authentic items;
determining, by the at least one computing device, whether the item being listed is authentic based on the comparing; and
responsive to a determination that the item being listed is authentic, surfacing, by the at least one computing device, an indication that a listing of the item on the listing service is allowed to include an authentic designation; or

responsive to a determination that the item being listed is not authentic, surfacing, by the at least one computing device, an indication that the listing of the item on the listing service is not allowed to include the authentic designation.

2. The method as described in claim 1 , wherein the authentication instructions specify a location of the item being listed to capture in the digital visual content.

3. The method as described in claim 1 , wherein the authentication instructions specify a feature of the item being listed to capture in the digital visual content.

4. The method as described in claim 1 , further comprising receiving an additional selection to surface the listing of the item with the authentic designation via the listing service.

5. The method as described in claim 1 , wherein the digital visual content depicting the one or more characteristics of the item being listed comprises digital video.

6. The method as described in claim 1 , wherein the digital visual content depicting the one or more characteristics of the item being listed comprises at least one digital image.

7. The method as described in claim 1 , wherein the additional non-textual data is at least one feature vector.

8. A system comprising:
one or more processors; and
memory having stored thereon computer-readable instructions that are executable by the one or more processors to perform operations comprising:
displaying a prompt via a user interface providing authentication instructions for providing digital visual content depicting one or more visual characteristics of an item being listed on a listing service, the authentication instructions instructing a user to provide the digital visual content of a specified portion of the item being listed depicting movement of the item being listed on the listing service;
receiving user selection of the digital visual content from a live feed of digital visual content via the user interface that depicts the one or more visual characteristics of the item being listed on the listing service;
generating non-textual data indicative of the one or more visual characteristics of the item from the digital visual content, wherein the non-textual data is at least one feature vector;
comparing the non-textual data to additional non-textual data indicative of visual characteristics of known authentic items generated from additional digital visual content depicting the known authentic items;
determining whether the item being listed is authentic based on the comparing; and
controlling presentation of an authentic designation with a listing of the item according to the determining.

9. The system as described in claim 8 , wherein the additional non-textual data is at least one feature vector.

10. The system as described in claim 8 , wherein controlling the presentation of the authentic designation with the listing includes allowing the item to be listed via the listing service with the authentic designation responsive to a determination that the item is authentic.

11. The system as described in claim 8 , wherein controlling the presentation of the authentic designation with the listing includes preventing the item from being listed via the listing service with the authentic designation responsive to a determination that the item is not authentic.

12. The system as described in claim 8 , wherein the listing service prevents items from being listed with the authentic designation absent a determination that the items are authentic.

13. The system as described in claim 8 , wherein the operations further comprise receiving a selection via the user interface to list the item on the listing service with the authentic designation.

14. The system as described in claim 8 , further comprising receiving an additional selection to surface the listing of the item with the authentic designation via the listing service.

15. A method implemented by at least one computing device, the method comprising:
displaying a prompt via a user interface providing authentication instructions for providing digital visual content depicting one or more visual characteristics of an item being listed on a listing service;
receiving user selection of the digital visual content from a live feed of digital visual content via the user interface that depicts the one or more visual characteristics of the item being listed on the listing service, the authentication instructions instructing a user to provide the digital visual content of a specified portion of the item being listed depicting movement of the item being listed;
generating non-textual data indicative of the one or more visual characteristics of the item from the digital visual content, wherein the non-textual data includes at least one feature vector;
comparing the non-textual data to additional non-textual data indicative of visual characteristics of known authentic items generated from additional digital visual content depicting the known authentic items;
determining whether the item being listed is authentic based on the comparing; and
controlling presentation of an authentic designation with a listing of the item according to the determining.

16. The method as described in claim 15 , wherein the additional non-textual data includes at least one feature vector.

17. The method as described in claim 15 , wherein the listing service prevents items from being listed with the authentic designation absent a determination that the items are authentic.

18. The method as described in claim 15 , wherein the authentication instructions instruct the user to capture digital video of the item being listed.

19. The method as described in claim 15 , wherein the authentication instructions instruct the user to capture at least one digital image of the item being listed.

20. The method as described in claim 15 , wherein the authentication instructions specify at least one of:
a location of the

Assignees

• Ebay Inc

Inventors

• Piramuthu Robinson
• Keefer Timothy Samuel
• Crookston Kenneth Clark
• Rekhi Ashmeet Singh
• Khaja Nazimudeen Niaz Ahamed
• Gudipati Padmapriya
• Lin Shane
• Weigel John F
• Zhong Fujun
• Ramesh Suchitra
• Kiapour Mohammadhadi
• Zheng Shuai
• Ordonez Pereira Alberto
• Lanka Ravindra Surya
• Islam Md Atiq Ul
• Whyte Nicholas Anthony
• Iyengar Giridharan
• Plummer Bryan Allen

Classifications

• G06F16/3326

  using relevance feedback from the user, e.g. relevance feedback on documents, documents sets, document terms or passages · CPC title

• G06Q30/0643

  graphically representing goods, e.g. 3D product representation · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06F16/9035

  Filtering based on additional data, e.g. user or group profiles · CPC title

• G06F16/907

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title