Assisted text input for computing devices

Patent metadata

Field	Value
Publication number	US-9736361-B2
Application number	US-201615094518-A
Country	US
Kind code	B2
Filing date	Apr 8, 2016
Priority date	Dec 11, 2013
Publication date	Aug 15, 2017
Grant date	Aug 15, 2017

Abstract

Various approaches provide for detecting and recognizing text to enable a user to perform various functions or tasks. For example, a user could point a camera at an object with text, in order to capture an image of that object. The camera can be integrated with a portable computing device that is capable of taking the image and processing the image (or providing the image for processing) to recognize, identify, and/or isolate the text in order to send the image of the object as well as recognized text to an application, function, or system, such as an electronic marketplace.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
obtaining first image data of a first portion of an object using a camera of a computing device;
obtaining second image data of a second portion of the object using the camera, the first portion being different from the second portion;
processing the first portion to isolate a first area including a first representation of the object;
analyzing the first area to recognize first text associated with the first portion of the object;
processing the second portion to isolate a second area including a second representation of the object;
analyzing the second area to recognize second text associated with the second portion of the object;
receiving a first selection of a first text input field;
determining a first set of words corresponding to the first area from first recognized text that are associated with the first text input field;
receiving a second selection of a second text input field;
determining a second set of words corresponding to the second area from second recognized text that are associated with the second text input field;
displaying on an interface a selectable list of words that includes a first subset of the first set of words and a second subset of the second set of words; and
enabling a user of the computing device to select at least one word from one of the first set of words or second set of words to fill in the first text input field and the second text input field.

2. The computer-implemented method of claim 1 , further comprising:
receiving an indication to submit at least one word to the first text input field; and
filtering the second set of words from the selectable list of words.

3. The computer-implemented method of claim 1 , further comprising:
receiving an indication to submit at least one word to the second text input field; and
filtering the first set of words from the selectable list of words.

4. The computer-implemented method of claim 1 , further comprising:
analyzing one of the first image data or the second image data to determine a product category of the object;
determining words associated with the product category of the object to fill in the first text input field and the second text input field; and
generating a product listing using the words.

5. The computer-implemented method of claim 1 , wherein the first text input field and the second text input field includes at least one of a title field, a product description field, a product search phrases field, a keyword search field, a price field, a quantity field, or a quality field.

6. The computer-implemented method of claim 1 , further comprising:
receiving an indication that input to the first text input field and the second text input field is complete; and
generating a product listing using entries in the first text input field and the second text input field.

7. The computer-implemented method of claim 1 , further comprising:
generating using at least the first image data and the second image data a three-dimensional representation of the object;
generating a product listing using entries in the first text input field and the second text input field; and
providing, to an electronic marketplace, the product listing and information corresponding to the three-dimensional representation of the object.

8. The computer-implemented method of claim 7 , further comprising:
determining the first text as being associated with a first type of text and the second text as being associated with a second type of text;
associating the first text with the first text input field based at least in part on the first text input field being associated with the first type of text;
associating the second text with the second text input field based at least in part on the second text input field being associated with the second type of text; and
generating a product listing that includes at least a portion of the first text included in the first text input field and at least a portion of the second text included in the second text input field.

9. The computer-implemented method of claim 1 , further comprising:
comparing one of the first image data or the second image data to a catalog of stored product information to identity a product offered through an electronic marketplace, the product associated with product information; and
generating a product listing that includes at least a portion of the product information and an image of the object obtained from one of the first image data, the second image data, or the electronic marketplace.

10. The computer-implemented method of claim 1 , further comprising:
identifying words of the first subset of the first set of words and the second subset of the second set of words matching a noun;
for each word of the first subset and the second subset matching a particular noun, determine a number of occurrences of the particular noun;
determining a relevance score for each word of the first subset and the second subset based at least in part on the number of occurrences of a matched particular noun; and
arranging the first subset and the second subset based at least in part on a respective relevance score for each word.

11. A computing device, comprising:
a camera;
a display element;
a processor; and
a memory device including instructions that, when executed by the processor, cause the computing device to:
obtain first image data of a first portion of an object using the camera;
obtain second image data of a second portion of the object using the camera, the first portion being different from the second portion;
process the first portion to isolate a first area including a first representation of the object;
analyze the first area to recognize first text associated with the first portion of the object;
process the second portion to isolate a second area including a second representation of the object;
analyze the second area to recognize second text associated with the second portion of the object;
receive a first selection of a first text input field;
determine a first set of words corresponding to the first area from first recognized text that are associated with the first text input field;
receive a second selection of a second text input field;
determine a second set of words corresponding to the second area from second recognized text that are associated with the second text input field;
display on an interface on the display element a selectable list of words that includes a first subset of the first set of words and a second subset of the second set of words; and
enable a user of the computing device to select at least one word from one of the first set of words or second set of words to fill in the first text input field and the second text input field.

12. The computing device of claim 11 , wherein the instructions, when executed further cause the computing device to:
receive an indication to submit at least one word to the first text input field; and
filter the second set of words from the selectable list of words.

13. The computing device of claim 11 , wherein the instructions, when executed further cause the computing device to:
receive an indication to submit at least one word to the second text input field; and
filter the first set of words from the selectable list of words.

14. The computing device of claim 11 , wherein the instructions, when executed further cause the computing device to:
determine a foreground region of the first image data and the second image data;
determine a background region of the first image data and the second image data;
identify

Assignees

• A9 Com Inc

Inventors

• Kraft Adam Wiggen
• Ma Kathy Wing Lam
• Lin Xiaofan
• Dhua Arnab Sanat Kumar
• Lou Yu

Classifications

• H04N23/64 Primary

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• G06T15/00

  Three-dimensional [3D] image rendering · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06Q30/0603 Primary

  Catalogue creation or management · CPC title

• G06Q30/0625

  by formulating product or service queries, e.g. using keywords or predefined options · CPC title