System and method of identifying visual objects

Patent metadata

Field	Value
Publication number	US-12346371-B2
Application number	US-202318531144-A
Country	US
Kind code	B2
Filing date	Dec 6, 2023
Priority date	Dec 6, 2011
Publication date	Jul 1, 2025
Grant date	Jul 1, 2025

Abstract

A system and method of identifying objects is provided. In one aspect, the system and method includes a hand-held device with a display, camera and processor. As the camera captures images and displays them on the display, the processor compares the information retrieved in connection with one image with information retrieved in connection with subsequent images. The processor uses the result of such comparison to determine the object that is likely to be of greatest interest to the user. The display simultaneously displays the images the images as they are captured, the location of the object in an image, and information retrieved for the object.

First claim

The invention claimed is:

1. A computer-implemented method comprising:
obtaining, by a user computing device comprising one or more computing devices, a plurality of image frames from a camera device associated with the user computing device, wherein the plurality of image frames collectively depict a captured object;
identifying, by the user computing device, one or more image analysis constraints associated with the user computing device at a current time;
making, by the user computing device, a determination that the user computing device cannot analyze the plurality of image frames based on the one or more image analysis constraints;
responsive to the determination, processing, by the user computing device, an image frame of the plurality of image frames to obtain an encoding of the image frame;
transmitting, by the user computing device, the encoding of the image frame to a server computing system that implements an image analysis engine;
receiving, by the user computing device from the server computing system, in response to transmitting the encoding of the image frame,
description data for a first object; and
providing, by the user computing device, the description data for the first object for display to a user.

2. The computer-implemented method of claim 1 , wherein the transmitting, by the user computing device, the encoding of the image frame to a server computing system that manages an image analysis engine further comprises: transmitting, by the user computing device, one or more characteristics of the user computing device.

3. The computer-implemented method of claim 2 , wherein the one or more characteristics of the user computing device comprise at least one of:
geospatial coordinates of the user computing device;
a local time for the user computing device;
movement information associated with the user computing device; or
a current wireless signal quality for the user computing device.

4. The computer-implemented method of claim 1 , wherein:
the captured object comprises a consumer product;
the description data is descriptive of an identity of the consumer product.

5. The computer-implemented method of claim 1 , further comprising:
providing, by the server computing system, additional description data.

6. The computer-implemented method of claim 1 , wherein:
the captured object comprises a consumer product;
the description data is descriptive of an identity of the consumer product; and
the additional descript data is descriptive of a website associated with the consumer product.

7. The computer-implemented method of claim 1 , wherein the description data describes one or more characteristics of the first object, and wherein the one or more characteristics comprise at least one of:
an identity of the first object;
one or more entities associated with the first object;
an image depicting the first object; or
search result data for the first object.

8. The computer-implemented method of claim 1 , wherein the plurality of image frames comprises video capture data.

9. The computer-implemented method of claim 1 , wherein the user computing device comprises an object recognition system.

10. The computer-implemented method of claim 1 , wherein the description data describes each of a plurality of features of the first object.

11. The computer-implemented method of claim 1 , wherein the encoding of the image frame further comprises compressing the image frame.

Assignees

• Google Llc

Inventors

• Petrou David
• Bridges Matthew
• Nalawadi Shailesh
• Adam Hartwig
• Casey Matthew R
• Neven Hartmut
• Harp Andrew

Classifications

• G06F3/048

  Interaction techniques based on graphical user interfaces [GUI] · CPC title

• G06F16/9538

  Presentation of query results · CPC title

• G06V30/19173

  Classification techniques · CPC title

• H04N23/00

  Cameras or camera modules comprising electronic image sensors; Control thereof · CPC title

• G06F18/24133

  Distances to prototypes · CPC title