Image recognition result visualization over time

Patent metadata

Field	Value
Publication number	US-10514825-B2
Application number	US-201514975653-A
Country	US
Kind code	B2
Filing date	Dec 18, 2015
Priority date	Dec 18, 2015
Publication date	Dec 24, 2019
Grant date	Dec 24, 2019

Abstract

A system and method for image processing result visualization. The method includes receiving a job, wherein the job includes a panoramic image and image recognition information, and creating a visualization based on the job, wherein the visualization includes the panoramic image with the image recognition information layered over the panoramic image.

First claim

What is claimed is:

1. A method comprising:
requesting, using one or more processors, a job;
receiving, using the one or more processors, the job, wherein the job includes a series of panoramic images and image recognition information including recognized products from images in the series of panoramic images;
creating, using the one or more processors, a first visualization of an image in the series of panoramic images by layering the image recognition information over the image; and
presenting, using the one or more processors, the first visualization concurrently with a second visualization of a second panoramic image captured at another point in time and related to the job in a timeline on a display, the timeline including a product recognition pane generated using the recognized products from the image recognition information related to images in the series of panoramic images, the product recognition pane including a list of the recognized products from the first visualization and the second visualization.

2. The method of claim 1 , further comprising:
displaying, using the one or more processors, the first visualization and the second visualization in a user interface; and
displaying, using the one or more processors, thumbnails of the series of panoramic images in the user interface.

3. The method of claim 1 , further comprising:
highlighting, using the one or more processors, a recognized product in the first visualization in response to a user selecting a corresponding product from the product recognition pane.

4. The method of claim 1 , wherein creating the first visualization of the series of images further comprises highlighting, using the one or more processors, a recognized product based on the image recognition information.

5. The method of claim 1 , wherein
the product recognition pane includes a list of recognized products detected in one or more of the first visualization or the second visualization using the image recognition information.

6. The method of claim 5 , further comprising:
determining, using the one or more processors, that a region of the first visualization is different from a corresponding region of the second visualization.

7. The method of claim 6 , further comprising:
highlighting, using the one or more processors, the region of the first visualization and the corresponding region of the second visualization;
determining, using the one or more processors, that the region of the first visualization displays a correct product; and
providing, using the one or more processors, a corrective instruction for the corresponding region of the second visualization.

8. A computer program product comprising a non-transitory computer useable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:
request, using one or more processors, a job;
receive, using the one or more processors, the job, wherein the job includes a series of panoramic images and image recognition information including recognized products from images in the series of panoramic images;
create, using the one or more processors, a first visualization of an image in the series of panoramic images by layering the image recognition information over the image; and
present, using the one or more processors, the first visualization concurrently with a second visualization of a second panoramic image captured at another point in time and related to the job in a timeline on a display, the timeline including a product recognition pane generated using the recognized products from the image recognition information related to images in the series of panoramic images, the product recognition pane including a list of the recognized products from the first visualization and the second visualization.

9. The computer program product of claim 8 , wherein the computer readable program when executed on a computer further causes the computer to:
display, using the one or more processors, the first visualization and the second visualization in a user interface; and
display, using the one or more processors, thumbnails of the series of panoramic images in the user interface.

10. The computer program product of claim 8 , wherein the computer readable program when executed on a computer further causes the computer to:
highlight, using the one or more processors, a recognized product in the first visualization in response to a user selecting a corresponding product from the product recognition pane.

11. The computer program product of claim 8 , wherein creating the first visualization of the series of images further comprises highlighting, using the one or more processors, a recognized product based on the image recognition information.

12. The computer program product of claim 8 , wherein the
product recognition pane includes a list of recognized products detected in one or more of the first visualization or the second visualization using the image recognition information.

13. The computer program product of claim 12 , wherein the computer readable program when executed on a computer further causes the computer to:
determine, using the one or more processors, that a region of the first visualization is different from a corresponding region of the second visualization.

14. The computer program product of claim 13 , wherein the computer readable program when executed on a computer further causes the computer to:
highlight, using the one or more processors, the region of the first visualization and the corresponding region of the second visualization;
determine, using the one or more processors, that the region of the first visualization displays a correct product; and
provide, using the one or more processors, a corrective instruction for the corresponding region of the second visualization.

15. A system comprising:
a processor; and
a memory storing instructions that, when executed, cause the system to:
request, using one or more processors, a job;
receive, using the one or more processors, the job, wherein the job includes a series of panoramic images and image recognition information including recognized products from images in the series of panoramic images;
create, using the one or more processors, a first visualization of an image in the series of panoramic images by layering the image recognition information over the image; and
present, using the one or more processors, the first visualization concurrently with a second visualization of a second panoramic image captured at another point in time and related to the job in a timeline on a display, the timeline including a product recognition pane generated using the recognized products from the image recognition information related to images in the series of panoramic images, the product recognition pane including a list of the recognized products from the first visualization and the second visualization.

16. The system of claim 15 , wherein the memory also stores instructions that, when executed cause the system to:
display, using the one or more processors, the first visualization and the second visualization in a user interface; and
display, using the one or more processors, thumbnails of the series of panoramic images in the user interface.

17. The system of claim 15 , wherein the memory also stores instructions that, when executed cause the system to:
highlight, using the one or more processors, a recognized product in the first visualization in response to a user selecting a corresponding product from the product recognition pa

Assignees

• Graham Jamey
• Findlay Roland
• Griffin Michael
• Romain Tiffany
• Ricoh Co Ltd

Inventors

• Graham Jamey
• Findlay Roland
• Griffin Michael
• Romain Tiffany

Classifications

• G06F3/0482 Primary

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06Q30/0643

  graphically representing goods, e.g. 3D product representation · CPC title

• G06T1/0007

  Image acquisition · CPC title

• G06K2209/27

  Physics · mapped topic

• G06V2201/10

  Recognition assisted with metadata · CPC title