System and method for automatically displaying variable image content in an image product

Patent metadata

Field	Value
Publication number	US-10522189-B2
Application number	US-201916519387-A
Country	US
Kind code	B2
Filing date	Jul 23, 2019
Priority date	Sep 13, 2016
Publication date	Dec 31, 2019
Grant date	Dec 31, 2019

Abstract

A computer-implemented method for automatically displaying variable image content in an image product includes automatically obtaining markers in photos or videos in a user account which includes detecting features in image content of the photos or the video frames and obtaining a marker for one of the photos or the video frames, automatically identifying a sequence of similar photos or videos if the markers detected in the photos or the associated video frames include more than a predetermined number or percentage of common features, detecting a marker in a photo product by a user device when the photo product is viewed by the user device, identifying a marked photo incorporated in the photo product based on the marker detected in the photo product, and enabling photos or videos in a sequence photos or videos associated with the marked photo to be displayed on the user device.

First claim

What is claimed is:

1. A computer-implemented method for automatically displaying variable image content in an image product, comprising:
obtaining a first marker in one of the photos or the video frames by a computer system based on a plurality of features detected in the one of the photos or the video frames;
automatically assigning similar photos or videos to a sequence of similar photos or videos by the computer system, wherein the similar photos or videos have associated markers sharing a similarity over a threshold;
storing the sequence of similar photos or videos in association with each other in the computer system;
detecting a second marker in a photo product when the photo product is captured or viewed by a user device;
identifying a marked photo incorporated in the photo product based on the second marker detected in the photo product; and
enabling a display of the sequence of photos or videos associated with the marked photo on the user device.

2. The computer-implemented method of claim 1 , wherein the marked photo is associated with a user account, the computer-implemented method further comprising:
retrieving, from the computer system, the photos or the videos associated with the user account using the second marker detected in the photo product.

3. The computer-implemented method of claim 1 , wherein the photos or videos associated with the marked photo are displayed in place of the marked photo on the photo product on the user device.

4. The computer-implemented method of claim 1 , wherein the photos or videos associated with the marked photo are displayed on the side or over the marked photo on the photo product on the user device.

5. The computer-implemented method of claim 1 , wherein the photo product is recorded in video by the user device, wherein the second marker in the photo product is detected in video frames in the video recording.

6. The computer-implemented method of claim 1 , wherein the photo product is captured by the user device in a still image, wherein the second marker in the photo product is detected in the still image.

7. The computer-implemented method of claim 1 , wherein the features are automatically detected in image content of photos or video frames in the videos in the user account by the computer system.

8. The computer-implemented method of claim 1 , wherein the photos or videos assigned to the sequence of similar photos or videos have their associated markers sharing more than a predetermined number of common features.

9. The computer-implemented method of claim 1 , wherein the photos or videos assigned to the sequence of similar photos or videos have their associated markers sharing more than a predetermined percentage of common features.

10. The computer-implemented method of claim 1 , further comprising:
ranking the similar photos or videos in the sequence to produce a ranked order, wherein the sequence of photos or videos associated with the marked photo are displayed on the user device in accordance with the ranked order.

11. The computer-implemented method of claim 10 , wherein the photos or videos in the sequence are ranked based on image content, image quality, and markers associated with the photos or videos.

12. The computer-implemented method of claim 1 , wherein the step of automatically assigning similar photos or videos to a sequence of similar photos or videos further comprises:
comparing features in two photos or the video frames;
identifying common features in the two photos or the video frames; and
determining if the common features are more than the predetermined number or the predetermined percentage of a total number of feature in the two photos or the video frames.

13. The computer-implemented method of claim 1 , wherein the sequence of similar photos or videos are identified among photos or videos that are captured or recorded within a time window.

14. The computer-implemented method of claim 1 , wherein the sequence of similar photos or videos is identified among photos or videos that are captured or recorded within a geographic area.

15. The computer-implemented method of claim 1 , further comprising:
displaying the photo product incorporating the marked photo in an online product store; and
manufacturing the photo product incorporating the marked photo in response to a user order.

16. The computer-implemented method of claim 1 , further comprising:
storing the photos and videos in association with their respective markers in a content storage in connection with the content server.

17. The computer-implemented method of claim 1 , further comprising:
sending the photos or videos associated with the marked photo to the user device.

Assignees

• Shutterfly Llc

Inventors

• Aroyo Nimrod
• Lev-Ari Shy
• Stein Yaron
• Mor Jonatan

Classifications

• H04N5/91 Primary

  Television signal processing therefor · CPC title

• G11B27/28 Primary

  by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} · CPC title

• G06V10/761

  Proximity, similarity or dissimilarity measures · CPC title

• G06F2218/08

  Feature extraction · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title