Image archival based on image categories

Patent metadata

Field	Value
Publication number	US-10891485-B2
Application number	US-201815912809-A
Country	US
Kind code	B2
Filing date	Mar 6, 2018
Priority date	May 16, 2017
Publication date	Jan 12, 2021
Grant date	Jan 12, 2021

Abstract

Implementations relate to removal of one or more images from a view of a plurality of images. In some implementations, a method includes obtaining a plurality of images, programmatically analyzing the plurality of images to determine a plurality of image features, and determining one or more image categories for the plurality of images based on the image features. The method further includes identifying a subset of the plurality of images based on the image categories, wherein each image of the subset is associated with an image category for archival. The method further includes causing a user interface to be displayed that includes one or more images of the subset, receiving user input to archive at least one of the one or more images, and in response to the user input, removing the at least one of the images from a view of the plurality of images.

First claim

What is claimed is:

1. A method comprising:
obtaining a plurality of images, wherein the plurality of images are available for display in a view of a device;
programmatically analyzing the plurality of images by at least one processor to determine a plurality of image features;
determining one or more image categories for the plurality of images based on the plurality of image features;
identifying, by the at least one processor, a subset of the plurality of images based on the one or more image categories, wherein each image in the subset of the plurality of images is associated with an archive image category, wherein the archive image category designates images for archival;
determining, by the at least one processor, whether one or more images in the subset of the plurality of images were captured more than a threshold period of time from a current time;
in response to determining that the one or more images in the subset of the plurality of images were captured more than the threshold period of time from the current time, causing, by the at least one processor, a user interface to be displayed that includes the one or more images of the subset and a suggestion to archive the one or more images of the subset;
receiving first user input to archive at least one image of the one or more images of the subset based on selection of the suggestion to archive by the first user input; and
in response to the first user input, removing, by the at least one processor, the at least one image of the one or more images of the subset such that the at least one image is not available to be displayed in the view of the device after the removal.

2. The method of claim 1 , wherein each image of the plurality of images includes archive metadata that indicates whether the image is included in the archive image category, and further comprising, in response to identifying the subset of the plurality of images, updating the archive metadata of each image of the subset to indicate that the image of the subset is in the archive image category.

3. The method of claim 1 , further comprising:
storing image identifiers and the one or more image categories for the plurality of images in a database;
receiving second user input indicative of selection of a particular category of the one or more image categories; and
in response to receiving the second user input,
performing a database lookup to identify one or more images for the particular category based on the image identifiers and the one or more image categories; and
causing the one or more images for the particular category to be displayed.

4. The method of claim 1 , wherein the archive image category includes one or more of document, meme, or screenshot.

5. The method of claim 4 , wherein determining the one or more image categories comprises applying an image classifier trained to classify input images as one of: document, meme, or screenshot based on one or more of: metadata of the input images and pixel values of the input images, wherein the image classifier comprises a machine-learning application that is configured to recognize the plurality of image features from the input images and classify each input image based on the plurality of image features.

6. The method of claim 1 , further comprising:
determining whether the subset of the plurality of images includes a count of images greater than a threshold,
wherein causing the user interface to be displayed is performed at a greater frequency in response to determining that the subset of the plurality of images includes the count of images greater than the threshold.

7. The method of claim 1 , further comprising determining whether the subset of the plurality of images includes a count of images greater than a threshold,
wherein causing the user interface to be displayed is performed in response to determining that the subset of the plurality of images includes the count of images greater than the threshold in addition to determining that the one or more images in the subset of the plurality of images was captured more than the threshold period of time from the current time.

8. The method of claim 1 further comprising, in response to the first user input:
identifying an archive database; and
storing the at least one image of the one or more images in the archive database.

9. The method of claim 1 wherein identifying the subset of the plurality of images further includes:
determining whether multiple images of the plurality of images depict a particular scene;
determining whether an image editing operation has been performed via user input on one image of the multiple images; and
in response to determining that the multiple images depict the particular scene and that the image editing operation has been performed via user input on the one image of the multiple images, designating one or more images of the multiple images, exclusive of the one image, to be included in the subset of the plurality of images.

10. The method of claim 1 wherein the plurality of images are stored locally on a local storage of a user device, and wherein removing the at least one image comprises deleting the at least one image from the local storage.

11. A system comprising:
one or more hardware processors; and
a storage device with instructions stored thereon that, when executed by the one or more hardware processors, cause the one or more hardware processors to perform operations comprising:
obtaining a plurality of images, wherein the plurality of images are available for display in a view of a device;
programmatically analyzing the plurality of images to determine a plurality of image features;
determining one or more image categories for the plurality of images based on the plurality of image features;
identifying a subset of the plurality of images based on the one or more image categories, wherein each image in the subset of the plurality of images is associated with an archive image category, wherein the archive image category designates images for archival;
determining whether one or more images in the subset of the plurality of images were captured more than a threshold period of time from a current time;
in response to determining that the one or more images in the subset of the plurality of images were captured more than the threshold period of time from the current time, causing a user interface to be displayed that includes the one or more images of the subset and a suggestion to archive the one or more images of the subset;

receiving first user input to archive at least one of the one or more images of the subset based on selection of the suggestion to archive by the first user input; and
in response to the first user input, removing the at least one image of the one or more images of the subset such that the at least one image is not available to be displayed in the view of the device after the removal.

12. The system of claim 11 , wherein each image of the plurality of images includes archive metadata that indicates whether the image is included in the archive image category, and the storage device having further instructions stored thereon that, when executed by the one or more hardware processors, cause the one or more hardware processors to perform operations comprising:
in response to identifying the subset of the plurality of images, updating the archive metadata of each image of the subset to indicate that the image of the subset is in the archive image category.

13. The system of claim 11 , the storage device having further instructions stored thereon that, when executed by the one or more hardware processors, cause the one or more har

Assignees

• Google Llc

Inventors

• Anorga Juan Carlos
• Lieb David
• Khandelwal Madhur
• Millar Evan
• NOVIKOFF Timothy
• Kulkarni Mugdha
• Ikemoto Leslie
• Verdu Jorge
• Cui Jingyu
• Ramaswamy Sharadh
• Ayyagari Raja Ratna Murthy
• Cannon Marc
• Roe Alexander
• Tungseth Shaun
• Jin Songbo
• Bridges Matthew
• Jiang Ruirui
• Selier Jeremy
• Suszek Austin
• Song Gang

Classifications

• G06V20/70

  Labelling scene content, e.g. deriving syntactic or semantic representations · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06F3/048 Primary

  Interaction techniques based on graphical user interfaces [GUI] · CPC title

• G06N7/01

  Probabilistic graphical models, e.g. probabilistic networks · CPC title

• G06N3/045

  Combinations of networks · CPC title