Annotation and retrieval of personal bookmarks

Patent metadata

Field	Value
Publication number	US-11574028-B2
Application number	US-201916972250-A
Country	US
Kind code	B2
Filing date	Apr 16, 2019
Priority date	Jun 28, 2018
Publication date	Feb 7, 2023
Grant date	Feb 7, 2023

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a first input associated with a bookmark and, in response to receiving the first input, obtaining context data for deriving annotations for the bookmark. An annotation engine of a system obtains multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark. The annotation engine generates an importance value for each annotation. The importance value characterizes a relationship between each annotation and at least one of: the information included in the context data; or the transcription of the first input. The annotation engine generates a set of annotations for retrieving the bookmark. Each annotation in the set of annotations is generated from the obtained multiple annotations and each annotation has an importance value that exceeds a threshold value.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
receiving, by a computing system, a first input associated with a bookmark;
in response to receiving the input, obtaining, by the computing system, context data for deriving annotations for the bookmark;
wherein the context data for deriving the annotations is obtained from a plurality of data sources;
wherein at least one data source of the plurality of data sources includes information obtained from a search engine based on search queries submitted to the search engine that returned one or more search results that included a resource identifier stored in the bookmark;

obtaining, by an annotation engine of the computing system, multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark;
generating, by the annotation engine, an importance value for each annotation, the importance value characterizing a relationship between each annotation and at least one of:
i) the information included in the context data; or
ii) the transcription of the first input;

generating, by the annotation engine, a set of annotations for retrieving the bookmark, each annotation in the set of annotations being generated from the obtained multiple annotations and each annotation having an importance value that exceeds a threshold value; and
using, by the computing system, a particular annotation in the set of annotations to retrieve the bookmark for accessing a resource page.

2. The method of claim 1 , wherein using the particular annotation comprises:
receiving, by the computing system, a second input; and
selecting, by the annotation engine and based on the second input, the particular annotation from the set of annotations to cause retrieval of the bookmark; and
using, by the computing system, the particular annotation to retrieve the bookmark for accessing the resource page.

3. The method of claim 2 , wherein selecting comprises:
analyzing a transcription of the second input;
obtaining one or more terms from the transcription of the second input;
for each annotation in the set of annotations:
determining a similarity score that indicates an extent to which terms in the transcription of the second input matches terms in the annotation for retrieving the bookmark; and

selecting the particular annotation based on the similarity score for the annotation exceeding a threshold similarity score.

4. The method of claim 1 , wherein the particular annotation is configured as a trigger to cause retrieval of the bookmark and the method further comprises:
determining, by the computing system, that a trigger condition is satisfied based on analysis of a transcription of a second input;
retrieving, by the computing system, the bookmark from a bookmark index in response to determining that the trigger condition is satisfied; and
providing, by the computing system, the bookmark for display at a client device in response to retrieving the bookmark from the bookmark index.

5. The method of claim 1 , wherein the context data for deriving the annotations further comprises at least one of:
i) an identifier for the bookmark;
ii) the resource identifier stored as the bookmark;
iii) a resource page that is accessed using the resource identifier; or
iv) text of the resource page.

6. The method of claim 5 , wherein the context data for deriving the annotations comprises an N-gram and data describing an entity, each of the N-gram and the data describing the entity being obtained from a plurality of data sources with reference to the transcription of the first input.

7. The method of claim 5 , wherein:
i) the resource page is generated by a web-browser application, and
ii) the resource identifier is a uniform resource locator (URL) that provides a resource address for accessing the resource page.

8. The method of claim 5 , wherein:
i) the resource page is generated by an application accessed using a client device, the application being configured to store one or more deep-links in an application index, and
ii) the resource identifier is a uniform resource locator (URL) for the resource page and is obtained from the application index comprising address data about the application.

9. The method of claim 5 , wherein the resource identifier is at least one of:
a) data identifying a screen image of the resource page generated by an application accessed using a client device, or
b) a deep-link that provides a resource address for accessing the resource page of the application.

10. An electronic system comprising:
one or more processing devices;
one or more non-transitory machine-readable storage devices for storing instructions that are executable by the one or more processing devices to perform operations comprising:
receiving, by a computing system, a first input associated with a bookmark;
in response to receiving the first input, obtaining, by the computing system, context data for deriving annotations for the bookmark;
wherein the context data for deriving the annotations is obtained from a plurality of data sources;
wherein at least one data source of the plurality of data sources comprises information obtained from a search engine based on search queries submitted to the search engine that returned one or more search results that included a resource identifier stored in the bookmark;

obtaining, by an annotation engine of the computing system, multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark;
generating, by the annotation engine, an importance value for each annotation, the importance value characterizing a relationship between each annotation and at least:
i) the information included in the context data; or
ii) the transcription of the first input;

generating, by the annotation engine, a set of annotations for retrieving the bookmark, each annotation in the set of annotations being generated from the obtained multiple annotations and each annotation having an importance value that exceeds a threshold value; and
using, by the computing system, a particular annotation in the set of annotations to retrieve the bookmark for accessing a resource page.

11. The electronic system of claim 10 , wherein using the particular annotation comprises:
receiving, by the computing system, a second input; and
selecting, by the annotation engine and based on the second input, the particular annotation from the set of annotations to cause retrieval of the bookmark; and
using, by the computing system, the particular annotation to retrieve the bookmark for accessing the resource page.

12. The electronic system of claim 11 , wherein selecting comprises:
analyzing a transcription of the second input;
obtaining one or more terms from the transcription of the second input;
for each annotation in the set of annotations:
determining a similarity score that indicates an extent to which terms in the transcription of the second input matches terms in the annotation for retrieving the bookmark; and

selecting the particular annotation based on the similarity score for the annotation exceeding a threshold similarity score.

13. The electronic system of claim 10 , wherein the particular annotation is configured as a trigger to cause retrieval of the bookmark and the method further comprises:
determining, by the computing system, that a trigger condition is satisfied based on analysis of a transcription of a second input;
retrieving, by the computing system, the bookmark from a bookmark index in

Assignees

• Google Llc

Inventors

• Andreica Mugurel Ionut
• Small Jonathan
• Nowak-Przygodzki Marcin M

Classifications

• G06F16/9562 Primary

  Bookmark management · CPC title

• G06F16/972

  Access to data in other repository systems, e.g. legacy data or dynamic Web page generation · CPC title

• G06F40/169

  Annotation, e.g. comment data or footnotes · CPC title

• G06F16/9574

  of access to content, e.g. by caching · CPC title