Methods, systems, and media for presenting information related to an event based on metadata

Patent metadata

Field	Value
Publication number	US-10284537-B2
Application number	US-201514619894-A
Country	US
Kind code	B2
Filing date	Feb 11, 2015
Priority date	Feb 11, 2015
Publication date	May 7, 2019
Grant date	May 7, 2019

Abstract

Methods, systems and media for presenting information related to an event based on metadata are provided. In some implementations, the method comprises: detecting that a user-initiated event has been performed on a user device; detecting a plurality of sensors connected to the user device; causing a plurality of content items related to the user-initiated event to be obtained using the plurality of sensors connected to the user device; determining whether each of the plurality of content items is to be associated with the user-initiated event based on user device information from a plurality of data sources; associating a portion of the plurality of content items with the user-initiated event based on the determination; retrieving information related to the portion of the plurality of content items; detecting, using the plurality of sensors connected to the user device, a second plurality of content items; determining that at least one of the second plurality of content items is related to at least one of the first plurality of content items; and causing information related to the user-initiated event to be presented by the user device based at least in part on the determination.

First claim

What is claimed is:

1. A method for presenting information related to an event based on metadata, the method comprising:
causing, using a hardware processor of a server device, a first user interface to be presented on a user device associated with a user account, wherein the first user interface receives a selection of a plurality of user-initiated events associated with the user account on the user device and a content type of a plurality of content types to be obtained in response to detecting one of the plurality of user-initiated events;
detecting, using the hardware processor, that a user-initiated event from the plurality of user-initiated events has been performed on the user device;
in response to detecting that the user-initiated event from the plurality of user-initiated events has been performed on the user device, detecting, using the hardware processor, a plurality of sensors connected to the user device that are capable of obtaining the content of the plurality of content types associated with the detected user-initiated event;
causing, using the hardware processor, at a first time associated with the user-initiated event, a plurality of content items related to the user-initiated event to be obtained using the plurality of sensors connected to the user device, wherein the plurality of content items includes a content item that contains recorded audio associated with the user-initiated event, wherein the plurality of content items includes a captured image associated with the user-initiated event, and wherein a person has been identified within the captured image;
determining, using the hardware processor, whether each of the plurality of content items is to be associated with the user-initiated event based on user device information from a plurality of data sources;
associating, using the hardware processor, a portion of the plurality of content items that includes the recorded audio with the user-initiated event based on the determination made using the user device information from the plurality of data sources;
retrieving, using the hardware processor, information related to the portion of the plurality of content items, wherein the information relates to the portion of the plurality of content items includes determining that the recorded audio corresponds to an audio fingerprint of related audio content and retrieving the related audio content;
detecting, using the plurality of sensors connected to the user device at a second time, a second plurality of content items;
determining, using the hardware processor, that at least one of the second plurality of content items matches at least one of the first plurality of content items; and
causing, using the hardware processor, a second user interface to be presented that prompts a user of the user device to communicate with the person identified within the captured image based at least in part on the determination that the at least one of the second plurality of content items matches the at least one of the first plurality of content items.

2. The method of claim 1 , wherein the plurality of sensors includes a microphone, wherein the first plurality of content items includes a first recorded audio stream, wherein the second plurality of content items includes a second recorded audio stream, and wherein the determination that at least one of the second plurality of content items is related to at least one of the first plurality of content items is determined based on whether the first recorded audio stream is related to the second recorded audio stream.

3. The method of claim 1 , further comprising:
requesting authorization to store the user-initiated event;
receiving authorization to store the user-initiated event; and
associating the portion of the plurality of content items with the user-initiated event based on the received authorization.

4. The method of claim 1 , further comprising determining that the user-initiated event is associated with positive emotions for a user of the user device, wherein causing the information related to the user-initiated event to be presented is based at least in part on the determination.

5. The method of claim 1 , wherein the information related to the user-initiated event includes an image associated with the user-initiated event.

6. The method of claim 1 , wherein the information related to the user-initiated event includes a suggestion to go to a place associated with the user-initiated event.

7. A system for presenting information related to an event based on metadata, the system comprising:
a hardware processor of a server device that is programmed to:
cause a first user interface to be presented on a user device associated with a user account, wherein the first user interface receives a selection of a plurality of user-initiated events associated with the user account on the user device and a content type of a plurality of content types to be obtained in response to detecting one of the plurality of user-initiated events;
detect that a user-initiated event from the plurality of user-initiated events has been performed on the user device;
in response to detecting that the user-initiated event from the plurality of user-initiated events has been performed on the user device, detect a plurality of sensors connected to the user device that are capable of obtaining the content of the plurality of content types associated with the detected user-initiated event;
cause, at a first time associated with the user-initiated event, a plurality of content items related to the user-initiated event to be obtained using the plurality of sensors connected to the user device, wherein the plurality of content items includes a content item that contains recorded audio associated with the user-initiated event, wherein the plurality of content items includes a captured image associated with the user-initiated event, and wherein a person has been identified within the captured image;
determine whether each of the plurality of content items is to be associated with the user-initiated event based on user device information from a plurality of data sources;
associate a portion of the plurality of content items that includes the recorded audio with the user-initiated event based on the determination made using the user device information from the plurality of data sources;
retrieve information related to the portion of the plurality of content items, wherein the information relates to the portion of the plurality of content items includes determining that the recorded audio corresponds to an audio fingerprint of related audio content and retrieving the related audio content;
detect, using the plurality of sensors connected to the user device at a second time, a second plurality of content items;
determine that at least one of the second plurality of content items matches at least one of the first plurality of content items; and
cause a second user interface to be presented that prompts a user of the user device to communicate with the person identified within the captured image based at least in part on the determination that the at least one of the second plurality of content items matches the at least one of the first plurality of content items.

8. The system of claim 7 , wherein the plurality of sensors includes a microphone, wherein the first plurality of content items includes a first recorded audio stream, wherein the second plurality of content items includes a second recorded audio stream, and wherein the determination that at least one of the second plurality of content items is related to at least one of the first plurality of content items is determined based on whether the first recorded audio stream is related to the second recorded audio stream.

Assignees

• Google Llc

Inventors

• Liu Eric H C
• Goran Charles
• Effrat Jonathan James

Classifications

• G06F16/433

  using audio data · CPC title

• G06F16/58

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F16/24

  Querying · CPC title

• G06F16/683

  using metadata automatically derived from the content · CPC title