Adding conversation context from detected audio to contact records

Patent metadata

Field	Value
Publication number	US-11019174-B2
Application number	US-201916695077-A
Country	US
Kind code	B2
Filing date	Nov 25, 2019
Priority date	Oct 25, 2017
Publication date	May 25, 2021
Grant date	May 25, 2021

Abstract

Provided are a computer program product, system, and method for adding conversation context from detected audio to contact records. An audio stream is received through a microphone of a personal computing device. Context analysis is performed of the audio stream to detect conversation context in the audio stream. A request is received to associate the conversation context with a selected contact person. A determination is made of conversation context detected from a segment of the audio stream received during a period of time from when the request was received. The conversation context determined for the period of time is included in a contact record for the selected contact person. The contact record is stored in a contact database including a plurality of contact records for a plurality of contact persons, wherein the contact records include conversation context and location information associated with the contact persons.

First claim

What is claimed is:

1. A computer program product for providing contact information for contacts in a personal computing device in communication with a microphone, the computer program product comprising a computer readable storage medium having computer readable program code embodied therein that executes to perform operations, the operations comprising:
receiving an audio stream through the microphone;
performing context analysis of the audio stream to generate conversation context instances in the audio stream gathered at different times to store in a conversation context stream, wherein each conversation context instance includes a conversation context comprising information on content of conversation detected and a time of an audio segment from which the conversation context is detected;
generating location information instances each having information on a geographical location of the personal computing device and a time the geographical location was determined;
associating a contact record for a contact person with at least one conversation context instance of the detected conversation context instances and at least one location information instance having times within a period of time from a specified time; and
storing the contact record in a contact database including a plurality of contact records for a plurality of contact persons, wherein the contact records include conversation context and location information associated with the contact persons for multiple time periods.

2. The computer program product of claim 1 , wherein the conversation context comprises at least one of topics of conversation, names, locations, and emotions determined by performing context analysis of the audio stream.

3. The computer program product of claim 2 , wherein the operations further comprise:
determining user content from multiple data sources related to the topics of conversation in the at least one conversation context instance and at least one location information instance associated with the contact record; and
including in the contact record information on the user content.

4. The computer program product of claim 1 , wherein a selected contact person comprises a new contact person to add to the contact database, wherein the operations further comprise:
determining whether a personal identifier of the new contact person is related to a personal identifier of an existing contact person having an existing contact record in the contact database with a threshold degree of certainty, wherein the contact record is created for the new contact person in response to determining that the personal identifier of the new contact person is not related to the personal identifier of an existing contact person in the contact database; and
including in the existing contact record for the existing contact person the conversation context determined for the period of time.

5. The computer program product of claim 1 , wherein the operations further comprise:
receiving a search request including at least one of a conversation context search term and location search term and a time period search term; and
determining at least one contact record of the contact records in the contact database including conversation context and location information related to the at least one of the conversation context search term and the location search term and associated with a time period matching the time period search term; and
returning information on each contact person associated with the determined at least one contact record including the at least one of the conversation context search term and the location search term.

6. The computer program product of claim 1 , wherein the operations further comprise:
receiving a search request including a personal identifier search term and a time period search term;
determining a contact record for a contact person having a personal identifier related to the personal identifier search term;
determining from the determined contact record at least one of the conversation context and the location information associated with a time period matching the time period search term; and
returning information for the contact person having the personal identifier related to the personal identifier search term and the at least of the conversation context and the location information associated with the time period matching the time period search term.

7. The computer program product of claim 6 , wherein the determining the location information further comprises:
searching a calendar of a user of the personal computing device for any scheduled events within the period of time of the specified time; and
indicating the scheduled events in the contact record for a selected contact person.

8. A system for providing contact information for contacts of a personal computing device, comprising:
a processor;
a microphone;
a computer readable storage medium having computer readable program code that when executed by the processor perform operations, the operations comprising:
receiving an audio stream through the microphone;
performing context analysis of the audio stream to generate conversation context instances in the audio stream gathered at different times to store in a conversation context stream, wherein each conversation context instance includes a conversation context comprising information on content of conversation detected and a time of an audio segment from which the conversation context is detected;
generating location information instances each having information on a geographical location of the personal computing device and a time the geographical location was determined;
associating a contact record for a contact person with at least one conversaation context instance of the detected conversation context instances and at least one location information instance having times within a period of time from a specified time; and
storing the contact record in a contact database including a plurality of contact records for a plurality of contact persons, wherein the contact records include conversation context and location information associated with the contact persons for multiple time periods.

9. The system of claim 8 , wherein the conversation context comprises at least one of topics of conversation, names, locations, and emotions determined by performing context analysis of the audio stream.

10. The system of claim 9 , wherein the operations further comprise:
determining user content from multiple data sources related to the topics of conversation in the at least one conversation context instance and at least one location information instance associated with the contact record; and
including in the contact record information on the user content.

11. The system of claim 8 , wherein a selected contact person comprises a new contact person to add to the contact database, wherein the operations further comprise:
determining whether a personal identifier of the new contact person is related to a personal identifier of an existing contact person having an existing contact record in the contact database with a threshold degree of certainty, wherein the contact record is created for the new contact person in response to determining that the personal identifier of the new contact person is not related to the personal identifier of an existing contact person in the contact database; and
including in the existing contact record for the existing contact person the conversation context determined for the period of time.

12. The system of claim 8 , wherein the operations further comprise:
receiving a search request including at least one of a conversation c

Assignees

• IBM

Inventors

• Cunico Hernan A
• Silva Asima

Classifications

• G06F40/30 Primary

  Semantic analysis · CPC title

• H04L67/52

  specially adapted for the location of the user terminal · CPC title

• H04M1/72454

  according to context-related or environment-related conditions · CPC title

• H04M1/72484

  wherein functions are triggered by incoming communication events · CPC title

• H04M1/27453

  Directories allowing storage of additional subscriber data, e.g. metadata · CPC title