Augmented reality conversation feedback

Patent metadata

Field	Value
Publication number	US-10996741-B2
Application number	US-201715702280-A
Country	US
Kind code	B2
Filing date	Sep 12, 2017
Priority date	Sep 12, 2017
Publication date	May 4, 2021
Grant date	May 4, 2021

Abstract

A method, computer system, and a computer program product for interpreting conversation engagement is provided. The present invention may include receiving, by an augmented reality device, an input, wherein the augmented reality device is associated with a user. The present invention may also include processing the received input. The present invention may then include analyzing the input based on the processed input. The present invention may further include determining that the user is engaged in a conversation with an individual based on the analyzed input. The present invention may also include capturing a plurality of core parameters between the user and the individual based on the determined engaged conversation. The present invention may then include analyzing the captured plurality of core parameters. The present invention may further include delivering a representation of the analyzed plurality of core parameters to the user on the augmented reality device.

First claim

What is claimed is:

1. A method for interpreting conversation engagement, the method comprising:
receiving, by an augmented reality device, an input, wherein the augmented reality device is associated with a user;
analyzing the received input;
determining that the user is engaged in a conversation with an individual based on the analyzed input, wherein a level of engagement is used to determine that the user and the individual are engaged in the conversation based on a quantifiable threshold parameter, wherein the quantifiable threshold parameter indicates a degree of conversation, wherein the degree of the conversation is low, medium or high, wherein the degree of conversation of the low, medium and high are scored between 0 and 1, respectively;
capturing a plurality of core parameters between the user and the individual based on the degree of conversation being medium or high, wherein the plurality of core parameters further quantifies the level of engagement between the user and the individual by assigning a weight to the individual based on a level of connection between the user and the individual;
determining that the individual is unknown to the user, wherein an intention of the conversation is monitored to indicate a willingness and an ability to speak on a particular topic;
analyzing the captured plurality of core parameters, wherein a characteristic model is built beginning with a random guess associated with features of the individual and interests of the user, wherein a communication distance is assigned between the user and the individual, wherein the communication distance is optimized for the user by refining the characteristic model, wherein the characteristic model is built using keypoint extraction;
delivering a representation of the analyzed plurality of core parameters to the user on the augmented reality device; and
adjusting, by the user, the conversation with the individual based on the representation of the analyzed plurality of core parameters.

2. The method of claim 1 , wherein the augmented reality device is a device that has a plurality of features that capture a plurality of core parameter data from a real life interaction between the user and at least one other individual, and wherein the augmented reality device has the plurality of features that capture a plurality of core parameter data from historical sources.

3. The method of claim 1 , wherein the received input on the augmented reality device is selected from a group consisting of a plurality of sound of voice data, a plurality of body language data, a plurality of biometric feature data and a location of the user and at least one other individual.

4. The method of claim 1 , wherein the captured core parameters include physical proximity between the user and at least one other individual, a social media network connection between the user and at least one other individual, a number of historical common interests between the user and at least one other individual and the communication distance between the user and at least one other individual, wherein the communication distance includes an analysis of known individuals to the user, unknown individuals to the user, mutual friends between the user and the individual, professional network connections between the user and the individual and a physical distance of residence between the user and the individual.

5. The method of claim 1 , wherein the captured core parameters are analyzed using natural language processing, sentiment analysis and semantic analysis.

6. The method of claim 1 , wherein the plurality of core parameters are analyzed by measuring a quality of the conversation, wherein measurements are selected from a group consisting of a biometric feature, a plurality of words, a plurality of body language and a social graph.

7. The method of claim 1 , wherein analyzing the core parameters produces a metric for the augmented reality device to notify the user, and wherein the metric is indicative of a level of engagement in the conversation.

8. A computer system for interpreting conversation engagement, comprising:
one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:
receiving, by an augmented reality device, an input, wherein the augmented reality device is associated with a user;
analyzing the received input;
determining that the user is engaged in a conversation with an individual based on the analyzed input, wherein a level of engagement is used to determine that the user and the individual are engaged in the conversation based on a quantifiable threshold parameter, wherein the quantifiable threshold parameter indicates a degree of conversation, wherein the degree of the conversation is low, medium or high, wherein the degree of conversation is scored between 0 and 1;
capturing a plurality of core parameters between the user and the individual based on the degree of conversation being medium or high, wherein the plurality of core parameters further quantifies the level of engagement between the user and the individual by assigning a weight to the individual based on a level of connection between the user and the individual;
determining that the individual is unknown to the user, wherein an intention of the conversation is monitored to indicate a willingness and an ability to speak on a particular topic;
analyzing the captured plurality of core parameters, wherein a characteristic model is built beginning with a random guess associated with features of the individual and interests of the user, wherein a communication distance is assigned between the user and the individual, wherein the communication distance is optimized for the user by refining the characteristic model, wherein the characteristic model is built using keypoint extraction;
delivering a representation of the analyzed plurality of core parameters to the user on the augmented reality device; and
adjusting, by the user, the conversation with the individual based on the representation of the analyzed plurality of core parameters.

9. The computer system of claim 8 , wherein the augmented reality device is a device that has a plurality of features that capture a plurality of core parameter data from a real life interaction between the user and at least one other individual, and wherein the augmented reality device has the plurality of features that capture a plurality of core parameter data from historical sources.

10. The computer system of claim 8 , wherein the received input on the augmented reality device is selected from a group consisting of a plurality of sound of voice data, a plurality of body language data, a plurality of biometric feature data and a location of the user and at least one other individual.

11. The computer system of claim 8 , wherein the captured core parameters include a physical proximity between the user and at least one other individual, a social media network connection between the user and at least one other individual, a number of historical common interests between the user and at least one other individual and the communication distance between the user and at least one other individual, wherein the communication distance includes an analysis of known individuals to the user, unknown individuals to the user, mutual friends between the user and the individual, professional network connections between the user and the individual and

Assignees

• IBM

Inventors

• Bastide Paul R
• Broomhall Matthew E
• Loredo Robert E
• Srinivasan Sathyanarayanan

Classifications

• G06Q10/40

  Business processes related to social networking or social networking services · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F40/30 Primary

  Semantic analysis · CPC title

• H04M2201/50

  Telephonic communication in combination with video communication · CPC title

• G06F16/9535

  Search customisation based on user profiles and personalisation · CPC title