Sentiment based social media comment overlay on image posts

Patent metadata

Field	Value
Publication number	US-10026023-B2
Application number	US-201615234159-A
Country	US
Kind code	B2
Filing date	Aug 11, 2016
Priority date	Aug 11, 2016
Publication date	Jul 17, 2018
Grant date	Jul 17, 2018

Abstract

By performing Natural Language Processing (NLP) on a comment to a social media post, an entity that is referenced in the comment is extracted. The entity is an object other than a human face that is depicted in an image in the post. The image is analyzed to determine whether the entity is represented in the image. When the entity is represented in the image, a sentiment value of the comment is computed relative to the entity. A value corresponding to the sentiment value is assigned to a characteristic of a graphical artifact. A position is determined relative to an area occupied by the entity in the image. The graphical artifact is caused to be overlaid on the image at the position and with the value of the characteristic.

First claim

What is claimed is:

1. A method comprising:
extracting, using a processor and a memory to perform Natural Language Processing (NLP) on a comment to a social media post, an entity that is referenced in the comment, the entity being an object other than a human face that is depicted in an image in the post;
analyzing the image to determine whether the entity is represented in the image;
computing, responsive to the entity being represented in the image, a sentiment value of the comment relative to the entity;
assigning, to a characteristic of a graphical artifact, a value corresponding to the sentiment value;
determining a position relative to an area occupied by the entity in the image;
causing the graphical artifact to be overlaid on the image at the position and with the value of the characteristic;
determining that a set of comments references the entity, the set including the comment;
computing a second sentiment value of a second comment in the set of comments; and
combining the sentiment value with the second sentiment value to form an overall sentiment value; and
using the overall sentiment value as the sentiment value in the assigning.

2. The method of claim 1 , further comprising:
locating, responsive to the entity being represented in the image, the area occupied by the entity in the image.

3. The method of claim 2 , wherein the area comprises:
only the pixels that form the entity.

4. The method of claim 1 , wherein the value of the characteristic is a color of the graphical artifact.

5. The method of claim 1 , further comprising:
assigning, to a second characteristic of the graphical artifact, a second value, the second value corresponding to a number of comments in the post that refer to the entity.

6. The method of claim 1 , further comprising:
assigning, to a second characteristic of the graphical artifact, a second value, the second value corresponding to a number of commentators who have supplied comments in the post, wherein the comments refer to the entity.

7. The method of claim 1 , further comprising:
averaging, as a part of the combining, the sentiment value and the second sentiment value.

8. The method of claim 1 , further comprising:
performing image analysis, as a part of the determining whether the entity is represented in the image is accomplished, without relying on a keyword in a metadata of the image.

9. The method of claim 1 , wherein the comment is an update to an existing comment.

10. The method of claim 1 , wherein the entity is referenced in the comment indirectly without identifying the entity.

11. A computer usable program product comprising one or more computer-readable storage devices, and computer usable code stored on at least one of the one or more storage devices, the stored computer usable code comprising:
program instructions to extract, using a processor and a memory to perform Natural Language Processing (NLP) on a comment to a social media post, an entity that is referenced in the comment, the entity being an object other than a human face that is depicted in an image in the post;
program instructions to analyze the image to determine whether the entity is represented in the image;
program instructions to compute, responsive to the entity being represented in the image, a sentiment value of the comment relative to the entity;
program instructions to assign, to a characteristic of a graphical artifact, a value corresponding to the sentiment value;
program instructions to determine a position relative to an area occupied by the entity in the image;
program instructions to cause the graphical artifact to be overlaid on the image at the position and with the value of the characteristic;
program instructions to determine that a set of comments references the entity, the set including the comment;
program instructions to compute a second sentiment value of a second comment in the set of comments; and
program instructions to combine the sentiment value with the second sentiment value to form an overall sentiment value; and
program instructions to use the overall sentiment value as the sentiment value in the program instructions to assign.

12. The computer usable program product of claim 11 , further comprising:
program instructions to locate, responsive to the entity being represented in the image, the area occupied by the entity in the image.

13. The computer usable program product of claim 11 , wherein the area comprises:
only the pixels that form the entity.

14. The computer usable program product of claim 11 , wherein the value of the characteristic is a color of the graphical artifact.

15. The computer usable program product of claim 11 , further comprising:
program instructions to assign, to a second characteristic of the graphical artifact, a second value, the second value corresponding to a number of comments in the post that refer to the entity.

16. The computer usable program product of claim 11 , further comprising:
program instructions to assign, to a second characteristic of the graphical artifact, a second value, the second value corresponding to a number of commentators who have supplied comments in the post, wherein the comments refer to the entity.

17. The computer usable program product of claim 11 , wherein the computer usable code is stored in a computer readable storage device in a data processing system, and wherein the computer usable code is transferred to the data processing system over a network from a remote data processing system.

18. The computer usable program product of claim 11 , wherein the computer usable code is stored in a computer readable storage device in a server data processing system, and wherein the computer usable code is downloaded from the server data processing system over a network to a remote data processing system for use in a computer readable storage device associated with the remote data processing system.

19. A computer system comprising one or more processors, one or more computer-readable memories, and one or more computer-readable storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the stored program instructions comprising:
program instructions to extract, using a processor and a memory to perform Natural Language Processing (NLP) on a comment to a social media post, an entity that is referenced in the comment, the entity being an object other than a human face that is depicted in an image in the post;
program instructions to analyze the image to determine whether the entity is represented in the image;
program instructions to compute, responsive to the entity being represented in the image, a sentiment value of the comment relative to the entity;
program instructions to assign, to a characteristic of a graphical artifact, a value corresponding to the sentiment value;
program instructions to determine a position relative to an area occupied by the entity in the image;
program instructions to cause the graphical artifact to be overlaid on the image at the position and with the value of the characteristic;
program instructions to determine that a set of comments references the entity, the set including the comment;
program instructions to compute a second sentiment value of a second comment in the set of comments; and
program instructions to combine the sentiment value with the second sentiment value to form an overall sentiment value

Assignees

• IBM

Inventors

• Greenberger Jeremy A
• Greenberger Zachary M
• Hewitt Trudy L

Classifications

• G06V30/274 Primary

  Syntactic or semantic context, e.g. balancing · CPC title

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06Q10/40 Primary

  Business processes related to social networking or social networking services · CPC title

• G06F40/295

  Named entity recognition · CPC title

• G06F40/30

  Semantic analysis · CPC title