Automatic detection of user personality traits based on social media image posts

Patent metadata

Field	Value
Publication number	US-2017193533-A1
Application number	US-201514985581-A
Country	US
Kind code	A1
Filing date	Dec 31, 2015
Priority date	Dec 31, 2015
Publication date	Jul 6, 2017
Grant date	—

Abstract

Embodiments are directed to a computer implemented method of analyzing image data. The method includes receiving, using a processor system, image data of one or more images and associated text data that have been posted by a user. The method further includes analyzing the image and text data to extract one or more image and one or more text features, and analyzing the one or more image and one or more text features to predict personality traits, needs and values of the user.

First claim

What is claimed is:

1 . A computer implemented method of analyzing image data, the method comprising:
receiving, using a processor system, image data of one or more images that have been posted by a user; analyzing, using the processor system, the image data to extract one or more image features; and analyzing, using the processor system, the one or more image features to predict personality traits of the user.

2 . The computer implemented method of claim 1 , wherein:
the processor system includes a machine learning module; and the analyzing of the one or more image features to predict the personality traits of the user is performed using the machine learning module.

3 . The computer implemented method of claim 2 , wherein:
the machine learning module includes a trainable machine learning algorithm; and the method further comprises training the trainable machine learning algorithm.

4 . The computer implemented method of claim 1 further comprising:
analyzing, using the processor system, the image data to extract one or more textual features of textual content associated with the one or more images; and
analyzing, using the processor system, the one or more textual features to further predict the personality traits of the user.

5 . The computer implemented method of claim 4 , wherein:
the processor system includes a machine learning module; the analyzing of the one or more image features to predict the personality traits of the user is performed using the machine learning module; and the analyzing of the one or more textual features to further predict the personality traits of the user is performed using the machine learning module.

6 . The computer implemented method of claim 5 , wherein:
the machine learning module includes a trainable machine learning algorithm; and the method further comprises training the trainable machine learning algorithm.

7 . The computer implemented method of claim 1 further comprising:
analyzing, using the processor system, the one or more image features to predict needs or values of the user; and
deriving a targeted business strategy based at least in part on the personality traits, needs or values of the user.

8 . A computer system for analyzing image data, the system comprising:
a memory; and a processor system communicatively coupled to the memory; the processor system configured to perform a method comprising: receiving image data of one or more images that have been posted by a user; analyzing the image data to extract one or more image features; and analyzing the one or more image features to predict personality traits of the user.

9 . The computer system of claim 8 , wherein:
the processor system includes a machine learning module; and the analyzing of the one or more image features to predict the personality traits of the user is performed using the machine learning module.

10 . The computer system of claim 9 , wherein:
the machine learning module includes a trainable machine learning algorithm; and the method further comprises training the trainable machine learning algorithm.

11 . The computer system of claim 8 further comprising:
analyzing, using the processor system, the image data to extract one or more textual features of textual content associated with the one or more images; and
analyzing, using the processor system, the one or more textual features to further predict the personality traits of the user.

12 . The computer system of claim 11 , wherein:
the processor system includes a machine learning module; the analyzing of the one or more image features to predict the personality traits of the user is performed using the machine learning module; and the analyzing of the one or more textual features to further predict the personality traits of the user is performed using the machine learning module.

13 . The computer system of claim 12 , wherein:
the machine learning module includes a trainable machine learning algorithm; and the method further comprises training the trainable machine learning algorithm.

14 . The computer system of claim 8 further comprising:
analyzing the one or more images features to predict values or needs of the user; and
deriving a targeted business strategy based at least in part on the personality traits, values or needs of the user.

15 . A computer program product for analyzing image data, the computer program product comprising:
a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions readable by a processor system to cause the processor system to perform a method comprising: receiving image data of one or more images that have been posted by a user; analyzing the image data to extract one or more image features; and analyzing the one or more image features to predict personality traits of the user.

16 . The computer program product of claim 15 , wherein:
the processor system includes a machine learning module; and the analyzing of the one or more image features to predict the personality traits of the user is performed using the machine learning module.

17 . The computer program product of claim 16 , wherein:
the machine learning module includes a trainable machine learning algorithm; and the method further comprises training the trainable machine learning algorithm.

18 . The computer program product of claim 15 further comprising:
analyzing, using the processor system, the image data to extract one or more textual features of textual content associated with the one or more images; and
analyzing, using the processor system, the one or more textual features to further predict the personality traits of the user.

19 . The computer program product of claim 18 , wherein:
the processor system includes a machine learning module; the analyzing of the one or more image features to predict the personality traits of the user is performed using the machine learning module; the analyzing of the one or more textual features to further predict the personality traits of the user is performed using the machine learning module. the machine learning module includes a trainable machine learning algorithm; and the method further comprises training the trainable machine learning algorithm.

20 . The computer program product of claim 15 further comprising:
analyzing the one or more features to predict values or needs of the user; and
controlling a business strategy development system to derive a targeted business strategy based at least in part on the personality traits, needs or values of the user.

Assignees

• IBM

Inventors

• Lai Jennifer
• Pervin Shaila
• Phan Anna
• Sherchan Wanita

Classifications

• G06F18/256

  of results relating to different input data, e.g. multimodal recognition · CPC title

• G06V10/454

  Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN] · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/09

  Supervised learning · CPC title

• G06K9/325

  Physics · mapped topic