First impressions - predicting user personality from Twitter profile images

Abhinav Dhall, Jesse Hoey

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

4 Citations (Scopus)

Abstract

This paper proposes a computer vision based pipeline for inferring the perceived personality of users from their Twitter profile images. We humans make impressions on a daily basis during communication. The perception of personality of a person gives information about the person’s behaviour and is an important attribute in developing rapport. The personality assessment in this paper is referred to as first impressions, which is similar to how humans create a mental image of another person by just looking at their profile pictures. In the proposed automated pipeline, hand crafted (engineered) and learnt feature descriptors are computed on user profile images. The effect of image background is assessed on the perception of the personality from a profile picture. A multivariate regression approach is used to predict the big five personality traits - agreeableness, conscientiousness, extraversion, openness and neuroticism. We study the correlation between the big five personality traits generated from Tweet analysis with the proposed profile image based framework. The experiments show high correlation for scene based first impressions perception. It is interesting to note that the results generated by analysing a profile image uploaded by a user in a particular point in time are in sync with the first impression traits generated by investigating Tweets posted over a longer duration of time.

Original languageEnglish
Title of host publicationHuman Behavior Understanding
Subtitle of host publication7th International Workshop, HBU 2016 Amsterdam, The Netherlands, October 16, 2016 Proceedings
EditorsMohamed Chetouani, Jeffrey Cohn, Albert Ali Salah
Place of PublicationCham Switzerland
PublisherSpringer
Pages148-158
Number of pages11
ISBN (Electronic)9783319468433
ISBN (Print)9783319468426
DOIs
Publication statusPublished - 2016
Externally publishedYes
EventInternational Workshop on Human Behavior Understanding 2016 - Amsterdam, Netherlands
Duration: 16 Oct 201616 Oct 2016
Conference number: 7th
https://www.cmpe.boun.edu.tr/hbu/2016/

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume9997
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceInternational Workshop on Human Behavior Understanding 2016
Abbreviated titleHBU 2016
CountryNetherlands
CityAmsterdam
Period16/10/1616/10/16
Internet address

Keywords

  • Big five personality traits
  • Personality perception
  • Profile images
  • Scene descriptors

Cite this

Dhall, A., & Hoey, J. (2016). First impressions - predicting user personality from Twitter profile images. In M. Chetouani, J. Cohn, & A. A. Salah (Eds.), Human Behavior Understanding: 7th International Workshop, HBU 2016 Amsterdam, The Netherlands, October 16, 2016 Proceedings (pp. 148-158). (Lecture Notes in Computer Science ; Vol. 9997 ). Springer. https://doi.org/10.1007/978-3-319-46843-3_10