A mathematical approach to correlating objective spectro-temporal features of non-linguistic sounds with their subjective perceptions in humans

Thomas Burns, Ramesh Rajan

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Non-linguistic sounds (NLSs) are a core feature of our everyday life and many evoke powerful cognitive and emotional outcomes. The subjective perception of NLSs by humans has occasionally been defined for single percepts, e.g., their pleasantness, whereas many NLSs evoke multiple perceptions. There has also been very limited attempt to determine if NLS perceptions are predicted from objective spectro-temporal features. We therefore examined three human perceptions well-established in previous NLS studies (“Complexity,” “Pleasantness,” and “Familiarity”), and the accuracy of identification, for a large NLS database and related these four measures to objective spectro-temporal NLS features, defined using rigorous mathematical descriptors including stimulus entropic and algorithmic complexity measures, peaks-related measures, fractal dimension estimates, and various spectral measures (mean spectral centroid, power in discrete frequency ranges, harmonicity, spectral flatness, and spectral structure). We mapped the perceptions to the spectro-temporal measures individually and in combinations, using complex multivariate analyses including principal component analyses and agglomerative hierarchical clustering.

Original languageEnglish
Article number794
Number of pages14
JournalFrontiers in Neuroscience
Volume13
DOIs
Publication statusPublished - 31 Jul 2019

Keywords

  • Auditory perception
  • Complexity
  • Environmental sounds
  • Non-linguistic sounds
  • Pleasantness
  • Psychoacoustics
  • Psychophysics
  • Subjective perception

Cite this

@article{59eab4a9243e403d8a0daad8dd97b4d9,
title = "A mathematical approach to correlating objective spectro-temporal features of non-linguistic sounds with their subjective perceptions in humans",
abstract = "Non-linguistic sounds (NLSs) are a core feature of our everyday life and many evoke powerful cognitive and emotional outcomes. The subjective perception of NLSs by humans has occasionally been defined for single percepts, e.g., their pleasantness, whereas many NLSs evoke multiple perceptions. There has also been very limited attempt to determine if NLS perceptions are predicted from objective spectro-temporal features. We therefore examined three human perceptions well-established in previous NLS studies (“Complexity,” “Pleasantness,” and “Familiarity”), and the accuracy of identification, for a large NLS database and related these four measures to objective spectro-temporal NLS features, defined using rigorous mathematical descriptors including stimulus entropic and algorithmic complexity measures, peaks-related measures, fractal dimension estimates, and various spectral measures (mean spectral centroid, power in discrete frequency ranges, harmonicity, spectral flatness, and spectral structure). We mapped the perceptions to the spectro-temporal measures individually and in combinations, using complex multivariate analyses including principal component analyses and agglomerative hierarchical clustering.",
keywords = "Auditory perception, Complexity, Environmental sounds, Non-linguistic sounds, Pleasantness, Psychoacoustics, Psychophysics, Subjective perception",
author = "Thomas Burns and Ramesh Rajan",
year = "2019",
month = "7",
day = "31",
doi = "10.3389/fnins.2019.00794",
language = "English",
volume = "13",
journal = "Frontiers in Neuroscience",
issn = "1662-453X",
publisher = "Frontiers Research Foundation",

}

A mathematical approach to correlating objective spectro-temporal features of non-linguistic sounds with their subjective perceptions in humans. / Burns, Thomas; Rajan, Ramesh.

In: Frontiers in Neuroscience, Vol. 13, 794, 31.07.2019.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - A mathematical approach to correlating objective spectro-temporal features of non-linguistic sounds with their subjective perceptions in humans

AU - Burns, Thomas

AU - Rajan, Ramesh

PY - 2019/7/31

Y1 - 2019/7/31

N2 - Non-linguistic sounds (NLSs) are a core feature of our everyday life and many evoke powerful cognitive and emotional outcomes. The subjective perception of NLSs by humans has occasionally been defined for single percepts, e.g., their pleasantness, whereas many NLSs evoke multiple perceptions. There has also been very limited attempt to determine if NLS perceptions are predicted from objective spectro-temporal features. We therefore examined three human perceptions well-established in previous NLS studies (“Complexity,” “Pleasantness,” and “Familiarity”), and the accuracy of identification, for a large NLS database and related these four measures to objective spectro-temporal NLS features, defined using rigorous mathematical descriptors including stimulus entropic and algorithmic complexity measures, peaks-related measures, fractal dimension estimates, and various spectral measures (mean spectral centroid, power in discrete frequency ranges, harmonicity, spectral flatness, and spectral structure). We mapped the perceptions to the spectro-temporal measures individually and in combinations, using complex multivariate analyses including principal component analyses and agglomerative hierarchical clustering.

AB - Non-linguistic sounds (NLSs) are a core feature of our everyday life and many evoke powerful cognitive and emotional outcomes. The subjective perception of NLSs by humans has occasionally been defined for single percepts, e.g., their pleasantness, whereas many NLSs evoke multiple perceptions. There has also been very limited attempt to determine if NLS perceptions are predicted from objective spectro-temporal features. We therefore examined three human perceptions well-established in previous NLS studies (“Complexity,” “Pleasantness,” and “Familiarity”), and the accuracy of identification, for a large NLS database and related these four measures to objective spectro-temporal NLS features, defined using rigorous mathematical descriptors including stimulus entropic and algorithmic complexity measures, peaks-related measures, fractal dimension estimates, and various spectral measures (mean spectral centroid, power in discrete frequency ranges, harmonicity, spectral flatness, and spectral structure). We mapped the perceptions to the spectro-temporal measures individually and in combinations, using complex multivariate analyses including principal component analyses and agglomerative hierarchical clustering.

KW - Auditory perception

KW - Complexity

KW - Environmental sounds

KW - Non-linguistic sounds

KW - Pleasantness

KW - Psychoacoustics

KW - Psychophysics

KW - Subjective perception

UR - http://www.scopus.com/inward/record.url?scp=85070584176&partnerID=8YFLogxK

U2 - 10.3389/fnins.2019.00794

DO - 10.3389/fnins.2019.00794

M3 - Article

VL - 13

JO - Frontiers in Neuroscience

JF - Frontiers in Neuroscience

SN - 1662-453X

M1 - 794

ER -