Privacy-preserving classification of personal text messages with secure multi-party computation: an application to hate-speech detection

Devin Reich, Ariel Todoki, Rafael Dowsley, Martine De Cock, Anderson Nascimento

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Classification of personal text messages has many useful applications in surveillance, e-commerce, and mental health care, to name a few. Giving applications access to personal texts can easily lead to (un)intentional privacy violations. We propose the first privacy-preserving solution for text classification that is provably secure. Our method, which is based on Secure Multiparty Computation (SMC), encompasses both feature extraction from texts, and subsequent classification with logistic regression and tree ensembles. We prove that when using our secure text classification method, the application does not learn anything about the text, and the author of the text does not learn anything about the text classification model used by the application beyond what is given by the classification result itself. We perform end-to-end experiments with an application for detecting hate speech against women and immigrants, demonstrating excellent runtime results without loss of accuracy.

Original languageEnglish
Title of host publicationNIPS Proceedings - Advances in Neural Information Processing Systems 32 (NIPS 2019)
EditorsH. Wallach, H. Larochelle, A. Beygelzimer, F. d'AlcheBuc, E. Fox, R. Garnett
Place of PublicationSan Diego CA USA
PublisherNeural Information Processing Systems (NIPS)
Pages3752-3764
Number of pages13
Volume32
Publication statusPublished - 2019
Externally publishedYes
EventAdvances in Neural Information Processing Systems 2019 - Vancouver, Canada
Duration: 8 Dec 201914 Dec 2019
Conference number: 32nd
https://nips.cc/Conferences/2019 (Proceedings)
https://papers.nips.cc/book/advances-in-neural-information-processing-systems-32-2019 (Proceedings)

Publication series

NameAdvances in Neural Information Processing Systems
ISSN (Print)1049-5258

Conference

ConferenceAdvances in Neural Information Processing Systems 2019
Abbreviated titleNIPS 2019
CountryCanada
CityVancouver
Period8/12/1914/12/19
Internet address

Cite this