This paper is published in Volume-6, Issue-3, 2020
Area
Computer Science Engineering
Author
S. Avinash
Co-authors
Satarup, Nilanjana Adhikary
Org/Univ
SRM Institute of Science and Technology, Chennai, Tamil Nadu, India
Pub. Date
13 May, 2020
Paper ID
V6I3-1195
Publisher
Keywords
Data set and preprocessing, Classification of Tweets, Feature extraction, Social network analyzer

Citationsacebook

IEEE
S. Avinash, Satarup, Nilanjana Adhikary. Detecting hate speech and offensive language on Twitter using Machine Learning, International Journal of Advance Research, Ideas and Innovations in Technology, www.IJARIIT.com.

APA
S. Avinash, Satarup, Nilanjana Adhikary (2020). Detecting hate speech and offensive language on Twitter using Machine Learning. International Journal of Advance Research, Ideas and Innovations in Technology, 6(3) www.IJARIIT.com.

MLA
S. Avinash, Satarup, Nilanjana Adhikary. "Detecting hate speech and offensive language on Twitter using Machine Learning." International Journal of Advance Research, Ideas and Innovations in Technology 6.3 (2020). www.IJARIIT.com.

Abstract

In this work, we argue for a focus on the latter problem for practical reasons. We show that it is a much more challenging task, as our analysis of the language in the typical datasets shows that hate speech lacks unique, discriminative features and therefore is found in the ‘long tail’ in a dataset that is difficult to discover. We then propose a Deep Neural Network structure serving as feature extractors that are particularly effective for capturing the semantics of hate speech. Our methods are evaluated on the largest collection of hate speech datasets based on Twitter and are shown to be able to outperform state of the art by up to 6 percentage points in macro-average F1, or 9 percentage points in the more challenging case of identifying hateful content. This aims to classify textual content into non-hate or hate speech, in which case the method may also identify the targeting characteristics (i.e., types of hate, such as race, and religion) in the hate speech.