Detection and Classification of Cyberbullying Using CR*

Abstract

Cyberbullying is one of the latest threats in the online world, affecting millions of people worldwide. The detection of cyberbullying became a challenging task due to the complexity involved. In this paper, we propose a novel approach for cyberbullying detection using CR* which concatenates the deep learning model’s features such as Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) which helps in detecting text, audio, and emoji. Initially, we collect a dataset of cyberbullying messages from social media platforms. Then we integrate convolutional neural networks and recurrent neural networks to build our deep learning model entitled Convolutional Recurrent (CR*) to extract features from a combination of the text data, emoji, and audio. The multimodal features were then concatenated and passed through fully connected layers for classification. The proposed approach can be useful for detecting cyberbullying on various online platforms and can help prevent the spread of cyberbullying.

Introduction

I. INTRODUCTION

Cyberbullying is a pervasive and serious problem in today's society, particularly in online social media platforms. Cyberbullying can have severe emotional and psychological consequences for victims, including depression, anxiety, and even suicide. Therefore, the development of effective cyberbullying detection systems is essential to prevent and mitigate the harmful effects of cyberbullying. Many researchers have recently developed various machine learning and deep learning models to detect cyberbullying. However, earlier systems have limitations and issues such as limited modality support, limited dataset size, lack of multimodal fusion, and limited audio and emoji representation. In this paper, we propose a solution for the detection of cyberbullying using text, audio, and emoji data. Our proposed system utilizes CNN and RNN model features to build our hybrid deep-learning model CR*.

This paper aims to discuss the limitations and issues of earlier cyberbullying detection systems, present our proposed system, and evaluate its performance using different metrics such as accuracy rate, precision, recall, and F1 score. The results of our proposed system will contribute to developing more effective and comprehensive cyberbullying detection systems.

II. LITERATURE SURVEY

Lee Jia Thun, Phoey Lee Teh, and Chi-Bin Cheng researched using machine learning to identify language that contains cyberbullying. The suggested method is trained to utilize features like variation in text seen in social media context and social network environment interactions. The machine may also determine through users' gender or whether they have used hate speech. To close the gaps and overcome the restrictions of current apps, this study suggests a mechanism that combines the best cyberbullying detection features. According to the study's findings, the suggested mobile application is more accurate than other ones at spotting cyberbullies.

Belal Abdullah Hezam Murshed., Jemal Abaway., et al., have proposed a hybrid deep learning model, called DEA-RNN, to detect Cyberbullying on Twitter social media networks. The Elman-type Recurrent Neural Networks (RNN) and Dolphin Echolocation Algorithm (DEA) are merged into the proposed DEA-RNN approach to enhance the Elman RNN's parameters and minimize training time. Using a dataset of 10,000 tweets, they thoroughly evaluated DEA-RNN and compared its performance with that of cutting-edge algorithms like Bi-directional long short-term memory (Bi-LSTM), RNN, SVM, Multinomial Naive Bayes (MNB), and Random Forests (RF). According to the experimental findings, DEA-RNN was preferred in every situation.

It performed much better than the evaluated existing methods while detecting CB on the Twitter network. In scenario 3, DEA-RNN was more effective and achieved an average of 90.45% accuracy, 89.52% precision, 88.98% recall, 89.25% F1-score, and 90.94% specificity.

Mithushi Raj., Kanishka Solanki., et al., have proposed a cyberbullying detection system to detect cyberbullying in text format. In this study, we put forth a deep learning system that will analyze Twitter tweets sent in real time and find any instances of cyberbullying.

Recent research has demonstrated that deep neural network-based methods are superior to traditional ones for identifying texts that contain cyberbullying. Furthermore, our software can detect cyberbullying posts written in English, Hindi, and Hinglish (Multilingual data).

Xiao-Zhi Gao, Tapan Kumar Das, et al. have proposed Deep Convolutional Neural Network(DCNN)-based automated approach to identify cyberbullying.

In addition to employing Convolutional neural network, the proposed DCNN model uses the Twitter text and GloVe embedding vector to extract the semantics from the messages. It outperformed the current models and attained the best precision, recall, and F1-score values of 0.93, 0.88, and 0.92.

III. LIMITATIONS IN THE EXISTING

A. System

1. Limited Modality Support: Some earlier systems only supported text-based cyberbullying detection, which means they were not able to detect cyberbullying in audio or emoji data.
2. Limited Dataset Size: Many earlier systems were trained on small datasets, which limited their ability to generalize to new data and detect rare cyberbullying events.
3. Lack of Multimodal Fusion: Some earlier systems did not incorporate multimodal fusion techniques, which means they did not fully leverage the complementary nature of text, audio, and emoji data.
4. Limited Audio Data Availability: Cyberbullying can occur in audio formats, such as in voice messages or calls. However, cyberbullying detection for audio formats can be challenging, which limits the effectiveness of models that rely on audio data.
5. Limited Emoji Representation: Emojis are a popular form of communication on social media, and can be used to convey emotions or attitudes in text messages. However, some earlier systems did not fully consider the meaning and context of emojis, which led to incorrect or biased classifications. Additionally, some languages have different interpretations of certain emojis, which further complicates the detection of cyberbullying in emoji data.

IV. PROPOSED WORK

Our proposed system for cyberbullying detection with text, audio, and emoji utilizes CNN and RNN model features to build our deep learning model CR* that leverages multimodal fusion techniques to improve detection accuracy.

A. Input

The first step will be collecting a dataset of cyberbullying messages from various social media platforms which are labelled as cyberbullying or non-cyberbullying.

B. Process

Initial step would be preprocessing, which involves cleaning data, and removing punctuations, stop words, single characters, and multiple spaces. If the input is in the form of audio, first it gets converted to text format. The input text is then converted into a sequence of integers using a tokenizer.

Then, an embedding layer is used to convert each integer into a dense vector of fixed size. Next, a convolutional layer is applied to capture local patterns in the text.

A pooling layer follows this to reduce the dimensionality of the output. Then, a recurrent layer is used to capture the global context of the text. Finally, the concatenated features are passed through fully connected layers for classification. The output is a binary classification, indicating whether the message contains cyberbullying content or not.

C. Output

The hybrid model detects and classifies them as cyberbullying and not cyberbullying. The performance of the model will be evaluated using standard metrics such as accuracy rate, precision, recall, and F1 score. Cross-validation also has been done to ensure that the model generalizes well to new data.

VII. ACKNOWLEDGEMENT

We are deeply indebted to Dr.M.S.Anbarasi, Assistant Professor, Department of Information Technology, Puducherry Technological University, Puducherry, India.

Conclusion

In conclusion, cyberbullying is a serious issue that affects many individuals on social media platforms, and the detection of cyberbullying is essential to prevent its harmful effects. In this paper, we presented a proposed solution for cyberbullying detection with text, audio, and emoji data using a CR* model. We discussed the limitations and issues of earlier systems, including limited modality support, limited dataset size, lack of multimodal fusion, and limited audio and emoji representation. Our proposed system overcomes these limitations and provides a more comprehensive and achieved average of 92.15% accuracy, 81.7% Precision, 93.8% Recall and 87.3% F1-score. Future work can explore increasing the size and diversity of the dataset to improve the model\'s ability to detect rare, complex, and multilingual cyberbullying events. Overall, we believe our proposed system can make a valuable contribution to the field of cyberbullying detection and help promote a safer and more inclusive social media environment.

References

[1] Lee Jia Thun; Phoey Lee Teh; Chi-Bin Cheng; (2022). CyberAid: Are your children safe from cyberbullying? Journal of King Saud University - Computer and Information Sciences, Elsevier, –. doi:10.1016/j.jksuci.2021.03.001 [2] B. A. H. Murshed, J. Abawajy, S. Mallappa, M. A. N. Saif and H. D. E. Al-Ariki, \"DEA-RNN: A Hybrid Deep Learning Approach for Cyberbullying Detection in Twitter Social Media Platform,\" in IEEE Access, vol. 10, pp. 25857-25871, 2022, doi:10.1109/ACCESS.2022.3153675. [3] P. K. Roy, A. K. Tripathy, T. K. Das, and [4] X. -Z. Gao, \"A Framework for Hate Speech Detection Using Deep Convolutional Neural Network,\" in IEEE Access, vol. 8, pp. 204951-204962, 2021, doi: 10.1109/ACCESS.2020.3037073. [5] Raj, M., Singh, S., Solanki, K. et al. An Application to Detect Cyberbullying Using Machine Learning and Deep Learning Techniques. SN COMPUT. SCI. 3, 401 (2022),Springer. https://doi.org/10.1007/s42979-022-01308-5 [6] Bellmore, A. J. Calvin, J.-M. Xu, and X. Zhu, ‘‘The five W’s of ‘bullying on Twitter: Who, what, why, where, and when,’’ Comput. Hum. [7] Behav., vol. 44, pp. 305–314, Mar. 2022 [8] Dadvar, M., Jong, D. F., Ordelman, R., & Trieschnigg, D. (2018). Improved cyberbullying detection using gender information. In Proceedings of the Twelfth Dutch-Belgian Information Retrieval (DIR 2022). The University of Ghent. [9] M. A. Al-Garadi, K. D. Varathan, and S. [10] Ravana, ‘‘Cybercrime detection in online communications: The experimental case of cyberbullying detection in the Twitter network,’’ Comput. Hum. Behav., vol. 63, pp. 433–443, Oct. 2022. [11] R. Zhao, A. Zhou, and K. Mao, ‘‘Automatic detection of cyberbullying on social networks based on bullying features,’’ in Proc. 17th Int. Conf. Distrib. Comput. Netw., 2022, Art. no. 43. [12] Y. Chen, Y. Zhou, S. Zhu, and H. Xu, ‘‘Detecting offensive language in social media to protect adolescent online safety,’’ in Proc. Int. Conf. Privacy, Security., Risk Trust (PASSAT), Sep. 2022, pp. 71–80. [13] Nahar, V., Li, X., Pang, C., & Zhang, Y. (2021). Cyberbullying detection based on text-stream classification. In The 11th Australasian Data Mining Conference (AusDM 2022). [14] Dinakar, K., Reichart, R., and Lieberman, H., “Modelling the detection of textual cyberbullying,” Social Mobile Web Workshop at International Conference on Weblog and Social Media, Barcelona, Spain, July 17-21,2021.

Copyright

Copyright © 2023 Gayathri R, Lydia Beryl D, Gowtham M, Naveen Kumar N, Dr. M. S. Anbarasi. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.