Enhancement of Support Vector Machine utilizing RoBERTa applied to Sentiment Analysis of Facebook Data

• Author(s): Patricia Mae A. Samson ; Eunna Jazrel M. Arcilla ; Raymund M. Dioses; Florencio V. Contreras Jr. ; Richard C. Regala; Jonathan C. Morano ; Leisyl M. Mahusay; Jamillah S. Guialil
• Paper ID: 1705811
• Page: 386-391
• Published Date: 20-05-2024
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 7 Issue 11 May-2024

Abstract

Many people are using social media sites like Facebook to express their opinions, experiences, or whatever they want to post online. Understanding user sentiment has become crucial for various applications, ranging from marketing to public opinion analysis. Researchers use natural language processing (NLP) and machine learning algorithms to evaluate textual information from Facebook posts and classify sentiments as positive, negative, or neutral. This study delves into sentiment analysis of Facebook data to better understand how users express their emotions. Additionally, the method addresses the limitations of sentiment analysis on social media due to informal language, slang, and context-dependent phrases. The study aims to develop an enhanced Support Vector Machine algorithm for sentiment analysis of Facebook data by utilizing the RoBERTa (A Robustly optimized BERT) model. To enhance sentiment accuracy, thus the performance of the traditional SVM algorithm, the proposed approach uses VADER to predict initial sentiment labels, loads a pre-trained RoBERTa model as preprocessing techniques, fine-tunes the RoBERTa model and extracts RoBERTa embeddings to optimize the SVM algorithm. This improves the model's capacity to handle imbalanced datasets and efficiently manage larger datasets while filtering out noisy or irrelevant characteristics. To analyze the performance of the proposed technique, results are compared with the result of existing algorithms. The enhanced SVM algorithm significantly outperforms the existing approach in terms of accuracy, precision, recall, and F1-score, with a 4% to 8% improvement in accuracy over the previous algorithm. This research highlights the potential of integrating RoBERTa techniques with SVM for enhanced sentiment analysis.

Keywords

Sentiment Analysis, Support Vector Machine, RoBERTa, Facebook

Citations

IRE Journals:
Patricia Mae A. Samson , Eunna Jazrel M. Arcilla , Raymund M. Dioses; Florencio V. Contreras Jr. , Richard C. Regala; Jonathan C. Morano , Leisyl M. Mahusay; Jamillah S. Guialil "Enhancement of Support Vector Machine utilizing RoBERTa applied to Sentiment Analysis of Facebook Data" Iconic Research And Engineering Journals Volume 7 Issue 11 2024 Page 386-391

IEEE:
Patricia Mae A. Samson , Eunna Jazrel M. Arcilla , Raymund M. Dioses; Florencio V. Contreras Jr. , Richard C. Regala; Jonathan C. Morano , Leisyl M. Mahusay; Jamillah S. Guialil "Enhancement of Support Vector Machine utilizing RoBERTa applied to Sentiment Analysis of Facebook Data" Iconic Research And Engineering Journals, 7(11)