An improved context-aware Sentiment Analysis of student comments on Social Networks based on ChatGPT
DOI:
https://doi.org/10.7494/csci.2025.26.1.6145Abstract
The widespread use of social networks has provided a variety of active, dynamic, and popular platforms for students to express their opinions and sentiments. These data are increasingly being exploited and integrated into university information systems to better govern and manage universities and improve educational quality. The analysis of such data can offer valuable insights into student experiences and attitudes towards various educational aspects including courses, professors, events, and facilities. However, automatic opinion mining in this context is challenging due to the difficulty of analyzing some languages such as Arabic, the variety of used languages, the presence of informal language, the use of emoticons and emoji, sarcasm, and the need to consider the surrounding context. To deal with all these challenges, we propose a novel approach for an effective sentiment analysis of student comments on the X platform (Twitter). The proposed approach allows to collect student comments from Twitter public pages and automatically classifies comments into positive, negative, and neutral. The new approach is based on ChatGPT capabilities, supports three languages: English, Arabic, and colloquial Arabic, and integrates a new scoring method that measures both the positiveness and subjectivity of student comments. Experiments performed on simulated and real public Twitter pages of five Saudi high education institutions showed the performance of the proposed tool to automatically analyze and summarize collected data.
Downloads
References
Bird S., Klein E., Loper E.: Natural language processing with Python: analyzing text with the natural language toolkit. " O’Reilly Media, Inc.", 2009.
Chauhan A., Mohana R.M.: Implementing LDA Topic Modelling Technique to Study User Reviews in Tourism. In: 2022 Seventh International Conference on Parallel, Distributed and Grid Computing (PDGC), pp. 357–360, 2022. URL: https://api.semanticscholar.org/CorpusID:257261243
Cohen M., Ernst R.: Multi-item classification and generic inventory stock control policies. In: Production and Inventory Management Journal, vol. 29, pp. 6–8, 1988.
Dyulicheva Y., E. B.: Learning Analytics of MOOCs based on Natural Language Processing. In: 4th Workshop for Young Scientists in Computer Science & Software Ingineering. 2021.
Ebrahimi P., Basirat M., Yousefi A., Nekmahmud M., Gholampour A., Fekete Farkas M.: Social Networks Marketing and Consumer Purchase Behavior: The Combination of SEM and Unsupervised Machine Learning Approaches. In: Big Data and Cognitive Computing, vol. 6(2), 2022. ISSN 2504-2289. URL http://dx.doi.org/10.3390/bdcc6020035.
Hariyani C.A., Hidayanto A.N., Fitriah N., Abidin Z., Wati T.: Mining Student Feedback to Improve the Quality of Higher Education through Multi Label Classification, Sentiment Analysis, and Trend Topic. In: 2019 4th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE), pp. 359–364, 2019. URL https://api.semanticscholar.
org/CorpusID:215721708.
Hew K.F.T., Hu X., Qiao C., Tang Y.: What predicts student satisfaction with MOOCs: A gradient boosting trees supervised machine learning and sentiment analysis approach. In: Comput. Educ., vol. 145, 2020. URL https://api.semanticscholar.org/CorpusID:208092131.
Jasim Y., Saeed M., Raewf M.: Analyzing Social Media Sentiment: Twitter as a Case Study. In: ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal, vol. 11, pp. 427–450, 2023. URL http://dx.doi.org/10. 14201/adcaij.28394.
Kastrati Z., Dalipi F., Imran A.S., Pireva Nuci K., Wani M.A.: Sentiment Analysis of Students’ Feedback with NLP and Deep Learning: A Systematic Mapping Study. In: Applied Sciences, vol. 11(9), 2021. URL http://dx.doi.org/10.3390/app11093986.
Kaur W., Balakrishnan V., Singh B.: Social media sentiment analysis of thermal engineering students for continuous quality improvement in engineering education. In: Journal of Mechanical Engineering, pp. 263–272, 2017. [11] Laranjo L., Arguel A., Neves A.L., Gallagher A.M., Kaplan R., Mortimer N.: The influence of social networking sites on health behavior change: a systematic review and meta-analysis. In: Journal of the American Medical Informatics Association, vol. 22(1), pp. 243–256, 2015.
URL http://dx.doi.org/10.1136/amiajnl-2014-002841.
Li X., Zhang H., Ouyang Y., Zhang X., Rong W.: A Shallow BERT-CNN Model for Sentiment Analysis on MOOCs Comments. pp. 1–6. 2019. URL http://dx.doi.org/10.1109/TALE48000.2019.9225993.
Manzoor U., Baig S.A., Hashim M., Sami A.: Impact of Social Media Marketing on Consumer’s Purchase Intentions: The Mediating Role of Customer Trust. In:International Journal of Entrepreneurial Research, vol. 3(2), pp. 41–48, 2020. URL http://dx.doi.org/10.31580/ijer.v3i2.1386.
Misuraca M., Scepi G., Spano M.: Using Opinion Mining as an educational analytic: An integrated strategy for the analysis of students’ feedback. In: Studies in Educational Evaluation, vol. 68, p. 100979, 2021. URL http://dx.doi.org https://doi.org/10.1016/j.stueduc.2021.100979.
Nasim Z., Rajput Q., Haider S.: Sentiment analysis of student feedback using machine learning and lexicon-based approaches. In: 2017 International Conference on Research and Innovation in Information Systems (ICRIIS), pp. 1–6, 2017. URL https://api.semanticscholar.org/CorpusID:23515904.
Osmanoğlu U., Atak O., Çağlar K., Kayhan H., Can T.: Sentiment Analysis for Distance Education Course Materials: A Machine Learning Approach. In:
Journal of Educational Technology and Online Learning, vol. 3, pp. 31–48, 2020. URL http://dx.doi.org/10.31681/jetol.663733.
R K.: Sentiment Research on Student Feedback to Improve Experiences in Blended Learning Environments. In: International Journal of Innovative Technology and Exploring Engineering, 2019. URL https://api.semanticscholar. org/CorpusID:240640139.
Rajput Q., Haider S., Ghani S.: Lexicon-Based Sentiment Analysis of Teachers’ Evaluation. In: Appl. Comput. Intell. Soft Comput., vol. 2016, pp. 2385429:1–2385429:12, 2016. URL https://api.semanticscholar.org/CorpusID:29421695.
S. C., M. G.: Patient Education and Engagement through Social Media. In: Current cardiology reviews, vol. 17(2), pp. 137–143, 2021.
URL http://dx.doi.org/https://doi.org/10.2174/1573403X15666191120115107.
Sangeetha K., Prabha D.: Sentiment analysis of student feedback using multi-head attention fusion model of word and context embedding for LSTM. In: Journal of Ambient Intelligence and Humanized Computing, vol. 12, pp. 4117–4126, 2020. URL https://api.semanticscholar.org/CorpusID:215895930.
Sangeetha K., Prabha D.: Sentiment analysis of student feedback using multihead attention fusion model of word and context embedding for LSTM. In:
Journal of Ambient Intelligence and Humanized Computing, vol. 12, pp. 4117–4126, 2020. URL https://api.semanticscholar.org/CorpusID:215895930.
Sindhu I., Daudpota S.M., Badar K., Bakhtyar M., Baber J., Nurunnabi M.: Aspect-Based Opinion Mining on Student’s Feedback for Faculty Teaching Performance Evaluation. In: IEEE Access, vol. 7, pp. 108729–108741, 2019. URL https://api.semanticscholar.org/CorpusID:199009922.
Spatiotis N., Perikos I., Mporas I., Paraskevas M.: Sentiment Analysis of Teachers Using Social Information in Educational Platform Environments. In: Int. J.
Artif. Intell. Tools, vol. 29, pp. 2040004:1–2040004:28, 2020. URL https://api.semanticscholar.org/CorpusID:216299768.
Srinivas S., Rajendran S.: Topic-based knowledge mining of online student views for strategic planning in universities. In: Computers and Industrial Engineering, vol. 128, pp. 974–984, 2019. ISSN 0360-8352. URL http://dx.doi. org/https://doi.org/10.1016/j.cie.2018.06.034.
Sutoyo E., Almaarif A., Yanto I.: Sentiment Analysis of Student Evaluations of Teaching Using Deep Learning Approach, pp. 272–281. 2021. ISBN 978-3-030-
-8. URL http://dx.doi.org/10.1007/978-3-030-80216-5_20.
Tzacheva A.A., Easwaran A.: Emotion Detection and Opinion Mining from Student Comments for Teaching Innovation Assessment. 2021.
URL https://api.semanticscholar.org/CorpusID:237360653.
V. D., Bino D., M S.A.: Opinion mining from student feedback data using supervised learning algorithms. In: 2016 3rd MEC International Conference on Big Data and Smart City (ICBDSC), pp. 1–5, 2016. URL https://api.semanticscholar.org/CorpusID:1368622.
Yu L., Lee C., Pan H., Chou C., Chao P., Chen Z., Tseng S., Chan C., Lai K.: Improving early prediction of academic failure using sentiment analysis on self-evaluated comments. In: Journal of Computer Assisted Learning, vol. 34(4), pp. 358–365, 2018. URL http://dx.doi.org/https://doi.org/10.1111/jcal. 12247.
Zhang Y., Sun S., Galley M., Chen Y.C., Brockett C., Gao X., Gao J., Liu J., Dolan B.: DIALOGPT : Large-Scale Generative Pre-training for Conversational
Response Generation. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 270–278.
Association for Computational Linguistics, 2020. URL http://dx.doi.org/10.
/v1/2020.acl-demos.30
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Computer Science
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
