Toxicity, Sentiment, and Social Network Analysis (SNA) of Borneo Death Blow Video Documentary Reviews

 (*)Yerik Afrianto Singgalen Mail (Atma Jaya Catholic University of Indonesia, Jakarta, Indonesia)

(*) Corresponding Author

Submitted: April 15, 2024; Published: April 30, 2024

Abstract

The study aimed to evaluate sentiment classification models using toxicity scores and to conduct Social Network Analysis (SNA) to understand network dynamics. The research used CRISP-DM methodology to comprehensively analyze sentiment classification models and toxicity scores. It utilized various machine learning algorithms, including Decision Tree (DT), Support Vector Machine (SVM), and Naive Bayes Classifier (NBC), with Synthetic Minority Over-sampling Technique (SMOTE) to address class imbalance. In addition, Social Network Analysis (SNA) was conducted to examine network properties and dynamics. The findings revealed varying toxicity scores, ranging from 0.12409 to 0.98808, across different categories, such as general toxicity, severe toxicity, identity attacks, insults, profanity, and threats. Evaluation of sentiment classification models indicated that the SVM model with SMOTE achieved the highest accuracy of 92.57% +/- 1.17% (micro average: 92.57%), followed by the NBC model with an accuracy of 78.24% +/- 1.30% (micro average: 78.24%), and the DT model with an accuracy of 61.16% +/- 1.20% (micro average: 61.16%). Despite variations in model performance, the SVM model consistently demonstrated robust performance across various evaluation metrics. Furthermore, the SNA findings provided insights into network structural characteristics, including Average Degree, Average Weighted Degree, Diameter, Radius, and Average Path Length, facilitating a comprehensive understanding of network organization and behavior. These findings contribute to advancing the understanding of sentiment analysis models and network dynamics in digital environments.

Keywords


Toxicity; Sentiment; Social Network; Borneo Death Blow; Video Documentary

Full Text:

PDF


Article Metrics

Abstract view : 361 times
PDF - 104 times

References

M. Li, M. Cheng, V. Quintal, and I. Cheah, “From live streamer to viewer: exploring travel live streamer persuasive linguistic styles and their impacts on travel intentions,” J. Travel Tour. Mark., vol. 40, no. 8, pp. 764–777, 2023, doi: 10.1080/10548408.2023.2294071.

A. Aigelova, A. Ishanova, and A. Suleimenova, “Analysis of the Content of the Kazakhstan Segment of YouTube,” Q. Rev. Film Video, vol. 0, no. 0, pp. 1–17, 2023, doi: 10.1080/10509208.2023.2265784.

B. Frankham, “Spaces of engagement–critical aesthetic practice, audience experience and the documentary-like work,” Stud. Doc. Film, vol. 16, no. 1, pp. 1–17, 2022, doi: 10.1080/17503280.2020.1854071.

B. Abarbanel and M. R. Johnson, “Gambling engagement mechanisms in Twitch live streaming,” Int. Gambl. Stud., vol. 20, no. 3, pp. 393–413, 2020, doi: 10.1080/14459795.2020.1766097.

Z. H. Gong and S. Holiday, “Parasocial Interaction Message Elements and Disclosure Timing in Nano- and Microinfluencers’ Sponsored Content As Alternative Explanations for Follower Count’s Influence on Engagement,” J. Interact. Advert., vol. 23, no. 4, pp. 374–387, 2023, doi: 10.1080/15252019.2023.2236093.

M. Paoli and B. Pezzotti, “Social critique and viewer’s response in the Italian Gangster film: the case of Bandits in Milan (1968) and Romanzo Criminale (2005),” Stud. Eur. Cine., vol. 17, no. 3, pp. 249–264, 2020, doi: 10.1080/17411548.2020.1798103.

S. Myers, S. Sen, H. Syrdal, and P. Woodroof, “The impact of Persuasion knowledge cues on social media engagement: a look at pet influencer marketing,” J. Mark. Theory Pract., vol. 32, no. 1, pp. 43–60, 2022, doi: 10.1080/10696679.2022.2093224.

J. Kwon, H. Lin, L. Deng, T. Dellicompagni, and M. Y. Kang, “Computerized emotional content analysis: empirical findings based on charity social media advertisements,” Int. J. Advert., vol. 41, no. 7, pp. 1314–1337, 2022, doi: 10.1080/02650487.2021.2012070.

P. Tan-intaraarj, “Exploring influence attempts, wishful identification, parasocial relationships, and behavioral loyalty among Thai game live-streamers and their viewers,” Asian J. Commun., vol. 34, no. 2, pp. 178–194, 2024, doi: 10.1080/01292986.2024.2315580.

N. Kyegombe et al., “A qualitative exploration of the salience of MTV-Shuga, an edutainment programme, and adolescents’ engagement with sexual and reproductive health information in rural KwaZulu-Natal, South Africa,” Sex. Reprod. Heal. Matters, vol. 30, no. 1, 2022, doi: 10.1080/26410397.2022.2083809.

Z. A. Huang and R. Wang, “‘Panda engagement’ in China’s digital public diplomacy,” Asian J. Commun., vol. 30, no. 2, pp. 118–140, 2020, doi: 10.1080/01292986.2020.1725075.

I. Sörensen, D. Vogler, S. Fürst, and M. S. Schäfer, “Platforms matter: analyzing user engagement with social media content of Swiss higher education institutions,” J. Mark. High. Educ., pp. 1–20, 2023, doi: 10.1080/08841241.2023.2289009.

S. Tan, M. Wiebrands, K. O’Halloran, and P. Wignell, “Analysing student engagement with 360-degree videos through multimodal data analytics and user annotations,” Technol. Pedagog. Educ., vol. 29, no. 5, pp. 593–612, 2020, doi: 10.1080/1475939X.2020.1835708.

K. K. Coker, R. L. Flight, and D. M. Baima, “Video storytelling ads vs argumentative ads: how hooking viewers enhances consumer engagement,” J. Res. Interact. Mark., vol. 15, no. 4, pp. 607–622, Jan. 2021, doi: 10.1108/JRIM-05-2020-0115.

B. Rodgers, K. Tudor, and A. Ashcroft, “Online video conferencing therapy and the person-centered approach in the context of a global pandemic,” Pers. Exp. Psychother., vol. 20, no. 4, pp. 286–302, 2021, doi: 10.1080/14779757.2021.1898455.

S. E. Chang and C. Yu, “Exploring Gamification for Live-Streaming Shopping - Influence of Reward, Competition, Presence and Immersion on Purchase Intention,” IEEE Access, vol. 11, no. June, pp. 57503–57513, 2023, doi: 10.1109/ACCESS.2023.3284033.

F. T. Giuntini et al., “Modeling and Assessing the Temporal Behavior of Emotional and Depressive User Interactions on Social Networks,” IEEE Access, vol. 9, pp. 93182–93194, 2021, doi: 10.1109/ACCESS.2021.3091801.

B. Guidi et al., “SentiTrust: A New Trust Model for Decentralized Online Social Media,” IEEE Access, vol. 11, no. June, pp. 53401–53417, 2023, doi: 10.1109/ACCESS.2023.3281194.

M. S. Rahman and H. Reza, “A Systematic Review Towards Big Data Analytics in Social Media,” Big Data Min. Anal., vol. 5, no. 3, pp. 228–244, 2022, doi: 10.26599/BDMA.2022.9020009.

D. Amangeldi, A. Usmanova, and P. Shamoi, “Understanding Environmental Posts: Sentiment and Emotion Analysis of Social Media Data,” IEEE Access, vol. 12, no. March, pp. 33504–33523, 2024, doi: 10.1109/ACCESS.2024.3371585.

F. S. Abousaleh, W. H. Cheng, N. H. Yu, and Y. Tsao, “Multimodal Deep Learning Framework for Image Popularity Prediction on Social Media,” IEEE Trans. Cogn. Dev. Syst., vol. 13, no. 3, pp. 679–692, 2021, doi: 10.1109/TCDS.2020.3036690.

M. J. Verdu, J. P. De Castro, L. M. Regueras, and A. Corell, “MSocial: Practical Integration of Social Learning Analytics into Moodle,” IEEE Access, vol. 9, pp. 23705–23716, 2021, doi: 10.1109/ACCESS.2021.3056914.

I. Aburagaga, M. Agoyi, and I. Elgedawy, “Assessing Faculty’s Use of Social Network Tools in Libyan Higher Education via a Technology Acceptance Model,” IEEE Access, vol. 8, pp. 116415–116430, 2020, doi: 10.1109/ACCESS.2020.3004200.

D. Burke, E. Hofstädter-Thalmann, and G. McVie, “Outcome Measures in Online Educational Videos,” J. Eur. C., vol. 9, no. 1, p. 1836867, 2020, doi: 10.1080/21614083.2020.1836867.

W. Ali, Y. Yang, X. Qiu, Y. Ke, and Y. Wang, “Aspect-Level Sentiment Analysis Based on Bidirectional-GRU in SIoT,” IEEE Access, vol. 9, pp. 69938–69950, 2021, doi: 10.1109/ACCESS.2021.3078114.

E. Zuo, H. Zhao, B. Chen, and Q. Chen, “Context-Specific Heterogeneous Graph Convolutional Network for Implicit Sentiment Analysis,” IEEE Access, vol. 8, pp. 37967–37975, 2020, doi: 10.1109/ACCESS.2020.2975244.

A. A. Al-Shargabi and A. Selmi, “Social Network Analysis and Visualization of Arabic Tweets during the COVID-19 Pandemic,” IEEE Access, vol. 9, pp. 90616–90630, 2021, doi: 10.1109/ACCESS.2021.3091537.

N. D. Soares, R. Braga, J. M. N. David, K. B. Siqueira, and V. Stroele, “Data Analysis in Social Networks for Agribusiness: A Systematic Review,” IEEE Access, vol. 11, no. January, pp. 8422–8432, 2023, doi: 10.1109/ACCESS.2023.3237984.

Q. Huang et al., “Modeling for Professional Athletes’ Social Networks Based on Statistical Machine Learning,” IEEE Access, vol. 8, pp. 4301–4310, 2020, doi: 10.1109/ACCESS.2019.2960559.

L. G. Moreno-Sandoval and A. Pomares-Quimbaya, “Hybrid Onion Layered System for the Analysis of Collective Subjectivity in Social Networks,” IEEE Access, vol. 10, no. September, pp. 115435–115468, 2022, doi: 10.1109/ACCESS.2022.3217467.

S. Dann and S. Cunningham, “The Viewer-As-Detective: Big Little Lies and the Productive Liminality of Complex Mystery Television,” Women’s Stud. Commun., vol. 46, no. 2, pp. 202–217, 2023, doi: 10.1080/07491409.2023.2187910.

H. Jodén and J. Strandell, “Building viewer engagement through interaction rituals on Twitch.tv,” Inf. Commun. Soc., vol. 25, no. 13, pp. 1969–1986, 2022, doi: 10.1080/1369118X.2021.1913211.

E. McLuskie, “The Public Engagement Industry: Distancing Publics through Managed Engagement and Ideologised Transparency,” Javnost, vol. 30, no. 3, pp. 299–321, 2023, doi: 10.1080/13183222.2023.2201761.

F. C. Uroko, “From Public Engagement to Violence: The Fragility and Loss of Public Engagement in Muslim Northern Nigeria,” Javnost, vol. 30, no. 3, pp. 339–355, 2023, doi: 10.1080/13183222.2023.2199226.

K. Kim, H. S. Kim, M. Y. Chung, and Y. Kim, “Do viewers really talk about ads during commercial breaks? Findings from a South Korean social TV platform,” Asian J. Commun., vol. 31, no. 4, pp. 299–317, 2021, doi: 10.1080/01292986.2021.1945118.

Y. Chen and C. Weninger, “The potential of eye tracking data to strengthen CDA’ explanatory power: the case of multimodal critical discourse analysis of advertising persuasion,” Crit. Discourse Stud., pp. 1–19, 2024, doi: 10.1080/17405904.2024.2331641.

Y. Liu, M. Zhang, M. Hu, and T. Qiao, “How multi-actor resources create value for live streaming platforms: the mediating role of engaged spectators,” Serv. Ind. J., 2024, doi: 10.1080/02642069.2024.2312352.

M. Grizzard and A. Eden, “The Character Engagement and Moral Adjustment Model (CEMAM): A Synthesis of More than Six Decades of Research,” J. Broadcast. Electron. Media, vol. 66, no. 4, pp. 698–722, 2022, doi: 10.1080/08838151.2022.2146116.

L. C. S. Lin, “Virtual gift donation on live streaming apps: the moderating effect of social presence,” Commun. Res. Pract., vol. 7, no. 2, pp. 173–188, 2021, doi: 10.1080/22041451.2021.1889190.

S. Black, “Could integrated subtitles benefit young viewers? Children’s reception of standard and integrated subtitles: a mixed methods approach using eye tracking,” Perspect. Stud. Transl. Theory Pract., vol. 30, no. 3, pp. 503–519, 2022, doi: 10.1080/0907676X.2020.1849324.

A. Wang, T. W. Whyke, and L. Dean, “The interplay between digital platforms and user-generated content in reinterpreting and recreating mythological narratives with traditional Chinese cultural elements: the animated series Yao-Chinese Folktales,” Creat. Ind. J., vol. 0, no. 0, pp. 1–22, 2023, doi: 10.1080/17510694.2023.2252423.

P. Arsenis, M. Flores, and D. Petropoulou, “Enhancing graduate employability skills and student engagement through group video assessment,” Assess. Eval. High. Educ., vol. 47, no. 2, pp. 245–258, 2022, doi: 10.1080/02602938.2021.1897086.

A. Morales, L. Medina Luna, D. W. Zietlow, J. E. LeBeau, and M. J. Molina, “Testing the impact of culturally-relevant communication style on engagement with Hispanic and Latinx adults,” J. Geosci. Educ., vol. 71, no. 3, pp. 355–368, 2023, doi: 10.1080/10899995.2022.2120701.

Anubha and S. Shome, “Customer Engagement and Advertising Effectiveness: A Moderated Mediating Analysis,” J. Internet Commer., vol. 20, no. 4, pp. 409–449, 2021, doi: 10.1080/15332861.2021.1955324.

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 JURNAL MEDIA INFORMATIKA BUDIDARMA

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.



JURNAL MEDIA INFORMATIKA BUDIDARMA
STMIK Budi Darma
Secretariat: Sisingamangaraja No. 338 Telp 061-7875998
Email: mib.stmikbd@gmail.com

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.