Toxicity, Sentiment, and Social Network Analysis (SNA) of Borneo Death Blow Video Documentary Reviews
DOI:
https://doi.org/10.30865/mib.v8i2.7633Keywords:
Toxicity, Sentiment, Social Network, Borneo Death Blow, Video DocumentaryAbstract
The study aimed to evaluate sentiment classification models using toxicity scores and to conduct Social Network Analysis (SNA) to understand network dynamics. The research used CRISP-DM methodology to comprehensively analyze sentiment classification models and toxicity scores. It utilized various machine learning algorithms, including Decision Tree (DT), Support Vector Machine (SVM), and Naive Bayes Classifier (NBC), with Synthetic Minority Over-sampling Technique (SMOTE) to address class imbalance. In addition, Social Network Analysis (SNA) was conducted to examine network properties and dynamics. The findings revealed varying toxicity scores, ranging from 0.12409 to 0.98808, across different categories, such as general toxicity, severe toxicity, identity attacks, insults, profanity, and threats. Evaluation of sentiment classification models indicated that the SVM model with SMOTE achieved the highest accuracy of 92.57% +/- 1.17% (micro average: 92.57%), followed by the NBC model with an accuracy of 78.24% +/- 1.30% (micro average: 78.24%), and the DT model with an accuracy of 61.16% +/- 1.20% (micro average: 61.16%). Despite variations in model performance, the SVM model consistently demonstrated robust performance across various evaluation metrics. Furthermore, the SNA findings provided insights into network structural characteristics, including Average Degree, Average Weighted Degree, Diameter, Radius, and Average Path Length, facilitating a comprehensive understanding of network organization and behavior. These findings contribute to advancing the understanding of sentiment analysis models and network dynamics in digital environments.References
M. Li, M. Cheng, V. Quintal, and I. Cheah, “From live streamer to viewer: exploring travel live streamer persuasive linguistic styles and their impacts on travel intentions,†J. Travel Tour. Mark., vol. 40, no. 8, pp. 764–777, 2023, doi: 10.1080/10548408.2023.2294071.
A. Aigelova, A. Ishanova, and A. Suleimenova, “Analysis of the Content of the Kazakhstan Segment of YouTube,†Q. Rev. Film Video, vol. 0, no. 0, pp. 1–17, 2023, doi: 10.1080/10509208.2023.2265784.
B. Frankham, “Spaces of engagement–critical aesthetic practice, audience experience and the documentary-like work,†Stud. Doc. Film, vol. 16, no. 1, pp. 1–17, 2022, doi: 10.1080/17503280.2020.1854071.
B. Abarbanel and M. R. Johnson, “Gambling engagement mechanisms in Twitch live streaming,†Int. Gambl. Stud., vol. 20, no. 3, pp. 393–413, 2020, doi: 10.1080/14459795.2020.1766097.
Z. H. Gong and S. Holiday, “Parasocial Interaction Message Elements and Disclosure Timing in Nano- and Microinfluencers’ Sponsored Content As Alternative Explanations for Follower Count’s Influence on Engagement,†J. Interact. Advert., vol. 23, no. 4, pp. 374–387, 2023, doi: 10.1080/15252019.2023.2236093.
M. Paoli and B. Pezzotti, “Social critique and viewer’s response in the Italian Gangster film: the case of Bandits in Milan (1968) and Romanzo Criminale (2005),†Stud. Eur. Cine., vol. 17, no. 3, pp. 249–264, 2020, doi: 10.1080/17411548.2020.1798103.
S. Myers, S. Sen, H. Syrdal, and P. Woodroof, “The impact of Persuasion knowledge cues on social media engagement: a look at pet influencer marketing,†J. Mark. Theory Pract., vol. 32, no. 1, pp. 43–60, 2022, doi: 10.1080/10696679.2022.2093224.
J. Kwon, H. Lin, L. Deng, T. Dellicompagni, and M. Y. Kang, “Computerized emotional content analysis: empirical findings based on charity social media advertisements,†Int. J. Advert., vol. 41, no. 7, pp. 1314–1337, 2022, doi: 10.1080/02650487.2021.2012070.
P. Tan-intaraarj, “Exploring influence attempts, wishful identification, parasocial relationships, and behavioral loyalty among Thai game live-streamers and their viewers,†Asian J. Commun., vol. 34, no. 2, pp. 178–194, 2024, doi: 10.1080/01292986.2024.2315580.
N. Kyegombe et al., “A qualitative exploration of the salience of MTV-Shuga, an edutainment programme, and adolescents’ engagement with sexual and reproductive health information in rural KwaZulu-Natal, South Africa,†Sex. Reprod. Heal. Matters, vol. 30, no. 1, 2022, doi: 10.1080/26410397.2022.2083809.
Z. A. Huang and R. Wang, “‘Panda engagement’ in China’s digital public diplomacy,†Asian J. Commun., vol. 30, no. 2, pp. 118–140, 2020, doi: 10.1080/01292986.2020.1725075.
I. Sörensen, D. Vogler, S. Fürst, and M. S. Schäfer, “Platforms matter: analyzing user engagement with social media content of Swiss higher education institutions,†J. Mark. High. Educ., pp. 1–20, 2023, doi: 10.1080/08841241.2023.2289009.
S. Tan, M. Wiebrands, K. O’Halloran, and P. Wignell, “Analysing student engagement with 360-degree videos through multimodal data analytics and user annotations,†Technol. Pedagog. Educ., vol. 29, no. 5, pp. 593–612, 2020, doi: 10.1080/1475939X.2020.1835708.
K. K. Coker, R. L. Flight, and D. M. Baima, “Video storytelling ads vs argumentative ads: how hooking viewers enhances consumer engagement,†J. Res. Interact. Mark., vol. 15, no. 4, pp. 607–622, Jan. 2021, doi: 10.1108/JRIM-05-2020-0115.
B. Rodgers, K. Tudor, and A. Ashcroft, “Online video conferencing therapy and the person-centered approach in the context of a global pandemic,†Pers. Exp. Psychother., vol. 20, no. 4, pp. 286–302, 2021, doi: 10.1080/14779757.2021.1898455.
S. E. Chang and C. Yu, “Exploring Gamification for Live-Streaming Shopping - Influence of Reward, Competition, Presence and Immersion on Purchase Intention,†IEEE Access, vol. 11, no. June, pp. 57503–57513, 2023, doi: 10.1109/ACCESS.2023.3284033.
F. T. Giuntini et al., “Modeling and Assessing the Temporal Behavior of Emotional and Depressive User Interactions on Social Networks,†IEEE Access, vol. 9, pp. 93182–93194, 2021, doi: 10.1109/ACCESS.2021.3091801.
B. Guidi et al., “SentiTrust: A New Trust Model for Decentralized Online Social Media,†IEEE Access, vol. 11, no. June, pp. 53401–53417, 2023, doi: 10.1109/ACCESS.2023.3281194.
M. S. Rahman and H. Reza, “A Systematic Review Towards Big Data Analytics in Social Media,†Big Data Min. Anal., vol. 5, no. 3, pp. 228–244, 2022, doi: 10.26599/BDMA.2022.9020009.
D. Amangeldi, A. Usmanova, and P. Shamoi, “Understanding Environmental Posts: Sentiment and Emotion Analysis of Social Media Data,†IEEE Access, vol. 12, no. March, pp. 33504–33523, 2024, doi: 10.1109/ACCESS.2024.3371585.
F. S. Abousaleh, W. H. Cheng, N. H. Yu, and Y. Tsao, “Multimodal Deep Learning Framework for Image Popularity Prediction on Social Media,†IEEE Trans. Cogn. Dev. Syst., vol. 13, no. 3, pp. 679–692, 2021, doi: 10.1109/TCDS.2020.3036690.
M. J. Verdu, J. P. De Castro, L. M. Regueras, and A. Corell, “MSocial: Practical Integration of Social Learning Analytics into Moodle,†IEEE Access, vol. 9, pp. 23705–23716, 2021, doi: 10.1109/ACCESS.2021.3056914.
I. Aburagaga, M. Agoyi, and I. Elgedawy, “Assessing Faculty’s Use of Social Network Tools in Libyan Higher Education via a Technology Acceptance Model,†IEEE Access, vol. 8, pp. 116415–116430, 2020, doi: 10.1109/ACCESS.2020.3004200.
D. Burke, E. Hofstädter-Thalmann, and G. McVie, “Outcome Measures in Online Educational Videos,†J. Eur. C., vol. 9, no. 1, p. 1836867, 2020, doi: 10.1080/21614083.2020.1836867.
W. Ali, Y. Yang, X. Qiu, Y. Ke, and Y. Wang, “Aspect-Level Sentiment Analysis Based on Bidirectional-GRU in SIoT,†IEEE Access, vol. 9, pp. 69938–69950, 2021, doi: 10.1109/ACCESS.2021.3078114.
E. Zuo, H. Zhao, B. Chen, and Q. Chen, “Context-Specific Heterogeneous Graph Convolutional Network for Implicit Sentiment Analysis,†IEEE Access, vol. 8, pp. 37967–37975, 2020, doi: 10.1109/ACCESS.2020.2975244.
A. A. Al-Shargabi and A. Selmi, “Social Network Analysis and Visualization of Arabic Tweets during the COVID-19 Pandemic,†IEEE Access, vol. 9, pp. 90616–90630, 2021, doi: 10.1109/ACCESS.2021.3091537.
N. D. Soares, R. Braga, J. M. N. David, K. B. Siqueira, and V. Stroele, “Data Analysis in Social Networks for Agribusiness: A Systematic Review,†IEEE Access, vol. 11, no. January, pp. 8422–8432, 2023, doi: 10.1109/ACCESS.2023.3237984.
Q. Huang et al., “Modeling for Professional Athletes’ Social Networks Based on Statistical Machine Learning,†IEEE Access, vol. 8, pp. 4301–4310, 2020, doi: 10.1109/ACCESS.2019.2960559.
L. G. Moreno-Sandoval and A. Pomares-Quimbaya, “Hybrid Onion Layered System for the Analysis of Collective Subjectivity in Social Networks,†IEEE Access, vol. 10, no. September, pp. 115435–115468, 2022, doi: 10.1109/ACCESS.2022.3217467.
S. Dann and S. Cunningham, “The Viewer-As-Detective: Big Little Lies and the Productive Liminality of Complex Mystery Television,†Women’s Stud. Commun., vol. 46, no. 2, pp. 202–217, 2023, doi: 10.1080/07491409.2023.2187910.
H. Jodén and J. Strandell, “Building viewer engagement through interaction rituals on Twitch.tv,†Inf. Commun. Soc., vol. 25, no. 13, pp. 1969–1986, 2022, doi: 10.1080/1369118X.2021.1913211.
E. McLuskie, “The Public Engagement Industry: Distancing Publics through Managed Engagement and Ideologised Transparency,†Javnost, vol. 30, no. 3, pp. 299–321, 2023, doi: 10.1080/13183222.2023.2201761.
F. C. Uroko, “From Public Engagement to Violence: The Fragility and Loss of Public Engagement in Muslim Northern Nigeria,†Javnost, vol. 30, no. 3, pp. 339–355, 2023, doi: 10.1080/13183222.2023.2199226.
K. Kim, H. S. Kim, M. Y. Chung, and Y. Kim, “Do viewers really talk about ads during commercial breaks? Findings from a South Korean social TV platform,†Asian J. Commun., vol. 31, no. 4, pp. 299–317, 2021, doi: 10.1080/01292986.2021.1945118.
Y. Chen and C. Weninger, “The potential of eye tracking data to strengthen CDA’ explanatory power: the case of multimodal critical discourse analysis of advertising persuasion,†Crit. Discourse Stud., pp. 1–19, 2024, doi: 10.1080/17405904.2024.2331641.
Y. Liu, M. Zhang, M. Hu, and T. Qiao, “How multi-actor resources create value for live streaming platforms: the mediating role of engaged spectators,†Serv. Ind. J., 2024, doi: 10.1080/02642069.2024.2312352.
M. Grizzard and A. Eden, “The Character Engagement and Moral Adjustment Model (CEMAM): A Synthesis of More than Six Decades of Research,†J. Broadcast. Electron. Media, vol. 66, no. 4, pp. 698–722, 2022, doi: 10.1080/08838151.2022.2146116.
L. C. S. Lin, “Virtual gift donation on live streaming apps: the moderating effect of social presence,†Commun. Res. Pract., vol. 7, no. 2, pp. 173–188, 2021, doi: 10.1080/22041451.2021.1889190.
S. Black, “Could integrated subtitles benefit young viewers? Children’s reception of standard and integrated subtitles: a mixed methods approach using eye tracking,†Perspect. Stud. Transl. Theory Pract., vol. 30, no. 3, pp. 503–519, 2022, doi: 10.1080/0907676X.2020.1849324.
A. Wang, T. W. Whyke, and L. Dean, “The interplay between digital platforms and user-generated content in reinterpreting and recreating mythological narratives with traditional Chinese cultural elements: the animated series Yao-Chinese Folktales,†Creat. Ind. J., vol. 0, no. 0, pp. 1–22, 2023, doi: 10.1080/17510694.2023.2252423.
P. Arsenis, M. Flores, and D. Petropoulou, “Enhancing graduate employability skills and student engagement through group video assessment,†Assess. Eval. High. Educ., vol. 47, no. 2, pp. 245–258, 2022, doi: 10.1080/02602938.2021.1897086.
A. Morales, L. Medina Luna, D. W. Zietlow, J. E. LeBeau, and M. J. Molina, “Testing the impact of culturally-relevant communication style on engagement with Hispanic and Latinx adults,†J. Geosci. Educ., vol. 71, no. 3, pp. 355–368, 2023, doi: 10.1080/10899995.2022.2120701.
Anubha and S. Shome, “Customer Engagement and Advertising Effectiveness: A Moderated Mediating Analysis,†J. Internet Commer., vol. 20, no. 4, pp. 409–449, 2021, doi: 10.1080/15332861.2021.1955324.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
