A Mixed-method Corpus Approach to the COVID-19 Vaccination Debate


Abstract


Social media have contributed to the recent proliferation of online discussions on the COVID-19 vaccines. The paper explores the evolution of this debate by analysing an ad hoc corpus of tweets (over 5.5 million words) collected from March 15th to April 14th, 2021. We deploy sentiment, emotion, and emoji analysis to uncover the users’ affective states, perceptions, and reactions regarding the COVID-19 vaccination. Our results show that vaccine sentiment is influenced by real-time news and by other information that circulates on the Internet, displaying polarizations on both the negative and the positive extremities of the sentiment scale. The emotion analysis indicates that trust issues (either trust or mistrust) regarding the COVID-19 vaccination prevail in our data, amounting to 21.29% of the overall emotional valence of tweets. Furthermore, the qualitative analysis suggests that the infodemic relies primarily on strong negative emotions (e.g., fear, anger, and disgust). Finally, the emoji analysis reveals that, besides iconicity functions, emoji act as boosters of emotions, contributing to the semantic dimension of the Twitter debate on the COVID-19 vaccination.


DOI Code: 10.1285/i22390359v47p191

Keywords: sentiment analysis; emotion analysis; emoji analysis; misinformation; COVID- 19 vaccine

References


Abel J.E. 2020, Not Everyone 5s Or, the Question of Emoji as ‘Universal’ Expression, in Giannoulis E. and Wilde L.R.A. (eds.), Emoticons, Kaomoji and Emoji, Routledge, New York, pp. 25-43.

Adams K.L. and Brink D.T. (eds.) 1990, Perspectives on Official English, De Gruyter Mouton, Berlin.

Acheampong F.A., Wenyu C. and Nunoo-Mensah C. 2020, Text-based emotion detection: Advances, challenges and opportunities, in “Engineering Reports” 2 [7], article e12189, pp. 1-24.

Bai Q., Dan Q., Mu Z. and Yang M. 2019, A Systematic Review of Emoji: Current Research and Future Perspectives, in “Frontiers in Psychology” 10(2019), pp. 1-23.

Breeze R., 2021, Claiming Credibility in Online Comments: Popular Debate Surrounding the COVID-19 Vaccine, in “Publications” 9, article 34, pp. 1-15.

Casciani F., Pantovic A., Al-Ajlouni Y., Failla G. and Ricciardi W. 2021, Attitudes, acceptance and hesitancy among the general population worldwide to receive the COVID-19 vaccines and their contributing factors: A systematic review, in “EClinicalMedicine” 40(2021), article 101113, pp. 1-14.

Çeliktuğ M.F. 2018, Twitter Sentiment Analysis, 3-Way Classification: Positive, Negative or Neutral, in “IEEE International Conference on Big Data (Big Data)”, Seattle, 2018, pp. 2098-2103.

Chandra R. and Krishna A. 2021, COVID-19 sentiment analysis via deep learning during the rise of novel cases, in “PLOS ONE” 16 [8], pp. 1-26.

Cheng L. 2017, Do I mean what I say and say what I mean? A cross cultural approach to the use of emoticons & emojis in CMC messages, in “Fonseca: Journal of Communication” 15(2017), pp. 199-217.

Chiusaroli F. 2017a, Emoticon, emoji e altre logografie per la rappresentazione del parlato nella comunicazione dei social media, in De Meo A. and Dovetto F.M. (eds.), La comunicazione parlata / Spoken communication, Aracne, Roma, pp. 233-251.

Chiusaroli F. 2017b, Emoji e questioni di genere: una piccola storia della scrittura nella comunicazione digitale, in De Meo et al. (eds.), Al femminile: Studi linguistici in onore di Cristina Vallini, Franco Cesati Editore, Firenze, pp. 137-150.

Cinelli M., De Francisci Morales G., Galeazzi A., Quattrociocchi W. And Starnini M. 2021, The echo chamber effect on social media, in “Proceedings of the National Academy of Sciences (PNAS)” 118 [9], article e2023301118, pp. 1-8.

Combei C.R. and Luporini A. 2021, Sentiment and Emotion Analysis Meet Appraisal: A Corpus Study of Tweets related to the Covid-19 pandemic, in “RILA [Rassegna italiana di linguistica applicata]” 53 [1-2], pp. 115-136.

Dainas A.R., Herring S.C. 2021, Interpreting emoji pragmatics, in Xie et al. (eds.), Approaches to Internet Pragmatics, John Benjamins Publishing Company, Amsterdam/Philadelphia, pp. 107-144.

Danesi M. 2017, The Semiotics of Emoji: the Rise of Visual Language in the Age of the Internet, Bloomsbury, London.

de Figueiredo A. and Larson H.J. 2021, Exploratory study of the global intent to accept COVID-19 vaccinations, in “Communications Medicine” 1 [1], article 30, pp. 1-10.

Feinerer I. and Hornik K. 2019, tm: Text Mining Package. R package. https://CRAN.R- project.org/package=tm (21.07.2021).

Feldman R. 2013, Techniques and Applications for Sentiment Analysis, in “Communications of the Association for Computing Machinery (ACM)” 56 [4], pp. 82-89.

Fellbaum C. (ed.) 1998, WordNet: An Electronic Lexical Database, MIT Press, Cambridge. Finn A.N. 2011, A new ANEW: Evaluation of a word list for sentiment analysis in microblogs, in Rowe M. et al. (eds.), Proceedings of the ESWC2011 Workshop on 'Making Sense of Microposts': Big things come in small packages (MSM2011),

CEUR-WS, Aachen, pp. 93-98.

Fleiss J.L., Cohen J. and Everitt B. 1969, Large sample standard errors of kappa and

weighted kappa, in “Psychological Bulletin” 72 [5], pp. 323-327.

Garett R. and Young S.D. 2021, Online misinformation and vaccine hesitancy, in

“Translational Behavioral Medicine”, 11 [9], article 128, pp. 1-2.

Gohil S., Vuik S. and Darzi A. 2018, Sentiment Analysis of Health Care Tweets: Review of the Methods Used, in “Journal of Medical Internet Research: Public Health and

Surveillance” 4 [2], pp. 1-10.

Hall J.A. and Pennington N. 2013, Self-monitoring, honesty, and cue use on Facebook: the

relationship with user extraversion and conscientiousness, in “Computers in Human

Behaviour” 29 [4], pp. 1556-1564.

Herring S.C. and Dainas A.R. 2018, Receiver Interpretations of Emoji Functions: A Gender

Perspective, in Wijeratne S. et al (eds.), Emoji Understanding and Applications in

Social Media, CEUR-WS, Aachen, paper 5, pp. 1-8.

Herring S.C. and Dainas A.R. 2020, Gender and Age Influences on Interpretation of Emoji

Functions, in “Transaction on Social Computing” 3 [2], pp. 1-26.

Hornik K. 2020, Unicode: Data and Utilities. https://cran.r-

project.org/web/packages/Unicode/index.html (21.08.2021).

Jiang, J., Ren X. and Ferrara E. Social Media Polarization and Echo Chambers in the

Context of COVID-19: Case Study, in “JMIRx Med” 2 [3], article e29570, pp. 1-14. Kricorian K., Civen R. and Equils O. 2021, COVID-19 vaccine hesitancy: misinformation and perception of vaccine safety, in “Human Vaccines and Immonotherapeutics” 17

, article 1950504, pp. 1-8.

Jacobsen K.H. and Vraga E.K. 2020, Improving communication about COVID‐19 and

emerging infectious diseases, in “European Journal of Clinical Investigation”, 50 [5],

article e13225, pp. 1-2.

James W. 1890, The Principles of Psychology, Henry Holt and Company, New York. Jockers M. 2017, syuzhet: Extracts Sentiment and Sentiment-Derived Plot Arcs from Text.

https://cran.r-project.org/web/packages/syuzhet/syuzhet.pdf (20.08.2021).

Kang G.J, Sinclair R.E.N., Mackey L., Schlitt J.T., Marathe A., Abbas K.M. and Swarup S. 2017, Semantic network analysis of vaccine sentiment in online social media, in

“Vaccine” 35(2017), pp. 3621-3638.

Kearney J. 2019, rtweet: Collecting Twitter Data. R Package. https://cran.r-

project.org/package=rtweet (15.04.2021).

Kejriwal M., Wang Q., Li H. and Wang L. 2021, An empirical study of emoji usage on

Twitter in linguistic and national contexts, in “Online Social Networks and Media”

(2021), pp. 1-23.

Landis J.R. and Koch G.G. 1977, The Measurement of Observer Agreement for Categorical

Data, in “Biometrics” 33 [1], pp.159.174.

Laurent-Simpson A. and Lo C. 2019, Risk society online: Zika virus, social media and

distrust in the Centers for Disease Control and Prevention, in “Sociology of Health and Illness” 41(2019), pp. 1270-1288.

Lazarus J.V., Ratzan S.C., Palayew A., Gostin L.O., Larson H.J., Rabin K., Kimball S. and El-Mohandes A. 2021, A global survey of potential acceptance of a COVID-19 vaccine, in “Nature Medicine” 27(2021), pp. 225–228.

Liu B. 2015, Sentiment analysis: Mining opinions, sentiments, and emotions, Cambridge University Press, Cambridge.

Liu B., Hu M. and Cheng J. 2005, Opinion Observer: Analyzing and Comparing Opinions on the Web, in Ellis A. and Hagino T. (eds.), Proceedings of the 14th international conference on World Wide Web (WWW ’05), Association for Computing Machinery Digital Library (ACM-DL), Chiba, pp. 342-351.

Lyons K. 2017. Emoji Dictionary. https://github.com/lyons7/emojidictionary (21.08.2021). Lyu H., Wang J., Wu W., Duong V., Zhang X., Dye T.D. and Luo J. 2021, Social media study of public opinions on potential COVID-19 vaccines: Informing dissent,

disparities, and dissemination, in “Intelligent Medicine” 8(2021), pp. 1-12.

Lyu J.C., Han E.L. and Garving K.L. 2021, COVID-19 Vaccine-Related Discussion on Twitter: Topic Modeling and Sentiment Analysis, in “Journal of Medical Internet

Research” 23 [6], article 24435, pp. 1-12.

Machingaidze S. and Wiysonge C.S. 2021, Understanding COVID-19 vaccine hesitancy, in

“Nature Medicine”, 27(2021), pp. 1338-1339.

Marcec R. and Likic R. 2021, Using Twitter for sentiment analysis towards

AstraZeneca/Oxford, Pfizer/BioNTech and Moderna COVID-19 vaccines, in

“Postgraduate Medical Journal” 1(2021), article 140685.

Miller G.A. 1995, WordNet: A Lexical Database for English, in “Communications of the

Association for Computing Machinery (ACM)” 38 [11], pp. 39-41.

Mocanu D., Baronchelli A., Perra N., Gonçalves B., Zhang Q. and Vespignani A. 2013, The Twitter of babel: Mapping world languages through microblogging platforms, in

“PLOS ONE” 8 [4], article e61981, pp. 1-9.

Mohammad S.M. and Turney P.D. 2013, Crowdsourcing a word-emotion association

lexicon, in “Computational Intelligence” 29 [3], pp. 436-465.

Novak P.K., Smailovic J., Sluban B. and Mozetic I. 2015, Sentiment of Emojis, in “PLOS

ONE” 10 [12], article e0144296, pp. 1-22.

Peterka-Bonetta J. 2015, Emoticons decoder for social media sentiment analysis in R.

https://www.r-bloggers.com/2015/10/emoticons-decoder-for-social-media-

sentiment-analysis-in-r/ (20.08.2021).

Plutchik R. 1991, The Emotions, University Press of America, Lanham.

Plutchik R. 2001, The Nature of Emotions, in “American Scientist”, 89 [4], pp. 344-350. Prada M., Rodrigues D.L., Garrido M.V., Lopes D., Cavalheiro B. and Gaspar, R. 2018,

Motives, frequency and attitudes toward emoji and emoticon use, in “Telematics and

Informatics” 35(2018), pp. 1925–1934.

R Core Team. 2021, R: A Language and Environment for Statistical Computing, R

Foundation for Statistical Computing, Vienna.

Sharma D., Sabharwal M., Goyal V. and Vij M. 2020, Sentiment Analysis Techniques for

Social Media Data: A Review, in Luhach A.K.et al. (eds.), First International Conference on Sustainable Technologies for Computational Intelligence. Proceedings of ICTSCI 2019, Springer, New York, pp. 75-90.

Silveira N., Dozat T., De Marneffe M.C., Bowman S., Connor M., Bauer J. and Manning C.D. 2014, A Gold Standard Dependency Corpus for English, in Calzolari N. et al. (eds.), Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), European Language Resources Association (ELRA), Reykjavik, pp. 2897-2904.

Wang Y., Croucher S.M. and Pearson E. 2021, National Leaders’ Usage of Twitter in Response to COVID-19: A Sentiment Analysis, in “Frontiers in Communication” 6(2021), article 732399.

Ward Church W. and Hanks P. 1990, Word Association Norms, Mutual Information, and Lexicography, in “Computational Linguistics” 16 [1], pp. 22-29.

Weissman B. and Tanner D. 2018, A strong wink between verbal and emoji-based irony: How the brain processes ironic emojis during language comprehension, in “PLOS ONE” 13 [8], pp. 1-26.

Wickham H. 2016, ggplot2: Elegant Graphics for Data Analysis, Springer-Verlag, New Y ork.

Wickham H. 2019, Welcome to the tidyverse, in “Journal of Open Source Software”, 4 [43], article 1686, pp. 1-6.

Wickham H., François R., Henry L. and Müller K. 2021, dplyr: A Grammar of Data Manipulation. https://CRAN.R-project.org/package=dplyr (21.07.2021).

Wickham H. 2020, emo: Easily insert emoji into R and RMarkdown. https://github.com/hadley/emo (20.08.2021).

Wijffels J. 2021, UDPipe Natural Language Processing – Text Annotation. https://cran.r- project.org/web/packages/udpipe/vignettes/udpipe-annotation.html (21.07.2021).

Wouters O.J., Shadlen K.C., Salcher-Konrad M., Pollard A.J., Laroson H.J., Teerawattananon Y. and Jit M. 2021, Challenges in ensuring global access to COVID- 19 vaccines: production, affordability, allocation, and deployment, in “The Lancet”, 397(10278), pp. 1023-1034.

Yousefinaghani S., Dara R., Mubareka S. and Papadopoulos A. 2021, An analysis of COVID-19 vaccine sentiments and opinions on Twitter, in “International Journal of Infectious Diseases” 108(2021), pp. 256-262.

Zarocostas J. 2020, How to fight an infodemic, in “The Lancet” 395(2020), article 10225, p.676.


Full Text: PDF

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribuzione - Non commerciale - Non opere derivate 3.0 Italia License.