Category Archives: Research

The impact of Facebook’s vaccine misinformation policy on the endorsements of vaccine problematic content in the Italian context

I quickly checked the impact of the Facebook MisinformationPolicy (announced on March 7, 2019) on the endorsements of vaccine-related posts by Italian misinformation actors, employing interrupted time series analysis (you can read about this technique in the didactic material I have made available online at https://nicolarighetti.github.io/Time-Series-Analysis-With-R/).

There is a small instantaneous drop in likes, a slight inversion in the overall trend, and a persistent decrease in the average likes from before to after the policy implementation. The analysis is just exploratory and has several limitations (e.g., small sample size), but the effect looks clear.

The analysis is directly inspired by the recent paper of Gu et al. It is, in fact, a quick check of their findings in the Italian context: Gu, J., Dor, A., Li, K., Broniatowski, D. A., Hatheway, M., Fritz, L., & Abroms, L. C. (2022). The impact of Facebook’s vaccine misinformation policy on user endorsements of vaccine content: An interrupted time series analysis. Vaccine, 40(14), 2209-2214.

The Facebook accounts spreading misinformation that I employed in the analysis come from the MINE project: Giglietto, F., Farci, M., Marino, G., Mottola, S., Radicioni, T., & Terenzi, M. (2022, January 7). Mapping Nefarious Social Media Actors to Speed-up Covid-19 Fact-checking. https://lnkd.in/eRMzrrvP

PolarVis: Visual Persuasion in a Transforming Europe

As part of the CHANSE initiative, the Austrian Science Fund (FWF) financed (about 300,000€) the project “PolarVis: Visual Persuasion in a Transforming Europe” (2023-2026) led by Annie Waldherr (PI) and Nicola Righetti (co-PI).

Climate change has been called the defining crisis of our time. In the last few years, millions of people have taken to the streets to demand urgent action on the escalating ecological emergency. Social media have had great importance in the development of the movement. For example, the virality of posts on Twitter and Instagram has quickly transformed the activist Greta Thunberg into an iconic figure, attracting supportive but also openly hostile reactions. The importance of images in the online communication of the movement and the emotions moving these activists and those who attack them online draw attention to the symbolic and emotional role of images for social movements. The PolarVis project will examine the role of visual content in processes of political polarization and belonging in the digital age by focusing on the intergenerational issue of climate change and the green transition.

PolarVis: Visual persuasion in a transforming Europe: The affective and polarizing power of visual content in online political discourse will be led by Annie Waldherr (PI) and Nicola Righetti (Co-PI), and supported by a postdoctoral researcher as well as a student research assistant. The funding provided by the Austrian Science Fund (FWF) totals to around € 300.000 over the course of the next three years. The Viennese project of PolarVis is part of a large and interdisciplinary international consortium within the CHANSE initiative. The consortium is led by Alexandra Segerberg of the Department of Government at Uppsala Universitet, Sweden.

Further information on the project can be accessed here.

Political Advertisement and Coordinated Behavior on Social Media in the Lead-Up to the 2021 German Federal Elections.

The report of the research project MINE-GE: Mapping Coordinated Inauthentic Behavior in the Lead Up to the 2021 German Federal Election has been released. During the project, which was funded by Landesanstalt für Medien Nordrhein Westfalen, we collected over 13,000 Facebook Ads, 2.5 million political posts, and 1.8 Million URLs shared on Facebook, Twitter, and Instagram by parties, candidates, and other social media users in the six weeks up to the election day, to monitor political social media communication, detect coordinated networks and analyze possible micro-targeting strategies.

The report is available in English and German on the website of Landesanstalt für Medien Nordrhein Westfalen at the following links:

The Anti-Gender Debate on Social Media

The Anti-Gender Debate on Social Media. A Computational Communication Science Analysis of Networks, Activism, and Misinformation (which can be freely accessed at this link) takes into account 10 years of anti-gender communication on Facebook in Italy, and proposes a multifaceted analysis of different aspects of the debate, including activism and misinformation.

It shows that both right-wing/populists/religious and pro-LGBTQI+ actors were involved in the debate, but the former got more engagement. Notably, religious accounts got even more engagement than the right-wing ones. Also, posts from left-wing parties’ accounts were just a few.

The most engaging posts against Gender came from Radio Maria, a popular (and sometimes controversial) catholic radio, and the conversations peaked in 2015, close to the conservative manifestation “Family Day”, but religious actors have kept paying attention to the issue. 

Time series analysis suggested that Facebook posts mostly amplified an agenda set by news media following offline events. Similarly, Facebook has been used to amplify “traditional” types of activism, like petitions “against gender”.

However, an analysis through CooRnet also revealed the presence of coordinated Facebook networks spreading news stories on gender ideology, also coming from websites renowned for spreading misinformation and low-quality, click-bait news stories. 

Still on the subject of misinformation, the analysis shows that 2% of the about 20,000 analyzed Facebook posts associated LGBTQI+ people and organizations with paedophilia by means of “gender ideology”.

Four Years of Fake News

A new paper briefly reviewing the scientific literature on fake news published up to 2020 is online on First Monday. You can read it here: Four Years of Fake News. A Quantitative Analysis of the Scientific Literature

Abstract

Introduction: Since 2016, “fake news” has been the main buzzword for online misinformation and disinformation. This term has been widely used and discussed by scholars, leading to hundreds of publications in a few years. This report provides a quantitative analysis of the scientific literature on the topic published up to 2020.

Methods: Documents mentioning the keyword “fake news” have been searched in Scopus, a large multidisciplinary scientific database. Frequency analysis of metadata and automated lexical analysis of titles and abstracts have been employed to answer the research questions.

Results: 2,368 scientific documents mentioned “fake news” in the title or abstract, published by 5,060 authors and 1,225 sources. Until 2016 the number of documents mentioning the term was less than 10 per year, suddenly rising from 2017 (203 documents), and steadily increasing in the following years (477 in 2018, 694 in 2019, and 951 in 2020). Among the most prolific countries are the USA and European countries such as the UK, but also many non-Western countries such as India and China. Computer Science and Social Sciences are the disciplinary fields with the largest number of documents published. Three main thematic areas emerged: computational methodologies for fake news detection, the social and individual dimension of fake news, and fake news in the public and political sphere. There are 10 documents with more than 200 citations, and two papers with a record number of citations (Alcott & Gentzkow, 2017; Lazer et al., 2018).

Conclusions: Research on “fake news” keeps on the rise, with a marked upward trend following the 2016 USA Presidential election. Despite having been the subject of debate and also criticism, the term is still widely used. A strong methodological interest in fake news detection through machine learning algorithms emerged, which – it can be argued – can be profitably balanced by a social science approach able to unpack the phenomenon also from a qualitative and theoretical point of view. Although dominated by the USA and other Western countries, the research landscape includes different countries of the world, thus enabling a wider and more nuanced knowledge of the problem. A constantly growing field of study like the one concerning fake news requires scholars to have a general overview of the scientific productions on the topic, and systematic literature reviews can be of help. The variety of perspectives and topics addressed by scholars also means that future analyses will need to focus on more specific topics.

Digital Animal Advocacy: A Study on Facebook Communication Styles of Italian Animal Rights Organizations and their Followers’ Reactions

A new paper (open access!) is out: Digital Animal Advocacy: A Study on Facebook Communication Styles of Italian Animal Rights Organizations and their Followers’ Reactions.

The paper analyzes the Facebook communication of the Italian galaxy of Italian animal advocates by using a text-mining approach, and reflects on the role of social media in promoting specific political approaches to animal rights.

The social media ecology does not change or construct the different positions of different sectors of animal advocacy, but contributes to amplify their distances, favoring the visibility or, using the term adopted by Dijck and Poell (2013), the ‘popularity’ of some groups over others. It is no coincidence that mainstream AAOs, which have greater financial and professional resources at their disposal, also have Facebook pages with the highest number of followers (Tab. 3), nor that they are clearly fully aware of the possibilities of exploiting the algorithms that preside over the distribution of the most popular content (…) in order to hack the social media attention economy (…) by calling on the concerted efforts of well-organized armies of web-activists.

From this perspective, Italian animal advocacy reflects a lack of democracy in digital platforms and is a further proof of the adage ‘the rich get richer and the poor get poorer’ (Merton, 1968). At least for the moment, the horizontal and democratic nature of Internet-based communication that is hoped for (in the case of anarchist AAOs) or explicitly claimed as already existent and widespread (in the case of anti-political AAOs) is absent (…)

Correspondences analysis of the posts published by four categories of animal rights organizations. The words represented in the map are a subset of the analyzed words with the highest contribution to the axes and representation quality.

QAnon in Italy: a growing phenomenon?

Pandemic are scary. There is nothing worse that an invisible enemy to spread anxiety. Information is partial, contradictory. Rumors and minsinformation flourish. People have to grapple daily with uncertainty and fear. Such a context is a breeding ground for conspiracy theories and their harmful consequences.

Among the interesting phenomena that have been observed so far, there is the attempt to incorporate the pandemic into already established conspiracy and fringe narratives, such as the anti-vax and the Q-Anon one. The first one is rather popular in Italy. In this country, a law on mandatory child vaccinations (2017) sparked an heated debate and information crisis and
fueled the spread of misinformation on social media. The QAnon conspiracy theory, on the contrary, is not so common in Italy. However, the situation could change.

Analyzing 12 months of data from Google Trends, Twitter and Facebook, I have observed a unequivocal rising interest in QAnon theories in Italy during the last period of Covid-19 quarantine (March/April 2020).

Italian Google Search interest, Facebook posts (CrowdTangle data) and Tweets matching the keywords WWG1WGA and Qanon. Data are scaled on a range of 0 to 100. The blu and red vertical lines represent, respectively, the structural break dates in the Google Trends and the two social media time series.

At the moment the number of tweets and posts is small. Nevertheless, if the peak keeps growing…

Data are divided in the pre-pandemic period (before 2019-12-31), pandemic period (after 2019-12-31 but before 2020-03-15) and peak of interest period (after 2020-03-15)

The following table includes the most active Facebook entities (pages, public groups, or verified profiles) and Twitter accounts in the collected data sets.

Facebook pages/groups and Twitter accounts that have the published the highest number of posts matching the keywords QAnon or WWG1WGA (not necessarily “QAnon believers”)

In the following Google sheets are included some examples of the Facebook posts and tweets with the highest engagement (data are divided in the pre-pandemic period – before 2019-12-31 – the pandemic period – after 2019-12-31 and before 2020-03-15 – and peak of interest period, after 2020-03-15).

Health and political misinformation in Italy. The case of mandatory vaccine law

Political and health misinformation are huge problems today. Both can have nefarious consequences on individuals, citizens, institutions and society. As I and co-authors have recently observed in our paper “Blurred Shots: Investigating the Information Crisis Around Vaccination in Italy”, politicization can increase the circulation of misinformation on vaccines “both directly and by opening the door to pseudoscientific and conspiratorial content (…) published by problematic news sources”. It is therefore interesting to further analyze the link between politicization and misinformation.

Italy is an excellent case for studying the intertwining of politics and health misinformation, since it has been at the center of both political and health information crisis during the election (on March 2018) and the debate on the law on mandatory child vaccinations (around July 2017).

I analyzed about 500,000 tweets published between 2016-02-01 and 2019-01-31 (three years),18 months before and after July 31, 2017, when the Italian law on mandatory vaccinations came into force (you can read here the working paper).

The peak of discussions during the political debate was very clear and a structural break analysis confirmed that the usual flow of conversation dramatically changed around that time.

Annotated time series of the Italian tweets on vaccines. The red box indicates the boundaries of the structural break, exactly during the debate on the mandatory vaccinations law.

I categorized over 1,000 information sources shared by Twitter’s users and used a combination of network analysis, correspondence analysis and clustering to identify the groups of information source categories frequently shared together.

The resulting map was unequivocal: the Twitter information environment related to vaccines was polarized and characterized by information homophily. The information sources openly promoting anti-vax perspectives were clustered with blacklisted domains (included in the blacklists of the main Italian debunkers), alternative therapy sites, and conspiracy blogs. On the opposite polarity of the Correspondence Analysis axis (the dimension account for over the 70% of the total variance) we find scientific information sources, those of health organizations, as well as the official sources. Political information sources (such as websites of political parties and advocacy organizations) lie in between these two polarities.

Clusters of information sources

I measured the spread of health misinformation by using the tweets that shared sources included in the cluster of problematic information sources and found that the time series of tweets sharing misinformation was characterized by a structural break during the political debate as the whole series of tweets. It seemed, therefore, that the politicization of the topic fostered not only the conversations on the topic in general, but also the spread of health misinformation.

Since the spread of misinformation can be clearly associated with the general attention and more specifically with the media attention to the topic (misinformation sources can try to “ride the wave” of this interest), I used a Vector Autoregressive Model to further test the hypothesis, and found that politicization, operationalized through a proxy variable indicating the structural break, was associated with an increase in quantity of misinformation also keeping constant the quantity of news media coverage of the previous days, which I measured through Media Cloud (but I found roughly the same results also using the time series of tweets sharing information sources categorized as news media).

Moreover, it seems that while misinformation, on average, grew a lot during the political debate (of about 6 times the period before the political debate) and also after that time (about two times the period before the political debate), the number of tweets sharing scientific and health information sources increased much less during the central period of the debate (only about two times) and even decreased after that time.

This study is only a small step toward the understanding of the intertwining of health and political misinformation. There is still much work to be done, other case studies are needed and more sophisticated measures are needed. In the meanwhile you can read here the full paper of the study briefly described above.


Understanding Coordinated and Inauthentic Link Sharing Behavior on Facebook

I am pleased to announce that it has just been published “Understanding Coordinated and Inauthentic Link Sharing Behavior on Facebook in the Run-up to 2018 General Election and 2019 European Election in Italy”. This report is the first outcome of our research project funded by the Social Science Research Council in partnership with Facebook and Social Science One.

In the report we analyzed “coordinated inauthentic behavior”, a concept only briefly defined in Facebook public statements which we found useful to frame our research in the light of existing scientific literature.

Based on a combination of CrowdTangle API (a tool for accessing Facebook and other social media data) and two datasets of Italian political news stories published in the run-up to the 2018 Italian general election and 2019 European election, we developed a method that led to the identification of several networks of pages/groups/verified public profiles (“entities”) that shared the same political news stories on Facebook within a very short period of time (10 in 2018, composed of 28 entities, and 50 in 2019, composed of 143 entities). We called this behavior “coordinated link sharing”. You can find the R script to implement the method here.

One of the Italian coordinated networks

By analyzing the social media profiles of such coordinated entities, we observed that while some of them were clearly political, others presented themselves as entertainment venues, despite sharing political content too. Since the political news stories shared by these non-political entities can reach a broad audience which is largely unguarded against attempts to influence, we describe their behavior as “inauthentic” (look at the following tweet to get an idea of what we mean by “inauthentic”).

Our analyses showed that the news shared by the coordinated networks received a Facebook engagement higher than other news included in our dataset. Further analyses are needed to understand the impact of coordinated activities on engagement and public opinion.

The engagement of the the news items shared by coordinated (orange) and non-coordinated (light blue) entities

We found also that much news boosted anti-immigration and far-right propaganda (primary League-friendly propaganda) and that several of the news outlets shared by these networks, as well as some of the Facebook pages involved in coordinated behavior, were already blacklisted by fact-checkers.

We estimated the partisan leaning of the online news media outlets shared by the coordinated networks using the Multi-Party Media Partisanship Attention Score (MP-MPAS), a method we described in a recently published paper.

From Robots to Social Robots. Trends, Representation and Facebook Engagement of Robot-Related News Stories

In recent years technological beings have been entering our individual and social lives in ever increasing numbers. From virtual personal assistants like Microsoft Cortana, Apple Siri, Amazon Alexa and Google Home to robots working with us and for us, artificial creatures are leaving both the fictional world they inhabited for centuries and the industrial and aeronautical fields in which they used to be applied, to increasingly share our living space.

To accommodate these artificial creatures in social life, a space in the symbolic order of society needs to be created. Since media communication is a significative means for creating such a cultural space and there is a lack of research in the field, we decided to conduct an empirical analysis on the Italian online media coverage of robot-related news stories and their Facebook engagement.

Robot-related news items published between 2014 and 2018 and their Facebook engagement

The study has analyzed how, and how much, robot-related topics have been covered and represented in the headlines of Italian online newspapers throughout recent years, relying on text mining techniques for unsupervised text classification developed in R. The news stories were collected through Media Cloud and their Facebook engagement retrieved through the Facebook Graph API, using an approach directly inspired by the Mapping Italian News project.

Topics in robot-related news stories

Results support the idea that online media have been increasingly covering robot-related news stories, and online public has been increasingly affected by this. The text analysis has revealed that the most relevant topic in online news media has concerned the work-skills of robots, which partly arouses astonishment, and partly concern about job losses.

Specificity table. The most characteristic lemmas in each topic (English translation).
The 10 most engaging Italian robot-related news stories on Facebook (English translation)

The news with the highest engagement concerns the experiment of two robots that started “talking to each other” in an unknown language (Facebook engagement: 67,819). Then, there is news on issues such as the future, human-robot relationship, and work-related controversies and policies.

Although fears that robots might steal human jobs and become autonomous and uncontrollable seem to persist, news representing robots as a threat is less than expected. This might support the idea that threatening representations of robots (Mori, 1970) are not so widespread or engaging.

This was not a specific area of inquiry of the current study and further research is needed to assess the attitude toward robots, and how and why it has changed through the years. However, some observations are possible. For example, there might be a lack of awareness regarding risks associated with the use of robots – for example war robots – due to a scarce media coverage of the topic. However, a stronger explanation has to do with socialization practices promoting human-robots coexistence: a lot of news revolves around the use of robots in teaching activities, entertainment industry, festivals, exhibits and in the personal and familial sphere. These activities promote a gradual, positive integration of robots in everyday life. Considering that many people still have limited direct experience with robots, media play a central role in promoting a positive representation of robots. Finally, a significant role is played, and will be played in the future, by marketing activities aimed at promoting positive attitudes toward consumer robotics products.

From a general perspective, the results have shown that online news stories on robots have increased over time, doubling in the five years considered in the study. The Facebook engagement follows the same path, so validating the idea of an increasing interest towards robots among the Italian online public and suggesting they no longer appear a topic people perceive far from their lives. In turn, familiarity with robots is reinforced by their increasing presence in online news stories.

The complete paper can be accessed here: From Robots to Social Robots. Trends, Representation and Facebook Engagement of Robot-Related News Stories Published by Italian Online News Media.