Obscured man in hoodie on laptop

Wondering if content is reliable? Determine its origin

Updates

Peter Adams

I am NLP's senior vice president of education. My team runs all of our professional learning opportunities, including NewsLit Camps, and our resource and content development, including Checkology assets. Many years ago I taught middle school ELA and social studies, in an after school program for high schoolers and at the college level.


Know the techniques bad actors use to fool you online.

The most essential question to ask of viral online content is also frequently one of the most difficult to answer: Where did this come from?

While this question isn’t new — after all, purveyors of misinformation have always “adapted their workflows to the latest medium” — it has been elevated by an information ecosystem optimized for anonymity, alteration, fabrication and sharing.

It’s a perfect storm, the authors of a new report argue, for “source hacking”: organized information influence campaigns that exploit “technological and cultural vulnerabilities” to strategically amplify — and obscure the provenance of — false information. The paper provides new vocabulary for common tactics employed by bad actors online: viral sloganeering (packaging and pushing claims and talking points); leak forgery (fabricating and “leaking” false documentation); evidence collages (selectively bundling information and examples from multiple sources); and keyword squatting (using sockpuppet impersonation accounts and flooding or “brigading” comments, keywords and hashtags to misrepresent issues, individuals or groups).

Used in combination, these tactics make it difficult to determine the origins of pieces of coordinated misinformation. Disguising the content’s creators and their intent helps false claims get amplified to large audiences by social media influencers and by news outlets debunking or otherwise covering the campaign. But this new vocabulary can help the public move beyond opaque and less useful terms — like “trolling” — to accurately describe and better understand coordinated disinformation efforts online.

Take, for example, the false rumor spread in the wake of a shooting spree in two West Texas towns on Aug. 31. When police identified the gunman the day after the shooting, a false claim quickly spread online (viral sloganeering) that he was a supporter of 2020 Democratic presidential candidate Beto O’Rourke. At one point, this claim comprised more than 13% of all tweets about shooter (keyword squatting). Doctored images of the shooter’s truck with an O’Rourke campaign bumper sticker emerged, as did screenshots of fake online profiles (WARNING: linked page includes examples of hate speech) listing false information about the shooter’s political affiliations and ethnicity (leak forgery). These claims were thencombined (evidence collage) and spread.

Here are some activities for the classroom:

Note: The false information about the Odessa, Texas, shooter is not the only recent example of Donovan and Friedberg’s source hacking techniques in action. Last week, NBC News traced a number of divisive social media accounts impersonating Jewish people back to 4chan’s /pol/ message board, a forum known to be a cauldron of anti-Semitism, sexism and racism.

Also note: The U.S. Department of Defense announced last week that disinformation is a significant enough threat to U.S. security that it is launching an initiative to repel “large-scale, automated…attacks.”

Discuss: Can breaking down and naming the techniques used by disinformation agents online help people better avoid being exploited by mis- and disinformation? Will knowing these four techniques help you?

Related:

More Updates

Watch seventh graders share news literacy skills at a holiday dinner table

The holidays are a time to be together with loved ones, but conversations can get contentious if the topic turns to falsehoods circulating on social media or elsewhere. Luckily, the seventh-grade students at North Salem Middle/High School in New York know how to keep the mood civil around the dinner table by relying on news…

NLP in the News