During a recent long drive, my husband and I listened to some podcasts. One of them was an interview with a researcher from the Pew Research Center, talking about a recent survey Pew has conducted to determine Americans' ability to distinguish factual statements from opinion statements.
The differentiation between factual and opinion statements used in this study – the capacity to be proved or disproved by objective evidence – is commonly used by others as well, but may vary somewhat from how “facts” are sometimes discussed in debates – as statements that are true.1 While Americans’ sense of what is true and false is important, this study was not intended as a knowledge quiz of news content. Instead, this study was intended to explore whether the public sees distinctions between news that is based upon objective evidence and news that is not.
The statements presented were political; five were written to appeal more to Democrats and five appealed more to Republicans. A lot of testing was done beforehand to make sure that respondents understood exactly what was being asked of them:
In the survey, respondents read a series of news statements and were asked to put each statement in one of two categories:
-
A factual statement, regardless of whether it was accurate or inaccurate. In other words, they were to choose this classification if they thought that the statement could be proved or disproved based on objective evidence.
-
An opinion statement, regardless of whether they agreed with the statement or not. In other words, they were to choose this classification if they thought that it was based on the values and beliefs of the journalist or the source making the statement, and could not definitively be proved or disproved based on objective evidence.
So what were the results?
...a majority of Americans correctly identified at least three of the five statements in each set. But this result is only a little better than random guesses. Far fewer Americans got all five correct, and roughly a quarter got most or all wrong.
Do you find that disturbing? I do. But I'm not surprised, either.
The people who did the best on the test were those with a high level of political awareness (36% identified all five factual news statements) and those who were "digitally savvy" (44% identified all five opinion statements correctly.)
And though political awareness and digital savviness are related to education in predictable ways, these relationships persist even when accounting for an individual’s education level.
And as you can imagine, political bias also played a part in skewing the responses. This was shown when respondents were matched with their party affiliations, and made clearer when they were asked if they agreed or not with the statements they called "opinion." But that really wasn't the entire point of the survey -- it was to determine if the respondents could distinguish between a factual statement and an opinion at all. That's a critical thinking skill. For instance:
Overall, Republicans and Democrats were more likely to classify both factual and opinion statements as factual when they appealed most to their side. Consider, for example, the factual statement “President Barack Obama was born in the United States” – one that may be perceived as more congenial to the political left and less so to the political right. Nearly nine-in-ten Democrats (89%) correctly identified it as a factual statement, compared with 63% of Republicans. On the other hand, almost four-in-ten Democrats (37%) incorrectly classified the left-appealing opinion statement “Increasing the federal minimum wage to $15 an hour is essential for the health of the U.S. economy” as factual, compared with about half as many Republicans (17%).
and further:
When Americans see a news statement as factual, they overwhelmingly also believe it to be accurate. This is true for both statements they correctly and incorrectly identified as factual, though small portions of the public did call statements both factual and inaccurate.
This is a failure of the educational system, and it certainly has a profound effect on electoral politics, as well as explaining some of the reasons why we're in this current predicament. People without critical thinking skills can be easily and successfully manipulated, as they are now being, by politicians, foreign governments, and biased media. The truly frightening part is how long it would take to correct such a failure - and how little political will there is, and has been, for an educated, critical, and independent electorate.
If you want to try the test yourself, it's online here.