Do We Exaggerate Our Political Differences?

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.


Andrew Gelman points me toward a new paper today that attempts to measure political polarization. The authors use NES survey data to measure (a) average positions from self-identified Democrats and Republicans on ten issues, and (b) perceptions of how big those differences are. They found that perceptions were consistently higher than reality: both Democrats and Republicans tended to overestimate how polarized we really are, and the more partisan you are the more you overestimate polarization. The full paper is here.

I’ve got a couple of problems with this paper, though. First, the dataset spans 30 years and ends in 2004. So even if the effect they find is real, it doesn’t tell us much about polarization, both real and imagined, over the past decade or so.

Second, and more important, is the effect real? There’s an obvious problem with how the authors calculate polarization:

We calculated perceived polarization, for every issue and respondent, as the respondent’s estimated attitude of the “Republican Party” minus the respondent’s estimated attitude of the “Democratic Party.” Higher numbers indicated greater polarization. We calculated actual polarization as the mean attitude of all respondents who self-identified as Republican minus the mean attitude of all respondents who self-identified as Democrat. We then calculated exaggerated polarization as perceived polarization minus actual polarization for each respondent on each issue in every year.

The problem is that when people are asked to estimate the actual positions of Democrats and Republicans, they probably aren’t thinking about national averages. More likely, they’re thinking about the positions of national leaders with big megaphones: presidents, governors, members of Congress, etc., all of whom are likely to have more strongly partisan positions. If that’s the case, perceptions of polarization might actually be fairly accurate. The authors are aware of this, so they ran a test to see if perceptions changed depending on how the questions were worded:

To directly address this possibility, we conducted a Web-based experiment to ascertain whether different ways of phrasing the attitude questions would produce different estimates of perceived polarization.

….Democratic or Republican targets were described using one of the four following prompts: (a) Where would you place the Democratic [Republican] Party on this scale? (b) Where would you place those people who identify as Democrats [Republicans] on this scale? (c) Where would you place Democratic [Republican] Party officials (that is, Democrats [Republicans] who hold an elected position at any level of government) on this scale? (d) Where would you place those people who identify as Strong Democrats [Republicans] on this scale?

The authors found no difference in perceptions based on question phrasing. Unfortunately, I don’t find this especially persuasive. Only about 70 people responded to each phrasing, so this is a pretty small sample set. Furthermore, I have my doubts that most people really have clear beliefs about these differences in the first place. For example, the authors report “somewhat surprisingly” that when the attitude question referred to party officials, perceived polarization was significantly lower. As they say, that doesn’t really make much sense, and it suggests that respondents simply weren’t thinking very hard about this. I suspect that happens a lot when you pay people a buck or two to fill out a questionnaire using Amazon’s Mechanical Turk.

So….I’m a little skeptical of this. It’s interesting in a limited way, but the differences between actual and perceived polarization were generally fairly modest; the data set is old; and it’s unclear that the authors’ definition of “actual” polarization corresponds to the real world. I don’t really doubt that the media exaggerates partisan differences these days, but I’d nonetheless take this study with a grain of salt.

WE'LL BE BLUNT

It is astonishingly hard keeping a newsroom afloat these days, and we need to raise $253,000 in online donations quickly, by October 7.

The short of it: Last year, we had to cut $1 million from our budget so we could have any chance of breaking even by the time our fiscal year ended in June. And despite a huge rally from so many of you leading up to the deadline, we still came up a bit short on the whole. We can’t let that happen again. We have no wiggle room to begin with, and now we have a hole to dig out of.

Readers also told us to just give it to you straight when we need to ask for your support, and seeing how matter-of-factly explaining our inner workings, our challenges and finances, can bring more of you in has been a real silver lining. So our online membership lead, Brian, lays it all out for you in his personal, insider account (that literally puts his skin in the game!) of how urgent things are right now.

The upshot: Being able to rally $253,000 in donations over these next few weeks is vitally important simply because it is the number that keeps us right on track, helping make sure we don't end up with a bigger gap than can be filled again, helping us avoid any significant (and knowable) cash-flow crunches for now. We used to be more nonchalant about coming up short this time of year, thinking we can make it by the time June rolls around. Not anymore.

Because the in-depth journalism on underreported beats and unique perspectives on the daily news you turn to Mother Jones for is only possible because readers fund us. Corporations and powerful people with deep pockets will never sustain the type of journalism we exist to do. The only investors who won’t let independent, investigative journalism down are the people who actually care about its future—you.

And we need readers to show up for us big time—again.

Getting just 10 percent of the people who care enough about our work to be reading this blurb to part with a few bucks would be utterly transformative for us, and that's very much what we need to keep charging hard in this financially uncertain, high-stakes year.

If you can right now, please support the journalism you get from Mother Jones with a donation at whatever amount works for you. And please do it now, before you move on to whatever you're about to do next and think maybe you'll get to it later, because every gift matters and we really need to see a strong response if we're going to raise the $253,000 we need in less than three weeks.

payment methods

WE'LL BE BLUNT

It is astonishingly hard keeping a newsroom afloat these days, and we need to raise $253,000 in online donations quickly, by October 7.

The short of it: Last year, we had to cut $1 million from our budget so we could have any chance of breaking even by the time our fiscal year ended in June. And despite a huge rally from so many of you leading up to the deadline, we still came up a bit short on the whole. We can’t let that happen again. We have no wiggle room to begin with, and now we have a hole to dig out of.

Readers also told us to just give it to you straight when we need to ask for your support, and seeing how matter-of-factly explaining our inner workings, our challenges and finances, can bring more of you in has been a real silver lining. So our online membership lead, Brian, lays it all out for you in his personal, insider account (that literally puts his skin in the game!) of how urgent things are right now.

The upshot: Being able to rally $253,000 in donations over these next few weeks is vitally important simply because it is the number that keeps us right on track, helping make sure we don't end up with a bigger gap than can be filled again, helping us avoid any significant (and knowable) cash-flow crunches for now. We used to be more nonchalant about coming up short this time of year, thinking we can make it by the time June rolls around. Not anymore.

Because the in-depth journalism on underreported beats and unique perspectives on the daily news you turn to Mother Jones for is only possible because readers fund us. Corporations and powerful people with deep pockets will never sustain the type of journalism we exist to do. The only investors who won’t let independent, investigative journalism down are the people who actually care about its future—you.

And we need readers to show up for us big time—again.

Getting just 10 percent of the people who care enough about our work to be reading this blurb to part with a few bucks would be utterly transformative for us, and that's very much what we need to keep charging hard in this financially uncertain, high-stakes year.

If you can right now, please support the journalism you get from Mother Jones with a donation at whatever amount works for you. And please do it now, before you move on to whatever you're about to do next and think maybe you'll get to it later, because every gift matters and we really need to see a strong response if we're going to raise the $253,000 we need in less than three weeks.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate