Wednesday, 27 August 2003

Conference advice

Apropos of this weekend, Daniel Drezner and Kieran Healy have some advice for first-time attendees of academic conferences, while Kevin Drum just wonders what all the fuss is about.

Tuesday, 26 August 2003

APSA-blogging

Jacob Levy continues presenting abstracts of APSA papers at The Volokh Conspiracy. I’ll probably be spending most of my time in Philly being poked and prodded by potential employers (no word yet on whether or not the Wonderlic test is involved), but I’ll try to blog about anything interesting I see in my fields of interest (which seem to be largely non-overlapping with the rest of the blogosphere).

Monday, 25 August 2003

The L.A. Times poll and oversampling

Dan Weintraub notes that the Los Angeles Times poll of California voters—the first to show a lead for Bustamante outside the margin of error—included a special sample of 125 Latino voters. Dan hasn’t get clarification yet as to how the Latinos were counted in the overall poll, which interviewed 1,351 (self-declared?) registered voters, 801 of whom were deemed “likely” voters.

The key question is whether the 125 Latinos were all “likely” voters or just registered. In terms of registration numbers, the count seems reasonable in terms of a sample of Californians; however, if all 125 were “likely” there was an oversampling of Latinos which should have been corrected. (* For more on this, follow the Read More link.)

So the big question is whether or not the oversampling was an issue in the main poll, and if so whether it was compensated for. If it wasn’t, the Times poll is giving us a very biased estimate of the population parameter (in this case, the percentage of likely voters who are planning to vote for Bustamante or leaning that way).

Another possible source of the high Bustamante number is that the Times poll included “leaners” in addition to voters who initially declared a preference for a particular candidate. (Generally in surveys on vote choice, if you say “I don’t know” to the first question, a followup question will ask if there’s a candidate you are leaning towards.) If other polls aren’t combining the two categories, this could explain a big part of the difference. It might also be of substantive interest; if Bustamante’s support includes a disproportionate share of leaners, they would be easier for other candidates to sway than voters who are committed to Bustamante.

Sunday, 24 August 2003

Perestroikans and the obsession with "rational choice"

Matthew at A Fearful Symmetry notes trouble brewing at Harvard’s Kennedy School of Government between “rational-choice theorists” and “more traditional political scientists,” according to NYT Magazine writer James Traub.

This description belies a lack of understanding about political science. We can generally break the history of political science into two eras: the pre-behavioral period and the post-behavioral period. During the pre-behavioral period, political scientists basically did two things: descriptive analysis of political institutions and what I’d term “normative political theory,” a nebuolous field that generally involves the study of political phiolosophy, with a nice dash of prescriptivism thrown in just for entertainment value. Woodrow Wilson did a bit of the former, when he wasn’t being a prescriptivist or a racist (the three occupations kept him fairly busy).

Then came World War II, James Gallup, and the sample survey. A bunch of folks at Columbia and Michigan (among other places) decided that it might be a good idea to test whether all these theories people had come up with about the behavior of voters during the “pre-behavioralist” period were valid (and it turns out that they basically were wrong). Thus was born the behavioral revolution in political science—and, arguably, the entire idea of the study of politics using the scientific method (or empiricism).

Note that this account has not used the words “rational choice.” That’s because rat choice really has almost nothing to do with behavioralism. The roots of rat choice come from economics (notably the work of Anthony Downs and Mancur Olson), and in particular the idea of “utility maximization”; rational choice theory generally argues that people behave in a way that has the maximum possible benefit to themselves (“utility”). Utility has proved rather annoying to quantify in political science (in economics, utility maps rather nicely to monetary units; in political science, about the best we’ve done is OxPoints).

However, there are plenty of other ways to explain behavior in political science other than rational choice. Many behaviorists today—including myself—incorporate rationalist explanations with sociological and psychological explanations to formulate their theories of political behavior, which they then test empirically using either experimental or survey-based data with statistical techniques (usually, although not always, borrowed from other fields, including mathematical statistics, economics, psychology, and biostatistics).

More importantly, this ignores other techniques used in other subfields of political science. In international relations (and some other parts of the discipline), many theories are formulated using game theory, which has some links to rational choice (mostly in terms of the institutions the procedures were developed at, most notably the University of Chicago and University of Rochester), or more advanced mathematical modelling techniques; sometimes these techniques are linked with rational choice under the rubric of “formal theory.” Some of these techniques (ironically, like normative political theory) have not historically been subjected to any real-world testing; however, now there is some interest in doing this through the NSF’s promotion of a series of EITM (Empirical Implications of Theoretical Models) workshops and works like that of Rebecca Morton.

So describing what I do as “rational choice” is something of a misnomer. It would be like describing all normative political theorists as “Plato scholars,” or all economists as Keynesians. The truth is that there’s room for many different perspectives on the study of politics in our discipline.

The problem is that I’m not sure most Perestroikans are aware that there are multiple empirically-based perspectives. For example, the book the Perestroikans hold up as validating their point of view comes from two political scientists grounded in the empiricist, Michigan school tradition. Now, I’ll agree that some leading journals often mistake sexy methodology with substantive importance; like in specifying any theory, simpler methods are preferable to complex ones—given similar explanatory power. (This also goes for theoretical articles; if the APSR is to be a journal that everyone with a graduate education can read, surely we should expect prose that is penetrable to non-specialists.) But to reject empiricism outright in a discipline that has science as part of its name is, in my view, a bridge too far.

Daniel Drezner has more on the Summers piece this morning, which will no doubt spark an interesting discussion, while this post (inexplicably) makes John Jenkins is glad he’s a theorist. He writes:

While I'm certain that good work can, has, and will continue to be done this way in political science, more often than not we end up with analysis so blatant in its biases that it's entirely useless. I am reminded of a study that we looked at in one of my methods classes that determined that, on the whole, those who were of [M]exican descent were paid far less than those who weren’t in some city in Texas. It failed utterly to account for how long the people had been in America (i.e. first-generation immigrants tend to work in low-paying jobs because of lack of training and lack of facility with English) and resolutely concluded that the disparity was due exclusively to racism. Anyone think there was a foreordained conclusion there?

Can you say omitted variable bias? Bad research is bad research, whether it’s empirical or not…

More to the point, I don’t think empirically-oriented political scientists claim to be able to make predictions on a par with those made by sciences solely governed by physical laws. In any event, that’s fundamentally not the point of science, which seeks explanations rather than predictions. Just because, as John puts it, “people will do stupid shit sometimes” doesn’t necessarily mean that their behavior isn’t at least somewhat explainable.

What can political science tell us about the recall?

At first glance, the nation’s first statewide recall election in modern history seems like a fairly bad testing ground for past theories of political behavior. Yet there are a few things worth considering from the body of knowledge we already have from over 50 years of behavioral research (starting with Berelson, Lazarsfeld, and McPhee’s famous Elmira studies and the National Election Studies conducted at the University of Michigan):

  1. The psychological effect of Duverger’s Law should be strong. As we’ve seen with the dropout of Bill Simon, it affects not only voters but also contributors and candidates themselves. Seemingly paradoxically, this effect will be stronger among the “non-gadfly” candidates: someone who wants to vote for Arianna Huffington, Larry Flynt, or (my personal fave) Georgy Russell may find Cruz Bustamante or Arnold Schwarzenegger a poor substitute for their preferred candidate, but a Ubberoth or McClintock voter may find the “mainstream” candidates more appealing. The longer the polls indicate a close election, the more likely this election is to shape up essentially as a two-candidate race. (This even holds in situations like Democratic presidential primaries, where the proportional nature of delegate selection is a fairly well-kept secret from the electorate.)
  2. One interesting question is how the voting on the two-stage ballot will shape up. There are two groups of voters who are likely to vote no on the recall: those who want Davis to remain in office (probably around a quarter of the electorate, judging from his approval ratings) and those who believe that the second-stage winner will be a worse governor than Davis. Polls leading up to the election may determine how people vote on this question; if there is a sizeable contingent of hardcore Republicans who think Bustamante will win the second ballot, they may vote no on the recall, to retain the lame-duck Davis in office. Similarly, a Bustamante lead may encourage Democrats to vote yes on the recall, so a (potentially) strong incumbent can be on the ballot for the Democrats in 2006. The “no, Bustamante” strategy only makes sense for Democrats (at least, Democrats not named Gray Davis) in the context of a Republican (Schwarzenegger) lead; how long will they stick with it?
  3. How much can Bustamante divorce himself from Davis’ coattails without alienating Democratic voters? In 2000, Gore ran to the left, thinking he really needed to stop Democratic voters from defecting to Nader (which he actually didn’t need to do), and generally didn’t run on the Clinton record. On the other hand, Clinton’s approval rating was much higher than Davis‘, and the economy was doing significantly better too. Assuming it’s in Bustamante’s personal interest to win the election, it’s probably in his best interest to run away from Davis’ record. More importantly, in the absence of any credible challenger from the left, he can run to the right—which makes his announced tax hike package seem like a rather boneheaded move, suggesting more is at work in his campaign than a simple desire to win the recall election.

The one thing political science can’t do is forecast this election; there’s simply no precedent for it. The big question remaining is whether or not the “no” strategy on the part of the Democrats persists much into September; if it does, the election isn’t effectively Bustamante vs. Schwarzenegger; it becomes Gray vs. Arnold. My belief is that the former election is probably much more winnable for the Democrats than the latter.

Thursday, 21 August 2003

Vita envy

Dan Drezner has expanded his site. Meanwhile, since I’ve publicized it for the eJobs placement service anyway, you can read my vita too. (Any emailed recommendations for beefing up or otherwise enhancing my vita would be greatly appreciated.)

Discrimination in the academy

John Lemon has sparked an interesting discussion at Kevin Drum’s site about whether or not conservatives are discriminated against in academia. My two cents, from my end of the universe:

  1. I’ve seen surveys of political scientists, and their political beliefs as a whole are decidedly left-wing. (One such survey was made available at the 2003 MPSA convention, but I can’t seem to find a copy online.)
  2. There are relatively few self-identified conservatives in political science. I know one self-identified Republican, and he considers himself a liberal Republican—and he’s a Ph.D. student. There are probably a larger pool of either independent or libertarian-leaners in the academy, including my dissertation chair, but to my knowledge none of them have described themselves as Republicans either. I do know a few other students who have expressed sympathies that are consistent with conservatism.
  3. Conservatives and Republicans routinely receive abuse that, if directed at women or racial or ethnic minorities would be grounds for an EEOC lawsuit on the basis of a “hostile work environment.” For example, I have never heard a positive word about George Bush from anyone in a tenure-track job. In general the same goes for people with strong religious beliefs.
  4. There are probably subfields in which this matters more than others. I suspect—but have no evidence—that more empirically-oriented research programs are more accepting of conservatives, since there is less scope for personal political beliefs in such scholarship. (Speaking for myself, in general what I study is fairly divorced from left-right debates, although there are implications in terms of what we can expect from democracy.)
  5. I also suspect that this discrimination is less widespread the higher up the “prestige ladder” one goes in the discipline. I would be surprised if Ohio State, Rochester or Michigan denied someone tenure on the basis of their political beliefs, but I wouldn’t put it past Podunk State University.

What does this add up to? I’m not sure. But I’d be inclined to believe Lemon’s account.

Serendipity: Matthew Stinson at A Fearful Symmetry has some observations from a Florida State (not to be confused with Podunk State) perspective. And, the MinuteMan has more too…

Why nobody takes our discipline seriously, part 325

Pejman passes on news that one of the Ivys (specifically, Cornell University) has offered professional race-baiter and ex-Congresswoman Cynthia McKinney a guest lecturer’s position. $20 says it’s teaching “political science” courses.

Southern Appeal has dug up the press release, with the additionally-exciting news that none other than John “I idolize Robert Fisk” Pilger will also be receiving a guest professorship at Cornell. Ah well, at least I don’t have to disown that university.

Recalls as votes of no confidence

A number of people, including a healthy chunk on the right (most notably political commentator and Washington Post columnist George Will), don’t particularly care for the California recall election, considering it (variously) anti-democratic, unfair, or inconsistent with the will of the Founders. (Matthew at A Fearful Symmetry has rescinded his previous opposition in this particular instance due to Gray Davis’ general pissiness.)

The last point is fairly easily dealt with; unlike in gubernatorial elections, the president is indirectly elected via the Electoral College. The Electoral College was originally designed as sort of a half-way house between parliamentary democracy and direct election: like in a parliamentary system, the executive (in the parliamentary case, usually the prime minister) would be indirectly elected by the electorate. However, the Electoral College only does two things—electing the president and vice president—and then they go home; in a parliamentary system, the same body remains in office to approve, amend, or reject legislation proposed by the executive, and possibly—eventually—to remove the executive from office if it no longer reflects the preferences of the legislature. This removal, common to all parliamentary systems, is known as a vote of no confidence; if it succeeds, the executive must resign and be replaced, or new elections for a new legislature (and thence a new executive) are called.

The vote of no confidence is one way in which proponents of parliamentary democracy believe it leads to more stable government (the mirror image of no confidence is the power of the executive to dissolve parliament and call for new elections). So, how would we bring this benefit into a presidential system* without undermining the separation of powers? Obviously, a traditional vote of no confidence is out, as it would allow the legislature to remove the executive at will, and allowing the executive to dissolve the legislature would have similar problems.

The obvious solution is to allow the people who elected the executive and the legislature a “vote of no confidence” of their own. And, essentially, this is what the recall is: it allows the electorate to remove an executive or member of the legislature who is no longer acting consistently with their preferences. Since there is no continuous assembly of the electorate, and we don’t schedule election days on a regular basis with no expectation of some election taking place, the recall petition procedure allows the electorate to schedule a recall election if one is needed. And, since presidential systems don’t work well when there is no executive, there is a simultaneous election of a replacement executive (in parliamentary terms, it is a constructive vote of no-confidence). This system allows the electorate to work around deadlock between the legislature and executive, while at the same time not hurting the formal separation of powers between the executive and legislature (which would be a problem if we gave similar powers to either branch).

Perhaps most importantly, though, the recall provision substantially mitigates the problem of “lame duck” politicians who are subject to term limits. While the empirical evidence of “shirking” is decidedly mixed, the threat of a recall election may motivate term-limited single-minded seekers of reelection to behave more consistently with the preferences of the people who elected them, which is surely an outcome favored by proponents of the “delegate” model of representative democracy (as opposed to the Burkean “trustee” model).

To be sure, there is some fiddling at the margins that may be worthwhile. Some have suggested that the signature requirement for both setting a recall election and qualification for the ballot is too low, although at least in the former case it seems like getting a million registered voters to actually sign a petition is a rather daunting task to begin with; few, if any, organized interests in the state can claim that many members. And it might be reasonable to require some sort of run-off if the plurality winner doesn’t have a clear margin above the second-placed challenger (majority runoff is one possibility, but a threshold of 45% has also been suggested in the political science literature, and Shugart and Carey suggest the use of what they describe as the “double-complement rule” in Presidents and Assemblies), or to use an alternate balloting system like approval or Condorcet voting. But generally speaking, the recall provision is sound and there is no good reason why it should not be adopted elsewhere—it’s one of the few “progressivist” reforms that actually is good for democracy.

Friday, 1 August 2003

Open primaries + Duverger's law = Fun

Steven Taylor explains in plain English why America’s party system has essentially stayed a true two-party system, even though other countries with similar electoral systems (notably Britain and Canada) have accreted semi-successful minor parties as well. The secret: open primaries.

The basic goal in the primary is to convince voters not party elites, that you ought to be the party’s nominee. If there is sufficient support for your candidacy, you will get on the ballot. What could be more democratic (as in rule by the people) than that?

Works for me…

Saturday, 26 July 2003

More on the Berkeley research

Virginia Postrel points out the real problem with the god-awful Psychological Bulletin piece:

As someone who believes social science can and does discover new truths about how people live and think, I find this sort of idiotic research particularly appalling. It teaches the general public that social science is bullshit. (It also demonstrates that university press offices can be really stupid about what they choose to publicize.)

That hits on the head why I find the research so egregious. It frankly makes me embarrassed to be a social scientist. It gives more ammunition to the people who want to dismiss good social scientific research, not to mention those who allegedly study politics who have neither respect for, nor understanding of, empiricism.* The only good news surrounding this study is that at least nobody thinks these professors were political scientists.

Meanwhile, Jonah Goldberg makes the point that dogmatism and simplicity are hardly the province of conservatives alone.

Friday, 25 July 2003

Who thinks Saddam was involved in 9/11?

One of the more bizarre questions revolving around the Iraq war is that there is a large proportion of the American public who believe that Saddam Hussein was involved personally in the 9/11 attacks on the World Trade Center and Pentagon and the foiled attack on the White House.* This belief persists despite there being no evidence of a direct link, no statements by any credible source that there is a direct link, and repeated refutations of a direct link. (Many leftists want to pin this belief on the Bush administration, but I don’t think the charge sticks without showing that Bush et al. deliberately fostered this belief; there’s simply no evidence of that.)

Being a good empirical social scientist, I was curious about who would believe this assertion. Again, I used the second March 2003 CBS/New York Times poll (conducted March 5-7, 2003). The poll doesn’t have much useful data for testing any psychological theories, but a sociological model seemed to work fairly well. I produced both maximum-likelihood (ML) and MCMC estimates; since the ML estimates were basically identical to the MCMC estimates (the missing data problem was less acute in this model), for ease of interpretation I stuck with them. Here are the probit results (I’m too lazy to build a proper table from the R output; sue me):

            Estimate Std. Error z value Pr(>|z|)
(Intercept) -0.01797    0.26186  -0.069 0.945277
pid         -0.09596    0.04594  -2.089 0.036699 *
college     -0.27348    0.14702  -1.860 0.062858 .
male        -0.62078    0.14587  -4.256 2.08e-05 ***
black        0.17079    0.17603   0.970 0.331934
catholic     0.05115    0.11446   0.447 0.654921
jewish      -1.18340    0.49424  -2.394 0.016649 *
atheist     -0.41736    0.14938  -2.794 0.005208 **
haskids     -0.04056    0.10507  -0.386 0.699462
agecat       0.01696    0.05475   0.310 0.756710
libcon       0.25993    0.07314   3.554 0.000379 ***
pid:college -0.10990    0.05790  -1.898 0.057699 .
pid:male     0.12066    0.05629   2.144 0.032059 *
---
Signif. codes:  0 `***' 0.001 `**' 0.01 `*' 0.05 `.' 0.1 ` ' 1
N: 782
Percent correctly classified: 64.83%
Proportional reduction in Error: 27.25%
McKelvey/Zavonia Pseudo-R^2: 0.214

Jewish and atheist voters are significantly less likely than Protestant voters (the omitted reference category) to believe Saddam was personally involved in 9/11, while there is no difference between Catholics and Protestants. Conservatives are significantly more likely to believe in the Saddam-9/11 link than liberals.

The other significant effects are expressed in interactions between multiple variables. I estimated interactions between gender (male) and party identification (pid) and between level of education (college) and party identification. These effects are shown in this graph. The horizontal axis is the respondent’s party identification, where 0 is “strong Republican”, 1 is “independent leaning Republican”, 2 is “true independent”, 3 is “independent leaning Democratic”, and 4 is “strong Democrat.” (Age is set to the mean value; other variables are set to the modal category.)

Males in general, particularly male Republicans, are much less likely than females to believe the Saddam-9/11 link, regardless of education level. However, among Democrats, the primary difference is between the college educated and the less-well educated, with the gender difference being relatively small.

What does this mean? There are a few possibilities. The most compelling one is that people who don’t know are guessing, drawing on some vague association between Saddam Hussein and radical Islam. The demographic variables may be indicators of attentiveness to the media; those who pay more attention to the media may have a more nuanced understanding of Middle Eastern politics. The partisan effects suggest that some voters may be projecting their own belief systems onto the question; strong Republicans may be projecting hawkish attitudes onto questions about Saddam, while strong Democrats may be projecting a belief that Saddam isn’t a threat onto him, at least among the better-educated.

More generally, the results suggest that trying to argue Saddam wasn’t linked to terrorism may be a losing strategy among their own base for Democratic presidential candidates that opposed the war or are having second thoughts now. Strongly Democratic voters without a college education are more likely than not to believe that Saddam was involved in 9/11, and it will be difficult to reeducate them on this point. These findings suggest that however candidates like Bob Graham and Howard Dean try to spin things, many Democratic voters think Saddam Hussein was a legitimate target in the war on terror, and they will cross these voters at their own peril.

Then again, maybe all these people think Saddam was involved in 9/11 because his regime actually was, at least to some degree.

Saddam and 9/11

Sorry, I meant to write up the results from the Saddam-9/11 analysis last night so I could post them here today. In the meantime, though, you can look at the pretty graphs. Not sure if they’ll make much sense without the writeup though…

Thursday, 24 July 2003

Public opinion is (almost) meaningless

As promised, I went off and played with the data on whether or not voters believed that Iraq's WMD threat justified war. Since it had the most questions on the issue, I used ICPSR Study #3755, better known as the second March 2003 CBS/New York Times telephone poll (1010 total respondents; conducted March 5-7). As I anticipated, no questions directly dealt with whether or not Iraq had been obtaining bits and pieces for nuclear weapons, or even mentioned the word "nuclear" at all; the popular phrase at the time was "Weapons of Mass Destruction," a term left undefined by any of the questions.

I'm extremely reluctant to present results for two main reasons. The first is that there was a huge amount of missing data; many respondents failed to answer a number of the questions, so there is less information available (I worked around this problem by using a Bayesian data augmentation model rather than a typical maximum-likelihood approach). The second reason is that I believe the question wording of most of the items on the survey make a recursive model somewhat inappropriate; many of the questions appear to tap the same underlying dimension, which is basically whether or not the respondent trusts the administration, and the causality is not at all clear. Nevertheless, there are a few interesting findings. So here goes:

Independent Variable Coefficient 95% Credible Interval
UN Handling of Crisis -0.358 -1.063 0.353
US has presented sufficient evidence of WMD 1.335 0.442 2.257
R trusts Bush to handle Iraq issue 1.389 0.558 2.351
R believes Iraq represents a WMD threat to US (3pt) 1.065 0.414 1.771
R believes admin telling all it knows 1.016 -0.097 2.198
R believes Saddam Hussein personally involved in 9/11 0.480 -0.306 1.308
R believes inspectors not making progress (4 pt) 0.511 -0.002 1.033
R party identification (0=Strong Rep; 2=Indep; 4=Strong Dem) 0.026 -0.198 0.262
Male respondent 0.029 -0.361 0.705
Education level of respondent (1-5) -0.066 -0.369 0.226
Age of respondent -0.018 -0.038 0.001
(Intercept - used for model identification) -2.971 -5.322 -0.767

(Coefficients are probit coefficients, as the dependent variable is dichotomous. All variables are yes/no "dummy" variables unless otherwise described.)

A few words for those who aren't accustomed to regression results. The left-hand column is the variable that is believed to have an independent effect on the dependent variable (in this case, support for the U.S. going to war in Iraq). The next column shows the magnitude of the mean effect of that variable. The final columns show the "credible interval" (similar to the "confidence interval" in frequentist interpretations), which basically says that there is a 95% chance that the true coefficient lies within that range of values. If the credible interval doesn't include zero (i.e. both values are positive or both are negative), we can say that at least 19 out of 20 times, the effect in the population at large would be in the direction of the sign (i.e. positive or negative).

What does this model tell us? Generally speaking, people who believed the U.S. had presented sufficient evidence of Iraq's WMD programs, trusted Bush to handle the Iraq issue, and believed Iraq's weapons to the a threat to the U.S. were more likely to support a conflict than those who didn't. (This finding was also robust across all of the various scenarios for war proposed in the survey; the dependent variable here posited no particular configuration of events.) A couple of other effects approach significance: belief that the administration was fully forthcoming, that the UN inspections were ineffective, and the respondent's age (older voters being less likely to support a war).

More interesting is what it doesn't tell us. The effects of education and gender are insignificant; men were no more likely to support the war than women, and more educated people are no less likely than less educated people. Perhaps most interesting, and possibly problematic for anti-war Democrats, especially if the "Bush lied" theme fails to stick, is that there was no independent effect of partisanship; this suggests that "Bush Democrats" (we might call them "WOT Democrats" if we wanted to be cute like Larry Sabato) were just as enthusiastic for war as "Bush Republicans." And, the people who believe Saddam was personally involved in the 9/11 attacks were no more likely to support war than those who didn't.

In my next post, I will present a more interesting model from the same dataset, looking at the question on Saddam and 9/11.

Wednesday, 23 July 2003

Partial defense withdrawn

In this post, I defended the research of four psychologists on the psychological determinants of conservatism. After reading the actual article in question, a response, and their response to the response, I am convinced I was in error in defending their work as not being politically motivated. The authors’ response to the critical response is particularly awful. Anyone who can make the following statement with a straight face is clearly partisan:

Sticking with contemporary American politics, it has been observed that Republicans are far more single-mindedly and unambiguously aggressive in pursuing Democratic scandals (e.g., Whitewater, the Clinton–Lewinsky affair) than Democrats have been in pursuing Republican scandals (e.g., Iran Contra, Bush–Harken Energy, Halliburton). (authors’ response, 391)

Iran-Contra resulted in prison terms for many its participants; with the exception of some peripheral figures (most notably, the self-martyring Susan McDougal and the otherwise-corrupt Jim Guy Tucker), Whitewater and Monicagate combined produced none. The authors also somehow forget about the Watergate scandal, doggedly (and rightly) pursued by Democrats, which brought down Richard Nixon and contributed to the defeat of Gerald Ford in 1976. Furthermore, citing Paul Krugman’s NYT op-eds twice as an authority on whether conservatives are more dogmatic than liberals doesn’t pass the laugh test.

More generally, I return to my previous criticisms based on the press release. They repeatedly use single indicators to represent latent constructs. They aggregate across nations without regard for contextual factors. They present bivariate correlations as evidence of causation (just having a bazillion similar correlations does not demonstrate causation). They dismiss exceptional cases out-of-hand, rather than attempting to explain them in terms of their research design (although they do make a half-hearted effort to do so in their response to the critics). They make no effort to integrate any of the previous hypotheses into a well-specified model.

And, to top it all off, most of the research is based on student populations, who are almost certainly atypical of the public at large in terms of their level of political socialization (an important explanation of conservatism in their half-baked theory). Anyone who thinks conservative extremists are less integratively complex than liberal extremists hasn’t had the dubious pleasure of reading both FreeRepublic.com and DemocraticUnderground.org (two popular cesspits for extremists on the right and left respectively, in case you haven’t had the pleasure). Coupled with a lack of any serious understanding of any of the research done on ideology outside psychology (Converse barely rates a footnote, while nothing newer than McCloskey and Zaller, a 1984 piece, is cited from the political science literature), this turkey doesn’t fly.

One hopes, not knowing the journal hierarchy in psychology, that the Psychological Bulletin is the intellectual equivalent of toilet paper among the APA’s journals, but somehow I doubt that. The editor and reviewers who allowed this garbage to be published ought to be embarrassed.

John Jay Ray, a well-published political psychologist in his own right, has been savaging the piece at Dissecting Leftism.

Libertarians and the do-not-call list

Henry Farrell at Crooked Timber has a lengthy response to Tyler Cowan’s (Volokh Conspiracy) libertarian counter-argument against the federal do-not-call list; Will Baude (Crescat Sententia) and Radley Balko (The Agitator) have other, thoughtful libertarian arguments against the do-not-call list.

I don’t have any particular thoughts to add on either side. I do wonder why Mississippi went ahead and created a separate, state-specific do-not-call list this year that covers less types of marketing and fewer numbers (only residential landline telephones) while the FTC action was pending; undoutably the program is solely an election-year boondoggle that a few incumbents can point to to justify their continued occupation of space in the legislature.

However, as a self-interested social scientist, these events may significantly improve the response rates for telephone surveys (which have dropped substantially since the telemarketing industry took off), so at least the part of me that likes getting publications has no problems with the do-not-call list whatsoever.

I must be missing something here

InstaPundit approvingly links to a post by the Angry Clam, who is “pissed off” about a study conducted by psychology professors at Berkeley, Stanford and Maryland that purports to describe the psychological determinants of conservatism.

I’ll admit that the press release linked to by the Clam makes the research seem rather simplistic, and some of the editorializing by assistant (i.e. untenured) professor Jack Glaser seems inappropriate. And, frankly, I think the researchers are really describing what Virginia Postrel calls “staisism” rather than conservatism. Say what you will about the Contract with America and the post-1994 Republican majority, but planning to roll back decades of creeping socialism is hardly a conservative position (in their terms); the neo-liberal policies of Britain’s successive governments since 1979 are not exactly “conservative” either, even though many of them were pioneered by the political right. And, as a political scientist, I’m not entirely sold on the idea that J. Random Psychologist is qualified to do research on political concepts, just as I’d have serious concerns if a political scientist tried to perform psychotherapy. To top it all off, I generally despise meta-analysis as a research technique, but that’s neither here nor there.

At the same time, though, the research itself, rather than the stupid commentary it was dressed up with in the press release, doesn’t seem (from its description) excessively political. I’d rather read the article (which appeared in the May 2003 Psychological Bulletin, according to the table of contents) and draw my own conclusions, thanks.

Monday, 21 July 2003

Not-so-sweet sixteen

Daniel Drezner has a challenge to those have criticized his take on the whole “sixteen words” theme that the left has been trying to make fly for the last week:

The power of the critique against Bush would be strengthened if it could be shown that a significant fraction of the American public—as well as the legislative branch—supported action against Iraq only because of the claim that Hussein’s regime had an active nuclear weapons program.

Ok, since I’m likely to be terribly bored at some point in the next day or two, and considering I’m sitting not-very-far from the computers the data is housed on, I’ll look at the February 2003 CBS/New York Times Poll, along with several others from the period after the State of the Union, and see what I can find. I can’t give any evidence on the behavior of legislators, but I can at least examine whether the public’s opinion was conditional on WMD, and nukes in particular—assuming the right questions were asked.

Warning for the faint of heart: I may present regression results in addition to the marginals.

Tuesday, 15 July 2003

Academic freedom in the Palestinian territories

Daniel Drezner has a post on the perils of being a political scientist in Arafatland. If my work annoys someone, at worst I might get blackballed at a journal; in the West Bank, you might get attacked by Fatah’s goons.

Not that this incident will make many of my more liberally-inclined colleagues in The Discipline™ to revise their views of the Israeli-Palestinian conflict, of course…

Wednesday, 9 July 2003

More pretty dissertation graphs

Since the last “mystery graph” was such a success (not), and because I have nothing else to write, here’s another from the “Dutch chapter.” Enjoy!

Actually, I do have another Dean post poking around in the back of my head, but I’ll save that for when I get home.

Wrapping the Dutch chapter

Apologies for the relative silence here at Signifying Nothing; I’m trying to finish the revisions on what I call the “Dutch chapter” (because it uses data from the 1998 elections in the Netherlands; there’s nothing particularly “Dutch” about it beyond that) of my dissertation. I have a few quick calculations to do, and about a page or two to write summarizing the results of two more regression models, and then it can be shipped off to my committee for further review (I may add more pretty graphs later).

Next up on the cavalcade: revisions on the “Nader chapter.” Then we get to go back to revise the “Hillary chapter,” the “sophistication chapter,” and the “heuristics chapter.” And, once that’s all done, I have to write the intro and conclusion. And then it will be done. Sounds so simple, doesn’t it?

Wednesday, 2 July 2003

You might be a polisci geek if...

Matthew has the list. My fave:

[Y]ou joke about chasing away “Bruce Bueno de Mosquitos” when spraying on insect repellent.

The whole list is pretty good. However, I make my sacrifices to a statue of Neal Beck. To each his own…

Monday, 30 June 2003

Sabato, clueless, you know the drill

Steven Jens is the latest to discover the general cluelessness of the man who is “probably the most quoted college professor in the land,” according to his press clippings. (And what’s with “probably”? The Wall Street Journal has Lexis-Nexis; use it!)

Now, he might be right that some states are already locks. Assuming the Republicans don’t nominate Howard Dean, they’ll win Mississippi, and assuming the Democrats don’t nominate Pat Buchanan, they’ll win the District of Columbia. Since neither of those nominations are happening, those are probably safe bets. But, for example, I don’t buy that states like Virginia and Ohio are Bush locks—and adjacent Michigan is a Democrat lock—in a “highly competitive contest.”

More fundamentally, I think the “red state–blue state” dichotomy is highly flawed, although it may be convenient shorthand. Voters are highly heterogeneous in all but the least populous states. To the extent it is meaningful, it only reflects the artifacts of the disproportionality of the “winner-takes-all” nature of the electoral college (in 48 of the 50 states) and the current unwillingness of the national Democratic party to compete for the median voter in the South.

Toward a theory of perceived media bias

Why can both liberals think the media is biased toward conservatives and conservatives think the media is biased against them? (Not to mention, why do libertarians like me think the media is biased toward government action?)

Here’s a rough draft of a theory. John Zaller’s The Nature and Origins of Mass Opinion makes a case for what he calls the “receive-accept-sample” (RAS) model of opinionation. In simple terms, people receive information (which may or may not be biased; it can be purely factual, or it can be partisan or distorted in some way) from a variety of sources, such as the mass media, friends, family, colleagues, etc. This information is then either accepted or rejected through a process of perceptual screening. Finally, when people are called upon to give their opinion on a particular issue, they sample from the information they have available pertaining to that issue (in Zaller’s terms, the relevant considerations).

Now, if we focus on the accept part of the RAS model, we find something interesting. People who are more politically sophisticated generally only accept the information that is consistent with their preexisting beliefs, while less sophisticated people have less developed screening mechanisms (since they care less about consistency or balance). People who complain about bias are, largely, the politically sophisticated (those who look down on Rush Limbaugh or Bill O’Reilly listeners may find this hard to accept, but compared to the average American I suspect those listeners are more politically sophisticated; they may have political beliefs that seem reactionary, but they generally know a lot more about politics and how it works than the average citizen). This probably isn’t a coincidence.

My theory is that citizens are more conscious of rejection than they are of acceptance. People who encounter information consistent with their beliefs will simply accept it and move on, while people who encounter information that is inconsistent will be more aware of that inconsistency. Thus, people who encounter more inconsistency when they encounter information from a particular source will find it to be more biased than those who encounter less inconsistency. And, they will perceive that bias as being in the direction opposite to their preexisting belief system—because, relative to them, the bias is in that direction.

Does that mean (if this theory is correct—I suspect it is, but then again, that’s because it’s my theory) that bias doesn’t exist? No. But it does mean that liberals like Eric Alterman and conservatives like Ann Coulter will only perceive bias in opposition to their own belief system.

Conceivably, one could pick a “belief system axis” and measure the bias of various information sources relative to the origin of that axis. To test this, you’d need to have a number of raters from various positions within that belief system axis (which you could locate using standard measures of ideological belief) and then have them give some measure of the bias of the information sources. Then you could produce an “objective” map of the bias of the sources using multidimensional scaling (which, hopefully, would be fairly easy to interpret).

Thursday, 26 June 2003

Item-response theory and public opinion

One of the things I’m wrestling with in my dissertation is how best to measure political sophistication or political expertise: roughly speaking, the degree to which a citizen is capable of making informed voting decisions. To do that, I’ve been using (in some places) an item-response theory model, borrowed from the psychometric and educational testing literature. These models assume that there’s a latent trait (or “ability“) that we can’t directly observe, but we can get at that ability by looking at how people answer a bunch of questions. Political expertise is a fairly straightforward application of this approach, but others have applied it to other political problems, most notably the “ideal-point estimation” problem (the most famous example of this is Keith Poole and Howard Rosenthal’s work on Congress using NOMINATE, but Simon Jackman and others have been doing important work in this area too), and the much of the field of structural equation models (or LISREL models) works on generalized versions of this problem.

What does this have to do with public opinion, per se? Well, I was thinking about the abortion issue, where each side wants to coopt as many “reasonable” people into its coalition as possible. The pro-life crowd uses slogans like “choose life” (surely nobody would “choose death,” as a recent correspondent suggested) while the pro-choice crowd tries to promote itself as “supporting family planning” (again, who would oppose that?).

Now, let’s transform this into a public opinion example. If we ask people whether or not they agree with just one of these statements, we’ll get very uninformative results; a few “die-hard” pro-choicers will recognize “choose life” as a pro-life codephrase and disagree, while a few “hardcore” pro-lifers would see “family planning” as a euphemism for abortion rights and oppose that. But most people (including myself) would agree with either statement, which would make them appear to be simultaneously “pro-choice” and “pro-life.” Is the public really this schizophrenic? Probably not; the question wording creates bias (systematic error).

Now, assume we solicit agreement or disagreement with both statements. That gives us two data points, which reflect—to some degree—the underlying attitude of the voter on abortion rights (our “latent trait” of interest). Every additional question (so long as it’s reflecting the same attitude!) gives us more leverage on the latent trait; we might, for example, ask voters whether or not they agree with abortion under particular sets of circumstances (e.g. if the mother’s life is in danger; if the child will have a birth defect; if the conception was due to rape; if the conception was incestuous; if the conception was due to the failure of other birth control; if the parent is a minor; etc.). But even using those two, very biased, questions together will give us a much better picture of the latent attitude toward abortion than just taking one of them alone. And even if the questions aren’t that biased, multiple questions beat a single question any day.

So, the moral of the story is: don’t rely on the marginals from a single survey question unless you just can’t possibly avoid it. And by “can’t possibly avoid it,” I mean “you’re stuck using data collected by people who didn’t (or couldn’t, if it was done before the 1970s) read Converse.”

If this part of public opinion is of interest to you, I strongly recommend reading The Nature and Origins of Mass Opinion, which is probably the definitive modern work in the field.