index

index

As the U.S. military embarks on its review of Don’t Ask, Don’t Tell, to be delivered in a final report later this year, the question arises: How many service members are affected by the policy? To help answer that question, the Pentagon this past summer surveyed its troops, asking them if they served or had ever served with someone they believe to be gay. Leaving aside an obvious problem with the survey—that it is based on pure speculation—it also raises a common statistical challenge: asymmetry in population sizes. Because the vast majority of service members are heterosexual, many more straights will be misclassified as gays than vice versa.

This is a general problem in survey research. For example, Harvard University researcher David Hem­en­way has shown how some well-publicized studies have overestimated the number of guns used in the U.S. for self-defense by 10 times. Even if only 1 percent of respondents answer the survey incorrectly, the error is large compared with the proportion of the general population in any given year that uses guns in self-defense, which reasonable studies show to be about 0.1 percent.* In other words, the misclassification rate far exceeds the actual population size. To get around this problem, we would be wiser to trust surveys of crime victims, which restrict the gun use question to a smaller pool of subjects.

Advertisements