Monday, November 26, 2007

AP Style - other recent updates

Some other recent updates to the AP Stylebook:

New Entries:
The preferred term as a noun is female students, but coed is acceptable as an adjective to describe coeducational institutions. No hyphen.

Magnetic resonance imaging, a noninvasive diagnostic procedure used to render images of the inside of an object. It is primarily used in medical imaging to demonstrate pathological or other physiological alterations of living tissues. MRI is acceptable on first reference and in all uses.

polls and surveys

(This one tightens the previous entry and allows for margins of error to be expressed to one decimal place instead of AP's ill-advised whole-number rounding rules in recent years. Unfortunately, it still expresses margins of error in percentage points rather than percent, but, hey, you can't win them all.)

Stories based on public opinion polls must include basic information for an intelligent evaluation of the results. Carefully word such stories to avoid exaggerating the meaning of poll results.
Every story based on a poll should include answers to these questions:
1. Who did the poll and who paid for it? Start with the polling firm, media outlet or other organization that conducted the poll. Be wary of polls paid for by candidates or interest groups; their release of poll results may be done selectively and is often a campaign tactic or publicity ploy. Any reporting of such polls must highlight the poll\'s sponsor, so readers can be aware of potential bias from such sponsorship.
2. How many people were interviewed? How were they selected? Only a poll based on a scientific, random sample of a population -- in which every member of the population has a known probability of inclusion -- can be considered a valid and reliable measure of that population\'s opinions. Among surveys that do not meet this criterion:
• Samples drawn from panels of people who volunteer for online polls. These cannot be considered representative of larger populations because panel members are self-selected -- often including "professional respondents" who sign up for numerous surveys to earn money or win prizes -- and exclude people without Internet access. (Online panels recruited randomly from the entire population, with Internet access provided to those who don't already have it, are valid.)
• Balloting via Web sites, cell phone text messaging or calls to 900 numbers. These too are self-selected samples, and results are subject to manipulation via Web log and e-mail campaigns and other methods. If such unscientific pseudo-polls are reported for entertainment value, they must never be portrayed as accurately reflecting public opinion and their failings must be highlighted.
3. Who was interviewed? A valid poll reflects only the opinions of the population that was sampled. A poll conducted only in urban areas of a country cannot be considered nationally representative; people in rural areas often have different opinions from those in cities. Many political polls are based on interviews with registered voters, since registration is usually required for voting. Polls may be based on "likely voters" closer to an election; if so, ask the pollster how that group was identified and what percentage of the voting population it totaled. Are there far more "likely voters" in the poll than turnout in comparable past elections would suggest?
4. How was the poll conducted -- by telephone or some other way? Avoid polls in which computers conduct telephone interviews using a recorded voice. Among the problems of these surveys are that they do not randomly select respondents within a household, and they cannot exclude children from adult samples
5. When was the poll taken? Opinion can change quickly, especially in response to events.
6. What are the sampling error margins for the poll and for subgroups mentioned in the story? The polling organization should provide sampling error margins, which are expressed as "plus or minus X percentage points," not "percent." (Note from Doug: This still remains a disputed point. Other experts say use "percent.") The margin varies inversely with sample size: the fewer people interviewed, the larger the sampling error. If the opinions of a subgroup -- women, for example -- are important to the story, the sampling error for that subgroup should be noted. (Some pollsters release survey results to the first decimal place, which implies a greater degree of precision than is possible from a sampling. Round poll results to whole numbers. However, the sampling error margin -- a statistical calculation -- may be reported to the first decimal place.)
Also consider the wording and order of the questions asked in the poll. Small differences in question wording can cause big differences in results, and the results for one question may be affected by preceding questions. The exact question wording need not be in every poll story unless it is crucial or controversial.

When writing and editing poll stories, here are areas for close attention:
--Do not exaggerate poll results. In particular, with pre-election polls, these are the rules for deciding when to write that the poll finds one candidate is leading another:
• If the difference between the candidates is more than twice the sampling error margin, then the poll says one candidate is leading.
• If the difference is less than the sampling error margin, the poll says that the race is close, that the candidates are "about even." (Do not use the term "statistical dead heat," which is inaccurate if there is any difference between the candidates; if the poll finds the candidates are tied, say they're tied.)
• If the difference is at least equal to the sampling error but no more than twice the sampling error, then one candidate can be said to be "apparently leading" or "slightly ahead" in the race.

--Comparisons with other polls are often newsworthy. Earlier poll results can show changes in public opinion. Be careful comparing polls from different polling organizations. Different poll techniques can cause differing results.
--Sampling error is not the only source of error in a poll, but it is one that can be quantified. Question wording and order, interviewer skill and refusal to participate by respondents randomly selected for a sample are among potential sources of error in surveys.
--No matter how good the poll, no matter how wide the margin, the poll does not say one candidate will win an election. Polls can be wrong and the voters can change their minds before they cast their ballots.

Labels: , , ,


At 10/23/08, 10:47 AM, Anonymous Alesk said...

What is your take on the recent AP poll that said that the difference between Obama and McCain at this late stage is only 1%?
After reviewing the documentation for the AP-GfK poll,

it turns out that about 44% of those participating in this AP poll identified themselves as Born Again or Evangelicals - a segment of the population that has consistently voted along conservative lines - and 44% is approximately twice the amount of the general voting population that those segments actually represent. However, many puplications picked up the poll and briefly reported it as a closening of the race, without further noting the nature of the actual poling sample used. I think that was misleading, at best, and clearly does not reflect approiate journalistic practices, nor do the poll results provide a valid basis for Republican optimism.

At 10/23/08, 12:53 PM, Blogger Doug Fisher said...

I had not seen that, so I will have to look at it.

Just glancing at it, however, that would give me some cause for concern.

At 11/24/11, 9:32 PM, Blogger Tony Lee said...

Hi Doug,

I was searching around to see if there's a rule of thumb on reporting accuracy in percentages, and came across this post. I absolutely agree with reporting whole numbers for polling data (with a single decimal point for margin of error).

However, what about voter turnout figures, which are measured accurately to the vote?

Here in Japan, the vernacular press report turnout to two decimal places. (My job is to copy edit the English versions of the Japanese stories, which retain the two decimal places.) Now, I can see one decimal place being used, but two just seems like overkill.

Do you have any advice on this?

At 11/24/11, 9:46 PM, Blogger Doug Fisher said...

I agree that two decimal places is overkill.

There's precision, but it's not precision if it doesn't really mean anything to readers. I suspect most aren't parsing hundredths of a percent.


At 11/24/11, 9:49 PM, Blogger Tony Lee said...

Hi Doug,

Thanks for your prompt response. Good to see we agree.

(Awesome website, by the way.)

And have a happy Thanksgiving!


Post a Comment

Links to this post:

Create a Link

<< Home