Back to Books & Culture Donate to Books & Culture
Subscribe to Books & Culture
Subscribe to Books & Culture

 

Main  |  Archives  |  Contact Us
Site Search

HOLIDAYS & EVENTS
Related Channels
Christianity Today
  magazine

Christian History &
  Biography

Small Groups





Home > Books & Culture > January/February

Sign up for our free newsletter:


Evangelicals Behaving Badly with Statistics
Mistakes were made.
Christian Smith | posted 1/01/2007



American evangelicals, who profess to be committed to Truth, are among the worst abusers of simple descriptive statistics, which claim to represent the truth about reality, of any group I have ever seen. At stake in this misuse are evangelicals' own integrity, credibility with outsiders, and effectiveness in the world. It is an issue worth making a fuss over. And so I write.

By simple descriptive statistics I mean elementary ways of quantifying differences in the world, such as percentages and averages describing distributions and trends in populations. Now, I am not among those who believe that the ability to quantify is the true test of authoritative knowledge. I am not even a quantoid-geek type of sociologist. But I do think that statistics can often usefully represent what is going on in reality. They can help to get at what seems to be true about what is actual. So statistics are well worth doing well and getting right.

Of course statistics are generally well known for their misuse. Anyone can easily twist, misrepresent, and lie with statistics. And it takes a bit of basic knowledge for even well meaning people to avoid common statistical pitfalls. But none of that exempts evangelicals from having to use statistics responsibly. The problem is, they often do not.

Why do evangelicals recurrently abuse statistics? My observation is that they are usually trying desperately to attract attention and raise people's concern in order to mobilize resources and action for some cause. In a world awash in information and burdened by myriad problems, some evangelicals may justify the problematic misuse of statistics to get people to pay attention to what they think are good causes. But this is inexcusable. Such desperation, alarmism, and sloppiness reflect the worst, not the best, in evangelicalism.

Let me here give one specific illustration of the larger problem I am talking about, although examples could be multiplied many times. In a recent issue of American evangelicalism's flagship magazine, I found a glossy, four-page, centerfold advertisement for a national leadership summit, announcing this:

Wake Up Call
"Christianity in America Won't Survive Another Decade."
Unless We Do Something Now

Anyone who gives this claim a moment's thought should realize immediately that it is preposterous. Unless we act now, U.S. Christianity will be dead in ten years? Please. I hope somebody will let God know. Still, the quotation suggests that some authority has determined this, so let us explore further. Inside the ad we are greeted by "A Call to Arms," and are informed that, "This generation of teens is the largest in history—and current trends show that only 4 percent will be evangelical believers by the time they become adults. Compare this with 34 percent of adults today who are evangelicals. We are on the verge of a catastrophe." This is really incredible. But still, specific statistics are staring up from the page: 4 percent compared to 34 percent. Plus, the ad shows a lineup of evangelical heavyweights endorsing this summit, including Chuck Colson, Ted Haggard (before his fall), Jerry Falwell, Pat Robertson, Jack Hayford, and many more. Not only was the president of the National Association of Evangelicals (Haggard) backing this, but a recent official nae resolution on youth ministry is also reprinted in the ad, suggesting a general nae endorsement of this program.

It turns out not to be possible from the ad to determine who is quoted saying that "Christianity in America Won't Survive," but the statistic that only 4 percent of today's teens will grow up to be evangelicals does have a reference. The fine print shows that it comes from a 1997 youth ministry book about "the bridger generation" written by a professor at a significant evangelical seminary. Having read nearly every book on youth ministry published in the last 15 years, I realize that I own the very book. I take it off my shelf and find the source of the 4 percent statistic. It turns out, as reported on pages 165-66, that this professor had done an "informal survey" of 211 young people in three states over seven months in the mid-1990s. No information about the methodology in sampling these youth is given—most likely it was a convenience sample. Based on this evidence, the author writes, "The vast majority of bridgers today have not accepted Christ. In a recent and informal survey of 211 bridgers, only 4 percent responded that they were born-again Christians who had trusted in Christ alone for salvation." Older Americans are then said, based on another similar "informal survey," to have accepted Christ at higher rates. The conclusion: "According to present trends, we are about to lose eternally the second largest generation in America's history."


Books & Culture
Home  |  Archives  |  Contact Us

Try an Issue of Books & Culture
Free!
Subscribe to Books & Culture
Name
Street Address
City/State/Zip
E-mail Address

No credit card required. Please allow 4-6 weeks for delivery. Offer valid in U.S. only. Click here for International orders.

If you decide you want to keep Books & Culture coming, honor your invoice for just $19.95 and receive five more issues, a full year in all. If not, simply write "cancel" across the invoice and return it. The trial issue is yours to keep, regardless.

Give Books & Culture as a gift

Buy 1 gift subscription, get 1 FREE!

Free Newsletter
Sign up today for the ChristianityToday.com Books & Culture Newsletter
   RSS Feed   RSS Help






XMLRSS Feed












Free Newsletter
Sign up today for the Books & Culture newsletter:





ChristianityToday.com
Home CT Mag Church/Ministry Bible/Life Communities Entertainment Schools/Jobs Shopping Free! Help
Books & Culture
Christianity Today
ChristianityTodayLibrary.com
Christian History Back Issues
Church Law & Tax Report
Leadership Journal
Men of Integrity
Your Church
Church Finance Today
BuildingChurchLeaders.com
ChristianBibleStudies.com
Christian College Guide
Christian History
Christian Music Today
Christianity Today Movies
ChurchLawToday.com
Church Products & Services
ChurchSafety.com
ChurchSiteCreator.com
Kyria.com
PreachingToday.com
PreachingTodaySermons.com
ReducingtheRisk.com
Seminary/Grad School Guide
Christianity Today International
www.ChristianityToday.com
Copyright © 2009 Christianity Today International
Privacy Policy | Contact Us | Advertise with Us | Job Openings