<img height="1" width="1" alt="" style="display:none" src="https://www.facebook.com/tr?id=1482979731924517&amp;ev=PixelInitialized">

The Litigation Consulting Report

Phone Surveys Aren't What They Used To Be

Posted by Laurie Kuslansky on Fri, Oct 31, 2014 @ 12:59 PM

 

phone-survey-mock-juror-jury-juriesby Laurie R. Kuslansky, Ph.D.
Managing Director, Jury Consulting
A2L Consulting

Research has shown that a variety of individuals are not fully represented in telephone surveys, especially Democrats,[1] the young, nonwhite, and urban voters who can be the hardest for pollsters to reach.[2]

In addition, the migration from landline phones associated with home addresses to portable cell phones unrelated to home addresses compounds the problem of reaching and surveying a representative sample using traditional approaches to phone surveys.

And, not all venues were created equally. Some have more hard-to-reach residents, while some have more cell phones replacing landlines. 

In general, “It has become increasingly difficult to contact potential respondents and to persuade them to participate,”[3] dropping from 36% in 1997 to 9% now willing to participate in phone surveys.

Consequences?

There are many.  To name a few:

Lower representativeness of people willing to respond to phone surveys requires taking additional measures to assure a representative sample, but the options aren’t ideal:

  • Even if you weight the sample, you may simply be giving undue weight to those you reach who may not actually match the ones you missed;
  • It may cost more money to buy additional samples to get a sufficient number of people who represent a particular category.

o    For example, if you are seeking to survey jury-eligible adults and voter registration is one of the requirements, you may have to spend extra money and buy a list of registered voters if not enough people in the normal random digit dialing (RDD) sample turn up eligible to be a juror, assuming they answer the phone and are willing to answer questions in the first place... and 91% on average are not.

  • You may have to spend more money and/or time to reach a reasonable representative sample because of the low incidence rate (i.e., people willing and able to complete the survey). This approach has improved the field rate of responses from the 9% average to 22%,[4] but added time means added cost.

Are people who answer telephone surveys different than people who don’t?

Yes. Among other things, people who engage significantly more in volunteerism and civic activity are more likely to agree to participate in telephone surveys than people who do not.”[5] Intuitively, this makes sense.

What does this mean for telephone surveys of mock jurors?

  • Anecdotally, the kinds of people unwilling to agree to participate in phone surveys are more similar to people unwilling to be on a jury than those who end up as jurors.  Hence, those who respond to surveys are perhaps a better representation of likely jurors than those who do not.
  • Financial information tends to be hard to gather in phone surveys in general.  If that information is pertinent to a jury study, it can perhaps be gleaned indirectly from other factors (education, employment, home ownership, marital status, etc.). Instead of the specific dollar amounts, one might be able to code someone who has more vs. fewer markers of likely affluence vs. poverty;
  • Many work to design the sample of a study by first referring to the latest (2010) Census data and the ACS (American Community Survey) estimates, but they are somewhat off, especially in terms of under-estimating the rise of Hispanics.  The problem is that such information is often the only or best available data. Other options that may be more current are real-estate websites that describe communities as well as anecdotal information from local counsel about a particular jury pool. Putting together the specifications for the polling sample is part of the art and science of polling.

Are There Any Solutions? 

Yes. “A new study by the Pew Research Center for the People & the Press finds that, despite declining response rates, telephone surveys that include landlines and cell phones and are weighted to match the demographic composition of the population continue to provide accurate data on most political, social and economic measures.”[6] 

In addition to the technical issues that depress response rates, one should also consider how easy or hard you make it for someone to reply to the questions. Shorter and easier are better than longer and more difficult.  Questions that require greater effort or too many questions are more likely to end up being asked, but not answered.

Ironically, the data that are missing is that which describe people who don't take surveys or end up making much difference on juries.

Other articles related to mock trials, jury consulting and phone surveys on A2L Consulting's site:

litigation consulting graphics jury trial technology

 

[1] Midterm Calculus - Why Polls Tend to Undercount Democrats by Nate Cohn, The Upshot, N.Y. Times 10/30/14 at http://www.nytimes.com/2014/10/30/upshot/why-polls-tend-to-undercount-democrats.html?_r=0&abt=0002&abg=1

[2] Assessing the Representativeness of Public Opinion Surveys, by Pew Research Center for the People and The Press, 5/15/12 at http://www.people-press.org/2012/05/15/assessing-the-representativeness-of-public-opinion-surveys/

[3] Op. Cit. at Pew

[4] Op. Cit. at Pew

[5] See Katherine G. Abraham, Sara Helms and Stanley Presser. 2009. “How Social Processes Distort Measurement: The Impact of Survey Nonresponse on Estimates of Volunteer Work in the United States.” Am. J. of Soc. 114: 1129-1165. Roger Tourangeau, Robert M. Groves and Cleo D. Redline. 2010. “Sensitive Topics and Reluctant Respondents: Demonstrating a Link between Nonresponse Bias and Measurement Error.” Public Opinion Quarterly 74: 413-432. 

[6] Post-election assessments of poll accuracy by the National Council of Public Polls at http://ncpp.org/files/NCPP%20Election%20Poll%20Analysis%202012%20-%20FINAL%20012413.pdf

 

Tags: Jury Questionnaire, Jury Consulting, Mock Trial, Litigation Consulting, Juries, Jury Consultants, Jury Selection, Phone Survey

Confidential A2L Consulting Conflicts Check Form

Join 9,000 Subscribers and Get Notified of New Articles Every Week

Watch Now: Persuading with Storytelling



Free Litigation Webinars - Watch Now

ryan flax a2l litigation consultants webinar recorded


patent litigation webinar free litigation graphics demonstrative

Featured E-Book: The Patent Litigator's Guide to Trial Presentation & Trial Preparation

patent litigation ebook 3rd edition

Featured Free Download: The Complex Civil Litigation Trial Guide

a2l consultants complex civil litigation trial guide download

Free Webinar - Integrating Expert Evidence & Winning Arguments - Watch Anytime.

expert witness teach science complex subject courtroom webinar

Nationally Acclaimed - Voted #1 Jury Research Firm and #1 Demonstrative Evidence Firm in the U.S.

voted best demonstrative evidence consultants

A2L best demonstrative trial graphics consultants
best demonstrative evidence litigation graphics consultants

Download the (Free) Storytelling for Litigators E-Book

describe the image

Considering Using a Trial Technician at Your Next Trial? Download this first.

trial technicians trial technology atlanta houston new york boston virginia

Featured Free Download: Using Science to Prevail in Your Next Case or Controversy

using science to win at trial litigation jury

Featured FREE A2L E-Book: Using Litigation Graphics Persuasively

using litigation graphics trial graphics trial presentation consultants

Free Jury Consulting & Trial Consulting Guidebook for Litigators

jury consulting trial consultants guide

Timelines Appear In Most Trials - Learn how to get the most out of using trial timelines in this ebook

trial timelines graphics consultants litigators

Featured Complimentary eBook - The 100-page Antitrust Litigation Guide

antitrust ebook a2l litigation consultants

Featured Complimentary eBook - Leadership Lessons for Litigators and Litigation Support

leadership lessons litigation law firms litigation support

Featured E-Book: The Environmental Litigator's Guide to Trial Presentation & Prep

environmental litigation trial presentation trial prep ebook a2l

Authors

KenLopez resized 152

Ken Lopez founded A2L Consulting in 1995. The firm has since worked with litigators from all major law firms on more than 10,000 cases with over $2 trillion cumulatively at stake.  The A2L team is comprised of psychologists, jury consultants, trial consultants, litigation consultants, attorneys and information designers who provide jury consulting, litigation graphics and trial technology.  Ken Lopez can be reached at lopez@A2LC.com.


tony-klapper-headshot-500x500.jpg 

Tony Klapper joined A2L Consulting after accumulating 20 years of litigation experience while a partner at both Reed Smith and Kirkland & Ellis. Today, he is the Managing Director of Litigation Consulting and General Counsel for A2L Consulting. Tony has significant litigation experience in products liability, toxic tort, employment, financial services, government contract, insurance, and other commercial disputes.  In those matters, he has almost always been the point person for demonstrative evidence and narrative development on his trial teams. Tony can be reached at klapper@a2lc.com.


dr laurie kuslansky jury consultant a2l consulting







Laurie R. Kuslansky, Ph.D., Managing Director, Trial & Jury Consulting, has conducted over 400 mock trials in more than 1,000 litigation engagements over the past 20 years. Dr. Kuslansky's goal is to provide the highest level of personalized client service possible whether one's need involves a mock trial, witness preparation, jury selection or a mock exercise not involving a jury. Dr. Kuslansky can be reached at kuslansky@A2LC.com.

Articles by Category

Follow A2L Consulting

Member Red Well Blog
ABA Blawg 100 2013 7th annual

Follow Us on Google+

A2L on Google+