Next >

Interviewer Effects from a Total Survey Error Perspective

Section I. History and Overview The Past, Present, and Future of Research on Interviewer Effects Introduction Training, Managing, and Monitoring Interviewers Interviewer Effects Across Contexts and Modes Interviewers and Nonresponse Interviewer Pace and Behaviors Estimating Interviewer Effects Closing Thoughts Acknowledgments References The Legacy of Charles Cannell Summary of Cannell’s Key Contributions Documenting Errors in Self-Reports Modeling the Survey Response Process Inventing New Interviewing Techniques Creating Methods of Interview Observation Evidence for the Effectiveness of Interviewer Feedback, Instructions, and Commitment Early Studies Subsequent Record Check Investigations Summary and Critique More Recent Cannell-Inspired Research Interview Observation Interviewing Methods Conclusions References Section II. Training Interviewers General Interviewing Techniques: Developing Evidence-based Practices for Standardized Interviewing Introduction Brief Historical Context Reasons to Revisit GIT A Process for Revising GIT Revisiting Interviewing Techniques General Goals Specific Gaps in Existing Training Structure of Training and Key Concepts Question–Answer Sequence Response Format (Question Form)Codable and Uncodable Answers Acknowledgments Discussion References How to Conduct Effective Interviewer Training: A Meta-Analysis and Systematic Review Introduction Conceptual Development of Research Questions Effect of Refusal Avoidance Training on Unit Nonresponse Rates Effect of Interviewer Training on Data Quality Effect Size Heterogeneity Training Features That May Improve Data Quality Data and Methods Results What Is the Effect of Interviewer Training on Data Quality?Moderator Analysis: Which Features Render Interviewer Training Successful?Interviewer Training Duration (Q4 in Table 4.1)Cooperation Rates and Training Methods (Q5 in Table 4.1)Conclusion and Discussion Acknowledgments Bibliography Section III. Managing and Monitoring Interviewers and the Survey Process Exploring the Mind of the Interviewer: Findings from Research with Interviewers to Improve the Survey Process Introduction Motivation Research Topics Method Results Sensitive Questions Difficult Questions Deciding Whether to Probe Vignettes Sensitivity Vignettes Difficulty Vignettes Summary and Conclusions Recommendations for Interviewer Training Recommendations for Future Research References Behavior Change Techniques for Reducing Interviewer Contributions to Total Survey Error Introduction Review of Relevant Literature Data and Methods The Medical Expenditure Panel Survey (MEPS)Two Critical Question Series: The Calendar Series and Provider Probes Series Behavior Coding of Audio-Recordings Supervisor Alerts Results Behavior Coding and Rapid Feedback Supervisor Alert System Discussion Behavior Coding and Rapid Feedback Supervisor Alert System Conclusion References Statistical Identification of Fraudulent Interviews in Surveys: Improving Interviewer Controls Introduction Interviewer Falsification – An Overview Forms of Falsification Frequency of Falsification Reasons for Falsification Effects of Falsification on Data Quality Non-Statistical Identification Strategies Re-contact Monitoring Validation with Administrative Data Statistical Identification Strategies Identification of Complete Falsifications Falsification Indicators Multivariate Analysis of Falsification Indicators Identification of Partial Falsifications Identification of Duplicate Records Data and Sample Findings Identification of Complete Falsifications Identification of Partial Falsifications Identification of Duplicates across the Interview Outlook and Discussion Acknowledgments References / Examining the Utility of Interviewer Observations on the Survey Response Process Introduction Methods Data Sources Post-Survey Interviewer Observations in the ESS Post-Survey Interviewer Observations in the NSFG Dependent Variables in the ESS Dependent Variables in the NSFG Analytic Approach Results ESS: Latent Class Analysis ESS: Class Comparisons on Dependent Variables NSFG: Latent Class Analysis NSFG: Class Comparisons on Dependent Variables Discussion Acknowledgments References Why Do Interviewers Vary in Achieving Interview Privacy and Does Privacy Matter?Introduction and Background Methods Measures Analysis Results Discussion References Unintended Interviewer Bias in a Community-Based Participatory Research Randomized Control Trial among American Indian Youth Introduction Social Desirability Research Questions Methods Sample Measures Analytic Strategy Results Internalizing and Externalizing Behaviors Substance Use, Cultural Participation, and Cultural Discrimination Discussion Limitations Conclusions References Virtual Interviewers, Social Identities, and Survey Measurement Error Introduction Virtual Interviewers Virtual Interviewer Identities and Measurement Error Research Design Analytic Methods Results Conclusions Acknowledgments References Differences in Interaction Quantity and Conversational Flow in CAPI and CATI Interviews Introduction Number of Turns, Events, and Words Uncertainty Markers and Hesitations Question Characteristics Methods Results Number of Turns and Eents Number of Words Interviewer and Respondent Filled Pauses and Respondent Uncertainty Markers Conclusion Acknowledgments References Interacting with Interviewers in Text and Voice Interviews on Smartphones Introduction Study Analyses of Interview Dynamics Do Interviewer Behaviors Predict Response Quality?Discussion Questions and Implications Acknowledgments References Section V. Interviewers and Nonresponse Explaining Interviewer Effects on Survey Unit Nonresponse: A Cross-Survey Analysis Introduction Data Methods Results Summary and Discussion References Comparing Two Methods for Managing Telephone Interview Cases Introduction Background of the Study and Design of the Case Management Approaches Case Management Systems Interviewer Training Interviewer Monitoring and Case Review Results Number of Call Attempts Per Case Variability in Timing of Call Attempts Number of Call Attempts Per Interviewer Hour Operational Observations Discussion References Investigating the Use of Nurse Paradata in Understanding Nonresponse to Biological Data Collection Introduction Data Methods Paradata Variables Nurse Performance Indicators Results Approach 1: Response Propensity Models Including Nurse Characteristics and Paradata Variables Approach 2: Response Propensity Models Including Nurse Performance Indicators Discussion References Section VI. Interview Pace and Behaviors Exploring the Antecedents and Consequences of Interviewer Reading Speed (IRS) at the Question Level Introduction Background Hypotheses Methods Results Discussion and Conclusions Acknowledgments References Response Times as an Indicator of Data Quality: Associations with Question, Interviewer, and Respondent Characteristics in a Health Survey of Diverse Respondents Introduction Response Times and Question Characteristics Response Times and Interviewers’ Experience Data and Methods Measures Analytic Strategy Results Discussion Acknowledgments References Accuracy and Utility of Using Paradata to Detect Question-Reading Deviations Introduction Background Interviewers’ Behavior and Measurement Error Data and Methods Data Dependent Variable and Variables for QATT Detection Methods Analysis Results Summary References What Do Interviewers Learn?: Changes in Interview Length and Interviewer Behaviors over the Field Period Introduction Hypotheses for Behaviors Affected by Interviewer Learning Data and Methods Creating Behavior Measures Dependent Variables Primary Independent Variable: Within-Survey Experience Control Variables Analytic Strategy Results RQ1: What Interviewer Behaviors Change over the Course of the Data Collection Period?RQ2: Do Interviewer Behaviors Account for Changes in Survey Length over the Course of the Data Collection Period?Variance Components Conclusions Acknowledgments References Section VII. Estimating Interviewer Effects Modeling Interviewer Effects in the National Health Interview Survey Introduction Methods Data Measures Data Structure Statistical Analyses Results IICs by Question Characteristics Interviewer IICs by Interviewer Characteristics Discussion References A Comparison of Different Approaches to Examining Whether Interviewer Effects Tend to Vary Across Different Subgroups of Respondents Introduction The Basic Model Data and Preliminary Analysis Data A Preliminary Analysis A Two-Step Procedure The Conditional Random Interviewer Effect Model Conclusion References Designing Studies for Comparing Interviewer Variance in Two Groups of Survey Interviewers Introduction Critical Study Design Considerations Interpenetrated Sample Assignment Geographic Balance Randomized Assignment to Groups Power Analysis Analytic Approaches Discussion References

Next >