Many federal agency research staff rely on surveys as part of their research and evaluation efforts to understand how federal programs are serving participants. Although federal staff often recognize that information from surveys should be collected in ways that are accessible, respectful, and responsive to community context, federal staff and their contractors may not always have a fully informed perspective on how to achieve these goals.

In September 2021, OPRE contracted with the Urban Institute to conduct the Advancing Contextual Analysis and Methods of Participant Engagement (CAMPE) project. The goal of the CAMPE project was to aid OPRE in better understanding, incorporating, and advancing equitable research practices in OPRE projects. As part of this project, the team convened a 13-member community advisory board (CAB) to review and comment on multiple documents and processes used in the conduct of OPRE research and evaluation projects. One OPRE process that the CAB explored was survey development and administration.

Purpose

This report focuses on the CAB’s review of an excerpt of a sample survey from an OPRE-funded research study. The OPRE-funded study used the sample survey, along with other data, to evaluate the effectiveness of programs that seek to help adults navigate employment challenges and achieve economic stability. This report details the CAB’s recommendations on developing and administering surveys in ways that reflect an understanding of and respect for survey participants. The report offers specific recommendations for developing and administering person-centered surveys, developing surveys with community engagement, providing incentives to survey participants, and maximizing survey recruitment and retention. Operationalizing the CAB’s recommendations may require additional work on the government’s part.

Key Findings and Highlights

• Survey development and administration processes should reflect an understanding of and respect for survey participants. 
• Person-centered approaches to survey development and administration can help build trust between participants and researchers and, in turn, improve the quality of data collected. 
• Person-centered approaches to surveys include demonstrating that researchers care about the person taking the survey, preparing for questions and concerns participants might have, using trauma-informed and culturally sensitive terms, prioritizing survey access, being thoughtful about survey delivery, and engaging with the community to develop and administer the survey.
• Community engagement is a powerful tool to increase the likelihood of a survey being person centered. 
• Reimagine incentives as compensation, rather than a thank you.