urban institute nonprofit social and economic policy research

Interviews

by Nancy Pindus

adapted from Michael Quinn Patton's How to Use Qualitative Methods in Evaluation and Qualitative Evaluation and Research Methods (2nd editon), and Meg Sewell's "The Use of Qualitative Interviews in Evaluation" at http://ag.arizona.edu/fcs/cyfernet/cyfar/Intervu5.htm.

What are they used to measure?

Unlike conversations in daily life, which are usually reciprocal exchanges, professional interviews for research and evaluation involve an interviewer who is in charge of structuring and directing the questioning. The task for the qualitative evaluator is to provide a framework within which people can accurately and thoroughly express their point of view about a program.

Qualitative interviewing is most useful for capturing and describing program processes; exploring differences between experiences and outcomes; evaluating programs that are seen as dynamic or evolving; understanding the meaning or purpose of a program to staff or participants; and documenting variations in program implementation at different sites. Interview data for program evaluation allow the evaluator to capture the perspectives of participants, staff, and others associated with the program.

How do they work?

Urban Institute researchers generally use semistructured discussions rather than closed-ended questionnaires (rigidly specified and directly quantifiable questions). A general guide is prepared in advance to serve as a checklist, ensuring that key topics are covered consistently across interviews and interviewers. Semi-structured interviews allow the interviewers flexibility in adapting the interview guide to capture variations in program details, the position of the respondent in the program, and the objectives of the interview. Such tailoring requires a clear understanding of the study objectives, careful preparation before each interview, and an ability to “think on your feet.”

Whether interviewing program staff or participants, individual interviews are important to assure that each respondent feels free to answer questions openly and honestly and not be inhibited by the presence of a supervisor, coworker, or service provider in the room.

Research examples

"Assessing Implementation of the 2002 Farm Bill's Legal Immigrant Food Stamp Restorations"

"Evaluation of the Sectoral Employment Demonstration Program"