Honduras Threshold Program: Endline Evaluation Report. With Nick Livingston, Albert Pijuan, Lisette Anzoategui, Irma Romero, Tommie Thompson, and Jordan Sticklin. Social Impact. 2020.
The Millennium Challenge Corporation (MCC)’s Threshold Program ran from August 2013 to May 2019 and focused on strengthening budget and treasury management, improving procurement capacity, planning and controls, building the capacity of the Supreme Audit Tribunal (TSC), providing grants to civil society organizations to foster social accountability, developing capacity within the Honduran government to carry out PPPs, and supporting the design and implementation of PPPs. This evaluation is an observational study and a longitudinal, performance evaluation, meaning that we attempt to triangulate among diverse data sources to measure changes over time between 2014 and 2019 and then use qualitative data to consider Threshold contribution to any observed changes. Data sources include (1) monitoring and administrative data, (2) documents generated by Threshold implementers, (3) qualitative interviews, (4) a survey of vendors who sell goods and services to the government, (5) a survey of public employees in three key government agencies, and (6) online surveys with government officials that participated in the TCP-promoted PPP and procurement training courses.
Malawi Power Sector Reform Project: Endline Performance Evaluation Report. With Meredith Feenstra, Arvid Kruze, and Linda Chinangwa. Social Impact. 2019.
MCC’s $350.7 million Malawi Compact (2013-2018) was designed to address financial, operational, and governance challenges among power sector institutions through the $27.5 million Power Sector Reform Project (PSRP). The project provided technical assistance and a management information system to turnaround the electrical utility financially, operationally, and in terms of corporate governance. The PSRP also sought to increase the regulator’s capacity, promote a cost-reflective tariff, and create an enabling environment for private sector investment in the power sector. The evaluation is a longitudinal, observation study that uses diverse data sources to track changes over time. Data sources included project documentation, key informant interviews, extensive process mapping, and quantitative indicators.
Evaluation of Secondary Prevention in the Community, Family, and Youth Resilience Program in St. Lucia, St. Kitts and Nevis and Guyana: Baseline Report. With Stephanie Gimenez Stahlberg, Alberto Díaz-Cayeros, Corinna Bordewieck, Jordan Robinson, Catherine Caligan, and Julia Kresky. USAID. 2019.
In 2016 in response to crime and violence in the Eastern and Southern Caribbean, the United States Agency for International Development (USAID) launched the Community, Family and Youth Resilience (CFYR) initiative in Guyana, Saint Lucia, and Saint Kitts and Nevis implemented by Creative Associates. This multi-site randomized control trial focuses on CFYR’s Family Matters secondary prevention efforts, a key component of the CFYR intervention. After applying a risk assessment tool known as the Youth Services Eligibility Tool (YSET) to close to the population of youth between the ages of 10 and 17 in the 15 communities, CFYR determined which youth are at higher risk and in need of secondary prevention efforts. Eligible youth were randomized into a treatment group, which would be eligible for a one-year family counseling program right away, and a control group, that would be eligible for the program in the following year. The tools used for the evaluation include a community survey conducted by CFYR, the YSET for youth, which was applied at baseline, after six months, and after one year, and a caregiver survey of the youth’s primary caregiver, which was conducted at baseline and at the end of the one-year program, and qualitative fieldwork.
Malawi Power Sector Reform Project and Infrastructure Development Project Performance Evaluation: Enterprise Survey and Case Study Community Baseline Report. With Patricia Delaney, Meredith Feenstra, Billy Hoo, Stella Kalengamaliro, Olga Rostapshova, Sylvia Sun, and Michele Wehle. Social Impact. 2018
The centerpiece of the Millennium Challenge Corporation’s $350.7 million Malawi Compact (2013-2018) were investments in Malawi’s transmission infrastructure with some additional investments in generation and distribution infrastructure. This report describes the baseline evaluation data from a) a nationwide geographically-representative sample of businesses with electricity connections, which we refer to as an enterprise survey (ES), and from b) the household survey and focus group discussions (FGD) conducted in select communities. At baseline, the ES, household survey, and FGDs illustrate the challenges frequent outages and poor-quality electricity present to both businesses and households.
Impact Evaluation of the ‘Increasing Services for Survivors of Sexual Assault in South Africa’ Program: Endline Impact Evaluation Report. With Jordan Robinson, Meredith Feenstra, Stephanie Stahlberg, and Olga Rostapshova. USAID. 2017.
The South African government has established a network of Thuthuzela Care Centers (TCCs) to provide services to survivors of sexual and gender-based violence (SGBV); however, utilization has remained low. This randomized controlled trial tests two different approaches to increasing utilization by randomizing police precincts around 50 TCCs. The first group received a community dialogue intervention designed to address the stigma associated with reporting SGBV. In the second group, police and teachers were trained to identify SGBV and refer victims to the TCCs. A third set of precincts served as a control.
DRG Mission Use of Evidence: Lessons from Evidence Utilization in USAID DRG Program Design. With Robert Gerstein and Aleta Starosta. USAID. 2022.
DRG Impact Evaluation Retrospective: Learning from Three Generations of Impact Evaluations. With Michael G. Findley and Aleta Starosta. USAID. 2020.
Yetu Initiative: Mid-Term Performance Evaluation. With Samir Panjwani, Susan Wilkinson, Patrick Ochieng, and Marcy Kelley. USAID. 2019.
Honduras Threshold Program: Interim Evaluation Report. With Nick Livingston, Albert Pijuan, Irma Romero, Andrew Carmona, and Braden Agpoon. Social Impact. 2019.
Power Sector Reform Project Volume 2: Midline Performance Evaluation Report. With Michele Wehle, Arvid Kruze, Stella Kalengamaliro and Olga Rostapshova. Social Impact. 2018.
Power Sector Reform Project Volume 1: Midline Process Evaluation Report. With Michele Wehle, Arvid Kruze, Stella Kalengamaliro, Marius Meijerink, and Olga Rostapshova. Social Impact. 2018.
Evaluation of Juvenile Justice Sector Reform Implementation in St. Lucia, St. Kitts and Nevis, and Guyana. With Dianne Williams, Lily Hoffman, Catherine Caligan and Meredith Feenstra. USAID. 2018.
Baseline Report: Honduras Threshold Country Program. With Nick Livingston, Albert Pijuan, Irma Romero, Andrew Carmona, Basab Dasgupta, and Braden Agpoon. Social Impact. 2017.
Process Evaluation and Performance Evaluation Baseline Report for the MCC Malawi Compact Power Sector Reform Project. With Michele Wehle, Arivd Kruze, Emily Gonzalez, Veronica Mazariegos, Stella Kalengamaliro, and Olga Rostapshova. Social Impact. 2017.
Performance Evaluation of the Elections and Political Processes Fund. With Katherine Vittum, Alison Miranda, Carrie Stefansky Huisman, Michele Wehle, Kelly Skeith, Molly Brune, Nathan Youngblood. USAID. 2017.
Impact and Performance Evaluation of Solidarity Center’s Global Labor Program in Bangladesh. With Olga Rostapshova, Heather Goldsmith, Jordan Fulp, Emily Gonzales, S. Ishtiaque Ahmed, and Md. Harunur Rashid. USAID. 2016.
Networks and Information: An Impact Evaluation of Efforts to Increase Political Participation in Mozambique. With Pedro C. Vicente and Macartan Humphreys. USAID. May 2015.
Assessment of Human Trafficking in Artisanal Mining Towns in Eastern Democratic Republic of Congo. With Jocelyn Kelly, Natasha Greenberg, and Jordan Fulp. USAID. August 2014.
Strengthening Democratic Local Governance: Midline Evaluation Report. Strengthening Democratic Local Governance. Tetra Tech ARD. April 2013.
“El régimen disciplinario de la Policía Federal.” With Eric Olson. La conformación de un sistema integral para el desarrollo policial. México D.F.: Secretaría de Seguridad Pública. 2012.
“Program Evaluation in Public Security Policy: Culture of Lawfulness” with John Bailey, Ricardo Martínez, and Luís Felipe Mantilla. In Freddy Ramón Mariñez Navarro and Vidal Garza Cantú, editors. Política pública y democracia en América Latina: Del análisis a la implementación. Mexico City: Miguel Ángel Porrúa. 2009.