Improving Development Effectiveness Through R&D: Dynamic Learning and Evaluation

28 Pages Posted: 20 Sep 2013

See all articles by Nathan Fiala

Nathan Fiala

University of Connecticut - Department of Agricultural and Resource Economics

Cormac Mangan

German Institute for Economic Research (DIW Berlin)

Date Written: September 2013

Abstract

Research and development (R&D) is a common process in for-profit organizations. Despite the benefits, it is not routinely practiced in nonprofit organizations, in part because it is difficult to identify the effects of programs that are designed to involve individuals over long periods of time. This paper presents a process by which organizations looking to affect social outcomes can learn from their programs in both the short- and long-run in order to develop the most cost- and impact-effective programs. We call it Dynamic Learning and Evaluation (DLE). DLE is a multi-arm experimental approach to program development that encompasses all stages of the design and implementation process. It combines a clear model of the causal chain of a program with high quality monitoring and impact evaluation. During the initial program development, organizations randomly apply multiple implementation designs and test them against each other using qualitative and administrative data. Once the organization determines a combination of designs that hold the most potential, they then implement these designs in the field and estimate impacts using participant data collection processes. The organization then uses the results to inform the next round of program implementation. They repeat this process over multiple designs for the life of the program and organization. At no point in the lifespan of the organization is this learning process stopped: programs are continually updated using systematic and objective methods to improve their design and impact. We present this process in detail.

Keywords: Research and development, program development, non-governmental organizations, development strategies, impact evaluation, monitoring and evaluation

JEL Classification: O32, O19, D73, L31

Suggested Citation

Fiala, Nathan and Mangan, Cormac, Improving Development Effectiveness Through R&D: Dynamic Learning and Evaluation (September 2013). DIW Berlin Discussion Paper No. 1325, Available at SSRN: https://ssrn.com/abstract=2328196 or http://dx.doi.org/10.2139/ssrn.2328196

Nathan Fiala (Contact Author)

University of Connecticut - Department of Agricultural and Resource Economics ( email )

Cormac Mangan

German Institute for Economic Research (DIW Berlin) ( email )

Mohrenstra├če 58
Berlin, 10117
Germany

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
35
Abstract Views
449
PlumX Metrics