One of the most common pathways to systems change is to ‘scale’ a successful small-scale innovation.
The theory is simple. Social innovators develop and test a new model or practice that they think can make a positive difference (e.g., improve grade 3 reading rates, protect wetlands, reduce the racism some people encounter when trying to secure good housing). This is usually (but not always) organized as a pilot project. If the experiment is successful, they then work with funders and early adopters to expand the practice broadly enough that it can ‘change’ a system and generate widespread impact.
A few years ago, I read a book called "Trying Hard is Not Good Enough" by Mark Friedman. The book talks about how initiatives can be complicated and complex, and therefore this makes it hard to reduce evaluating these initiatives to a set of numbers and equations. Mark suggests that we need to talk about the story behind the data. Look at the stories, anecdotes and accomplishments that explain what the data is saying.
The video System Thinking and Evaluation, by Kylie Hutchinson, Chris Lovato and Bev Parsons is an excellent introduction to evaluating systems change. It describes how an evaluation of a hypothetical initiative to improve nutrition in a community must both ‘zoom in’ to explore the programmatic effects of the effort (e.g., improved health of program participants) and ‘zoom out’ to assess influence and change on factors in the larger systems that affect their individual health (e.g., urban design which affects levels of physical activity, the quality of industrial food production, the culture of portion sizes). The video also reminds us that deep and durable progress on complex issues depends on our ability to reshape the deeper systems that contribute to those problems in the first place.
One of my roles as ‘curator’ of the Tamarack Institute’s Evaluating Community Impact work is to track and share ideas and methodologies that community changemakers might find useful in their work.
Over the next six months, I will focus on evaluating systems change and social change. Innovators all over the world are focused on reforming or transforming systems, whether they be related to energy, child protection, ecological education, economic, social systems, or (more likely) a mix of all them.
Read More
Michael Quinn Patton, evaluation expert, has argued that even the best intentioned, well-resourced evaluation processes can become, “the enemy of social innovation” if change-makers, evaluators and funders employ a traditional – rather than developmental – approach to assessment.
Read More