Shift Your Evaluation from Activity to Impact Reporting

Posted on February 17, 2020
By Natasha Pei

Cities Reducing Poverty members are showing increasing interest in making the shift from evaluating and reporting on their activities – such as the number of volunteer hours worked or the amount of people who registered for a program – to measuring and talking about their impact.

Collective Impact initiatives, by nature, seek to “move the needle” on issues such as poverty, and with such complex efforts, it is important to have a shared measurement system to help keep efforts aligned, hold one another accountable, and to have data to indicate progress and for making strategic decisions.

From March – August 2019, 17 Cities Reducing Poverty (CRP) members participated in a pilot coaching program to gain knowledge, skills and resources to help them start or upgrade their tracking and reporting of their impact. Many finished the year by publishing a 2019 Community Impact Report, despite beginning with a number of common evaluation challenges, including:

GTI1
  • Lack of capacity for the coordinator – or backbone – and partners to dedicate to evaluation
  • Uneven availability and quality of local data from partners who host programs, projects and services
  • Lack of a common definition of what constitutes “poverty” and shared indicators of success
  • Mis-match between goals and data availability to track progress against those goals

Led by evaluator, Mark Cabaj, President of Here 2 There Consulting, the program provided an evaluation framework - adaptable at the local level, and comparable against similar collaborative efforts across Canada – to guide collaboratives in clarifying and formalizing their theory of change and establishing short, medium and long-term outcome goals and indicators.

Several communities developed new impact frameworks to guide and communicate their work broadly and some were able to continue with and/or adapt existing frameworks. Examples include:

 

DC GTI

Dufferin County Equity Collaborative impact framework (new)

SSM GTI

Sault Ste. Marie Poverty Round Table impact framework (existing)

Here are four good ideas learned from the program, for building your own impact evaluation framework and plan:

  1. Shifting awareness and will – Build a strategy and track how you are creating an environment that is receptive to poverty reduction efforts, through awareness-raising, education and advocacy efforts.
  2. Policy and systems change – Start tracking and tracing the collaborative’s and partners’ activities to see how you have incrementally contributed to local and regional policy and systems changes.
  3. Niche initiatives – Clarify the logic and describe how outputs and outcomes of projects, programs and services are contributing to your medium and long-term goals.
  4. Population-level change – Discuss and establish one or more imperfect population-level indicators of poverty, in order to keep your eye on whether the local “needle” is moving on poverty.

Take Your Learning Further


Topics:
Evaluation, Cities Reducing Poverty


Natasha Pei

By Natasha Pei

Natasha Pei brings online content to life and engages our members in the Vibrant Communities learning centre for poverty reduction. Natasha's involvement with Tamarack began with the Communities First: Impacts of Community Engagement (CFICE) project, where she worked as a Research Assistant in the Poverty Reduction Hub, studying effective ways community-campus engagement can be undertaken to have real benefits for the community.

Related Posts

BACK TO THE LATEST