--- title: Rethinking How We Evaluate and Use Data description: Everyone, regardless of whether you consider yourself an evaluator or not, uses metrics. We track our finances, look at gas mileage and so much more. image: https://www.tamarackcommunity.ca/hubfs/Photos/Image%20Library/tyranny%20of%20metrics.jpg --- [![20yrLogo-2_WhiteOrange](https://www.tamarackcommunity.ca/hs-fs/hubfs/Administration/Tamarack%20Logos/20yrLogo-2_WhiteOrange.png?width=200&height=47&name=20yrLogo-2_WhiteOrange.png "20yrLogo-2_WhiteOrange")](https://www.tamarackcommunity.ca/?hsLang=en-us) # Rethinking How We Evaluate and Use Data Posted on April 15, 2019 [By Duncan Field](https://www.tamarackcommunity.ca/latest/author/duncan-field) - [Tweet](https://twitter.com/share) ![tyranny of metrics](https://www.tamarackcommunity.ca/hs-fs/hubfs/Photos/Image%20Library/tyranny%20of%20metrics.jpg?width=300&name=tyranny%20of%20metrics.jpg)Everyone, regardless of whether you consider yourself an evaluator or not, uses metrics. We track our finances, look at gas mileage and so much more. In a community change context, we often find ways to track the performance of things like marketing and communications, program delivery, and budgeting. In a recent article, evaluation expert Mark Cabaj reviewed The Tyranny of Metrics by Jerry Z Muller. In his book, Jerry takes on three underlying assumptions about how we typically use data: - Outcomes and performance can be reduced to standardized measurements even in complex challenges - Making metrics public or transparent increases the chances that institutions will be accountable for their actions and results - The best way to motivate people is by attaching financial and reputational rewards and penalties to their ability to meet quantifiable performance targets Mark's review of The Tyranny of Metrics highlights some of the practical issues that come up when an organization becomes over reliant on simple metrics to track and manage progress on complex issues. For example, an emphasis on a simple key performance indicator (KPI) may cause an organization to focus more effort on supporting the work that directly impacts that KPI at the expense of other work that may ultimately be just as important, but is not closely monitored. Mark, and ultimately Jerry Muller himself, is quick to explain that it is not the data or the desire to collect it that is the issue here, but rather the "inappropriate, excessive, and simplistic application of standardized metrics to decision-making" that can creep into our work. Both Mark Cabaj and Jerry Muller are ultimately concerned with ensuring that organizations are intentional about what and how they are measuring progress and impact. Bad faith reporting, where an organization does not believe a metric has any relevance or impact but continues to report it, leads to lower morale, lost staff time, and bad decisions. This review is a great introduction to anyone who wants to dig deeper into this problem and equip themselves with the information it will take to do something about it. If you're interested in learning more about the role of evaluation in the context of complex systems change, we're hosting a unique two-day workshop [Evaluation + Design: Evaluating Systems Change](https://events.tamarackcommunity.ca/evaluation-design-2019?hsLang=en) in Ottawa, ON from May 22-23. We'll talk in depth about the challenges of measuring impact on complex systems, and equip you with the practical tools, principles, and resources needed to truly make an impact. **Learn More:** - Read the full review [The Tyranny of Metrics](https://www.tamarackcommunity.ca/library/tyranny-of-metrics-review-mark-cabaj-evaluation?hsLang=en) - Learn more about our upcoming two-day workshop [Evaluation + Design: Evaluating Systems Change](https://events.tamarackcommunity.ca/evaluation-design-2019?hsLang=en) where we'll be exploring tools from both the evaluation and design field that will help you evaluate complex systems change efforts. - Check out our new [Systems Change Evaluation Canvas](https://www.tamarackcommunity.ca/library/systems-change-evaluation-canvas?hsLang=en), a tool designed to help you build an evaluation of complex systems change efforts. You can also view a [free webinar recording](https://www.tamarackcommunity.ca/library/webinar-the-systems-change-evaluation-canvas-tool-for-planning-to-evaluate-systems?hsLang=en) of Mark Cabaj and Galen MacLusky introducing the canvas  and going through it piece by piece. Topics: [Evaluating Community Impact](https://www.tamarackcommunity.ca/latest/topic/evaluating-community-impact), [Evaluation](https://www.tamarackcommunity.ca/latest/topic/evaluation), [Mark Cabaj](https://www.tamarackcommunity.ca/latest/topic/mark-cabaj) ![Duncan Field](https://www.tamarackcommunity.ca/hubfs/Administration/Team%20Headshots/Duncan%20Field%20Headshot.jpg) ### By [Duncan Field](https://www.tamarackcommunity.ca/latest/author/duncan-field) Duncan is a researcher, writer, and editor with a focus on supporting community organizations. He has experience creating and producing engaging content and learning materials, and maintaining online spaces for knowledge sharing. Duncan studied Psychology, Philosophy, and Law at York and Queen’s University. He has also worked in the charitable sector designing e-learning courses and building online communities of practice. ## Related Posts [![](https://www.tamarackcommunity.ca/hubfs/Quilt.png)](https://www.tamarackcommunity.ca/latest/learning-indigenous-ways-of-knowing-and-being?hsLang=en-us) #### [Learning Indigenous Ways of Knowing and Being](https://www.tamarackcommunity.ca/latest/learning-indigenous-ways-of-knowing-and-being?hsLang=en-us) [![](https://www.tamarackcommunity.ca/hubfs/Vibrant-Communities-Calgary-to-10.png)](https://www.tamarackcommunity.ca/latest/vibrant-communities-calgarys-top-10-highlights-of-2021?hsLang=en-us) #### [Vibrant Communities Calgary’s Top 10 Highlights of 2021](https://www.tamarackcommunity.ca/latest/vibrant-communities-calgarys-top-10-highlights-of-2021?hsLang=en-us) [![](https://www.tamarackcommunity.ca/hubfs/elena-rouame-tools.jpg)](https://www.tamarackcommunity.ca/latest/tools-for-2022?hsLang=en-us) #### [Tools for 2022: Tamarack’s Top 10 Resources published in 2021](https://www.tamarackcommunity.ca/latest/tools-for-2022?hsLang=en-us) [![BACK TO THE LATEST](https://www.tamarackcommunity.ca/hs/cta/cta/default/316071/e6ffa9bb-4467-4833-8ecc-eb340b11d829.png)](https://www.tamarackcommunity.ca/hs/cta/cta/redirect/316071/e6ffa9bb-4467-4833-8ecc-eb340b11d829?hsLang=en-us) [![20yrLogo-2_WhiteOrange](https://www.tamarackcommunity.ca/hs-fs/hubfs/Administration/Tamarack%20Logos/20yrLogo-2_WhiteOrange.png?width=3401&name=20yrLogo-2_WhiteOrange.png "20yrLogo-2_WhiteOrange")](https://www.tamarackcommunity.ca/?hsLang=en-us) ### Tamarack [Home](https://www.tamarackcommunity.ca/?hsLang=en-us) [Latest](https://www.tamarackcommunity.ca/latest) [Events](https://www.tamarackcommunity.ca/eventlisting?hsLang=en-us) [Donate](https://www.tamarackcommunity.ca/donate?hsLang=en-us) [About](https://www.tamarackcommunity.ca/whoweare?hsLang=en-us) ### Follow Us [** ** ](https://www.facebook.com/TamarackInstitute) [** ** ](https://twitter.com/Tamarack_Inst) [** ** ](https://www.linkedin.com/company/tamarack-institute-for-community-engagement)   In the spirit of respect, reciprocity, and truth we honour and acknowledge that our work occurs across Turtle Island (North America), which has been home since time immemorial to the ancestors of First Nations, Métis, and Inuit Peoples. ### Subscribe Be in the know. Get the latest updates, events and resources about community change. [Learn More](https://www.tamarackcommunity.ca/subscribe?hsLang=en-us) Tamarack Institute © 2023