Metrics to measure spiritual growth is the holy grail of integral mission, at least among organizations that receive funding from Western \ evangelical donors. Ever since development agencies began trying to develop holistic programs by incorporating spiritual aspects, they have been scrambling for ways to assess the success (or failure) of those initiatives. Last time, we investigated the forces behind the search for spiritual metrics. Today, we are going to look at four fundamental principles and their associated problems. Next time, we will look at ways to move forward.
The Observer Effect
Arguably the most fascinating and disturbing finding of the 20th century was that photons behave differently if their behavior is observed in the “two slit experiment”. It is much less surprising to assert that the “observer effect” applies to humans as well. From early childhood until old age, people behave differently when their behavior is being observed. Peer pressure is a real thing.
How does this affect measuring impact? Here we can borrow from experience with measuring social impact. The observer effect is relatively insignificant when it comes to tangible outcomes. Bridges, schools, wells, and utilizing new farming practices leave tangible results, which are verifiable. But intangible or ephemeral results are much harder to capture. Measuring school attendance (ephemeral) or changes in attitudes about gender (intangible) are much more challenging and require measuring tangible substitutes (called proxies) and then trying to infer the actual impact to the intangible outcome.
This introduces big problems because of the observer effect. The community is being offered powerful incentives to demonstrate (or report) positive change on issues of interest to the NGO. “Does the male head of the household help with the housework?” “Of course he does, please keep helping my family.”
This is the principle that motivates the “rice Christian” to profess faith in Jesus. As long as the interested organization pays attention and provides rice, the rice Christian demonstrates Christian behaviors. But these behaviors are not indicative of real spiritual impact, are they? The observer effect is a crucial consideration when thinking about measuring spiritual impact, by definition intangible.
The Unknowable Heart
I mentioned earlier that “a comprehensive measure of social impact is practically impossible” Given the complexity of the problem and current limitations in our science and technology, that kind of analysis isn’t feasible. But it may become feasible at some point in the future.
Directly measuring spiritual impact is not practically impossible. It is impossible. Impossible theologically, philosophically, theoretically. It has always been impossible and will always be impossible. Scripture elegantly captured our conundrum more than 3,000 years before the term “metrics” was invented.
1 Samuel 16:7 The Lord does not look at the things people look at. People look at the outward appearance, but the Lord looks at the heart.
As humans, we are limited to seeing outward things. We can see actions, hear words, but only God Almighty can see the human heart, which is the only place that spiritual impact happens. In fact, we are told in Scripture repeatedly that we can’t even fully understand our own hearts!
Jeremiah 17:9 The heart is deceitful above all things and beyond cure. Who can understand it?
People can tell us what they believe, but we are bound by the observer effect. Are they just telling us what we want to hear? The perceptive Bible student will point out James 2 (faith and works) and Matt 7 (good tree good fruit) both directly associate spiritual and behavioral change. This observation gives us some hope, but also leads directly to our third issue.
The Pharisee Problem
The idea that we can see behavior (or life situation for that matter) and assess spirituality is not novel. The Pharisees were particularly good at determining which behaviors indicated a healthy relationship with God. The problem we need to face now is how Jesus reacted to those Pharisees. “You white-washed tombs” comes immediately to mind. More subtly, Jesus very intentionally undermined their system – refusing to wash his hands, reaping on the Sabbath, healing on the Sabbath, hanging out with the undesirables. He also condemned the good actions of the Pharisees because they were done for the wrong reason.
The unknowable heart forces us to use behavior as a proxy, but the Pharisees clearly show that this approach is fraught with danger. What metric can we think of that the Pharisees didn’t already use? How will we deal with the ever-present danger of legalism? We know that we can see something from behavior because that is also scriptural, but what exactly and how precisely are open questions.
How will this kind of assessment affect the community? The organization doing the assessing? We can’t overlook the fact that choosing to evaluate spiritual impact will itself have an impact. That’s just the observer effect writ large.
Measurement Is Not Neutral
There is one final issue that merits investigation. The culture of the development organization is biased towards measurement, as the underlying culture is. The West has a love affair with data! We measure our steps, heart rate, exercise patterns, weight, calories, mood, even blood sugar. It is a paradise for data nerds. But measurement, like every other human action, is not value-neutral. Everyone understands that at some deep, possibly subconscious level. For no one keeps careful track of the monetary value of gifts from their family. It would be “good” data, that might tell you the relative affection of your family members over time. But we know that the act of measuring that data would harm our relationships and insult our family. Measuring something always has a cost, both relational and monetary, and that cost bears careful consideration.
After considering the cost, we must also consider our own motivation. When the Lord commanded a census in Numbers, it was good. But God was deeply offended when David took it upon himself to conduct a census in 1 Chronicles 21, and the judgment was grievous.
Why are we searching so desperately for spiritual metrics? Is it to attract more funding? Are we worried about God’s provision? Do we feel like better data would lead to better spiritual outcomes? Is spiritual development a management problem at heart? I stand with Lesslie Newbigin, the great 20th century missiologist, and assert that it isn’t. I deal with this issue at length elsewhere, but more important is that we all put our motivations under the microscope.
Next Steps
The goal of this discussion was to consider the very real limitations and difficulties confronted by any attempt to measure spiritual impact, as well as the costs and potential pitfalls. I hope that it has tempered some of the irrational optimism that comes along with the technocratic mindset. With realistic expectations, we can now consider how we can move forward.