The Measure of Metrics
Tuesday, July 28th, 2009The basis of socialmarkets’ brand of social capital is the metrics we employ to approximate social value. For starters, we try to keep up with the social science on non-profit outcomes and their social value (see our research section here.)
The database of such values is large and growing, and we are grateful for it. Every study that contributes data on the social return of a meal served to the hungry, on medical treatment to the uninsured, etc. helps us more accurately produce SROIs to associate with the related project listings on our site.
But the database of outcomes and their social values is not nearly comprehensive. This would prevent us from compiling SROIs for many non-profits, if we didn’t have the help of our crowdsourcing mechanism.
One of the most important functions of socialmarkets is capturing our users’ opinions on which outcomes they value most. For better or worse, opinions are never in short supply, so our own database of user input can cover the entire non-profit space.
Ideally we would have both subjective and objective data available for the SROI calculation of a given project, but we know this won’t always be the case. In any case, the amount of available data is significant. Like in any market, size matters in socialmarkets. The more players in the market, the more likely we can mitigate gaming, bias and other distortions that prey upon markets with few participants.
The wisdom of crowds presents another argument for more crowdsourcing data. Consider a classic guessing game, like when a random crowd is asked to guess the number of jelly beans in a jar, or the weight of a prize bull. It turns out that while the average guess is off by a wide margin, the average of all guesses becomes more accurate as the number of guesses grows. The bigger the crowd, the wiser they seem to be. This is a fascinating emergent property of society, and it certainly applies to socialmarkets - at least to the extent we can reconcile votes on social priorities with guesses at bean counts.
The bottom line is that socialmarkets runs on social metrics, and is both producer and consumer of the data it needs. Using the data generated by our own users, and by others doing related social science, we are piecing together a truer picture of the costs and benefits of social projects. Ultimately, this will enable us to see how our social investments can generate the greatest social returns.