Measuring impact : how can third sector organisations make sense of a rapidly expanding marketplace of tools?

Metcalf, Lindsey (2013) Measuring impact : how can third sector organisations make sense of a rapidly expanding marketplace of tools? Working Paper. Third Sector Research Centre (TSRC), Birmingham.

Preview

PDF
Available under License

Creative Commons Attribution Non-commercial No Derivatives

.
WP111%2D_Metcalf.pdf
556Kb

URL of Published Version: http://www.birmingham.ac.uk/generic/tsrc/documents/tsrc/working-papers/working-paper-111.pdf

Abstract

There is a growing interest in methods of impact measurement as a means of demonstrating the achievements of third sector organisations (TSOs) (Ógáin et al, 2012). A large number of different tools have been developed to support third sector impact measurement work and organisations are faced with the challenge of selecting an approach that is compatible with their budget, expertise, time, organisational size and purpose. The availability of both generic and sub-sector specific tools, as well as a drive towards ‘shared measurement’ (Ógáin et al., 2013), add further layers of complexity to decisions faced by TSOs. In response to this, several publications and online guides have been developed to encourage and advise TSOs engaging in impact measurement work.
This paper examines these recent developments and provides an overview of some of the sources of information available to TSOs about impact measurement. It assesses the potential value of available guides and summaries of impact measurement tools – including an Online Marketplace prototype currently being developed by Inspiring Impact (2013a) - and examines the ways in which such guidance can help the user to create a shortlist of tools suited to their size, budget and capacity. The paper draws on some of the extant academic literature on evaluation and methodology to identify some of the wider factors that could potentially inform third sector decision-making about the approaches to impact measurement most appropriate for their organisations.

Type of Work:

Monograph (Working Paper)

School/Faculty:

Colleges (2008 onwards) > College of Social Sciences

Department:

School of Social Policy, Third Sector Research Centre

References:

Alexander, C. & Smaje, C., 2008. Evaluating third sector reuse organisations in the UK: Case-studies and analysis of furniture reuse schemes. Resources, Conservation and Recycling, 52(5), pp.719–730.
Arvidson, M. 2009 Impact and evaluation in the UK third sector: reviewing literature and exploring ideas. Third Sector Research Centre Working Paper 27, University of Birmingham.
Arvidson, M. and Kara, H., 2013, Evaluations and social value: describing and valuing third sector achievements, Third Sector Research Centre, Working Paper tbc.
Arvidson, M. and Lyon, F., 2013, ‘Social Impact Measurement and Non-profit Organisations: Compliance, Resistance and Promotion’, VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations. Online First, 30 April 2013.
Arvidson, M. and Lyon, F., 2013. Social Impact Measurement and Non-profit Organisations: Compliance, Resistance, and Promotion. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations, pp.1–18.
Arvidson, M., Lyon, F. and McKay, S., 2013. Valuing the social? The nature and controversies of measuring social return on investment (SROI). Voluntary Sector Review, 4(1), pp.3–18.
Barman, E., 2007. What is the Bottom Line for Nonprofit Organizations? A History of Measurement in the British Voluntary Sector. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations, 18(2), pp.101–115.
Clark, J. Kane, D, Wilding, K. and Bass, P., 2012. The UK Civil Society Almanac 2012. London: NCVO.
Donaldson, S., 2009. In search of the blueprint for and evidence-based global society. In Donaldson, S., Christie, C. and Mark, M. (Eds.) What counts as credible evidence in applied research and evaluation practice? Los Angeles: Sage.
Ellis, J. with Gregory, T., 2008 Developing monitoring and evaluation in the third sector: Research report, London: Charities Evaluation Service (CES).
Ellis, J., 2012. Measuring social impact - avoiding a methodological straightjacket. Third Sector Magazine, 3 August 2012.
Hall, M., Forthcoming. Evaluation Logics in the Third Sector. VOLUNTAS: International Journal of Voluntary and Nonprofit Organizations. Online First, November, 2012.
Harlock, J., 2013. Impact measurement practice in the UK third sector: a review of emerging evidence. Third Sector Research Centre, Working paper 106.
Inspiring Impact, 2013a. Inspiring Impact. Available at: .
Inspiring Impact, 2013b. Code of Impact Good Practice. Available at: .
Jargonbusters, 2013. The jargonbuster group. Available at:
Lee, C., 2012. We need to keep impact measurement simple. Third Sector Magazine, 21 February 2012.
16
Lyon, F. and Arvidson, M., 2011. Social impact measurement as an entrepreneurial process, Third Sector Research Centre Briefing Paper 66, University of Birmingham.
McKay, S., Moro, D., Teasdale, S. and Clifford, D., 2011. The marketisation of charities in England and Wales. Third Sector Research Centre, working paper 69.
Milbourne, L., 2013. Voluntary sector in transition: Hard times or new opportunities. Bristol: Policy Press.
NCVO, 2013. Impact Tools. Available at: http://www.ncvo-vol.org.uk/strategy-impact/learn/tools-and-t
New Economics Foundation, 2009. Tools for you. London: Charities Evaluation Service.
Ógáin, E., Lumley, T. and Prichard, D., 2012. Making an impact: Impact measurement among charities and social enterprises in the UK. London: New Philanthropy Capital.
Ógáin, E., Svistak, M. and de Las Casas, L., 2013. Blueprint for shared measurement. London: NPC.
Proving and Improving, 2013. A quality and impact toolkit for social enterprise. Available at:
Rinaldo, H., 2010 Getting Started in Social Impact Measurement: A guide to choosing how to measure social impact, Norwich: The Guild.
Roberts, N., 2013. Impact Measurement: Tools for success: doing the right things and doing them right. Cass Centre for Charity Effectiveness.
Soteri Proctor, A., 2010. Making use of qualitative tools: towards a fuller understanding of the voluntary sector’s engagement with public service delivery. International Journal of social research methodology, 13(5), pp.411–424.
Teasdale, S., Alcock, P. and Smith, G., 2012. ‘Legislating for the big society? The case of the Public Services (Social Value) Bill’, Public Money and Management, 32 (3): 201-208.
TRASI, 2013. Tools and Resources for Assessing Social Impact. Available at:
Wilkes, V. and Mullins, D., 2012. ‘Community investment by social housing organisations: measuring the impact’, Third Sector Research Centre Survey Report for HACT, University of Birmingham.

Date:

October 2013

Keywords:

Impact, measurement tools, social value, Third Sector

Subjects:

H Social Sciences > H Social Sciences (General)

Related URLs:

URL	URL Type
http://www.birmingham.ac.uk/generic/tsrc/index.aspx	UNSPECIFIED

Funders:

Economic and Social Research Council , Office for Civil Society, Cadbury Barrow Trust

TSRC

ID Code:

1853

Export Reference As :	ASCII + BibTeX + Dublin Core + EndNote + HTML + METS + MODS + OpenURL Object + Reference Manager + Refer + RefWorks
Share this item :

Repository Staff Only: item control page