Showing posts with label outcomes measures. Show all posts
Showing posts with label outcomes measures. Show all posts

Wednesday, 30 March 2016

New to volunteering? Some top tips for successful outcomes (Guest blog from Ruth Kaufman)

Many thanks to Ruth Kaufman (President of The OR Society) for writing this guest blog.

New to volunteering? Some top tips for successful outcomes

“O.R.” is one of the most adaptable disciplines imaginable, and its practitioners are among the most flexible, prepared to bring scientific rigour and methods to any question even if it is outside their previous specialism. Given this adventurous approach, it is always a good idea to see if there are any tips from previous explorers.

For Pro Bono O.R., there are two types of novelty for many of us: working with charities, and working as volunteers. Neither of these are terribly difficult areas, but they both bring special issues which are worth noting. This post looks at working with charities for the first time, and a second will look at working as a volunteer.

In most ways, working as a consultant to a charity is no different from working as a consultant anywhere, and the same success factors apply. Here are five top tips for charity special features.

1) before you meet the client, do prior research. Make sure you understand the basics of the charity sector (there is a useful summary available as part of the Pro Bono resource set). Armed with that, find out, for your client: what are their charitable objects; who are their beneficiaries; what are their main funding sources; how many staff, volunteers, and trustees do they have. These will all be part of your client’s day-to-day reality, and they’re all things you may not have come across in a non-charity organisation, whether or not it is not-for-profit.

2) identify the stakeholders In particular, find out about how the work is split between paid staff, volunteers and trustees (who are usually also volunteers); and in particular how they manage the interface between staff and trustee board

3) understand clients’ time constraints. Charities – small ones, especially – are run by volunteers to an extent that is unthinkable in other organisations. Trustees, in particular, will have a significant role in decision-making, but will be doing this as a tiny part of their day-to-day life. Only rarely will a trustee have signed up in advance to commit a significant amount of time, at regular well-specified intervals, to the charity. This can also be an issue for paid staff, depending on sources of funding; sometimes there is no money for staff to do anything other than deliver services specified by the funder, so thinking about strategy or change is all done in ‘spare time’ snatched from other activities.

4) build communication and trust A critical issue here can be language. Many charities will have staff who are suspicious of ‘business agendas’ and anxious that commercial considerations may be used as an excuse for driving out the qualitative aspects of their work. This is mainly a matter of being sensitive to the fact that terminology or arguments that sound professional and normal in the business world may bring different connotations to people focused on helping beneficiaries. Of course it is important to say what you mean; just do it in ordinary human language.

5) co-producing with the client It takes two parties to deliver a successful consultancy project. Agreeing terms of reference, project plans and deliverables; adapting these as necessary; managing expectations; keeping commitment through to the end; these crucial success factors rely on both consultant and client . The difference with charities is that the charity is less likely to have experience of such things than other organisations you have worked with. Make allowances! Watch out for risks such as specification changes, project drift, misunderstandings, reprioritisation. Never put these down to incompetence or lack of interest from the client, unless the evidence for that is overwhelming – they are much more likely to be due to inexperience with project management, or the organisation’s vulnerability to external events temporarily blowing it off course. Responding with a suitable mix of empathy, sympathy, and professionalism will make all the difference.

To see some of the projects we've worked on and to find out how to get involved please visit the Pro Bono O.R. webpage


Wednesday, 3 February 2016

Making a real difference makes it all worthwhile #volunteer #ORblog

I really enjoy managing the Pro Bono O.R. scheme and I see the value in the scheme for the volunteers, the organisations and the volunteers employers.

Everyday is different and rewarding in a different way. Some of the best days are when I receive feedback from the organisations who have received support. Today I got some feedback from the latest project we completed with PiP (Pursuing independent Paths)

The project with PiP was 'Understanding the effectiveness of training and development'. If you missed the case study slide you can view it here.

The feedback given by the Director and Accreditation Worker at PiP really encouraged me and put a smile on my face. It's fantastic to hear the value carrying out a pro bono project can make.

What went well?

"The volunteer grasped the concept of what we needed very quickly after a couple of initial phone conversations. We now have a working tool that is bespoke to our organisation’s needs. Importantly it is a very straightforward tool to use and user friendly for those with little Excel knowledge. We have already begun using this tool in live review meetings and grant applications."

What difference will this make to your organisation?

"We have a tool that allows us to measure student progress (individual or group) in quantifiable terms over the course of a year and present this information visually in a variety of graphs. Crucially, it also measures status quo, which is crucial to our beneficiaries and service.

Previously we have been relying on qualitative data such as verbal feedback or written observations.

This in turn is a way of monitoring and evaluating the organisations’ effectiveness in achieving three of our core outcomes.

We can present this data for students, parents and carers, and donors to see if they are achieving goals, internally for monitoring goal appropriateness and consistency, and externally in grant or commission applications and project monitoring."

Any final thoughts?

"THANK YOU SO MUCH - great match of your skills and our need. Staff awareness, and ownership of, impact and quality has increased as a result of this project."

For more information about the scheme, to see who we've worked with, read example case studies and to request support please visit: www.theorsociety.com/Pages/Probono/Probono.aspx

You can also connect with me via twitter (@FMcLeister) or LinkedIn

Tuesday, 28 July 2015

Measuring Impact: recommended resources #ORblog



O.R. in the Third sector
Measuring impact: sources of information

  1. There is an enormous amount of material available on this topic. If your project requires impact measurement, outcomes measurement or evaluation, you should first review as much of the material below as you have time for – the charity may well be aware of it, even if you aren’t. CES and NPC, in particular, are well known in the charity world and are partially responsible for the recent increased importance attached to impact measurement and evaluation.

Outcomes, impact, evaluation

  1. Some organisations use these terms interchangeably, some don’t – there is not much consistency. A useful guide to the terminology is produced by the Big Lottery Fund; worth reading if only because you may have been asked to undertake the analysis to support an application for funding to Big Lottery or to another funder that takes a similar approach. www.biglotteryfund.org.uk/er_impact_measurement.pdf
  2. Optional extra reading, or for reference if you feel the need: http://www.jargonbusters.org.uk/

Charities Evaluation Services http://www.ces-vol.org.uk/tools-and-resources

  1. CES have useful material on planning for monitoring and evaluation, and outcomes and outcome indicators
  2. They discuss purpose of evaluating impact:
5.1  reflect on and develop work
5.2  report to funders
5.3  identify gaps in services
5.4  bid for new work
and have a nice template (used by a Pro Bono O.R. volunteer carrying out a project for Elfrida   Rathbone Camden) demonstrating impact and effectiveness.

Outcome
Outcome indicators
Data collection
When and who by
How this will be used






Impact measurement and ‘theory of change’

  1. The charity/think-tank New Philanthropy Capital (NPC) has been instrumental in promulgating the importance of impact measurement.  Its methodology, based on the idea of a ‘theory of change’ (a mapping of actions to outputs and outcomes which should be a familiar way of looking at the world to an O.R. professional), is now widely accepted. It is described in: http://www.thinknpc.org/publications/npcs-four-pillar-approach/
  2. For more tools:  http://www.thinknpc.org/blog/7-practical-outcomes-tools/
  3. To read about different approaches in practice: http://socialvalueint.org/wp-content/uploads/2015/01/SIAA-Challenge-Report_2014.pdf

Social return on investment (SROI)

  1. SROI is a principles-based method for measuring extra-financial value (i.e., environmental and social value not currently reflected in conventional financial accounts) relative to resources invested. It can be used by any entity to evaluate impact on stakeholders, identify ways to improve performance, and enhance the performance of investments.  Useful introductions are:


  1. The Green Book is a guide to best practice appraisal (before investment) and evaluation (post-implementation) of public sector initiatives, which applies equally well to any initiative where there is no market value of the outcome.
  2. It covers:
11.1   Valuing costs and benefits where there is no market value (value, utility, welfare, well-being)
11.2   Weighting and scoring
11.3   Critical success factors (met or not)
11.4   Discounting
11.5   Risk management
11.6   Valuing risks (uses ‘expected value’)
11.7   Performance management and measurement (tracking the success of a policy, programme or     
          project in achieving its objectives and in securing the expected benefits)
11.8   Benefits categories:
11.9   Financial quantitative
11.10  Non-financial quantitative
11.11  Non-financial qualitative
11.12  Outcomes qualitative and quantitative
11.13  Objectives and outcomes; outputs and targets.
11.14  Social Cost Benefit Analysis which seeks to assess the net value of a policy or project to
           society as a whole
11.15  Utility: the satisfaction a person gets from consumption of a good, or to a change in their  welfare or well-being

Specific types of charity

  1. If your charity works with offenders or their families, you should be aware of Clinks: http://www.clinks.org/support-evaluation-and-effectiveness/demonstrating-outcomes
  2. If your charity works with young people, you should be aware of Project Oracle: www.project-oracle.com  and http://inspiringimpact.org/listing/project-oracle/
  3. If your charity is involved in overseas aid or development, you should be aware of the Logframe approach (“Logical framework”, which you can find out more about via google): http://www.usip.org/sites/default/files/PW77.pdf  and https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/253889/using-revised-logical-framework-external.pdf

Pro Bono Economics  http://www.probonoeconomics.com/

Pro Bono Economics matches volunteer economists with charities to address questions around measurement, results, impact and value. Volunteers produce a full, peer-reviewed report on each project, and all reports are published on the website, constituting a valuable resource.


Pro Bono OR moving elsewhere

Pro Bono OR projects can now be found here:  https://www.theorsociety.com/get-involved/pro-bono-or/open-pro-bono-projects/ This blog will no...