information system data, programme monitoring statistics or other forms of systematic information that are not necessarily research-orientated. According to Patton, programme evaluation differs fundamentally from research as regards the purpose of data collection and the standards for judging quality. Basic scientific research is undertaken to discover new knowledge, test theories, establish the truth, and generalise across time and space. Programme evaluation, however, is undertaken to inform decisions, clarify options, identify improvements, and provide information about programmes and policies within contextual boundaries of time, place, values and politics. Ideas proposed by both Rossi et al. (2004) and Patton (1997) inform the way in which evaluation is understood and utilised in this manual. Purposes of evaluation The two approaches discussed above in fact converge with respect to the purposes of evaluation. Their first point of convergence is to distinguish two categories of evaluation: summative and formative. They describe summative evaluation as an exercise that judges the overall effectiveness of a programme and is particularly important in making decisions about continuing or terminating a programme or project. They posit that summative evaluation can be contrasted with formative evaluation, which focuses on ways of improving and enhancing programmes rather than rendering a definitive judgement about effectiveness. Summative evaluation, by contrast, provides data to support a judgement about a programme’s worth so that a decision can be made about the merit of continuing with the programme. Be that as it may, there are three main purposes of evaluation that Patton (1997, pp. 65–70) identifies: Judgement-orientated evaluation Judgement-orientated evaluation is evaluation that is aimed at determining the overall merit, worth or value of a project or programme. ‘Merit’ refers to the value of a programme, for example how effective it is in meeting the needs of those it is intended to help. ‘Worth’ refers to the extrinsic value for those outside the programme, for example the larger community or society. Judgement-orientated evaluation approaches include summative evaluations aimed at deciding if a programme is sufficiently effective to be continued or replicated. Questions asked include: Did the programme work? Did it attain its goals? Should the programme be continued or ended? Were desired client outcomes achieved? Improvement-orientated evaluation Improvement-orientated forms of evaluation include formative evaluation, quality enhance-ment and responsive evaluation, among others. These approaches gather varieties of data about strengths and weaknesses, with the expectation that both will be found and each can be used to inform an ongoing cycle of reflection and innovation. According to Patton (1997, p. 68), improvement-orientated evaluations ask: What are the programme’s strengths and weaknesses? To what extent are participants progressing towards the desired out-comes? Which types of participants are making good progress and which types are not doing so well? What kinds of implementation problems have emerged and how are they being addressed? What is happening that was not expected? How is the programme’s external environment affecting internal operations? What new ideas are emerging that can be tried out and tested? Knowledge-orientated evaluation The evaluation findings contribute to knowledge and may involve: clarifying a programme’s model; testing theory; distinguishing types of interventions; determining how to measure outcomes; generating lessons learnt; and/or elaborating policy options. This is sometimes described as ‘enlightenment’, where the evaluation findings broaden the knowledge base. 128 Community Healing: A training manual for Zimbabwe

Select target paragraph3

Add to table of contents