Category Archives: Community programs

Friday Funny – community engagement and evidence-based policy

Policy that is developed in response to clearly identified needs and through careful processes of community engagement – while being feasible in an adversarial political system and short timeframes?  Time for the Hollowmen to show us how it can be … Continue reading

Posted in Adequate scope, Appropriate criteria and standards, Appropriate reporting, Civil society engagement, Community programs, Friday Funnies, Government programs, Professional development, Synthesis of findings, Uncategorized | Leave a comment

The importance of values for substantiating evaluative conclusions

The comments shared in response to the earlier post, Culturally Competent Needs Assessment By An “Outsider” raise issues that are critical to the discipline of evaluation. Two things come to mind; a) reflections on how we define evaluation theory, and … Continue reading

Posted in Appropriate criteria and standards, Community programs, Cultural context, Development, Evaluation Theory, Values-based | Tagged , , , , | 3 Comments

Credibility and independence in evaluation – an alternative view

Standard ‘mainstream’ belief is that one element of credibility as an evaluator comes from one’s independence and the perceived objectivity (lack of bias) that derives from that. Here in Aotearoa New Zealand, we often find the opposite is the case: … Continue reading

Posted in Community programs, Cultural context | Tagged , , , , , | 1 Comment

How to spot a ‘lip service’ approach to culturally responsive evaluation (a checklist for evaluation clients)

So you’ve put out an RFP for an evaluation of a policy, program or initiative intended to serve and effect positive change in a “minority” community. All the proposals look terribly impressive, and they all include “cultural experts” on the evaluation team. How can you distinguish the proposals that show a clear understanding of what it takes to do effective and culturally responsive evaluations from those that merely pay ‘lip service’ to cultural competence? Continue reading

Posted in Appropriate criteria and standards, Appropriate inference, Appropriate reporting, Community programs, Cultural context, Evaluation team composition, Evaluative questions & answers, The client's role | Tagged , , , , , , , , , | 8 Comments

What constitutes “evidence”? Implications for cutting-edge, tailored treatments, and small sub-populations

In the medical profession in particular, there are some very rigid beliefs about what constitutes good enough “evidence of effectiveness” to justify offering, recommending, allowing patients to try, or even just not vehemently opposing a particular type of treatment for a patient.

There are some glimmers of hope in other sectors (e.g. in the Best Evidence Synthesis work here in New Zealand). But there are still three areas where there are very serious challenges in building a credible evidence base given the kinds of constraints and realities surrounding them. They are: (1) cutting-edge treatments; (2) treatments that are by their very nature tailored/individualized rather than standardized across patients or populations; and (3) learning what works for small sub-populations Continue reading

Posted in Causal inference, Community programs, Development, Education, Government programs, Health, Strategic policy evaluation | Tagged , , , , , , , , , , | 12 Comments