Shelfari: Book reviews on your book blog

Credibility and independence in evaluation - an alternative view

Standard ‘mainstream’ belief is that one element of credibility as an evaluator comes from one’s independence and the perceived objectivity (lack of bias) that derives from that.

Here in Aotearoa New Zealand, we often find the opposite is the case: one’s credibility with the community and the provider – and with funder and external audiences who

Read the whole post –> Credibility and independence in evaluation – an alternative view

Valuing cultural expertise - in $$ terms

Are high caliber evaluators with outstanding cultural expertise undercharging for their services? Some comments about pricing culturally competent evaluation services in ways that fairly recognize – and help shape perceptions of – their true value.

Read the whole post –> Valuing cultural expertise – in $$ terms

How to spot a 'lip service' approach to culturally responsive evaluation

So you’ve put out an RFP for an evaluation of a policy, program or initiative intended to serve and effect positive change in a “minority” community. All the proposals look terribly impressive, and they all include “cultural experts” on the evaluation team. How can you distinguish the proposals that show a clear understanding of what it takes to do effective and culturally responsive evaluations from those that merely pay ‘lip service’ to cultural competence?

Read the whole post –> How to spot a ‘lip service’ approach to culturally responsive evaluation (a checklist for evaluation commissioners)

A 'program logic' for including 'outsiders' in evaluation teams

Suppose you are an evaluator looking to put together a team of colleagues to bid on an evaluation of a program that primarily or exclusively targets members of your own ‘culture’ (ethnicity, gender, sexual orientation, life/health/social history, profession or disciplinary roots, etc – yes, everyone is a member of several ‘cultures’).

What are the various reasons for including outsiders (people from outside that culture) on your evaluation team? What is the implicit “problem” or “challenge” you would be responding to with that rationale? In what roles would outsiders be involved? How would that influence your evaluation ‘product’ (the services and the report delivered?

Read the whole post –> A ‘program logic’ for including ‘outsiders’ in evaluation teams

Friday Funny - Reconciling insider views and hard evidence

The satirical blog “HR International” provides a wincing description of how not to include insiders in planning and evaluation processes:

… it was proposed that HRI will develop a radio spot, to go with the acclaimed “edutainment” program already implemented by one of our implementing partners.

Tengetile the displaced woman said that she knows nobody in the

Read the whole post –> Friday funny – reconciling insider views and hard evidence

A fleshed out 'program logic' for why and where 'insiders' are included in evaluation

**Revised and updated, March 4th** Here’s an elaborated version of the table presented in our earlier post that discussed the implicit reasons for creating evaluation teams with cultural (and other) ‘insiders’ in different proportions and in different roles. The table is presented in four columns:
* Implicit “Problem” or “Challenge” Addressed
* Insider Inclusion Rationale
* Likely Practice Implication (How ‘Insiders’ Are Involved)
* Likely Evaluation ‘Product’

Read the whole post –> A fleshed out ‘program logic’ for why and where ‘insiders’ are included in evaluation

The insider/outsider mix: A 'program logic' for evaluation team composition?

What are some of the different rationales for building an evaluation team that includes cultural ‘insiders’? And, what implications do those rationales have for what roles cultural (and other) ‘insiders’ play in an evaluation? In this joint post from Patricia Rogers and Jane Davidson, we ponder these questions as a discussion starter.

Read the whole post –> The insider/outsider mix: A ‘program logic’ for evaluation team composition

Culture - insiders' and outsiders' insights - and genuine evaluation

One great area of interest for me is the study of organizational culture and organizational culture change. I’d like to present a few ideas from that area and see how they apply to the concept of culture more generally. And, how these insights might be able to drive us closer to genuine evaluation. What mix of ‘insiders’ and ‘outsiders’ can provide rich insights into what really matters and help surface important undiscussables?

Read the whole post –> Culture – insiders’ and outsiders’ insights – and genuine evaluation

Working across the cultural divide in evaluation

Working across the cultural divide in evaluation: What are the roles, challenges, and benefits for evaluators working in diverse cultural contexts and settings?

Read the whole post –> Working across the cultural divide in evaluation: roles, challenges and benefits