-
Recent Posts
- Evaluation of marketing – grappling with the important but hard to measure outcomes
- The Friday Funny: A surrealistic mega-analysis of redisorganization theories
- Getting the facts straight on youth unemployment rates
- The Friday Funny: Negotiating the budget
- The Friday Funny: Evaluation and content expertise
Recent Comments
- Michael Scriven on Evaluation of marketing – grappling with the important but hard to measure outcomes
- Kathleen Lynch on The Friday Funny: Negotiating the budget
- Heather Nunns on Friday Funny – 10 ways of knowing you’ve been an evaluator too long
- Tarina MacDonald on 9 golden rules for commissioning a waste-of-money evaluation
- Tarina MacDonald on Valuing cultural expertise – in $$ terms
Archives
Category Archives: Education
Pushing sand uphill with a pointy stick? ‘No value-free’ in higher ed evaluation
There’s a unique and extremely challenging barrier to singing the ‘no value-free’ parts of the genuine evaluation song in a higher education (a.k.a. tertiary education) setting. And that’s what Michael Scriven calls the value-free doctrine. Last week I delivered the … Continue reading
Posted in Education, Values-based
Tagged higher education, self-assessment, value-free, valuephobia, values
9 Comments
Punished for productivity – poor use of an average in performance evaluation
Developing good performance indicators is not easy. The history of their use is littered with examples of how they can produce a distorted picture of performance and provide dysfunctional incentives. Burt Perrin’s report to the OECD (Organization for Economic Co-operation … Continue reading
Oxford admissions essay: “simple, yet devilish” … An evaluation aptitude test?
Many thanks to Michael Quinn Patton for sending us through this gem (from the New York Times) about a rather interesting essay exam for selecting graduate students into All Souls College in Oxford, England. Continue reading
Posted in Education, Personnel evaluation
Tagged Personnel evaluation, predictive validity, student assessment, UK
2 Comments
What constitutes “evidence”? Implications for cutting-edge, tailored treatments, and small sub-populations
In the medical profession in particular, there are some very rigid beliefs about what constitutes good enough “evidence of effectiveness” to justify offering, recommending, allowing patients to try, or even just not vehemently opposing a particular type of treatment for a patient.
There are some glimmers of hope in other sectors (e.g. in the Best Evidence Synthesis work here in New Zealand). But there are still three areas where there are very serious challenges in building a credible evidence base given the kinds of constraints and realities surrounding them. They are: (1) cutting-edge treatments; (2) treatments that are by their very nature tailored/individualized rather than standardized across patients or populations; and (3) learning what works for small sub-populations Continue reading
Bad faith survey
Over-sampling of particular population strata, and subsequent reweighting of the responses to match the population, might be appropriate sometimes, but not when it involves gathering and then discarding data about a politically contentious and high cost program.
Posted in Appropriate reporting, Education, Learning from failure, Uncategorized
Tagged audit, GFC, sampling
3 Comments
Jane at Real Evaluation
Patricia at CIRCLE (RMIT)