Don’t expect quantitative evidence to answer a qualitative evaluation question

Tweet

A while back I authored a post called Breaking out of the Likert scale trap in which I suggested that, for evaluation work, we might consider transforming more descriptive survey items like this one …

To what extent do you agree or disagree with the following:

strongly disagree

disagree neutral

Read the whole post –> Don’t expect quantitative evidence to answer a qualitative evaluation question

Boxers or briefs? Why having a favorite response scale makes no sense

Tweet To what extent do you agree or disagree with the following?

“Boxers are more comfortable than briefs”

Strongly Agree … [insert favorite response scale length/format] … Strongly Disagree

(pics on Sodahead)

Time after time I see debates about whether response scales should have an even or odd number of

Read the whole post –> Boxers or briefs? Why having a favorite response scale makes no sense

Building causation into survey items about outcomes

Tweet

Earlier this week I posted about the uninterpretability of the standard Likert scale that asks people to agree or disagree with a statement. I suggested a more evaluative scale that is more interpretable, particularly for survey items that go after process evaluation.

Now, let’s look at survey items for outcome evaluation and a few

Read the whole post –> Building causation into survey items about outcomes

Breaking out of the Likert scale trap

Tweet

A recent conversation with a colleague has reminded me of how traditional social science training has managed to hardwire our brains into some default thinking that needs to be questioned.

Obviously, there are a lot of places one could go with this as an opening statement, but for now, let’s look at the design

Read the whole post –> Breaking out of the Likert scale trap