Customer Satisfaction Surveys
Another great podcast by Church of the Customer - April 26, 2005. As usual it got me thinking. This time about how companies, specifically individuals within companies use their customer satisfaction survey data.
How often do departments create and/or modify questions that are geared towards getting the highest possible score? Is this done maliciously, or is it done in part by a desire to celebrate the things that are working? What is influencing the operational improvements - the questions or the findings?
I also wonder if the bombardment of the customer satisfaction advertisements (i.e. "JD Power & Associates say we do this better than anyone else...") we hear and see impact our thinking about what we want to hear from our customers? Are companies seeking endorsements or valuable intelligence? Or more dangerously, are they trying influence survey results for their marketing efforts?
One thing for sure is that most customer satisfaction surveys don't always connect in meaning to the customer (i.e. Does ACME company treat you with respect?). If you can't relate to the word respect in this question as a customer, the question becomes meaningless. Now imagine the effort and energy applied to improving and/or changing the variables in the company around meaningless findings...
Jackie and Ben mocked an survey interview playing roles with a company they currently do business with. Below is the question/answer response in summary:
How satisfied are you with ACME? / I don't understand the question
How likely are you to continue to repurchase from ACME? / likely
How likely are you recommend ACME? / depends, depends on the need of the person
Would you say ACME is a name you can trust? / I think so
Do you think ACME always delivers on what they promise / I think so
ACME always treats me fairly / I don't understand the question - compared to what? - if they didn't treat me fairly I wouldn't be a customer
If a probably arises, I can always count on ACME to reach a fair & satisfactory resolution / I think so
I feel proud to be an ACME customer / not really
ACME always treats me with respect / I am not sure what that means - what does it mean to me?
ACME is the perfect company like me / I am not sure what that means - I don't know other people like me that fit into this category
I cannot imagine a world without ACME / Yes, I can - other options are available
While I am not a survey expert by any means, I do see abuse often with satisfaction programs, and more often than not confusion about what to do with the findings. Probably because of the confusing findings based upon questions that are meaningless to customers - do you see how cyclical this is? I strongly encourage you to try this with a company you purchase goods or services from on a regular basis.
The Gallup CE11 questionnaire they referenced appears flawed because the definitions are too broad. So, what is the best way to measure these emotional intentions? Ben's suggestion is to use recommendation as the key indicator (yes, no, maybe), and then drill down from there.
How often do departments create and/or modify questions that are geared towards getting the highest possible score? Is this done maliciously, or is it done in part by a desire to celebrate the things that are working? What is influencing the operational improvements - the questions or the findings?
I also wonder if the bombardment of the customer satisfaction advertisements (i.e. "JD Power & Associates say we do this better than anyone else...") we hear and see impact our thinking about what we want to hear from our customers? Are companies seeking endorsements or valuable intelligence? Or more dangerously, are they trying influence survey results for their marketing efforts?
One thing for sure is that most customer satisfaction surveys don't always connect in meaning to the customer (i.e. Does ACME company treat you with respect?). If you can't relate to the word respect in this question as a customer, the question becomes meaningless. Now imagine the effort and energy applied to improving and/or changing the variables in the company around meaningless findings...
Jackie and Ben mocked an survey interview playing roles with a company they currently do business with. Below is the question/answer response in summary:
How satisfied are you with ACME? / I don't understand the question
How likely are you to continue to repurchase from ACME? / likely
How likely are you recommend ACME? / depends, depends on the need of the person
Would you say ACME is a name you can trust? / I think so
Do you think ACME always delivers on what they promise / I think so
ACME always treats me fairly / I don't understand the question - compared to what? - if they didn't treat me fairly I wouldn't be a customer
If a probably arises, I can always count on ACME to reach a fair & satisfactory resolution / I think so
I feel proud to be an ACME customer / not really
ACME always treats me with respect / I am not sure what that means - what does it mean to me?
ACME is the perfect company like me / I am not sure what that means - I don't know other people like me that fit into this category
I cannot imagine a world without ACME / Yes, I can - other options are available
While I am not a survey expert by any means, I do see abuse often with satisfaction programs, and more often than not confusion about what to do with the findings. Probably because of the confusing findings based upon questions that are meaningless to customers - do you see how cyclical this is? I strongly encourage you to try this with a company you purchase goods or services from on a regular basis.
The Gallup CE11 questionnaire they referenced appears flawed because the definitions are too broad. So, what is the best way to measure these emotional intentions? Ben's suggestion is to use recommendation as the key indicator (yes, no, maybe), and then drill down from there.
