A general question about managing data analysis projects.
What questions do you ask the requester?
Those questions are just a stab in the dark.
What questions do you ask when taking on a data analysis project? I ask because I'm moving to a new team and am looking to develop some techniques for success to avoid the usual pitfalls of data analysis projects.
give them what they need, this may not what they are asking for
show us what you are asking for
who is going to maintain it, how often?
is it private, internal, public?
do you have Department Head approval before doing the work?
What other data is needed to get the final product?
Not analysis related, but this bit me pretty bad the other week: What size do you need the final layout to be?
You might consider it from a metadata standpoint as in have the requester supply a (preliminary) Summary, Description, (credits), Use Limitations, etc., for whatever product they are requesting.
Here are my updated questions:
Notes from a colleague:
#4 and 7 both sort of cover this but it's critical to ask if the data exists, how reliable is it? In Work Order Management software terms, failure analysis is pretty popular right now. Everyone wants to say they can help predict future failures. But the number of organizations that aren't even capturing failure data or are capturing it in free form fields (like long descriptions) where the same problem can be reported dozens of different ways by different people makes it really difficult. Even when the data is structured, such as using problem/cause/remedy, most companies don't have all the possible options. Things constantly end up in the wrong bucket because the fields are required but the correct option doesn't exist in the eyes of the technician. Even if you have the data, you can't necessarily get anything valuable out of it.
Most analysis requests come from managers/executives that don't really understand the problem trying to be solved. You need the people that are capturing the data to explain how they capture it and the challenges they have with capturing it reliably.
#5 the first question "why are we doing this" and the follow up question (in my eyes, don't see it here) is "what are we going to do with this" is extremely critical to me. Managers love KPIs because it gives a way to measure the team against some desired outcome. For example, if you want to focus on quality, you will set objectives for number of defects. If you want to focus on customer service, you'll set objectives for time to resolution for example. Neither of these are inherently bad.
But you have to be careful. KPIs often lead to undesirable outcomes, especially if people (managers and/or employees) are incentivized by the KPI. In software, if you measure teams on the number of bugs, genuine issues with the product are "working as designed". Customer service will close cases as soon as they respond even if the issue isn't resolved from the customer perspective. You essentially change the behavior of employees to meet the KPI but at the end of the day, your customer (internal or external) isn't benefitting from the changes.
Then in 6 months when customer satisfaction is down, the KPIs are changed to try and achieve that objective. And the cycle continues on and on.