The charts we look at will only be as good as the data that went into them, even though our own cognitive biases will lead us to believe otherwise.
It’s critical that we understand how good the data is, before we use it to make decisions. At the top of every report, we have a “Data Quality” section and in that, we list those things that we think are important to note.
What do we check for?
- Items that were moved “back to the backlog” after being started. This is a poor practice and yet almost every team does it.
- Items for which we know when they completed but can’t tell when they started. This usually means items moving directly from ToDo to Done.
- Items that continued to have status changes after they were identified as having completed. Likely what we’re considering ‘done’ isn’t really done.
- Items that moved backwards on the board. Almost always a poor practice.
- Items that are in progress but for whatever reason, are not visible on the board.
- Items that are considered ‘done’ before they even started.
- Items that are considered to not have started, yet some of their subtasks have started. Almost certainly a mistake.
- Items that have been declared as done but which still have active subtasks.
- Items that show up on multiple boards and that are likely being included in multiple sets of metrics