What to Measure and Why: Kanban Metrics
You might have heard the saying “what gets measured gets managed”. Monitoring progress and measuring performance is a key component of the Kanban Method – both for tracking your project and making your process more efficient over time.
Here we will explain the specific Kanban metrics & analytics that you should be using to monitor your team performance and your process efficiency and delivery times, as well as the red flags to watch for that signal trouble ahead.
Cycle time is a key metric in Kanban and it measures how much time a task spends going through your process. Cycle time differs from lead time in that it is only measured from when your team starts working on the task.
Cycle time, then, is the metric that directly measures how long it takes your team to deliver a task. Low cycle times means your team is working efficiently, high cycle times indicate that something is stalling your process. Keeping your cycle times down keeps your lead times down, and leads to high customer satisfaction.
You can see how your cycle times evolve over time using a cycle time histogram and use them to predict future work delivery times. In the plot above we can see from the percentile lines that once your team starts working on a task, it has a 50% chance of being completed in less than 7 days and a 95% chance of being completed within 45 days.
Whereas cycle time measures how long it takes an individual task to go through your process, the throughput metric in Kanban measures the total amount of work delivered in a certain time period. Throughput only measures completed work items – nothing that is still in progress gets counted.
The reason throughput is a key Kanban metric is that it can be used to measure your capacity to deliver results. Consider a Kanban team whose throughput for each of the past 5 weeks was 3, 7, 4, 5, and 6, giving an average throughput of 5 tasks per week. Without knowing anything about the tasks themselves, we can say that this team can deliver approximately the same amount of work – 5 tasks – every week.
Throughput over time is used to track your team performance and is measured using the throughput histogram. This maps how frequently your team achieves a certain throughput over a period of time. From the chart below, we can see this team has a median output of 4 items per day over this month.
By tracking your throughput over time, you can directly see how your team’s overall performance is changing. Ideally, throughput should stay the same or increase – a decreasing throughput indicates that something is negatively affecting your team’s ability to deliver and needs additional attention.
Work In Progress
A key component of the Kanban Method is limiting Work In Progress (WIP) to improve your team’s efficiency. Think about it – do you get work faster when you split your attention between many tasks, or when you choose one to focus on?
The optimum WIP limit for your team will depend on several factors such as the size of your team, however a good place to start is setting the limit at around the number of people in your team – this way, everyone can focus on one task at a time.
The two Kanban metrics that best measure your team performance are cycle times (how fast work gets done) and throughput (how much work is delivered). These metrics are the ones to watch to make sure you are delivering results to your customers!
Cycle time, throughput, and WIP are connected by Little’s Law. This formula applies to any system which meets Little’s Law assumptions.
Cycle Time = WIP/Throughput
Little’s Law shows the relationship between the three basic flow metrics, and that changing one will have an effect on the other two. For example, for a reduction in cycle time, WIP must decrease.
Short cycle times and high levels of throughput are signs of good team performance, but another thing to look out for is consistency. From the cycle time histogram and throughput histogram, you can not only see the average value of your Kanban metrics but also how this data is distributed over a period of time. When your values are spread over a smaller range, your future predictions are naturally more accurate.
Cumulative Flow Diagram
The Kanban Method primarily deals with incremental evolutionary improvements. It is most powerful when applied over longer periods of time. We’ve already discussed how cycle time and throughput are tracked over time, however, the real star for examining process efficiency on a longer timescale is the cumulative flow diagram.
The cumulative flow diagram shows the distribution of tasks in each of the process states, accumulating over time. Each colored band indicates how many tasks are present in each state of the process at a given time. Approximate average cycle time can be calculated straight from the diagram, but the real benefit of the CFD is how quickly you can get a visual assessment of the stability of your process.
Changes in your team performance can be seen at a glance from how the gradients of the bands change over time. An increase in gradient for the “Done” band means your team is delivering work faster. On the other hand, a sharp increase in the gradient of the “In Progress” band indicates a bottleneck is beginning to develop.
The biggest red flag that your performance is about to suffer is the bottleneck – increasing work that is not being completed. The bottleneck signals that your team does not have the resource capacity to handle the amount of work assigned to them in a timely manner.
Using Kanban metrics you can spot bottlenecks as they occur: signs to watch out for increasing cycle times, decreasing throughput, and sharp increase in gradient in your cumulative flow diagram.
When you begin to see signs of a bottleneck, it’s time to take a close look at why this could be occurring – is an external requirement causing items to get stalled? Has your work in progress limit crept up without you realizing it? Do changes in the roles of your team mean tasks should be assigned differently? By taking action quickly, you should be able to eliminate bottlenecks before they become a problem.
What Kanban metrics & analytics do you use to track your team performance? What was the most important insight you learned from your data and how did you act on it? Tell us about your experience in the comments!
Meet the Author
Sonya Siderova is a passionate product manager and a driving force behind Nave, a Kanban analytics suite that helps teams improve their delivery speed through data-driven decision making. When she's not catering to her two little ones, you might find Sonya absorbed in a good heavyweight boxing match or behind a screen crafting a new blog post.
Take your training and consultancy sessions to a whole new level. With Kanban analytics on their existing tools, yo… https://t.co/cFCxoaUeJNFollow
How organizations can be successful in their pursuit of agility by leading with purpose, creating customer-centric… https://t.co/5sHBveVpmjFollow
A chain is as strong as its weakest link and a process is limited by its slowest step – its constraint. The Theory… https://t.co/ub5OtCXWijFollow
A Cycle Time Histogram with a big hump on the left and a very long tail to the right indicates that your cycle time… https://t.co/qVnh8bTFZmFollow
Identifying services and achieving flow of information are the keys to scaling across an enterprise. Learn more abo… https://t.co/EFFDbNjV9JFollow
Businesses with higher levels of team motivation perform better for a simple reason: they appreciate their employee… https://t.co/VnkDTJAIF9Follow
Immersive charts for your Jira projects. Get more done, faster, with Nave analytics on Jira. Start your free 14-day… https://t.co/cyZhw9wQw8Follow
Learn how to efficiently manage blocked work in Kanban to drive evolutionary change and deliver work in a quicker,… https://t.co/NINEr9yPZxFollow
Rely on data, not instincts. Nave Power-Up for Trello builds immersive analytical charts over your Trello boards. T… https://t.co/AfHkWytZeBFollow
High flow efficiency is vital to sustaining a scalable, productive business. Learn how you can calculate, analyze a… https://t.co/TjXc2yOgqvFollow
Follow this guide to quickly and easily set up Nave in Jira. We've broken down the process in three simple steps so… https://t.co/6RsMGcCUFFFollow
Product teams often argue which is better, but the focus should be on how to merge Kanban and Scrum together to del… https://t.co/lVOh9ARV7jFollow
Get straight to the essence of your Azure board data and analyze your processes with our immersive data-visualizati… https://t.co/wzeM5fv1UTFollow
Optimizing workflow efficiency is often at the forefront of project managers’ minds, but eliminating individual's i… https://t.co/QqQ6lcK9dkFollow
Yesterday's webinar was a great success. It was such a pleasure to have so many people passionate about making reli… https://t.co/4hszHx1h5hFollow
Rely on data to build better software. Your Jira project, visualised across enhanced Kanban analytics. Try out our… https://t.co/oc8pksGwkTFollow
Improve your business' performance while working remotely with Kanban. Presented by SquirrelNorth along with guests… https://t.co/FvuqFHClcHFollow
Learn how to make accurate, data-driven estimation to stay on track, meet deadlines and keep a high level of custom… https://t.co/MHXZoGOVY1Follow