What to Measure and Why: Kanban Metrics
You might have heard the saying “what gets measured gets managed”. Monitoring progress and measuring performance is a key component of the Kanban Method – both for tracking your project and making your process more efficient over time.
Here we will explain the specific Kanban metrics & analytics that you should be using to monitor your team performance and your process efficiency and delivery times, as well as the red flags to watch for that signal trouble ahead.
Cycle time is a key metric in Kanban and it measures how much time a task spends going through your process. Cycle time differs from lead time in that it is only measured from when your team starts working on the task.
Cycle time, then, is the metric that directly measures how long it takes your team to deliver a task. Low cycle times means your team is working efficiently, high cycle times indicate that something is stalling your process. Keeping your cycle times down keeps your lead times down, and leads to high customer satisfaction.
You can see how your cycle times evolve over time using a cycle time histogram and use them to predict future work delivery times. In the plot above we can see from the percentile lines that once your team starts working on a task, it has a 50% chance of being completed in less than 7 days and a 95% chance of being completed within 45 days.
Whereas cycle time measures how long it takes an individual task to go through your process, the throughput metric in Kanban measures the total amount of work delivered in a certain time period. Throughput only measures completed work items – nothing that is still in progress gets counted.
The reason throughput is a key Kanban metric is that it can be used to measure your capacity to deliver results. Consider a Kanban team whose throughput for each of the past 5 weeks was 3, 7, 4, 5, and 6, giving an average throughput of 5 tasks per week. Without knowing anything about the tasks themselves, we can say that this team can deliver approximately the same amount of work – 5 tasks – every week.
Throughput over time is used to track your team performance and is measured using the throughput histogram. This maps how frequently your team achieves a certain throughput over a period of time. From the chart below, we can see this team has a median output of 4 items per day over this month.
By tracking your throughput over time, you can directly see how your team’s overall performance is changing. Ideally, throughput should stay the same or increase – a decreasing throughput indicates that something is negatively affecting your team’s ability to deliver and needs additional attention.
Work In Progress
A key component of the Kanban Method is limiting Work In Progress (WIP) to improve your team’s efficiency. Think about it – do you get work faster when you split your attention between many tasks, or when you choose one to focus on?
The optimum WIP limit for your team will depend on several factors such as the size of your team, however a good place to start is setting the limit at around the number of people in your team – this way, everyone can focus on one task at a time.
The two Kanban metrics that best measure your team performance are cycle times (how fast work gets done) and throughput (how much work is delivered). These metrics are the ones to watch to make sure you are delivering results to your customers!
Cycle time, throughput, and WIP are connected by Little’s Law. This formula applies to any system which meets Little’s Law assumptions.
Cycle Time = WIP/Throughput
Little’s Law shows the relationship between the three basic flow metrics, and that changing one will have an effect on the other two. For example, for a reduction in cycle time, WIP must decrease.
Short cycle times and high levels of throughput are signs of good team performance, but another thing to look out for is consistency. From the cycle time histogram and throughput histogram, you can not only see the average value of your Kanban metrics but also how this data is distributed over a period of time. When your values are spread over a smaller range, your future predictions are naturally more accurate.
Cumulative Flow Diagram
The Kanban Method primarily deals with incremental evolutionary improvements. It is most powerful when applied over longer periods of time. We’ve already discussed how cycle time and throughput are tracked over time, however, the real star for examining process efficiency on a longer timescale is the cumulative flow diagram.
The cumulative flow diagram shows the distribution of tasks in each of the process states, accumulating over time. Each colored band indicates how many tasks are present in each state of the process at a given time. Approximate average cycle time can be calculated straight from the diagram, but the real benefit of the CFD is how quickly you can get a visual assessment of the stability of your process.
Changes in your team performance can be seen at a glance from how the gradients of the bands change over time. An increase in gradient for the “Done” band means your team is delivering work faster. On the other hand, a sharp increase in the gradient of the “In Progress” band indicates a bottleneck is beginning to develop.
The biggest red flag that your performance is about to suffer is the bottleneck – increasing work that is not being completed. The bottleneck signals that your team does not have the resource capacity to handle the amount of work assigned to them in a timely manner.
Using Kanban metrics you can spot bottlenecks as they occur: signs to watch out for increasing cycle times, decreasing throughput, and sharp increase in gradient in your cumulative flow diagram.
When you begin to see signs of a bottleneck, it’s time to take a close look at why this could be occurring – is an external requirement causing items to get stalled? Has your work in progress limit crept up without you realizing it? Do changes in the roles of your team mean tasks should be assigned differently? By taking action quickly, you should be able to eliminate bottlenecks before they become a problem.
What Kanban metrics & analytics do you use to track your team performance? What was the most important insight you learned from your data and how did you act on it? Tell us about your experience in the comments!
Meet the Author
Sonya Siderova is a passionate product manager and a driving force behind Nave, a Kanban analytics suite that helps teams improve their delivery speed through data-driven decision making. When she's not catering to her two little ones, you might find Sonya absorbed in a good heavyweight boxing match or behind a screen crafting a new blog post.
Take your training and consultancy sessions to a whole new level. With Kanban analytics on their existing tools, yo… https://t.co/4G3X9FehF5Follow
Learn how to make accurate, data-driven predictions to stay on track, meet deadlines and keep a high level of custo… https://t.co/zPBlWxv5X7Follow
The Flow Efficiency Chart shows your average flow efficiency, as well as how trends have been moving over time. Ide… https://t.co/Eff9ITFFnrFollow
Learn more about the difference between thin-tailed and fat-tailed distributions and the approaches to evaluate you… https://t.co/oHCaDCa4WXFollow
Last chance to get 60% off! We list our Sustainable Predictability digital course at the lowest price ever! The off… https://t.co/Af5U0kiBIEFollow
Get straight to the essence of your Azure board data and analyze your processes with our immersive data-visualizati… https://t.co/MpB4kgNiCeFollow
Kanban can help you run your business better, make your processes more efficient and empower your team to accomplis… https://t.co/RwXHnb4UcEFollow
A Cycle Time Histogram with a big hump on the left and a very long tail to the right indicates that your cycle time… https://t.co/mFKXLpx4HhFollow
Service level agreements define the responsibilities of a service provider to their customers. Defining SLAs are im… https://t.co/s7HeXDvfkWFollow
Today, we’ll explore the consequences of moving cards backward has on your performance, as well as the most effecti… https://t.co/IZmafKMe9YFollow
Value stream mapping is a visual technique that depicts the lifecycle of your product and finds and eliminates wast… https://t.co/fyJZvdPVCxFollow
Our digital course Sustainable Predictability is listed for $397 until Nov 30th. Take advantage of the 60% discount… https://t.co/8bBbiaWPa3Follow
Start making reliable decisions and eliminating the bottlenecks caused by unclear priorities with a dynamic priorit… https://t.co/hVpa8sCtR9Follow
Take your team to a whole new level with Nave's Kanban analytics for Trello. Picture what's going on behind your da… https://t.co/BhnrABnsPBFollow
In our latest article, we’ll take you through the key steps to reducing the impact that blockers have on your deliv… https://t.co/10L6MoruB4Follow
30% discount on all annual plans until the 30th November! Subscribe now with a coupon code NAVEBLACK20… https://t.co/dnSM2KzS5cFollow
The dotted horizontal lines on the Cycle Time Scatterplot are called percentiles. We use percentiles to define the… https://t.co/nlUcIGRDm3Follow
High pressure over long time periods leads to your team suffering from burnout and its symptoms. Learn more about w… https://t.co/hcYg29OE3YFollow
Successful project managers are effective leaders whose decisions will drive a business forward. Here are the top 5… https://t.co/gDVZffzmDbFollow