Effective Forecasting: Estimation in Kanban
When it comes to project management, the big question is always “How long will this take?”. From single work items to entire projects, making accurate delivery forecasts maintains a high level of customer trust and satisfaction.
In the Agile community, there are many different opinions about how often estimation should be performed and how detailed an estimate should be. Some teams prefer not to estimate at all – time spent making estimates is time that could have been spent creating more value. Others prefer to set direction using Kanban roadmaps, while leaving the details to be worked out day-by-day. Nevertheless, when you are bound by fixed deadlines and release dates, a certain level of estimation is necessary to keep things running smoothly.
Estimates are by definition not exact and affected by multiple risk factors. The Kanban method suggests data-driven, probability-based future predictions using only historical performance records. Learn how to use these scientifically proven methods to make accurate Kanban estimates.
Estimating for single tasks: Cycle time scatterplot
Cycle time measures how long it takes for a task to be completed once it has been pulled into the workflow. The cycle time scatterplot shows the cycle times for all tasks completed during a certain timeframe.
By looking at how fast tasks have been completed in the past, you can make predictions about your future performance. The cycle time scatterplot can be used to give both an estimated time of a single task completion and the probability of that commitment being met.
The horizontal percentile lines crossing the scatterplot indicate how many tasks are completed within a certain cycle time. A scatterplot with the 85th percentile line crossing the 37 day mark means 85% of tasks were completed within 37 days or less. This means that this team can communicate to the client that any item pulled into the workflow has an 85% chance of being completed within this timeframe.
One great advantage of the cycle time scatterplot is that you can estimate cycle time for any type of task. No matter your team or task size, these Kanban estimates can be used to set service level agreements with your customers.
Estimating for projects: Monte Carlo simulation
Monte Carlo simulations use historical data to model the probability of different outcomes. They can be used for almost any process and are especially useful in processes where unpredictability is high due to risk, uncertainty or multiple random variables being in play.
In Kanban, Monte Carlo simulation uses past throughput data to estimate future throughput. The simulation is run many times using a range of possible values for uncertain variables. This means that rather than spitting out a single number, Monte Carlo simulations show a probability distribution. The central peak indicates the most likely throughput outcome, with the most optimistic and conservative outcome shown by the tails.
Monte Carlo simulations are a popular forecasting tool used across several project management methodologies. They are regarded as the most accurate and realistic way of showing the likelihood of different outcomes in Kanban processes.
How not to estimate in Kanban
Kanban tracks many different metrics and uses several different tools for analysis. It’s important to keep in mind which tools are for looking ahead and which are for looking back. Using the wrong method for Kanban estimation will give you inaccurate results.
WIP = Throughput * Cycle Time
In a stable system which does not violate the Little’s Law assumptions, this relationship remains valid no matter the type of work or size of task. However, the formula cannot be used to make accurate future predictions.
Little’s Law tells us that to reduce cycle time, either throughput must increase or WIP must decrease. However, this does not mean that halving WIP will also halve your cycle time! It only means that the relationship will balance. A change to WIP will cause cycle time or throughput or both to change to maintain the relationship.
This makes Little’s Law an unsuitable method for estimation in two ways. First, Little’s Law is based on averages, which should not be used for forecasting. Second, there is no way to know the exact way changing one variable will affect the other two. Nevertheless, the more closely your process follows the Little’s Law assumptions, the more predictable and stable it will be.
WE UNCOVER THE EFFICIENCY OF YOUR WORKFLOW
Optimise your performance with Kanban analyticsExplore Your Data Now
Cumulative Flow Diagram Projections
The cumulative flow diagram is a powerful tool for analysing your process efficiency. Learning its common patterns helps you to identify bottlenecks and stop them before they grow bigger. However, the CFD should be used for analysing your past performance instead of estimating the future. Again, CFD will give an estimate based on averages and forecasts should never be made based on an average.
While it is tempting to try and forecast using the CFD, this is an inaccurate method and it is not recommended. A Monte Carlo simulation makes far better predictions as it takes into account the probability distribution of different outcomes. We highly recommend sticking to Monte Carlo simulations for large-scale estimation in Kanban.
In any process with multiple variables, relying on “single point” estimates for likely delivery times is simply inaccurate. Kanban estimates give both timeframes and probabilities, keeping customers informed of the range of different possible outcomes. Using these data-driven probabilistic methods keeps estimates reliable and eliminates guesswork.
Are you using Kanban estimates? Are they more accurate than your old methods of estimating? Tell us about your experience in the comments!
Meet the Author
Sonya Siderova is a passionate product manager and a driving force behind Nave, a Kanban analytics suite that helps teams become more efficient through data-driven decision making. When she's not catering to her two little ones, you might find Sonya absorbed in a good heavyweight boxing match or behind a screen crafting a new blog post.
Learn more about the experience of changing an organization with 130 years of history and more than 2,000 employees… https://t.co/HhqjlfVEwzFollow
"Nave’s powerful data-visualization toolkit helps you optimize your flow and take your team to a whole new level. T… https://t.co/znpofG06htFollow
Take your training and consultancy sessions to a whole new level. With Kanban analytics on their existing tools, yo… https://t.co/8iNe3zZS87Follow
Models of self-government, as well as models of harmonized autonomy, have emerged to address the need for strategic… https://t.co/Fkn2w1FybrFollow
Learn how applying Kaizen principles brings continuous improvement to your business practices, increases your perfo… https://t.co/EKejZQdt98Follow
Are you ready to recap the benefits Kanban analytics can bring to your teams? Choose your platform today!… https://t.co/IBRMXPLPXOFollow
In Kanban, Little’s Law links the three basic flow metrics – throughput, cycle time and work in progress. Understan… https://t.co/lz0dCe8fJLFollow
Choose your platform today and deliver outstanding customer value sooner with our range of analytical charts.… https://t.co/maqOaaqgFbFollow
Learn more about how a Financial Technology Company in Brazil evolve from 20 teams running around 50 initiatives to… https://t.co/3pk151Pm1MFollow
The Aging Chart for Trello helps you identify where your process is slowing down while tasks are still in progress.… https://t.co/D51LQOxxhIFollow
After many years of experience with classic waterfall projects at Sitegeist, in 2013 Gina and Sven started to compl… https://t.co/f33g593GhPFollow
Large teams and complex projects face a common issue – the Kanban board becomes cluttered and hard to read. Learn h… https://t.co/uxW9I3XhhpFollow
All of our plans come with full visibility into your past performance so that you can make decisions based on your… https://t.co/CECD3QA2MnFollow
Product teams who use Nave to analyze their workflows can make empirical predictions based on their performance dat… https://t.co/w2UOo7Q3q5Follow
When implementing Kanban, it can be difficult to know how much work has been done, and how well your team is perfor… https://t.co/sT6p8qDJfxFollow
With Nave, you can use your favorite tool to boost your productivity and improve workflow efficiency.… https://t.co/KhWe93qHO0Follow
This is the story of how 30 teams in Petrobras have evolved their maturity and how patterns of evolution can be rec… https://t.co/AHImgtqYBrFollow
Nave's Kanban analytics suite helps you collaborate better and ship faster across all of your Azure boards. Unleash… https://t.co/NttVDesyGoFollow
Choose your platform today and deliver outstanding customer value sooner with our range of analytical charts that v… https://t.co/ZEJTgy7JweFollow