Data-Driven Decision Making: The Value of Probabilistic Thinking
More than 50 years ago, Peter Drucker, a management consultant and author, described as the founder of modern management, predicted we would shift to a knowledge society. He said information would change the way people work – that knowledge will become the most important economic resource. Instead of generating value through physical labor with their muscles, people will do it with their minds. Drucker described these people as “knowledge workers”.
So, who is a knowledge worker? Simply described, a knowledge worker is someone whose job requires them to think for a living. Knowledge workers are people who “figure out” what they need to do. People who weigh many factors to determine the best course of action. People whose actions are based on multiple sources of information. These are the people who gather clues, follow up and discover new possibilities.
In knowledge work, we make assumptions about the future. In the most effective manner, we validate these assumptions by delivering results early and often. We learn what brings value and avoid the risk of spending time and money on the wrong things. That is simply because the nature of knowledge work is unpredictable.
People Feel More Comfortable Being Wrong Than Uncertain
When it comes to product management, the big question always seems to be “When will this be done?”. The problem is rooted in the expectation of having a single certain delivery date as an answer. And people tend to provide it. Fact is people feel more comfortable being wrong than uncertain.
The fear of uncertainty is a cultural problem. Professor Geert Hofstede, a Dutch population biologist, conducted one of the most comprehensive studies of how values are influenced by national culture. He defines six dimensions of national culture, one being the uncertainty avoidance index. The index is scaled from 1 to 100 – the higher the index the more uncomfortable to uncertainty you are as a society. Countries exhibiting strong uncertainty avoidance index maintain rigid codes of belief and behaviour and are intolerant of unorthodox ideas.
We’d rather provide a single certain delivery date that’s wrong than remain uncertain.
The Difference Between an Estimate and a Forecast
How can we answer the question “When will this be done”? Can we predict exact future delivery dates, despite the unpredictability of knowledge work? Are we capable of predicting the exact time a feature will take to go through the whole process while coordinating the rest of the work in progress at the same time? Is it possible to predict that there won’t be any additional work coming in between, any dependencies, bottlenecks or external blockers that might cause a delay?
There are two approaches trying to provide the answer to “When will this be done” question – an estimate and a forecast. What’s the difference?
Estimates are predictions based on guesswork, judgment or a gut feeling.
The prediction is delivered as a single value – it could be a date or a number of days for example. An estimate doesn’t involve any probability of its occurrence.
Forecasts, on the other hand, are based on historical performance data. The prediction is communicated as a range of values and the probability of those values occurring.
Forecasting is faster, cheaper and more reliable than estimating.
Agile businesses across the globe are using Nave to perform probabilistic forecasts based on their past performance data. Try our versatile range of analytical charts for free on your favorite platform.
Increasing Predictability Through Probabilistic Outcomes
When making business decisions, we are constantly confronted with possibilities whose outcomes we don’t know. Getting rid of uncertainty and being in control of everything is impossible. The real challenge is dealing with the uncertain and unknown in an effective way. That is the realm of probability.
Using a probabilistic approach of making future predictions based on past performance data increases the predictability of our outcomes. Making probabilistic forecasts helps us maintain high levels of customer and stakeholder trust, satisfaction and retention. It allows us to define service level agreements with more confidence and deliver value to our customers in a consistent, predictable manner.
WE UNCOVER THE EFFICIENCY OF YOUR WORKFLOW
Optimise your performance with Kanban analyticsExplore Your Data Now
Learn To Think Probabilistically To Improve Decision Making
Thinking probabilistically means having a willingness to always ask questions like “What else might happen?”, “What could happen next?”, “What if we’re wrong?” and to look at the full range of possibilities that might come to pass rather than to assume that things will go as planned. Ignoring unwanted facts won’t make them disappear. Knowledge work is complicated and lots of unexpected and surprising things happen.
Start making probabilistic forecast using historical performance data in parallel with your old approach. If you have the data, use the data. If you do not have the data, then get the data and use the data. It will probably give you as good or even better answers and it will take a lot less time. Keep both the approaches and observe the results. At some point, it will become obvious which one works best for you.
Thinking probabilistically increases our predictability and improves decision making. It provides an alternative to get more accurate answers with a lot less effort. Most importantly, it enables us to spend our time on what matters the most – delivering customer value.
Meet the Author
Sonya Siderova is a passionate product manager and a driving force behind Nave, a Kanban analytics suite that helps teams become more efficient through data-driven decision making. When she's not catering to her two little ones, you might find Sonya absorbed in a good heavyweight boxing match or behind a screen crafting a new blog post.
Using data-driven probabilistic methods keeps forecasts reliable and eliminates guesswork. Try out our Kanban abaly… https://t.co/YeC8iLemhrFollow
You need pragmatic and evidence-based guidance that works. The KMM codifies a decade of Kanban coaching experience… https://t.co/K8ZPzRW5B8Follow
Learn how applying Kaizen principles brings continuous improvement to your business practices, increases productivi… https://t.co/fMvgvjKVSVFollow
Product teams who use Nave to analyze their workflow can make empirical predictions based on their performance data… https://t.co/F7iWMZcZ0aFollow
Most companies wanting to be agile, start at the team level. Often this involves adopting a model or framework that… https://t.co/6wlCWGycpeFollow
Keep track of your work in progress, instantly spot bottlenecks and improve your process performance with the Cumul… https://t.co/66o0RbiuEeFollow
Service level agreements define the responsibilities of a service provider to their customers. Defining SLAs are im… https://t.co/eN8GmBO9wdFollow
Gain early stage access and insight into our platform. Test our new features and give us your feedback. You have th… https://t.co/tugiVu7QUZFollow
Enterprise projects are known to have challenges with uncertainty, risk, forecasting and commitment. Explore the te… https://t.co/zMagDrdm9UFollow
Nave’s range of Kanban analytics helps you spot productivity trends at a glance. Select your platform and improve y… https://t.co/XJcbTsr9GfFollow
Increase your performance and improve your workflow with Kanban Analytics. Get actionable insights from your Kanban… https://t.co/K6OZAeAYGKFollow
The basic flow metrics let you monitor your productivity and give you the information to make data-driven decisions… https://t.co/d0zHVr7bw1Follow
Nave’s powerful data-visualization toolkit helps you optimize your flow and take your team to a whole new level. Tr… https://t.co/ds20muRvYYFollow
Bosch Power Tools is undergoing its biggest transformation ever. This is the story about how 50 cross-functional pu… https://t.co/RxtXSsFu1OFollow
Making accurate delivery forecasts is essential to staying on track, meeting deadlines and keeping a high level of… https://t.co/rxVLHCQbdGFollow
Are you ready to recap the benefits Kanban analytics can bring to your process? Get started with Nave today!… https://t.co/sJwBRflOczFollow
For years Agile practices have failed to adequately address management concerns: prioritization, meaningful metrics… https://t.co/xBp4G9Sd3TFollow
Nave's Kanban analytics suite helps you collaborate better and ship faster across all of your Azure boards. Start y… https://t.co/4TJcDUT5dCFollow
Manage your work more efficiently with our Kanban analytics suite. Try it out for free on your favorite tool and st… https://t.co/qi4yS47rhPFollow