Stay on Track: Service Level Agreements
Service level agreements (SLAs) precisely define the responsibilities of a service provider to their customers. They can range from formal binding contracts to informal agreements. Depending on the service or industry involved, SLAs can cover service quality, availability/uptime, helpdesk hours, emergency responses, delivery times and more. Comparing service levels over time to the agreement is a good way to track performance.
Service level agreements are an efficient mechanism to keep misunderstandings, inconsistencies and disappointments at a minimum.
Service Level Agreements and Kanban
Service level agreements have typically been geared towards sectors like network services, cloud computing and outsourcing. How can SLAs be tailored to work for Kanban processes?
The core of the Kanban Method is to increase flow efficiency. Several of the flow metrics are related to this core concept, but one in particular drives customer satisfaction – cycle time. One of the fundamental practices in Kanban is that the team should pull new tasks in only when there is capacity for them. However, it is important to clarify to stakeholders how quickly tasks are likely to move through the process.
Any Kanban SLA should come with two things – a cycle time and the confidence level of achieving that same cycle time. If historically 85% of all items were completed within 24 days, the probability that any single item will be completed in 24 days or less is 85%.
Metrics reduce the guesswork involved in this process. Historical performance data is analysed to make accurate future predictions.
Estimations with Cycle Time Scatterplot
Luckily, we have a powerful tool at our disposal for estimating cycle time: the Cycle Tme Scatterplot. Every dot on the graph represents a work item from your Kanban board. The height of the dot represents its cycle time – the higher the dot, the longer it took for that task to be completed.
The dotted horizontal lines are called percentile lines. We can see that there is a 50% chance that any type of task will be completed within 6 days, and a 95% chance that it will be completed within 30 days. This means there is a 95% chance that any task, regardless of size or type, will be completed in this 30 day timeframe.
You can use Cycle Time Scatterplot percentile lines to decide service level agreements. Involve your customers and stakeholders and ask them what kind of confidence level they would be most comfortable with. We recommend starting out using the 85th percentile to define your service level agreements.
Service level agreements in Kanban are not limited to overall average cycle time. We encourage you to define SLAs with your customers and stakeholders for different types of work items or Classes of Service. For example, committing to resolving emergency tasks faster than maintenance requests. Filtering your Cycle Time Scatterplot by work item type or CoS will let you make these estimations confidently.
Estimation, Accuracy and Little’s Law
Estimation is most accurate in stable, predictable systems. The accuracy of Cycle Time Scatterplot estimations is strongly correlated to how well the process follows the Little’s Law assumptions:
- The average Arrival Rate is equal to the average Departure Rate
- All tasks entering the system will eventually exit the system once completed
- There should not be large variances in WIP between the beginning and the end of the time period examined
- The WIP average age should remain the same, neither increasing nor decreasing
- Consistent units must be used to measure Cycle Time, WIP, and Throughput
As these assumptions become less valid, the process behaviour becomes increasingly unpredictable. To keep estimations used in service level agreements as accurate as possible, the Little’s Law assumptions should be adhered to as much as possible for all different work item types (user stories, defects, maintenance requests).
WE UNCOVER THE EFFICIENCY OF YOUR WORKFLOW
Optimize your performance with Kanban analyticsSee a dashboard with your data
Warning Signs and Taking Action
Once a service level agreement has been defined, you can use it to decide when to intervene on a lagging task. By comparing an item’s age to the agreed cycle time, we can see how the chances of missing the SLA target increase with time.
The longer an item has been in the workflow, the greater the chance that it will exceed its SLA limit. To make sure tasks are completed on schedule, you could set Kanban rules to expedite or swarm an item when it comes close to its SLA limit.
Service level agreements give you a way to assess your Kanban workflow. SLA align customer expectations and make the internal targets for your team solid but transparent. By tracking average cycle time in general and for each type of task, you can identify areas of weakness and take action to improve. When you and your stakeholders are on the same page, trust remains high and customer satisfaction is maximised.
Have you applied service level agreements to your Kanban process? Has this helped align expectations between your team, customers and stakeholders? Tell us about your experience in the comments!
Meet the Author
Sonya Siderova is a passionate product manager and a driving force behind Nave, a Kanban analytics suite that helps teams become more efficient through data-driven decision making. When she's not catering to her two little ones, you might find Sonya absorbed in a good heavyweight boxing match or behind a screen crafting a new blog post.
Agile businesses across the globe are using Nave to analyze and improve their workflow performance. Try our versati… https://t.co/sAtLGiaFiaFollow
In Kanban, throughput is one of the key measures of team performance. Learn how to track your capacity to deliver o… https://t.co/UkHWZ35iYnFollow
We've introduced manual data uploads at Nave through CSV and JSON files to give you the flexibility to analyze your… https://t.co/HDSgR2S3I2Follow
High flow efficiency is vital to sustaining a scalable, productive business. Learn how you can calculate, analyze a… https://t.co/t13OzxfopvFollow
Manage your work more efficiently with our Kanban analytics suite. Try it out for free on your favorite tool and st… https://t.co/44FvBin5qYFollow
You need pragmatic and evidence-based guidance that works. The KMM codifies a decade of Kanban coaching experience… https://t.co/DLTpSgt8CwFollow
Nave’s powerful data-visualization toolkit helps you optimize your flow and take your team to a whole new level. Tr… https://t.co/wM6BFIkKyXFollow
Learn about what failure demand is, the approaches to analyzing it in your system and the strategies of turning fai… https://t.co/XxU6rBPbpwFollow
The Cumulative Flow Diagram for Trello gives you an instant insight into the exact amount of work in each state of… https://t.co/R1ZHNKVVIqFollow
Are you looking to improve your team performance, but find yourself held back? Throughput measures your team’s capa… https://t.co/uZpeNBrAFJFollow
Nave’s range of Kanban analytics helps you spot productivity trends at a glance. Select your platform and improve y… https://t.co/3nkibf75YjFollow
Service level agreements define the responsibilities of a service provider to their customers. Defining SLAs are im… https://t.co/txniyg97OCFollow
The Cycle Time Scatterplot for Azure DevOps is using the lead times of all tasks completed within a specific time f… https://t.co/h4gqSmvVq0Follow
This is a story about how the use of the Kanban Maturity Model changed the dynamics in a long-standing customer eng… https://t.co/NaFUi7k6uQFollow