Work in Progress
In addition to tracking deploy metrics, Sleuth also provides Work in Progress dashboards for Teams and Projects that provide real-time visibility into in-flight work (i.e. work that has not yet deployed) and highlights risks that you can address right now.
Work in Progress, or WIP, includes any PRs or Future Deploys that have not yet deployed to their target environment (where a Future Deploy in Sleuth is essentially a container for PRs that have been merged but have not yet deployed).
While the Work in Progress dashboards present in-flight work in part to provide general visibility into the changes that are likely deploy next, the real value of these dashboard is that they highlight "at risk" items that are likely to have a negative impact on your DORA metrics. This early risk identification allows you to take immediate corrective actions on at-risk items before they ship, driving tactical improvements to your DORA metrics.
Sleuth currently highlights the following risk types:
- Batch Size
- Total change lead time (CLT)
- Coding time
- Review lag time
- Review time
- Waiting to deploy
For Batch Size, an item is considered "at risk" if it is either Large or Gigantic.
For change lead time and its four composite breakdowns, an item is considered "at risk" if it's current value exceeds your average by more than 30% (where your "average" is calculated based on the items that deployed during the same period as your currently work-in-progress data range selection). Note that an item must accumulate a minimum of 30 minutes in a given CLT bucket before Sleuth will potentially flag it as at-risk relative to your average.
The Work in Progress dashboards provide two levels of filtering.
Just like the Metrics Dashboards for Projects and teams, the Work in Progress dashboard can be filtered using top-level filters for Date Range, Projects, Teams, Environments, and Deployments. These filters impact the specific PRs and Future deploy that display in the listing as well as the data that is displayed in all of the dashboard charts.
Top-level work-in-progress dashboard filters
Bear in mind the following considerations when using the Date Range filter:
- The Date Range filter allows you to select the "from" date, but the "to" date will always be the current date. The main reason for specifying a "from" date is to exclude "zombie PRs" (i.e. PRs that have not been updated for a long time and so should not be included in your universe of "current work in progress"
- For WIP risks that rely on comparison against your "average", that average is calculated based on the items that deployed in the same period as your currently selected work-in-progress date range.
- Note that Sleuth has been collecting work in progress data only since November 23, 2022, so it is not possible to view work in progress that has not been updated since before that date.
In addition to the top-level filters, the detailed listing of work-in-progress items provides an additional filter to zero-in on items that exhibit a particular risk type.
Work-in-progress listing filters by specific risk types
By default, this filter is set to "No Filters," which displays all work-in-progress items that match the top-level filters (i.e. regardless of what risks they might or might not exhibit).
Selecting "All at risk items" filters the listing to show only those items that exhibit some risk (regardless of which specific risk type or types they might exhibit).
The remaining filters selections show items that exhibit a particular risk type. When these specific risk type filters are active, the listing is also sorted by that risk value from riskiest to least risky.
To subscribe to email digests summarizing the work in progress dashboard, simply click on the notification bell on the top-right of the dashboard and select "Daily." The digest will be sent to your email inbox each day if and only if there is at least one risk present in the work in progress dashboard.
Note that the digest subscription is specific to your currently selected Team or Project context and currently selected Environment. The date range for the email digest will always be the default look-back period of 28 days.