Overview
The OrgDORAMetricsAzureDevOps module uses Azure DevOps REST APIs to aggregate build, pull request, and work item data across all projects in an organization. It provides organization-wide insights into delivery performance and resilience without exposing low-level implementation details.Authentication & Permissions
-
Personal Access Token (PAT)
- Build: Read access to query pipeline runs
- Code: Read access for pull requests and commits
- Work Items: Read access to query incident-related work items
-
Service Principal / OAuth Token
- Grant equivalent scopes for Builds, Git, and Work Items APIs
- Ensure the token is valid for the target organization and all its projects
Metrics
Deployment Frequency
- Total number of successful pipeline runs on the main branch across all projects within the selected date range.
Lead Time for Changes
- Average time from pull request creation to successful pipeline completion on merge, aggregated at the organization level.
Change Failure Rate
- Proportion of pipeline runs triggered by pull request merges that resulted in failure or partial success.
Mean Time to Recovery (MTTR)
- Average time to resolve work items labeled as incidents, measured across the organization.
First Review Time
- Average time from pull request creation to the first review comment, aggregated across all repositories.
First Approval Time
- Average time from pull request creation to the first approval vote, aggregated across all repositories.
First-to-Last Approval Time
- Average interval between the first and last approval vote on each pull request, across the organization.
Last Approval-to-Merge Time
- Average duration from the final approval vote to the merge event for all pull requests across the organization.
Time to Open
- Average time between the first commit in a pull request branch and the pull request’s creation, with negative intervals zeroed out.
Time to Merge
- Average duration from pull request creation to merge completion, aggregated at the organization level.