Overview

The OrgDORAMetricsAzureDevOps module uses Azure DevOps REST APIs to aggregate build, pull request, and work item data across all projects in an organization. It provides organization-wide insights into delivery performance and resilience without exposing low-level implementation details.

Authentication & Permissions

  • Personal Access Token (PAT)

    • Build: Read access to query pipeline runs
    • Code: Read access for pull requests and commits
    • Work Items: Read access to query incident-related work items
  • Service Principal / OAuth Token

    • Grant equivalent scopes for Builds, Git, and Work Items APIs
    • Ensure the token is valid for the target organization and all its projects

Metrics

Deployment Frequency

  • Total number of successful pipeline runs on the main branch across all projects within the selected date range.

Lead Time for Changes

  • Average time from pull request creation to successful pipeline completion on merge, aggregated at the organization level.

Change Failure Rate

  • Proportion of pipeline runs triggered by pull request merges that resulted in failure or partial success.

Mean Time to Recovery (MTTR)

  • Average time to resolve work items labeled as incidents, measured across the organization.

First Review Time

  • Average time from pull request creation to the first review comment, aggregated across all repositories.

First Approval Time

  • Average time from pull request creation to the first approval vote, aggregated across all repositories.

First-to-Last Approval Time

  • Average interval between the first and last approval vote on each pull request, across the organization.

Last Approval-to-Merge Time

  • Average duration from the final approval vote to the merge event for all pull requests across the organization.

Time to Open

  • Average time between the first commit in a pull request branch and the pull request’s creation, with negative intervals zeroed out.

Time to Merge

  • Average duration from pull request creation to merge completion, aggregated at the organization level.