Visualize GitHub Copilot metrics

This guide demonstrates how to set up a monitoring dashboard to gain insights into your GitHub Copilot usage using Port. You'll learn how to visualize key metrics like acceptance rates, active users, chat productivity, and track team adoption over time.

Available Github Integrations

This guide includes one or more steps that require integration with GitHub.
Port supports two GitHub integrations:

• GitHub (Legacy) - uses a GitHub app, which is soon to be deprecated.
• GitHub (Ocean) - uses the Ocean framework, recommended for new integrations.

Both integration options are present in this guide via tabs, choose the one that fits your needs.

Common use cases

• Monitor Copilot usage trends and adoption across teams.
• Track code suggestion acceptance rates to measure productivity gains.
• Analyze chat productivity and user engagement with Copilot.
• Report on ROI of GitHub Copilot investment to leadership.

Prerequisites

This guide assumes the following:

• You have a Port account and have completed the onboarding process.
• Port's GitHub integration or Port's GitHub Ocean integration is installed in your account.
• The GitHub Copilot integration is installed and syncing data.

Create the dashboard

1. Navigate to your software catalog.

2. Click on the + New button in the left sidebar.

3. Select New dashboard.

4. Name the dashboard Copilot Insights.

5. Input Monitor Copilot usage and performance metrics across teams under Description.

6. Select the Github icon.

7. Click Create.

You now have a blank dashboard where you can add widgets to visualize your GitHub Copilot metrics.

Add widgets

Create the following widgets to gain insights into your GitHub Copilot usage. Select the tab that matches your integration type for the correct blueprint and property names.

GitHub (Legacy)

Total active users widget

Total active users (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Total Active Users (Avg).
   • Description: Average number of active users using Copilot per day.
   • Icon: Users.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate by property.
   • Property: total_active_users.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: users.

3. Click Save.

Overall acceptance rate widget

Overall acceptance rate (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Overall Acceptance Rate (%).
   • Description: How often Copilot suggestions are accepted.
   • Icon: metric.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate by property.
   • Property: acceptance_rate.
   • Function: Average.
   • Average of: total.
   • Unit: %.

3. Click Save.

Total suggestions generated widget

Total suggestions generated (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Total Suggestions Generated.
   • Description: Average suggested lines of code per day.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate by property.
   • Property: total_lines_suggested.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: suggested lines of code.

3. Click Save.

Chat productivity widget

Chat productivity (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Chat Productivity.
   • Description: Average chat turns per day.
   • Icon: Chat.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate by property.
   • Property: total_chat_turns.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: chats.

3. Click Save.

Usage by team widget

Usage by team (click to expand)

1. Click on + Widget and select Pie Chart.

2. Fill in the following details:

   • Title: Usage by Team.
   • Description: Contribution of each team to copilot usage.
   • Icon: Pie.
   • Blueprint: github_copilot_usage.
   • Breakdown by Property: git_hub_team.

3. Click Save.

Acceptance rate over time widget

Acceptance rate over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Fill in the following details:

   • Title: Acceptance Rate Over Time.
   • Description: See quality improvements (or declines) over time.
   • Icon: LineChart.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate properties(All Entities).
   • Properties: total_acceptances_count.
   • Function: average.
   • Time interval: Week.
   • Time range: In the past 30 days.
   • Measure time by: createdAt.

3. Click Save.

Active users over time widget

Active users over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Fill in the following details:

   • Title: Active Users Over Time.
   • Description: Shows if team usage is growing.
   • Icon: LineChart.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate properties(All Entities).
   • Properties: total_active_users, total_active_chat_users.
   • Function: average.
   • Time interval: Week.
   • Time range: In the past 30 days.
   • Measure time by: createdAt.

3. Click Save.

Chat productivity over time widget

Chat productivity over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Fill in the following details:

   • Title: Chat Productivity Over Time.
   • Description: Reveals growing reliance on Copilot Chat.
   • Icon: LineChart.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate properties(All Entities).
   • Properties: total_chat_turns, total_chat_acceptances.
   • Function: average.
   • Time interval: Week.
   • Time range: In the past 30 days.
   • Measure time by: createdAt.

3. Click Save.

Total suggestions vs. acceptances over time widget

Total suggestions vs. acceptances over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Fill in the following details:

   • Title: Total Suggestions vs. Acceptances Over Time.
   • Description: How Copilot suggestions and acceptances change over time to track usage and engagement.
   • Icon: LineChart.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate properties(All Entities).
   • Properties: total_suggestions_count, total_acceptances_count.
   • Function: average.
   • Time interval: Week.
   • Time range: In the past 30 days.
   • Measure time by: createdAt.

3. Click Save.

GitHub (Ocean)

Total active users widget

Total active users (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Total Active Users (Avg).
   • Description: Average number of active users using Copilot per day.
   • Icon: Users.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate by property.
   • Property: daily_active_users.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: users.

3. Click Save.

Overall acceptance rate widget

Overall acceptance rate (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Overall Acceptance Rate (%).
   • Description: How often Copilot suggestions are accepted.
   • Icon: metric.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate by property.
   • Property: acceptance_rate.
   • Function: Average.
   • Average of: total.
   • Unit: %.

3. Click Save.

Total suggestions generated widget

Total suggestions generated (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Total Suggestions Generated.
   • Description: Average suggested lines of code per day.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate by property.
   • Property: loc_suggested_to_add_sum.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: suggested lines of code.

3. Click Save.

User-initiated interactions widget

User-initiated interactions (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: User-Initiated Interactions.
   • Description: Average user-initiated interactions per day.
   • Icon: Chat.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate by property.
   • Property: user_initiated_interaction_count.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: interactions.

3. Click Save.

Usage by organization widget

Usage by organization (click to expand)

1. Click on + Widget and select Pie Chart.

2. Fill in the following details:

   • Title: Usage by Organization.
   • Description: Contribution of each organization to copilot usage.
   • Icon: Pie.
   • Blueprint: githubCopilotOrganizationUsage.
   • Breakdown by Property: git_hub_org.

3. Click Save.

Acceptance rate over time widget

Acceptance rate over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Fill in the following details:

   • Title: Acceptance Rate Over Time.
   • Description: See quality improvements (or declines) over time.
   • Icon: LineChart.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate properties(All Entities).
   • Properties: code_acceptance_activity_count.
   • Function: average.
   • Time interval: Week.
   • Time range: In the past 30 days.
   • Measure time by: createdAt.

3. Click Save.

Active users over time widget

Active users over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Fill in the following details:

   • Title: Active Users Over Time.
   • Description: Shows if organization usage is growing.
   • Icon: LineChart.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate properties(All Entities).
   • Properties: daily_active_users.
   • Function: average.
   • Time interval: Week.
   • Time range: In the past 30 days.
   • Measure time by: createdAt.

3. Click Save.

User-initiated interactions over time widget

User-initiated interactions over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Fill in the following details:

   • Title: User-Initiated Interactions Over Time.
   • Description: Reveals growing reliance on Copilot interactions.
   • Icon: LineChart.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate properties(All Entities).
   • Properties: user_initiated_interaction_count.
   • Function: average.
   • Time interval: Week.
   • Time range: In the past 30 days.
   • Measure time by: createdAt.

3. Click Save.

Total suggestions vs. acceptances over time widget

Total suggestions vs. acceptances over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Fill in the following details:

   • Title: Total Suggestions vs. Acceptances Over Time.
   • Description: How Copilot suggestions and acceptances change over time to track usage and engagement.
   • Icon: LineChart.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate properties(All Entities).
   • Properties: code_generation_activity_count, code_acceptance_activity_count.
   • Function: average.
   • Time interval: Week.
   • Time range: In the past 30 days.
   • Measure time by: createdAt.

3. Click Save.