| Table of Contents | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
...
|
Introduction
Defect leakage refers to the percentage of defects that escape detection during testing and emerge in the production environment or post-release. Analyzing this metric helps improve testing processes and ensures better software quality. To measure the Defect leakage the following Formula is used at camms.
Formula
...
...
At Camms, we are dedicated to fostering growth through continuous learning and improvement. In our Product Engineering division, we meticulously track a range of Key Performance Indicators (KPIs) to assess our delivery efficiency and ensure the best possible client experience. These KPIs serve as fundamental pillars in evaluating the performance of Camms Products.
By leveraging these statistics, we aim to swiftly identify any potential risks and enhance our processes accordingly. As we advance, we will continuously refine and enhance these KPIs based on our observations and insights. Our commitment to leveraging data-driven insights enables us to drive continuous improvement and deliver exceptional value to our clients.
Formula / Base
Live Issues = Total number of open tickets at end of the respective month (From Freshdesk Data)
Defect Leakage - Captured through QA Data set = Number of defects reported by end-users or customers (from Fresh Desk) X 100
Total number of defects found by QA (From JIRA)Issues Injected Per Story Points = (Total number of Live Issues Reported for the Month + Total number of defects reported by BA+QA for the Month (JIRA)
Story points developed for the month and released
Development Velocity = Total Dev days available for the month * Total Story Points developed and released
Total number of Dev Days worked Number of Developers
...
Product KPIs - Year 2024
March 2024
Date Range: to
...
Date Range: to
Product | Defect Leakage | FD Ticket count | Defect count in Jira. |
|---|---|---|---|
camms.project | 44.12% | 30 | 68 |
camms.risk | 64.17% | 77 | 120 |
camms.strategy | 27.78% | 15 | 54 |
camms.incident and camms.compliance | 53.25% | 41 | 77 |
Reporting Hub | 32.20% | 19 | 59 |
Integration | 0.00% | 0 | 35 |
Mobile | 0.00% | 0 | 8 |
Product | Defect Leakage | FD Ticket count | Defect count in Jira. |
|---|---|---|---|
camms.project | 28.77% | 61 | 212 |
camms.risk | 60.00% | 201 | 335 |
camms.strategy | 28.08% | 57 | 203 |
camms.incident and camms.compliance | 31.91% | 97 | 304 |
Reporting Hub | 40.16% | 49 | 122 |
Integration | 1.56% | 1 | 64 |
Mobile | 0.0% | 0 | 24 |
February
...
Product | Live Issues (<10) As of EOD March 31, 2024. | Defect Leakage Range: 5% - 15% | Issues Injected Per Story Points Range: 1.5% - 5% | Development Velocity Average Story Points developed by a Developer | Notes |
|---|---|---|---|---|---|
Camms.Incident | 29 | 1.46% | 0.55% | 58.21 | |
Camms.Compliance | 11 | N/A | N/A | N/A | |
Camms.SRT | 7 | N/A | N/A | N/A | |
Camms.Risk | 48 | 1.53% | 0.31% | 59.86 | |
Camms.Audit | 13 | N/A | N/A | N/A | |
Camms.Mobile | 1 | 0.25% | 1.38% | 23.30 | |
Camms.Strategy | 13 | 4.37% | 0.28% | 56.93 |
February 2024
Date Range: to
Product | Live Issues (<10) As of EOD 29th February 2024. | Defect Leakage |
|---|
...
FD Ticket count
...
Defect count in Jira.
...
camms.project
...
21.5%
...
31
...
144
...
camms.risk
...
57.7%
...
124
...
215
...
camms.strategy
...
28.2%
...
42
...
149
...
camms.incident and camms.compliance
...
24.7%
...
56
...
227
...
Reporting Hub
...
47.6%
...
30
...
63
...
Integration
...
6.9%
...
2
...
29
...
Mobile
...
0.0%
...
0
...
16
January
...
Range: 5% - 15% | Issues Injected Per Story Points Range: 1.5% - 5% | Development Velocity Average Story Points developed by a Developer | Notes | ||
|---|---|---|---|---|---|
Camms.Incident | 27 | 1.02% | 3.08% | 24.70 | |
Camms.Compliance | 7 | N/A | N/A | N/A | |
Camms.SRT | 8 | N/A | N/A | N/A | |
Camms.Risk | 57 | 2.96% | 1.10% | 24.53 | |
Camms.Audit | 13 | N/A | N/A | N/A | |
Camms.Mobile | 0 | 0.30% | 1.59% | 23.89 | |
Camms.Strategy | 13 | 1.09% | 1.60% | 9.39 | Sprint started on February 19, 2024 and dependent on other product basic developments |
January 2024
Date Range: to
Product | Live Issues (<10) As of EOD 31st January 2024. | Defect Leakage |
|---|
...
FD Ticket count
...
Defect count in Jira.
...
camms.project
...
7.5%
...
8
...
107
...
camms.risk
...
20.0%
...
13
...
65
...
camms.strategy
...
7.8%
...
8
...
103
...
camms.incident and camms.compliance
...
13.8%
...
8
...
58
...
Reporting Hub
...
77.3%
...
17
...
22
...
Integration
...
-
...
-
...
-
...
Mobile
...
0.0%
...
0
...
...
2024
...
Range: 5% - 15% | Issues Injected Per Story Points Range: 1.5% - 5% | Development Velocity Average Story Points developed by a Developer | Notes | ||
|---|---|---|---|---|---|
Camms.Incident | 19 | 0.63% | N/A | N/A | We did not have new developments in January 2024, Staging and Demo weeks. Focused on issue fixing |
Camms.Compliance | 4 | N/A | N/A | N/A | Did not have new developments in January 2024 |
Camms.SRT | 8 | N/A | N/A | N/A | Did not have new developments in January 2024 |
Camms.Risk | 29 | 2.03% | 0.85% | 23.66 | |
Camms.Audit | 11 | N/A | N/A | N/A | Did not have new developments in January 2024 |
Camms.Mobile | 2 | 2.80% | 1.03% | 23 | |
Camms.Strategy | 13 | 2.35% | 2.31% | 17.01 |
...