Each organization will have to define what their quality goals are for integrated testing based on the business and customer requirements for speed and outcomes. The fact is that these goals must be quantified or in other words measurable. If you are not measuring your testing activities in alignment with the strategic goals then success becomes subjective and it will be very difficult to show value for your effort.
Some examples of measurements might be in the form of Run-To-Plan and Pass-To-Plan.
- Run-To-Plan (RTP) is the number of the total planned tests that have completed and typical goals are to have 95% RTP
- Pass-TopPlan is the number of tests that have passed and a typical goal for this metric is to have a 90% PTP
When considering goals for reliability an S-curve diagram for pass rates could be used to show when the pass rate stabilizes to meet your goal.
- Example: 95% pass rate for 3 consecutive test cycle
For DevOps education and certification:
…educate and inspire!