Slide 1: Test Process Improvement and the Test Manager
(An uncomfortable marriage?) Geoff Thompson Experimentus www.experimentus.com
Test Management Summit 30th January 2008
Slide 2: Agenda
1. Introduction 2. What is Test Process Improvement? 3. The issue 4. Discuss
Slide 3: Introduction
Slide 4: Experimentus
Is a leading specialist in Software Quality Management Provides strategic consulting solutions aimed at optimising software quality processes and help organisation’s properly manage the integration, installation and performance of new and existing software applications
Has developed industry recognised Test Maturity Model (TMM) assessment method Has delivery capabilities in:
Project Management Requirements Management Testing (both Non-Functional and Functional) Configuration Management Product Selection Management Information and Training
Client base predominantly represents ‘blue chip’ corporations operating in the Finance, Professional Services, Media, Telecommunications and Technology sectors
Slide 5: What is Test Process Improvement?
Slide 6: “Continuous improvement of the quality, and the efficiency of the testing process, in the context of the total software process”
Costs Effort Throughput time Early defects ….. Insight Coverage Product quality Control Predictability ….. Testability Requirements Project planning ...
Slide 7: Examples of Test Process Improvement models
TMMi (Test Maturity Model) CMMi (Capability Maturity Model) TPI (Test Process Improvement) CTP (Critical Test Process) STEP (Systematic Test and Evaluation Process)
Slide 8: How many of you has managed or been involved in Test Process Improvement?
Slide 9: The Issue
Slide 10:
There is a stigma attached to Test Process Improvement Its easy, isn't it, doesn’t need good project management skills! Most seem to focus on detection rather than prevention activities Focus on revolution rather than evolution – which delivers long term results
No metrics are recorded so no real value identified Career limiting?
However it is one of the most effective solutions when
an organisation does ‘poor testing’ isn’t it?
Slide 11: Case Study 1
Very experienced contract Test Manager – managed many multi million pound test projects to successful delivery for many blue chip companies – during the 90’s and early 2000’s
Identified many issues in that time that could have been resolved by implementing better and more repeatable processes
Decided in early 2003 to specialise in Test Process Improvement Between 2003 and mid 2007 he implemented better process models into 3 major companies with over 200 test resources each
In 2007 decided he wanted to go back to Test Management
January 2008 still not employed, why… TPI is seen as easier than delivery so with TPI on it, his CV is unusable
for ‘real’ testing jobs
Slide 12:
Do you agree it is a worthwhile exercise? Do you agree it is career limiting? What do you think?
Slide 13: The good news
It is the first planned ISTQB (International Software Testing Qualification Board) Expert level syllabus
It is no longer the activity that gets stopped first when the pennies get short it is seen to add real value in mature organisations
Slide 14: Thank You
Geoff Thompson
Geoff.Thompson@experimentus.com 07843 617676