Insights into Agile, Testing, and QA Transformation
Uncover a wealth of knowledge from an experienced Sr. QA Manager & Agile Director, featuring topics such as Agile myths, software testing practices, defect management costs, off-shoring trends, and the importance of pushing left in development. Explore the challenges and strategies in QA transformation and gain valuable insights to enhance your practices.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
QA Transformation Get on board or risk NOW! Ray Scott QA Transformation Consultant rayscott65@sky.com Ray.scott@qualityagile.co.uk
Who am I? 25 years I.T (15 QA, 10 Agile) Sr. QA Manager & Agile Walt Disney Theme Parks & Resorts Director Agile and professional services Grid Tools Bank of Boston, Fidelity Investments QA Transition Manager/Interim Head of QA Ladbrokes/Aditi UK Leading airline Head of Performance SOA, Consultant Speaker at: Agile and QA conferences throughout Europe and USA 2
AGILE True of False? CULTURE METHODOLOGY SET OF PRACTICES Practicing SCRUM is AGILE Performing TDD, BDD and Pair programming means you are AGILE Is hard to do!
What is Software Testing? What is Software Testing? 4
Testing practices $$$ Test plans Test cases/scenarios Aligning to requirements Wait for code to be delivered Automation Expect defects and report KPI Defect management Triage manager Test manager Test lead Tester QA Manager 5
What is the cost of exposing defects? What is the cost of exposing defects? 6
Costs of Issues Dev. Design. Detail Prod UAT SIT PreProd Req. Arch. 20,000 6000 10,000 300 800 1800 3800 - Clients Total 400 hrs ~ 40,000 7
What are we trying to save? Problems! 9
Pushing LEFT Arch. Dev. Detail Design. Prod UAT SIT PreProd Req. 1X 3X 6X 13X 20X 35X 65X 140+X Traditional testing Quality $$$ Assurance Testing finds defects, QA prevents defects 10
How does it all change for a tester in an How does it all change for a tester in an Agile environment? Agile environment? 11
Some core concepts Some core concepts How we work together Collaboration Communication Transparency Innovation How we move information Know what is going on Trying something different Does this sound like Testing? 12
Traditional Tester Traditional Tester 13
Transforming Transforming 14
WoW WoW - - Ways of Working Ways of Working Testing finds defects, QA prevents defects 15
Quality Assurance agenda Quality Assurance agenda Testing is the responsibility of the TEAM Testing occurs ALL THE TIME Push-Left Reduce risk and increase confidence with predictability Alignment to business goals in the SPRINT Validates a potential release candidate DONE is DONE 16
How can testing be the responsibility of the TEAM? Development testing practices, TDD and BDD Non-Functional requirements Product Owner feedback Test Scenarios over Test cases Manage technical debt (Sev 3 and 4s) Identifying Sev 1 and 2s early leaves time for 3s and 4s 17
Quality Assurance agenda Quality Assurance agenda Testing is the responsibility of the TEAM Testing occurs ALL THE TIME Push-Left Reduce risk and increase confidence with predictability Alignment to business goals in the SPRINT Validates a potential release candidate DONE is DONE 18
How can testing occur ALL THE TIME? Continuous Integration (Build & Test) - TDD, BDD QA reviews Product Owner reviews Plan for the Unplanned Avoid more than needs to be tested 19
Quality Assurance agenda Quality Assurance agenda Testing is the responsibility of the TEAM Testing occurs ALL THE TIME Push-Left Reduce risk and increase confidence with predictability Alignment to business goals in the SPRINT Validates a potential release candidate DONE is DONE 20
Push Left = How do we detect defects earlier? The best protection is EARLY PROTECTION Understand the Sprint delivery Create relationships with team Communication plans Participate in user story maintenance (Func. & NFR) Perfection is only a test case away 21
Quality Assurance agenda Quality Assurance agenda Testing is the responsibility of the TEAM Testing occurs ALL THE TIME Push-Left Reduce risk and increase confidence with predictability Alignment to business goals in the SPRINT Validates a potential release candidate DONE is DONE 22
How can RISK be reduced? The probability of LOSS AND Exposing to harm or danger Understand the limitations of what is under test Testing is NOT trying to break it Shorter, incremental & cumulative Understand the data 23
Quality Assurance agenda Quality Assurance agenda Testing is the responsibility of the TEAM Testing occurs ALL THE TIME Push-Left Reduce risk and increase confidence with predictability Alignment to business goals in the SPRINT DONE is DONE 24
How to align with the business Know your Product owners (Business Representative) Prove the value you bring to the product development Intelligently challenge Walk through demo s Introduce Quality Controls (KPI s) 25
Quality Assurance agenda Quality Assurance agenda Testing is the responsibility of the TEAM Testing occurs ALL THE TIME Push-Left Reduce risk and increase confidence with predictability Alignment to business goals in the SPRINT DONE is DONE 26
When are we DONE? Define DONE Work towards DONE Communicate DONE to all Stop when DONE enough DONE-DONE-DONE 27
Joining an Agile team Testers are pack animals Joining an Agile can be a lonely existence Reporting into a Dev. Manager Reduced structure, stage gates and documentation Loss of control 28
The new world of Agile Testers no longer need to be siloed or feel alone in Agile Work with support groups Influence team members Focus on Quality not quantity of test cases Testing finds defects, QA prevents defects Requires courage to move out of comfort zone Learn new skills (Customer focus) Team up with those that build the quality into product delivery 29
WoW WoW - - Ways of Working Ways of Working A real world worked example 30
Environment Agile-like 3rd party development team, distributed 3rd party testing team, distributed (Not same as above) Product Owner engaged and committed Some SCRUM practices encouraged Too much technical debt Sev 3 and 4 pushed aside UAT duplicated SIT testing 31
WoW original lifecycle Development SIT UAT 32
Goals Reduce cycle delivery time for Sprints Reduce number of defects found late in the cycle Increase confidence with delivery of quality product 33
KPIs Cumulated defects Sprint 1 & 2 45 40 35 30 25 20 15 10 5 0
WoW Early engagement of QA with Dev and Business team Sharing product and testing objectives Added value to Dev testing effort Last few days of Sprint became a Pre-SIT period Execution of HappyPath Early detection of Sev 1s & 2 Entry stage gate criteria met Fast turn around of defects 35
WoW Entry to formal SIT with Known Knowns More confidence of product quality Less UnknownUnknowns Next Sprint Technical debt (Sev 3/4) Product owner can Go-Live earlier UAT cycle shorter Less technical debt More communication .more reliability .earlier value 36
WoW Modified lifecycle Development SIT Pre- SIT Development QA involvement SIT UAT UAT 37
KPIs Cumulative KNOWN defects Sprint 1 & 2 Sprint 3 & 4 45 45 40 40 35 35 30 30 25 25 20 20 15 15 10 10 5 5 0 0 11/1/2013 11/2/2013 11/3/2013 11/4/2013 11/5/2013 11/6/2013 11/7/2013 11/8/2013 11/9/2013 11/10/2013 11/11/2013 11/12/2013 11/13/2013 11/14/2013 11/15/2013 11/16/2013 11/17/2013 11/18/2013 11/19/2013 11/20/2013 11/21/2013 11/22/2013 10/1/2013 10/2/2013 10/3/2013 10/4/2013 10/5/2013 10/6/2013 10/7/2013 10/8/2013 10/9/2013 10/10/2013 10/11/2013 10/12/2013 10/13/2013 10/14/2013 10/15/2013 10/16/2013 10/17/2013 10/18/2013 10/19/2013 10/20/2013 10/21/2013 10/22/2013
WoW comments from team Much more engagement created a collaborative environment Gut feel entering SIT stage was superior Quality product delivered but more effort needed 39
In closing AGILE is HARD to do! Agile is NOT for everyone Leaders over Mangers A Pat on the back cost nothing and Motivates 40
Questions ???? Questions ???? Published in ComputerWorld.co.uk Good reading : Good reading : Say hello to QA and goodbye to testing Failure is only a stepping stone to success Test data governance Test data warehouse What does quality look like Test data management is the new Automation 41
