Quality in a Quick Series: Regression Testing
Bob Crews, President and Co-Founder of Checkpoint Technologies, is the author of a new series "Quality in a Quick", a new educational series on Software Quality Assurance. What follows are my notes from the Regression Testing presentation.
Don't Overlook Improving Your Regression Testing
Regression testing is the strategic process to retest a system or software application, that has already been tested, with the goal of identifying inadvertently introduced defects or anomalies.
Regression testing ensures that the modification of a system or system component has not:
• Introduced unintended adverse effects into the system or software
• Modified system or software still meets the specified requirements specification
Objectives of Regression Testing:
• To ensure what has been fixed is truly fixed
o Does the application work as intended?
o Does the application meet specifications?
o Is the modified application Fit for Use?
• To ensure that no other defects have been introduced.
When to Perform Regression Testing:
• Whenever new releases of the packaged software have been put out to production.
• When the application is enhanced, or changes are made, for any reason.
• Changes to software configuration or incoming or outgoing interfaces.
• When changes have been made after a testing state has been completed.
Design Tips for a more Effective RTS:
• Keep the tests simple and independent
• Group linked tests into an easily identifiable test group or test suite
• Utilize an intuitive name for test suites so that it's obvious what that RTS tests
• Modularize test scripts to facilitate change management and decrease maintenance costs
• Lock critical tests into the fundamental core test suite
The Five Most Common Problems Creating an RTS:
• An organization does not have a Regression Test Suite (RTS)
• Validity of the existing RTS is Unknown
• The original conditions in the RTS cannot be recreated
• Too large to run after each change; too massive and too many test cases
• Lack of regression test tools
Prerequisites for Peer Review include:
• Is our RTS OK?
o Are all of our RGS test cases valid?
o Do any test cases need to be updated or deprecated due to obsolescence?
o Does the RTS test what we need to validate, including all critical applications and interfaces?
o Is our RTS finding defects?
Questions may be submitted to firstname.lastname@example.org.
Fit for Use. A judgment by the customer and end users that a system or software application is acceptable for use in a production environment.
Regression Test. IEEE Definition: The selective testing of software to detect defects introduced during modification of a system or system component.
Regression Test Suite (RTS). A collection of regression tests.
Regression Test Organization Tips
See TechBeacon's The Best Software Testing Conferences of 2018 for a complete listing of upcoming SQA and Test Engineering conferences.
More Quality in a Quick Presentation Notes
See my notes on The Value of Peer Reviews, Walkthroughs, and Inspections presentation.