Pre-1 :  Exploratory Test Automation
Monday, 9:00am - 4:00pm

 
Track:

Automated software testing has historically meant having the computer run individually crafted test cases. The vast majority of automated test cases are regression tests that perform the same exercises as manual tests, only run by a machine. The principle advantages for these automated tests are repeatability, speed, and volume of checking. The principle disadvantages are they're relatively more expensive to create than manual tests, require more maintenance than manual tests, and are more limited in the specificity of things they can compare, relative to manual tests.

This presentation describes another way to approach test automation: to test things that cannot be tested manually. Extending the scope of testing in this way allows checking for errors that might not be found otherwise or even conceived of. These tests enable us to focus on learning about the software, allow us to go behind the UI to extend our reach, are not limited to doing the same thing each time (although even random sequences can be repeated), and can perform huge numbers of iterations and combinations that would be unthinkable using manual testing or automated regression tests. These tests are quick-hit or abstracted one or two levels from the user interface, which substantially reduces maintenance costs. This approach also encourages checking broader classes of test outcomes, thus improving the types of errors that can be discovered.

Doug Hoffman

Consultant, Software Quality Methods

Doug Hoffman is a management consultant for Software Quality Methods, LLC and has over 30 years experience as a trainer in strategies and tactics for quality assurance. His technical focus is on test automation and test oracles. His management focus is on evaluating, recommending, and leading implementation of quality improvement programs. He is the President of the Association for Software Testing (AST); a Fellow of the ASQ; and holds MBA, MSEE, and BACS degrees. He is certified by ASQ as a Software Quality Engineer and as a Manager of Quality/Organizational Excellence.  He has spoken at dozens of conferences and chaired several international conferences on software quality.