The REAL Load Testing Challenge...

From HP Software Business Outcomes Wiki

The real load testing challenge has very little to do with the tool or how sharp your technical skills are. It has EVERYTHING to do with business knowledge and planning for DATA dependencies.

Anybody can memorize a user guide or read a help file, but planning for and executing a successful load test requires business knowledge and a data strategy. So often I interview or speak with LoadRunner "Consultants" who think their technical skills make them a great resource. When I ask them how they used the tool to overcame a specific business challenge, they look at me with the deer in the headlights glare. "How did you handle your consumable data" I ask...."Well, actually just used the 5 same pieces of data over and over again". "Really" I inquire..."Did you verify that the transactions were completing as expected?" "Yes, we got the green check mark every time"....If I weren't already bald, I would be pulling my hair out. Knowing the tool does not make a successful performance tester.

Why is it that so many "Performance Testers" overlook the importance of understanding the business and the impact that data has on the validity of their results? Technology for technology's sake does nobody any good.

Just my 2 cents!

Josh