Rajeshwari G

Ramkumar Ramaswamy

 

How to Set Up and Run a Successful Performance Testing CoE

   
 

Several IT organizations invest in Performance "Testing" Centers of Excellence (CoEs) to cater to the needs and demands of their customers (internal and/or external). Testing, however, is only part of the performance story, and soon enough the CoE faces the business mandate to handle the broader area of software performance engineering. To be successful in meeting their business objectives and leverage their investments, the key imperative for these organizations is to have a clear definition of their existing and future CoE service profile along with a sound technology foundation.

However, even the mature IT organizations adopt a trail-and-error approach to defining, managing and executing the operations of their Performance CoE. Such an approach throws up perennial issues with respect to the following:

  1. The precise nature of the relationship between the CoE and its consumers is often ill-understood, and the scope of the work and the deliverables that the CoE commits to is consequently ill-defined. The result is much finger pointing and firefighting that could have been avoided.
  2. The core element of a scientific technology foundation in the area of software performance lies in some important quantitative techniques. This poses an entry barrier to practitioners, and there are few practicing subject matter experts available for help.
  3. Industry-standard approaches for performance testing or benchmarking are restricted to the scope of a specific platform or technology. However, the bulk of any performance engineering approach or methodology is platform-agnostic and this is, perhaps paradoxically, not covered by industry standards.

So, what are the essential ingredients for setting up and running a successful Performance CoE? In this tutorial, the anchors address both the technical as well as the management aspects of this question using representative real-life scenarios and case studies.

   

Speaker's Background

Rajeshwari G has over 11 years of IT industry experience. Her area of specialization is performance engineering. She has over 25 research papers in PE, and many of these have been published in international conferences and journals. She also has two filed U.S. patents. In her previous position at Infosys Technologies Ltd., she was Head, Performance Engineering group, where she spearheaded the conceptualization, implementation and deployment of the PE framework. She also has vast experience in consulting for several key Infosys customers in this area. Her primary interest in PE has been the detection and modeling of self-similar workloads in HTTP traffic, and using these models to provide fresh perspectives into, and improve the accuracy of, system sizing.

Ramkumar Ramaswamy has a PhD in Operations Research from Indian Institute of Management, Calcutta, and over 12 years of IT industry experience. His experience spans technology consulting, software performance engineering research, and education. He has led CIO-level technology consulting engagements for several Fortune 1000 clients in multiple domains including manufacturing, distribution, and financial services. He has published papers in a variety of reputed journals such as IEEE Transactions on Systems, Man and Cybernetics, IEEE Software, IEEE Distributed Systems and Mathematical Programming. In his previous position he was Associate Vice President and Head, Technology Consulting for the Transportation and Services vertical of Infosys Technologies Ltd. Ramkumar's primary interest lies in bringing formalized approaches to enterprise architecture definition and modeling.