Business Value of Outsourced Product Testing

Introductionbenchmarking current performance thoroughly and
The recent sharp downturn in the economy is forcingprepare detail business case to ensure that the
independent software vendors to reconsider theirprovider delivers a tangible return on investment
approach towards product engineering. In light of the- Do not focus only on cost reduction. Take a strategic
new business realities, companies are forced toview of the engagement and select a partner rather
consider how they can reduce their R&D budget,than a vendor. This will ensure that you gain other
or get higher return on the same or incrementaltangible and intangible benefits
investments. However, it is becoming increasingly- Give proper importance to outsourcing location.
important for ISVs to enhance customer loyalty andEvaluate parameters such as past history, availability
reduce support cost! ISVs are realizing that one wayof skilled manpower, language capability, political
to achieve this is by improving the quality of thestability, stable economy, etc., along with cost
product without increasing the cost of quality.structures
Consequently, ISVs are actively consideringOutsourcing Benefit
outsourcing non-core functions like testing to cut costsCost savings, though a major result, is not the only
quickly, avoid new capital investment, and improvebenefit of outsourced product testing. Benefits from an
product quality.outsourced product testing initiative become more
Why Outsource Product Testingsignificant when combined with a global delivery model
Testing is a vital phase in any product developmentand right-sourcing model. In addition, companies that
initiative. Frequently changing requirements coupled withhave already out sourced their product development
a reduced product development life cycle hasprocess will be benefited by using an independent third
increased the pressure on testing teams to do moreparty for testing. Here the testing partner works as a
at less. They face time crunch as well as resourcecertifying authority, providing unbiased insights into
crunch. A survey conducted by the National Institute ofimproving product quality. Following are the benefits
Standards and Technology (NIST) has found that USthat come out as a result of a successful outsourced
companies spend as much as $60 billion on fixingproduct testing initiative.
software defects at the post-release stage. This- Higher return on QA investment: ROI of a product
study also reveals that third party QA & Testingquality initiative includes the savings occurred due to
could have saved companies nearly $20 billion. Thedecreased rework, increased customer satisfaction,
direct cost of quality in terms of staff time by itself is alower support costs, and decreased product
compelling reason for considering QA & Testingmaintenance cost. An outsourced product testing
outsourcing model. Though it is difficult to measure, theprogram, if executed successfully using an offshore/
loss of revenue in terms of repeat business, due todual-shore model, not only lowers the cost of testing
unhappy customers, is also significant. A wellby reducing staff cost, but also helps to increase
structured outsourcing model can help ISVs reduceproduct quality. A company can save up to 40% in
cost (by using less expensive resources) and increasedirect staff cost and another 10-20% in associated
the quality of the product, which ultimately results incosts through outsourcing model.
satisfied customers. Migrating to an outsourced- Shorter Revenue Realization Cycle: Outsourced
product testing model, where the onus of productproduct testing can help reduce time to market with
quality is shared with the participating testing company,the usage of additional skilled resources and test
will give product companies a competitive advantageautomation. This helps the company to reach market
in the marketplace.faster and protect/create competitive advantage.
Current Situation - However, as per a Forrester reportHence, outsourced product testing initiative helps
published in 2008, despite the enormous potentialcompanies shorten their revenue realization cycle,
benefits of outsourcing, not many organizationswhich means they can achieve more with less capital
currently outsource their testing activities. According toor invest the free resources in growth related
a survey of IT leaders, only 16% of organizationsinitiatives.
outsource software testing while 16% expect to- Improved Efficiency: If properly planned, a well
outsource to a third party in the next 12 months.defined outsourced testing engagement can bring
Though another 29% were considering using a thirdimprovements in quality and delivery processes.
party for this service, a substantial 39% were not inOutsourcing engagements are governed by defined
favour of using this service. While this is one side ofPerformance Metrics (PM) and Service Level
the story, the outsourced testing market is actuallyAgreements (SLA). Outsourced testing service
experiencing a rapid growth, and according to theproviders have formal and proven testing
same Forrester report, outsourced testing services ismethodologies rather than heuristic or experiential
growing at 50% annually or higher. There is a growingtechniques to identify, generate, and execute test
awareness that software product testing is acases. These formal methodologies provide for
specialized skill, and cannot be accomplished merely byenhanced coverage and defect identification resulting
any developer. But it is becoming increasingly difficultin an improvement in product quality. Clients can benefit
for CTOs to allocate enough funds to hire expertfrom working with outsourced testing companies by
resources, or train the existing resources to meet thesharing best practices and investing in process
demand. As a consequence, product quality isimprovement initiatives.
increasingly being compromised.- Flexible Scale: The testing lifecycle is characterized
Offshore outsourcingby staffing peaks and troughs. Managing this variation
Though ISVs are slowly getting convinced about theof utilization becomes a challenge for in-house testing
benefit of outsourcing their QA activities to offshoredepartments. This always results in either lower
partners, in most of the cases they merely treat thisutilization (higher cost) or non availability of skilled
as a cost saving measure. Offshore outsourcing ofresourced when required most. But in an outsourced
product testing, if treated strategically, can yield moreproduct testing scenario, managing the ebb and flow of
than just cost benefit. However, treating offshoring asresources becomes the responsibility of the testing
process of simply moving existing software productpartner. Hence, outsourced product testing provides a
testing to an offshore outsource partner may bemuch needed degree of flexibility to the client
counter-productive. Executives making the decision toOrganisation, and allows them to focus on product
offshore testing must draw the strategic plan fordesign and development activities.
outsourcing, define their goal, and last but not the least,- Independence and Insight: Good software
must understand the possible pitfalls of outsourcing.development practice calls for separating the
This will enable them gain maximum from theirdevelopment team from the testing team. The primary
outsourcing initiative.purpose behind this separation is to provide an
Challenges Faced in Outsourced Product Testingunbiased view of the product quality. In many cases,
Activitiesthese checks and balances are compromised due to
We all know that product development, being a moreconstraints like product release pressure, same team
intense & involved process, differs fromworking for both development and testing, absence of
application development. Similar is the case of productany proper certification process, etc. Outsourced
testing. Hence, outsourced product testing comes withproduct testing brings a certain degree of
its own set of challenges. Some of the majorindependence, leading to greater visibility of product
challenges faced in outsourced product testing are:quality issues. This unbiased and independent insight
- Partner integration: Success of an outsourcedhelps the product management team to make more
product testing initiative is based on the integration ofinformed business decisions on product release
methodology, usage of proper tools &schedule and product quality.
technologies, and a right-sourcing approach. It is easierIn a distributed development scenario, when product
said than done. And is normally is the primary reasondevelopment is outsourced, an outsourced testing
for failure of such initiatives.team becomes even more valuable. The outsourced
- Proper communications management: Due totest team serves as the certification authority,
language and cultural barriers, time-zone difference,providing for an unbiased third view, which is
physical distance, and poor processes, many times itindependent from client's Organization and the
becomes difficult to have an effective communicationoutsourced development Organization. This evaluation
process.is more objective as it is delivered independent of two
- Mismatched or miscommunication of expectations:reference points.
Absence of a well-defined goal and an ineffectiveConclusion
oversight process, along with poor communication, canOutsourced Product Testing is not a new idea -
create difference in expectationscurrent economic situation has made it more
- Lack of product engineering focus: Most of theappropriate and attractive. Over a period of time, the
offshore vendors are application service providers.process also has become mature and you have more
Hence, they do not have the required expertise orofferings available from service providers. The current
more importantly, the necessary product mindset toeconomy, customer's intolerance towards product
test a productquality issues, and new competitions are leading more
- Management issues due to the lack of a workableproduct companies to adopt the outsourced product
test management process and associatedtesting initiative. Outsourced testing service providers,
methodologywho compete with one another and whose core
- Vendor problems or vendor infrastructure problemsbusiness is to provide these services, have also made
such as poor data bandwidth.an investment to go up the value chain by developing
- IPR protection concernsreusable IP in the form of automated testing
Overcoming the Challengesframeworks and employing the necessary skilled
Many of the barriers associated with Outsourcedresources to serve customers and maintain their
Product Testing activities, as mentioned above, can becompetitive edge. These service providers have
overcome by selecting an experienced and reliablebecome more efficient over a period of time, and
testing partner with requisite product engineeringoffer services faster, better and more cost-effectively
expertise, quality orientation, structured processes,compared to an in-house function.
proven credentials, and an impeccable record onThe current recessionary state is opening up a
protecting its customer's IP. This will ensure thatstrategic option for leaders: free up scarce cash for
product engineering principles are in use and bestdeployment elsewhere to focus on core capabilities.
practices are consistently applied. Cost advantagesWe see a greater flexibility in offerings from
are achieved through various means such as -outsourced test service providers, and an overall
optimization of the testing process, test automation,increased receptiveness to outsourcing in general by
leveraging low-cost test centres. When successfullyOrganizations. Globalization (aka flattening of the world)
planned and executed, outsourced product testing canhas also resulted in product companies seeking new
reduce the overall product engineering cost by 40% orways of doing business, learning new techniques,
more, as well as shortening the time to market andoptimizing the software manufacturing process, and
improve overall software quality. But to ensure themaking funds available for global initiatives. This makes
best possible results from product testing outsourcingthe business case for outsourced product testing
initiative, you must:more appealing as it enables organizations to free up
- Hire specialist companies to conduct product testing,both its cash and critical resources and have a partner
These companies should have strong background andcare for its quality. Outsourced product testing offers a
proven track record in providing Product Engineeringstrategic option to ISVs to be prepared to scale new
Servicesheights when market conditions improve.
- Plan the process thoroughly. Invest time upfront in