A Forrester Total Economic Impact™ Study Commissioned By IBM, November 2024
As business processes become more complex, organizations face a growing need for seamless integration between different systems and applications. IBM Integration, powered by webMethods, unifies multiple integration capabilities, including application integration, B2B, managed file transfer, and events, into a single, comprehensive platform. By addressing these integration challenges, webMethods helps businesses optimize their processes, eliminate data siloes, and improve productivity.
Powered by webMethods, IBM Integration addresses the challenges of connecting and integrating diverse systems and applications. With its comprehensive set of tools and capabilities, webMethods simplifies integration projects and provides a scalable solution for managing complex business workflows.
Forrester research highlights how organizations with a mix of modern and legacy operational systems can leverage integration platforms to revitalize their tech stack: “Legacy operational systems struggle to keep up with modern business needs, but rip-and-replace is often too costly. A proper integration architecture centered on business interfaces provides a way forward. Middleware such as APIs, event brokers, and integration platform as a service (iPaaS) are key tools in building an architecture that creates efficient ways to modernize legacy systems.”1
IBM commissioned Forrester Consulting to conduct a Total Economic Impact™ (TEI) study and examine the potential return on investment (ROI) enterprises may realize by deploying webMethods.2 The purpose of this study is to provide readers with a framework to evaluate the potential financial impact of webMethods on their organizations.
To better understand the benefits, costs, and risks associated with this investment, Forrester interviewed five representatives with experience using webMethods. For the purposes of this study, Forrester aggregated the interviewees’ experiences and combined the results into a single composite organization that is an organization with $8 billion in annual revenue and 15,000 employees.
generates $0 in annual revenue, performs 0 integration projections in Year 1, and eliminates $0 in legacy solutions costs with IBM webMethods. Custom results are based on your inputs and the TEI case study.
Some interviewees reported that before adopting webMethods, they had disparate integration tools that had limited functionalities and were not the comprehensive integration solutions that they needed. The interviewees said that prior to implementing webMethods, their organizations had data siloed across platforms, making it difficult to complete or automate everyday business processes. Building integrations was a slow and error-prone process, and many of the integrations that they did develop were custom-built and difficult to scale. The interviewees’ organizations also lacked a centralized view into their integrations, leaving them unable to identify production issues and vulnerable to application performance degradation.
The interviewees’ organizations adopted multiple webMethods integration capabilities, including application integration, API management, B2B integration, and managed file transfer. After the investment, the interviewees’ organizations were able to leverage webMethods’ user-friendly interface, reusable templates, and vast library of prebuilt connectors to significantly reduce the amount of time required to complete integration projects. The interviewees also reported that the visibility, testing capabilities, and automatic updates provided by webMethods enabled their organizations to improve application reliability. By moving to webMethods, the interviewees’ organizations were also able to consolidate technologies and vendors, leading to substantial cost savings.
Quantified benefits. Three-year, risk-adjusted present value (PV) quantified benefits for the composite organization include:
For , this benefit could be worth over three years.
For , this benefit could be worth over three years.
For , this benefit could be worth over three years.
Unquantified benefits. Benefits that provide value for the composite organization but are not quantified for this study include:
Costs. Three-year, risk-adjusted PV costs for the composite organization include:
For , this cost could be over three years.
For , this cost could be over three years.
The representative interviews and financial analysis found that a composite organization experiences benefits of $3.81 million over three years versus costs of $1.38 million, adding up to a net present value (NPV) of $2.43 million and an ROI of 176%.
Return on investment (ROI)
Benefits PV
Net present value (NPV)
Payback
From the information provided in the interviews, Forrester constructed a Total Economic Impact™ framework for those organizations considering an investment in webMethods.
The objective of the framework is to identify the cost, benefit, flexibility, and risk factors that affect the investment decision. Forrester took a multistep approach to evaluate the impact that webMethods can have on an organization.
Interviewed IBM stakeholders and Forrester analysts to gather data relative to webMethods.
Interviewed five representatives from four organizations using webMethods to obtain data about costs, benefits, and risks.
Designed a composite organization based on characteristics of the interviewees’ organizations.
Constructed a financial model representative of the interviews using the TEI methodology and risk-adjusted the financial model based on issues and concerns of the interviewees.
Employed four fundamental elements of TEI in modeling the investment impact: benefits, costs, flexibility, and risks. Given the increasing sophistication of ROI analyses related to IT investments, Forrester’s TEI methodology provides a complete picture of the total economic impact of purchase decisions. Please see Appendix A for additional information on the TEI methodology.
Readers should be aware of the following:
This study is commissioned by IBM and delivered by Forrester Consulting. It is not meant to be used as a competitive analysis.
Forrester makes no assumptions as to the potential ROI that other organizations will receive. Forrester strongly advises that readers use their own estimates within the framework provided in the study to determine the appropriateness of an investment in webMethods. For the interactive functionality using Configure Data/Custom Data, the intent is for the questions to solicit inputs specific to a prospect’s business. Forrester believes that this analysis is representative of what companies may achieve with webMethods based on the inputs provided and any assumptions made. Forrester does not endorse IBM or its offerings. Although great care has been taken to ensure the accuracy and completeness of this model, IBM and Forrester Research are unable to accept any legal responsibility for any actions taken on the basis of the information contained herein. The interactive tool is provided ‘AS IS,’ and Forrester and IBM make no warranties of any kind.
IBM reviewed and provided feedback to Forrester, but Forrester maintains editorial control over the study and its findings and does not accept changes to the study that contradict Forrester’s findings or obscure the meaning of the study.
IBM provided the customer names for the interviews but did not participate in the interviews.
Consulting Team:
Matt Dunham
Sam Conway
Role | Industry | Geography | Annual Revenue |
---|---|---|---|
Enterprise integration lead | Networking technology | Global | $5 billion |
Head of application integration Integration architect |
Telecommunications | Global | >$20 billion |
Business analyst | Logistics | US | $100 million |
Integration architect | Industrial manufacturing | EMEA | $1 billion |
Most of the interviewees said their organizations had previously used integration tools, but they reported that the incumbent tools had limited functionalities and did not have comprehensive tooling to meet all their integration requirements. The interviewees noted how their organizations struggled with common challenges, including:
The interviewees’ organizations searched for a solution that could:
Based on the interviews, Forrester constructed a TEI framework, a composite company, and an ROI analysis that illustrates the areas financially affected. The composite organization is representative of the five interviewees, and it is used to present the aggregate financial analysis in the next section. The composite organization has the following characteristics:
Description of composite. The composite organization is a global firm with $8 billion in annual revenue and 15,000 employees. The composite begins using webMethods in Year 1, following a three-month implementation period. In Year 1, it performs 40 integration projects on webMethods. The organization conducts 45 and 50 integration projects in Years 2 and 3, respectively.
generates $0 in annual revenue, performs 0 integration projections in Year 1, and eliminates $0 in legacy solutions costs with IBM webMethods. Custom results are based on your inputs and the TEI case study.
Ref. | Benefit | Year 1 | Year 2 | Year 3 | Total | Present Value |
---|---|---|---|---|---|---|
Atr | Integration time savings | $431,308 $431,308 | $485,222 $485,222 | $539,134 $539,134 | $1,455,664 $1,455,664 | $1,198,167 $1,198,167 |
Btr | Reduced downtime | $512,000 $512,000 | $512,000 $512,000 | $512,000 $512,000 | $1,536,000 $1,536,000 | $1,273,268 $1,273,268 |
Ctr | Technology and vendor consolidation cost savings | $540,000 $540,000 | $540,000 $540,000 | $540,000 $540,000 | $1,620,000 $1,620,000 | $1,342,900 $1,342,900 |
Total benefits (risk-adjusted) | $1,483,308 $1,483,308 | $1,537,222 $1,537,222 | $1,591,134 $1,591,134 | $4,611,664 $4,611,664 | $3,814,335 $3,814,335 | |
Evidence and data. Interviewees shared that using webMethods helped their organizations develop integrations faster than they were able to previously.
Modeling and assumptions. Based on the interviews, Forrester assumes the following about the composite organization:
Risks. The integration time savings will vary depending on:
Results. To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $1.2 million.
For , this benefit may have a three-year, risk-adjusted total PV of .
The following table shows custom results for .
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|
A1 | Total number of integration projects annually | CompositeComposite | 4040 | 4545 | 5050 | |
A2 | Share of integration projects that are complex | CompositeTEI case study | 20%20% | 20%20% | 20%20% | |
A3 | Number of complex integration projects per year | A1*A2 | 88 | 99 | 1010 | |
A4 | Time to complete a complex integration project prior to adopting webMethods (months) | InterviewsInterviews | 33 | 33 | 33 | |
A5 | Reduction in time to complete a complex integration with webMethods | InterviewsTEI case study | 33%33% | 33%33% | 33%33% | |
A6 | Number of developers required per integration project | InterviewsTEI case study | 33 | 33 | 33 | |
A7 | Fully burdened annual salary for an application integration specialist | CompositeTEI standard | $175,000$175,000 | $175,000$175,000 | $175,000$175,000 | |
A8 | Subtotal: Annual time savings on complex integration projects | A3*A4*A5*A6*(A7/12 months) | $350,000$350,000 | $393,750$393,750 | $437,500$437,500 | |
A9 | Number of simple integration projects per year | A1-A3 | 3232 | 3636 | 4040 | |
A10 | Time to complete a simple integration project prior to adopting webMethods (days) | InterviewsInterviews | 33 | 33 | 33 | |
A11 | Reduction in time to complete a simple integration project with webMethods | InterviewsTEI case study | 67%67% | 67%67% | 67%67% | |
A12 | Subtotal: Time savings on simple integration projects | A9*A10*A11*A6*(A7/260 days) | $129,231$129,231 | $145,385$145,385 | $161,538$161,538 | |
At | Integration time savings | A8+A12 | $479,231$479,231 | $539,135$539,135 | $599,038$599,038 | |
Risk adjustment | ↓10% | |||||
Atr | Integration time savings (risk-adjusted) | $431,308 $431,308 | $485,222 $485,222 | $539,134 $539,134 | ||
Three-year total: $1,455,664 $1,455,664 | Three-year present value: $1,198,167 $1,198,167 |
Evidence and data. Interviewees shared that webMethods helped their organizations improve application reliability, preventing them from incurring downtime costs.
Modeling and assumptions. Based on the interviews, Forrester assumes the following about the composite organization:
Risks. The application downtime reduction will vary depending on:
Results. To account for these risks, Forrester adjusted this benefit downward by 20%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $1.3 million.
For , this benefit may have a three-year, risk-adjusted total PV of .
The following table shows custom results for .
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|
B1 | Annual application downtime before webMethods (hours) | CompositeComposite | 4040 | 4040 | 4040 | |
B2 | Percentage of applications that are business-critical | CompositeTEI case study | 10%10% | 10%10% | 10%10% | |
B3 | Average hourly cost of downtime | TEI case studyScaled to annual revenue | $400,000$400,000 | $400,000$400,000 | $400,000$400,000 | |
B4 | Downtime reduction with webMethods | InterviewsTEI case study | 40%40% | 40%40% | 40%40% | |
Bt | Reduced downtime | B1*B2*B3*B4 | $640,000 $640,000 | $640,000 $640,000 | $640,000 $640,000 | |
Risk adjustment | ↓20% | |||||
Btr | Reduced downtime (risk-adjusted) | $512,000 $512,000 | $512,000 $512,000 | $512,000 $512,000 | ||
Three-year total: $1,536,000 $1,536,000 | Three-year present value: $1,273,268 $1,273,268 |
Evidence and data. Interviewees reported that they were able to consolidate around webMethods and eliminate various tools from other vendors.
Modeling and assumptions. Based on the interviews, Forrester assumes that the composite organization eliminates its incumbent integration tools, resulting in a savings of $600,000 annually.
Risks. The system consolidation cost savings will vary depending on:
Results. To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $1.3 million.
For , this benefit may have a three-year, risk-adjusted total PV of .
The following table shows custom results for .
Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|
C1 | Total legacy costs eliminated with webMethods | InterviewsInterviews | $600,000$600,000 | $600,000$600,000 | $600,000$600,000 | |
Ct | Technology and vendor consolidation cost savings | C1 | $600,000 $600,000 | $600,000 $600,000 | $600,000 $600,000 | |
Risk adjustment | ↓10% | |||||
Ctr | Legacy cost savings (risk-adjusted) | $540,000 $540,000 | $540,000 $540,000 | $540,000 $540,000 | ||
Three-year total: $1,620,000 $1,620,000 | Three-year present value: $1,342,900 $1,342,900 |
Interviewees mentioned the following additional benefits that their organizations experienced but were not able to quantify:
Ref. | Cost | Initial | Year 1 | Year 2 | Year 3 | Total | Present Value |
---|---|---|---|---|---|---|---|
Dtr | Licensing | $0 $0 | $535,500 $535,500 | $535,500 $535,500 | $535,500 $535,500 | $1,606,500 $1,606,500 | $1,331,709 $1,331,709 |
Etr | Implementation effort | $48,125 $48,125 | $0 $0 | $0 $0 | $0 $0 | $48,125 $48,125 | $48,125 $48,125 |
Total costs (risk-adjusted) | $48,125 $48,125 | $535,500 $535,500 | $535,500 $535,500 | $535,500 $535,500 | $1,654,625 $1,654,625 | $1,379,834 $1,379,834 | |
Evidence and data. Interviewees’ organizations incurred licensing costs for using webMethods with most of their costs varying based on the number of transactions. With the transaction-based pricing, interviewees’ organizations paid only for what they consumed, enabling them to scale their integration solutions to meet specific business demands without incurring unnecessary expenses. The integration architect at an industrial manufacturer praised the pricing structure: “The transaction-based license is more effective for us because we can start very low at the beginning and then we can grow as we do more. It’s easier to manage and measure.”
Modeling and assumptions. The composite organization incurs transaction-based licensing costs of $510,000 per year.
Risks. Licensing costs will vary depending on an organization’s size and usage. Contact IBM for a more detailed pricing estimate.
Results. To account for these risks, Forrester adjusted this cost upward by 5%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $1.3 million.
For , fees to IBM may have a three-year, risk-adjusted total PV of .
The following table shows custom results for .
Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|---|
D1 | Annual licensing costs | InterviewsInterviews | $0$0 | $510,000$510,000 | $510,000$510,000 | $510,000$510,000 | |
Dt | Licensing | D1 | $0 $0 | $510,000 $510,000 | $510,000 $510,000 | $510,000 $510,000 | |
Risk adjustment | ↑5% | ||||||
Dtr | Licensing (risk-adjusted) | $0 $0 | $535,500 $535,500 | $535,500 $535,500 | $535,500 $535,500 | ||
Three-year total: $1,606,500 $1,606,500 | Three-year present value: $1,331,709 $1,331,709 |
Evidence and data. Interviewees reported that their organizations incurred internal labor costs for implementing webMethods.
Modeling and assumptions. For the composite organization, Forrester assumes the following:
Risks. The implementation effort costs will vary depending on:
Results. To account for these risks, Forrester adjusted this cost upward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $48,000.
For , implementation and startup costs may have a three-year, risk-adjusted total PV of .
The following table shows custom results for .
Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 | |
---|---|---|---|---|---|---|---|
E1 | Length of implementation (months) | CompositeTEI case study | 33 | ||||
E2 | FTEs required for implementation | CompositeScaled to A1 | 22 | ||||
E3 | Percentage of time spent on implementation | CompositeTEI case study | 50%50% | ||||
E4 | Fully burdened annual salary for an FTE | CompositeTEI standard | $175,000$175,000 | ||||
Et | Implementation effort | (E1/12 months)*E2*E3*E4 | $43,750 $43,750 | $0 $0 | $0 $0 | $0 $0 | |
Risk adjustment | ↑10% | ||||||
Etr | Implementation effort (risk-adjusted) | $48,125 $48,125 | $0 $0 | $0 $0 | $0 $0 | ||
Three-year total: $48,125 $48,125 | Three-year present value: $48,125 $48,125 |
The financial results calculated in the Benefits and Costs sections can be used to determine the ROI, NPV, and payback period for the composite organization’s investment. Forrester assumes a yearly discount rate of 10% for this analysis.
These risk-adjusted ROI, NPV, and payback period values are determined by applying risk-adjustment factors to the unadjusted results in each Benefit and Cost section.
Initial | Year 1 | Year 2 | Year 3 | Total | Present Value | |
---|---|---|---|---|---|---|
Total costs | ($48,125)($48,125) | ($535,500)($535,500) | ($535,500)($535,500) | ($535,500)($535,500) | ($1,654,625)($1,654,625) | ($1,379,834)($1,379,834) |
Total benefits | $0 $0 | $1,483,308 $1,483,308 | $1,537,222 $1,537,222 | $1,591,134 $1,591,134 | $4,611,664 $4,611,664 | $3,814,335 $3,814,335 |
Net benefits | ($48,125)($48,125) | $947,808 $947,808 | $1,001,722 $1,001,722 | $1,055,634 $1,055,634 | $2,957,039 $2,957,039 | $2,434,501 $2,434,501 |
ROI | 176%176% | |||||
Payback | <6<6 | |||||
Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists vendors in communicating the value proposition of their products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of IT initiatives to both senior management and other key business stakeholders.
Benefits represent the value delivered to the business by the product. The TEI methodology places equal weight on the measure of benefits and the measure of costs, allowing for a full examination of the effect of the technology on the entire organization.
Costs consider all expenses necessary to deliver the proposed value, or benefits, of the product. The cost category within TEI captures incremental costs over the existing environment for ongoing costs associated with the solution.
Flexibility represents the strategic value that can be obtained for some future additional investment building on top of the initial investment already made. Having the ability to capture that benefit has a PV that can be estimated.
Risks measure the uncertainty of benefit and cost estimates given: 1) the likelihood that estimates will meet original projections and 2) the likelihood that estimates will be tracked over time. TEI risk factors are based on “triangular distribution.”
The initial investment column contains costs incurred at “time 0” or at the beginning of Year 1 that are not discounted. All other cash flows are discounted using the discount rate at the end of the year. PV calculations are calculated for each total cost and benefit estimate. NPV calculations in the summary tables are the sum of the initial investment and the discounted cash flows in each year. Sums and present value calculations of the Total Benefits, Total Costs, and Cash Flow tables may not exactly add up, as some rounding may occur.
Related Forrester Research
Breathe New Life Into Legacy Operational Systems With Integration Best Practices, Forrester Research, Inc., November 16, 2023.
1 Source: Breathe New Life Into Legacy Operational Systems With Integration Best Practices, Forrester Research, Inc., November 16, 2023.
2 Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists vendors in communicating the value proposition of their products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of IT initiatives to both senior management and other key business stakeholders.
Cookie Preferences
Accept Cookies
A cookie is a small text file that a website saves on your computer or mobile device when you visit the site. It enables the website to remember your actions (data inputs, website navigation), so you don’t have to re-enter data when you come back to the site or browse from one page to another.
Behavioral information collected by our web analytics vendor is used to analyze data pertaining to visitor trends, plan website enhancements, and measure overall website effectiveness. We may also use cookies or web beacons to help us offer you products, programs, or services that may be of interest to you and to deliver relevant advertising. We may use third-party advertising companies to help tailor website content to users or to serve ads on our behalf. These companies may also employ cookies and web beacons to measure advertising effectiveness.
Please accept cookies and the collection of behavioral information to receive full functionality and enhance your experience. If you decline cookies, some features of the website may not function normally.
Please see our
Privacy Policy for more information.
https://mainstayadvisor.com/go/mainstay/gdpr/policy.html