A Forrester Total Economic Impact™ Study Commissioned By smartShift, May 2023
With the transition to SAP's S/4HANA product, SAP customers run the risk of incurring high time and labor costs for the various processes that make up a complete transformation. Customers may want to look toward automation, such as that provided by smartShift, that can reduce the costs associated with custom code transformation, dual maintenance, custom code maintenance, and the risk of business interruption.
smartShift offers automated solutions for custom SAP code transformation, dual maintenance, and carve-out and consolidation of SAP systems. smartShift solutions can also be used to run performance remediation on SAP systems, and to run security remediation.
smartShift commissioned Forrester Consulting to conduct a Total Economic Impact™ (TEI) study and examine the potential return on investment (ROI) enterprises may realize by deploying smartShift for SAP code transformation1. The purpose of this study is to provide readers with a framework to evaluate the potential financial impact of smartShift on their organizations.
To better understand the benefits, costs, and risks associated with this investment, Forrester interviewed four representatives with experience using smartShift for SAP code transformation. For the purposes of this study, Forrester aggregated the interviewees’ experiences and combined the results into a single composite organization that is a global organization with 180,000 employees, $86 billion in revenues, and three SAP systems needing to undergo code transformation.
Prior to using smartShift for SAP code transformation, these interviewees noted how their organizations either incurred or expected to incur high costs associated with running manual code transformation for their SAP S/4HANA conversions. Manual processes also introduced unnecessary risk of code errors and security breaches. The interviewees also lacked experience, given such transformations are once-in-a-career events, and looked to smartShift as an expert to guide them.
After the investment in smartShift for SAP code transformation, the interviewees avoided substantial costs that they were incurring during their manual transformation processes, reduced the costs of maintaining, upgrading, and testing custom code, a portion of which was decommissioned, reduced the costs of dual maintenance via automation, and were able to continue critical projects in parallel, which may not have been possible otherwise.
Quantified benefits. Three-year, risk-adjusted present value (PV) quantified benefits for the composite organization include:
Unquantified benefits. Benefits that provide value for the composite organization but are not quantified in this study include:
Costs. Three-year, risk-adjusted PV costs for the composite organization include:
The representative interviews and financial analysis found that a composite organization experiences benefits of $17.87 million over three years versus costs of $5.07 million, adding up to a net present value (NPV) of $12.81 million and an ROI of 253%
Return on investment (ROI)
Benefits PV
Net present value (NPV)
Payback
From the information provided in the interviews, Forrester constructed a Total Economic Impact™ framework for those organizations considering an investment in smartShift for SAP code transformation.
The objective of the framework is to identify the cost, benefit, flexibility, and risk factors that affect the investment decision. Forrester took a multistep approach to evaluate the impact that smartShift for SAP code transformation can have on an organization.
Interviewed smartShift stakeholders and Forrester analysts to gather data relative to smartShift for SAP code transformation.
Interviewed four representatives at organizations using smartShift for SAP code transformation to obtain data with respect to costs, benefits, and risks.
Designed a composite organization based on characteristics of the interviewees’ organizations.
Constructed a financial model representative of the interviews using the TEI methodology and risk-adjusted the financial model based on issues and concerns of the interviewees.
Employed four fundamental elements of TEI in modeling the investment impact: benefits, costs, flexibility, and risks. Given the increasing sophistication of ROI analyses related to IT investments, Forrester’s TEI methodology provides a complete picture of the total economic impact of purchase decisions. Please see Appendix A for additional information on the TEI methodology.
Readers should be aware of the following:
This study is commissioned by smartShift and delivered by Forrester Consulting. It is not meant to be used as a competitive analysis.
Forrester makes no assumptions as to the potential ROI that other organizations will receive. Forrester strongly advises that readers use their own estimates within the framework provided in the study to determine the appropriateness of an investment in smartShift for SAP code transformation
smartShift reviewed and provided feedback to Forrester, but Forrester maintains editorial control over the study and its findings and does not accept changes to the study that contradict Forrester’s findings or obscure the meaning of the study.
smartShift provided the customer names for the interviews but did not participate in the interviews.
Consulting Team:
Nick Mayberry
| Organization or Industry | Name and/or Role | Region | Use Cases |
|---|---|---|---|
| BMW Group | SAP manager | Global | SAP S/4HANA transformation, dual maintenance, upgrades, system consolidation, security remediation |
| Jabil | Cynthia Kendall, IT director | Global | SAP S/4HANA transformation, dual maintenance, performance remediation |
| JBS Foods | Colin Cole, IT director | North America | SAP S/4HANA transformation, dual maintenance |
| Procter & Gamble | Bruno Pont, Senior director | Global | SAP S/4HANA transformation, dual maintenance |
Before smartShift, three of the interviewees’ organizations had already begun their transformation process via manual effort, whether from internal employees or external consultants. The remaining organization engaged with smartShift from the earliest stages of its transformation.
The interviewees noted how their organizations struggled with common challenges, including:
Based on the interviews, Forrester constructed a TEI framework, a composite company, and an ROI analysis that illustrates the areas financially affected. The composite organization is representative of four interviewees, and it is used to present the aggregate financial analysis in the next section. The composite organization has the following characteristics:
Description of composite. The composite is a large global organization with $86 billion in revenue and 180,000 total employees. It has three SAP systems that need to be transformed: one deployed in 2003, one deployed in 2015, and a third that was acquired via a business combination. Each of these are brownfield conversions from SAP ECC to SAP S/4HANA.
Deployment characteristics. The relevant characteristics of the composite organization’s SAP systems are as follows:
| Ref. | Benefit | Year 1 | Year 2 | Year 3 | Total | Present Value |
|---|---|---|---|---|---|---|
| Atr | Avoided cost of manual code transformation | $9,688,909 | $0 | $625,091 | $10,314,000 | $9,277,739 |
| Btr | Reduced cost of unused custom code upgrading, maintenance, and testing | $1,439,046 | $1,439,046 | $1,530,900 | $4,408,992 | $3,647,706 |
| Ctr | Reduced costs of dual maintenance | $331,569 | $711,660 | $315,395 | $1,358,623 | $1,126,535 |
| Dtr | Avoided risk of business interruption | $3,100,962 | $930,288 | $310,096 | $4,341,346 | $3,820,869 |
| Total benefits (risk-adjusted) | $14,560,485 | $3,080,994 | $2,781,482 | $20,422,961 | $17,872,849 | |
Evidence and data. The core reason each interviewee decided to invest in smartShift was the ability to avoid the high costs associated with manually updating custom code during their transition from SAP ECC to SAP S/4HANA. Not only would using a manual approach require a lengthy timeline to complete, it also would necessitate the use of costly resources that might be better spent on other organizational initiatives.
For example, the SAP manager from BMW Group shared: “Based on our own trusted calculation, smartShift has saved us [tens of thousands of] person-days of manual work with their automated solution. This is a big benefit in and of itself, but we also usually only utilize external resources on these sorts of projects, which come at a higher cost, of course.”
Similarly, Ms. Kendall from Jabil stated: “Our avoided costs were a big deal. We estimated that it would take approximately 10 months of work for three dozen resources to complete the custom code transformation process manually.”
Mr. Cole from JBS Foods noted: “Our original plan was to do all of this manually. If we had continued down that path, it would have taken up to nine months of effort from up to 30 expensive ABAP development resources to transform our custom code.”
Finally, Mr. Pont from Procter & Gamble explained: “smartShift saved us on all manual work associated with our code transformation, among other workstreams.”
Despite the expected timeline length and resource cost with a manual approach, the interviewees shared that using smartShift’s automated approach to custom SAP code transformation substantially reduced timelines and costs.
For example, the SAP manager from BMW Group said, “smartShift completed our full SAP S/4HANA custom code remediation in four weeks, which included 20,000-plus custom objects.” Ms. Kendall from Jabil shared, “With smartShift, we remediated all custom code in five weeks, with 29,000 specific issues fixed in this time.” Mr. Pont from Procter & Gamble said, “smartShift transformed nearly 80,000 custom objects in approximately eight weeks, with guaranteed quality.”
Importantly, multiple interviewees noted that the importance of smartShift’s automated code transformation technology was not just that it led to cost savings. Rather, it had the added benefit of improving project predictability and the certainty of completion by their set deadlines, sometimes set two years in advance. This is covered in more detail in the Unquantified Benefits section below.
Modeling and assumptions. For the composite organization, Forrester models:
Risks. The avoided cost of manual code transformation will vary with:
Results. To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $9.3 million.
| Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |
|---|---|---|---|---|---|---|
| A1 | Person-hours avoided for System 1 | Interviews | 115,758 | 0 | ||
| A2 | Person-hours avoided for System 2 | Interviews | 63,667 | 0 | ||
| A3 | Person-hours avoided for System 3 | Interviews | 0 | 0 | 11,576 | |
| A4 | Average fully burdened hourly rate, ABAP developer | TEI standard | $60 | $60 | $60 | |
| At | Avoided cost of manual code transformation | (A1+A2+A3)*A4 | $10,765,455 | $0 | $694,545 | |
| Risk adjustment | ↓10% | |||||
| Atr | Avoided cost of manual code transformation (risk-adjusted) | $9,688,909 | $0 | $625,091 | ||
| Three-year total: $10,314,000 | Three-year present value: $9,277,739 | |||||
Evidence and data. In addition to reducing the time and cost to transform custom SAP ECC code to SAP S/4HANA code, smartShift automatically decommissioned any custom code that was no longer needed. This in turn eliminated the future cost of upgrading, maintaining, and testing this code, reducing overall costs for code maintenance.
For example, the SAP manager from BMW Group said: “smartShift helped us retire 9.5 million lines of custom code that was no longer needed. We [decommissioned] 863,000 custom code issues across 43 landscapes.”
Ms. Kendall from Jabil noted: “smartShift safely decommissioned a full 40% of our custom code, which amounted to 5,300 unused objects. This had a big impact on reducing our TCO since we estimate about $0.25 cost per line to maintain, update, and test this code annually.”
Mr. Cole from JBS Foods shared, “smartShift [decommissioned] 2.7 million lines of unused custom ABAP code, for about 25,000 objects, or about 30% to 50% of all our custom SAP code. This reduces the maintenance we need to do on this unused code. We have had hundreds of developers in the system over the years, and they must figure out this custom code every time there’s a problem or an enhancement. The less of this moving forward, the better.”
Modeling and assumptions. For the composite organization, Forrester models.
Risks. The reduced cost associated with decommissioning unused custom code will vary with:
Results. To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV of $3.6 million.
| Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |
|---|---|---|---|---|---|---|
| B1 | Total lines of custom code | Composite | 6,750,000 | 6,750,000 | 6,750,000 | |
| B2 | Percentage of custom code attributable to System 1 | Interviews | 61% | 61% | 61% | |
| B3 | Percentage of custom code attributable to System 2 | Interviews | 33% | 33% | 33% | |
| B4 | Percentage of custom code attributable to System 3 | Interviews | 0% | 0% | 6% | |
| B5 | Percentage of custom code decommissioned | Interviews | 40% | 40% | 40% | |
| B6 | Cost per line of code | Interviews | $0.63 | $0.63 | $0.63 | |
| Bt | Reduced cost of unused custom code upgrading, maintenance, and testing | B1*(B2+B3+B4)*B5+B6 | $1,598,940 | $1,598,940 | $1,701,000 | |
| Risk adjustment | ↓10% | |||||
| Btr | Reduced cost of unused custom code upgrading, maintenance, and testing (risk-adjusted) | $1,439,046 | $1,439,046 | $1,530,900 | ||
| Three-year total: $153,900 | Three-year present value: $150,400 | |||||
Evidence and data. In addition to automating custom code transformation during a conversion to SAP S/4HANA, smartShift also enabled interviewees’ organizations to automate dual maintenance. Dual maintenance is typically done manually, whereby development continues in the legacy system and resources are required to manually sync this to the project system to attain parity before the full transformation is complete. smartShift can automate this process, reducing costs and enabling developers to effectively continue other important work in parallel with the transformation effort.
For example, Ms. Kendall from Jabil shared: “Manual dual maintenance requires resources to both manage and run any updates to our SAP systems on both the legacy and new system. We were handling this via spreadsheets and a solution manager cockpit, but it was all just too much to effectively manage. There were always questions about what gets tested, what (if anything) has been remediated, etc. The smartShift tool took quite a load off of us during this process, reducing our dual maintenance costs by around 20%.”
Mr. Pont from Procter & Gamble added: “With smartShift automating dual maintenance, we no longer have to worry about keeping our systems in sync. We can run projects in parallel without hurting our time to market or the number of projects we do.”
Modeling and assumptions. For the composite organization, Forrester models:
Risks. The reduced cost of dual maintenance will vary with:
Results. To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV of $1.1 million.
| Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |
|---|---|---|---|---|---|---|
| C1 | Number of FTEs required for dual maintenance | Composite | 36 | 36 | 36 | |
| C2 | Percentage for System 1 | Interviews | 41% | 61% | 0% | |
| C3 | Percentage for System 2 | Interviews | 0% | 27% | 34% | |
| C4 | Percentage for System 3 | Interviews | 0% | 0% | 5% | |
| C5 | Reduction in dual maintenance costs | Interviews | 20% | 20% | 20% | |
| C6 | Average fully burdened annual rate for FTEs performing dual maintenance | A4*2,080 | $124,800 | $124,800 | $124,800 | |
| Ct | Reduced costs of dual maintenance | C1*(C2+C3+C4)*C5*C6 | $368,410 | $790,733 | $350,438 | |
| Risk adjustment | ↓10% | |||||
| Ctr | Reduced costs of dual maintenance (risk-adjusted) | $331,569 | $711,660 | $315,395 | ||
| Three-year total: $3,669,375 | Three-year present value: $3,010,272 | |||||
Evidence and data. In addition to cost reductions, smartShift’s automations enable organizations to continue operating their businesses as usual, avoiding code freezes and downtime associated with complex SAP transformations.
For example, Mr. Pont from Procter & Gamble said: “Our entire strategy for going with smartShift for our SAP S/4HANA transition was around maintaining zero business risk. We were able to run over 1,000 projects in parallel and do nearly 40,000 transports, keeping everything in sync while still being able to fully operate our SAP systems and, therefore, our business.”
Ms. Kendall from Jabil noted: “We ran a ‘near-zero-downtime’ process, but smartShift certainly helped indirectly with this. We didn’t miss any shipments coming in or going out, we met all the demands of our management, and were able to move everything over within a weekend’s time.”
Modeling and assumptions. For the composite organization, Forrester models:
Risks. The avoided risk of business impact will vary with:
Results. To account for these risks, Forrester adjusted this benefit downward by 25%, yielding a three-year, risk-adjusted total PV of $3.8 million.
| Ref. | Metric | Source | Year 1 | Year 2 | Year 3 | |
|---|---|---|---|---|---|---|
| D1 | Annual revenue | Composite | $86,000,000,000 | $86,000,000,000 | $86,000,000,000 | |
| D2 | Potential weeks of business interruption | Interviews | 1.0 | 0.3 | 0.1 | |
| D3 | Weekly revenue | D1/52*D2 | $1,653,846,154 | $496,153,846 | $165,384,615 | |
| D4 | Profit margin | Composite | 5% | 5% | 5% | |
| D5 | Avoided risk of business interruption | Assumption | 5% | 5% | 5% | |
| Dt | Avoided risk of business interruption | D1*D2*D3*D4 | $4,134,615 | $1,240,385 | $413,462 | |
| Risk adjustment | ↓25% | |||||
| Dtr | Avoided risk of business interruption (risk-adjusted) | $3,100,962 | $930,288 | $310,096 | ||
| Three-year total: $4,341,346 | Three-year present value: $3,820,869 | |||||
Interviewees mentioned the following additional benefits that their organizations experienced but were not able to quantify:
The value of flexibility is unique to each customer. There are multiple scenarios in which a customer might implement smartShift for SAP code transformation and later realize additional uses and business opportunities, including:
Flexibility would also be quantified when evaluated as part of a specific project (described in more detail in Appendix A).
| Ref. | Cost | Initial | Year 1 | Year 2 | Year 3 | Total | Present Value |
|---|---|---|---|---|---|---|---|
| Etr | Total smartShift fees | $0 | $3,925,750 | $840,000 | $768,000 | $5,533,750 | $4,840,088 |
| Ftr | Time cost of implementation and deployment | $54,912 | $0 | $0 | $0 | $54,912 | $54,912 |
| Gtr | Time cost of ongoing management | $0 | $68,640 | $68,640 | $68,640 | $205,920 | $170,698 |
| Total costs (risk-adjusted) | $54,912 | $3,994,390 | $908,640 | $836,640 | $5,794,582 | $5,065,698 | |
Evidence and data. smartShift charges separately for its code transformation, automated dual maintenance, and carve-out and consolidation solutions. The price itself is determined by the size of the SAP system undergoing transformation, as measured by the maximum number of objects to be transformed. In the case of dual maintenance, pricing is dependent on the length of dual maintenance as well as the maximum number of objects to be maintained quarterly.
Modeling and assumptions. For the composite organization, Forrester models:
Risks. Total smartShift fees will vary with:
Results. As the composite organization was priced directly with smartShift, there has been no risk adjustment made, yielding a three-year, total PV (discounted at 10%) of $4.8 million.
| Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|---|
| E1 | System 1 fees | smartShift | $0 | $2,769,750 | $0 | $0 |
| E2 | System 2 fees | smartShift | $0 | $1,156,000 | $840,000 | $0 |
| E3 | System 3 fees | smartShift | $0 | $0 | $0 | $768,000 |
| Et | Total smartShift fees | E1+E2+E3 | $0 | $3,925,750 | $840,000 | $768,000 |
| Risk adjustment | 0% | |||||
| Etr | Total smartShift fees (risk-adjusted) | $0 | $3,925,750 | $840,000 | $768,000 | |
| Three-year total: $5,533,750 | Three-year present value: $4,840,088 | |||||
Evidence and data. The interviewees noted incurring relatively minor time costs associated with implementation of smartShift. For example, internal teams needed to work with smartShift code reviews and change control processes.
Modeling and assumptions. For the composite organization, Forrester models:
Risks. The time cost of implementation and deployment will vary with:
Results. To account for these risks, Forrester adjusted this cost upward by 10%, yielding a three-year, risk-adjusted total PV of $55,000.
| Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|---|
| F1 | Number of IT professionals needed | Interviews | 4 | |||
| F2 | Hours to implement and deploy | Interviews | 208 | |||
| F3 | Average IT professional fully burdened hourly rate | TEI standard | $60 | |||
| Ft | Time cost of implementation and deployment | F1*F2*F3 | $49,920 | $0 | $0 | $0 |
| Risk adjustment | ↑10% | |||||
| Ftr | Time cost of implementation and deployment (risk-adjusted) | $54,912 | $0 | $0 | $0 | |
| Three-year total: $54,912 | Three-year present value: $54,912 | |||||
Evidence and data. The interviewees also noted incurring low time costs associated with ongoing management of smartShift. They relayed that no FTEs needed to be fully dedicated to this workstream.
Modeling and assumptions. For the composite organization, Forrester models:
Risks. The time cost of ongoing management may vary with very large numbers of transformations.
Results. To account for these risks, Forrester adjusted this cost upward by 10%, yielding a three-year, risk-adjusted total PV of $171,000.
| Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|---|
| G1 | Number of IT professionals | Interviews | 1 | 1 | 1 | |
| G2 | Percentage of time | Interviews | 50% | 50% | 50% | |
| G3 | Average IT professional fully burdened annual rate | F3*2,080 | $124,800 | $124,800 | $124,800 | |
| Gt | Time cost of ongoing management | G1*G2*G3 | $0 | $62,400 | $62,400 | $62,400 |
| Risk adjustment | ↑10% | |||||
| Gtr | Time cost of ongoing management (risk-adjusted) | $0 | $68,640 | $68,640 | $68,640 | |
| Three-year total: $205,920 | Three-year present value: $170,698 | |||||
The financial results calculated in the Benefits and Costs sections can be used to determine the ROI, NPV, and payback period for the composite organization’s investment. Forrester assumes a yearly discount rate of 10% for this analysis.
These risk-adjusted ROI, NPV, and payback period values are determined by applying risk-adjustment factors to the unadjusted results in each Benefit and Cost section.
| Initial | Year 1 | Year 2 | Year 3 | Total | Present Value | |
|---|---|---|---|---|---|---|
| Total costs | ($54,912) | ($3,994,390) | ($908,640) | ($836,640) | ($5,794,582) | ($5,065,698) |
| Total benefits | $0 | $14,560,485 | $3,080,994 | $2,781,482 | $20,422,961 | $17,872,849 |
| Net benefits | ($54,912) | $10,566,095 | $2,172,354 | $1,944,842 | $14,628,379 | $12,807,151 |
| ROI | 253% | |||||
| Payback period (months) | <6 | |||||
Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists solution providers in communicating their value proposition to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of business and technology initiatives to both senior management and other key stakeholders.
Benefits represent the value the solution delivers to the business. The TEI methodology places equal weight on the measure of benefits and costs, allowing for a full examination of the solution’s effect on the entire organization.
Costs comprise all expenses necessary to deliver the proposed value, or benefits, of the solution. The methodology captures implementation and ongoing costs associated with the solution.
Flexibility represents the strategic value that can be obtained for some future additional investment building on top of the initial investment already made. The ability to capture that benefit has a PV that can be estimated.
Risks measure the uncertainty of benefit and cost estimates given: 1) the likelihood that estimates will meet original projections and 2) the likelihood that estimates will be tracked over time. TEI risk factors are based on “triangular distribution.”
The initial investment column contains costs incurred at “time 0” or at the beginning of Year 1 that are not discounted. All other cash flows are discounted using the discount rate at the end of the year. PV calculations are calculated for each total cost and benefit estimate. NPV calculations in the summary tables are the sum of the initial investment and the discounted cash flows in each year. Sums and present value calculations of the Total Benefits, Total Costs, and Cash Flow tables may not exactly add up, as some rounding may occur.
1 Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists vendors in communicating the value proposition of their products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of IT initiatives to both senior management and other key business stakeholders.
Cookie Preferences
Accept Cookies
A cookie is a small text file that a website saves on your computer or mobile device when you visit the site. It enables the website to remember your actions (data inputs, website navigation), so you don’t have to re-enter data when you come back to the site or browse from one page to another.
Behavioral information collected by our web analytics vendor is used to analyze data pertaining to visitor trends, plan website enhancements, and measure overall website effectiveness. We may also use cookies or web beacons to help us offer you products, programs, or services that may be of interest to you and to deliver relevant advertising. We may use third-party advertising companies to help tailor website content to users or to serve ads on our behalf. These companies may also employ cookies and web beacons to measure advertising effectiveness.
Please accept cookies and the collection of behavioral information to receive full functionality and enhance your experience. If you decline cookies, some features of the website may not function normally.
Please see our
Privacy Policy for more information.
https://mainstayadvisor.com/go/mainstay/gdpr/policy.html