A Forrester Total Economic Impact™ Study Commissioned By Clumio, December 2024
Organizations seek secure, reliable, and cost-effective solutions for backing up and restoring their cloud-based workloads and data. They prefer options that require minimal management and can scale globally. As data volumes increase exponentially, companies need additional layers of protection against disaster recovery scenarios caused by operator error or third-party attacks. Additionally, new data regulations mandate companies to retain data for audit and compliance purposes.
Clumio provides an immutable, serverless backup solution for cloud-native data protection. This secure, air-gapped software-as-a-service (SaaS) backup offers strong ransomware defense, quick rapid backup and recovery, and increased visibility to reduce cloud storage costs. The Clumio platform efficiently scales to protect complex data sets from production data loss or malicious attacks.
Clumio commissioned Forrester Consulting to conduct a Total Economic Impact™ (TEI) study and examine the potential return on investment (ROI) enterprises may realize by deploying Clumio.1 The purpose of this study is to provide readers with a framework to evaluate the potential financial impact of Clumio on their organizations.
To better understand the benefits, costs, and risks associated with this investment, Forrester interviewed four representatives with experience using Clumio. For the purposes of this study, Forrester aggregated the interviewees’ experiences and combined the results into a single composite organization that is a B2C organization with revenue of $650 million per year and 1.14 petabytes (PB) of data.
Interviewees said that prior to using Clumio, their organizations generally used cloud-native or on-premises, custom-built solutions to back up their data. However, these solutions offered inadequate protection and functionality, resulting in lengthy backups and restorations; limited access to previous versions or single files; and exposure to accidental deletions and ransomware attacks.
After the investment in Clumio, the interviewees felt they had purchased a cost-effective, comprehensive “insurance policy” that was easy to implement, required little ongoing management, provided multiregional capabilities, and met regulatory and compliance requirements. Key results from the investment included peace of mind from easy data restoration in the event of a disaster; reduced need for team time in backup and restoration tasks; and enhanced analytics, customer service, and scalability features.
Quantified benefits. Three-year, risk-adjusted present value (PV) quantified benefits for the composite organization include:
Unquantified benefits. Benefits that provide value for the composite organization but are not quantified for this study include:
Costs. Three-year, risk-adjusted PV costs for the composite organization include:
The representative interviews and financial analysis found that a composite organization experiences benefits of $3.21 million over three years versus costs of $1.16 million, adding up to a net present value (NPV) of $2.04 million and an ROI of 176%.
Return on investment (ROI)
Benefits PV
Net present value (NPV)
Payback
From the information provided in the interviews, Forrester constructed a Total Economic Impact™ framework for those organizations considering an investment in Clumio.
The objective of the framework is to identify the cost, benefit, flexibility, and risk factors that affect the investment decision. Forrester took a multistep approach to evaluate the impact that Clumio can have on an organization.
Interviewed Clumio stakeholders and Forrester analysts to gather data relative to Clumio.
Interviewed four representatives at organizations using Clumio to obtain data about costs, benefits, and risks.
Designed a composite organization based on characteristics of the interviewees’ organizations.
Constructed a financial model representative of the interviews using the TEI methodology and risk-adjusted the financial model based on issues and concerns of the interviewees.
Employed four fundamental elements of TEI in modeling the investment impact: benefits, costs, flexibility, and risks. Given the increasing sophistication of ROI analyses related to IT investments, Forrester’s TEI methodology provides a complete picture of the total economic impact of purchase decisions. Please see Appendix A for additional information on the TEI methodology.
Readers should be aware of the following:
This study is commissioned by Clumio and delivered by Forrester Consulting. It is not meant to be used as a competitive analysis.
Forrester makes no assumptions as to the potential ROI that other organizations will receive. Forrester strongly advises that readers use their own estimates within the framework provided in the study to determine the appropriateness of an investment in Clumio.
Clumio reviewed and provided feedback to Forrester, but Forrester maintains editorial control over the study and its findings and does not accept changes to the study that contradict Forrester’s findings or obscure the meaning of the study.
Clumio provided the customer names for the interviews but did not participate in the interviews.
Consulting Team:
Rachna Agarwalla
Chengcheng Dong
Rachel Ballard
| Role | Industry | Region | Revenue | Employees |
|---|---|---|---|---|
| Manager of strategy for FinOps | Biotech | US | $300 million | 800 |
| Head of cybersecurity | Fast-food chain | US | $700 million | 8,000 |
| Tech lead platform engineer | Financial institution | UK | $340 million | 1,100 |
| Senior director of global platforms | Software company | US | $1 billion | 10,800 |
Before adopting Clumio, interviewees noted that their organizations typically relied on either cloud-native backup solutions or custom-built, on-premises systems for data backup management; however, these methods fell short of providing adequate and comprehensive protection. Consequently, interviewees faced prolonged backup and restoration processes, restricted access to individual files or previous versions, geographical limitations, and vulnerabilities to accidental deletions and ransomware attacks.
The interviewees noted common challenges for their organizations, including:
The interviewees’ organizations searched for a solution that could:
Based on the interviews, Forrester constructed a TEI framework, a composite company, and an ROI analysis that illustrates the areas financially affected. The composite organization is representative of the four interviewees, and it is used to present the aggregate financial analysis in the next section. The composite organization has the following characteristics:
Description of composite. The composite organization is a US-based B2C organization that generates $650 million in annual revenue. It has a large and rapidly growing data footprint. It currently has 1.14 PB of data, which is expected to grow by 18% per year.
Deployment characteristics. The composite organization begins using Clumio in Year 1 following a 20-day implementation period. The initial rollout requires 30% of one FTE’s time.
| Ref. | Benefit | Year 1 | Year 2 | Year 3 | Total | Present Value |
|---|---|---|---|---|---|---|
| Atr | Total legacy solution cost | $667,200 | $789,600 | $930,288 | $2,387,088 | $1,958,047 |
| Btr | Cost savings in event of breach | $343,835 | $405,725 | $478,756 | $1,228,316 | $1,007,584 |
| Ctr | Backup efficiency improvement | $55,080 | $64,994 | $76,672 | $196,746 | $161,391 |
| Dtr | Restoration efficiency improvement | $31,752 | $31,752 | $31,752 | $95,256 | $78,963 |
| Total benefits (risk-adjusted) | $1,097,867 | $1,292,071 | $1,517,468 | $3,907,406 | $3,205,985 | |
Evidence and data. Switching to Clumio enabled the interviewees’ organizations to reduce their dependence on cloud-native backup or custom-built, on-premises solutions, resulting in reduced costs, improved functionality, and increased scalability. With previous solutions, the interviewees’ organizations had to pay per gigabyte (GB) to back up data. In addition, inefficient cloud use resulted in additional cloud-related expenses.
Several interviewees mentioned that while their legacy solutions’ monthly fees were comparable to Clumio’s, it offered more features. A senior director of global platforms at a software company noted: “Our previous solution didn’t provide as much as Clumio. We didn’t have the backup capabilities. We had some versioning in place, but we couldn’t restore efficiently if things were accidentally deleted. That solution had the same operating expense as Clumio, but Clumio provides additional capabilities.”
Modeling and assumptions. Based on the interviews, Forrester assumes the following about the composite organization:
Risks. The expected financial impact is subject to risks and variation based on several factors that may reduce or slow recognition of this benefit, including:
Results. To account for these risks, Forrester adjusted this benefit downward by 20%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $2.0 million.
| Ref. | Metric | Source | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|
| A1 | Cloud-native solution backup price per GB per month | Composite | $0.05 | $0.05 | $0.05 |
| A2 | Annual backup storage amount (PB) | Composite | 1.14 | 1.35 | 1.59 |
| A3 | Savings from optimized cloud consumption | Composite | $150,000 | $177,000 | $208,860 |
| At | Total legacy solution cost | A1*A2*1,000,000 *12+A3 | $834,000 | $987,000 | $1,162,860 |
| Risk adjustment | ↓20% | ||||
| Atr | Total legacy solution cost (risk-adjusted) | $667,200 | $789,600 | $930,288 | |
| Three-year total: $2,387,088 | Three-year present value: $1,958,047 | ||||
Evidence and data. In the event of a ransomware attack, organizations need to quickly recover their data to minimize downtime. The simplicity of restoring data from Clumio and its immutable backups offered the interviewees’ organizations greater confidence that a clean copy of the data was always accessible and could be restored swiftly — helping organizations reduce restoration costs in the event of a breach.
A senior director of global platforms mentioned: “We’re using Clumio to provide a resilient backup of our content so that in the event it’s ever needed — either to grab a specific version at a point in time, recover from an issue generated by a cloud provider, handle a technical resiliency issue, or manage a ransomware attack — we have the capabilities to recover quickly and efficiently.”
Modeling and assumptions. Based on the interviews, Forrester assumes the following about the composite organization:
Risks. The expected financial impact is subject to risks and variation based on several factors that may reduce or slow recognition of this benefit, including:
Results. To account for these risks, Forrester adjusted this benefit downward by 25%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $1.0 million.
| Ref. | Metric | Source | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|
| B1 | Likelihood of experiencing one or more breaches per year | Forrester research | 73% | 73% | 73% |
| B2 | Mean cumulative cost of third-party breaches for enterprise organizations | Forrester research | $2,556,000 | $3,016,080 | $3,558,974 |
| B3 | Percentage of breaches originating from external third-party attacks | Forrester research | 27% | 27% | 27% |
| B4 | Annual risk exposure from external third-party attacks | B1*B2*B3 | $503,788 | $594,469 | $701,474 |
| B5 | Reduced costs to restore data due to a breach | Interviews | 91% | 91% | 91% |
| Bt | Cost savings in event of breach | B4*B5 | $458,447 | $540,967 | $638,341 |
| Risk adjustment | ↓25% | ||||
| Btr | Cost savings in event of breach (risk-adjusted) | $343,835 | $405,725 | $478,756 | |
| Three-year total: $1,228,316 | Three-year present value: $1,007,584 | ||||
Evidence and data. Before implementing Clumio, the interviewees’ organizations regularly completed numerous backup-related changes, such as adding or deleting workloads. Each year, these changes required numerous dedicated employee hours. Clumio’s API-based setup allowed seamless and automated backups and reduced the need for manual intervention.
A tech lead platform engineer at a financial institution shared: “Clumio’s protection policies and rules are very well thought out. If you create a tag and the backup policy is daily, then you implement this rule. For example, you might set your backup at 8 p.m. Pacific time and keep it around for seven days. And for those accounts that you’ve created a Clumio connection, the platform will go through, find everything with those tags, and back it up. Once you set that rule up, it’s just applied across your data. You can apply it by region as well. It’s plug and play, especially when using tags.”
Modeling and assumptions. Based on the interviews, Forrester assumes the following about the composite organization:
Risks. The expected financial impact is subject to risks and variation based on several factors that may reduce or slow recognition of this benefit, including:
Results. To account for these risks, Forrester adjusted this benefit downward by 15%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $161,000.
| Ref. | Metric | Source | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|
| C1 | Total number of workload changes annually | Interviews | 4,000 | 4,720 | 5,570 |
| C2 | Time to set up, adjust, or delete a workload change (hours) | Interviews | 0.25 | 0.25 | 0.25 |
| C3 | SDE annual hours saved on backup tasks due to Clumio | C1*C2 | 1,000 | 1,180 | 1,392 |
| C4 | Fully burdened hourly rate for an SDE | Composite | $72 | $72 | $72 |
| C5 | Productivity recapture rate | Composite | 90% | 90% | 90% |
| Ct | Backup efficiency improvement | C3*C4*C5 | $64,800 | $76,464 | $90,202 |
| Risk adjustment | ↓15% | ||||
| Ctr | Backup efficiency improvement (risk-adjusted) | $55,080 | $64,994 | $76,672 | |
| Three-year total: $196,746 | Three-year present value: $161,391 | ||||
Evidence and data. When incidents like accidental deletions occurred, Clumio’s user-friendly interface and automated processes made it easier for the interviewees to restore files, machines, and databases. Specifically, the interviewees noted their organizations benefited from faster recovery times, simpler recovery processes, and continuous access to critical data during restoration.
A tech lead platform engineer at a financial institution shared: “We spend so little time on Clumio on restore tasks. In total, there have been less than 10 incidents, like deleted files, so it’s not the volume of incidents, it’s the ease of getting [the data] back.”
Modeling and assumptions. Based on the interviews, Forrester assumes the following about the composite organization:
Risks. The expected financial impact is subject to risks and variation based on several factors that may reduce or slow recognition of this benefit, including:
Results. To account for these risks, Forrester adjusted this benefit downward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $80,000.
| Ref. | Metric | Source | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|
| D1 | Incidents that required backup and restore services before Clumio | Composite | 10 | 10 | 10 |
| D2 | Time spent restoring the data before Clumio in each incident (hours) | Interviews | 54 | 54 | 54 |
| D3 | Time spent restoring the data with Clumio in each incident (hours) | Interviews | 5 | 5 | 5 |
| D4 | Fully burdened hourly rate for an SDE | Composite | $72 | $72 | $72 |
| Dt | Restoration efficiency improvement | D1*(D2-D3)*D4 | $35,280 | $35,280 | $35,280 |
| Risk adjustment | ↓10% | ||||
| Dtr | Restoration efficiency improvement (risk-adjusted) | $31,752 | $31,752 | $31,752 | |
| Three-year total: $95,256 | Three-year present value: $78,963 | ||||
Interviewees mentioned the following additional benefits that their organizations experienced but were not able to quantify:
The value of flexibility is unique to each customer. There are multiple scenarios in which a customer might implement Clumio and later realize additional uses and business opportunities, including:
Data strategy development. A manager of strategy for FinOps at a biotech company noted: “Our environment is not static, so we need to continuously review our data to make sure we are covering the right data. There are probably some things we are protecting that are no longer relevant, and before Clumio, we were spending money doing that.”
Flexibility would also be quantified when evaluated as part of a specific project (described in more detail in Appendix A).
| Ref. | Cost | Initial | Year 1 | Year 2 | Year 3 | Total | Present Value |
|---|---|---|---|---|---|---|---|
| Etr | Clumio annual backup and restoration costs | $0 | $359,520 | $425,670 | $501,270 | $1,286,460 | $1,055,241 |
| Ftr | Clumio initial implementation and ongoing management costs | $3,802 | $41,250 | $41,250 | $41,250 | $127,552 | $106,385 |
| Total costs (risk-adjusted) | $3,802 | $400,770 | $466,920 | $542,520 | $1,414,012 | $1,161,626 | |
Evidence and data. Clumio backup and restoration costs were influenced by the total volume of data backed up, the frequency of restoration incidents, and the size of the data being restored.
Modeling and assumptions. Forrester modeled the cost assuming:
Risks. The expected financial impact is subject to risks and variation based on several factors that may reduce or slow recognition of this cost, including:
Results. To account for these risks, Forrester adjusted this cost upward by 5%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $1.1 million.
| Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|---|
| E1 | Clumio backup unit price per GB per month | Composite | $0.025 | $0.025 | $0.025 | |
| E2 | Total backup storage (PB) | Composite | 1.14 | 1.35 | 1.59 | |
| E3 | Number of incidents requiring restore services | Composite | 10 | 10 | 10 | |
| E4 | Average data size to be restored each time (GB) | Composite | 1,000 | 1,000 | 1,000 | |
| E5 | Clumio restore cost per GB | Composite | $0.04 | $0.04 | $0.04 | |
| Et | Clumio annual backup and restoration costs | E1*E2*12*1,000,000+E3*E4*E5 | $342,400 | $405,400 | $477,400 | |
| Risk adjustment | ↑5% | |||||
| Etr | Clumio annual backup and restoration costs (risk-adjusted) | $0 | $359,520 | $425,670 | $501,270 | |
| Three-year total: $1,286,460 | Three-year present value: $1,055,241 | |||||
Evidence and data. Interviewees found that the implementation and subsequent ongoing management of Clumio required minimal team time. A senior director of global platforms for a software company noted: “We had Clumio up and running in our test environment the same day we started working on it. The test was completed within two weeks, and that was not a consecutive 40-hour week, but doing it on and off as needed. So, our total effort for implementing the solution was probably a month. Calendar time was more just working through legal parts of it, but not effort.”
Modeling and assumptions. Forrester modeled the cost assuming:
Risks. The expected financial impact is subject to risks and variation based on several factors that may reduce or slow recognition of this cost, including:
Results. To account for these risks, Forrester adjusted this cost upward by 10%, yielding a three-year, risk-adjusted total PV (discounted at 10%) of $106,000.
| Ref. | Metric | Source | Initial | Year 1 | Year 2 | Year 3 |
|---|---|---|---|---|---|---|
| F1 | Time to implement Clumio (in days) | Interviews | 20 | |||
| F2 | Number of FTE involved internally | Interviews | 1 | |||
| F3 | Percentage of effort input into implementation | Interviews | 30% | |||
| F4 | Number of FTE involved daily | Interviews | 1 | 1 | 1 | |
| F5 | Percentage of effort required daily | Interviews | 25% | 25% | 25% | |
| F6 | Total hours involved | F1*F2*F3*8+F4*F5*2080 | 48 | 520 | 520 | 520 |
| F7 | SDE fully loaded hourly rate | Composite | $72 | $72 | $72 | $72 |
| Ft | Clumio initial implementation and ongoing mgmt cost | F6*F7 | $3,456 | $37,500 | $37,500 | $37,500 |
| Risk adjustment | ↑10% | |||||
| Ftr | Clumio initial implementation and ongoing mgmt cost (risk-adjusted) | $3,802 | $41,250 | $41,250 | $41,250 | |
| Three-year total: $127,552 | Three-year present value: $106,385 | |||||
The financial results calculated in the Benefits and Costs sections can be used to determine the ROI, NPV, and payback period for the composite organization’s investment. Forrester assumes a yearly discount rate of 10% for this analysis.
These risk-adjusted ROI, NPV, and payback period values are determined by applying risk-adjustment factors to the unadjusted results in each Benefit and Cost section.
| Initial | Year 1 | Year 2 | Year 3 | Total | Present Value | |
|---|---|---|---|---|---|---|
| Total costs | ($3,802) | ($400,770) | ($466,920) | ($542,520) | ($1,414,012) | ($1,161,626) |
| Total benefits | $0 | $1,097,867 | $1,292,071 | $1,517,468 | $3,907,406 | $3,205,985 |
| Net benefits | ($3,802) | $697,097 | $825,151 | $974,948 | $2,493,394 | $2,044,359 |
| ROI | 176% | |||||
| Payback | <6 | |||||
Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists vendors in communicating the value proposition of their products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of IT initiatives to both senior management and other key business stakeholders.
Benefits represent the value delivered to the business by the product. The TEI methodology places equal weight on the measure of benefits and the measure of costs, allowing for a full examination of the effect of the technology on the entire organization.
Costs consider all expenses necessary to deliver the proposed value, or benefits, of the product. The cost category within TEI captures incremental costs over the existing environment for ongoing costs associated with the solution.
Flexibility represents the strategic value that can be obtained for some future additional investment building on top of the initial investment already made. Having the ability to capture that benefit has a PV that can be estimated.
Risks measure the uncertainty of benefit and cost estimates given: 1) the likelihood that estimates will meet original projections and 2) the likelihood that estimates will be tracked over time. TEI risk factors are based on “triangular distribution.”
The initial investment column contains costs incurred at “time 0” or at the beginning of Year 1 that are not discounted. All other cash flows are discounted using the discount rate at the end of the year. PV calculations are calculated for each total cost and benefit estimate. NPV calculations in the summary tables are the sum of the initial investment and the discounted cash flows in each year. Sums and present value calculations of the Total Benefits, Total Costs, and Cash Flow tables may not exactly add up, as some rounding may occur.
1 Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s technology decision-making processes and assists vendors in communicating the value proposition of their products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the tangible value of IT initiatives to both senior management and other key business stakeholders.
2 Base: 432 security decision-makers from organizations with revenue of at least $1 billion with network, data center, app security, or security ops responsibility and that have experienced a breach in the past 12 months; Source: Forrester’s Security Survey, 2023.
Cookie Preferences
Accept Cookies
A cookie is a small text file that a website saves on your computer or mobile device when you visit the site. It enables the website to remember your actions (data inputs, website navigation), so you don’t have to re-enter data when you come back to the site or browse from one page to another.
Behavioral information collected by our web analytics vendor is used to analyze data pertaining to visitor trends, plan website enhancements, and measure overall website effectiveness. We may also use cookies or web beacons to help us offer you products, programs, or services that may be of interest to you and to deliver relevant advertising. We may use third-party advertising companies to help tailor website content to users or to serve ads on our behalf. These companies may also employ cookies and web beacons to measure advertising effectiveness.
Please accept cookies and the collection of behavioral information to receive full functionality and enhance your experience. If you decline cookies, some features of the website may not function normally.
Please see our
Privacy Policy for more information.
https://mainstayadvisor.com/go/mainstay/gdpr/policy.html