What Is Data Archiving?
The query that ran in 200ms a year ago now runs in eleven seconds. The plan looks the same. The indexes are the same. The hardware is faster than it was a year ago. The data is just bigger.
Someone says we need to archive. Three meetings later, nobody can name the policy that says what archives.
I have seen this shape before. Not in archive policy meetings — on Oracle production databases, the morning after a quarter-end, when execution-plan-first shows nothing wrong and the wait events tell a different story than the plan does. Plan instability is a clean explanation that holds for about an hour. Then you look at the table size and realize the optimizer is right; the query just has more rows to chew through than it did when someone wrote the index.
Data archiving fails the same way. The system tells you the data is fine. The compliance report says the retention policy is met. The size of the warehouse keeps going up. The plan keeps getting slower. And nobody has the authority to delete anything, because nobody knows what should be deleted, because the policy that would tell them was written before half the tables existed.
Step One — The Wrong Assumption
"Add storage. Re-index. The plan will stabilize."
"We just need more storage and a better partition strategy. The data isn't the problem." — Quarterly capacity review, every organization, the third year running
This is the answer that buys you six months. Storage is cheap, the cloud sells it elastic, and adding capacity does not require anyone to make a decision about what data the business actually needs. The CFO signs a slightly larger bill and the meeting moves on.
What the storage answer does not address is that the cost of carrying old data is not the cost of the disk. It is the cost of the backups, the replicas, the disaster-recovery copies, the test environments that get refreshed from production, the longer query plans the optimizer has to consider, the slower batch windows, and the engineers who have to keep all of it consistent. Every one of those costs scales with row count, not with disk price.
Step Two — The Partial Signal
The DBA tunes. The infra team scales. Both fixes work for one quarter.
The runbook for slow queries on a growing table is well understood. Tune the plan, add a covering index, partition the table by date, move the cold partitions to a slower storage tier. Each one of these works the first time you do it. None of them work the third time.
This is the partial signal. You can keep the loud system — the production database — quiet for a long time using techniques that were designed for a different problem. The original problem was query performance on data the application is using right now. The actual problem is that the application stopped using most of the data three years ago and nothing in the system noticed.
Backup admins know this exact distinction. The backup job completes. The runtime is creeping. Then one quarter you miss the window, and the post-mortem reveals that the dataset has tripled while the policy that would have moved old records out of scope never changed.
Step Three — The Failed Fix
Someone proposes a deletion. Legal says no. Nothing moves.
Eventually a senior DBA proposes the obvious thing: delete the closed records older than seven years. The deletion script is written in an afternoon. It is short, well-tested, and never runs.
It does not run because legal asks one question that nobody can answer: which records, specifically, are subject to which retention obligations? The seven-year default came from somewhere, but the somewhere was a policy document last reviewed in 2019, and the company has acquired three subsidiaries since then, each with a different retention regime, each with regulators in different jurisdictions, none of whom were in the room when the original policy was written.
The deletion script sits in a Git repository, technically functional, organizationally inert. The table keeps growing. The query keeps getting slower. The capacity review next quarter will recommend more storage.
Fig. 1 — The database is the loudest system. The cause is one floor up, in a policy nobody owns.
Step Four — The Real Failure
It was never a database problem. It was a policy with no owner.
The database is not broken. The optimizer is doing its job. The infrastructure is sized correctly for the data it has been asked to hold. The fact that the data should not be there is not visible to any of the systems that are signaling pain.
The actual failure is upstream of the database, in a control function that did not get updated when the business changed shape. The retention policy is the policy. The policy has no owner. No owner means no one to ratify changes when a new product line, a new jurisdiction, or a new contractual obligation lands. So the policy stays exactly the way it was, and the data accumulates around it like silt in a riverbed.
The clean version of this would be: every record class has a named retention rule, a named owner, and a defined disposition action that fires when the retention period elapses. The actual version is: the rule exists in someone's PDF, the owner left in 2022, and the disposition action has never run because nobody has the authority to approve it.
Step Five — The Definition
Now the definition lands.
Data archiving is the policy-governed movement of data out of operational systems into a retained, retrievable, immutable store — with named owners, named retention rules, and a disposition action that runs when the rules say it should. Not storage. Not deletion. The governance of when each, on what evidence.
Most articles on this topic define archiving as either "moving cold data to cheaper storage" or "long-term data retention for compliance." Both descriptions are true and both are insufficient, because they describe the storage destination but not the control function. A bucket of cold data with no retention rules attached is not an archive. It is a graveyard with no caretaker.
The discipline is the rules and the ownership of the rules. The storage is downstream.
What Solix Enforces
The control function is the product. The bucket is just where the data lives.
Solix's archival platform is architected around the policy layer, not the storage layer. What the platform actually enforces is the rule set: who owns this class of records, how long they must be retained, what disposition fires at end-of-life, and what evidence is preserved when a regulator asks why the disposition happened when it did.
The same control function applies whether the source is SAP ECC, Oracle E-Business Suite, a custom application, or a database that has been growing without governance for a decade. Capture the records under policy, retain them past the source system, query independently when the request comes. The database can stay smaller. The plan can stay stable. The records that should still exist still exist.
Three things to do this week
- Pull the size-vs-active-use ratio for your top five tables. For each, calculate what fraction of the rows have been modified or read by the application in the last twelve months. The ratio almost always points at the table that needs an archiving conversation, not a tuning conversation. The data tells you which problem is actually a database problem.
- Find the retention policy and check the date on the last review. If the document was last reviewed more than two years ago, it does not reflect the business. Walk it to the records-management or compliance function and ask who currently owns it. The answer is the most useful piece of information you will get this quarter.
- Pick one record class and run the disposition end-to-end on a non-production copy. Pick a class with low litigation risk — closed marketing campaigns, completed onboarding records. Run the rule, run the disposition, write the evidence. A single end-to-end run reveals every gap in the policy in a way that a hundred meetings will not.
References
- Gartner Peer Insights, market category — Digital Communications Governance and Archiving Solutions. Reviewed 2026
- Gartner Peer Insights, market category — Records Management Systems. Reviewed 2026
- Forrester Research — The Forrester Wave™: Data Governance Solutions, Q3 2025. Report ID RES184107
- Forrester blog — The Forrester Wave Data Governance Solutions Q3 2025 Shows That Governance Entered the Agentic Era.
About the author
Barry Kunst is VP of Marketing at Solix Technologies. He writes about enterprise data lifecycle, application retirement, and modernization in systems that have outlived their original mandate. Earlier in his career he supported IBM zSeries ecosystems for CA Technologies' multi-billion-dollar mainframe business, with first-hand exposure to lifecycle risk at scale.
- Solix Leadership
- Forbes Technology Council
- MIT
Find him at:
What you can do with Solix
Enter to win a $100 Amex Gift Card
Related Resources
Explore related resources to gain deeper insights, helpful guides, and expert tips for your ongoing success.
Why SOLIXCloud
SOLIXCloud offers scalable, secure, and compliant cloud archiving that optimizes costs, boosts performance, and ensures data governance.
-
Common Data Platform
Unified archive for structured, unstructured and semi-structured data.
-
Reduce Risk
Policy driven archiving and data retention
-
Continuous Support
Solix offers world-class support from experts 24/7 to meet your data management needs.
-
On-demand AI
Elastic offering to scale storage and support with your project
-
Fully Managed
Software as-a-service offering
-
Secure & Compliant
Comprehensive Data Governance
-
Free to Start
Pay-as-you-go monthly subscription so you only purchase what you need.
-
End-User Friendly
End-user data access with flexibility for format options.
