Data Quality Dimensions, Honestly: Why the Six Buckets Don't Help You at 2 a.m.
Figure 1. DQ Dimensions Failure: The Loudest System Is Not Always the Root Cause. The 99.9% green is the symptom; The hidden segment is the failure.
The DQ scorecard is green.
All six dimensions pass.
Completeness is 99.9%.
And the report is still wrong.
That is the entire opening of every real data quality dimensions incident I have lived through. Not a definition. Not a diagram. A wrongness that won't show up on a dashboard until you go looking for it on purpose.
This page is for the engineer who is already there.
What this actually feels like at the keyboard
The incident starts with something small enough to ignore: ingestion lag around watermark-first. As a Data Engineer on ETL Pipelines, I would first trust the logs, because that is where this kind of pain usually shows up. But the moment retries, stuck work, and stale state start crossing into other platforms, the first fix becomes dangerous — it can make the symptom quieter while the real leak keeps spreading from a retry loop.
That last sentence is the whole problem. DQ Dimensions fails in a shape where the metric you can read is honest about itself and misleading about the incident. The signal is real. The pain is real. The cause of the pain is somewhere else.
The wrong assumption I'd make first
"Maybe we need a seventh dimension. Let's audit timeliness more strictly."
That's the assumption I'd reach for, because it's the one I'm fastest at fixing. Late data arrival has a known playbook — inspect the scorecard, identify the failing dimension, tighten the rule. So I'd run the playbook. The graph would settle for an hour. I'd close the incident.
That hour of quiet is the misdiagnosis.
The partial signal — what the logs actually show
The first thing visible is watermark-first in logs, mixed with side effects from a retry loop.
That phrase — no single owner looks guilty — is the most honest sentence anyone has written about data quality dimensions. Because the way these systems get built, every component that touches the data has plausible deniability. Each system passes its own self-check. The failure lives in the gap between the self-checks.
The fix I'd try first — and why it doesn't hold
Try the obvious local fix for ingestion lag, then compare timestamps against the upstream systems before declaring victory.
That's a real playbook. It's also where most data quality dimensions failures get hidden. The local fix works for the next four hours. Then the next breach happens, and the team thinks they have a "late data arrival" problem when they actually have a "the dimensions measure dimension averages but the failure lives in a specific segment that isn't a dimension at all" problem. According to Forrester research, this pattern is one of the most under-recognized drivers of data governance / quality cost across enterprise stacks.
Why it's actually hard
Every fix changes the shape of the failure, so the team keeps mistaking quieter logs for actual recovery.
This is the entire degree of difficulty. Not the technology. Not the configuration. The hard part is that the system most equipped to show the problem is rarely the system that caused it. It's the system honest enough to complain. The cause lives one or two hops upstream — in a producer that biases its errors into a small but business-critical segment — and nobody noticed because each individual component was inside its own SLO.
What clean would look like (so you know when you're lying to yourself)
A clean failure stays inside ETL Pipelines; fix the local cause and the symptom disappears instead of migrating.
If your "fix" makes the failure migrate to a different system, you didn't fix it. You moved it. Apply this test after every data quality dimensions incident. If the answer is "the failure moved," your post-incident action items are wrong.
How this gets misdiagnosed
You blame ETL Pipelines, make a local change, and accidentally hide the clue that would have pointed outside your lane.
That sentence is the entire reason this page exists. Engineers who debug data quality dimensions well are not the ones who know the most about data quality dimensions. They're the ones who have learned to not trust the silence. The dashboard going green is data, not victory. The first fix working is information about the symptom, not proof of the cause.
NOW — what data quality dimensions actually is
Data quality dimensions are the standard categories used to measure data quality — typically accuracy, completeness, timeliness, consistency, validity, and uniqueness. They are useful as a vocabulary, but they are aggregate measures, and aggregate measures hide segment-specific failures.
Most data quality dimensions failures are violations of that contract caused by something upstream of it. The system didn't fail. The system reported truthfully. The truth was contaminated.
Where Solix fits — honestly
Solix's data governance approach is to treat the six dimensions as a starting vocabulary, not the audit. The audit lives in who consumes which segment and what each consumer's tolerance is for which dimension. That contract is what turns 99.9% completeness from a green box into a defensible claim.
What to do this week, if any of this sounded familiar
- Take your DQ scorecard. Slice it by your most business-critical segment. What changes?
- List your top five consumers. Ask each one which dimensions they care about. Compare answers.
- Decide whether your DQ measures the aggregate or the segment. They are not the same thing.
Sources cited
About the author
Barry Kunst is VP of Marketing at Solix Technologies. He writes about enterprise data lifecycle, application retirement, and modernization in systems that have outlived their original mandate. Earlier in his career he supported IBM zSeries ecosystems for CA Technologies' multi-billion-dollar mainframe business, with first-hand exposure to lifecycle risk at scale.
- Solix Leadership
- Forbes Technology Council
- MIT
Find him at:
What you can do with Solix
Enter to win a $100 Amex Gift Card
Related Resources
Explore related resources to gain deeper insights, helpful guides, and expert tips for your ongoing success.
Why SOLIXCloud
SOLIXCloud offers scalable, secure, and compliant cloud archiving that optimizes costs, boosts performance, and ensures data governance.
-
Common Data Platform
Unified archive for structured, unstructured and semi-structured data.
-
Reduce Risk
Policy driven archiving and data retention
-
Continuous Support
Solix offers world-class support from experts 24/7 to meet your data management needs.
-
On-demand AI
Elastic offering to scale storage and support with your project
-
Fully Managed
Software as-a-service offering
-
Secure & Compliant
Comprehensive Data Governance
-
Free to Start
Pay-as-you-go monthly subscription so you only purchase what you need.
-
End-User Friendly
End-user data access with flexibility for format options.
