Database-to-Database Integration, Honestly: Why CDC Doesn't Save You
Figure 1. DB-to-DB Integration Failure: The Loudest System Is Not Always the Root Cause. The green lag is the symptom; The unencoded state is the failure.
CDC is on.
Latency is low.
Replication lag is green.
And the target database is missing yesterday's promotions.
That is the entire opening of every real database-to-database integration incident I have lived through. Not a definition. Not a diagram. A wrongness that won't show up on a dashboard until you go looking for it on purpose.
This page is for the engineer who is already there.
What this actually feels like at the keyboard
I did not see a giant outage first; I saw connection-first in the job log and assumed it was my normal remote file access failures problem. Then jobs sit active but do no useful work, and the timeline stopped matching the system I was staring at. The first pass looked logical until the next signal contradicted it. I would try to stabilize the enterprise mainframe environment, but the ugly part is that a bad API caller can make my local evidence look guilty even when it is only absorbing the leak.
That last sentence is the whole problem. DB-to-DB Integration fails in a shape where the metric you can read is honest about itself and misleading about the incident. The signal is real. The pain is real. The cause of the pain is somewhere else.
The wrong assumption I'd make first
"It's a CDC config issue. Re-snapshot the table."
That's the assumption I'd reach for, because it's the one I'm fastest at fixing. Remote file access failures has a known playbook — check the lag, re-snapshot, restart the connector. So I'd run the playbook. The graph would settle for an hour. I'd close the incident.
That hour of quiet is the misdiagnosis.
The partial signal — what the logs actually show
Job log shows connection-first, delayed work, and half-failed operations, but no single owner looks guilty.
That phrase — no single owner looks guilty — is the most honest sentence anyone has written about database-to-database integration. Because the way these systems get built, every component that touches the data has plausible deniability. Each system passes its own self-check. The failure lives in the gap between the self-checks.
The fix I'd try first — and why it doesn't hold
Follow the familiar remote file access failures playbook first: inspect job log, isolate the noisy worker/job, and reduce pressure before changing logic.
That's a real playbook. It's also where most database-to-database integration failures get hidden. The local fix works for the next four hours. Then the next breach happens, and the team thinks they have a "remote file access failures" problem when they actually have a "CDC captures changes; promotions were implied by an absence of changes the producer assumed everyone would understand" problem. According to Forrester research, this pattern is one of the most under-recognized drivers of data integration cost across enterprise stacks.
Why it's actually hard
Symptoms overlap: the local system shows distress, but the timing points to a bad API caller and cross-system backpressure.
This is the entire degree of difficulty. Not the technology. Not the configuration. The hard part is that the system most equipped to show the problem is rarely the system that caused it. It's the system honest enough to complain. The cause lives one or two hops upstream — in a producer that uses NULL as a state, or a soft-delete the target doesn't recognize — and nobody noticed because each individual component was inside its own SLO.
What clean would look like (so you know when you're lying to yourself)
Clean feels boring: job log points to one bad path, the timestamps line up, and the same action fails every time.
If your "fix" makes the failure migrate to a different system, you didn't fix it. You moved it. Apply this test after every database-to-database integration incident. If the answer is "the failure moved," your post-incident action items are wrong.
How this gets misdiagnosed
It feels like proving yourself right for an hour, then realizing you only suppressed connection-first while a bad API caller kept feeding the incident.
That sentence is the entire reason this page exists. Engineers who debug database-to-database integration well are not the ones who know the most about database-to-database integration. They're the ones who have learned to not trust the silence. The dashboard going green is data, not victory. The first fix working is information about the symptom, not proof of the cause.
NOW — what database-to-database integration actually is
Database-to-database integration is the synchronization of data between two databases — typically via CDC (change data capture), bulk loads, or trigger-based replication. The contract is: every meaningful change in the source produces a corresponding change in the target.
Most database-to-database integration failures are violations of that contract caused by something upstream of it. The system didn't fail. The system reported truthfully. The truth was contaminated.
Where Solix fits — honestly
Solix's perspective: CDC is necessary but not sufficient. Many state changes that matter to the business are encoded in absence of change — soft deletes, NULL semantics, retention triggers — and CDC doesn't naturally capture those. Solix makes the full state contract explicit so the target reflects what actually happened.
What to do this week, if any of this sounded familiar
- Pick a CDC pipeline. List the source events that don't produce CDC records (NULLs, soft deletes, retention). Are they captured?
- Audit the target. Does it ever lag behavior, even when it's caught up on records?
- Decide whether your DB-to-DB integration is change capture or state contract. The promotion bug will tell you.
If the answer is yes to any of these — that's where Solix lives.
Sources cited
About the author
Barry Kunst is VP of Marketing at Solix Technologies. He writes about enterprise data lifecycle, application retirement, and modernization in systems that have outlived their original mandate. Earlier in his career he supported IBM zSeries ecosystems for CA Technologies' multi-billion-dollar mainframe business, with first-hand exposure to lifecycle risk at scale.
- Solix Leadership
- Forbes Technology Council
- MIT
Find him at:
What you can do with Solix
Enter to win a $100 Amex Gift Card
Related Resources
Explore related resources to gain deeper insights, helpful guides, and expert tips for your ongoing success.
Why SOLIXCloud
SOLIXCloud offers scalable, secure, and compliant cloud archiving that optimizes costs, boosts performance, and ensures data governance.
-
Common Data Platform
Unified archive for structured, unstructured and semi-structured data.
-
Reduce Risk
Policy driven archiving and data retention
-
Continuous Support
Solix offers world-class support from experts 24/7 to meet your data management needs.
-
On-demand AI
Elastic offering to scale storage and support with your project
-
Fully Managed
Software as-a-service offering
-
Secure & Compliant
Comprehensive Data Governance
-
Free to Start
Pay-as-you-go monthly subscription so you only purchase what you need.
-
End-User Friendly
End-user data access with flexibility for format options.
