The Technology
CertainSync provides a first-of-its-kind, guaranteed, rateless set reconciliation solution that enables distributed systems to synchronize data more reliably, with reduced and predictable overhead and without manual parameter tuning — unlocking robust synchronization for blockchains, cloud services, distributed databases, and next-generation network applications.
In distributed networks like blockchains, cloud storage, and P2P systems, nodes often must reconcile differing datasets efficiently. Traditional reconciliation protocols either rely on statistical success (with no guaranteed outcome) or require pre-tuned parameters and estimations that may fail and significantly increase communication overhead. CertainSync overcomes these limitations by offering the first parameter-free, rateless, and guaranteed reconciliation method that adapts to unknown differences between datasets without prior estimation.
At its core, CertainSync builds on advanced data structures and introduces multiple constructions that ensure successful reconciliation once a communication threshold is reached. Unlike probabilistic schemes where failure is possible, CertainSync protocol guarantees accurate identification of every difference regardless of network conditions, as soon as sufficient coded information is exchanged. This makes it particularly valuable for modern distributed environments where communication costs and synchronization speed are critical.
Advantages
- Guaranteed reconciliation success without any parameter tuning or symmetric difference estimation compared to current state of art.
- Rateless adaptability that dynamically scales communication until reconciliation is achieved.
- Lower communication overhead – more than order of magnitude reduction, compared to schemes requiring redundant exchanges or estimation erors.
- Improved performance in blockchain networks, reducing synchronization time and network cost.
- Flexible architecture with multiple constructions tailored to practical system constraints.
Applications & Opportunities
- Blockchain synchronization: Reliable reconciliation of transaction pools across decentralized peers.
- Cloud storage consistency: Ensures that distributed cloud infrastructures maintain consistent replicated datasets.
- Distributed databases: Fast and guaranteed repair of database replicas with minimal communication.
- Peer-to-Peer systems: Efficient state synchronization in P2P file sharing and communication systems.
- Collaborative editing platforms: Real-time reconciliation of concurrent edits with certainty.
- Edge computing networks: Low-overhead synchronization across distributed edge nodes.
Publication:
“CertainSync: Rateless Set Reconciliation with Certainty”, Tomer Keniagin, Eitan Yaakobi, Ori Rottenstreich, Proceedings of the ACM on Measurement and Analysis of Computing Systems, 2025
https://dl.acm.org/doi/10.1145/3727110