Search Results for "data replication"
Sort By:
Showing 125 open source projects for "data replication"
View related business solutions-
Gen AI apps are built with MongoDB AtlasMongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
-
Get to know our award-winning HR software.BambooHR is all-in-one HR software made for small and medium businesses and the people who work in them—like you. Our software makes it easy to collect, maintain, and analyze your people data, improve the way you hire talent, onboard new employees, manage compensation, and develop your company culture. It’s designed to set you free to focus on what matters most—your people.
-
1
data-diff
Efficiently diff rows across two different databases
...Replicating data at scale, across hundreds of tables, with low latency and at a reasonable infrastructure cost is a hard problem, and most data teams we’ve talked to, have faced data quality issues in their replication processes. The hard truth is that the quality of the replication is the quality of the data. Since copying entire datasets in batch is often infeasible at the modern data scale, businesses rely on the Change Data Capture (CDC) approach of replicating data using a continuous stream of updates. -
2
pg_easy_replicate
Easily setup logical replication and switchover to new database
pg_easy_replicate is a simple tool for replicating PostgreSQL data from one database to another using logical replication. It abstracts away the complexity of publication/subscription setup and enables selective table replication. Ideal for developers or data engineers who want quick replication without deep Postgres expertise. -
3
pglogical
Logical Replication extension for PostgreSQL
pglogical is an advanced logical replication extension for PostgreSQL that allows selective replication of data between databases. Unlike physical replication, it enables fine-grained control of which tables or changes to replicate. It’s well-suited for multi-master setups, version upgrades, and real-time data distribution across environments. -
4
ReplicaDB
ReplicaDB is open source tool for database replication
ReplicaDB is an open-source, multi-platform tool for database replication, enabling the migration and synchronization of data across different relational and NoSQL databases. It is optimized for efficiency and minimal downtime. -
Transforming NetOps Through No-Code Network Automation - NetBrainNetBrain, founded in 2004, provides a powerful no-code automation platform for hybrid network observability, allowing organizations to enhance their operational efficiency through automated workflows. The platform applies automation across three key workflows: troubleshooting, change management, and assessment.
-
5
SymmetricDS
SymmetricDS is database replication and file synchronization software
SymmetricDS is an open-source platform for database replication and synchronization across heterogeneous systems. It supports multi-master and one-way replication with conflict resolution and works over unreliable networks. SymmetricDS is ideal for distributed applications, data warehousing, and edge deployments where consistency and availability are key. -
6
PeerDB
Fast, Simple and a cost effective tool to replicate data from Postgres
PeerDB is an open-source platform for real-time replication and transformation of data from PostgreSQL to analytical warehouses like BigQuery and Snowflake. It supports Change Data Capture (CDC) and provides seamless syncing and transformation logic with low latency. PeerDB is ideal for teams building real-time data pipelines without relying on expensive proprietary solutions. -
7
SyncLite
Build Anything Sync Anywhere
SyncLite is an open-source, low-code, comprehensive relational data consolidation platform enabling developers to rapidly build data-intensive applications for edge, desktop and mobile environments. SyncLite enables real-time, transactional data replication and consolidation from various sources including edge/desktop applications using popular embedded databases (SQLite, DuckDB, Apache Derby, H2, HyperSQL), data streaming applications, IoT message brokers, traditional database systems(ETL) and more into a diverse array of databases, data warehouses, and data lakes, enabling AI and ML use-cases at all three levels: Edge, Fog and Cloud. ... -
8
RxDB
Client side, offline-first, reactive database for JavaScript apps
...Reactive means that you can not only query the current state but subscribe to all state changes like the result of a query or even a single field of a document. This is great for UI-based real-time applications in a way that makes it easy to develop and also has great performance benefits. To replicate data between your clients and server, RxDB provides modules for real-time replication with any CouchDB compliant endpoint and also with custom GraphQL endpoints. Multiplatform support for browsers, nodejs, electron, Cordova, react-native and every other javascript runtime. Replication between client and server-data, compatible with pouchdbPouchDB, couchdbCouchDB, and cloudantIBM Cloudant. ... -
9
Redis
An in-memory database that persists on disk
Redis is an open-source (BSD licensed), in-memory data structure store, used as a database, cache, and message broker. Redis provides data structures such as strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperloglogs, geospatial indexes, and streams. Redis has built-in replication, Lua scripting, LRU eviction, transactions, and different levels of on-disk persistence, and provides high availability via Redis Sentinel and automatic partitioning with Redis Cluster. ... -
Windocks - Docker Oracle and SQL Server ContainersWindocks is a leader in cloud native database DevOps, recognized by Gartner as a Cool Vendor, and as an innovator by Bloor research in Test Data Management. Novartis, DriveTime, American Family Insurance, and other enterprises rely on Windocks for on-demand database environments for development, testing, and DevOps. Windocks software is easily downloaded for evaluation on standard Linux and Windows servers, for use on-premises or cloud, and for data delivery of SQL Server, Oracle, PostgreSQL, and MySQL to Docker containers or conventional database instances.
-
10
Kubegres
Kubegres is a Kubernetes operator allowing to deploy clusters
Kubegres is a Kubernetes operator that allows to deployment one or many clusters of PostgreSQL pods with data replication and failover enabled out-of-the-box. It brings simplicity when using PostgreSQL considering how complex managing a stateful-set's life cycle and data replication could be with Kubernetes. Kubegres is fully integrated with Kubernetes' lifecycle as it runs as an operator written in Go. It is minimalist in terms of codebase compared to other open-source Postgres operators. ... -
11
Dgraph
The Only Native GraphQL Database With A Graph Backend
Dgraph is a horizontally scalable and distributed GraphQL database, the only native GraphQL database to have a graph backend. Dgraph is able to do things that other graph DBs can’t. It provides consistent replication, automatic data movement for shard balancing, distributed ACID transactions, as well as native support for full text search, regular expressions and geo search. If you have over 10 SQL tables interconnected via foreign keys, or sparse data that don’t fit neatly into SQL tables; or if you just want a simple and flexible schema, and prioritize speed and performance at scale, Dgraph is the best choice for you. ... -
12
pg_flo
Stream, transform, and route PostgreSQL data in real-time
The easiest way to move and transform data between PostgreSQL databases. -
13
CouchDB.NET
EF Core-like CouchDB experience for .NET
CouchDB-Net is a .NET client library for Apache CouchDB, providing developers with a simple way to interact with the database using C#. It enables document storage, querying, and replication in .NET applications. -
14
Olric
Distributed, in-memory key/value store and cache
A lightweight, distributed in-memory data store designed for key-value caching and ephemeral storage. -
15
ReductStore
The fastest time series object store for Edge AI
History storage and management of images, vibration data, text, labels, and more - all in one place with the highest performance. Merge blob and time series functionalities, reducing the need for multiple databases. Customize real-time data retention policies and replication strategies. Store billions of time-stamped blobs with AI labels and access them with low latency. Outperform other databases with a customized solution for time-series object data. ... -
16
ClickHouse
A fast open-source OLAP database management system
...Apart from its blazing speed, ClickHouse is highly reliable and fault tolerant. It supports multi-master asynchronous replication with the option of being deployed across multiple datacenters. With all nodes equal, there is no single point of failure. Downtime of a single node or even the whole datacenter won't affect the system's availability. ClickHouse also has exceptional hardware efficiency and a host of other features, including a feature-rich SQL database, vectorized query execution, real-time query processing and data ingestion, and more. -
17
Canal
MySQL binlog
Canal is an open-source project developed by Alibaba that simulates MySQL slave functionality to parse MySQL binlog files. It enables real-time data synchronization and change data capture (CDC) between MySQL and other systems such as Elasticsearch, Kafka, or HBase. Canal is widely used for data integration, replication, and monitoring across distributed systems, offering high performance and low-latency log parsing. -
18
pgwire
PostgreSQL wire protocol implemented as a rust library.
Build a Postgres compatible access layer for your data service. This library implements PostgreSQL Wire Protocol and provides essential APIs to write PostgreSQL-compatible servers and clients. If you are interested in a related topic, you can check project ideas to build on top of this library. -
19
Sanoid
These are policy-driven snapshot management and replication tools
...It sets and respects ZFS properties, places holds to protect in-use snapshots, and surfaces health issues so you notice problems before recovery time. Paired with its sibling syncoid, it also handles local and remote replication of incremental snapshots over SSH, supporting resume tokens, bandwidth shaping, and common accelerators like mbuffer. The design favors safety and observability: dry-run modes, verbose logging, and conservative defaults reduce the risk of accidental data loss. In production, Sanoid turns ZFS’s powerful but low-level primitives into dependable, auditable data protection for everything from home labs to multi-tenant servers. -
20
CubeFS
cloud-native file store
CubeFS is a new generation cloud-native storage that supports access protocols such as S3, HDFS, and POSIX. It is widely applicable in various scenarios such as big data, AI/LLMs, container platforms, separation of storage and computing for databases and middleware, data sharing and protection, etc. Compatible with various access protocols such as S3, POSIX, HDFS, etc., and the access between protocols can be interoperable. Support replicas and erasure coding engines, users can choose flexibly according to business scenarios. ... -
21
pg_auto_failover
Postgres extension and service for automated failover
pg_auto_failover is a PostgreSQL extension and management tool for automated high availability. It handles health checks, failover, and monitoring without requiring third-party tools or complex configuration. Designed by the Citus Data team at Microsoft, it's ideal for developers and ops teams wanting reliable HA with minimal effort. -
22
cbl-dart
Couchbase Lite for Dart and Flutter
CBL-Dart is a Dart wrapper for Couchbase Lite, allowing Flutter and Dart applications to integrate with Couchbase’s NoSQL database. It enables offline data storage, synchronization, and efficient querying for mobile and embedded applications. -
23
Sequin
Postgres change data capture to streams and queues like Kafka
Sequin is a change data capture (CDC) system that replicates API data to Postgres in real time. It syncs services like Stripe, Salesforce, and GitHub into PostgreSQL tables, enabling developers to query third-party data with standard SQL. Sequin is ideal for building data-driven applications that need immediate visibility into external SaaS platforms. -
24
PULSAR
Distributed pub-sub messaging system
...scale for over 5 years, with millions of messages per second across millions of topics. Expand capacity seamlessly to hundreds of nodes. Low publish latency (< 5ms) at scale with strong durability guarantees. Configurable replication between data centers across multiple geographic regions. Built from the ground up as a multi-tenant system. Supports isolation, authentication, authorization and quotas. Persistent message storage based on Apache BookKeeper. IO-level isolation between write and read operations. Flexible messaging models with high-level APIs for Java, Go, Python, C++, Node.js, WebSocket and C#. -
25
Elasticsearch
A Distributed RESTful Search Engine
Elasticsearch is a distributed, RESTful search and analytics engine that lets you store, search and analyze with ease at scale. It lets you perform and combine many types of searches; it scales seamlessly, and offers answers incredibly fast with search results you can rank based on a variety of factors. Elasticsearch can be used for a wide variety of use cases, from maps and metrics to site search and workplace search, and with all data types.