Software Engineer - Database Integrations

Note:. We are hiring for this role remotely in any country ClickHouse has a hiring presence. ABOUT THE TEAM The ClickPipes - Database Integrations team builds the platform that enables real-time data replication from databases into ClickHouse at petabyte scale. As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open — our database integrations are built on PeerDB https://github.com/PeerDB-io/peerdb, an open-source CDC platform we actively maintain and contribute to. See some of our recent work: - ClickPipes for Postgres now supports failover replication slots https://clickhouse.com/blog/clickpipes-postgres-failover-replication - MongoDB CDC to ClickHouse with Native JSON Support https://clickhouse.com/blog/mongodb-cdc-clickhouse-preview - Under the Hood: Building MySQL Change Data Capture in ClickPipes https://clickhouse.com/blog/building-msql-change-data-capture-in-clickpipes WHAT YOU’LL DO: - Build data-intensive systems - Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake). - Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc. - Design integration solutions to enable users to fully harness ClickHouse's performance and throughput. Own end-to-end reliability - Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing). - Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations. - Write clear documentation, both publicly and internally. - Participate in on-call rotation. Drive product innovation - Work directly with customers to understand integration requirements and discover gaps in existing product. - Collaborate cross-functionally with internal teams to ensure operational efficiency. - Lead technical discussions and influence product roadmaps. ABOUT YOU: - 5+ years of industry experience building data-intensive software solutions. - Proficient in Go, or experienced in systems programming with willingness to ramp up quickly in Go. - Cloud-native experience deploying and operating services on at least one major cloud platform (AWS/GCP/Azure). - Practical experience with Kubernetes. - Strong problem solver and solid production debugging skills. - Clear communication in writing (design docs, code review) and verbally (technical discussions, customer calls, incident response). Bonus Points - Experience with database replication technologies (CDC, logical replication). - Experience with durable execution frameworks (Temporal). - Experience with data formats and protocols (Avro, Parquet, Protobuf). - Experience with modern data processing frameworks (e.g. Kafka, Spark, Flink). - Experience with maintaining/contributing to open-source software. WHY JOIN US - Work on challenging problems at the intersection of database technologies, distributed systems, and cloud-native architecture. - Work on a team that builds software in the open (PeerDB https://github.com/PeerDB-io/peerdb), and that cares about the craft of engineering, documentations, and continuous learning. - Be part of a high-visibility team that delivers meaningful impact to customers in a dynamic, hyper-growth environment. #LI-remote