# datazip-inc/olake

> olake is an open-source data ingestion engine that replicates databases, S3 and Kafka into Apache Iceberg tables or plain Parquet files. It runs full loads and change data capture (CDC) from PostgreSQL, MySQL, MongoDB, Oracle, DB2, MSSQL, Kafka and S3 sources, then writes the records to the chosen destination. The core is written in Go, with a Java component for the Iceberg writer.

Source: https://github.com/datazip-inc/olake
Indexed: commit de2b96e on 2026-09-29 by Repowise. Facts come from the source and git history, not from the maintainer.

## Facts

- Type: App
- Language: Go
- Stars: 1,585 at index time
- License: Apache-2.0
- Code health: 6.5/10, Fair
- Last commit: 2026-09-28
- Contributors: 59

## How it works

Each source has its own connector directory under drivers, such as drivers/mysql/main.go, which serves as that connector's entry point. The main.go file in each driver relies on the single public entry in the root module to set up the shared protocol machinery and start the connector run. The files protocol/root.go, protocol/discover.go, protocol/sync.go, protocol/clear.go and protocol/check.go define the lifecycle operations, such as discover, check, sync and clear. The destination directory defines the writer interfaces and destination error handling, and destination/iceberg/iceberg.go and destination/parquet/parquet.go implement them for Iceberg and plain Parquet. The Iceberg writer also has a Java project in destination/iceberg/olake-iceberg-java-writer.

- drivers/db2/main.go: entry point
- drivers/kafka/main.go: entry point
- drivers/mongodb/main.go: entry point
- drivers/mssql/main.go: entry point
- drivers/mysql/main.go: entry point
Modules: drivers, destination, utils, tests, pkg, types, protocol, root. 374 files, 54,816 lines, 3,058 symbols.

## Code health

- Score: 6.5/10 (Fair)
- Rank: #190 of 4,000+ indexed repos
- Hotspots: destination/iceberg/proto/records_ingest.pb.go, destination/iceberg/iceberg.go, destination/parquet/parquet.go, destination/iceberg/java_client.go, destination/iceberg/arrow-writer/writer.go
- Lowest file: drivers/kafka/internal/cdc.go
- Dead code: 35 findings

## Maintenance

- Last commit 2026-09-28, first commit 2023-05-15, 787 commits
- 59 contributors, bus factor 4

## Security

- Security findings are shown to signed-in users at https://repowise.dev/repo/datazip-inc/olake/security

## More

- Page: https://repowise.dev/repo/datazip-inc/olake
- Ask this codebase: https://repowise.dev/repo/datazip-inc/olake/chat
- Docs: https://repowise.dev/repo/datazip-inc/olake/docs
- MCP (signs in with Repowise on first use):
    claude mcp add --transport http repowise https://api.repowise.dev/mcp/datazip-inc/olake
