Quarry
Data and analytics
Collection, pipelines, a warehouse and BI dashboards running on infrastructure you control.
- Pipelines and warehouse on your hardware
- Dashboards without per-viewer seats
- Query cost you can predict
A working, pinned Docker Compose stack for self-hosted data engineering and analytics. Not a link dump - the integration layer: services wired together, environment template, quickstart, runbook, and a script that fetches the exact upstream sources at pinned commits.
Anyone moving analytics off metered warehouses.
Choose your tier
One-time purchase. Higher tiers add components; the top tier adds a live onboarding session. Every tier includes the runbook, verify script and component guides.
- Working Compose stack
- DuckDB and Polars recipes
- Pinned source fetch
- Everything in Local Analytics
- Airflow and ClickHouse wired
- First DAG walkthrough
- Everything in Pipeline Pack
- Trino and Superset running
- Dashboard and data-app guide
- Everything in Warehouse & BI
- Kafka and CDC streaming
- 30 days priority support
- All twelve components
- 1:1 onboarding session
- Lifetime updates
How it fits together
Each service runs as its own container. The compose file defines the network, the volumes and the wiring between them.
12 services, pinned
Every project keeps its own licence and copyright. The stack ships the integration, not a fork.
| Component | What it does | Licence | Source |
|---|---|---|---|
| duckdb
C++ |
In-process analytical database. | MIT | upstream fc9d6e9340 |
| polars
Rust |
Fast DataFrame library for Python. | MIT | upstream 9ee0dc5b81 |
| airflow
Python |
Workflow orchestration for data pipelines. | Apache 2.0 | upstream 484a87b54b |
| ClickHouse
C++ |
Column-oriented analytics database. | Apache 2.0 | upstream c83ecfd441 |
| trino
Java |
Distributed SQL query engine over many sources. | Apache 2.0 | upstream 2cf6ed7e29 |
| superset
Python |
Dashboards and business intelligence over your warehouse. | Apache 2.0 | upstream 549508b340 |
| streamlit
Python |
Turn Python scripts into data apps. | Apache 2.0 | upstream 7716a0c0bb |
| kafka
Java |
Distributed event streaming platform. | Apache 2.0 | upstream 432141b93a |
| debezium
Java |
Change data capture from your databases. | Apache 2.0 | upstream 15bcfe1892 |
| iceberg
Java |
Open table format for large analytic datasets. | Apache 2.0 | upstream 411c38b58c |
| dagster
Python |
Data orchestration with typed assets. | Apache 2.0 | upstream 54577dad9a |
| prefect
Python |
Python workflow orchestration. | Apache 2.0 | upstream 2338265f65 |
Run it
# 1. fetch the pinned upstream sources
./fetch-sources.sh ./sources
# 2. configure and start
cp .env.example .env
docker compose up -d
# 3. confirm everything came up
./verify.sh
Docker Engine 24+ with the Compose v2 plugin. 4 GB RAM for light tiers, 16 GB+ for the complete deployment.