← Gallery
Diagram
high-level
← Prev
Next →
High-level
Lakehouse capability sweep
Lakehouse capability sweep
A five-phase platform sweep. External relational databases, SFTP drops and web forms land in Apache NiFi under the ingest phase; NiFi writes to MinIO, the focal object storage hub under the store phase; Trino federates queries over MinIO under the query phase; JupyterHub reads Trino under the analyse phase; Superset publishes under the visualise phase. An Airflow orchestration bar inside the Kubernetes deployment boundary drops dashed triggers into NiFi, Trino and JupyterHub. Identity and observability cross-cutting bars span the full width below the boundary, paired with the security and observability concern chevrons in the right-hand strip.
Ingest
Store
Query
Analyse
Visualise
Orchestr.
Security
Observ.
Kubernetes deployment boundary
External sources
JDBC
SFTP
HTTPS
PUT
scan
JDBC
publish
Apache Airflow
scheduler · triggers ingest, federation and notebook runs
Relational DBs
SFTP drops
Web forms
Apache NiFi
ingest tool
MinIO
object storage hub
Trino
federation engine
JupyterHub
notebook surface
Superset
presentation surface
Identity and policy
Keycloak · LDAP · OIDC · HashiCorp Vault — applies to every phase, emits no connectors
Observability
Prometheus · Grafana · Loki — applies to every phase, emits no connectors