Transformation
SQL and dataframe frameworks that turn landed data into models.
- dbt
SQL-first framework for tested, documented warehouse models. This entry is dbt Core.
- dbt Cloud
Commercial hosted product for developing, scheduling, and documenting dbt projects.
- SQLMesh
SQL transformation framework with virtual environments and plan-based deploys.
- Apache Spark
Engine for large-scale batch processing, with a streaming API on the same model.
- Polars
Dataframe library for local analytical work in Python and Rust.
- Dataform
SQL workflow framework for warehouse models. Google Cloud also offers a managed Dataform product.