Article
The Lean Data Platform: An AI-Ready Architecture Without Spark
A lean, AI-ready data platform built on Python, DuckDB 2.0, Parquet, and Apache Iceberg, serving BI tools and AI agents without a distributed framework.
The Publication
Practical ideas for simpler data systems.
Articles for engineers and technical leaders building data systems their teams can understand, maintain, and use.
Latest Articles
Ideas to put into practice.
Article
Why AI-Generated Code Becomes Slop and How to Fix It
Improve AI-generated code with clear requirements, reusable agent skills, appropriate model selection, and planning that reduces unnecessary assumptions.
Article
AI Isn’t Replacing Data Engineers. It’s Changing Their Job.
Much of the discussion around AI in data engineering focuses on where AI fits into pipelines, analytics workflows, or orchestration platforms. There is growing interest in AI generated…
The Newsletter
Keep learning with Lean Data Engineer.
Get new writing on practical data engineering in your inbox.
Need help with your data systems?
Consulting is provided by Constellation Systems, the company behind Lean Data Engineer.