Kiran Kumar
Staff Data Engineer
I build lakehouse platforms on Spark, Delta Lake, and Databricks — then write about the failures that no getting-started guide covers.
Four Hallucinations and a Python Script
I asked an LLM agent to get a Databricks job ID at runtime. It confidently proposed four approaches. All four were wrong. The fix was a 30-line Python script I could have written in ten minutes.
One Cluster per Task — Proven, Ready, and Waiting
We know what the real answer is. We tested it. The code is ready. We're just waiting for the right moment, and that's a completely legitimate engineering decision.
Free eBook
Spark, Delta Lake, and Databricks in Production
Real Problems, Real Fixes, No Theory
Early Access — 3 chapters published
Enterprise Lakehouse Migration
Migrated legacy data warehouse to modern lakehouse architecture, reducing costs by 45% and improving query performance.
Real-Time Analytics Platform
Built streaming data platform processing 10M+ events per day with sub-second latency using Structured Streaming.
— Always open to connecting with fellow engineers, swapping war stories, and talking shop about data platforms. —