Kiran Kumar
Staff Data Engineer
I build lakehouse platforms on Spark, Delta Lake, and Databricks — then write about the failures that no getting-started guide covers.
27 seconds: what a UC metastore blip taught us about streaming resilience
Three streaming jobs died within 32 seconds of each other. The data plane was healthy the whole time. Here's what actually happened and what we changed.
Four Hallucinations and a Python Script
I asked an LLM agent to get a Databricks job ID at runtime. It confidently proposed four approaches. All four were wrong. The fix was a 30-line Python script I could have written in ten minutes.
Free eBook
Spark, Delta Lake, and Databricks in Production
Real Problems, Real Fixes, No Theory
Early Access — 3 chapters published
Enterprise Lakehouse Migration
Migrated legacy data warehouse to modern lakehouse architecture, reducing costs by 45% and improving query performance.
Real-Time Analytics Platform
Built streaming data platform processing 10M+ events per day with sub-second latency using Structured Streaming.
— Always open to connecting with fellow engineers, swapping war stories, and talking shop about data platforms. —