Kiran Kumar

Staff Data Engineer

I build lakehouse platforms on Spark, Delta Lake, and Databricks — then write about the failures that no getting-started guide covers.

October 27, 2026

A paused stream is a countdown: when the checkpoint outlives the Delta log

We paused a streaming job in staging and forgot about it. Sixty days later it couldn't start, because the source table had cleaned up the log versions its checkpoint still pointed at. Same job, same error, twice.

Databricks/Structured Streaming/Delta Lake/Incident Analysis
7 min read

Free eBook

Spark, Delta Lake, and Databricks in Production

Real Problems, Real Fixes, No Theory

Early Access — 3 chapters published

— Always open to connecting with fellow engineers, swapping war stories, and talking shop about data platforms. —