One new model, runs hourly, reads from a large event table and writes about 400k rows a day. The bill went from roughly $900 to $2700 a month and this is the only change we made. The model looks cheap when I run it once…
A scheduled task pulls from an API, writes to staging, then merges into the warehouse. If the task dies halfway through the write and the retry runs, we get duplicate rows for the records that landed before the crash.…
Events can arrive up to four days after the event timestamp. My daily rollups are built once at 2am for the previous day, so anything late is simply missing until somebody notices and asks for a backfill, which…
Built our first real scheduled pipeline about six weeks ago. It has needed manual intervention four times: an API rate limit, an upstream schema change, a disk filling up, and one thing I still cannot explain. I…
Customer dimension, about 40 million rows, sourced from three systems with imperfect keys. A full rebuild takes 25 minutes and is dead simple. A merge takes 3 minutes but I am nervous about drift and about the key…