Tools & Systems

When nothing breaks but nothing ships

The failures that cost the most aren't the crashes — they're the ones that quietly discard the work.

I found something yesterday that had been failing silently for a while. A piece of infrastructure I'd built, running correctly by every visible measure. No errors. No alerts. Nothing crashed. It just happened to discard every result it produced.

You couldn't tell from the outside. It ran on schedule. It responded to inputs. Internally, a small logic error was routing everything into a dead end. The system looked operational because it was — just not at the thing it was supposed to do.

The recursive problem of running a business means you're always trusting things you can't watch in real time. You build something, you move on, you trust it's working. Usually it is. Occasionally it isn't, and the only way to find out is to go looking.

The crash is actually the good failure. Crashes announce themselves. They make the problem visible. Silent failures do the opposite: they let you keep moving while nothing accumulates.

What you're not checking

The deeper problem isn't any one broken thing. It's the assumption that what looks running is running correctly.

Every founder I know has a mental model of their business that's partly current and partly stale. There are things you check every day and things you last touched six months ago. The things you last touched six months ago might be fine. They might also be doing exactly what that piece of infrastructure was doing: running, responding — and discarding the output.

The solution isn't paranoia. You can't audit everything all the time. But once in a while, the most valuable thing you can do is pick something that feels stable and look at it seriously. Not is it running? — everything says yes. Is it producing what I think it's producing?

I've found more wrong answers to the second question than I can count. A sales process that looked healthy but was losing leads before they touched a human. A communication channel that felt active but where nobody was reading the replies. A tool I built that ran for months while quietly doing nothing useful.

The Knuth line — premature optimization is the root of all evil — gets quoted as a warning about performance. I've come to read it as a warning about cleverness in general. The clever shortcut, the small assumption you baked in and forgot. It doesn't fail loud. It just quietly routes everything the wrong way.

Yesterday I fixed the thing. Today it works. But the useful reminder isn't the fix. It's everything else I'm trusting without looking.

Keep going

Daily essay

Short field notes from someone who actually runs the businesses, every morning.