#ops

By the end of this post you will... Understand, at a deeper level, how LLMs work Have built some new intuition for why LLMs work the way they do Understand the exact 1s and 0s that get cached, and how they reduce the cost of your LLM requests

By enforcing the lack of local state, we can ensure that state lives somewhere more appropriate - a queue, a database, an object store and so on. This makes coordination significantly easier - shared-nothing services can be thrown away, scaled up and down without having to worry about state.