TLDR: the commit broke caching so the entire conversation history was being treated as new input on each call instead of most of the conversation being cached.
TLDR: the commit broke caching so the entire conversation history was being treated as new input on each call instead of most of the conversation being cached.