- tools because the context is in the tools - memory which all do some sort of...

@mistersql

@AlSweigart - tools because the context is in the tools
- memory which all do some sort of condensing of the old prompt or a tool, again, except for looking up chat windows
- Gemini, etc, which just did computer science tricks to just make the context larger
- context rot, where studies of giving bots too much context makes them perform worse

youtube.com/watch?v=TUjQuC4uga

Self-replies

@AlSweigart I've had to write python tools to convert all my code to markdown, when that got too big, I would strip out the comments/docstrings, or alternately, strip out the code and just leave the signatures. This turns out to be difficult, but it really improved performance of small context window bots like GPT 3.5.

I recently started paying for gemini for the large context window & it does a reasonable job of thinking about a code base holistically.