A niche has opened for creating library Assistants* and AI Functions** that work off of plain document generators (like offline LLM and all the ChatGPT competitors)
* LLM things that use tools
** tools that interface with ordinary code via known formats
e.g. something that argues with the bot until it gives you json or toml or whatever and then a parser than can rip out the extraneous polite-text.