Sure maybe a really beastly one, but all the available models right now have relatively poor context windows. When assisting in complex setups, they let go of information frequently to keep the dialogue flowing. Suddenly it’ll be giving you code snippets like
BASE_URL = [your base URL]
even when it should know my base URL.
So like, yeah, openai could probably show an AI create a fediverse instance. It’d take as much electricity as Manhattan uses in a day. But I doubt even OpenAIs new pro o1 model could achieve this, currently.
In fact, the context window was a significant weakness in the o1-preview. It was even worse than 4o.
Sure maybe a really beastly one, but all the available models right now have relatively poor context windows. When assisting in complex setups, they let go of information frequently to keep the dialogue flowing. Suddenly it’ll be giving you code snippets like
BASE_URL = [your base URL]
even when it should know my base URL.
So like, yeah, openai could probably show an AI create a fediverse instance. It’d take as much electricity as Manhattan uses in a day. But I doubt even OpenAIs new pro o1 model could achieve this, currently.
In fact, the context window was a significant weakness in the o1-preview. It was even worse than 4o.