The surprising insight due to the advent of large language models (LLM) is, that Artificial Intelligence isn't emerged from itself but a human has to formulate a prompt which gets executed by the AI. A LLM can search in databases, write a poem or program a software, but a human operator has to provide the command in natural language first. More recent LLMs can generate their own prompt and execute it. They don't need a human operator as prompt generator anymore but they are working truly autonomously. A possible meta prompt would "Can you generate 10 random prompts for different tasks and execute them one by one?". Most current large language models will understand and process such a prompt. The counter in the prompt can be increased from 10 to 1000 or any arbitrary value. Such a large language model will occupy all the available energy and has a huge workload. More on reddit.com

I think the system prompt is essentially prompt cached which drastically reduces their costs. More on reddit.com

API.... More on reddit.com

Haha no wonder you get ten messages in and all of a sudden you’re hit with “The chat is getting too long, long chats cause you to hit your limit faster” More on reddit.com