Been seeing more and more OpenAI users raving about how much it blows GPT4 out of the water, and considering how hit or miss it’s been lately……I may finally be considering converting lol
But could someone please just…..break down what’s going on in the document that details the setup process? Maybe I’m just a dumbass but the only reason I haven’t converted yet is because it always looks SO overwhelming with all the walls of text and the code, and I end up just not even worrying about it. And I know it isn’t actually that difficult. So a breakdown of how I can get it up and running would be appreciated!
Edit: Wow I lowkey forgot about this post, I'm reminded of it because I keep getting comments occasionally just as confused as I was. For everyone who helped at the time, thank you!! I've since become a DS girlie like a lot of us, but I'll still leave this up for the memories lol
Videos
has anyone used claude ai with the 100k context for their role-plays? i’m someone who likes to do detailed slow burn with multiple scenarios in a chat, so if anyone has used claude ai does it generate good, realistic responses and have a good memory?
I have used Claude 2 before which also has 100k context, I havent seen it perform in long RPs cause I really dont do long RPs, but I can say its response is mostly fucking good, but btw sometimes Claude Instant can get to the same level as Claude 2 in terms of response but barely most at the time.
How do you guys use Claude on Janitor?
I'm just curious, mainly. Janitor (the model) is getting quite old with its antics and I'm wondering if there is an alternative that works well.
Anthropic just release Claude haiku today, it's their gpt3.5 equivalent model. which only cost 1/5 of the openai's (5$ should lasts you around 3 millions words in rp). and can easily jailbreak with assistance prefill
if you have access to it, you could use it as openai proxy for janitor through colab https://colab.research.google.com/drive/1OYj_IUCu5Wc8T3Wtxnf0iRul17CPEF4K
if you don't have access to it yet, you can use it through openrouter(a bit pricier due to recharge fee). which could be turned into proxy through colab too. (using self moderated claude, normal version got very strong filter)
openrouter user also has benefit of no daily limit and no soft ban. unlike Anthropic key method.
And you can use leftover credit for some other cheap model there too if you got bored of Claude's response. I recommend wizardlm 8x22b and command r plus
TURN ON THE PREFILL IF YOU WANT TO USE CLAUDE THROUGH OPENROUTER
https://colab.research.google.com/drive/1IRY1EU5cg87oUeOrIhmRSYpbJx_1wYN9