What are some use cases for this? More on reddit.com

I'm working with Anthropic's Claude models and need to accurately count the number of tokens in my prompts and responses. I'm using the anthropic_bedrock Python client but recently came across an alternative method using the anthropic client. More on stackoverflow.com

Simon Willison llm seems close but seems to focus much on the CLI and not the library, also doesn't seem to give precise control for non-OpenAI models (might be wrong here) · context - i'm the repo maintainer More on news.ycombinator.com

Released yesterday by Mike Lambert. Example call: def main(max_tokens_to_sample: int = 200): c = anthropic.Client(os.environ['ANTHROPIC_API_KEY']) response = c.completion_stream( prompt=f"{anthropic.HUMAN_PROMPT} How many toes do dogs have?\n{anthropic.AI_PROMPT}", stop_sequences = [anthropic.HUMAN_PROMPT], max_tokens_to_sample=max_tokens_to_sample, model = 'claude-v0', stream=True, ) for data in response: print(data) (skippable) Some background on Anthropic OpenAI has ~375 employees, Anthropic has ~45. OpenAI median comp is ~$620k , which is top of market, and the people at Anthropic (which split off from OpenAI) are just as talented. In my opinion their best work is the Transformer Circuits Thread Project . Anthropic raised $124 million in a Series A round in 2021, then a $580 million Series B. But the Series B was led by SBF, and it's unsure how the FTX crash affected them. OpenAI's latest funding round details here: ( https://fortune.com/2023/01/11/structure-openai-investment-microsoft/ ). For more info, try reading all posts with the "Anthropic" tag at the AI alignment forum . Docs coming soon This snippet is a confirmation that Anthropic is going to monetize API access to Claude, which I don't think anyone doubted, but it's evidence that keys will be sent out sooner rather than later. # NOTE: disabling_checks can lead to very poor sampling quality from our API. # _Please_ read the docs on "Claude instructions when using the API" before disabling this _validate_prompt(params['prompt']) Differences from OpenAI's API The OpenAI equivalent of this can be found at https://github.com/openai/openai-python . It's a lot more fleshed out from an engineering POV, but in principle the gap shouldn't be too hard to close rapidly, so I'd wait for the SDK to mature up to parity before passing high-level judgements. I'm interested in seeing what decisions they make in their API design because that could provide insights into what they're thinking on a strategic/philosophical/cultural level. I think in general you can tell a lot about a team by reading their code. With the above caveat in mind, to level the playing field a bit, let's look at the initial commit for OpenAI , and put it next to the initial commit by Anthropic . Noting down a few observations I found interesting (plus some commentary): OpenAI's library was forked from Stripe's. Anthropic's library seems to have been made from scratch. Of the 527 people on LinkedIn who have OpenAI listed as their current company (not sure if all 375 people who actually work at OpenAI are represented in that), only 11 worked previously at Stripe, which is a smaller proportion than I expected! However, one of those 11 people is Greg Brockman , President and Co-Founder of OpenAI, who is also the author of this commit! OpenAI was founded in 2015, and this commit is from 2020. It'd be cool to see where it diverged and what changes the OpenAI fork made to Stripe's code. Snooping the gitignore is kinda mandatory at this point. Anthropic initial: .env __pycache__ .DS_Store **/.DS_Store Hah! They're using mac :D OpenAI initial: *.egg-info __pycache__ /public/dist OpenAI's gitignore contains a few more things now, but git blame shows most of them are due to Azure endpoints for finetuning. Also one line that's dead code leftover from an old thing that got removed, but I'm not going to talk about the present version too much since we're comparing initial commits. Simplicity: OpenAI: 52 files, 8074 lines Anthropic: 9 files, 241 lines More on reddit.com