Claude 2 Anthropic Support

[bhctest123]

It would be awesome to support claude 2! the 100k context window is amazing.

You could implement this and solve it across many LLMs: https://github.com/BerriAI/litellm

[ishaan-jaff]

I'm the maintainer of liteLLM - happy to make a PR and add an integration😊

[codebanesr]

At the moment, I am unable to see Claude being utilized to facilitate completions on Langchain. Nevertheless, Langchain does provide a Chat API as detailed here: https://python.langchain.com/docs/integrations/llms/. On the other hand, Claude's support for completions is available on Llama Index, so experimenting with that option could be worthwhile.

[ishaan-jaff]

ChatLiteLLM() is integrated into langchain and allows you to call all models using the OpenAI I/O interface
https://python.langchain.com/docs/integrations/chat/litellm