Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tool use refresh #378

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Tool use refresh #378

wants to merge 2 commits into from

Conversation

mrmer1
Copy link
Contributor

@mrmer1 mrmer1 commented Jan 23, 2025

This PR introduces a new section on tool use, which is a technique that allows developers to connect Cohere's Command R family of models to external tools. The section covers basic usage, tool definition, parameter types, streaming, structured outputs, and citations.

  • Basic usage: The PR provides an overview of tool use, explaining how it enables developers to connect Cohere's Command R models to external tools like search engines, APIs, functions, and databases. It highlights the value of this technique for enterprise developers, as it allows them to leverage data stored in external sources. The Chat endpoint is introduced, which comes with built-in tool use capabilities such as function calling, multi-step reasoning, and citation generation. The PR then walks through the tool use workflow, consisting of four steps: getting the user message, generating tool calls, getting tool results, and generating the response and citations.
  • Tool definition: The PR explains the process of defining tools, which is a prerequisite for running a tool use workflow. It covers tool creation and tool schema definition. Tool creation involves creating a function or using external services that return an object for a given input. The PR provides an example of defining a get_weather function that returns the temperature for a given location. Tool schema definition is also explained, including the required fields and their purpose. The PR emphasizes the importance of clear and descriptive tool schemas to help the LLM make the right tool call decisions.
  • Parameter types: The PR introduces a new page on parameter types in tool use, although the content is currently a placeholder.
  • Streaming: The PR adds a new page on streaming for tool use, which is also a placeholder.
  • Structured outputs: The PR includes a new page on structured outputs for tool use, but the content is not yet available.
  • Citations: The PR introduces a new page on citations for tool use, which provides an overview of accessing citations and citation modes.
  • FAQs: The PR adds a new page for frequently asked questions about tool use, but the content is not yet provided.

Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant