Skip to main content

Together AI

The Together API simplifies accessing and fine-tuning leading open-source models like Llama-2, RedPajama, Falcon, Alpaca, and Stable Diffusion XL with minimal code.

Requisites​

To use Together AI models, you need to have the following credential information.

Required credentials:

  • TOGETHERAI_API_KEY: Your TogetherAI API Key for authentication.

Supported Models​

All models provided by Together AI has the following properties:

  • Function call: Depend on the model
  • Streaming: Supported

All models accept the following extra configs when generating texts:

  • temperature
  • top_p
  • max_tokens
  • stop
  • top_k

Wildcard​

Model schema id: togetherai/wildcard

Since Together AI is a platform that hosts multiple models, TaskingAI created a wildcard model that can integrate all eligible models on Together AI. To integrate a specific model, pass the model id to the Provider Model Id parameter, for example mistralai/Mistral-7B-Instruct-v0.1.

NOTE: Only the following models supports function call:

mistralai/Mistral-7B-Instruct-v0.1,

mistralai/Mixtral-8x7B-Instruct-v0.1,

togethercomputer/CodeLlama-34b-Instruct

Integrate Togetherai Models