Together AI

Together AI MCP Connector for Claude

A+

Access 100+ open-source models for chat, image generation, and fine-tuning. Power your AI agents with Llama 3.3, Flux, and more.

27 tools Official Updated Oct 1, 2026 Official Vinkius Partner

Connect Together AI to your AI agent to leverage the world's fastest inference cloud for open-source models. This server provides a comprehensive suite of tools for generative AI, from text and image creation to advanced fine-tuning and batch processing.

What you can do

  • Inference & Chat — Generate high-quality responses using models like Llama 3.3, Qwen, and Mixtral via chat or text completions.
  • Media Generation — Create stunning images and videos from text prompts using state-of-the-art models like Flux and Stable Diffusion.
  • Audio Services — Convert text to speech (TTS) or transcribe audio files (STT) with speaker identification.
  • Advanced RAG — Generate vector embeddings and rerank documents to build high-performance search and retrieval systems.
  • Model Management — Manage fine-tuning jobs, dedicated endpoints, and file uploads for custom model training.
  • Batch Processing — Handle large-scale asynchronous workloads efficiently using the Batch API.

How it works

  1. Subscribe to this server
  2. Enter your Together AI API Key
  3. Start building with the most powerful open-source models directly from your MCP-compatible client

Who is this for?

  • AI Developers — integrate cutting-edge LLMs and image models into your applications without managing infrastructure
  • Data Scientists — fine-tune models on custom datasets and manage checkpoints seamlessly
  • Product Teams — prototype and scale AI features using a unified, high-performance API
llmgenerative-aillama-3image-generationfine-tuning

27 tools expose this connector's capabilities to your AI agent.

upload_file

Specify the purpose (fine-tune, eval, or batch-api) when uploading. Upload a file for fine-tuning, evals, or batch inference

create_chat_completion

3-70B-Instruct-Turbo. Generate a model response for a given chat conversation

create_fine_tune

Provide the base model and training data file ID; set learning rate and batch size. Create a fine-tuning job

delete_endpoint

Ensure the endpoint is not currently in use before calling this function. Delete a dedicated endpoint

delete_fine_tune

Ensure the job is not currently running before calling this tool. Delete a fine-tuning job

get_endpoint

Use the endpoint ID to fetch the details. Get details of a specific dedicated endpoint

get_fine_tune

Provide the required job ID. Get details of a specific fine-tuning job

list_endpoints

List all dedicated endpoints

list_files

List all uploaded files

list_fine_tune_checkpoints

Specify the job ID to retrieve the list. List checkpoints for a fine-tuning job

list_fine_tunes

Use this tool to view the status and details of existing jobs. List all fine-tuning jobs

list_models

List all available models on Together AI

create_video_generation

Provide a prompt and model name. Create videos from text or image prompts

update_endpoint

Use this tool to change scaling or status settings. Update a dedicated endpoint (Start/Stop/Scale)

create_audio_speech

Provide the text and model name; use a specific voice name for consistency. Text-to-Speech (TTS) generation

cancel_batch

Use the Batch Job ID to target the job. Cancel a running batch job

get_file

Use the file ID to fetch the details. Retrieve metadata for a specific file

list_batches

List all batch jobs

create_audio_transcription

Specify the audio file and the desired language code. Transcriptions (STT) from audio file

create_batch

Provide the target endpoint and the ID of the input file. Create a new asynchronous batch job

create_embeddings

Provide the input text and specify the desired model name. Turn text into vector embeddings

create_endpoint

Specify the model and required hardware configuration. Create a dedicated endpoint for predictable performance

create_image_generation

Specify a prompt and model name; width and height are required. Generate images from text prompts

create_rerank

Supply the search query and the documents to be ranked. Reorder documents by relevance to a query

create_text_completion

Use this tool when you need generative text output. Generate text completions for a given prompt

delete_file

Provide the file ID to remove the resource. Delete an uploaded file

get_batch

Pass the required Batch Job ID. Get details of a specific batch job

See how to talk to your AI agent using Together AI.

Generate a chat completion using meta-llama/Llama-3.3-70B-Instruct-Turbo explaining quantum computing.

I've initiated the request to Llama-3.3-70B. Quantum computing uses qubits to perform calculations that are impossible for classical computers by leveraging superposition and entanglement...

Create an image of a futuristic laboratory using the black-forest-labs/FLUX.1-schnell model.

Generating image... I've successfully created the image of a futuristic laboratory. You can access the result at the provided URL or as a base64 string.

List all available models on Together AI.

Fetching model list... You have access to over 100 models, including Llama-3.3-70B, Mixtral-8x7B, Flux.1, and various embedding models. Would you like to filter by type?

Use the `create_chat_completion` tool. Specify the model name (e.g., 'meta-llama/Llama-3.3-70B-Instruct-Turbo') and provide an array of messages. The agent will return the generated response from the model.

Related Connectors