MCP Router Server

Created By
r2r0garzaa year ago
Overview

what is MCP Router Server?

MCP Router Server is a FastAPI-based server that routes requests to multiple LLM providers (such as OpenAI, LM Studio, OpenRouter, Ollama, Claude, Azure, etc.) through a unified REST API.

how to use MCP Router Server?

To use MCP Router Server, install the dependencies, configure the environment variables, and run the server. You can then test the health check and use the /ask endpoint to interact with the LLM providers.

key features of MCP Router Server?

  • Switch between LLM providers by editing the .env file.
  • Context-aware chat requests via the /ask endpoint.
  • Health check endpoint at /health.
  • Provider abstraction for various LLMs.
  • Easy deployment and configuration.

use cases of MCP Router Server?

  1. Integrating multiple LLM providers into a single application.
  2. Creating a chat application that can switch between different AI models.
  3. Testing and comparing responses from various LLMs.

FAQ from MCP Router Server?

  • What LLM providers are supported?

The server supports OpenAI, LM Studio, OpenRouter, Ollama, Claude, and Azure Foundry AI.

  • Is there a health check feature?

Yes, you can check the health of the server using the /health endpoint.

  • How do I switch LLM providers?

You can switch providers by editing the .env file to set your desired provider keys and options.

Project Info
Created At
a year ago
Updated At
a year ago
Author Name
r2r0garza
Star
0
Language
Python
License
MIT license

Recommend Servers

View All