Llama-Server MCP Proxy

Created By
extopicoa year ago
Simple node proxy for llama-server that enables MCP use
Overview

what is Llama-Server MCP Proxy?

Llama-Server MCP Proxy is a Node.js application that acts as a proxy server for llama-server, enabling the use of Model Context Protocol (MCP) tools for enhanced chat completion requests.

how to use Llama-Server MCP Proxy?

To use the proxy, clone the repository, set up the necessary configuration files, and run the proxy server. Point your LLM GUI client to the proxy's address to interact with the LLM using the configured tools.

key features of Llama-Server MCP Proxy?

  • MCP Tool Integration: Connects to MCP-compatible tool servers.
  • Dynamic System Prompt: Automatically generates a system prompt listing available tools.
  • Iterative Tool Use: Allows multiple tool calls in a single user turn.
  • Streaming Support: Maintains streaming of LLM responses.
  • Error Handling: Forwards errors from llama-server and provides feedback.
  • Configurable: Uses environment variables for customization.
  • Debug Logging: Optional verbose logging for troubleshooting.

use cases of Llama-Server MCP Proxy?

  1. Enhancing chat interactions with external tools.
  2. Integrating various MCP-compatible services for dynamic responses.
  3. Streamlining the development of applications using llama-server.

FAQ from Llama-Server MCP Proxy?

  • Can I use any MCP-compatible tool with this proxy?

Yes! You can configure any MCP-compatible tool server in the mcp-config.json file.

  • What are the prerequisites for running this proxy?

You need Node.js version 18 or higher and a running instance of llama-server.

  • How do I handle errors during tool execution?

The proxy will forward errors from llama-server, and you can enable debug logging for more insights.

Project Info
Created At
a year ago
Updated At
a year ago
Author Name
extopico
Star
13
Tags

Recommend Clients

View All
VIDEO-TO-CLAUDE

14 days ago
VIBE-PROSPECTING

3 months ago
ONTHEIA

a month ago
SUPERNORMAL

2 months ago
VERILEX-DATA

3 months ago
RAGEMP-SERVER

2 months ago
HEYM

4 days ago
PACE

2 months ago
SAGE

4 months ago
FEEDSPACE

3 months ago
rootcause
@Yuvraj

3 months ago
PDFCHECK-MCP

a month ago
SILVIA222

3 months ago