Llama-Server MCP Proxy

Created By
extopicoa year ago
Simple node proxy for llama-server that enables MCP use
Overview

what is Llama-Server MCP Proxy?

Llama-Server MCP Proxy is a Node.js application that acts as a proxy server for llama-server, enabling the use of Model Context Protocol (MCP) tools for enhanced chat completion requests.

how to use Llama-Server MCP Proxy?

To use the proxy, clone the repository, set up the necessary configuration files, and run the proxy server. Point your LLM GUI client to the proxy's address to interact with the LLM using the configured tools.

key features of Llama-Server MCP Proxy?

  • MCP Tool Integration: Connects to MCP-compatible tool servers.
  • Dynamic System Prompt: Automatically generates a system prompt listing available tools.
  • Iterative Tool Use: Allows multiple tool calls in a single user turn.
  • Streaming Support: Maintains streaming of LLM responses.
  • Error Handling: Forwards errors from llama-server and provides feedback.
  • Configurable: Uses environment variables for customization.
  • Debug Logging: Optional verbose logging for troubleshooting.

use cases of Llama-Server MCP Proxy?

  1. Enhancing chat interactions with external tools.
  2. Integrating various MCP-compatible services for dynamic responses.
  3. Streamlining the development of applications using llama-server.

FAQ from Llama-Server MCP Proxy?

  • Can I use any MCP-compatible tool with this proxy?

Yes! You can configure any MCP-compatible tool server in the mcp-config.json file.

  • What are the prerequisites for running this proxy?

You need Node.js version 18 or higher and a running instance of llama-server.

  • How do I handle errors during tool execution?

The proxy will forward errors from llama-server, and you can enable debug logging for more insights.

Project Info
Created At
a year ago
Updated At
a year ago
Author Name
extopico
Star
13
Tags

Recommend Clients

View All
GGWP

22 days ago
HEYM

2 months ago
Chain.Love MCP
@Chain.Love

## Overview ### what is Chain.Love MCP? Chain.Love MCP is a hosted remote MCP server and gateway for AI agents. It provides a single endpoint for discovering and comparing Web3 infrastructure services across 50+ blockchain networks, including RPCs, indexing, oracles, storage, compute, and developer tools. ### how to use Chain.Love MCP? To use Chain.Love MCP, add the hosted endpoint to your MCP client and connect to `https://app.chain.love/mcp` over Streamable HTTP. For public use cases, the basic MCP server URL is enough. For private downstream MCPs, add credentials only when required using `x-chainlove-cred-<credentialKey>` headers. ### key features of Chain.Love MCP? - Hosted remote MCP gateway for AI agents - Single endpoint for Web3 infrastructure discovery across 50+ blockchain networks - Aggregates infrastructure options across RPCs, indexing, oracles, storage, compute, and developer tools - Streamable HTTP transport - Public documentation and onboarding resources available online ### use cases of Chain.Love MCP? - Discovering and comparing Web3 infrastructure providers across many blockchain networks - Finding RPC, indexing, oracle, storage, compute, and developer tooling options through one MCP server - Giving AI agents a single hosted integration surface for Web3 infrastructure discovery - Reducing the need to integrate many separate provider-specific endpoints ### FAQ from Chain.Love MCP? - Can Chain.Love MCP be used as a hosted remote MCP server? Yes. Chain.Love MCP is designed to be consumed as a hosted remote MCP endpoint at `https://app.chain.love/mcp`. - Does Chain.Love MCP require credentials? Not always. Some downstream integrations may require credentials, which can be passed using `x-chainlove-cred-<credentialKey>` headers when needed. - How do I know which credential header to use? You can check the open-source Chain.Love registry at `https://github.com/Chain-Love/chain-love/blob/main/references/offers/mcpservers.csv` or browse `https://app.chain.love/toolbox/mcpservers` and look for the relevant `credentialKey` value. - Where can I learn more? Landing page: `https://www.chain.love/mcp-gateway` Documentation: `https://chain-love.gitbook.io/mcp-module`

3 months ago
ENCONVERT-MCP

3 months ago
NOVAMYND

a month ago
AGENT

a month ago
IGPSPORT-MCP

21 days ago
LIVONIAN

a month ago
VIDEO-TO-CLAUDE

2 months ago