Lynkr - Claude Code Proxy with Multi-Provider Support

Production-ready Claude Code proxy supporting 9+ LLM providers with 60-80% cost reduction through token optimization.

---

Overview

Lynkr is a self-hosted proxy server that unlocks Claude Code CLI , Cursor IDE and Codex Cli by enabling:

• 🚀 Any LLM Provider - Databricks, AWS Bedrock (100+ models), OpenRouter (100+ models), Ollama (local), llama.cpp, Azure OpenAI, Azure Anthropic, OpenAI, LM Studio
• 💰 60-80% Cost Reduction - Built-in token optimization with smart tool selection, prompt caching, and memory deduplication
• 🔒 100% Local/Private - Run completely offline with Ollama or llama.cpp
• 🎯 Zero Code Changes - Drop-in replacement for Anthropic's backend
• 🏢 Enterprise-Ready - Circuit breakers, load shedding, Prometheus metrics, health checks

Perfect for:

• Developers who want provider flexibility and cost control
• Enterprises needing self-hosted AI with observability
• Privacy-focused teams requiring local model execution
• Teams seeking 60-80% cost reduction through optimization

---

Quick Start

Installation

Option 1: NPM Package (Recommended)

# Install globally
npm install -g lynkr

# Or run directly with npx
npx lynkr

Option 2: Git Clone

# Clone repository
git clone https://github.com/vishalveerareddy123/Lynkr.git
cd Lynkr

# Install dependencies
npm install

# Create .env from example
cp .env.example .env

# Edit .env with your provider credentials
nano .env

# Start server
npm start

Option 3: Docker

docker-compose up -d

---

Supported Providers

Lynkr supports 9+ LLM providers:

Provider	Type	Models	Cost	Privacy
AWS Bedrock	Cloud	100+ (Claude, Titan, Llama, Mistral, etc.)	$$-$$$	Cloud
Databricks	Cloud	Claude Sonnet 4.5, Opus 4.5	$$$	Cloud
OpenRouter	Cloud	100+ (GPT, Claude, Llama, Gemini, etc.)	$-$$	Cloud
Ollama	Local	Unlimited (free, offline)	FREE	🔒 100% Local
llama.cpp	Local	GGUF models	FREE	🔒 100% Local
Azure OpenAI	Cloud	GPT-4o, GPT-5, o1, o3	$$$	Cloud
Azure Anthropic	Cloud	Claude models	$$$	Cloud
OpenAI	Cloud	GPT-4o, o1, o3	$$$	Cloud
LM Studio	Local	Local models with GUI	FREE	🔒 100% Local

📖 Full Provider Configuration Guide

---

Claude Code Integration

Configure Claude Code CLI to use Lynkr:

# Set Lynkr as backend
export ANTHROPIC_BASE_URL=http://localhost:8081
export ANTHROPIC_API_KEY=dummy

# Run Claude Code
claude "Your prompt here"

That's it! Claude Code now uses your configured provider.

📖 Detailed Claude Code Setup

---

Cursor Integration

Configure Cursor IDE to use Lynkr:

1. Open Cursor Settings

   • Mac: Cmd+, | Windows/Linux: Ctrl+,
   • Navigate to: Features → Models

2. Configure OpenAI API Settings

   • API Key: sk-lynkr (any non-empty value)
   • Base URL: http://localhost:8081/v1
   • Model: claude-3.5-sonnet (or your provider's model)

3. Test It

   • Chat: Cmd+L / Ctrl+L
   • Inline edits: Cmd+K / Ctrl+K
   • @Codebase search: Requires embeddings setup

📖 Full Cursor Setup Guide | Embeddings Configuration

Codex CLI with Lynkr

Configure Codex Cli to use Lynkr
Option 1: Environment Variable (simplest)

export OPENAI_BASE_URL=http://localhost:8081/v1                                                                                                                                                                                                    
 export OPENAI_API_KEY=dummy                                                                                                                                                                                                                        
 codex 

Option 2: Config File (~/.codex/config.toml)

model_provider = "lynkr"                                                                                                                                                                                                                           
                                                                                                                                                                                                                                                   
[model_providers.lynkr]                                                                                                                                                                                                                            
name = "Lynkr Proxy"                                                                                                                                                                                                                               
base_url = "http://localhost:8081/v1"                                                                                                                                                                                                              
env_key = "OPENAI_API_KEY"     

Lynkr also supports Cline, Continue.dev and other OpenAI compatible tools.

---

Documentation

Getting Started

• 📦 Installation Guide - Detailed installation for all methods
• ⚙️ Provider Configuration - Complete setup for all 9+ providers
• 🎯 Quick Start Examples - Copy-paste configs

IDE Integration

• 🖥️ Claude Code CLI Setup - Connect Claude Code CLI
• 🎨 Cursor IDE Setup - Full Cursor integration with troubleshooting
• 🔍 Embeddings Guide - Enable @Codebase semantic search (4 options: Ollama, llama.cpp, OpenRouter, OpenAI)

Features & Capabilities

• ✨ Core Features - Architecture, request flow, format conversion
• 🧠 Memory System - Titans-inspired long-term memory
• 💰 Token Optimization - 60-80% cost reduction strategies
• 🔧 Tools & Execution - Tool calling, execution modes, custom tools

Deployment & Operations

• 🐳 Docker Deployment - docker-compose setup with GPU support
• 🏭 Production Hardening - Circuit breakers, load shedding, metrics
• 📊 API Reference - All endpoints and formats

Support

• 🔧 Troubleshooting - Common issues and solutions
• ❓ FAQ - Frequently asked questions
• 🧪 Testing Guide - Running tests and validation

---

External Resources

• 📚 DeepWiki Documentation - AI-powered documentation search
• 💬 GitHub Discussions - Community Q&A
• 🐛 Report Issues - Bug reports and feature requests
• 📦 NPM Package - Official npm package

---

Key Features Highlights

• ✅ Multi-Provider Support - 9+ providers including local (Ollama, llama.cpp) and cloud (Bedrock, Databricks, OpenRouter)
• ✅ 60-80% Cost Reduction - Token optimization with smart tool selection, prompt caching, memory deduplication
• ✅ 100% Local Option - Run completely offline with Ollama/llama.cpp (zero cloud dependencies)
• ✅ OpenAI Compatible - Works with Cursor IDE, Continue.dev, and any OpenAI-compatible client
• ✅ Embeddings Support - 4 options for @Codebase search: Ollama (local), llama.cpp (local), OpenRouter, OpenAI
• ✅ MCP Integration - Automatic Model Context Protocol server discovery and orchestration
• ✅ Enterprise Features - Circuit breakers, load shedding, Prometheus metrics, K8s health checks
• ✅ Streaming Support - Real-time token streaming for all providers
• ✅ Memory System - Titans-inspired long-term memory with surprise-based filtering
• ✅ Tool Calling - Full tool support with server and passthrough execution modes
• ✅ Production Ready - Battle-tested with 400+ tests, observability, and error resilience

---

Architecture

┌─────────────────┐
│ Claude Code CLI │  or  Cursor IDE
└────────┬────────┘
         │ Anthropic/OpenAI Format
         ↓
┌─────────────────┐
│  Lynkr Proxy    │
│  Port: 8081     │
│                 │
│ • Format Conv.  │
│ • Token Optim.  │
│ • Provider Route│
│ • Tool Calling  │
│ • Caching       │
└────────┬────────┘
         │
         ├──→ Databricks (Claude 4.5)
         ├──→ AWS Bedrock (100+ models)
         ├──→ OpenRouter (100+ models)
         ├──→ Ollama (local, free)
         ├──→ llama.cpp (local, free)
         ├──→ Azure OpenAI (GPT-4o, o1)
         ├──→ OpenAI (GPT-4o, o3)
         └──→ Azure Anthropic (Claude)

📖 Detailed Architecture

---

Quick Configuration Examples

100% Local (FREE)

export MODEL_PROVIDER=ollama
export OLLAMA_MODEL=qwen2.5-coder:latest
export OLLAMA_EMBEDDINGS_MODEL=nomic-embed-text
npm start

AWS Bedrock (100+ models)

export MODEL_PROVIDER=bedrock
export AWS_BEDROCK_API_KEY=your-key
export AWS_BEDROCK_MODEL_ID=anthropic.claude-3-5-sonnet-20241022-v2:0
npm start

OpenRouter (simplest cloud)

export MODEL_PROVIDER=openrouter
export OPENROUTER_API_KEY=sk-or-v1-your-key
npm start

📖 More Examples

---

Contributing

We welcome contributions! Please see:

• Contributing Guide - How to contribute
• Testing Guide - Running tests

---

License

Apache 2.0 - See LICENSE file for details.

---

Community & Support

• ⭐ Star this repo if Lynkr helps you!
• 💬 Join Discussions - Ask questions, share tips
• 🐛 Report Issues - Bug reports welcome
• 📖 Read the Docs - Comprehensive guides

---

Made with ❤️ by developers, for developers.