Llama models powered AI Chatbot

An open-source AI chatbot app experiment built with Next.js, the Vercel AI SDK and Anyscale Endpoints.

Features · Model Providers · Running locally · Authors

Features

• Try Different Llama model variants in this chatbot
• Anyscale Endpoints for various Llama models to try out.
• Next.js App Router
• React Server Components (RSCs), Suspense, and Server Actions
• Vercel AI SDK for streaming chat UI
• shadcn/ui
  • Styling with Tailwind CSS
  • Radix UI for headless component primitives
  • Icons from Phosphor Icons

Model Providers

This experiment ships with Llama models. Thanks to the Anyscale Endpoints, you can choose any of the available Llama models.

Vercel AI SDK

This whole project is based off of the Next.js AI chatbot template

Running locally

You will need to use the environment variables defined in .env.example to run Next.js AI Chatbot. It's recommended you use Vercel Environment Variables for this, but a .env file is all that is necessary.

Note: You should not commit your .env file or it will expose secrets that will allow others to control access to your various OpenAI and authentication provider accounts.

1. Install Vercel CLI: npm i -g vercel
2. Link local instance with Vercel and GitHub accounts (creates .vercel directory): vercel link
3. Download your environment variables: vercel env pull

pnpm install
pnpm dev

Your app template should now be running on localhost:3000.

Standing on the shoulders of giant:

• Vercel
• Next.js
• Anyscale Endpoints
• Next.js AI Chatbot