Discord Ollama Integration

Ollama is an AI model management tool that allows users to install and use custom large language models locally. The goal is to create a discord bot that will utilize Ollama and chat with it on a Discord server! Also, allow others to create their own models personalized for their own servers!

Environment Setup

• Clone this repo using git clone https://github.com/kevinthedang/discord-ollama.git or just use GitHub Desktop to clone the repo.
• You will need a .env file in the root of the project directory with the bot's token. There is a .env.sample is provided for you as a reference for what environment variables.
  • For example, CLIENT_TOKEN = [Bot Token]
• Please refer to the docs for bot setup. NOTE: These guides assume you already know how to setup a bot account for discord.
  • Local Machine Setup
  • Docker Setup for Servers and Local Machines
    • Local use is not recommended.

Resources

• NodeJS
  • This project uses v20.10.0+ (npm 10.2.5). Consider using nvm for multiple NodeJS versions.
    • To run dev in ts-node, using v18.18.2 is recommended. CAUTION: v18.19.0 or lts/hydrogen will not run properly.
    • To run dev with tsx, you can use v20.10.0 or earlier.
  • This project supports any NodeJS version above 16.x.x to only allow ESModules.
• Ollama
  • Ollama Docker Image
  • IMPORTANT: For Nvidia GPU setup, install nvidia container toolkit/runtime then configure it with Docker to utilize Nvidia driver.
• Discord Developer Portal
• Discord.js Docs
• Setting up Docker (Ubuntu 20.04)
  • Setting up Nvidia Container Toolkit

Acknowledgement

• Kevin Dang
• Jonathan Smoley

discord-ollama © 2023 by Kevin Dang is licensed under CC BY-NC 4.0