mirror of https://github.com/kevinthedang/discord-ollama.git synced 2025-12-12 11:56:06 -05:00

Go to file

Kevin Dang 1b70fc2787 Nvidia Container Toolkit Setup and Docs (#26 )

* update: nvidia as runtime

* add: setup instructions for nvidia

* update: setup-docker.md

2024-03-28 12:01:33 -07:00

.github

formatting and contributing

2024-01-30 16:15:35 -08:00

docs

Nvidia Container Toolkit Setup and Docs (#26 )

2024-03-28 12:01:33 -07:00

src

User Preferences and Setup Docs (#20 )

2024-03-22 10:37:06 -07:00

.env.sample

User Preferences and Setup Docs (#20 )

2024-03-22 10:37:06 -07:00

.gitignore

User Preferences and Setup Docs (#20 )

2024-03-22 10:37:06 -07:00

docker-compose.yml

Nvidia Container Toolkit Setup and Docs (#26 )

2024-03-28 12:01:33 -07:00

Dockerfile

User Preferences and Setup Docs (#20 )

2024-03-22 10:37:06 -07:00

nodemon.json

NodeJS TypeScript Setup (#1 )

2023-12-22 11:22:16 -08:00

package-lock.json

User Preferences and Setup Docs (#20 )

2024-03-22 10:37:06 -07:00

package.json

User Preferences and Setup Docs (#20 )

2024-03-22 10:37:06 -07:00

README.md

User Preferences and Setup Docs (#20 )

2024-03-22 10:37:06 -07:00

tsconfig.json

slash commands integrated

2024-01-31 10:28:02 -08:00

README.md

Discord Ollama Integration

Ollama is an AI model management tool that allows users to install and use custom large language models locally. The goal is to create a discord bot that will utilize Ollama and chat with it on a Discord!

Environment Setup

Clone this repo using git clone https://github.com/kevinthedang/discord-ollama.git or just use GitHub Desktop to clone the repo.
You will need a .env file in the root of the project directory with the bot's token. There is a .env.sample is provided for you as a reference for what environment variables.
- For example, CLIENT_TOKEN = [Bot Token]
Please refer to the docs for bot setup. NOTE: These guides assume you already know how to setup a bot account for discord.
- Local Machine Setup
- Docker Setup for Servers and Local Machines
  - Local use is not recommended.

Resources

NodeJS
- This project uses v20.10.0+ (npm 10.2.5). Consider using nvm for multiple NodeJS versions.
  - To run dev in ts-node, using v18.18.2 is recommended. CAUTION: v18.19.0 or lts/hydrogen will not run properly.
  - To run dev with tsx, you can use v20.10.0 or earlier.
- This project supports any NodeJS version above 16.x.x to only allow ESModules.
Ollama
- Ollama Docker Image
- IMPORTANT: For Nvidia GPU setup, install nvidia container toolkit/runtime then configure it with Docker to utilize Nvidia driver.
Discord Developer Portal
Discord.js Docs
Setting up Docker (Ubuntu 20.04)
- Setting up Nvidia Container Toolkit

README.md

Discord Ollama Integration

Environment Setup

Resources

Acknowledgement