mirror of https://github.com/kevinthedang/discord-ollama.git synced 2025-12-12 03:46:08 -05:00

Files

Kevin Dang 43fb2ea94e User Preferences and Setup Docs (#20 )

* added message style command

* docker setup scripts

* reformat messageStyle.ts

* fix: register unregister on deploy

* add: messageStream preference

* add: json config handler

* update: messageCreate gets config

* update: shifted chat to config callback

* fix: naming conventions based on discord

* update: setup in docs now

* add: static docker ips

* version increment

* add: bot message for no config

* fix: no config case

* add: clarification for subnetting

* update: version increment in lock file

---------

Co-authored-by: JT2M0L3Y <jtsmoley@icloud.com>

2024-03-22 10:37:06 -07:00

2.7 KiB

Raw Blame History

Discord Ollama Integration

Ollama is an AI model management tool that allows users to install and use custom large language models locally. The goal is to create a discord bot that will utilize Ollama and chat with it on a Discord!

Environment Setup

Clone this repo using git clone https://github.com/kevinthedang/discord-ollama.git or just use GitHub Desktop to clone the repo.
You will need a .env file in the root of the project directory with the bot's token. There is a .env.sample is provided for you as a reference for what environment variables.
- For example, CLIENT_TOKEN = [Bot Token]
Please refer to the docs for bot setup. NOTE: These guides assume you already know how to setup a bot account for discord.
- Local Machine Setup
- Docker Setup for Servers and Local Machines
  - Local use is not recommended.

Resources

NodeJS
- This project uses v20.10.0+ (npm 10.2.5). Consider using nvm for multiple NodeJS versions.
  - To run dev in ts-node, using v18.18.2 is recommended. CAUTION: v18.19.0 or lts/hydrogen will not run properly.
  - To run dev with tsx, you can use v20.10.0 or earlier.
- This project supports any NodeJS version above 16.x.x to only allow ESModules.
Ollama
- Ollama Docker Image
- IMPORTANT: For Nvidia GPU setup, install nvidia container toolkit/runtime then configure it with Docker to utilize Nvidia driver.
Discord Developer Portal
Discord.js Docs
Setting up Docker (Ubuntu 20.04)
- Setting up Nvidia Container Toolkit

2.7 KiB Raw Blame History

Discord Ollama Integration

Environment Setup

Resources

Acknowledgement

2.7 KiB

Raw Blame History