alex/discord-aidolls
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Nvidia Container Toolkit Setup and Docs (#26)

Browse Source 
* update: nvidia as runtime

* add: setup instructions for nvidia

* update: setup-docker.md
This commit is contained in:
Kevin Dang
2024-03-28 12:01:33 -07:00
committed by GitHub
parent 43fb2ea94e
commit 1b70fc2787
2 changed files with 40 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docker-compose.yml
View File

@@ -32,9 +32,9 @@ services:
ollama-net:
ipv4_address: ${OLLAMA_IP}
# runtime: nvidia # use Nvidia Container Toolkit for GPU support
# devices:
# - /dev/nvidia0
runtime: nvidia # use Nvidia Container Toolkit for GPU support
devices:
- /dev/nvidia0
volumes:
- ollama:/root/.ollama
ports: