Containerized build and socket activation docs
Some checks failed
Linux CI / run-tests (push) Has been cancelled
Windows CI / run-tests (push) Has been cancelled
Close inactive issues / close-issues (push) Successful in -1m16s
Build Containers / build-and-push (cpu) (push) Failing after -1m14s
Build Containers / build-and-push (cuda) (push) Failing after -1m13s
Build Containers / build-and-push (intel) (push) Failing after -1m14s
Build Containers / build-and-push (musa) (push) Failing after -1m13s
Build Containers / build-and-push (vulkan) (push) Failing after -1m13s
Build Containers / delete-untagged-containers (push) Has been skipped

This commit is contained in:
2025-11-20 00:18:58 +01:00
parent 553d8659b7
commit b984f5ca08
5 changed files with 141 additions and 0 deletions

View File

@@ -0,0 +1,20 @@
[Unit]
Description=LLama.cpp (fullvulkan) inference server
After=network-online.target
Wants=network-online.target
[Container]
Image=localhost/lamaswap:latest
#AutoRemove=yes
#PublishPort=8080:8080
Network=none
Volume=%h/models:/models:ro,Z
Volume=%h/config.yaml:/config.yaml:ro,Z
AddDevice=/dev/dri
Exec=
#[Service]
#Restart=always
[Install]
WantedBy=default.target