tlg/DesTEngSsv006_swd
SHA256
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: add accelerate package for transformers device_map support

Browse Source 
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
tlg
2026-04-05 17:19:17 +02:00
parent f2f73d204c
commit d3285bad8a
1 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
kischdle/llmux/Dockerfile
View File

@@ -27,9 +27,10 @@ RUN pip install --no-cache-dir --break-system-packages \
"sentencepiece>=0.2.0" \ "sentencepiece>=0.2.0" \
"protobuf>=5.0.0" "protobuf>=5.0.0"
# Install transformers (doesn't touch torch) # Install transformers + accelerate (needed for device_map)
RUN pip install --no-cache-dir --break-system-packages --no-build-isolation \ RUN pip install --no-cache-dir --break-system-packages --no-build-isolation \
"transformers>=5.4.0" "transformers>=5.4.0" \
"accelerate>=1.0.0"
# Install chatterbox-tts WITHOUT its dependencies (it would downgrade # Install chatterbox-tts WITHOUT its dependencies (it would downgrade
# torch from 2.11 to 2.6 and pull gradio, librosa, etc.) # torch from 2.11 to 2.6 and pull gradio, librosa, etc.)