tlg 38e1523d7e feat: proper VRAM cleanup and admin clear-vram endpoint ...

- gc.collect() + torch.cuda.empty_cache() in unload for reliable VRAM release
- POST /admin/clear-vram endpoint unloads all models and reports GPU memory
- VRAMManager.clear_all() method for programmatic VRAM cleanup

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-05 21:03:39 +02:00

kischdle/llmux

feat: proper VRAM cleanup and admin clear-vram endpoint

2026-04-05 21:03:39 +02:00

.gitignore

Initial commit with .gitignore

2026-03-31 17:58:54 +02:00

Description

No description provided

144 KiB

Languages

Python 91.2%

Shell 6%

Dockerfile 2.8%