rdmsandClaude Opus 4.6 06923d51b4 fix: streaming response fix + GPT-OSS-20B-Uncensored MXFP4 GGUF ...

- Fix async generator streaming: _stream_generate yields directly
  instead of returning nested _iter(), route handler awaits generate()
  then passes async generator to StreamingResponse
- Replace aoxo/gpt-oss-20b-uncensored (no quant, OOM) with
  HauhauCS MXFP4 GGUF via llama-cpp backend

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-06 22:21:22 +02:00

kischdle/llmux

fix: streaming response fix + GPT-OSS-20B-Uncensored MXFP4 GGUF

2026-04-06 22:21:22 +02:00

.gitignore

Initial commit with .gitignore

2026-03-31 17:58:54 +02:00

S

Description

No description provided

144 KiB

Languages

Python 91.2%

Shell 6%

Dockerfile 2.8%