Diverse neue Prompts in mehreren Dateien

This commit is contained in:
tlg
2026-06-19 11:42:09 +02:00
parent ded8d3c5fb
commit 3211369973
7 changed files with 2318 additions and 0 deletions

View File

@@ -76,3 +76,7 @@ For the deep research, my plans for the inference stack are not relevant. Any st
I'm also okay with *multiGPU BF16 numbers* that illustrate the “ceiling” of unquantized performance.
---
Please explain in detail the differences between the 4-bit quantized GGUF model variants UD-Q4_K_XL, Q4_K_M, IQ4_XS, Q4_K_S, IQ4_NL, Q4_0, Q4_1 which I see on the Hugging Face page [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B) and also explain what GPTQInt4, AWQInt4 and NVFP4 means.
---