Neue Prompt-Dateien und neue Prompts in bestehenden Dateien
This commit is contained in:
@@ -1058,3 +1058,7 @@ Ich bedanke mich für Ihr Verständnis und Ihre Kulanz.
|
||||
Mit besten Grüßen
|
||||
|
||||
Thomas Langer
|
||||
|
||||
---
|
||||
|
||||
The article `https://x.com/yume_arasaki/status/2102395182184534404` states EXL3 has a relatively good quality. I know that common 3-bit quantization has a severe impact on LLM inference while 4-bit quantization is acceptable. Is EXL3 really a game changer? Please explain; in case EXL3 is too new for your knowledge (your training data might be just outdated) do a research. Also find examples for recent LLMs like Qwen3.8-27B which compare intelligence of 16-bit, 8-bit, 4-bit and EXL3 quantizations.
|
||||
|
||||
Reference in New Issue
Block a user