Commit Graph

6 Commits

Author SHA256 Message Date
tlg
a36ea14b84 fix(projekt-matching): nice-heading exception in extract prompt; lock enable_thinking in tests
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-09 16:09:58 +02:00
tlg
cef4041500 fix(projekt-matching): disable thinking for structured vLLM calls; retry non-JSON responses
With the vLLM qwen3 reasoning parser active, json_schema guided decoding
plus thinking degenerates: runs burn the whole 65k context
(finish_reason "length", ~63k completion tokens) and return empty or
truncated content. chat_template_kwargs {"enable_thinking": false} fixes
it (extract answers in ~35 s). Also: retry chat_json up to 3x on
non-JSON content, and two prompt calibrations verified against both
gate examples — Nice signal words bind only to their own line (following
unmarked lines stay Must), and compound requirements with clear evidence
for one part rate "unknown" instead of "no".

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-09 15:48:55 +02:00
tlg
20796b3a68 fix(projekt-matching): retry chat_json on empty/unparseable vLLM completion 2026-07-09 15:33:11 +02:00
tlg
b9133a2416 fix(projekt-matching): correct stale llm.py docstring 2026-07-09 10:59:14 +02:00
tlg
9cbdd2e28c fix(projekt-matching): use response_format json_schema (vLLM 0.22 ignores guided_json) 2026-07-09 10:55:23 +02:00
tlg
a7f94914d0 feat(projekt-matching): vLLM guided-json client with extraction and matching prompts 2026-07-09 10:44:59 +02:00