Tag

RouterBench

1 stories

A router that scores every prompt for difficulty without calling a model (github.com)

Wayfinder sits behind any OpenAI-compatible client and decides local-vs-cloud from structure, not meaning: 'a fast, offline hard-or-easy call on every prompt, scored deterministically, with no model call.' Lexical features beat held-out hard prompts by ~20% but didn't generalize, so they ship off by default.

A CISO building his own router said it from first-hand experience: you cannot route between models with different context windows and tool tuning at proxy level without fighting the very tricks that make the harness work.