The documents of the bench. The field is live here too - place a lens.
The documents of the bench
FoQLens is a precision regulator for language models: the weights sit behind a glass and lenses open where the query needs to see. This is the documentation of the bench that tests it - the mechanism, the goals, the plan, every preregistration and every run.
Pick a document on the left. Each is a markdown file in the repository, and every link below goes to its source.
The idea
- The filter and its lenses · docs/lens.md
- Problem statement · docs/problem-statement.md
- Goals · docs/goals.md
- Plan · docs/plan.md
- Hypotheses - all untested · docs/hypotheses.md
What the bench measures on
- The corpus, and why the first one failed · docs/corpus.md
- Invariants · docs/invariants.md
- Data sources · docs/data-sources.md
Around it
- Expert zones (legacy layout) · docs/zones.md
- Visual metaphor · docs/visual-metaphor.md
- Prior art · docs/prior-art.md
- Reading notes · docs/reading-notes.md
Preregistration
- Preregistration (English) · prereg/PREREGISTRATION.md
- Пререгистрация (original) · prereg/PREREGISTRATION.ru.md
- E010 - the lens layout · experiments/E010-lens-layout/ADDENDUM-11.md
- E013 - the map of the regulator · experiments/E013-regulator-map/ADDENDUM-14.md
- E015 - three topic pairs · experiments/E015-topic-pairs/ADDENDUM-16.md
Runs - verdicts withdrawn
- E001 - separation and masks · experiments/E001-run1-exploration/results.md
- E006 - read depths · experiments/E006-read-depths/results.md
- E011 - depth caps · experiments/E011-depth-caps/results.md
- E010 - the lens layout · experiments/E010-lens-layout/results.md
- E013 - the map of the regulator · experiments/E013-regulator-map/results.md
- E014 - the zones carried elsewhere · experiments/E014-moved-zones/results.md