Views
No views yet
inkling-* series. Built to power
navox-labs/inkling-hire — an
open-source screening system with an always-on counterfactual bias audit,
blind review by default, and human-in-the-loop by construction.
Navox Labs is not affiliated with or endorsed by Thinking Machines Lab.score_v1 prompt in the repo), it emits
one JSON verdict: a calibrated fit probability, up to 5 quoted evidence
items, job-relevant gaps, or an explicit insufficient_information
abstention for unreadable input. Wrong-field candidates get low scores, not
abstentions — identity signals are not scoring features.| metric | base @0.3 | tuned @0.3 | base @0.8 | tuned @0.8 |
|---|---|---|---|---|
| JSON validity | 0.993 | 1.000 | 0.993 | 1.000 |
| Score MAE vs rubric | 0.206 | 0.024 | 0.177 | 0.027 |
| Spearman | 0.794 | 0.949 | 0.808 | 0.958 |
| Abstention tp/fp/fn | 14/0/0 | 14/0/0 | 10/0/4 | 14/0/0 |
| Counterfactual name-swap gap | 0.0254 | 0.0189 | 0.0414 | 0.0176 |
| Completion tokens (460 calls) | 523,710 | 42,073 | — | — |
finetune/RESULTS.md.python -m finetune.build_training_data, hash 16c9ba62c5d0993e).
Three task types: rubric-target scoring (demonstrated skills weighted over
merely listed ones), abstention discipline (incl. anti-abstention for
wrong-field candidates), and counterfactual consistency (name-swapped twins
with byte-identical targets).adapter_model.safetensorsadapter_config.json, ~20GB — rank 32 across all layers incl. 256 experts).
Converting to standard PEFT format requires the base model's weights on local
disk — which your serving machine needs anyway — so convert on the box that
serves it (one command, via tinker-cookbook):1from tinker_cookbook import weights
2weights.build_lora_adapter(
3 base_model="thinkingmachines/Inkling", # already in your HF cache if you serve it
4 adapter_path="./inkling-hire", # this repo, downloaded
5 output_path="./inkling-hire-peft", # vLLM --lora-modules / SGLang --lora-paths
6)config.yaml at your endpoint — no candidate data leaves your infrastructure.
(On Tinker, the checkpoint is directly usable at
tinker://2b4f6b9a-9e2c-546c-a600-866e9755dbb8:train:0/sampler_weights/final.)