Views
No views yet
p_machine ∈ [0,1]. ~16 ms inference per 4 s of audio on a single CPU
thread — fast enough to decide inside the first ring seconds.| checkpoint | training pool | how it was measured |
|---|---|---|
v5b_full (root) | 50,876 clips — the full max-data pool (incl. real carrier voicemail, IVR, network intercepts, robocalls, call-center + conversational telephone speech) | validation (4,949 held-out clips) |
benchmarked_v4a/ | 31,947 clips (frozen-eval-disjoint) | two frozen external test sets |
v5b_full (validation, threshold 0.5): 97.7% accuracy, machine recall
97.0% under a ≤3% false-machine-on-humans cap, fmh 1.56%. On held-out
clips of the hardest class — real carrier voicemail greetings — error is
13%, versus 91% for a naive-composition baseline.benchmarked_v4a (frozen external sets, never trained on, one pass): 79.8%
accuracy / balanced-acc .845 / AUC .935 on a 796-clip external set;
92.5% / .928 / .979 on a 1,429-clip balanced set; machine recall at the
FTC-style ≤3% abandonment cap: 0.56–0.91.1pip install torch numpy soundfile scipy
2python code/predict_example.py your_call.wav1import sys; sys.path.insert(0, "code")
2from predict_example import load, predict
3yamnet, head = load()
4p_machine = predict(yamnet, head, "call.wav") # 0..1v5b_full has no fully-external benchmark (its pool absorbed the project's
test sources — by design, for maximum coverage); benchmarked_v4a is the
checkpoint with honest external numbers. Known weak spots: robocall recall
(v5 val slice: 26% miss), heavily accented/studio-recorded humans.torch.stft mel
frontend — no TensorFlow; top-2 blocks fine-tuned (BN frozen), bf16.*.yamnet.pth (backbone, 15 MB) + *.head.pt (head + config, 1 MB)
*.json (export manifest with round-trip verification).