You can deploy this model and start earning money today!

siddharthmb/
2026.mechaptcha.full-accuracy-target-90p-new-settings-20260525

Name: 2026.mechaptcha.full-accuracy-target-90p-new-settings-20260525
Availability: InStock

pytorch

captcha

image-classification

jacobcohen/mechaptcha

Views

No views yet

2026.mechaptcha.full-accuracy-target-90p-new-settings-20260525

CAPTCHA CNN trained on the Mechaptcha dataset.

Source Links

Dataset: jacobcohen/mechaptcha
Weights & Biases run: https://wandb.ai/siddharth-stanford/mechaptcha/runs/08yp3b4g

Validation Metrics

Metric	Value
`global_step`	`23440`
`val/final/by_distortion/blur/absent_exact_match`	`0.9631823275172082`
`val/final/by_distortion/blur/exact_match_delta`	`-0.013518166314585467`
`val/final/by_distortion/blur/present_exact_match`	`0.9496641612026228`
`val/final/by_distortion/bold/absent_exact_match`	`0.9712238853758105`
`val/final/by_distortion/bold/exact_match_delta`	`-0.029591199679800284`
`val/final/by_distortion/bold/present_exact_match`	`0.9416326856960102`
`val/final/by_distortion/char_jitter/absent_exact_match`	`0.9620970315991063`
`val/final/by_distortion/char_jitter/exact_match_delta`	`-0.011383204200967056`
`val/final/by_distortion/char_jitter/present_exact_match`	`0.9507138273981393`
`val/final/by_distortion/dots/absent_exact_match`	`0.9896775736319796`
`val/final/by_distortion/dots/exact_match_delta`	`-0.06675814691874338`
`val/final/by_distortion/dots/present_exact_match`	`0.9229194267132362`
`val/final/by_distortion/easy_line/absent_exact_match`	`0.95800356832426`
`val/final/by_distortion/easy_line/exact_match_delta`	`-0.012604014042184253`
`val/final/by_distortion/easy_line/present_exact_match`	`0.9453995542820758`
`val/final/by_distortion/hard_line/absent_exact_match`	`0.9565297096633745`
`val/final/by_distortion/hard_line/exact_match_delta`	`-0.0008623617621010826`
`val/final/by_distortion/hard_line/present_exact_match`	`0.9556673479012734`
`val/final/by_distortion/italic/absent_exact_match`	`0.9592635488637725`
`val/final/by_distortion/italic/exact_match_delta`	`-0.00569598346174538`
`val/final/by_distortion/italic/present_exact_match`	`0.9535675654020271`
`val/final/by_distortion/rotation/absent_exact_match`	`0.9610749578211617`
`val/final/by_distortion/rotation/exact_match_delta`	`-0.009270608263287072`
`val/final/by_distortion/rotation/present_exact_match`	`0.9518043495578746`
`val/final/by_distortion/salt_pepper/absent_exact_match`	`0.964994586791772`
`val/final/by_distortion/salt_pepper/exact_match_delta`	`-0.017107431450803956`
`val/final/by_distortion/salt_pepper/present_exact_match`	`0.947887155340968`
`val/final/by_distortion/spacing_jitter/absent_exact_match`	`0.9684264805045417`
`val/final/by_distortion/spacing_jitter/exact_match_delta`	`-0.02421735548941406`
`val/final/by_distortion/spacing_jitter/present_exact_match`	`0.9442091250151277`
`val/final/by_distortion/two_lines/absent_exact_match`	`0.9602037785849725`
`val/final/by_distortion/two_lines/exact_match_delta`	`-0.030382034566986293`
`val/final/by_distortion/two_lines/present_exact_match`	`0.9298217440179862`
`val/final/by_distortion/wave/absent_exact_match`	`0.964199341870515`
`val/final/by_distortion/wave/exact_match_delta`	`-0.01569871629033992`
`val/final/by_distortion/wave/present_exact_match`	`0.9485006255801751`
`val/final/by_distortion/wavy_line/absent_exact_match`	`0.9585134362492853`
`val/final/by_distortion/wavy_line/exact_match_delta`	`-0.016680766926576163`
`val/final/by_distortion/wavy_line/present_exact_match`	`0.9418326693227091`
`val/final/char_accuracy`	`0.99064`
`val/final/confusion_matrix_csv_path`	`runs/captcha-cnn/20260525-124202_slurm-15554118/val_final_confusion_matrix.csv`
`val/final/confusion_matrix_path`	`runs/captcha-cnn/20260525-124202_slurm-15554118/val_final_confusion_matrix.json`
`val/final/distortion_summary_path`	`runs/captcha-cnn/20260525-124202_slurm-15554118/val_final_distortion_summary.json`
`val/final/exact_match`	`0.95642`
`val/final/failed_exact_count`	`2179.0`
`val/final/loss`	`0.054235595703125`

Validation History

`epoch`	`global_step`	`val/char_accuracy`	`val/exact_match`	`val/loss`
`1`	`1000`	`0.902804`	`0.65368`	`0.31929294921875`
`1`	`1172`	`0.924228`	`0.71716`	`0.24951232421875`
`2`	`2000`	`0.960944`	`0.83768`	`0.127478310546875`
`2`	`2344`	`0.966548`	`0.85816`	`0.107767265625`
`3`	`3000`	`0.974316`	`0.8879`	`0.082253037109375`
`3`	`3516`	`0.976532`	`0.89628`	`0.0754258447265625`
`4`	`4000`	`0.978316`	`0.90346`	`0.0680853857421875`
`4`	`4688`	`0.982192`	`0.91934`	`0.0558616943359375`
`5`	`5000`	`0.983184`	`0.9242`	`0.0532486962890625`
`5`	`5860`	`0.984164`	`0.92792`	`0.0496459521484375`
`6`	`6000`	`0.985616`	`0.93356`	`0.0466565380859375`
`6`	`7000`	`0.986172`	`0.93622`	`0.044111982421875`
`6`	`7032`	`0.985908`	`0.93528`	`0.0445144091796875`
`7`	`8000`	`0.987236`	`0.94128`	`0.0411058642578125`
`7`	`8204`	`0.986864`	`0.9392`	`0.04247525390625`
`8`	`9000`	`0.986688`	`0.93822`	`0.044242294921875`
`8`	`9376`	`0.988096`	`0.94472`	`0.0400172607421875`
`9`	`10000`	`0.988152`	`0.94518`	`0.040445966796875`
`9`	`10548`	`0.988904`	`0.9484`	`0.03830552734375`
`10`	`11000`	`0.988668`	`0.9472`	`0.0416409521484375`
`10`	`11720`	`0.989144`	`0.94948`	`0.03860938720703125`
`11`	`12000`	`0.989384`	`0.95088`	`0.0397985498046875`
`11`	`12892`	`0.989248`	`0.9501`	`0.041160830078125`
`12`	`13000`	`0.989384`	`0.95078`	`0.0424521240234375`
`12`	`14000`	`0.989444`	`0.95106`	`0.042723447265625`
`12`	`14064`	`0.98966`	`0.9522`	`0.0421437744140625`
`13`	`15000`	`0.989632`	`0.95174`	`0.0438708056640625`
`13`	`15236`	`0.989544`	`0.95146`	`0.044698896484375`
`14`	`16000`	`0.990096`	`0.9543`	`0.0455725`
`14`	`16408`	`0.989988`	`0.95336`	`0.046574384765625`
`15`	`17000`	`0.990344`	`0.9551`	`0.0465655078125`
`15`	`17580`	`0.990332`	`0.95508`	`0.0458802001953125`
`16`	`18000`	`0.990688`	`0.95662`	`0.04717384765625`
`16`	`18752`	`0.99038`	`0.95524`	`0.048042421875`
`17`	`19000`	`0.990688`	`0.95658`	`0.0489055615234375`
`17`	`19924`	`0.990584`	`0.95608`	`0.05016974609375`
`18`	`20000`	`0.990744`	`0.9569`	`0.0506588134765625`
`18`	`21000`	`0.990692`	`0.95652`	`0.051659453125`
`18`	`21096`	`0.9907`	`0.9567`	`0.051540810546875`
`19`	`22000`	`0.990652`	`0.95642`	`0.0528588037109375`
`19`	`22268`	`0.990636`	`0.9564`	`0.052826123046875`
`20`	`23000`	`0.990628`	`0.95638`	`0.054078935546875`
`20`	`23440`	`0.99064`	`0.95642`	`0.054235595703125`

Validation Summary Artifacts

val_final_distortion_summary.json: validation metrics split by distortion/style flag.
val_final_confusion_matrix.json: character-level confusion matrix.
val_final_confusion_matrix.csv: CSV version of the character-level confusion matrix.
val_failed_ids.json: validation example IDs that failed exact match.

Training Summary

Global step: 23440
Best validation exact match: 0.9569

Configuration

The full training and model configuration is included in training_metadata.json.

siddharthmb/2026.mechaptcha.full-accuracy-target-90p-new-settings-20260525