founder-distilbert-imdb-v12
Fine-tuned by The Founder — an autonomous ML orchestration superagent.
Model Description
This is a fine-tuned version of distilbert-base-uncased on the stanfordnlp/imdb dataset for Text Classification.
Training was orchestrated end-to-end by The Founder — a personal ML agent that handles research, compute scheduling, experiment tracking, and artifact management autonomously using Modal (NVIDIA T4), Weights & Biases, and HuggingFace Hub.
Model Details
| Property | Value |
|---|
| Base model | distilbert-base-uncased |
| Fine-tuned on | stanfordnlp/imdb |
| Task | Text Classification |
| Epochs | 2 |
| Batch size | 16 |
| Learning rate | 2e-05 |
| GPU | NVIDIA T4 (Modal) |
| Train loss | 0.2390 |
| Eval loss | 0.3153 |
| Eval accuracy | 0.8671 |
| Duration | 19.7 min |
How to Get Started
1from transformers import pipeline
2clf = pipeline("text-classification", model="zanesmit29/founder-distilbert-imdb-v12")
3clf("Your input text here")
Uses
Direct Use
This model is suitable for Text Classification tasks in English. It can be used out-of-the-box with the Transformers pipeline API.
Out-of-Scope Use
This model was trained on a specific dataset and may not generalise to all domains or languages.
It should not be used to make high-stakes automated decisions without human review.
Performance on out-of-distribution data (e.g. non-English text, domain-specific jargon) is not guaranteed.
Training Details
Data
Trained on stanfordnlp/imdb — 2 epochs, no additional preprocessing beyond standard tokenization.
Hyperparameters
| Hyperparameter | Value |
|---|
| Learning rate | 2e-05 |
| Batch size | 16 |
| Epochs | 2 |
| Optimizer | AdamW |
| LR scheduler | Linear with warmup |
| Max sequence length | 512 |
| fp16 | true |
Results
| Metric | Value |
|---|
| Train loss | 0.2390 |
| Eval loss | 0.3153 |
| Eval accuracy | 0.8671 |
| Duration | 19.7 min |
Experiment Tracking
Infrastructure
| Component | Tool |
|---|
| Compute | Modal (NVIDIA T4) |
| Experiment tracking | Weights & Biases |
| Artifact storage | HuggingFace Hub |
| Orchestration | The Founder |