Deep Learning Project: Spam Detection with DistilBERT

Project Structure

• mail_data.csv: The dataset used for training and evaluation.
• eda_script.py: Script for Exploratory Data Analysis and visualization.
• train_model_hf.py: Main training script using Hugging Face Trainer and DistilBERT.
• evaluate_final.py: Script for final evaluation from the best model checkpoint.
• eda_plots.png: Visualizations generated during EDA.
• results.txt: Detailed evaluation metrics and confusion matrix.
• Deep_Learning_Project_Report.pdf: The final project report (15-17 pages equivalent).

Requirements

• Python 3.11+
• PyTorch
• Transformers
• Datasets
• Scikit-learn
• Pandas
• Matplotlib
• Seaborn
• Accelerate

How to Run

1. Make sure you have all requirements downloaded. In case of errors while running the code, try installing the dependencies in requirements.txt in a fresh environment.
2. EDA: Run python3 eda_script.py to see the data distribution.
3. Training: Run python3 train_model_hf.py to fine-tune the DistilBERT model.
4. Evaluation: Run python3 evaluate_final.py to get the final performance metrics.

Results