Billsum-T5-Small is a fine-tuned version of the T5-small model specifically tailored for the task of text summarization on U.S. Congressional bills. The model has been trained on the BillSum dataset, which contains the full texts of U.S. Congressional bills and their corresponding summaries. This model is capable of generating concise and informative summaries from lengthy legislative texts, making it useful for legal professionals, policymakers, and researchers who need to quickly understand the essence of complex documents.
Model Details
Model Architecture: T5-Small
Base Model: T5-Small
Fine-tuning Dataset: BillSum
Number of Parameters: 60 million
Training Data
The model was fine-tuned on the BillSum dataset's training split. The dataset contains texts of U.S. Congressional bills and their summaries. We used 80% of the dataset for training and 20% for evaluation.
