license: mit

Quote Identification and Attribution Pipeline

License

Included Files:

• Training Script for BERT Quote Identifier Model: The script used to train the BERT model for identifying quotes in text.
• Example of BERT Quote Identifier Model file: This is a pre-trained BERT Model file you will be able to use for the BERT infrence script pipeline.
• Training Script for GPT-2 Quotation Attribution Model: The script used to train the GPT-2 model for attributing quotes to characters.
• Example of GPT-2 Quotation Attribution Model: This is a pre-trained GPT2 Model file you will be able to use for the GPT2 infrence script pipeline.
• Pipeline.py: A script that integrates both the BERT and GPT-2 models, allowing for inference on text to identify and attribute quotes.
• Training Dataset: A collection of books located in the 'books' folder, used for training the models.

Overview

1. BERT Quote Identifier Model: This model processes text to identify what is a quote and what is not. It is trained to differentiate between quoted and non-quoted text.
2. GPT-2 Quotation Attribution Model: Once quotes are identified, this model attributes each quote to the character who likely said it. It is trained specifically on quotes to predict which character said each line in a story.