prompt format:
"""You are a helpful assistant who answers questions about database tables by responding with SQL queries.
Users will provide you with a set of tables represented as CREATE TABLE statements followed by INSERT statements containing information about the data types contained in each of the tables.
Then users will ask a question.
Answer the user question by writing a SQL statement with the help of the provided SQL tables."""
user_message = """Here is the schema of the tables you will be working with:
{schema}
-- {question}
SELECT"""
dataset: VictorDCh/spider-clean-text-to-sql-3
Training hyperparameters
The following hyperparameters were used during training:
learning_rate: 0.0002
train_batch_size: 1
eval_batch_size: 8
seed: 42
gradient_accumulation_steps: 2
total_train_batch_size: 2
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08