You can deploy this model and start earning money today!

LoneWolfgang/
tinyllama-for-abalone-RAG

Name: tinyllama-for-abalone-RAG
Availability: InStock

text-generation-inference

endpoints_compatible

Views

No views yet

TinyLlama for Abalone RAG

This is a toy model fine-tuned specifically for the Abalone RAG App. A dataset was developed to finetune this model:

Questions were suggested by GPT-5.
Passages were retrieved from a small index created for the app.
Responses were generated by prompting GPT-5 with the query, the retrieved context, and instructions to produce concise answers referencing the context.

TinyLlama was finetuned on this dataset, resulting in a dedicated TinyLlama model for Abalone RAG. This model is designed to provide concise, context-aware answers about abalone for use in the RAG application.

These are the hyperparamters that were used, and they were not optimized:

Epochs: 3
Batch Size: 2
Gradient Accumulation Steps: 8
Learning Rate: 2e-4

LoneWolfgang/tinyllama-for-abalone-RAG

TinyLlama for Abalone RAG

LoneWolfgang/
tinyllama-for-abalone-RAG