Dimeji12/

Dimeji-Fatima-Fellowship

	Evaluating Causal and Reasoning Blind Spots in Base LLMs




	
	Model Tested

Model Name: Qwen/Qwen2.5-3B Model Link: https://huggingface.co/Qwen/Qwen2.5-3B

The model was evaluated using a Google Colab instance with a free T4 GPU. To accommodate the VRAM constraints of the hardware while maintaining inference fidelity, I utilized the transformers library alongside bitsandbytes to load the model using 8-bit quantization. Here is the exact code… See the full description on the dataset page: https://huggingface.co/datasets/Dimeji12/Dimeji-Fatima-Fellowship.