Blind Spots Evaluation
Model Tested
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.float16,
device_map="auto"
)
def generate(prompt, max_tokens=100):
inputs = tokenizer(prompt… See the full description on the dataset page:
https://huggingface.co/datasets/Ndong21/gwen2.5-3B-blind-spots.