GPT-2 Chess LoRA

Training Data

• Dataset: Lichess/standard-chess-games
• Filtered to games where both players are rated > 1800 ELO
• 10000 games used for fine-tuning

Prompt Format

Board FEN: <fen string>
Best move:

Training

• Base model: openai-community/gpt2
• Fine-tuning method: LoRA (r=8, alpha=16)
• Max steps: 5000
• Learning rate: 5e-4
• Custom tokens added: all 64 board squares as atomic tokens

Usage