LatentGym_Qwen3-8B_10episodes_MultiLatent_secretary – AI Model by namkoong-lab | AlphaNeural AI

You can deploy this model and start earning money today!

namkoong-lab/
LatentGym_Qwen3-8B_10episodes_MultiLatent_secretary

like

0

text-generation

in-context-learning

text-generation-inference

endpoints_compatible

Views

No views yet

LatentGym_Qwen3-8B_10episodes_MultiLatent_secretary

GRPO-fine-tuned Qwen3-8B for in-context meta-learning on secretary (3 latents, N=10). Part of the LatentGym testbed.

Environments & training latents

Env	Latents seen during training
secretary	`sorted_order`, `inverse_order`, `fixed_position_2`

Training hyperparameters


Base model	`Qwen/Qwen3-8B`
Algorithm	GRPO
Optimizer	AdamW (β₁=0.9, β₂=0.999)
Learning rate	5e-07
LR schedule	constant_with_warmup
Weight decay	0.01
Max grad norm	1.0
KL coefficient β	0.04
Clip range ε	0.2
Train batch (prompts)	32
Mini-batch	1
Rollouts per prompt	8
Episodes per trajectory (N)	10
Reward Φ	Σᵢ Gᵢ (cumulative)
Epochs	20
Max generation length	64
Sampling (train)	T=0.8, top-p=0.95
Seed	263