CuriousForCausalLM architecture with Curious-specific optimizations| Parameter | Value |
|---|---|
| Architecture | CuriousForCausalLM |
| Model Type | curious_text |
| Parameters | ~2.6B |
| Context Length | 8,192 tokens |
| Vocabulary | 256,000 tokens |
| Training | Instruction-tuned |
| Curious Version | 2.0 |
pip install requirements.txt1# Use the included chat interface
2python chat_with_adam.py to talk to adam.1{
2 "architectures": ["CuriousForCausalLM"],
3 "model_type": "curious_text",
4 "hidden_size": 2304,
5 "num_attention_heads": 8,
6 "num_hidden_layers": 26,
7 "max_position_embeddings": 8192,
8 "curious_version": "2.0",
9 "curious_instruction_tuned": true
10}