AlpineLLM-Tiny-10M-Base is a lightweight base language model with ~10.8 million trainable parameters. It was pre-trained from scratch on raw text corpora drawn primarily from public-domain literature on alpinism, including expedition narratives and climbing essays.
Please note that AlpineLLM is a base model, and it has not been fine-tuned for downstream tasks such as summarization or dialogue. Its outputs reflect patterns learned directly from the training texts.
For a complete list of dependencies, refer to the source training repository.
Check out the
AlpineLLM Live Demo repository on HuggingFace Spaces for a practical implementation.
1@misc{alpinellm2025,
2 title={AlpineLLM: A Domain-Specific Language Model for Alpine Storytelling.},
3 author={Borzyszkowski, Bartek},
4 year={2025},
5 publisher={Hugging Face},
6 howpublished={https://github.com/Borzyszkowski/AlpineLLM}
7}
