Basé Sur Le Modèle Originale :
Almanach/camembert-base :
"A Tasty French Language Model"
Pre-trained models by almanach/camembert-base
| Model | #params | Arch. | Training data |
|---|
camembert-base | 110M | Base | OSCAR (138 GB of text) |
camembert/camembert-large | 335M | Large | CCNet (135 GB of text) |
camembert/camembert-base-ccnet | 110M | Base | CCNet (135 GB of text) |
camembert/camembert-base-wikipedia-4gb | 110M | Base | Wikipedia (4 GB of text) |
camembert/camembert-base-oscar-4gb | 110M | Base | Subsample of OSCAR (4 GB of text) |
camembert/camembert-base-ccnet-4gb | 110M | Base | Subsample of CCNet (4 GB of text) |
Fine-Tunning by MisterAI/ALMANACH_CamemBERT_Agent001
Testing Training/FineTunning For Now >:)
| Model | #params | Arch. | Training data |
|---|
MisterAI/ALMANACH_CamemBERT_Agent001 based on camembert-base | 110M | Base | MisterAI/SimpleSmallFrenchQA (50 KB of text) |
If you use our work, please cite:
@inproceedings{martin2020camembert,
title={CamemBERT: a Tasty French Language Model},
author={Martin, Louis and Muller, Benjamin and Su{'a}rez, Pedro Javier Ortiz and Dupont, Yoann and Romary, Laurent and de la Clergerie, {'E}ric Villemonte and Seddah, Djam{'e} and Sagot, Beno{^\i}t},
booktitle={Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics},
year={2020}
}
