Views
No views yet
projecte-aina/aina-translator-zh-ca,
Projecte Aina's (Barcelona Supercomputing Center, Language Technologies Unit) Chinese → Catalan
machine translation model, fine-tuned from facebook/m2m100_1.2B. All credit for training data,
fine-tuning and evaluation goes to Projecte Aina — see the
source model card for training
details, BLEU/ChrF numbers, and paper reference.apache-2.0, verbatim as declared on the source model card
(projecte-aina/aina-translator-zh-ca). Same licence applies to this derived ONNX export.encoder_model.onnx(_data) fp32 encoder
decoder_model.onnx(_data) fp32 decoder (no cache)
decoder_with_past_model.onnx(_data) fp32 decoder (with KV cache)
int8/encoder_model.onnx dynamic-quantized (uint8) encoder
int8/decoder_model.onnx dynamic-quantized (uint8) decoder
int8/decoder_with_past_model.onnx dynamic-quantized (uint8) decoder w/ cache
sentencepiece.bpe.model, vocab.json, tokenizer_config.json, ... tokenizer files (M2M100Tokenizer)M2M100ForConditionalGeneration (transformers model_type: m2m_100), fine-tuned
by Projecte Aina from facebook/m2m100_1.2B.1optimum-cli export onnx \
2 --model projecte-aina/aina-translator-zh-ca \
3 --task text2text-generation-with-past \
4 --no-post-process \
5 aina-translator-zh-ca-onnx--no-post-process is required: optimum's decoder-merge step OOMs on this model size on
constrained hardware. As a result the ONNX export ships an un-merged decoder_model.onnx
(no cache) and decoder_with_past_model.onnx (with cache) instead of a single
decoder_model_merged.onnx.optimum.onnxruntime.ORTQuantizer, AVX2 config) was applied to each of
the three graphs.m2m_100 architecture (which normally supports many-to-many translation via a
>>lang<</forced_bos_token_id mechanism), this checkpoint is a single-direction fine-tune:
Chinese → Catalan only. The upstream model card's own usage example calls
tokenizer(sentence, return_tensors="pt") + model.generate(...) with no src_lang,
tgt_lang, or forced_bos_token_id set — the tokenizer's tokenizer_config.json ships
src_lang: "en" (a leftover default, not meaningful) and tgt_lang: null, and
generation_config.json has no forced_bos_token_id. The fine-tuning baked the zh→ca direction
into the weights directly; do not set language codes or forced BOS tokens, just call
tokenizer(text) → model.generate() exactly like the upstream example.num_beams=4, max_new_tokens=64, compared against the original
PyTorch model (transformers.AutoModelForSeq2SeqLM) with identical decoding settings.| exact-match rate | |
|---|---|
| ONNX fp32 | 8/8 = 100.0% |
| ONNX int8 (dynamic) | not separately re-verified against reference; same graphs, expect near-parity |
| Chinese | Catalan (Aina / ONNX, identical) |
|---|---|
| 欢迎来到 Aina 项目! | Benvingut al projecte Aina! |
| 你好,你今天怎么样? | Hola, com estàs avui? |
| 今天天气很好。 | Avui fa bon temps. |
| 我想预定两个人的桌子。 | M'agradaria reservar una taula per a dos. |
| 火车站在哪里? | On és l'estació de tren? |
| 这本书很有意思。 | Aquest llibre és interessant. |
| 孩子们在公园里玩。 | Els nens juguen al parc. |
| 我需要帮助解决我的电脑问题。 | Necessito ajuda per resoldre el meu problema informàtic. |
1from transformers import AutoTokenizer
2from optimum.onnxruntime import ORTModelForSeq2SeqLM
3
4model_id = "TigreGotico/aina-translator-zh-ca-onnx"
5
6tokenizer = AutoTokenizer.from_pretrained(model_id)
7model = ORTModelForSeq2SeqLM.from_pretrained(model_id) # fp32
8# int8: ORTModelForSeq2SeqLM.from_pretrained(model_id, subfolder="int8")
9
10text = "欢迎来到 Aina 项目!"
11ids = tokenizer(text, return_tensors="pt").input_ids
12out = model.generate(ids, num_beams=4, max_new_tokens=64)
13print(tokenizer.decode(out[0], skip_special_tokens=True))
14# Benvingut al projecte Aina!langtech@bsc.es.