Views
No views yet
google/madlad400-3b-mt for use with CrispStrobe/CrispASR.| File | Size | Notes |
|---|---|---|
madlad400-3b-mt-f16.gguf | ~5.7 GB | F16 weights (reference quality) |
madlad400-3b-mt-q8_0.gguf | ~3.1 GB | Q8_0 quantized |
madlad400-3b-mt-q4_k.gguf | ~1.8 GB | Q4_K quantized |
1# 1. Build CrispASR
2git clone https://github.com/CrispStrobe/CrispASR
3cd CrispASR
4cmake -B build -DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=OFF
5cmake --build build -j
6
7# 2. Pull model
8huggingface-cli download cstr/madlad400-3b-mt-GGUF madlad400-3b-mt-q8_0.gguf --local-dir .
9
10# 3. Translate (uses <2xx> language tags)
11./build/bin/crispasr --backend madlad -m madlad400-3b-mt-q8_0.gguf \
12 --text "Hello world, how are you today?" \
13 -sl en -tl de
14
15# English → Japanese
16./build/bin/crispasr --backend madlad -m madlad400-3b-mt-q8_0.gguf \
17 --text "Machine learning is changing the world." \
18 -sl en -tl ja
19
20# French → Portuguese
21./build/bin/crispasr --backend madlad -m madlad400-3b-mt-q8_0.gguf \
22 --text "Bonjour le monde!" \
23 -sl fr -tl pt<2xx> target language tags (ISO 639 codes). This includes all major world languages plus many low-resource languages. See the original model card for the full language list.Text → SentencePiece tokenizer (256K vocab, shared encoder-decoder)
→ <2xx> target language tag prepended to source text
→ T5 encoder (24 layers, d=1024)
→ T5 decoder (24 layers, d=1024) with cross-attention
→ Greedy decode → translated text1python models/convert-madlad-to-gguf.py \
2 --input google/madlad400-3b-mt \
3 --output madlad400-3b-mt-f16.ggufcstr/m2m100-418m-GGUF — M2M-100, 100 languages, any-to-anycstr/wmt21-dense-24-wide-en-x-GGUF — WMT21 English-to-many (7 langs, highest quality)cstr/wmt21-dense-24-wide-x-en-GGUF — WMT21 many-to-English (7 langs)google/madlad400-3b-mt — original PyTorch model