Views
No views yet
Revela-1b was trained on a corpus of 320K batches in the size of 16 by chunking Wikipedia. See the paper for more details.| Binary | Description |
|---|---|
| trumancai/Revela-code-3b | 3 B-parameter code-retriever. |
| trumancai/Revela-code-1b | 1 B-parameter code-retriever. |
| trumancai/Revela-code-500M | 500 M-parameter code-retriever. |
| trumancai/Revela-3b | 3 B-parameter Wikipedia retriever. |
| trumancai/Revela-1b | 1 B-parameter Wikipedia retriever. |
| trumancai/Revela-500M | 500 M-parameter Wikipedia retriever. |
| trumancai/revela_code_training_corpus | Code training corpus. |
| trumancai/revela_training_corpus | Wikipedia training corpus. |
1from mteb.model_meta import ModelMeta
2from mteb.models.repllama_models import RepLLaMAWrapper, _loader
3
4revela_llama_3b = ModelMeta(
5 loader=_loader(
6 RepLLaMAWrapper,
7 base_model_name_or_path="meta-llama/Llama-3.2-3B",
8 peft_model_name_or_path="trumancai/Revela-3b",
9 device_map="auto",
10 torch_dtype=torch.bfloat16,
11 ),
12 name="trumancai/Revela-3b",
13 languages=["eng_Latn"],
14 open_source=True,
15 revision="2b31c92f23acc46762587ea37cb55032da788561", # base-peft revision
16 release_date="2025-04-13",
17)
18revela_llama_3b_model = revela_llama_3b.loader()
19
20evaluation = mteb.MTEB(tasks=["SciFact", "NFCorpus"])
21evaluation.run(model=revela_llama_3b_model, output_folder="results/Revela-3b")