Views
No views yet
intra_encoding_pattern in its config and ships the MSA scoring path (modeling_ceno_p.py),
which consumes a per-token seq_idx to score packed MSA inputs.trust_remote_code=True — the model code is bundled here.| Family | CENO-P (MSA post-trained) |
| Training stage | MSA post-training (VEP) |
| Parameters | 1.3B (1302.4M) |
| Precision | float32 |
model_type | ceno |
| Architecture class | CENOPForCausalLM |
| Auto-map (model) | modeling_ceno_p.CENOPForCausalLM |
| Auto-map (tokenizer) | ceno_tokenizer.CENOCharLevelTokenizer |
| Property | Value |
|---|---|
| Hidden layers | 38 |
| Hidden size | 1024 |
| Attention heads | 16 |
| Intermediate size | 4096 |
| Experts (MoE) | 8 (top-2 per token) |
| Vocabulary | 512 (byte / character-level) |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3ckpt = "CladeTeam/CENO-P-1B"
4model = AutoModelForCausalLM.from_pretrained(ckpt, trust_remote_code=True)
5tokenizer = AutoTokenizer.from_pretrained(ckpt, trust_remote_code=True)
6
7ids = tokenizer.encode("ATCGATCG", return_tensors="pt")
8# out = model.generate(ids, max_new_tokens=128) # needs a CUDA GPU (Mamba kernels)The Mamba layers require CUDA kernels, so forward passes and generation need a GPU. Config, tokenizer, and weight loading are CPU-safe.
CENO-*) — genomic-sequence generation and embedding extraction;
downstream adaptation (fine-tuning, probing) for genomics tasks.CENO-P-*) — variant effect prediction (VEP) by scoring wild-type
vs. variant sequences with delta log-likelihood. See the TraitGym VEP example in the
CENO code repository.CharLevelTokenizer (Apache-2.0). See the LICENSE and NOTICE files in this repository
for full attribution.