This repository hosts the model weights for Gengram-10B. For instructions and details, please refer to the
Gengram GitHub.
Gengram is a novel conditional memory module designed for genomic foundation models (GFMs) that introduces explicit motif memory retrieval to enhance Transformer-based DNA sequence modeling. Unlike traditional GFMs that rely on dense computation to implicitly infer multi-nucleotide motifs, Gengram provides an efficient lookup mechanism for biological patterns through a genomic-specific hashing scheme.
For full documentation, training details, and usage instructions, please visit the
GitHub repository.
