You can deploy this model and start earning money today!

SongsongBaobao8694/
genelm-spatial

Name: genelm-spatial
Availability: InStock

safetensors

Views

No views yet

GeneLM – Gene Expression Language Model for Spatial Transcriptomics

Epoch 2 checkpoint trained on mouse brain scRNA-seq (C57BL/6J Allen Brain Atlas sections).

Architecture

Gene encoder: CellFM (custom Vision/Transformer backbone, enc_dims=1536)
LLM: meta-llama/Llama-3.1-8B (LoRA fine-tuned then merged)
Projection: Linear(1536→4096) → GELU → Linear(4096→4096)
Task: given cell gene-expression + metadata instruction, predict spatial (x, y) coordinates

Files

File	Description
`llama_merged/`	Merged LLaMA-3.1-8B + LoRA weights (safetensors) + tokenizer
`custom_modules/custom_modules.safetensors`	CellFM encoder, LayerNorm, projection layer
`custom_modules/genelm_config.json`	Architecture metadata

Usage

python

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from safetensors.torch import load_file

# Load merged LLaMA
llama = AutoModelForCausalLM.from_pretrained("yue/genelm-spatial/llama_merged", torch_dtype=torch.bfloat16)
tokenizer = AutoTokenizer.from_pretrained("yue/genelm-spatial/llama_merged")

# Load custom modules
custom = load_file("yue/genelm-spatial/custom_modules/custom_modules.safetensors")

SongsongBaobao8694/genelm-spatial

GeneLM – Gene Expression Language Model for Spatial Transcriptomics

Architecture

Files

Usage

SongsongBaobao8694/
genelm-spatial