You can deploy this model and start earning money today!

kojima-lab/
molcrawl-genome-sequence-clinvar-gpt2-small

Name: molcrawl-genome-sequence-clinvar-gpt2-small
Availability: InStock

Views

No views yet

molcrawl-genome-sequence-clinvar-gpt2-small

Model Description

GPT-2 small (124M parameters) fine-tuned on ClinVar genomic variant sequences, starting from the molcrawl-genome-sequence-gpt2-small pre-trained model.

Datasets

ClinVar: https://www.ncbi.nlm.nih.gov/clinvar/ (Fine-tuning dataset)
GRCh38 human genome reference assembly: https://www.ncbi.nlm.nih.gov/assembly/GCF_000001405.26/ (Pre-training corpus used by the base model)
Model Type: gpt2
Data Type: DNA/Genome
Training Date: 2026-04-24

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model = AutoModelForCausalLM.from_pretrained("kojima-lab/molcrawl-genome-sequence-clinvar-gpt2-small")
tokenizer = AutoTokenizer.from_pretrained("kojima-lab/molcrawl-genome-sequence-clinvar-gpt2-small")

# Generate DNA/genome sequence
prompt = "ATCGATCGATCGATCGATCGATCGATCGATCG"
inputs = tokenizer(prompt, return_tensors="pt")
with torch.no_grad():
    output_ids = model.generate(
        **inputs,
        max_new_tokens=50,
        do_sample=True,
        temperature=0.8,
        eos_token_id=None,  # HF config.json has legacy eos_token_id=0; disable early stop
        pad_token_id=0,
    )
print(tokenizer.decode(output_ids[0], skip_special_tokens=True))

Source Code

Training pipeline, configuration files, and data preparation scripts are available in the MolCrawl GitHub repository: https://github.com/mmai-framework-lab/MolCrawl

License

This model is released under the APACHE-2.0 license.

Citation

If you use this model, please cite:

bibtex

@misc{molcrawl_genome_sequence_clinvar_gpt2_small,
  title={molcrawl-genome-sequence-clinvar-gpt2-small},
  author={{RIKEN}},
  year={2026},
  publisher={{Hugging Face}},
  url={{https://huggingface.co/kojima-lab/molcrawl-genome-sequence-clinvar-gpt2-small}}
}