You can deploy this model and start earning money today!

Pieces/
embeddinggemma-300m-distilled-15pct-768dim

Name: embeddinggemma-300m-distilled-15pct-768dim
Availability: InStock

safetensors

gemma3_text

Views

No views yet

Distilled Backbone: embeddinggemma-300m-distilled-112hidden-768dim

This is a distilled/compressed version of google/embeddinggemma-300m.

Compression Details

Base model: google/embeddinggemma-300m
Width reduction factor: None
Target hidden size: 112
Final embedding dimension: 768
Had projection layer: True
Projection incorporated: True

Usage

To use this as a pretrained backbone in validation:

bash

python -m playground.validate_from_checkpoint \
    --pretrained_backbone_model "Pieces/embeddinggemma-300m-distilled-15pct-768dim" \
    --backbone_embedding_dim 768 \
    --backbone_pooling_mode "mean" \
    --num_samples 100 \
    --dataset_split "val" \
    --num_general_tags_high 100 \
    --num_general_tags_low 100

Important: The path must point to the sentence_transformer subdirectory (not the parent directory).

The exported model has been configured to output embeddings of dimension 768 directly, incorporating any projection layers from the distillation process.