Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
DINO-topk-x64-all_patches_8-resid_post-768-99 – AI Model by Prisma-Multimodal | AlphaNeural AI
You can deploy this model and start earning money today!
Prisma-Multimodal
/
DINO-topk-x64-all_patches_8-resid_post-768-99
like
0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
DINO Sparse Autoencoder Checkpoint
This model is a sparse autoencoder trained on DINO's internal representations.
Model Details
Architecture
Layer
: 9
Layer Type
: hook_resid_post
Model
: facebook/dino-vitb16
Dictionary Size
: 49152
Input Dimension
: 768
Expansion Factor
: 64
CLS Token Only
: False
Training
Learning Rate
: 0.00032652183388019257
L1 Coefficient
: -
Batch Size
: 4096
Context Size
: 197
Checkpoint details
Checkpoint
: 1/10
Sparsity
L0 (Active Features)
: 768
Additional Information
Wandb Run
:
https://wandb.ai/perceptual-alignment/dino-sae-sweep/runs/u0aw58c0
Random Seed
: 42
