Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
CLIP-transcoder-topk-1024-x64-all_patches_10-mlp-97 – AI Model by Prisma-Multimodal | AlphaNeural AI
You can deploy this model and start earning money today!
Prisma-Multimodal
/
CLIP-transcoder-topk-1024-x64-all_patches_10-mlp-97
like
0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
CLIP Transcoder Checkpoint
This model is a Transcoder trained on CLIP's internal representations.
Model Details
Architecture
Layer
: 10
Layer Type
: ln2.hook_normalized
Model
: laion/CLIP-ViT-B-32-DataComp.XL-s13B-b90K
Dictionary Size
: 49152
Input Dimension
: 768
Expansion Factor
: 64
CLS Token Only
: False
Training
Learning Rate
: 0.0010281538518292835
Batch Size
: 4096
Context Size
: 50
Sparsity
L0 (Active Features)
: 1024
Additional Information
Wandb Run
:
https://wandb.ai/perceptual-alignment/openclip-transcoders/runs/9y2vv0lh/
Random Seed
: 42
