Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
my-glm-demo – AI Model by GlimmerCS | AlphaNeural AI
You can deploy this model and start earning money today!
GlimmerCS
/
my-glm-demo
like
0
safetensors
bert
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Card: my-glm-demo
Training Hyperparameters
learning_rate: 5e-05
train_batch_size: 32
eval_batch_size: 32
seed: 42
distributed_type: multi-GPU
num_devices: 2
total_train_batch_size: 64
total_eval_batch_size: 64
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 3.0
mixed_precision_training: Native AMP
Model Architecture (from config.json)
Model Type
: bert
Architectures
: BertForMaskedLM
Hidden Size
: 768
Num Hidden Layers
: 12
Num Attention Heads
: 12
Intermediate Size
: 3072
Max Position Embeddings
: 512
Hidden Activation
: gelu
Attention Dropout
: 0.1
Hidden Dropout
: 0.1
