Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
gemma-2b-finetune – AI Model by aromo17 | AlphaNeural AI
You can deploy this model and start earning money today!
aromo17
/
gemma-2b-finetune
like
0
keras-hub
text-generation
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is a
Gemma
model
uploaded using the KerasHub library and can be used with JAX, TensorFlow, and PyTorch backends. This model is related to a
CausalLM
task.
Model config:
name:
gemma_backbone
trainable:
True
dtype:
{'module': 'keras', 'class_name': 'DTypePolicy', 'config': {'name': 'float32'}, 'registered_name': None}
vocabulary_size:
256000
num_layers:
18
num_query_heads:
8
num_key_value_heads:
1
hidden_dim:
2048
intermediate_dim:
32768
head_dim:
256
layer_norm_epsilon:
1e-06
dropout:
0
query_head_dim_normalize:
True
use_post_ffw_norm:
False
use_post_attention_norm:
False
final_logit_soft_cap:
None
attention_logit_soft_cap:
None
sliding_window_size:
4096
use_sliding_window_attention:
False
This model card has been generated automatically and should be completed by the model author. See
Model Cards documentation
for more information.
