Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Pinecone-Rune-12b-Token-Surgery-Chatml-v0.1a – AI Model by Nitral-Archive | AlphaNeural AI

You can deploy this model and start earning money today!

Nitral-Archive/
Pinecone-Rune-12b-Token-Surgery-Chatml-v0.1a

like

0

Entropicengine/Pinecone-Rune-12b

Views

No views yet

Original base model Entropicengine/Pinecone-Rune-12b

Modified base model used for this train: Nitral-AI/Pinecone-Rune-12b-chatmlified

Only around 750 entries in rank/alpha 32 4bit-qlora at 3e-6 for 2 epochs. bs 4 grad accum 4, for ebs 16 with cosine.

Dataset here: https://huggingface.co/datasets/Nitral-AI/antirep_sharegpt

Example Notebook using l4/t4: https://huggingface.co/Nitral-AI/Pinecone-Rune-12b-Token-Surgery-Chatml/tree/main/TokenSurgeon-Example

Boring Training graph.

Starting loss: 1.74 Final loss 0.95

image/png