You can deploy this model and start earning money today!

NiekWork/
gemma-3-12b-logql-finetune

Name: gemma-3-12b-logql-finetune
Availability: InStock

Views

No views yet

gemma-3-12b-logql-finetune

Fine-tuned Gemma 3 12B for LogQL Query Generation [MLC]

This model is fine-tuned from Google's Gemma 3 12B to generate LogQL queries from natural language descriptions.

Model Information

Base Model: gemma-3-12b
Quantization: q4f16_1
Format: MLC (Machine Learning Compilation)
Use Case: LogQL query generation

Training Details

Base model: gemma/gemma-3-12b-it
Fine-tuned for LogQL query generation
Trained on custom generated dataset (15000 samples, 5 epochs)

Usage

With MLC-LLM Python API

python

from mlc_llm import MLCEngine

# Create engine
engine = MLCEngine(
    model="NiekWork/gemma-3-12b-logql-finetune",
    mode="local"
)

# Generate text
response = engine.chat.completions.create(
    messages=[
        
    ]
)

print(response.choices[0].message.content)

With MLC-LLM CLI

mlc_llm chat NiekWork/gemma-3-12b-logql-finetune

Files

This repository contains:

mlc-chat-config.json - MLC configuration
ndarray-cache.json - Weight metadata
params_shard_*.bin - Quantized model weights
tokenizer.json - Tokenizer
tokenizer_config.json - Tokenizer configuration

About MLC-LLM

MLC LLM is a universal solution that allows any language model to be deployed natively on diverse hardware backends and native applications. More info at: https://llm.mlc.ai/

License

This model is released under the Apache 2.0 license.