Views
No views yet
meta-llama/Llama-3.1-8B-Instruct, fine-tuned on multi-turn function-calling traces from NousResearch/hermes-function-calling-v1. Designed to be served with NVFP4 weight-quantization and an off-the-shelf EAGLE-3 speculative-decoding head for low-latency tool-use on a single Grace Blackwell.| Adapter | LoRA (PEFT, rank 32, α 64, dropout 0.1, target=q,k,v,o,gate,up,down) |
| Base model | meta-llama/Llama-3.1-8B-Instruct |
| Recommended serving base | nvidia/Llama-3.1-8B-Instruct-NVFP4 |
| Speculative head | RedHatAI/Llama-3.1-8B-Instruct-speculator.eagle3 |
| License | Llama 3.1 Community License (inherited from base) |
| Hardware trained on | Single NVIDIA Grace Blackwell (GB10) |
NousResearch/hermes-function-calling-v1, ~10k multi-turn function-calling traces.max_seq_length=2048, paged AdamW 8-bit, gradient checkpointing.bfcl-eval (v4 data, core v3 categories, single-turn) against this adapter served on nvidia/Llama-3.1-8B-Instruct-NVFP4 via vLLM.| Category | Passed / Total | Accuracy |
|---|---|---|
simple_python | 270 / 400 | 67.5% |
multiple | 140 / 200 | 70.0% |
parallel | 123 / 200 | 61.5% |
parallel_multiple | 74 / 200 | 37.0% |
irrelevance | 38 / 240 | 15.8% |
live_simple | 111 / 258 | 43.0% |
live_multiple | 478 / 1,053 | 45.4% |
live_parallel | 9 / 16 | 56.2% |
live_parallel_multiple | 6 / 24 | 25.0% |
live_irrelevance | 558 / 884 | 63.1% |
live_relevance | 8 / 16 | 50.0% |
simple_java (out-of-scope) | 15 / 100 | 15.0% |
simple_javascript (out-of-scope) | 11 / 50 | 22.0% |
simple_python / multiple / parallel (Hermes's distribution) but is over-conservative on irrelevance and live categories. A DPO-aligned follow-up trained against BFCL refusal patterns is the planned next step.1from peft import PeftModel
2from transformers import AutoModelForCausalLM, AutoTokenizer
3
4base = "meta-llama/Llama-3.1-8B-Instruct"
5adapter = "pyloxsystems/pylox-crypto-agent-8b"
6
7tok = AutoTokenizer.from_pretrained(base)
8model = AutoModelForCausalLM.from_pretrained(base, device_map="auto")
9model = PeftModel.from_pretrained(model, adapter)1vllm serve nvidia/Llama-3.1-8B-Instruct-NVFP4 \
2 --enable-lora \
3 --lora-modules pylox-crypto-agent-8b=pyloxsystems/pylox-crypto-agent-8b \
4 --speculative-config '{"method":"eagle3","model":"RedHatAI/Llama-3.1-8B-Instruct-speculator.eagle3"}'multi_turn_*); long-context retrieval (memory_*); web-search categories; format-sensitivity categories.@misc{pylox_crypto_agent_8b_2026,
title = {Pylox Crypto Agent 8B},
author = {Pylox Systems},
year = {2026},
url = {https://huggingface.co/pyloxsystems/pylox-crypto-agent-8b}
}