Views
No views yet
AutoDecompiler/AutoDecompiler-30B-pscode.
It is a format conversion for llama.cpp; the model weights were not fine-tuned
or otherwise modified here.| File | Format | Size | SHA-256 |
|---|---|---|---|
AutoDecompiler-30B-pscode-BF16.gguf | GGUF v3, BF16 | 61,095,804,640 bytes (56.89 GiB) | 83d5a42e828e391aac16e68ac2fe7332d7ed4307cf5cf470cb3c33be35c92367 |
1hf download guu3/AutoDecompiler-30B-pscode-GGUF \
2 AutoDecompiler-30B-pscode-BF16.gguf \
3 --local-dir .1llama-server \
2 --model AutoDecompiler-30B-pscode-BF16.gguf \
3 --alias autodecompiler-30b-pscode-bf16 \
4 --host 127.0.0.1 \
5 --port 8080 \
6 --ctx-size 32768 \
7 --n-gpu-layers all \
8 --flash-attn on--n-gpu-layers or --ctx-size if the model does not fit available
GPU or unified memory.1curl http://127.0.0.1:8080/v1/chat/completions \
2 -H 'Content-Type: application/json' \
3 -d '{
4 "model": "autodecompiler-30b-pscode-bf16",
5 "messages": [
6 {
7 "role": "system",
8 "content": "You are a decompilation specialist. Convert the supplied P-code pseudocode into a faithful high-level source representation."
9 },
10 {
11 "role": "user",
12 "content": "Recover high-level source code from this P-code pseudocode. Return code only.\n\n<PASTE PCODE HERE>"
13 }
14 ],
15 "temperature": 0,
16 "max_tokens": 4096,
17 "stream": false
18 }'temperature: 0).
Increase max_tokens for larger functions, while keeping in mind that very
large functions may be truncated or become impractically slow.43c73bfabe24c284c31ccb76fc5dc90e5736b5dcconvert_hf_to_gguf.py48d22e295e2b86b47366c16390794f3e05ba970a1python convert_hf_to_gguf.py /path/to/AutoDecompiler-30B-pscode \
2 --outfile AutoDecompiler-30B-pscode-BF16.gguf \
3 --outtype bf16AutoDecompiler paper and the
upstream model repository
for the model and research context.