You can deploy this model and start earning money today!

NewEden/
Austral-70B-FP8

Name: Austral-70B-FP8
Availability: InStock

Delta-Vector/Austral-70B-Preview

quantized

Views

No views yet

fp8 quant made via llm-compressor. compressed via ztsd due to slow internet.

Linux

Install zstd:

bash

# Ubuntu/Debian
sudo apt install zstd

# RHEL/CentOS/Fedora
sudo dnf install zstd

Extract (multi-threaded):

bash

# Single command (if tar supports zstd)
tar -I 'zstd -T0' -xf Austral-FP8.tar.zst

# Two-step method
zstd -d -T0 Austral-FP8.tar.zst
tar -xf Austral-FP8.tar

macOS

Install zstd:

brew install zstd

Extract (multi-threaded):

bash

# Single command
tar -I 'zstd -T0' -xf Austral-FP8.tar.zst

# Two-step method
zstd -d -T0 Austral-FP8.tar.zst
tar -xf Austral-FP8.tar

Windows

Install zstd:

Download from Facebook/zstd releases
Or use Chocolatey: choco install zstandard
Or use WSL with Linux instructions

Extract (multi-threaded):

PowerShell/CMD:

cmd

zstd.exe -d -T0 Austral-FP8.tar.zst
tar -xf Austral-FP8.tar

WSL:

bash

zstd -d -T0 Austral-FP8.tar.zst
tar -xf Austral-FP8.tar

Options Explained

-d: Decompress
-T0: Use all available CPU cores
-T4: Use 4 threads (specify number)
--rm: Remove source file after extraction

Notes

Maximum compression means slower decompression but better file size
Multi-threading (-T0) significantly speeds up extraction on multi-core systems

NewEden/Austral-70B-FP8

Linux

macOS

Windows

Options Explained

Notes

NewEden/
Austral-70B-FP8