You can deploy this model and start earning money today!

furiosa-ai/
Llama-3.3-70B-Instruct-INT8

Name: Llama-3.3-70B-Instruct-INT8
Availability: InStock

meta-llama/Llama-3.3-70B-Instruct

finetune

llama3.3

Views

No views yet

Model Overview

Model Architecture: Meta-Llama-3
- Input: Text
- Output: Text
Model Optimizations:
Maximum Context Length: 32k tokens
- Maximum Prompt Length: 32768 tokens
- Maximum Generation Length: 32768 tokens
Intended Use Cases: Intended for commercial and non-commercial use. Same as Meta-Llama-3.3-70B-Instruct, this models is intended for assistant-like chat.
Release Date: 08/27/2025
Version: v2025.3
License(s): Llama3.3
Supported Inference Engine(s): Furiosa LLM
Supported Hardware Compatibility: FuriosaAI RNGD
Preferred Operating System(s): Linux
Quantization:
- Tool: Furiosa Model Compressor v0.6.6, included in Furiosa SDK 2025.3
- Weight: int8, Activation: bfloat16, KV cache: bfloat16

Description:

This model is the pre-compiled version of the Llama-3.3-70B-Instruct, which is an auto-regressive language model that uses an optimized transformer architecture.

Usage

To run this model with Furiosa-LLM, follow the example command below after installing Furiosa-LLM and its prerequisites.

furiosa-llm serve furiosa-ai/Llama-3.3-70B-Instruct-INT8