LiLT (Language-independent Layout Transformer) is a dual-stream encoder that combines RoBERTa (768d text) with a parallel layout transformer (192d) via BiACM (bidirectional attention complementation). It takes OCR text + bounding boxes and performs token classification for document understanding.

This variant is fine-tuned on FUNSD (Form Understanding in Noisy Scanned Documents) with 7 IOB labels: O, B-HEADER, I-HEADER, B-QUESTION, I-QUESTION, B-ANSWER, I-ANSWER.

Model Details

Property	Value
Architecture	LiLT (RoBERTa + Layout Transformer + BiACM)
Parameters	130.7M
Hidden size	768 (text) / 192 (layout)
Layers	12
Heads	12
Vocab	50,265 (RoBERTa BPE)
Labels	7 (FUNSD IOB)
License	MIT
Base model	SCUT-DLVCLab/lilt-roberta-en-base

Available Formats

File	Format	Size
	Float32	498 MB
	Q8_0	134 MB
	Q4_K	90 MB

Usage

Python

CLI

Parity

Verified against HuggingFace transformers using the crispembed-diff harness:

25/25 encoder stages: cos_min = 1.000000
16/16 token labels match (100%)
max_abs < 1.6e-03 across all layers

Citation

Provenance and EU AI Act Art. 53 note

Upstream model: philschmid/lilt-en-funsd — published by philschmid.
Upstream licence: mit. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
What was done here: format conversion and/or quantisation only (GGUF). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository.
Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.

cstr/lilt-funsd-GGUF

LiLT FUNSD — GGUF