Layout-only pretrained checkpoint from the official LiLT repository.

This is not a complete model — it contains only the 2D spatial (layout) encoder, with no text encoder. It is intended as a building block for combining with any RoBERTa-like text encoder.

LiLT (Language-Independent Layout Transformer) decouples text and layout understanding into two separate encoders. lilt-only-base contains exclusively the layout encoder weights, pretrained on document layout understanding (IIT-CDIP dataset).

This allows combining it with any RoBERTa-compatible text encoder to produce a language-specific document understanding model.

Use gen_weight_roberta_like.py from the official repository to combine with your text encoder of choice:

Compatible text encoders: any RoBERTa-like model (roberta-base, camembert-base, microsoft/infoxlm-base, etc.)

This checkpoint uses model_type = liltrobertalike, a custom type defined in the original LiLT repository. It cannot be loaded directly with AutoModel from HuggingFace transformers without first combining it with a text encoder via the procedure above.

MIT — following the original jpwang/lilt repository.