Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

NewsBERT_1850_1875_lora_3epochs – AI Model by TextMachineProject | AlphaNeural AI

You can deploy this model and start earning money today!

TextMachineProject/
NewsBERT_1850_1875_lora_3epochs

like

0

masked-language-modeling

TextMachineProject/NewsBERT_1800-1920

Views

No views yet

NewsBERT 1850–1875 LoRA adapter (3 epochs)

A LoRA adapter for TextMachineProject/NewsBERT_1800-1920, fine-tuned for three epochs on newspaper text (1850–1875) from the Heritage Made Digital (HMD14) and Living with Machines (LwM) collections.

Training details

Period: 1850–1875
Base model: TextMachineProject/NewsBERT_1800-1920
Method: LoRA (PEFT), target modules: query, value, word_embeddings
LoRA rank: 16, alpha: 32, dropout: 0.05
Task: Masked Language Modelling (15% masking probability)
Sequence length: 128 tokens (sliding window, stride 96)
Epochs: 3
Batch size: 256

Usage

python

from transformers import AutoTokenizer, AutoModelForMaskedLM
from peft import PeftModel

base = AutoModelForMaskedLM.from_pretrained("TextMachineProject/NewsBERT_1800-1920")
tokenizer = AutoTokenizer.from_pretrained("TextMachineProject/NewsBERT_1800-1920")
model = PeftModel.from_pretrained(base, "TextMachineProject/NewsBERT_1850_1875_lora_3epochs")