You can deploy this model and start earning money today!

umarzein/
INCITE-WikipediaHeadings

Name: INCITE-WikipediaHeadings
Availability: InStock

umarzein/wikipedia-headings-20k

apache-2.0

Views

No views yet

This is RedPajama-INCITE-Bse-3B-v1, fine-tuned to generate children wikipedia headings. The input should be "root>downto>bottom:", e.g.: "Mathematics>History>19-th Century:". The output shuold be seperated by "|"

Usage

python

from peft import *
from transformers import *
peft_path='umarzein/INCITE-WikipediaHeadings'
base_path="togethercomputer/RedPajama-INCITE-Base-3B-v1"
base=AutoModelForCausalLM.from_pretrained(base_path)
tokenizer=AutoTokenizer.from_pretrained(base_path)
model=PeftModel(base,peft_path)
output=model.generate(input_ids=tokenizer("Mathematics:",return_tensors='pt')['input_ids'])
decoded=tokenizer.decode(output.flatten())
#Mathematics:History|Etymology|Areas of mathematics