Full web-page text for reproducing the visit / /web_parser tool of LiteResearcher.
The LiteResearcher local environment exposes two tools, backed by two separate datasets:
search
/search
LiteResearcher-Corpus
url / title / doc — doc is snippet-level (~200 chars), used to build the BGE-M3 vector index
visit
/web_parser
this dataset
url / title / text — text is the full page… See the full description on the dataset page:
https://huggingface.co/datasets/simplex-ai-inc/LiteResearcher-Browse-Corpus.