This dataset contains 1,141 multilingual web pages.
Each page contains the visible text extracted from the page. Each page includes 2 or more languages, with 2 prominent languages.
page.csv lists the 2 prominent for each page. The content of the page is found in the pages/ folder.
The breakdown of languages is the following:
1705 en
1043 fr
336 zh
90 es
79 id
77 de
75 pt
40 it
34… See the full description on the dataset page:
https://huggingface.co/datasets/MAximeSobrier/Web-multilingual.
