You could always access the latest arXiv papers via this dataset.
We update the dataset weekly, on every Sunday. So the dataset always provides the latest arXiv papers created in the past week.
The current dataset on main branch contains the latest arXiv papers submitted from 2024-09-02 to 2024-09-09.
The data collection was conducted on 2024-09-09.
Use the dataset via:
ds = datasets.load_dataset('RealTimeData/arxiv_latest')
You could… See the full description on the dataset page:
https://huggingface.co/datasets/RealTimeData/arxiv_latest.