← Back to live feed · 1 stories across 1 day

Sunday, Sep 20, 2026

1 story
1
User Releases First Complete 16 TB arXiv Corpus of 3.1 Million Papers on Hugging Face
topics 🤖 AI💻 Tech tags AIAI ModelsAI Open Source keywords

An extensive new archive of academic literature is now available as an open dataset on the Hugging Face platform. The 16 TB collection, shared by user @secemp9, provides access to 3,148,796 papers from the arXiv repository, including every version of the documents in LaTeX, PDF, PostScript, and HTML formats.

The project organizes the complete arXiv site into a single downloadable resource for scientific workflows. This release encompasses the full history of papers hosted on the original repository, providing a unified source for all previously published versions of the academic works.

Earlier version from Saturday, Sep 19
Developer Releases Full arXiv Archive of 3.1 Million Papers as 16 TB Hugging Face Dataset
5 tweets • 5 sources
See all 5 tweets →