TREC Washington Post Corpus

The TREC Washington Post Corpus contains 728,626 news articles and blog posts from January 2012 through December 2020. The articles are stored in JSON format, and include:

• title
• byline
• date of publication
• kicker (a section header)
• article text broken into paragraphs
• links to embedded images and multimedia (for 2012-2017 documents)

You need to have an organizational agreement on file with NIST to download these files.

NEWS: Version 4 is released, and includes articles in 2020.

• Washington Post corpus, version 4 (2.4GB) (adds 2020, reformats dates in the content block to be human-readable)
• Washington Post corpus, version 3 (1.8GB) (adds 2018-2019, removes near-duplicates; as used in TREC 2020 News Track)
• Washington Post corpus, version 2 (1.5GB) (removes exact duplicates; as used in the TREC 2018 and 2019 News Track)
• original version (contains duplicate docids) (1.5GB)