Directory Contents

Please consider making a donation (https://pushshift.io/donations) if you download a lot of data. This helps offset the costs of my time collecting data and providing bandwidth to make these files available to the public. Thank you!


If you have any questions about the data formats of the files or any other questions, please feel free to contact me at jason@pushshift.io


In this directory, you will notice that some months have an .xz extension as well as a .bz2 extension. The data in both are the same, but the .xz files offer a higher compression ratio. If an .xz file is available for a specific month, I would recommend downloading that instead of the .bz2 file. Eventually all files will be available in the .xz compression type.


File sizes starting with the October 2017 data dumps are approximately 10-15% larger in size. The reason for this is due to the fact that Reddit started offering a new field for comment objects called "permalink". The values for this new field are the direct link to the comment itself.


Reddit banned the subreddit /r/incels in early November of 2017. This happened as I was re-ingesting data for the month of October, 2017. Since the data was no longer available via the Reddit API, I still had the data from my real-time ingest database. In the interest of research, I included these comments in the October 2017 dump. The comments from the real-time database will have a score of "null". This only affects a subset of /r/incels comments for the months of October and November 2017.

Filename Type Size (bytes) Date Modified
RC_2018-01-01.xz LZMA2 Compressed Reddit Comments (JSON objects) 201,491,588 Sep 8 2021 10:27 PM
RC_2018-01-02.xz LZMA2 Compressed Reddit Comments (JSON objects) 257,462,668 Sep 8 2021 10:27 PM
RC_2018-01-03.xz LZMA2 Compressed Reddit Comments (JSON objects) 272,128,832 Sep 8 2021 10:27 PM
RC_2018-01-04.xz LZMA2 Compressed Reddit Comments (JSON objects) 263,591,508 Sep 8 2021 10:27 PM
RC_2018-01-05.xz LZMA2 Compressed Reddit Comments (JSON objects) 276,650,320 Sep 8 2021 10:28 PM
RC_2018-01-06.xz LZMA2 Compressed Reddit Comments (JSON objects) 231,980,432 Sep 8 2021 10:28 PM
RC_2018-01-07.xz LZMA2 Compressed Reddit Comments (JSON objects) 238,647,200 Sep 8 2021 10:28 PM
RC_2018-01-08.xz LZMA2 Compressed Reddit Comments (JSON objects) 265,732,596 Sep 8 2021 10:28 PM
RC_2018-01-09.xz LZMA2 Compressed Reddit Comments (JSON objects) 282,587,992 Sep 8 2021 10:28 PM
RC_2018-01-10.xz LZMA2 Compressed Reddit Comments (JSON objects) 284,180,712 Sep 8 2021 10:29 PM
RC_2018-01-11.xz LZMA2 Compressed Reddit Comments (JSON objects) 283,236,364 Sep 8 2021 10:29 PM
RC_2018-01-12.xz LZMA2 Compressed Reddit Comments (JSON objects) 276,506,628 Sep 8 2021 10:29 PM
RC_2018-01-13.xz LZMA2 Compressed Reddit Comments (JSON objects) 232,455,056 Sep 8 2021 10:29 PM
RC_2018-01-14.xz LZMA2 Compressed Reddit Comments (JSON objects) 241,863,632 Sep 8 2021 10:30 PM
RC_2018-01-15.xz LZMA2 Compressed Reddit Comments (JSON objects) 270,389,580 Sep 8 2021 10:30 PM
RC_2018-01-16.xz LZMA2 Compressed Reddit Comments (JSON objects) 283,671,148 Sep 8 2021 10:30 PM
RC_2018-01-17.xz LZMA2 Compressed Reddit Comments (JSON objects) 285,712,836 Sep 8 2021 10:30 PM
RC_2018-01-18.xz LZMA2 Compressed Reddit Comments (JSON objects) 283,337,320 Sep 8 2021 10:30 PM
RC_2018-01-19.xz LZMA2 Compressed Reddit Comments (JSON objects) 277,897,516 Sep 8 2021 10:31 PM
RC_2018-01-20.xz LZMA2 Compressed Reddit Comments (JSON objects) 224,279,488 Sep 8 2021 10:31 PM
RC_2018-01-21.xz LZMA2 Compressed Reddit Comments (JSON objects) 242,182,372 Sep 8 2021 10:31 PM
RC_2018-01-22.xz LZMA2 Compressed Reddit Comments (JSON objects) 286,728,736 Sep 8 2021 10:31 PM
RC_2018-01-23.xz LZMA2 Compressed Reddit Comments (JSON objects) 290,508,688 Sep 8 2021 10:32 PM
RC_2018-01-24.xz LZMA2 Compressed Reddit Comments (JSON objects) 286,541,304 Sep 8 2021 10:32 PM
RC_2018-01-25.xz LZMA2 Compressed Reddit Comments (JSON objects) 289,371,304 Sep 8 2021 10:32 PM
RC_2018-01-26.xz LZMA2 Compressed Reddit Comments (JSON objects) 277,301,600 Sep 8 2021 10:33 PM
RC_2018-01-27.xz LZMA2 Compressed Reddit Comments (JSON objects) 229,186,324 Sep 8 2021 10:33 PM
RC_2018-01-28.xz LZMA2 Compressed Reddit Comments (JSON objects) 235,834,624 Sep 8 2021 10:33 PM
RC_2018-01-29.xz LZMA2 Compressed Reddit Comments (JSON objects) 280,791,856 Sep 8 2021 10:33 PM
RC_2018-01-30.xz LZMA2 Compressed Reddit Comments (JSON objects) 291,447,164 Sep 8 2021 10:34 PM
RC_2018-01-31.xz LZMA2 Compressed Reddit Comments (JSON objects) 291,719,444 Sep 8 2021 10:34 PM
RC_2018-02-01.xz LZMA2 Compressed Reddit Comments (JSON objects) 289,104,140 Sep 8 2021 10:34 PM
RC_2018-02-02.xz LZMA2 Compressed Reddit Comments (JSON objects) 285,506,500 Sep 8 2021 10:34 PM
RC_2018-02-03.xz LZMA2 Compressed Reddit Comments (JSON objects) 233,527,844 Sep 8 2021 10:35 PM
RC_2018-02-04.xz LZMA2 Compressed Reddit Comments (JSON objects) 240,203,632 Sep 8 2021 10:35 PM
RC_2018-02-05.xz LZMA2 Compressed Reddit Comments (JSON objects) 280,892,740 Sep 8 2021 10:35 PM
RC_2018-02-06.xz LZMA2 Compressed Reddit Comments (JSON objects) 289,659,524 Sep 8 2021 10:35 PM
RC_2018-02-07.xz LZMA2 Compressed Reddit Comments (JSON objects) 297,964,020 Sep 8 2021 10:36 PM
RC_2018-02-08.xz LZMA2 Compressed Reddit Comments (JSON objects) 296,955,308 Sep 8 2021 10:36 PM
RC_2018-02-09.xz LZMA2 Compressed Reddit Comments (JSON objects) 284,746,912 Sep 8 2021 10:36 PM
RC_2018-02-10.xz LZMA2 Compressed Reddit Comments (JSON objects) 241,526,116 Sep 8 2021 10:37 PM
RC_2018-02-11.xz LZMA2 Compressed Reddit Comments (JSON objects) 242,067,128 Sep 8 2021 10:37 PM
RC_2018-02-12.xz LZMA2 Compressed Reddit Comments (JSON objects) 282,219,184 Sep 8 2021 10:37 PM
RC_2018-02-13.xz LZMA2 Compressed Reddit Comments (JSON objects) 294,497,316 Sep 8 2021 10:37 PM
RC_2018-02-14.xz LZMA2 Compressed Reddit Comments (JSON objects) 290,163,976 Sep 8 2021 10:38 PM
RC_2018-02-15.xz LZMA2 Compressed Reddit Comments (JSON objects) 287,401,276 Sep 8 2021 10:38 PM
RC_2018-02-16.xz LZMA2 Compressed Reddit Comments (JSON objects) 290,034,184 Sep 8 2021 10:38 PM
RC_2018-02-17.xz LZMA2 Compressed Reddit Comments (JSON objects) 235,801,868 Sep 8 2021 10:38 PM
RC_2018-02-18.xz LZMA2 Compressed Reddit Comments (JSON objects) 258,003,820 Sep 8 2021 10:39 PM
RC_2018-02-19.xz LZMA2 Compressed Reddit Comments (JSON objects) 275,976,808 Sep 8 2021 10:39 PM
RC_2018-02-20.xz LZMA2 Compressed Reddit Comments (JSON objects) 294,847,144 Sep 8 2021 10:39 PM
RC_2018-02-21.xz LZMA2 Compressed Reddit Comments (JSON objects) 300,724,704 Sep 8 2021 10:39 PM
RC_2018-02-22.xz LZMA2 Compressed Reddit Comments (JSON objects) 300,666,232 Sep 8 2021 10:40 PM
RC_2018-02-23.xz LZMA2 Compressed Reddit Comments (JSON objects) 294,198,912 Sep 8 2021 10:40 PM
RC_2018-02-24.xz LZMA2 Compressed Reddit Comments (JSON objects) 237,922,356 Sep 8 2021 10:40 PM
RC_2018-02-25.xz LZMA2 Compressed Reddit Comments (JSON objects) 246,607,052 Sep 8 2021 10:41 PM
RC_2018-02-26.xz LZMA2 Compressed Reddit Comments (JSON objects) 289,734,660 Sep 8 2021 10:41 PM
RC_2018-02-27.xz LZMA2 Compressed Reddit Comments (JSON objects) 298,644,600 Sep 8 2021 10:41 PM
RC_2018-02-28.xz LZMA2 Compressed Reddit Comments (JSON objects) 301,483,312 Sep 8 2021 10:41 PM
RC_2019-02-01.gz Reddit Comments (JSON objects) 838,295,689 Sep 8 2021 10:42 PM
RC_2019-02-02.gz Reddit Comments (JSON objects) 733,524,648 Sep 8 2021 10:43 PM
RC_2019-02-03.gz Reddit Comments (JSON objects) 748,567,111 Sep 8 2021 10:44 PM
RC_2019-02-04.gz Reddit Comments (JSON objects) 801,327,846 Sep 8 2021 10:45 PM
RC_2019-02-05.gz Reddit Comments (JSON objects) 841,895,980 Sep 8 2021 10:45 PM
RC_2019-02-06.gz Reddit Comments (JSON objects) 874,531,952 Sep 8 2021 10:46 PM
RC_2019-02-07.gz Reddit Comments (JSON objects) 871,231,038 Sep 8 2021 10:47 PM
RC_2019-02-08.gz Reddit Comments (JSON objects) 837,375,022 Sep 8 2021 10:48 PM
RC_2019-02-09.gz Reddit Comments (JSON objects) 736,000,761 Sep 8 2021 10:49 PM
RC_2019-02-10.gz Reddit Comments (JSON objects) 748,103,043 Sep 8 2021 10:50 PM
RC_2019-02-11.gz Reddit Comments (JSON objects) 876,696,555 Sep 8 2021 10:50 PM
RC_2019-02-12.gz Reddit Comments (JSON objects) 884,868,915 Sep 8 2021 10:51 PM
RC_2019-02-13.gz Reddit Comments (JSON objects) 883,869,393 Sep 8 2021 10:52 PM
RC_2019-02-14.gz Reddit Comments (JSON objects) 851,354,125 Sep 8 2021 10:53 PM
RC_2019-02-15.gz Reddit Comments (JSON objects) 827,015,029 Sep 8 2021 10:53 PM
RC_2019-02-16.gz Reddit Comments (JSON objects) 721,016,796 Sep 8 2021 10:54 PM
RC_2019-02-17.gz Reddit Comments (JSON objects) 737,071,192 Sep 8 2021 10:55 PM
RC_2019-02-18.gz Reddit Comments (JSON objects) 822,496,034 Sep 8 2021 10:55 PM
RC_2019-02-19.gz Reddit Comments (JSON objects) 878,214,064 Sep 8 2021 10:56 PM
RC_2019-02-20.gz Reddit Comments (JSON objects) 890,563,320 Sep 8 2021 10:57 PM
RC_2019-02-21.gz Reddit Comments (JSON objects) 888,567,510 Sep 8 2021 10:58 PM
RC_2019-02-22.gz Reddit Comments (JSON objects) 870,531,953 Sep 8 2021 10:58 PM
RC_2019-02-23.gz Reddit Comments (JSON objects) 749,838,129 Sep 8 2021 10:59 PM
RC_2019-02-24.gz Reddit Comments (JSON objects) 788,015,238 Sep 8 2021 11:00 PM
RC_2019-02-25.gz Reddit Comments (JSON objects) 850,749,444 Sep 8 2021 11:01 PM
RC_2019-02-26.gz Reddit Comments (JSON objects) 869,830,059 Sep 8 2021 11:01 PM
RC_2019-02-27.gz Reddit Comments (JSON objects) 892,893,754 Sep 8 2021 11:02 PM
RC_2019-02-28.gz Reddit Comments (JSON objects) 880,612,847 Sep 8 2021 11:03 PM
RC_2020-01-01.gz Reddit Comments (JSON objects) 810,234,744 Sep 8 2021 11:03 PM
RC_2020-01-02.gz Reddit Comments (JSON objects) 963,299,167 Sep 8 2021 11:04 PM
RC_2020-01-03.gz Reddit Comments (JSON objects) 1,014,964,458 Sep 8 2021 11:05 PM
RC_2020-01-04.gz Reddit Comments (JSON objects) 922,089,840 Sep 8 2021 11:06 PM
RC_2020-01-05.gz Reddit Comments (JSON objects) 948,658,997 Sep 8 2021 11:07 PM
RC_2020-01-06.gz Reddit Comments (JSON objects) 970,822,842 Sep 8 2021 11:08 PM
RC_2020-01-07.gz Reddit Comments (JSON objects) 1,012,375,123 Sep 8 2021 11:09 PM
RC_2020-01-08.gz Reddit Comments (JSON objects) 1,015,719,719 Sep 8 2021 11:09 PM
RC_2020-01-09.gz Reddit Comments (JSON objects) 1,007,601,814 Sep 8 2021 11:10 PM
RC_2020-01-10.gz Reddit Comments (JSON objects) 994,307,696 Sep 8 2021 11:11 PM
RC_2020-01-11.gz Reddit Comments (JSON objects) 892,442,546 Sep 8 2021 11:12 PM
RC_2020-01-12.gz Reddit Comments (JSON objects) 924,030,778 Sep 8 2021 11:13 PM
RC_2020-01-13.gz Reddit Comments (JSON objects) 980,338,778 Sep 8 2021 11:14 PM
RC_2020-01-14.gz Reddit Comments (JSON objects) 1,028,110,742 Sep 8 2021 11:15 PM
RC_2020-01-15.gz Reddit Comments (JSON objects) 1,020,398,911 Sep 8 2021 11:16 PM
RC_2020-01-16.gz Reddit Comments (JSON objects) 1,007,294,841 Sep 8 2021 11:17 PM
RC_2020-01-17.gz Reddit Comments (JSON objects) 981,575,198 Sep 8 2021 11:17 PM
RC_2020-01-18.gz Reddit Comments (JSON objects) 863,972,135 Sep 8 2021 11:18 PM
RC_2020-01-19.gz Reddit Comments (JSON objects) 876,395,547 Sep 8 2021 11:19 PM
RC_2020-01-20.gz Reddit Comments (JSON objects) 959,580,872 Sep 8 2021 11:20 PM
RC_2020-01-21.gz Reddit Comments (JSON objects) 977,475,841 Sep 8 2021 11:21 PM
RC_2020-01-22.gz Reddit Comments (JSON objects) 976,479,021 Sep 8 2021 11:22 PM
RC_2020-01-23.gz Reddit Comments (JSON objects) 984,172,122 Sep 8 2021 11:23 PM
RC_2020-01-24.gz Reddit Comments (JSON objects) 980,325,655 Sep 8 2021 11:24 PM
RC_2020-01-25.gz Reddit Comments (JSON objects) 864,635,153 Sep 8 2021 11:24 PM
RC_2020-01-26.gz Reddit Comments (JSON objects) 878,264,431 Sep 8 2021 11:25 PM
RC_2020-01-27.gz Reddit Comments (JSON objects) 959,641,056 Sep 8 2021 11:26 PM
RC_2020-01-28.gz Reddit Comments (JSON objects) 1,006,750,108 Sep 8 2021 11:27 PM
RC_2020-01-29.gz Reddit Comments (JSON objects) 1,014,508,868 Sep 8 2021 11:28 PM
par_recovery <Directory> File <Directory> Sep 8 2021 5:54 AM