For NLP tasks we provide the top 1000 frequent terms in frequent_terms. csv, the top 1000 bigrams in frequent_bigrams. csv, and the top 1000 trigrams in frequent_trigrams. csv. Some general statistics per day are included for both datasets in the full_dataset-statistics. tsv and full_dataset-clean-statistics. tsv files. For more statistics and some visualizations visit: http://www.
We release all tweets and retweets on the full_dataset. tsv file (1, 371, 993, 942 unique tweets), and a cleaned version with no retweets on the full_dataset-clean. tsv file (355, 691, 266 unique tweets). There are several practical reasons for us to leave the retweets, tracing important tweets and their dissemination is one of them.