Storing, preprocessing and analyzing Tweets: Finding the suitable NoSQL system

Abstract: NoSQL systems are a new generation of databases that aim to handle a large volume of data. However there is a large set of NoSQL systems, each has its own characteristics. Consequently choosing the suitable NoSQL system to handle Tweets is challenging. Based on these motivations, this work is carried out to find the suitable NoSQL system to store, preprocess and analyze Tweets. This paper presents the requirements of managing Tweets and provides a detailed comparison of five of the most popular NoSQL systems namely, Redis, Cassandra, MongoDB, Couchbase and Neo4j regarding to these requirements. The results of this work show that for Tweets storing, preprocessing and analyzing, MongoDB and Couchbase are the most suitable NoSQL systems. Unlike related works, this work compares five NoSQL systems from different types in a real scenario which is Tweet storing, preprocessing and analyzing. The chosen scenario enables to evaluate not only the performance of read and write operations, but also other requirements related to Tweets management such as scalability, analysis tools support and analysis languages support.