Developing a Strongly Consistent, Fault-Tolerant, Long-Lived Distributed Storage System with Failure Prediction Mechanism
IMDEA Networks Institute is an External Collaborator
Distributed Storage Systems (DSS) encompass the technology powering modern cloud data storage services such as DropBox and Google Drive that are used by millions of users as networked platforms for collaborative applications and data storage. Algorithms for DSS ensure data availability and survivability by replicating data in geographically dispersed network locations. However, a major problem with data distribution is consistency, especially when the storage is accessed concurrently by multiple processes; a key to enabling collaboration. Numerous strategies have been devised to mitigate these issues, however a robust and efficient solution remains elusive. In this project, we propose a novel atomic DSS built on top of asynchronous message-passing, failure-prone, commodity devices. Atomicity is the most natural consistency guarantee as it provides the illusion of a centralised sequentially accessed storage. The project’s goal is to enhance the practicality of atomic data storage by combining three services: (i) Fragmentation, (ii) Reconfiguration, and (iii) Failure Prediction.