Distributed Cloud Yunfs : Concepts and Design

The Brief Description of the YunFS

The YunFS is a cloud storage based Distributed Filesystem, it has some important features.

• Bases on a Distributed Framework that can provide complete dynamic and modular design, it is easy to install, remove, start, stop a module with the CLI interface. This Framework provides an automatic code generator. With an IDL file, all necessary files are automatically generated in a second, it is easy to develop a new module for the YunFS.


• Provides the RESTful service that can create, add, remove, read and write files of the YunFS. Any other third online web services can access the YunFS by following the RESTful service.


• The files are stored in a hierarchal directory tree and support streaming read&write, which can't be provided by the AWS S3 Cloud Storage


• As a Complete Memory Filesystem, the blocks of the disk are managed by using the Memory Management Technologies. The blocks on disk are treated as memory blocks.


• The disk blocks are directly stored on the Cloud Storage, and there is no traditional volume concept.


• Adopts the concept of Bitcoin's Block Chain. A huge disk file is split into many small pieces of files. It is unnecessary to request for getting a large file from the Cloud Storage.


• Distributed data consistence, the YunFS is designed as one leader and multiple followers. Only the leader can have the read, write, create and delete privileges, and the follower only has the read right. Because the followers are independent of each other, so the performance can be linear growth. With the more followers, the read performance can be much better. To deploy the YunFS followers with the nearest policy, the end user can benefit from the nearest service, which is very attractive.

From the Author

When talking about the design and implementation of a system most technical books are almost hard and boring. A reader need concentrates his energies on reading those hard technical books without any distraction. Though the reader may get knowledge from the books finally, he need to spend more time and more energy.

When I decide to write this book to introduce the YunFS, how to avoid boring and keep reading simple becomes my most important target. When we were still children, we usually learned the words by using cartoon pictures and stories, with those interesting cartoon pictures and stories, we knew the language step by step.

This book is fulfilled with many nice illustrations and stories when describing the background, design and implementation of the YunFS. Wish you felt happy when reading this illustrated technical book.

When talking about the design and implementation of a system most technical books are almost hard and boring. A reader need concentrate his energies on reading those hard technical books without any distraction. Though the reader may get knowledge from the books finally, he need to spend more time and more energy.

When I decide to write this book to introduce the YunFS, how to avoid boring and keep reading simple becomes my most important target. When we were still children, we usually learned the words by using cartoon pictures and stories, with those interesting cartoon pictures and stories, we knew the language step by step.

This book is fulfilled with many nice illustrations and stories when describing the background, design and implementation of the YunFS. Wish you felt happy when reading this illustrated technical book.