Developing Architectural Documentation for the Hadoop Distributed File System
|Title||Developing Architectural Documentation for the Hadoop Distributed File System|
|Publication Type||Conference Proceedings|
|Year of Publication||2011|
|Authors||Bass, Len, Kazman Rick, and Ozkaya Ipek|
|Secondary Title||Open Source Systems: Grounding Research (OSS 2011)|
Many open source projects are lacking architectural documentation that describes the major pieces of the system, how they are structured, and how they interact. We have produced architectural documentation for the Hadoop Distributed File System (HDFS), a major open source project. This paper describes our process and experiences in developing this documentation. We illustrate the documentation we have produced and how it differs from existing documentation by describing the redundancy mechanisms used in HDFS for reliability.