檔案儲存在電腦的設計架構裡面，向來扮演著舉足輕重的角色。面對現在Big data的盛行，檔案系統的容量需求也就越來越大，從以往幾Megabyte的儲存空間，到現在動輒上Terabyte級的硬碟，儲存空間的巨大進化，意味著人們有著極大的資訊儲存需求。然而，硬碟的容量是有極限的，就算你買了現在最大的硬碟，並把系統的硬碟擴充全部接滿，你還是有可能會遇到容量不夠的問題。
在網路發達的今日，人們也逐漸的改變習慣，從一開始的網路免費空間、免費郵件，到現在企業普遍使用的Amazon S3、一般用戶使用Google Drive、Dropbox、iCloud等雲端服務，顯見人們已經逐漸習慣在網路上處理許多大大小小任務，而這些網路工具的背後，正是一台台伺服器叢集串聯起來所提供的服務，雲端系統的需求也日益龐大。
本論文針對監視攝影系統這樣的一個實例需求。挑選了較為人熟知的幾套分散式檔案系統及其他網路檔案系統應用，像是GlusterFS、MooseFS以及NFS、iSCSI等，主要針對吞吐量的負載能力與系統特性來做分析比較。藉以尋找出適合這樣情境的一個檔案系統。
希望透過這些實驗，可以作為使用者選擇檔案系統時的一個參考。

Storage system play an important role in computer architecture. In the era of big data, the demand of the capacity in storage is increasing. We use 100 megabytes in the past, but now we can see hundreds of thousands of terabytes hard disks in the market. The big revolution in capacity, tell us people have big demand on storage space.
As the popularity of the Internet, people change their habit and put their work on Internet, Google Drive, iCloud and Dropbox is a good example here. In the backend of these service, is supported by the cluster system. And now, the requirement of the cloud storage is growing.
In this thesis, we want to solve the storage problem for CCTV system. We pick up some famous distributed file system and other application of network file system, just like GlusterFS, MooseFS, NFS and iSCSI. We focus on system throughput and characteristic for comparison. Hope to find out the best file system in this case and give reader a reference when choosing the file system.

論文審定書 i
誌謝 ii
摘要 iii
Abstract iv
目錄 v
圖次 vii
表次 ix
第一章 序論 1
1.1 研究動機與目的 1
1.2 研究方法 2
1.3 論文架構 3
第二章 IOzone Benchmark介紹 4
2.1 Benchmark Tools的選用 4
2.2 IOzone簡介 5
2.3 參數說明 7
2.4 測試3D圖表說明 8
2.5 參數選擇 9
2.5.1 Remount實驗 10
2.5.2 Default、Direct I/O與fsync模式差異比較 16
2.5.3 Record size的選擇 21
第三章 磁碟檔案系統 23
3.1 Ext4 23
3.2 BtrFS 23
3.3 XFS 24
3.4 實驗：磁碟檔案系統比較 24
第四章 網路檔案系統 27
4.1 NFS 27
4.1.1 實驗：NFS多Client吞吐量測試 28
4.2 iSCSI 32
4.2.1 實驗：單Client，Multi-task吞吐量測試 32
4.3 MooseFS 35
4.3.1 實驗：MooseFS特性與多Client吞吐量測試 37
4.4 GlusterFS 42
4.4.1 分散型卷宗 Distributed Volume 43
4.4.2 複製型卷宗 Replicated Volume 43
4.4.3 交錯型卷宗 Striped Volume 44
4.4.4 複合應用：Distributed Striped Volume 45
4.4.5 複合應用：Distributed Replicated Volume 45
4.4.6 複合應用：Striped Replicated Volume 46
4.4.7 實驗：GlusterFS多Client吞吐量測試比較 47
4.4.8 實驗：GlusterFS使用NFS協定多Client壓力測試 52
第五章 實際應用：監視攝影系統運作模擬 55
第六章 結語 57
參考文獻 58
附錄 62

[1] YANG, Qing; HU, Yiming. DCD---disk caching disk: A new approach for boosting I/O performance. In: Computer Architecture, 1996 23rd Annual International Symposium on. IEEE, 1996. p. 169-169.
[2] Iozone Filesystem Benchmark Document, http://www.iozone.org/docs/IOzone_msword_98.pdf
[3] Best of open source in storage – InfoWorld, http://www.infoworld.com/[primary-term-alias-prefix]/[primary-term]/best-open-source-in-storage-837&current=6
[4] 10 iozone Examples for Disk I/O Performance Measurement on Linux, http://www.thegeekstuff.com/2011/05/iozone-examples/
[5] iozone的使用与介绍_petercnmei_新浪博客, http://blog.sina.com.cn/s/blog_3cba7ec10100ea62.html
[6] Phoronix Global - Linux Benchmarking & Results Database, http://global.phoronix-test-suite.com/
[7] DJORDJEVIC, Borislav; TIMCENKO, Valentina. Ext4 file system in Linux Environment: Features and Performance Analysis. International Journal of Computers, 2012, 1.6: 2012.
[8] Btrfs, https://btrfs.wiki.kernel.org/index.php/Main_Page
[9] RODEH, Ohad; BACIK, Josef; MASON, Chris. Btrfs: The linux b-tree filesystem. ACM Transactions on Storage (TOS), 2013, 9.3: 9.
[10] XFS, http://oss.sgi.com/projects/xfs/
[11] KÁRA, Jan. Ext4, btrfs, and the others. In: Proceeding of Linux-Kongress and OpenSolaris Developer Conference. 2009. p. 99-111.
[12] accoduies' space: MooseFS簡介, http://accoduies.blogspot.tw/2011/09/moosefs.html
[13] MooseFS, http://www.moosefs.org/
[14] MooseFS使用总结_百度文库, http://wenku.baidu.com/view/3c1cc140336c1eb91a375d74.html
[15] Moosefs管理中的小技巧, http://www.mysqlsystems.com/2011/05/moosefs_tips.html
[16] Bai, S., & Wu, H. (2011, October). The Performance Study on Several Distributed File Systems. In CyberC p. 226-229.
[17] SHI, Xiaohong, et al. A Prefetching Mechanism Based on MooseFS. In: Trustworthy Computing and Services. Springer Berlin Heidelberg, 2014. p. 146-153.
[18] 艾云霄, 谭跃生, & 王静宇. (2013). MooseFS 中 chunkserver 负载均衡算法研究. 微型机与应用, 32(5), 1-3.
[19] GlusterFS, http://www.gluster.org/
[20] DAVIES, Alex; ORSARIA, Alessandro. Scale out with GlusterFS. Linux Journal, 2013, 2013.235: 1.
[21] 實作Scale-out NAS – Gluster & Heartbeat, http://www.james-tw.com/jnote/shi-zuoscale-out-nas-gluster-heartbeat
[22] Chapter 8. Setting up Red Hat Storage Volumes, https://access.redhat.com/site/documentation/en-US/Red_Hat_Storage/2.0/html/Administration_Guide/chap-User_Guide-Setting_Volumes.html
[23] BOYER, Eric B.; BROOMFIELD, Matthew C.; PERROTTI, Terrell A. GlusterFS One Storage Server to Rule Them All. Los Alamos National Laboratory (LANL), 2012.
[24] YONG, Y. A. N. G. Distribution Redundancy Storage Based on GlusterFS. Journal of Xi'an University of Arts & Science (Natural Science Edition), 2010, 4: 022.
[25] 熊文; 喻之斌; 须成忠. 几个常见分布式文件系统特征分析和性能对比. 集成技术, 2012, 1.4.
[26] 林晟毓. 安裝 GlusterFS 3.4 之 Striped 篇. 林晟毓.
[27] Ubuntu建構GlusterFS叢集儲存(分享列表) - iT邦幫忙::IT知識分享社群, http://ithelp.ithome.com.tw/question/10107014
[28] Glusterfs 刪除 Volume 之後就無法再建立了？ « 毓林園地, http://tern.logdown.com/posts/109530-glusterfs-volume-create-failed
[29] 鳥哥的 Linux 私房菜：第十三章、檔案伺服器之一：NFS 伺服器
http://linux.vbird.org/linux_server/0330nfs.php
[30] OSADZINSKI, Alex. The network file system (NFS). Computer standards & interfaces, 1989, 8.1:p. 45-48.
[31] 鳥哥的 Linux 私房菜：第十八章、網路磁碟裝置： iSCSI 伺服器
http://linux.vbird.org/linux_server/0460iscsi.php
[32] 新增來自網路的儲存空間 – iSCSI target
http://download.ithome.com.tw/article/index/id/2319
[33] English for You, Michael´s Blog: Linux作業系統中記憶體buffer和cache的區別
http://hon0612.blogspot.tw/2007/10/linuxbuffercache.html
[34] 分布式文件系统MFS、Ceph、GlusterFS、Lustre的比较 - 魏若愚--专注Linux - 51CTO技术博客, http://weiruoyu.blog.51cto.com/951650/786607
[35] 最新linux搭建gfs系统--iscsi+GFS实现网络存储 - 宗军 - 51CTO技术博客, http://tech110.blog.51cto.com/438717/485534/
[36] RAICU, Ioan; FOSTER, Ian T.; BECKMAN, Pete. Making a case for distributed file systems at exascale. In: Proceedings of the third international workshop on Large-scale system and application performance. ACM, 2011. p. 11-18.
[37] DEPARDON, Benjamin, et al. Analysis of Six Distributed File Systems. 2013.
[38] SATRAN, Julian; METH, Kalman. Internet small computer systems interface (iSCSI). 2004.
[39] RADKOV, Peter, et al. A Performance Comparison of NFS and iSCSI for IP-Networked Storage. In: FAST. 2004. p. 101-114.
[40] VISHWAKARMA, Smita; BAGARIA, Sankalp. iSCSI simulation study of storage system. In: Computer Modeling and Simulation, 2008. UKSIM 2008. Tenth International Conference on. IEEE, 2008. p. 703-707.
[41] CAPPS, Don; MCNEAL, Tom. Analyzing NFS client performance with IOzone.