Responsive image
博碩士論文 etd-0815112-131044 詳細資訊
Title page for etd-0815112-131044
論文名稱
Title
設計並實現具負載平衡之雲端化資料儲存系統
Design and Implementation of Cloud Data Backup System with Load Balance Strategy
系所名稱
Department
畢業學年期
Year, semester
語文別
Language
學位類別
Degree
頁數
Number of pages
75
研究生
Author
指導教授
Advisor
召集委員
Convenor
口試委員
Advisory Committee
口試日期
Date of Exam
2012-07-25
繳交日期
Date of Submission
2012-08-15
關鍵字
Keywords
雲端儲存、伺服器選擇、同步機制、多執行緒、分散式檔案系統
Cloud Storage, Server Selection, Distributed File System, Multithreading, Synchronization
統計
Statistics
本論文已被瀏覽 5683 次,被下載 1028
The thesis/dissertation has been browsed 5683 times, has been downloaded 1028 times.
中文摘要
雲端儲存隨著頻寬的提升而蓬勃發展,越來越多的資源被投入到雲端儲存。在論文中我們設計一套雲端儲存系統,由單一主伺服器和多個資料伺服器組成。主伺服器控制整個系統,例如管理資料伺服器,並且週期性的取得資料伺服器狀態。資料伺服器則透過Windows檔案系統將資料儲存於本地硬碟。為了因應大量的資料存取,在伺服器選擇上就必須能提供效能上的平等。在這篇論文中我們提出伺服器選擇策略,結合多個參數來做效能衡量。藉此平衡伺服器端的多個資源項目。
我們將此策略實現於我們自行設計的雲端儲存系統上,並且進行了兩個實驗,分別是上傳實驗和上傳加下載實驗。在上傳實驗中我們的演算法將可用空間的最大最小差距維持在5GB內,而隨機存取則會造成可用空間的最大最小差隨著時間發散,最高接近30GB。而上傳加下載實驗,使用我們演算法的結果,可用空間的最大最小差維持在10GB內。而隨機存取的最大最小差也是隨著時間發散,最高也接近30GB。另外在兩個實驗中,我們的演算法也有效的提升了使用者傳輸速度,上傳實驗中使用演算法的平均下載速度較隨機方式快上1.1倍。上傳加下載實驗中使用演算法的平均下載速度提升了1.03倍,平均上傳速度提升了1.1倍。
Abstract
The fast growing bandwidth has made the development of cloud storage. More and more resource has put in cloud storage. In this thesis, we proposed a new cloud storage that consists of a single main server and multiple data servers. The main server controls system-wide activities such as data server management. It also periodically communicates with each data server and collects its state. Data servers store data on local disks as Windows files. In order to response to the large number of data access, Selection of the server which is necessary to offer equalized performance. In this paper, we propose a server selection algorithm using different parameters to get the performance metrics which enables us to balance multi-resource from server-side.
We design new cloud storage and implement the algorithm. According to upload experiment, the difference between the maximum and the minimum free space when using our algorithm is less than 5GB. But using the random mode, the free space difference is increased as time, and the maximum is 30GB. In the mixed experiment, we added the download mode, and our algorithm is fewer than 10GB. The result of the random mode approximated to the first experiment. Finally, our algorithm obtains 10% and 3% speedup in upload throughput by upload experiment and mixed experiment, 10% speedup in download throughput by mixed experiment.
目次 Table of Contents
第一章 簡介 1
1.1 研究動機 1
1.2 研究目的 2
1.3 論文大綱 2
第二章 背景知識與相關研究 3
2.1分散式檔案系統 3
2.2 多執行緒程式設計 6
2.2.1 共用變數存取同步機制 6
2.2.2臨界區段同步機制 8
2.2.3 多重讀取單一寫入同步機制 11
2.2.4 互斥器同步機制 12
2.2.5 信號同步機制 13
2.2.6 事件同步機制 13
2.3 伺服器選擇策略 15
第三章 MPD Cloud Storage與伺服器選擇策略 18
3.1 MPD Cloud Storage系統架構 18
3.2 MPD Cloud Storage軟體架構 20
3.2.1資料儲存層(Data Storage Layer) 21
3.2.2資料管理層(Data Manager Layer) 27
3.2.3應用程式介面層(Application Interface Layer)32
3.2.4雲端應用程式層(Cloud Application Layer) 34
3.3 Ratio Balance Algorithm 34
3.3.1 動機和目的 34
3.3.2 Performance Metric 36
3.3.3 Ratio Balance Algorithm用於上傳檔案 37
3.3.4 Ratio Balance Algorithm用於下載檔案 39
3.4 傳輸範例 39
3.4.1 客戶端上傳檔案 39
3.4.2客戶端下載檔案 41
3.5 Base Library 46
第四章 實作和實驗結果 54
4.1 實驗環境 54
4.2 數據與討論 56
4.2.1 實驗一,上傳模式 57
4.2.2 實驗二,上傳模式加下載模式 58
第五章 結論 62
參考文獻 63
參考文獻 References
[1]A. Guyton; M. Schwartz, “Locating nearby copies of replicated internet servers” in Proc. ACM SIGCOMM, August 1995, pp. 288–298.
[2]Alex FTP Filesystem, Available: http://www.ludd.luth.se/~kavli/alex.html
[3]Amazon, Amazon Simple Storage Service, Available: http://aws.amazon.com/s3/
[4]Da-Wei Zhang; Fu-Quan Sun; Xu Cheng; Chao Liu, “Research on hadoop-based enterprise file cloud storage system” in Proc. International Conference on Awareness Science and Technology, iCAST’2001, Sept. 2011, pp. 434 - 437
[5]F.L. Presti; N. Bartolini; C. Petrioli,” Dynamic replica placement and user request redirection in content delivery networks” in Proc. IEEE Conference on International Communications, ICC’2005, Vol. 3, May 2005, pp. 1495 - 1501
[6]File Transfer Protocol, RFC-959, 1985.
[7]Google, 2003, Google File System, Available: http://static.googleusercontent.com/external_content/untrusted_dlcp/research.google.com/en//archive/gfs-sosp2003.pdf
[8]Google, Google Drive, Available: https://drive.google.com/start?authuser=0#home
[9]H. Lamehamedi; B. Szymanski; Z. Shentu; E. Deelman, “Data replication strategies in grid environments” in Proc. Fifth International Conference on Algorithms and Architectures for Parallel Processing, ICAPP’2002, Oct. 2002, pp. 378 - 383.
[10]He Qinlu; Li Zhanhuai; Xiao Zhang, “Study on Cloud Storage System Based on Distributed Storage Systems”, in Proc. International Conference on Computational and Information Sciences, ICCIS’2010, pp. 1332 – 1335
[11]K. M. Hanna; N. Natarajan; B.N. Levine, “Evaluation of a novel two-step server selection metric” in Proc. IEEE International Conference on Network Protocols (ICNP), November 2001, pp. 290–300.
[12]Ke ZHOU; Hua WANG; LI Chun-hua, “Cloud Storage Technology and Its Application”, ZTE Communications, vol.16, pp. 24-27, 2010.
[13]M. Sayal; Y. Breitbart; P. Scheuermann; R. Vingralek, “Selection algorithms for replicated web servers” ACM SIGMETRICS Performance Evaluation Review, 1998, vol. 26, no. 3, pp. 44–50.
[14]Microsoft, 2012, Critical Section Objects, [Online], Available: http://msdn.microsoft.com/en-us/library/windows/desktop/ms682530(v=vs.85).aspx
[15]Microsoft, 2012, Event Objects, [Online], Available: http://msdn.microsoft.com/en-us/library/windows/desktop/ms682655(v=vs.85).aspx
[16]Microsoft, 2012, Interlocked Variable Access, [Online], Available: http://msdn.microsoft.com/en-us/library/windows/desktop/ms684122(v=vs.85).aspx
[17]Microsoft, 2012, Mutex Objects, [Online], Available: http://msdn.microsoft.com/en-us/library/windows/desktop/ms684266(v=vs.85).aspx
[18]Microsoft, 2012, Semaphore Objects, [Online], Available: http://msdn.microsoft.com/en-us/library/windows/desktop/ms685129(v=vs.85).aspx
[19]Microsoft, 2012, Slim Reader/Writer (SRW) Locks, [Online], Available: http://msdn.microsoft.com/en-us/library/windows/desktop/aa904937(v=vs.85).aspx
[20]Microsoft, SkyDrive, Available: https://skydrive.live.com/
[21]OpenAFS, 2012, OpenAFS, Available: http://www.openafs.org/
[22]S. Higashi; S. Ata; A. Nakao; I. Oka, “Server selection for equalizing of performance in distributed cooperative system” in Proc. International Conference on Information Networking, ICOIN’2011, Jan. 2011, pp. 519 - 214
[23]S. Ratnasamy; M. Handley; R. Karp; S. Shenker, “Topologically-aware overlay construction and server selection” in Proc. IEEE INFOCOM, June 2002, pp. 1190–1199.
[24]S.Bakiras; “Approximate server selection algorithms in content distribution networks”, in Proc. IEEE International Conference on Communications, ICC’2005, vol. 3, pp. 1490 - 1494
[25]S.G. Dykes; K.A. Robbins; C.L. Jeffery, “An empirical evaluation of client-side server selection algorithms” in Proc. IEEE INFOCOM, March 2000, pp. 1361–1370.
[26]SUN, 1985, Design and Implementation or the Sun Network File system, Available: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.14.473
[27]Y. Tanahashi; Cheng-Kai Chen; S. Marchesin; Ma. Kwan-Liu, ”An Interface Design for Future Cloud-Based Visualization Services” in Proc. IEEE Second International Conference on Cloud Computing Technology and Science, CloudCom’2010, Dec. 2010, pp. 609 - 613.
電子全文 Fulltext
本電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。
論文使用權限 Thesis access permission:校內校外完全公開 unrestricted
開放時間 Available:
校內 Campus: 已公開 available
校外 Off-campus: 已公開 available


紙本論文 Printed copies
紙本論文的公開資訊在102學年度以後相對較為完整。如果需要查詢101學年度以前的紙本論文公開資訊,請聯繫圖資處紙本論文服務櫃台。如有不便之處敬請見諒。
開放時間 available 已公開 available

QR Code