Responsive image
博碩士論文 etd-0129105-124412 詳細資訊
Title page for etd-0129105-124412
論文名稱
Title
高效率檔案伺服器群組之設計與分析
Design and Analysis of a Highly Efficient File Server Group
系所名稱
Department
畢業學年期
Year, semester
語文別
Language
學位類別
Degree
頁數
Number of pages
128
研究生
Author
指導教授
Advisor
召集委員
Convenor
口試委員
Advisory Committee
口試日期
Date of Exam
2005-01-21
繳交日期
Date of Submission
2005-01-29
關鍵字
Keywords
資料一致性、負載分攤、可用性、檔案伺服器
Data Consistency, Availability, Load-sharing, File Server
統計
Statistics
本論文已被瀏覽 5688 次,被下載 1977
The thesis/dissertation has been browsed 5688 times, has been downloaded 1977 times.
中文摘要
由於網際網路技術的快速提昇,儲存媒體漸漸地被視為一個獨立於電腦系統外的一個子系統,且有許多的電腦工作站將共同分享此網路儲存資源。再則,由於全球資訊網網站資訊內容快速成長,使得資訊提供者對於網路檔案系統的擴充性及可用性越來越重視。因此,對於系統的可靠度、可擴充性以及操作的便利性顯得格外重要。一種用來改善檔案系統的可靠度的基本技術就是利用複製的方式來處理錯誤失敗所造成的影響。同時,利用一致性控制協定的設計來確保這些複製資料間的一致性。
在本論文中,我們已經成功的引進Intermediate File Handle 的觀念來掩飾不同檔案系統間的異質性。然而,由於先前的簡易系統缺乏客戶寫入需求之間的相依性檢查以及失序需求的管理,使得整體系統的效率不彰。因此,我們基於Intermediate File Handle 的觀念提出一個有效率且能減少無相依性客戶寫入需求之間不必要的等待的一致性控制機制,藉以提昇檔案伺服器群組的效率。此外,我們也提出一個簡單的負載分攤的機制來平均分攤伺服器的負載藉以增加系統的整體效能以及複製伺服器的使用效率。最後,我們利用實驗的結果來說明我們提出關於複製資料間資料一致性的控制機制以及負載分攤的演算法的效率及優異性。除以上特點外,容易建置是我們系統設計最主要的考量。
Abstract
The IT community has increasingly come to view storage as a resource that should be shared among computer systems and managed independently of the computer systems that it serves. And, the explosive growth of the Web contents has led to increasing attention on two major challenges: scalability and high availability of network file system. Therefore, the ways to improve the reliability and availability of system, to achieve the expected reduction in operational expenses and to reduce the operations of system management of system have become essential issues. A basic technique for improving reliability of a file system is to mask the effects of failures through replication. Consistency control protocols are implemented to ensure the consistency among these replicas.
In this dissertation, we leveraged the concept of intermediate file handle to cover the heterogeneity of file system. But, the monolithic server system suffered from the poor system utilization due to the lack of dependence checking between writes and management of out-of-ordered requests. Hence, in this dissertation, we followed the concept of intermediate file handle and proposed an efficient data consistency control scheme, which attempts to eliminate unnecessary waits for independent NFS writes to improve the efficiency of file server group. In addition, we also proposed a simple load-sharing mechanism for NFS client to improve system throughput and the utilization of duplicates. Finally, the results of experiments proved the efficiency of the proposed consistency control mechanism and load-sharing policy. Above all, easy to implement is our main design consideration.
目次 Table of Contents
Table of Figures
List of Tables
Chapter 1. Introduction
1.1. Types of File services
1.2. Replication
1.3. Consistency Semantics for File sharing
Chapter 2. Background
2.1. Multicast
2.2. Replica Management
2.3. Metadata Integrity
2.4. Related Systems
Chapter 3. Design of File Server Group
3.1. Assumptions
3.2. System Overview
3.3. The Structure of Mapping Table
3.4. A New Ordering and Consistency Control Scheme
3.5. The processing of the GETTOKEN request
3.6. Multi-component LOOKUP
3.7. Control Schemes for Data Consistency
3.8. Read Requests
3.9. Write Requests
3.10. Server Crash Recovery
3.11. Other Features
Chapter 4. Load Balancing
4.1. Load Measurement
4.2. Load Distribution
4.3. Group Management
Chapter 5. Performance Measurement Analysis
5.1. Evaluation of the new ordering scheme with minor tokens
5.2. Evaluation of the load-sharing policy
5.3. A Numeric Case for Consistency Control Schemes
Chapter 6. Conclusions and Future Works
6.1. System conclusion
6.2. Future Applications
6.3. Applied Shared Storage Model
6.4. Future Plans
References
參考文獻 References
[AKK90] A. Siegel, K. Birman and K. Marzullo. "Deceit: A flexible distributed file systems" In Summer 1990 USENIX Conference, pages 51-61, Anaheim, CA, June 1990
[ASE91] A. Bhide, S. Morgan, E. Elnozahy and A. Siegel "A comparison of two approaches to build reliable distributed file servers", 11th International Conference on Distributed Computing Systems, May 1991, pages 616-623
[AST] Andrew S. Tanenbaum, “DISTRIBUTED OPERATING SYSTEMS”, PRENTICE HALL INTERNATIONAL EDITIONS.
[BAS99] Bjorn Gronvall, Assar Westerlund, and Stephen Pink. “The design of a multicast-based distributed file system”. In Proc. of Operating Systems Design and Implementation, pages 251-264, 1999.
[CD89] C.G.Gray, D.R.Cheeriton, Leases: an efficient fault-tolerant mechanism for distributed file cache consistency, In Proceedings of the 12th ACM Symposium on Operating System Principles, 1989.
[CMK97] Chang, K.; Morris, R.; Kung, H.T., “NFS Dynamics Over Flow-Controlled Wide Area Networks”, INFOCOM '97. Sixteenth Annual Joint Conference of the IEEE Computer and Communications Societies. Driving the Information Revolution., Proceedings IEEE Volume: 2 , 1997 , Page(s): 619 -625 vol.2
[CSF97] C. S. Yang, S. S. B. Shi and F. J. Liu, “The Design and Implementation of a Reliable File Server”, Newsletter of the Technical Committee on Distributed Processing, summer 1997.
[DD90] D.D., Clark, D.L. Tennenhouse, Architectural considerations for a new generation of protocols, In Proceedings of the ACM SIGCOMM 1990.
[FC03] F.J.Liu and C.S.Yang, “THE DESIGN AND ANALYSIS OF A HIGHLY-AVAILABLE FILE SERVER GROUP”, IEICE Transactions on Information and System, Vol.86-E, No.11, pp. 2291-2299, 2003.
[FCY04] F.J.Liu, C.S.Yang and Y.K.Lee, "The Design of An Efficient and Fault-tolerant Consistency Control Scheme in File Server Group", IEICE Transactions on Information and System, Vol.E87-D No.12, pp.2697-2705, 2004.
[HMS88] Haskin, R., Malachi, Y., Sawdon, W., Chan, G. “Recovery Management in QuickSilver,” ACM Transaction on Computer System, 6(1), pp.82-108. Feb. 1988.
[HR87] Hagmann, R. “Reimplementing the Cedar File System Using Logging and Group Commit,” Proceedings of the 11th SOSP, pp. 155-162. Austin, TX, Nov. 1987.
[KAP91] K.Birman, A.Schiper, P.Stephenson, Light-weight Causal and Atomic Group Multicast, ACM Transactions on Computer Systems, 9(3), Aug. 1991.
[KF88] K.Marzullo and F. Schmuck "Supplying high availability with a standard network file system", IEEE Eighth International Conference on Distributed Computing, June 1988, pages 447-453.
[Mac94] Macklem, Rick, "Not Quite NFS, Soft Cache Consistency for NFS," Winter USENIX Conference Proceedings, USENIX Association, Berkeley, CA, Jan. 1994.
[MBJ88] M.Nelson, B.Welch, and J.Ousterhout. Caching in the Sprite Network File System. ACM Transactions on Computer Systems, 6(1):pp.134-154,Feb.1988.
[MFR00] Margo I. Seltzer, Fregory R. Ganger, M. Kirk McKusick, Keith A. Smith, Craig A. N. Soules, Christopher A. Stein, “ Journaling versus Soft Updates: Asynchronous Meta-data Protection in File Systems”, USENIX Technical Conference, June, 2000.
[MJP90] M. Satyanarayanan, J.J. Kistler, P.Kumar, M.E. Okasaki, E.H. Siegel and D.C.Steere "Coda: A highly available file system for a distributed workstation environment" IEEE Transactions on Computers, 39(4), pp.447-459, April 1990
[ML88] M.L.Kazar, Synchronization and Caching Issues in the Andrew File System, In Proceedings of the USENIX Winter Technical Conference, 1988.
[Mog94] J. Mogul, Recovery in Spritely NFS, Computing Systems, 7(2): pp. 201-262, 1994
[MRT94] M. Dahlin, R. Wang, T. Anderson, and D. Patterson. Cooperative Caching: Using Remote Client Memory to Improve File System Performance. In Proc. of the First Symp. on Operating Systems Design and Implementation, pages 267-- 280, November 1994.
[MT98] M.M. Leboute and Taicy Weber, “A reliable distributed file system for UNIX based on NFS“, UFRGS, Brazil, IFIP International Workshop on Dependable Computing and Its Applications (DCIA 98) January 12 - 14, 1998, Johannesburg, South Africa
[NFS4] The NFS Version 4 Protocol.
[PJB] Peter J. Braam, “File Systems for Clusters from a Protocol Perspective”, http://www.inter-mezzo.org
[PM95] P.Kumar, M.Satyanarayanan, “Flexible and Safe Resolution of File Conflicts”, In Proceedings of the USENIX Winter Technical Conference, 1995.
[RFC12] S.Deering, Host Extensions for IP Multicasting, RFC 1112, Internet Engineering Task Force, 1989.
[RFC54] Callaghan, B., “WebNFS Client Specification,” RFC 2054, October 1996. http://www.ietf.org/rfc/rfc2054.txt
[RFC55] Callaghan, B., “WebNFS Server Specification,” RFC 2055, October 1996. http://www.ietf.org/rfc/rfc2055.txt
[RFC76] W.Fenner, Internet Group Management Protocol, Version 3, RFC 3376, Interenet Engineering Task Force.
[RFC94] Sun MicroSystems, Inc. NFS: Network File System: Version 2 Protocol Specification, RFC-1094, 1989
[RJK90] R.G. Guy, J.S. Heidemann, W. Mak, W. Page and G.J. Popek "Implementation of the Ficus replicated file system". In Proceedings of Summer 1990 USENIX Conference, June 1990, Pages 63-71
[SC00] Stein, C. “The Write-Ahead File System: Integration Kernel and Application Logging,” Harvard University Technical Report, TR-02-00, Cambridge, MA, Apr. 2000.
[SCD88] S.Deering, C.Partridge, D.Waitzman, Distance Vector Multicast Routing Protocol, RFC 1075, Internet Engineering Task Force, 1988.
[SD91] S.Deering, Multicast Routing in a Datagram Internetwork, PhD Thesis, Standford University, Dec. 1991.
[SDD88] S.Deering, D.Estrin, D.Frainacci, V.Jacobson, C.Liu, L.Wei, The PIM Architecture for Wide-Area Multicast Routing, IEEE/ACM Transactions on Networking, 4(2), April. 1988.
[SHS03] Sanjay Ghemawat, Howard Gobioff, Shun-Tak Leung, "The Google File System,” Proceedings of the nineteenth ACM symposium on Operating systems principles 2003, Bolton Landing, NY, USA October 19 - 22, 2003, Pages: 29 – 43
[SNIA] Shared Storage Model-A framework for describing storage architectures, http://www.snia.org/home
[SPD98] S.Kumar, P.Radoslavov, D.Thaler, C.Alaet-tinoglu, D.Estrin, M.Handley, The MASC/BGMP Architectural Support for Inter-domain Multicast Routing, In Proceedings of the ACM SIGCOMM 1998.
[SVC97] S.Floyd, V. Jacobson, C.Liu, S. McCanne, L.Zhang, A Reliable Multicast Framework for Light-weigh Sessions and Application Level Framing, IEEE/ACM Transactions on Networking, 5(6), Dec. 1997.
[TPJ93] T.Ballardie, P.Francis, J.Crowcroft, Core Based Trees (CBT), In Proceedings of the ACM SIGCOMM 1993.
[TRD95] Thomas T. Kwan, Robert E. McGrath, and Daniel A. Reed. Nsca’s world wide web server: Design and performance. IEEE computer, 28(11):68-74, November 1995.
[VJ89] V. Srinivasan and J. Mogul. Spritely NFS: Experiments with Cache Consistency Protocols. In Proceedings of the Twelfth ACM Symposium on Operating Systems Principles, pp. 45--57, Dec. 1989
[VJ95] Venkata N. Padmanabhan and Jeffrey C. Mogul. Improving HTTP latency. Computer Networks and ISDN systems, 28:25-35, 1995.
[YB04]Ying Xu and Brett D. Fleisch, NFS-cc: Tuning NFS for Concurrent Read Sharing, the International Journal on High Performance Computing and Networking (IJHPCN), Inderscience Publishing, issue 3, 2004.
[YC02] Yasushi Saito and Christos Karamanolis, “Pangaea: a symbiotic wide-area file system,” ACM SIGOPS European Workshop, Sep 2002.
電子全文 Fulltext
本電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。
論文使用權限 Thesis access permission:校內校外完全公開 unrestricted
開放時間 Available:
校內 Campus: 已公開 available
校外 Off-campus: 已公開 available


紙本論文 Printed copies
紙本論文的公開資訊在102學年度以後相對較為完整。如果需要查詢101學年度以前的紙本論文公開資訊,請聯繫圖資處紙本論文服務櫃台。如有不便之處敬請見諒。
開放時間 available 已公開 available

QR Code