論文使用權限 Thesis access permission:自定論文開放時間 user define
開放時間 Available:
校內 Campus:永不公開 not available
校外 Off-campus:永不公開 not available
論文名稱 Title |
一個量子啟發式演化分群演算法 A Quantum-inspired Evolutionary Clustering Algorithm |
||
系所名稱 Department |
|||
畢業學年期 Year, semester |
語文別 Language |
||
學位類別 Degree |
頁數 Number of pages |
102 |
|
研究生 Author |
|||
指導教授 Advisor |
|||
召集委員 Convenor |
|||
口試委員 Advisory Committee |
|||
口試日期 Date of Exam |
2014-03-28 |
繳交日期 Date of Submission |
2014-04-17 |
關鍵字 Keywords |
演化式演算法、量子啟發式演化法、分群 clustering, quantum-inspired evolutionary algorithm, Evolutionary algorithm |
||
統計 Statistics |
本論文已被瀏覽 5715 次,被下載 0 次 The thesis/dissertation has been browsed 5715 times, has been downloaded 0 times. |
中文摘要 |
近年來,有許多以量子力學概念為基礎的演化式計算方法被提出並應用在解決組合最佳化問題上。在這些方法中,有些是特別針對資料分群問題求解的方法。然而,利用這些方法卻無法求得令人滿意的分群結果。因此,本研究提出一個新的量子演化式計算方法來解決資料分群問題,稱為「量子啟發式演化分群演算法」。本研究所提出的方法在以傳統量子演化法為基礎的架構上,加入分群解的概念與 k-means 機制,同時提出有效的修復機制來提升量子啟發式演化分群演算法的效能。為了評估本論文提出的方法之效能,特別針對真實環境資料集進行分群並比較量子啟發式演化分群演算法與傳統量子演化法以及 genetic k-means algorithm 的資料分群結果。從實驗結果顯示,本論文提出的方法是有效且可行的,同時也是非常具有潛力的方法。 |
Abstract |
In recent years, a lot of evolutionary computation methods have been proposed to solve the combinatorial optimization problem based on the concepts of quantum mechanics. Although some of them are purposely presented for solving the data clustering problem, they are all far from optimal quality-wise. As such, this thesis proposes a new method, called quantum-inspired evolutionary clustering algorithm (QECA), to address the data clustering problem. The proposed method adds not only the concepts of clustering and the k-means to the traditional quantum-inspired evolutionary algorithm to make it work for clustering but also an effective repair operator to improve the performance of the proposed method. Experimental results on real world data show that the proposed method provides a promising result than those obtained by QEA and genetic k-means algorithm. |
目次 Table of Contents |
論文審定書 i Acknowledgments iii 摘要 v Abstract vi List of Figures x List of Tables xii Chapter 1 Introduction 1 1.1 Background 1 1.2 Motivation 3 1.3 Contributions 3 1.4 Organization 3 Chapter 2 Related Works 5 2.1 Clustering Problem and Related Algorithms 5 2.1.1 Taxonomy of Clustering Problem 5 2.1.2 Definition of Clustering Problem 7 2.1.3 Basis of Clustering Activity 8 2.1.4 Similarity of Clustering Problem 9 2.1.5 k-means algorithm 10 2.1.6 Genetic k-means Algorithm (GKA) 12 2.1.6.1 Selection Operation 13 2.1.6.2 Mutation Operation 14 2.1.6.3 k-means Operation 15 2.2 Quantum Computing 16 2.2.1 Background of Quantum Computing 16 2.2.2 Principles of Quantum Computation 19 2.2.3 Quantum-inspired Computing 19 2.3 Quantum-inspired Evolutionary Algorithm 22 2.3.1 Quantum-inspired Evolutionary Algorithm (QEA) 22 2.3.1.1 Representation of QEA 22 2.3.1.2 Overall Design of QEA 23 2.3.2 QEA for Clustering 27 2.3.2.1 Initialization 27 2.3.2.2 Representation and Fitness Function 28 2.3.2.3 Make and Repair Operation 28 2.3.2.4 Evaluate and Update Operation 29 Chapter 3 The Proposed Method 31 3.1 Concepts and Representation 31 3.1.1 Concepts 31 3.1.2 Representation 31 3.2 Structure of the Proposed Method 34 3.3 Algorithm of the Proposed Method 37 3.3.1 Initialization Operation 37 3.3.2 Observation Operation 37 3.3.3 Repair Operation 38 3.3.4 Clustering Operation 41 3.3.5 k-means Operation 42 3.3.6 Evaluation Operation 43 3.3.7 Update Operation 43 3.3.8 Store Best Operations 47 3.3.9 Migration Operation 48 3.4 Difference between QECA and QEA 48 3.5 Application Example 50 Chapter 4 Experiments 55 4.1 Environment, Datasets and Parameter Settings 55 4.1.1 Environment 55 4.1.2 Datasets and Parameter Settings 56 4.2 Simulation Results 58 4.3 Analysis 61 4.3.1 Rotation Angle 61 4.3.1.1 Convergence of Q-bits 61 4.3.1.2 The Value of Rotation Angle 64 4.3.2 Trends of Optimum Solution 67 4.3.3 Population Size 72 Chapter 5 Conclusions and Future Works 76 5.1 Conclusions 76 5.2 Future Works 77 Bibliography 78 Appendix A Rotation Angle and Corresponding SSE Value 84 |
參考文獻 References |
[1] A. K. Jain, M. N. Murty, and P. J. Flynn, “Data clustering: a review,” ACM computing surveys (CSUR), vol. 31, no. 3, pp. 264–323, 1999. [2] A. K. Jain and R. C. Dubes, Algorithms for clustering data. Prentice-Hall, Inc., 1988. [3] J. A. Hartigan, Clustering algorithms. New York, USA: John Wiley & Sons, Inc., 1975. [4] M. R. Anderberg, Cluster analysis for applications. Academic Press, 1973. [5] W. J. Welch, “Algorithmic complexity: Three NP-hard problems in computational statistics,” Journal of Statistical Computation and Simulation, vol. 15, no. 1, pp. 17–25, 1982. [6] W. Xu, X. Liu, and Y. Gong, “Document clustering based on non-negative matrix factorization,” in Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pp. 267–273, The Association for Computing Machinery, 2003. [7] W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, “Face recognition: A literature survey,” ACM Computing Surveys (CSUR), vol. 35, no. 4, pp. 399–458, 2003. [8] G. Getz, H. Gal, I. Kela, D. A. Notterman, and E. Domany, “Coupled two-way clustering analysis of breast cancer and colon cancer gene expression data,” Bioinformatics, vol. 19, no. 9, pp. 1079–1089, 2003. [9] P. Ferragina and A. Gulli, “A personalized search engine based on web-snippet hierarchical clustering,” in Special interest tracks and posters of the 14th international conference on World Wide Web, pp. 801–810, 2005. [10] U. Maulik and S. Bandyopadhyay, “Genetic algorithm-based clustering technique,” Pattern Recognition, vol. 33, no. 9, pp. 1455–1465, 2000. [11] X. Cui, T. E. Potok, and P. Palathingal, “Document clustering using particle swarm optimization,” in Proceedings of the IEEE Swarm Intelligence Symposium, pp. 185–191, Institute of Electrical and Electronics Engineers, 2005. [12] K. Krishna and M. N. Murty, “Genetic k-means algorithm,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 29, pp. 433–439, 1999. [13] D. W. V. D. Merwe and A. P. Engelbrecht, “Data clustering using particle swarm optimization,” in Proceedings of the 2003 IEEE Congress on Evolutionary Computation, vol. 1, pp. 215–220, 2003. [14] R. Kicinger, T. Arciszewski, and K. D. Jong, “Evolutionary computation and structural design: A survey of the state-of-the-art,” Computers & Structures, vol. 83, no. 23, pp. 1943–1978, 2005. [15] T. Bäck, Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms. Oxford University Press, 1996. [16] T. Bäck and H.-P. Schwefel, “An overview of evolutionary algorithms for parameter optimization,” Evolutionary Computation, vol. 1, no. 1, pp. 1–23, 1993. [17] W. M. Spears, K. A. D. Jong, T. Bäck, D. B. Fogel, and H. D. Garis, “An overview of evolutionary computation,” in Proceedings of the 1993 European Conference on Machine Learning, pp. 442–459, Springer, 1993. [18] K.-H. Han and J.-H. Kim, “Quantum-inspired evolutionary algorithm for a class of combinatorial optimization,” IEEE Transactions on Evolutionary Computation, vol. 6, no. 6, pp. 580–593, 2002. [19] J. H. Holland, Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence. University of Michigan Press, 1975. [20] L. J. Fogel, A. J. Owens, and M. J. Walsh, Artificial intelligence through simulated evolution. John Wiley & Sons, Inc., 1966. [21] H.-P. P. Schwefel, Evolution and optimum seeking: the sixth generation. John Wiley & Sons, Inc., 1993. [22] J. R. Koza, Genetic programming: on the programming of computers by means of natural selection, vol. 1. MIT press, 1992. [23] P. J. Bentley, T. G. W. Gordon, J. Kim, and S. Kumar, “New trends in evolutionary computation,” in Proceedings of the 2001 IEEE Congress on Evolutionary Computation, vol. 1, pp. 162–169, Institute of Electrical and Electronics Engineers, 2001. [24] W. Zhou, C. Zhou, Y. Huang, and Y. Wang, “Analysis of gene expression data: application of quantum-inspired evolutionary algorithm to minimum sum-of-squares clustering,” in Proceedings of the 10th International Conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing, pp. 383–391, Springer, 2005. [25] D. H. Wolpert and W. G. Macready, “No free lunch theorems for optimization,” IEEE Transactions on Evolutionary Computation, vol. 1, no. 1, pp. 67–82, 1997. [26] C. Blum and A. Roli, “Metaheuristics in combinatorial optimization: Overview and conceptual comparison,” ACM Computing Surveys (CSUR), vol. 35, pp. 268–308, September 2003. [27] R. Xu and D. Wunsch, “Survey of clustering algorithms,” IEEE Transactions on Neural Networks, vol. 16, no. 3, pp. 645–678, 2005. [28] J. MacQueen, “Some methods for classification and analysis of multivariate observations,” in Proceedings of the fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281–297, University of California Press, 1967. [29] J. Xiao, Y. Yan, J. Zhang, and Y. Tang, “A quantum-inspired genetic algorithm for k-means clustering,” Expert Systems with Applications, vol. 37, no. 7, pp. 4966–4973, 2010. [30] D. E. Goldberg, Genetic algorithms in search, optimization, and machine learning, vol. 412. Addison-Wesley Professional, 1989. [31] A. Narayanan, “Quantum computing for beginners,” in Proceedings of the 1999 IEEE Congress on Evolutionary Computation, vol. 3, pp. 2231–2238, 1999. [32] M. A. Nielsen and I. L. Chuang, Quantum computation and quantum information. Cambridge university press, 2010. [33] C. H. Bennett, G. Brassard, C. Crépeau, R. Jozsa, A. Peres, and W. K. Wootters, “Teleporting an unknown quantum state via dual classical and Einstein-Podolsky-Rosen channels,” Physical Review Letters, vol. 70, pp. 1895–1899, March 1993. [34] C. H. Bennett, F. Bessette, G. Brassard, L. Salvail, and J. Smolin, “Experimental quantum cryptography,” Journal of Cryptology, vol. 5, no. 1, pp. 3–28, 1992. [35] A. M. Turing, “On computable numbers, with an application to the Entscheidungsproblem,” Proceedings of the London Mathematical Society, vol. 2, no. 42, pp. 230–265, 1936. [36] R. Landauer, “Irreversibility and heat generation in the computing process,” IBM Journal of Research and Development, vol. 5, pp. 183–191, July 1961. [37] C. H. Bennett, “Logical reversibility of computation,” IBM journal of Research and Development, vol. 17, pp. 525–532, November 1973. [38] P. Benioff, “The computer as a physical system: A microscopic quantum mechanical Hamiltonian model of computers as represented by Turing machines,” Journal of Statistical Physics, vol. 22, no. 5, pp. 563–591, 1980. [39] P. Benioff, “Quantum mechanical models of Turing machines that dissipate no energy,” Physical Review Letters, vol. 48, no. 23, pp. 1581–1585, 1982. [40] R. P. Feynman, “Simulating physics with computers,” International Journal of Theoretical Physics, vol. 21, no. 6, pp. 467–488, 1982. [41] C. H. Bennett and R. Landauer, “The fundamental physical limits of computation,” Scientific American, vol. 253, no. 1, pp. 48–56, 1985. [42] D. Deutsch, “Quantum theory, the Church-Turing principle and the universal quantum computer,” Proceedings of the Royal Society of London, vol. 400, no. 1818, pp. 97–117, 1985. [43] D. Deutsch, “Quantum computational networks,” Proceedings of the Royal Society of London, vol. 425, no. 1868, pp. 73–90, 1989. [44] D. Deutsch and R. Jozsa, “Rapid solution of problems by quantum computation,” Proceedings of the Royal Society of London, vol. 439, no. 1907, pp. 553–558, 1992. [45] P. W. Shor, “Algorithms for quantum computation: discrete logarithms and factoring,” in Proceedings of the 35th Annual Symposium on Foundations of Computer Science, pp. 124–134, Institute of Electrical and Electronics Engineers, 1994. [46] D. R. Simon, “On the power of quantum computation,” Society for Industrial and Applied Mathematics Journal on Computing (SICOMP), vol. 26, no. 5, pp. 1474–1483, 1994. [47] L. K. Grover, “A fast quantum mechanical algorithm for database search,” in Proceedings of the twenty-eighth annual ACM symposium on Theory of computing, pp. 212–219, The Association for Computing Machinery, 1996. [48] M. Moore and A. Narayanan, “Quantum-inspired computing,” 1995. [49] T. Hey, “Quantum computing: an introduction,” Computing & Control Engineering Journal, vol. 10, no. 3, pp. 105–112, 1999. [50] A. O. Pittenger, An Introduction to Quantum Computing Algorithms, vol. 19. Birkhäuser, 1999. [51] J. Preskill, “Lecture notes for physics 229: Quantum information and computation,” 1998. [52] A. Narayanan and M. Moore, “Quantum-inspired genetic algorithms,” in Proceedings of the 1996 IEEE International Conference on Evolutionary Computation, pp. 61–66, Institute of Electrical and Electronics Engineers, IEEE Press, 1996. [53] K.-H. Han and J.-H. Kim, “Quantum-inspired evolutionary algorithms with a new termination criterion, Hε gate, and two-phase scheme,” IEEE Transactions on Evolutionary Computation, vol. 8, no. 2, pp. 156–169, 2004. [54] J. Sun, W. Xu, and B. Feng, “A global search strategy of quantum-behaved particle swarm optimization,” in Proceedings of the 2004 IEEE Conference on Cybernetics and Intelligent Systems, vol. 1, pp. 111–116, Institute of Electrical and Electronics Engineers, 2004. [55] Y. Li, Y.-N. Zhang, R.-C. Zhao, and L.-C. Jiao, “An edge detector based on parallel quantum-inspired evolutionary algorithm,” in Proceedings of the 2004 International Conference on Machine Learning and Cybernetics, vol. 7, pp. 4062–4066, Institute of Electrical and Electronics Engineers, August 2004. [56] Y. Li, Y.-N. Zhang, R.-C. Zhao, and L.-C. Jiao, “The immune quantum-inspired evolutionary algorithm,” in Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics, vol. 4, pp. 3301–3305, Institute of Electrical and Electronics Engineers, 2004. [57] J. Sun, W. Xu, and B. Ye, “Quantum-behaved particle swarm optimization clustering algorithm,” in Advanced Data Mining and Applications, vol. 4093, Springer, 2006. [58] W. Chen, J. Sun, Y. Ding, W. Fang, and W. Xu, “Clustering of gene expression data with quantum-behaved particle swarm optimization,” in New Frontiers in Applied Artificial Intelligence, vol. 5027 of Lecture Notes in Computer Science, pp. 388–396, Springer, 2008. [59] J. Xiao, Y. Yan, Y. Lin, L. Yuan, and J. Zhang, “A quantum-inspired genetic algorithm for data clustering,” in Proceedings of the 2008 IEEE Congress on Evolutionary Computation, pp. 1513–1519, Institute of Electrical and Electronics Engineers, 2008. [60] S. Li and H. Li, “Quantum immune evolutionary algorithm with application in clustering,” Journal of Information & Computational Science, vol. 9, no. 5, pp. 1167–1174, 2012. [61] K. Bache and M. Lichman, “UCI machine learning repository,” 2013. [62] K. L. Priddy and P. E. Keller, Artificial neural networks: an introduction, vol. 68. SPIE Press, 2005. |
電子全文 Fulltext |
本電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。 論文使用權限 Thesis access permission:自定論文開放時間 user define 開放時間 Available: 校內 Campus:永不公開 not available 校外 Off-campus:永不公開 not available 您的 IP(校外) 位址是 3.141.100.120 論文開放下載的時間是 校外不公開 Your IP address is 3.141.100.120 This thesis will be available to you on Indicate off-campus access is not available. |
紙本論文 Printed copies |
紙本論文的公開資訊在102學年度以後相對較為完整。如果需要查詢101學年度以前的紙本論文公開資訊,請聯繫圖資處紙本論文服務櫃台。如有不便之處敬請見諒。 開放時間 available 永不公開 not available |
QR Code |