眼控系統之發展已有時日，牽涉技術含訊號�影像處理、人臉特徵辨識、即時追蹤、及動作指令編碼。而在實作方法亦有憑藉特殊機械獲取資訊，與利用泛用儀器來達成。其應用範圍包括軍事、醫護、娛樂、和其他適用工作等。效能上由於操作環境之狀況及使用者個體差異而有不同表現。

　　本論文所提之眼位追蹤系統，乃以目前普遍的PC Camera擷取使用者平面影像，再整合橢圓頭部模型、眼部雙態偵測、可變型樣板比對、型變濾波器等各項處理分析技術，用逐步逼近的策略縮小搜尋範圍來追蹤眼部狀態以執行各種操作，結果顯示本演算法具有其強健度與速度。本系統將有助於殘障朋友或不適合使用一般輸入方法作為控制方法的場所。

　　It has been for a long time to develop systems of eye control, which are related to a variety of techniques, such as signal/image processing, characteristics of face identifying/tracking, action-mappings, etc. In terms of implementations, the acquisition of data can be done by either special instruments or by general devices. Such systems can be applied to many fields, for instance, military, medicine, entertainments, and other tasks that are fitted. And for the similar system, the performance differs due to the disparity of distinct situations and the way to use it.

　　In this thesis, we present a system that takes a sequence of images of a user as inputs, and then integrates methods of elliptical model of head, dual states of eyes, deformable templates, and the most yield filter to track the user’s eyes. A coarse-to-fine strategy is used to rapidly locate the region of eyes and to get the information of eyes in order to translate into corresponding operations on machines. The experiment shows that our system is quite robust and fast so that it can help people who are unable to use physical body well.

封面
誌謝
摘要
中文摘要 Ⅰ
Abstract Ⅱ
目錄 Ⅲ
圖表目錄 Ⅴ
表格目錄 Ⅶ
前言 1-01
預備知識 2-01
2.1 色彩空間 2-01
RGB 2-01
YMC 2-02
YCbCr 2-03
YIQ 2-04
色度/彩度/亮度 2-04
2.2 影像空間 2-07
空間域 2-07
頻域 2-07
2.3 影像處理技術 2-09
去雜訊 2-09
邊緣偵測 2-10
物件切割 2-12
相關研究 3-01
3.1 資料擷取 3-01
眼電圖法 3-01
磁線圈法 3-01
角膜反射法 3-02
3.2 頭部搜尋 3-03
橢圓頭部追蹤 3-03
3D頭部模型 3-03
3.3 眼部搜尋 3-05
霍夫轉換 3-05
可變形樣版 3-08
型變濾波器 3-11
3.4 其他方法 3-14
系統架構 4-01
4.1 整體架構 4-01
4.2 臉部定位 4-01
HS分支處理 4-01
V分支處理 4-03
橢圓頭部比對 4-04
4.3 眼部區域 4-05
4.4 眼位偵測 4-07
4.5 眼位追蹤 4-08
簡化眼睛樣版 4-08
改良式型變濾波器 4-08
4.6 指令編碼 4-11
摩斯碼 4-11
摩斯簡易鍵盤 4-12
眼控簡易鍵盤 4-16
實驗結果 5-01
5.1 臉部偵測 5-01
5.2 眼位偵測 5-03
5.3 眼位追蹤 5-05
結論與展望 6-01
參考文獻 7-01

[1] 朱培申, 孫濱生, 韓振宗. 中國大百科《航空航天卷》
[2] 楊秀芝. "平視顯示器的設計," 福州大學學報(自然科學版) 28(4). 2000/8.
[3] 大紀元9月21日訊. 9/21/2001 12:26:00 PM. http://www.dajiyuan.com/
[4] Canon Camera Museum. http://www.canon.com/camera-museum/camera/f_camera.html
[5] 洪文斌, 陳志遠, 張懿, 范俊海. "A vision-based real-time driver fatigue detection system," 2002年第十五屆電腦視覺、圖學暨影像處理研討會論文集編號081. 新竹關西. 2002/8/25~27.
[6] 李賢輝. "多媒體科技在表演藝術及其教育上的運用," 一九九九年科技與人文對話
[7] "The eye mouse project," 2000/6/30. http://www.research.linst.ac.uk/eyemouse/
[8] 張凱傑. "眼控與頭控之人機介面系統研發與整合," 2000
[9] D. Nicklin. Xilinx公司策略解決方案市場部. http://www.eettaiwan.com/ART_8800235854_617717,876045.HTM
[10] 洪柏湘, 張雅惠, 陳婕方, 胡力文, 莊智皓, 謝沛宇. 台北市東湖國中. http://www.ntnu.edu.tw/art/tank/e_teacher/st_web/
[11] 王為豪. 夏威夷大學天文所. http://www.asiaa.sinica.edu.tw/whwang/randomwalk/8-13-2001-colors.html
[12] S. Kr. Singh, D. S. Chauhan, and M. Vatsa, R. Singh. "Comparison of two approaches of face detection algorithm in controlled background," Internet Journal ElectronicsLetters.com. 2003/1. http://www.electronicsletters.com/papers/2003/0001/paper.asp
[13] R. C. Gonzalez and R. E. Woods. Digital Image Processing. Addision Wesley. 1993/9.
[14] A. Ford and A. Roberts. "Colour space conversions," 1998/8/11.
[15] 何錦隆. 大中華印藝網. http://www.cgan.com/book/books/print/cn-en_dict/indexcidian/
[16] D. Marshall. 1994-1997. http://www.cs.cf.ac.uk/Dave/Vision_lecture/
[17] R. Fisher, S. Perkins, A. Walker, and E. Wolfart. "Image analysis - connected components labeling," http://www.dai.ed.ac.uk/HIPR2/label.htm
[18] T. E. Hutchinson. "Computers that sense eye position on the display," Computer 26(7): 65-67. 1993/7.
[19] G. Norris and E. Wilson. "The eye mouse, an eye communication device," Proceedings of the IEEE 1997 23rd Northeast Bioengineering Conference, pp. 66-67. 1997.
[20] J. H. J. Allum, F. Honegger, and M. Troescher. "Principle underlying real-time nystagmus analysis of horizontal and vertical eye movements recorded with electro-, infra-red-, or video-occulographic techniques," Journal of Vestibular Research 8(6). 1998.
[21] A. E. Kaufman, A. Bandopadhay, and B. D. Shaviv. "An eye tracking computer user interface," Research Frontier in Virtual Reality Workshop Proceedings, IEEE Computer Society Press, pp. 120-121. San Jose, CA , USA. 1993/10/25~26.
[22] H. Kaspar and B. J. Hess. "Magnetic search coil system for linear detection of three-dimensional angular movements," Biomedical Engineering, IEEE Transactions 38(5): 466-475. 1991/5.
[23] A. O. DiScenna, V. Das, A. Z. Zivotofsky, S. H. Seidman, and R. J. Leigh. "Evaluation of a video tracking device for measurement of horizontal and vertical rotations during locomotion," Journal of Neuroscience Methods, 58: 89-94. 1995.
[24] 簡志忠. "光學式瞳位追蹤器之人機介面系統研製," 逢甲大學自動控制工程學系碩士論文. 1998.
[25] M. Vezjak, J. Korosec, L. Gyergyek, N. Pavesic, T. Savek, I. Erjavc, and A. Gere. "System for description and identification of individuals," Proceedings of the 6th Mediterranean Electrotechnical Conference, 2: 1251-1254. 1991/5/22~24.
[26] R. Bulot, J. M. Boi, J. Sequeria, and M. Caprioglio. "Contour segmentation using Hough transform," Proceedings of the 1996 IEEE International Conference on Image Processing. 1996/9/16~19.
[27] L. Xin, X. Yanjun, and D. Limin, "Locating facialfeatures with color information," ICSP '98 Proceedings, 2. 1998.
[28] M. A. Shackleton and W. J. Welsh. "Classification of facial features for recognition," Proc. CVPR, pp. 573-579. 1991.
[29] C. L. Huang and C. W. Chen. "Human facial feature extraction for face interpretation and recognition," Pattern Recognition, 25(12): 1435-1444. 1992.
[30] A. Haro, M. Flickner, and I. Essa. "Detecting and tracking eyes by using their physiological properties, dynamics, and appearance," Proceedings of IEEE CVPR 2000, Hilton Head Island, South Carolina. 2000/6.
[31] S. H. Lin, Y. Chan, and S. Kung, "A probabilistic decision-based neural network for locating deformable objects and its applications to surveillance system and video browsing," International Conference on Acoustics, Speech and Signal Processing, 6: 3553-3556, 1996.
[32] H. C. Sim and R. I. Damper. "Two-dimensional object matching using Kohonen maps," Proceedings IEEE International Conference on Systems, Man and Cybernetics, 1: 620-625. Orlando, FL, USA. 1997/10/12~15.
[33] D. Devault and A. H. Bond. "A flexible eyetracker for psychological applications," Proceedings of the 5th IEEE Workshop on Applications of Computer Vision WACV2000, pp. 201-206. Palm Springs, CA, USA. 2000/12/4~6.
[34] T. Haslwanter and S. T. Moore. "A theoretical analysis of three-dimensional eye position measurement using polar cross-correlation," IEEE Transactions on biomedical engineering 42(11): 1053-1061. 1995.
[35] J. Ivins, J. Porrill, and J. P. Frisby. "A deformable model of the human iris driven by non-linear least-squares minimisation," The 6th International Conference on Image Processing and its Applications(IPA'97; Dublin, Ireland), 1: 234-238. 1997.
[36] W. J. Huang, B. C. Yin, C. Y. Jiang and J. Miao. "A new approach for eye feature extraction using 3D eye template," Proceedings of 2001 International Symposium on Intelligent Multimedia, Video & Speech Processing, pp. 340-343. Hong Kong. 2001/5/2~4.
[37] S. A. Samad, A. Hussain, and A. Teoh. "Eye detection using hybrid rule based approach and contour mapping," The 6th International Symposium on Signal Processing and its Appications(ISSPA), 2: 631-634. Kuala Lumpur, Malaysia. 2001/8/13~16.
[38] Y. Ebisawa, M. Ohtani, A. Sugioka, and S. Esaki. "Single mirror tracking system for free-head video-based eye-gaze detection method," Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1448-1451. Chicago, IL, USA. 1997/10/30~11/2.
[39] Y. Matsumoto, T. Ogasawara, and A. Zelinsky. "Behavior recognition based on head pose and gaze direction measurement," Proceedings of the 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000), 3: 2127-2132. 2000.
[40] Z. Liu and Z. Zhang. "Robust head motion computation by taking advantage of physical properties," IEEE Workshop on Human Motion (HUMO 2000), Austin, USA. 2000/12.
[41] R. S. Feris and R. M. Cesar Junior. "Tracking facial features using Gabor wavelet networks. computer graphics and image processing," pp. 22-27. Proceedings XIII Brazilian Symposium. Gramado, Brazil. 2000/10/17~20.
[42] S. Spors and R. Rabenstein. "A real-time face tracker for color video," IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), USA, Salt Lake City. 2001/5.
[43] R. L. Hsu, M. Abdel-Mottaleb, and A. K. Jain. "Face detection in color images," IEEE Trans. Pattern Analysis and Machine Intelligence 24(5): 696-706. 2002/5.
[44] C. A. Perez, A. Palma, C. A. Holzmann, and C. Pena. "Face and eye tracking algorithm based on digital image processing," 2001 IEEE International Conference on Systems, Man & Cybernetics, pp. 1178-1183. Tucson, Arizona, USA. 2001/10.
[45] 譚永??. "以數位影像處理技術做人臉自動追蹤系統之研究," 國立成功大學電機工程學系碩士論文. 2000.
[46] S. Birchfield. "An elliptical head tracker," Proceedings of the 31st Asilomar Conference on Signals, Systems, and Computers, pp. 1710-1714. Pacific Grove, California. 1997/11.
[47] S. Birchfield. "Elliptical head tracking using intensity gradients and color histograms," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 232-237. Santa Barbara, California. 1998/6.
[48] A. Bottino. "Real time head and facial features tracking from uncalibrated monocular views," Proceedings of the 5th Asian Conference on Computer Vision (ACCV 2002), Melbourne, Australia. 2002/1/23~25.
[49] 林宸生. "圖形轉換--霍氏轉換與曲線偵測," http://cslin.auto.fcu.edu.tw/scteach/mech/media/media01.html
[50] P. V. C. Hough. "A method and means for recognizing complex patterns," U. S. Patent 3, 069, 654. 1962
[51] R. O. Duda and P. E. Hart. "Use of the Hough transformation to detect lines and curves in pictures," Communications of the ACM, 15(1): 11-15. 1972/1.
[52] 張向勻. "霍氏轉換於圓偵測之應用," http://nova.bime.ntu.edu.tw/~ttlin/Course01/examples/c1project_example10.htm
[53] 黃銘裕. "眼位追蹤: 型變濾波器," 國立成功大學電機工程學系碩士論文. 2001.
[54] A. L. Yuille, D. S. Cohen, and P. W. Hallinan. "Feature extraction from faces using deformable templates," IEEE Proc. of Computer Vision and Pattern Recognition (CVPR `89), pp. 104-109. Washington, DC. 1989/6.
[55] S. Baskan, M. M. Bulut, and V. Atalay. "Projection based method for segmentation of human face and its evaluation," Pattern Recognition Letters 23(14): 1623-1629. 2002/12.
[56] G. Chow and X. Li. "Towards a system for automatic facial feature detection," Pattern Recognition, 26(12): 1739-1755. 1993.
[57] J. Deng and F. Lai. "Region-based template deformation and masking for eye-feature extraction and description," Pattern Recognition, 30(3): 403-419, 1997/3.
[58] K. Lam and H. Yan. "Locating and extracting the eye in human face images," Pattern Recognition, 29(5): 771-779. 1996.
[59] X. Xie, R. Sudhakar, and H. Zhuang. "On improving eye feature extraction using deformable templates," Pattern Recognition, 27(6): 791-799. 1994.
[60] A. L. Yuille, P. Hallinan, and D. S. Cohen. "Feature extraction from faces using deformable templates," International Journal of Computer Vision 8(2): 99-111. 1992.
[61] T. Kawaguchi, D. Hidaka, and M. Rizon. "Detection of eyes from human faces by Hough transform and separability filter," 2000 International Conference on Image Processing, IEEE. 2000/9/11.
[62] T. Kawaguchi, D. Hidaka, and M. Rizon. "Robust extraction of eyes from face," Proceedings of 15th International Conference on Pattern Recognition. IEEE Computer Society Press, 1: 1109-1114. 2000/9/3~7.
[63] R. H. S. Carpenter. Movements of the eyes, Pion Limited, London. 1977.
[64] S. E. Umbaugh. Computer vision and image processing : a practical approach using CVIPtools. Prentice Hall PTR. Upper Saddle River, New Jersey. 1998.
[65] J. M. Coughlan, A. L. Yuille, C. English, and D. Snow. "Efficient optimization of a deformable template using dynamic programming," IEEE Proc. of Computer Vision and Pattern Recognition (CVPR `98), pp. 747-752. Santa Barbara, CA, USA. 1998/6/23~25
[66] B. Fisher. "2-D deformable template models: a review," 1999/5/5. http://www.dai.ed.ac.uk/CVonline/LOCAL_COPIES/ZHONG1/zhong.html
[67] J. Yang, R. Stiefelhagen, U. Meier, and A. Waibel. "Real-time face and facial feature tracking and applications," Proceedings of Auditory-Visual Speech Processing (AVSP'98), pp. 79-84. 1998. http://www.ri.cmu.edu/pubs/pub_2973.html
[68] S. Kawato and J. Ohya. "Real-time detection of nodding and head-shaking by directly detecting and tracking the "between-eyes"," Proceedings of IEEE 4th International Conference on Automatic Face and Gesture Recognition, pp. 40-45. 2000/5/28~30. http://www.mis.atr.co.jp/~skawato/indexE.html
[69] V. Govindaraju, S. N. Srihari, and D. Sher. "A computational model for face location based on cognitive principles," Proceedings of the 10th National Conference on Artificial Intelligence(AAAI'92), 1:350-355. 1992.
[70] Y. Tian, T. Kanade, and J. Cohn. "Multi-state based facial feature tracking and detection," Technical Report CMU-RI-TR-99-18, Robotics Institute, Carnegie Mellon University. 1999/8. http://www.ri.cmu.edu/people/person_49_pubs_text.html
[71] 謝明哲, 羅錦興. 摩斯簡易鍵盤. 中華民國專利, 公告卷數: 028, 公告期數: 030, 權證書號: 000000, 專利申請日期: 1999/2/12.