Responsive image
博碩士論文 etd-0701103-120712 詳細資訊
Title page for etd-0701103-120712
論文名稱
Title
虛擬滑鼠:以視覺為基礎之手勢辨識
Virtual Mouse:Vision-Based Gesture Recognition
系所名稱
Department
畢業學年期
Year, semester
語文別
Language
學位類別
Degree
頁數
Number of pages
85
研究生
Author
指導教授
Advisor
召集委員
Convenor
口試委員
Advisory Committee
口試日期
Date of Exam
2003-06-30
繳交日期
Date of Submission
2003-07-01
關鍵字
Keywords
人機介面、手勢辨識、以視覺為基礎之方法、虛擬滑鼠
gesture recognition, human-computer interaction, virtual mouse, vision-based methods
統計
Statistics
本論文已被瀏覽 5701 次,被下載 2768
The thesis/dissertation has been browsed 5701 times, has been downloaded 2768 times.
中文摘要
本論文係採用以視覺為基礎之方法進行手勢辨識之研究。與之前大部分研究不同之處在於,本研究是在手上不標記任何顏色記號及不穿戴任何膚色手套或感應裝置之情形下,單靠一台彩色CCD攝影機擷取手勢影像,對手勢進行分析工作。實作方法及操作步驟分為以下五個部份進行:(1)透過CCD取像系統擷取連續手勢影像、(2)將手勢從影像中分離出來、(3)擷取特徵資訊辨識手勢動作、(4)決定手勢動作所代表之滑鼠事件、(5)傳送訊息控制系統滑鼠動作。首先以一台彩色CCD攝影機攝取手勢影像;接著利用膚色模型將手勢區域從影像中分離出來;再針對分離出來的手勢影像進行辨識;最後根據連續影像之前後關係,分析與判斷手勢動作所代表之意義,並轉換成系統控制訊息,然後呼叫系統之滑鼠事件函式觸發滑鼠動作事件,達成由手勢控制滑鼠之目的。本論文之研究目標,首先是要提高滑鼠手勢辨識正確率及辨識速度,最後實作出一虛擬滑鼠手勢輸入介面系統應用於電腦操控上。
Abstract
The thesis describes a method for human-computer interaction through vision-based gesture recognition and hand tracking, which consists of five phases: image grabbing, image segmentation, feature extraction, gesture recognition, and system mouse controlling. Unlike most of previous works, our method recognizes hand with just one camera and requires no color markers or mechanical gloves. The primary work of the thesis is improving the accuracy and speed of the gesture recognition. Further, the gesture commands will be used to replace the mouse interface on a standard personal computer to control application software in a more intuitive manner.
目次 Table of Contents
中文摘要...............................................Ⅰ
ABSTRACT...........................................Ⅱ
目錄.......................................................Ⅲ
圖目錄...................................................Ⅳ
表目錄...................................................Ⅶ

第一章 簡介..................................................1
 第一節 序論..............................................1
 第二節 相關研究......................................8
 第三節 研究目的.....................................26

第二章 基本理論.........................................27
 第一節 手勢定義.....................................27
 第二節 影像分割.....................................30
 第三節 特徵擷取.....................................37
 第四節 手勢分析.....................................42

第三章 研究方法、步驟與結果.................48
 第一節 取像環境.....................................49
 第二節 校正工作.....................................50
 第三節 影像分割.....................................54
 第四節 特徵擷取與分析.........................57
 第五節 滑鼠控制.....................................72

第四章 結論.................................................78

第五章 參考文獻.........................................81
參考文獻 References
英文文獻
[1] Ying Wu and T. S. Huang, “Hand modeling, analysis and recognition,” IEEE Signal Processing, vol.18, no.3, pp.51-60, May 2001.

[2] D. J. Sturman and D. Zeltzer, “A survey of glove-based input,” IEEE Computer Graphics and Appl., pp.30-39, 1994.

[3] J. J. Kuch and T. S. Huang, “Vision based hand modeling and tracking for virtual teleconference and telecollaboration,” ICCV, pp.666-671, 1995.

[4] J. M. Rehg and T. Kanade, “DigitEyes:vision-based hand tracking for human-computer interaction,” IEEE Workshop on Motion of Non-Rigid and Articulated Objects, pp.16-22, Nov. 1994.

[5] J. Davis and M. Shah, “Visual gesture recognition,” Proc. of IEE on Vision, Image and Signal Processing, Vol.141, pp.101-106, Apr. 1994.

[6] Wei Du and Hua Li, “Vision based gesture recognition system with single camera,” Proc. of ICSP2000, vol.2, pp.1351-1357, 2000.

[7] C. L. Huang and S. H. Jeng, “A model-based hand gesture recognition system,” Machine Vision and Appl., vol.12, pp.243-258, 2001.

[8] T. S. Huang, Ying Wu, and John Lin, “3D model-based visual hand tracking,” Proc. of the 2002 IEEE Int. Conf. on Multimedia and Expo, vol.1, pp.905-908, 2002.

[9] Y. Yasumuro, Qian Chen, and K. Chihara, “3D modeling of human hand with motion constraints,” Proc. of the Int. Conf. on 3-D Digital Imaging and Modeling, pp.275-282, May 1997.

[10] Jintae Lee and T. L. Kunii, “Model-based analysis of hand posture,” IEEE Computer Graphics and Appl., vol.15, no.5, pp.77-86, Sep. 1995.

[11] C. C. Lien and C. L. Huang, “Model-based articulated hand motion tracking for gesture recognition,” Image and Vision Computing, vol.16, no.2, pp.121-134, 1998.

[12] C. C. Lien and C. L. Huang, “The model based dynamic hand posture identification using genetic algorithm,” Machine Vision and Appl., vol.11, pp.107-121, 1999.

[13] Ying Wu and T. S. Huang, “Capturing articulated human hand motion: A divide-and-conquer approach,” Proc. of IEEE Int. Conf. on Computer Vision, pp.606-611, Sep.1999.

[14] F. Lathuiliere and J.-Y. Herve, “Visual tracking of hand posture with occlusion handling,” Proc. of the 15th Int. Conf. on Pattern Recognition, vol.3, pp.1129-1133, 2000.

[15] Shinn-Ying Ho, Zhen-Bang Huang, and Shinn-Jang Ho, “An evolutionary approach for pose determination and interpretation of occluded articulated objects,” Proc. of the 2002 Congress on Evolutionary Computation, vol.2, pp.1092-1097, 2002.

[16] J. M. Rehg and T. Kanade, “Model-based tracking of self-occluding articulated objects,” Proc. of the 5th Int. Conf. on Computer Vision, pp.612-617, June 1995.

[17] Y. Sato, M. Saito, and H. Koike, “Real-time input of 3D pose and gestures of a user's hand and its applications for HCI,” Proc. of IEEE on Virtual Reality, pp.79-86, 2001.

[18] A. Utsumi and J. Ohya, “Multiple-hand-gesture tracking using multiple cameras,” IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, vol.1, pp.473-478, 1999.

[19] Lae Kyoung Lee, Sungshin Kim, Young-Kiu Choi, and Man Hyung Lee, “Recognition of hand gesture to human-computer interaction,” The 26th Annual Conf. of IEEE on Industrial Electronics Society, vol.3, pp.2117-2122, 2000.

[20] Y. Sato, Y. Kobayashi, and H. Koike, “Fast tracking of hands and fingertips in infrared images for augmented desk interface,” Proc. of the 4th IEEE Int. Conf. on Automatic Face and Gesture Recognition(FG 2000), pp.462-467, 2000.

[21] M. V. Lamar and M. Shoaib, “Temporal series recognition using a new neural network structure T-CombNET,” Proc. of the 6th IEEE ICONIP’99, vol.3, pp.1112–1117, 1999.

[22] L. Bretzner, I. Laptev, and T. Lindeberg, “Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering,” Proc. of the 5th IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp.405-410, May 2002.

[23] B. W. Min and H. S. Yoon, “Hand gesture recognition using hidden Markov models Systems,” Proc. of IEEE Int. Conf. on Computational Cybernetics and Simulation, vol.5, pp.4232–4235, 1997.

[24] W. T. Freeman, D. B. Anderson, P. Beardsley, C. N. Dodge, M. Roth, C. D. Weissman, W. S. Yerazunis, H. Kage, I. Kyuma, Y. Miyake, and K. Tanaka, “Computer vision for interactive computer graphics,” IEEE Computer Graphics and Appl., vol.18, pp.42-53, May/June 1998.

[25] Andrew Wilson and Nuria Oliver, “GWindows:towards robust perception-based UI,” Proc. of CVPR 2003, 2003.

[26] Benjamin D. Zarit, “Skin detection in video images,” the master thesis, Vision Interfaces and Systems Laboratory, Electrical Engineering and Computer Science Department, The University of Illinois at Chicago, 1999.

[27] D. B. Gennery, “Object detection and measurement using stereo vision,” Proc. of ARPA Image Understanding Workshop, pp.217-253, 1980.

[28] A. Witkin, D. Terzopoulos, and M. Kass, “Signal Matching through Scale Space,” Int. Journal on Computer Vision, vol.1, pp.231-258, 1987.

[29] D. Marr and E. Hildreth, “Theory of edge detection, ” Proc. Royal Soc. London, vol.B207, pp.187-217, 1980.

[30] I. C. Chang and C. L. Huang, “Skeleton-based walking motion analysis using Hidden Markov Model and Active Shape Models,” JISE, vol.17, pp.371-403, 2001.

[31] J. Hu, M. K. Brown, and W. Turin, “HMM based on-line handwriting recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.18, no.10, pp.1039-1045, 1996.

[32] J. Yamato, J. Ohya, and K. Ishii, “Recognizing human action in time-sequential images using hidden Markov model,” Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp.379-385, 1992.

[33] T. Starner and A. Pentland, “Visual recognition of American sign language using hidden Markov models,” Int. Workshop on Automatic Face and Gesture Recognition, pp.189-194, 1995.

[34] F. Samaria and S. Young, “HMM-based architecture for face identification,” Image and Vision Computing, vol.12, no.8, pp. 537-543, 1994.


中文文獻
[A] 王國榮,基於資料手套的智慧型手勢辨識之廣泛研究,碩士論文,國立台灣科技大學電機工程所,台北,民國90年。

[B] 范揚平,電腦簡報系統中以手勢替代滑鼠做操控功能,碩士論文,國立交通大學資訊工程學系,新竹,民國86年。

[C] 黃仲陵,聽障者電腦輔具之相關技術的研發,國科會研究計畫,國立清華大學電機工程學系,新竹,民國86年。

[D] 蔡騰興,影像分割技術之深入探討及摭拾,碩士論文,國立台灣海洋大學電機工程學系,基隆,民國89年。
電子全文 Fulltext
本電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。
論文使用權限 Thesis access permission:校內校外完全公開 unrestricted
開放時間 Available:
校內 Campus: 已公開 available
校外 Off-campus: 已公開 available


紙本論文 Printed copies
紙本論文的公開資訊在102學年度以後相對較為完整。如果需要查詢101學年度以前的紙本論文公開資訊,請聯繫圖資處紙本論文服務櫃台。如有不便之處敬請見諒。
開放時間 available 已公開 available

QR Code