傳統人機互動多僅狹隘定義為促進人類與機器設備之溝通，人機互動之速度與自然程度受限，須將意圖透過符號指令及圖示點選等中介形式表達，現今發展趨勢則將焦點轉移至以人為中心之人機互動，更直覺地進行計算、判斷與顯示，其方法與樣式亦推陳出新，體感設備不只突破人與機器之互動限制，更跳脫以往傳統設備互動模式，透過紅外線或可見光攝影機擷取影像，進而捕捉人體運動姿勢與行為，使人機互動方式更自然且直覺。惟現今系統均限於單一應用範疇，僅能針對特定動作序列進行偵測，一旦人機互動應用改變，便須依體感需求，重新撰寫各動作序列之辨識程式，無法視使用者應用需求彈性定義人體動作序列，製作程序複雜且適用範疇較為狹隘。
本文針對上述缺失提出以視覺為基礎之體感動作編寫工具(ATVISA)，使用者可透過圖形化介面，自行定義人體動作序列，迅速客製化視覺偵測及辨識之體感動作，由下層體感硬體針對設定之動作序列進行偵測後，視應用需求觸發對應事件並加以處理。本文則將ATVISA應用至動作序列與三項復健項目，系統具備彈性與多樣化，而使用者更可以自身專業知識為基礎編寫人體動作序列，應用於教育、運動、遊戲與復健等多種領域。

Human-Computer Interaction (HCI) in tradition is narrow defined the communication of information between human and machines. Because the limited of the HCI's speed and the natural level, it needs to use the medium form such as symbol instructions and buttons to express the intent of human. In recent year, the trend of HCI development will be focused on human, with directly computing, determining, and displaying technologies progress, and constantly innovation. Somatosensory equipment not only breaks through the limit of HCI but also the mode of interaction of traditional equipment. Somatosensory equipment can retrieve images through the infrared projector or visible camera, capture the human motion and action, and increase its interaction for natural and intuition. But unfortunately, most of systems are limited to a unique application for special areas, and only detected specific sequences of actions. Once changing the interaction of applications then users have to rewrite the action sequences recognition program to satisfy the somatosensory demands. System cannot be defined human action sequences flexible according the applications request of users, the production process is complex and the scope of application is narrow.
This thesis presents an Authoring Tool of Vision-based Somatosensory Action (ATVISA) to improve the drawback. Users can define the human action sequences by the graphical interface, customize the visual detection quickly and recognize correspond to the Somatosensory Action. Till the Somatosensory equipment detects the defined action sequences, triggering the correspond event and dealing with the event request. This thesis employs ATVISA applied to the action sequences and three rehabilitation projects, that with the flexibility and diversification. Users also can compile human action sequences with professional expertise to application to area of education, game, rehabilitation, and so on.

論文審定書 iii
摘要 iv
Abstract v
目錄 vi
圖目錄 vii
表目錄 viii
第一章 簡介 1
1.1背景及目的 1
1.2復健類型 3
第二章 相關研究 5
2.1 kinect應用 5
2.2編寫工具應用 9
2.3設備 10
第三章 以視覺為基礎之體感動作編寫工具 14
3.1 ATVISA架構 14
3.2 ATVISA概念 15
3.2.1靜態姿勢 17
3.2.2單元力量 22
3.2.3人體動作序列 25
3.3 動作評估 30
3.3.1人體關節比例關係 31
3.3.2位置與擺動幅度 32
3.3.3速度與連續程度 34
第四章 ATVISA之應用 36
4.1 ATVISA之運動動作序列 36
4.2 ATVISA之復健應用 45
4.2.1復健環境 46
4.2.2跑步機 46
4.2.3肩輪 48
4.2.4拉棒運動 51
第五章 結論與展望 54
參考資料 55

[1]鄭詠澤，”智慧化居住空間創新應用整合案例-人機互動技術：科技化的念力，”工業技術與資訊月刊200期，2008。
[2]Y.C. Ho, "The No Free Lunch theorem and the Human Machine Interface", IEEE. Control Systems Magazine, vol. 19, pp. 8-10, June 1999.
[3]K. T. Tseng, W. F. Huang, and C. H. Wu, "Vision-based finger guessing game in human machine interaction," Proceedings of IEEE International Conference on Robotics and Biomimetics(ROBIO), Kunming, China, December 17-20, 2006, pp. 619-624.
[4]V. Pavlovic, R. Sharma and T.S. Huang, "Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review, " IEEE Transactions on Pattern Analysis and Machine Intelligence(PAMI), vol. 19, pp. 677-695, 1997.
[5]V. Pavlovic, R. Sharma and T.S. Huang, "Toward multimodal human-computer interface, " Proceedings of the IEEE, vol. 86, pp. 853-869, 1998.
[6]E.S. Santos, "Interaction in Augmented Reality Environments Using Kinect, " Proceedings of 2011 XIII Symposium on Virtual Reality (SVR), pp. 112 - 121, 2011.
[7]M. Argyle, "The communication of inferior and superior attitudes by verbal and nonverbal signal," British Journal of Social and Clinical Psychology, vol. 9, pp. 222-231, Sep. 1970.
[8]R. Poppe,"Vision-based human motion analysis: An overview", Computer Vision and Image Understanding(CVIU), vol.108, pp.4-18, 2007.
[9]Kinect for Windows SDK中文官方。
[10]A. Agarwal, B. Triggs, "Recovering 3D human pose from monocular images, "IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 28, pp. 44-58, Jan 2006. [11]Y.H. Chang, "Interactive boxing motion sensing game system, " Proceedings of Conference on Electrical and Control Engineering (ICECE), Sept., 2011, pp. 3043-3046.
[12]A.S. Shminan, "Student Awareness Model based on Student Affective Response and Generic Profiles, " Proceedings of 2012 IEEE International Conference on Information Science and Technology(ICIST), pp. 675-681, Wuhan, Hubei, China, March 23-25, 2012.
[13]H. Hai, " Interaction System of Treadmill Games based on Depth Maps and CAM-Shift," Proceedings of International Conference on Communication Software and Networks (ICCSN), May, 2011, pp. 219-222.
[14]C. Schonauer, "Chronic Pain Rehabilitation with a Serious Game using Multimodal Input, " Proceedings of International Conference on Virtual Rehabilitation 2011(ICVR), ETH Zurich Science City, Switzerland, June 27 - 29, 2011, pp. 1-8.
[15]Y.J. Changa, S.F. Chen, J.D. Huang, "A Kinect-based system for physical rehabilitation: A pilotstudy for young adults with motor disabilities," Research in Developmental Disabilities, vol. 32, pp. 2566-2570, Dec 2011.
[16]Wikipedia，authoring tool。
[17]N. Dabbagh, "Authoring Tools and Learning Systems: A Historical Perspective., " Proceedings of Selected Research and Development Paper Presentations. A publication of the Research and Theory Division of the Association for Educational Communications and Technology(AECT), AECT 2001, Atlanta, Georgia, USA, 2001.
[18]J. Hedberg, B. Harper, "Visual metaphors and authoring, " ITFORUM, 1998.
[19]蘇宗柏，陳思遠，王亭貴，王顏和，連倚南，復健醫療服務之疾病分類研究：國內某醫學中心近期經驗，2010。
[20]中山醫學院附設醫院復健科主治醫師：丁化醫師，心肺復健簡介。
[21]台大復健部部復健科，神經復健常見症狀。
[22]D. Fu and R. Houlette, "Putting AI in entertainment: an AI authoring tool for simulation and games, " IEEE intelligent systems, vol. 17, pp. 81-84, 2002.
[23]J.H. Liu, B.S. Huang and M. Chao, " The Design of Learning Object Authoring Tool Based on SCORM," Proceedings of Fifth IEEE International Conference on Advanced Learning Technologies (ICALT), July 5-8, 2005, Taichung, Taiwan, pp.778-782.
[24]N.R. Howe, M.E. Leventon, W.T. Freeman, "Bayesian reconstruction of 3D human motion from single-camera video, "Proceedings of conference on Advances in Neural Information Processing Systems (NIPS), Denver, CO, November 2000, pp. 820–826.
[25]A. Agarwal, B. Triggs, "Recovering 3D human pose from monocular images, " IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 28, pp. 44-58, Jan 2006.
[26]C. Sminchisescu, B. Triggs, "Estimating articulated human motion with covariance scaled sampling, "International Journal of Robotic Research, vol. 22, pp. 371-392, 2003.
[27]H. Sidenbladh, M.J. Black, D.J. Fleet, "Stochastic tracking of 3D human figures using 2D image motion, "Proceedings of the European Conference on Computer Vision (ECCV’00), Lecture Notes in Computer Science, vol. 2 (1843), Dublin, Ireland, June 2000, pp. 702–718.
[28]Q. Delamarre, O. Faugeras, "3D articulated models and multiview tracking with physical forces, "Computer Vision and Image Understanding (CVIU), vol. 81, pp. 328–357, 2001.
[29]D.M. Gavrila, L.S. Davis, “Tracking of humans in action: A 3D model-based approach, "Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR’96), San Francisco, CA, June 1996, pp. 73–80.
[30]R.E. Rosales, M. Siddiqui, J. Alon, S. Sclaroff, “Estimating 3D body pose using uncalibrated cameras, "Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR’01), vol. 1, Kauai, HI, December 2001, pp. 821–827.
[31]L. Ren, G. Shakhnarovich, J.K. Hodgins, H. Pfister, P.A. Viola, "Learning silhouette features for control of human motion," ACM Transactions on Computer Graphics, vol. 24, pp. 1303-1331, 2005.
[32]視翔高科：3D MOCAP專業高效能即時3D動作捕捉系統。
[33]物理治療數位博物館。