為了使得新的資訊或想法能夠傳達給更多人，近年來，人們大多會以演說的方式來做呈現。一些人會使用三腳架攝影機對整個演講台來錄製，或是雇用攝影師來拍攝演說活動。然而，這樣會耗費許多人力成本並且依賴攝影師的技術。因此，本論文提出一個智慧演說者追蹤系統，其中包含了人物偵測模組，與人物追蹤模組。另一方面，結合全景攝影機，可以在PTZ攝影機的追蹤目標遺失的時候能夠快速的找回目標。實驗結果展示了自動偵測演說者的功能，並使用PTZ攝影機結合多核心追蹤技術來追蹤演說者，並且將拍攝畫面錄製下來，而藉由全景攝影機的影像，能夠以手動點選的方式快速地將PTZ攝影機轉向至指定的位置。

In recent years, most people make speeches or talks to spread out their latest information or ideas. Some of them use a camera with tripod to record the whole activity, others may hire a camera operator. However, it will cost lots of human resource. In addition, the quality of video recording depends on the skills of camera operators. Hence, in this thesis, we proposed a smart speaker tracking system to automatically record the whole speech. In addition, the proposed system uses the human detection and multiple kernel tracking schemes to automatically track and record the speaker via one PTZ camera. Furthermore, the omni directional camera is adopted to find the speaker’s position when losing the speaker’s position via the PTZ camera. Experimental results show that the proposed system can automatically tracking the speaker position. When losing the speaker’s position, the proposed system can relocate the speaker’s position by clicking the omni directional camera image manually.

論文審定書 i
誌 謝 ii
摘 要 iii
Abstract iv
目 錄 v
壹、 簡介 1
一、 論文概述 1
二、 論文貢獻 2
三、 論文架構 2
貳、 文獻探討 3
參、 研究方法 5
一、 人物偵測 6
二、 人物追蹤 10
三、 PTZ攝影機控制 13
四、 全景攝影機處理 15
肆、 系統實作 21
伍、 結論 30
參考文獻 31

[1] Arvind Rajpurohit, Ankit Agarwal, Mayur Gaikwad, Kapil Garg and Vahid Inamdar, "Securing Public Places Using Intelligent Motion Detection," IEEE International Conference on Engineering Education: Innovative Practices and Future Trends(AICERA 2012), pp. 1-4, 2012.
[2] Gunnar Farneb¨ack, "Two-Frame Motion Estimation Based on Polynomial Expansion," Image Analysis Lecture Notes in Computer Science, vol. 2749, pp. 363-370, 2003.
[3] Fan-Chieh Cheng and Shanq-Jang Ruan, “Accurate Motion Detection Using a Self-Adaptive Background Matching Framework,” IEEE Transactions on Intelligent Transportation Systems, pp. 671-679, 2012.
[4] Pankaj Kumar, Member, Surendra Ranganath, Kuntal Sengupta and Huang Weimin, "Cooperative Multitarget Tracking With Efficient Split and Merge Handling," IEEE Transactions on Circuits and Systems for Video Technology, vol. 16, no. 12, pp. 1477-1490, 2006.
[5] Xinghua Li, Qinglei Chen and Haiyang Chen, "Detection and Tracking of Moving Object Based on PTZ Camera," IEEE fifth International Conference on Advanced Computational Intelligence, pp. 493-497, 2012.
[6] Ning Liu, Hefeng Wu and Liang Lin, "Hierarchical Ensemble of Background Models for PTZ-Based Video Surveillance," IEEE Transactions on Cybernetics, vol. 45, no. 1, pp. 89-102, 2015
[7] Jean-Yves Bouguet, "Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm," Intel Corporation, 2001.
[8] Daniel D. Doyle, Alan L. Jennings and Jonathan T. Black, "Optical Flow Background Subtraction for Real-Time PTZ Camera Object Tracking," IEEE International Instrumentation and Measurement Technology Conference, pp. 866-871, 2013.
[9] Plamen Angelov, Chirag Gude, Pouria Sadeghi-Tehran and Tsvetan Ivanov, “ARTOT: Autonomous Real-Time Object Detection and Tracking by a Moving Camera,” IEEE International Conference on Intelligent Systems, pp. 446-452, 2012.
[10] David G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
[11] Navneet Dalal and Bill Triggs, "Histograms of Oriented Gradients for Human Detection," IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 886-893, 2005.
[12] Faliang Chang, Guoqiang Zhang, Xiaolin Wang and Zhenxue Chen, "PTZ Camera Target Tracking in Large Complex Scenes," World Congress on Intelligent Control and Automation, pp. 2914-2918, 2010.
[13] Pankaj Kumar, Anthony Dick and Tan Soo Sheng, "Real Time Target Tracking with Pan Tilt Zoom Camera," Digital Image Computing: Techniques and Applications, pp. 492-497, 2009.
[14] Dorin Comaniciu, Visvanathan Ramesh and Peter Meer, "Kernel-Based Object Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 5, pp. 564-577, 2003.
[15] Chun-Te Chu, Jenq-Neng Hwang, Hung-I Pai and Kung-Ming Lan, "Tracking Human Under Occlusion Based on Adaptive Multiple Kernels With Projected Gradients," IEEE Transactions on Multimedia, vol. 15, no. 7, pp. 1602-1615, 2013.
[16] Yuan-Tai Cheng, “PTZ Camera Foreground Localization and Segmentation Guided by Omnidirectional Camera,” Master degree, Department of Computer and Communication Engineering, National Kaohsiung First University of Science and Technology, 2010.
[17] Ciarán Hughes, Patrick Denny, Edward Jones and Martin Glavin, "Accuracy of Fish-eye Lens Models," Applied Optics, vol. 49, no. 17, pp. 3338-3347, 2010.
[18] Hsun-Shun Yu, “Calibrations for Fisheye Camera and Time-of-Flight Sensor,” Master degree, Department of Computer Science and Information Engineering, National Cheng Kung University, 2014.
[19] Satoshi Suzuki and Keiichi Abe, "Topological Structural Analysis of Digitized Binary Images by Border Following," Compter Vision, Graphics, and Image Processing, vol. 30, pp. 32-46, 1985.
[20] Andrew W. Fitzgibbon and Robert B. Fisher, "A Buyer's Guide to Conic Fitting," Proc.5th British Machine Vision Conference, pp. 513-522, 1995.