近年來，在生物行為模擬多半是採用物理計算來模擬，相較真實生物常有不真實的感覺。因此，我們提出一可以從記錄真實魚類運動之影片轉換成模仿魚類動作之動畫系統。在本論文中，先將相機架設在想要拍攝的魚缸前方與上方，使用橢圓關係校正了兩視角的垂直性，並使用相似三角形法校正長度，使用主動式輪廓法(SBGFRLS)分割出生物之輪廓並以樣板比對加速，使用Delaunay三角化與三角型更新法找出兩視角分別之二維骨架，再用線性擬合法將兩視角之骨架合併成三維骨架，再將一些錯誤的骨架資訊片段修正，輸出骨架資訊；接著將骨架及路徑資訊輸入至動畫產生器中，其動畫產生方式使用區塊切割的骨架綁定法，加入曲率半徑的機制來控制模型網格的縮放，減少骨架綁定後動作造成的破碎，最後加入三維顯示的技術來增加真實性。經由上述之方法使虛擬水族箱可以透過電腦視覺來觀察真實的水族箱，進而分析資料並模仿其游動之動作，產生擬真三維水族箱動畫。

This thesis describes a system that can imitate the swimming behavior from a real fish motion recording from videos. The proposed method does not require the setting of markers or sensors on the target objects like making a 3D movie. Object data are obtained from videos setting on variety of viewpoints. Top and front cameras were used to record the motion of fish. The videos were calibrated with pole-polar relationship and deformable objects were tracked using template matching associated with the selective binary and Gaussian filtering regularized level set. Following the tracking procedure, the skeletons were extracted using Delaunay triangulation from the contours of the creatures. We also proposed a line fitting method to facilitate the formulation of 2D skeletons obtained from two views into a 3D skeleton. The proposed method enables the simulation of fish motion with the same motion of real fish in video.

論文審定書 i
誌謝 ii
摘要 iii
Abstract iv
目錄 v
圖目錄 vii
表目錄 ix
壹、 簡介 1
一、 論文概述 1
二、 論文貢獻 2
三、 論文架構 2
貳、 文獻探討 3
一、 相機校正(CAMERA CALIBRATION) 3
二、 影像分割(SEGMENTATION) 3
三、 骨架擷取(SKELETON EXTRACTION) 4
四、 三維重建(3D RECONSTRUCTION) 5
五、 動作擷取(MOTION EXTRACTION) 6
參、 研究方法 7
一、 相機校正(CAMERA CALIBRATION) 10
1、 相機參數計算(Camera Parameter Calculation) 11
2、 影像校正(Image Adjusting) 13
二、 影像分割(SEGMENTATION) 16
1、 模板匹配(Template Matching) 16
2、 輪廓擷取(Contour Finding) 17
三、 動作擷取(MOTION EXTRACTION) 20
1、 骨架擷取(Fish Skeleton Extraction) 20
2、 骨架合併(Skeleton Integration) 22
四、 資訊修訂(DATA REVISION) 25
1、 頭點跳動修正(Head Point Jittering Revision) 25
2、 骨架平滑化(Skeleton Smooth) 26
3、 尾鰭安排(Tail Arrangement) 27
五、 三維動畫生成(3D ANIMATION GENERATION) 28
1、 動畫產生(Animation Generation) 28
2、 三維顯示(3D Display) 30
肆、 系統實作 32
一、 操作介面及環境 33
二、 實作詳細內容 35
伍、 結論 51
參考文獻 52

[1] X. Ying and H. Zha, “Camera calibration from a circle and a coplanar point at infinity with applications to sports scenes analyses,” International Conference on Intelligent Robots and Systems, pp. 220-225, 2007.
[2] C. Conomis, “Conics-based homography estimation from invariant points and pole-polar relationship,” Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT), pp. 908-915, 2006.
[3] H. Yu and Y. Wang, “An improved self-calibration method for active stereo camera,” IEEE Conference on Intelligent Control and Automation, pp. 5186-5190, 2006.
[4] Z. Zhao, Y. Liu, and Z. Zhang, “Camera calibration with three non-collinear points under special motions,” IEEE Transactions on Image Processing, vol. 17, no.12, pp. 2393-2402, 2008.
[5] Itseez, OpenCV API, http://docs.opencv.org/modules/calib3d/doc/calib3d.html, accessed November 2014.
[6] S. Zhu, X. Xia, Q. Zhang, and K. Belloulata, “A novel spatio-temporal video object segmentation algorithm,” IEEE International Conference on Industrial Technology, pp. 1-5, 2008.
[7] Y. Zhang, D. Wang, and Y. Hou, “An effective algorithm of automatic video object segmentation based on temporal-spatial information,” International Conference on Computer Science and Education, pp. 1755-1759, 2010.
[8] K. Zhang, L. Zhang, H. Song, and W. Zhou, “Active contours with selective local or global segmentation: a new formulation and level set method,” Journal of Image and Vision Computing, vol. 28, no. 4, pp. 668-676, 2010.
[9] S. Dambreville, Y. Rathi, and A. Tannenbaum, “Tracking deformable objects with unscented kalman filtering and geometric active contours,” American Control Conference, pp.2856-2861, 2006.
[10] Z. Messaoudi, A. Ouldali, and M. Oussalah, “Tracking objects in video sequence using active contour models and unscented kalman filter,” International Workshop on Systems, Signal Processing and their Applications (WOSSPA), pp. 135-138, 2011.
[11] J. Zou, “A fast skeletonization method,” International Conference on Digital Image Computing: Techniques and Applications, pp. 283-288, 2003.
[12] T. Igarashi, S. Matsuoka, and H. Tanaka, “Teddy: a sketching interface for 3d freeform design,” ACM SIGGRAPH, pp. 409-416, 1999.
[13] J. Wu, G. Zhang, J. Xia, and Z. Cui, “Skeleton extraction of cerebrovascular image based on topology nodes,” International Symposium on Information Processing, pp. 159-162, 2009.
[14] J. Wu, G. Zhang, J. Xia, and Z. Cui, “Gray cerebrovascular image skeleton extraction algorithm using level set model,” Journal of Multimedia, vol. 5, no. 3, pp. 208-215, 2010.
[15] O. Au, C. Tai, H. Chu, D. Cohen-Or, and T. Lee, “Skeleton extraction by mesh contraction,” ACM Transactions on Graphics (TOG), vol. 27, no. 3, pp. 44:1-44:10, 2008.
[16] J.A.G. de Souza, D. Sandra, F. Madricardo, and I.C.S. Correa, “Ultra-shallow water geophysics surveys for a pseudo-3D palaeochannel reconstruction, Lagoon of Venice, Italy,” IEEE International Conference on Acoustics in Underwater Geosciences Symposium, pp. 1-4, 2013.
[17] P.N. Andono, E.M. Yuniarno, M. Hariadi, and V. Venus, “3D reconstruction of underwater coral reef images using low cost multi-view cameras,” IEEE International Conference on Multimedia Computing and Systems, pp. 803-808, 2012.
[18] C. Hernandez, F. Schmitt, and R. Cipolla, “Silhouette coherence for camera calibration under circular motion,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 343-349, 2007.
[19] J. Gall, C. Stoll, E. de Aguiar, C. Theobalt, B. Rosenhahn, and H. Seidel, “Motion capture using joint skeleton tracking and surface estimation,” IEEE Conference on Computer Vision and Pattern Recognition, pp. 1746-1753, 2009.
[20] A.Y. Mulayim, U. Yilmaz, and V. Atalay, “Silhouette-based 3-D model reconstruction from multiple images,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 33, no. 4, pp. 582-591, 2003.
[21] J. Frahm, M. Pollefeys, B. Clipp, D. Gallup, R. Raguram, C. Wu, and C. Zach, “3D reconstruction of architectural scenes from uncalibrated video sequences,” 3D Virtual Reconstruction and Visualization of Complex Architectures (3D-ARCH), vol. 38, no. 5, pp.7, 2009.
[22] K. Terajima, T. Komuro, and M. Ishikawa, “Fast finger tracking system for in-air typing interface,” Annual CHI Conference on Human Factors in Computer Systems, pp. 3739-3744, 2009.
[23] G. Wen, Z. Wang, S. Xia, and C. Li, “Articulated skeleton fitting,” IEEE International Conference on Computer-Aided Design and Computer Graphics, pp. 395-400, 2007.
[24] S. Omachi and M. Omachi, “Fast template matching with polynomials,” IEEE Transactions on Image Processing, vol. 16, no. 8, pp. 2139-2149, 2007.
[25] L. Zini, A. Cavallaro, and F. Odone, “Action-based multi-camera synchronization,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 3, no. 2, pp. 165-174, 2013.
[26] H. Lu, Y. Li, L. Zhang, A. Yamawaki, S. Yang, and S. Serikawa, “Underwater Optical Image Dehazing Using Guided Trigonometric Bilateral Filtering,” IEEE International Symposium on Circuits and Systems(ISCAS), pp. 2147-2150, 2013.