Responsive image
博碩士論文 etd-0908110-110729 詳細資訊
Title page for etd-0908110-110729
論文名稱
Title
擴增實境應用於建物影像附加資訊之研究
A study of augmented reality for posting information to building images
系所名稱
Department
畢業學年期
Year, semester
語文別
Language
學位類別
Degree
頁數
Number of pages
98
研究生
Author
指導教授
Advisor
召集委員
Convenor
口試委員
Advisory Committee
口試日期
Date of Exam
2010-07-20
繳交日期
Date of Submission
2010-09-08
關鍵字
Keywords
三維地理資訊系統、擴增實境、相機校正
camera calibration, 3D GIS, augmented reality, SURF
統計
Statistics
本論文已被瀏覽 5698 次,被下載 19
The thesis/dissertation has been browsed 5698 times, has been downloaded 19 times.
中文摘要
地理圖資的使用可以有效率地協助我們在陌生環境中行動。當二維展示與虛擬實境式的視覺化三維展示無法滿足使用者需求時,擴增實境技術的出現,為地理圖資的展示開啟嶄新的一頁。擴增實境講求的是在即時的運算下進行虛擬物件與真實場景的套疊,此概念對於建物空間資訊的展示有相當大的助益。本文探討當我們站在建物外圍,如何以透視建物的方式,取得更深入、更多元的空間資訊。本研究採模組化的開發方式,以單一鏡頭對建物捕捉序列影像,經過SURF特徵導向演算法作建物的辨識與追蹤,並且以電腦視覺的技術從連續影像之點對應關係間接取得相機參數,克服相機定位問題。最後根據追蹤與定位的結果,將建物內部的平面圖以立體化的方式擴增於建物影像中。
Abstract
Geographical image data efficiently help people with wayfinding when in an unfamiliar environment. However, since the display modes of geographical image data such as 2D and 3D virtual reality could not meet with users' needs anymore, the new technique augmented reality (AR) has then become a better and effective solution to graphics Augmented reality is a kind of 3D display technique by computer vision, in which 3D virtual objects are combined with 3D real environment interactively, dynamically, and in real-time. It will bring more advantages especially to the display of building spatial data. The research aims to find out more spatial information by seeing-through buildings when we stay outside it. The approach is firstly to use a single camera to capture building features with serial images, and secondly to do building recognition and tracking between reference images and serial images by Speeded-Up Robust Features (SURF) algorithm. Thirdly, the relationship of points correspondence between serial images are then applied to estimate camera parameters via computer vision technique. Finally, the 3D model map of buildings can augment to building images according to the camera parameters.
目次 Table of Contents
摘要 I
Abstract II
誌謝 III
圖目錄 VIII
表目錄 XI
第一章 緒論 1
1.1研究背景與動機 1
1.2研究目的 2
1.3研究方法與流程 3
1.4論文架構 4
第二章 文獻回顧 5
2.1擴增實境相關研究 5
2.1.1擴增實境的定義 5
2.1.2擴增實境的運作方式 9
2.1.3擴增實境應用於地理資訊系統之發展概況 12
2.2建物辨識 13
2.3相機參數估算 14
2.4小結 14
第三章 相機幾何 15
3.1針孔相機模型 15
3.2 OpenGL成像原理 20
3.3 相機幾何 24
3.3.1核幾何與基礎矩陣 24
3.3.2必要矩陣 27
3.3.3相機校正 29
3.4小結 30
第四章 Speeded-Up Robust Features特徵導向演算法 32
4.1興趣點位偵測 32
4.1.1 積分影像 32
4.1.2 Fast-Hessian特徵偵測子 33
4.1.3 建構尺度空間 37
4.1.4 定義興趣點位 39
4.2興趣點位特徵描述 40
4.2.1定義最大梯度方向 40
4.2.2建構描述子 41
4.3特徵匹配與除錯 42
4.3.1特徵匹配 42
4.3.2 RANSAC除錯 43
第五章 實驗成果與分析 45
5.1實驗資訊 45
5.1.1系統開發環境 45
5.1.2實驗區資訊 46
5.1.3實驗流程 48
5.2相機校正 49
5.3 序列影像建物辨識與追蹤 53
5.3.1特徵偵測與描述 53
5.3.2 Hessian門檻值與尺度空間參數測試 55
5.3.4選取感興趣區域 67
5.4 模型讀取與套疊 70
第六章 結論與建議 76
6.1結論 76
6.2未來研究方向 77
參考文獻 79
參考文獻 References
[1] 林傑斌、劉明德,「地理資訊系統GIS理論與實務」,文魁資訊2002。
[2] 柯翰庭,「應用擴充現實技術於配置設計之視覺化」,國立成功大學工業設計研究所碩士論文,2002。
[3] 呂其展,「運用影像序列建構與顯示三為地形模型之研究」,國立成功大學資訊工程研究所碩士論文,2002。
[4] 何浩如,「環場影像引導之視訊追蹤及其在增添式實境之應用」,國立台灣大學資訊工程研究所碩士論文,2000。
[5] 張庭榮,「SIFT演算法於立體對影像匹配與影像檢索應用之研究」,國立高雄應用科技大學土木工程與防災科技研究所碩士論文,2008。
[6] 愛瘋玩家,免費且支援台灣地圖的擴增實境iPhone程式:Argo, Available: http://funiphone.pixnet.net/blog/post/30174075/.
[Accessed: July 10, 2010].
[7] 愛瘋玩家,免費且支援台灣地圖的擴增實境iPhone程式:Acrossair,
Available: http://funiphone.pixnet.net/blog/post/30254349/.
[Accessed: July 10, 2010].
[8] 高雄市歷史博物館,
Available: http://w5.kcg.gov.tw/khm/tw/chinese/index.aspx/.
[Accessed: July 10, 2010].
[9] R. Azuma, "A Survey of Augmented Reality," Presence, vol. 6, pp. 355-385, 1997.
[10] Layar Reality Browser, Available: http://www.layar.com/.
[Accessed: July 10, 2010].
[11] Tokyo Underground iPhone and iPod Touch Application,
Available: http://www.presselite.com/iphone/tokyometro/.
[Accessed: July 10, 2010].
[12] I. E. Sutherland, "A head-mounted three dimensional display," in Proceedings of the December 9-11, 1968, fall joint computer conference, part I, San Francisco, California, pp. 757-764, 1968.
[13] G. C. Burdea and P. Coiffet, Virtual Reality Technology, John Wiley and Sons, 1994.
[14] P. Milgram and F. Kishino, "A taxonomy of mixed reality visual displays," IEICE Transactions on Information Systems, vol. E77-D, no. 12, pp. 1321-1329, 1994.
[15] P. Milgram, H. Takemura, A. Utsumi, and F. Kishino, "Augmented Reality: A Class of Displays on the Reality-Virtuality Continuum," in Proceedings of the SPIE Conference on Telemanipulator and Telepresence Technologies, vol. 2351, pp. 282-292, 1994.
[16] R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. Macintyre, "Recent advances in augmented reality," Computer Graphics and Applications, IEEE, vol. 21, no. 6, pp. 34-47, 2001.
[17] E. Dubois and L. Nigay, "Augmented reality: Which augmentation for which reality?" in Proceeding of DARE2000, Designing Augmented Reality Environments, Elsinore, Denmark, ACM, pp. 165-166, 2000.
[18] D. Norman and S. Draper, User Centered System Design: New Perspectives on Human-computer Interaction, L. Erlbaum Associates Inc., pp. 31-61, 1986.
[19] B. Ullmer, H. Ishii, and D. Glas, "mediaBlocks: Physical Containers, Transports, and Controls for Online Media," in Proceedings of the 25th annual conference on Computer graphics and interactive techniques, pp. 379-386, 1998.
[20] P. Wellner, "Interacting with paper on the DigitalDesk," Communications of the ACM, vol. 36, no. 7, pp. 87-96, 1993.
[21] J. Rekimoto and K. Nagao, "The world through the computer: computer augmented interaction with real world environments," in Proceedings of the 8th annual ACM symposium on User interface and software technology, Pittsburgh, Pennsylvania, United States, pp. 29-36, 1995.
[22] S. K. Feiner, "Augmented Reality: A New Way of Seeing," in Scientific American, 2002.
[23] T. Höllerer, S. Feiner, T. Terauchi, G. Rashid, and D. Hallaway, "Exploring MARS: Developing Indoor and Outdoor User Interfaces to a Mobile Augmented Reality System," Computers and Graphics, vol. 23, no. 6, pp. 779-785, 1999.
[24] C. Harris and M. Stephens, "A combined corner and edge detector," in Proceedings of the Alvey Vision Conference, pp. 147–151, 1988.
[25] T. Lindeberg, "Feature Detection with Automatic Scale Selection," International Journal of Computer Vision, vol. 30, no. 2, pp. 79-116, 1998.
[26] K. Mikolajczyk and C. Schmid, "Indexing based on scale invariant interest points," in ICCV. vol. 1, pp. 525-531, 2001.
[27] D. G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, vol. 60(2), pp. 91-110, 2004.
[28] W. Zhang and J. Kosecka, "Localization Based on Building Recognition," in Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 21-28, 2005.
[29] K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 27, no. 10, pp. 1615-1630, 2005.
[30] H. Bay, T. Tuytelaars, and L. V. Gool, "SURF: Speeded Up Robust Features," in 9th European Conference on Computer Vision, 2006.
[31] H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "Speeded-Up Robust Features (SURF)," Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, 2008.
[32] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, Second Edition, Cambridge University Press, 2003.
[33] B. Triggs, "Autocalibration and the absolute quadric," in Proceedings of IEEE Conference of Computer Vision and Pattern Recognition, 1997, pp. 609-614.
[34] O. D. Faugeras, Q. T. Luong, and S. J. Maybank, "Camera Self-Calibration: Theory and Experiments," in Proceedings of the Second European Conference on Computer Vision, 1992, pp. 321-334.
[35] M. Pollefeys, R. Koch, and L. V. Gool, "Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters," International Journal of Computer Vision, vol. 32, pp. 7-25, 1999.
[36] D. Shreiner and The Khronos OpenGL ARB Working Group, OpenGL Programming Guide: The Official Guide to Learning OpenGL, Versions 3.0 and 3.1, 7th Edition, Addison-Wesley, 2009.
[37] AForge.Net, Available: http://www.aforgenet.com/.
[Accessed: July 10, 2010].
[38] OpenCV Camera Calibration and 3D Reconstruction,
Available: http://sourceforge.net/projects/opencvlibrary/.
[Accessed: July 10, 2010].
[39] Camera Calibration Toolbox for Matlab,
Available: http://www.vision.caltech.edu/bouguetj/calib_doc/. [Accessed: July 10, 2010].
[40] P. Viola and M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," in Computer Vision and Pattern Recognition, vol. 1, pp. I-511 – I-518, 2001.
[41] C. Evans, "Notes on the OpenSurf Library," Technical Report CSTR-09-001, University of Bristol, 2009.
[42] J. J. Koenderink, "The structure of images," Biological Cybernetics, vol. 50, no. 5, pp. 363-370, 1984.
[43] T. Lindeberg, "Scale-Space for Discrete Signals," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12, no. 3, pp. 234-254, 1990.
[44] J. H. Friedman, J. L. Bentley, and R. A. Finkel, "An Algorithm for Finding Best Matches in Logarithmic Expected Time," ACM Transactions on Mathematical Software, vol. 3, no. 3, pp. 209-226, 1977.
[45] J. S. Beis and D. G. Lowe, "Shape Indexing Using Approximate Nearest-Neighbour Search in High-Dimensional Spaces," in Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), pp. 1000-1006, 1997.
[46] M. A. Fischler and R. C. Bolles, "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography," in Communications of the ACM, vol. 24, no. 6, pp. 381-395, June 1981.
[47] EmguCV, Available: http://www.emgu.com/.
[Accessed: July 10, 2010].
[48] Tao Framework,
Available: http://en.wikipedia.org/wiki/Tao_Framework/.
[Accessed: July 10, 2010].
[49] Mobile Robot Programming Toolkit (MRPT),
Available: http://www.mrpt.org/. [Accessed: July 10, 2010].
[50] Z. Zhang, "A flexible new technique for camera calibration," IEEE Transactions on Pattern Analysis and Machine Intelligence vol. 22, no. 11, pp. 1330-1334, 2000.
[51] K. W. Chia, A. D. Cheok, and S. J. D. Prince, "Online 6 DOF Augmented Reality Registration from Natural Features," in Proceedings of the 1st International Symposium on Mixed and Augmented Reality, pp. 305-313, 2002.
電子全文 Fulltext
本電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。
論文使用權限 Thesis access permission:校內公開,校外永不公開 restricted
開放時間 Available:
校內 Campus: 已公開 available
校外 Off-campus:永不公開 not available

您的 IP(校外) 位址是 18.234.55.154
論文開放下載的時間是 校外不公開

Your IP address is 18.234.55.154
This thesis will be available to you on Indicate off-campus access is not available.

紙本論文 Printed copies
紙本論文的公開資訊在102學年度以後相對較為完整。如果需要查詢101學年度以前的紙本論文公開資訊,請聯繫圖資處紙本論文服務櫃台。如有不便之處敬請見諒。
開放時間 available 已公開 available

QR Code