فصلنامه علمی- پژوهشی اطلاعات جغرافیایی « سپهر»

فصلنامه علمی- پژوهشی اطلاعات جغرافیایی « سپهر»

ارزیابی رویکرد ترکیبی فیلتر هدایت‌شده و الگوریتم خوشه‌بندی چگالی‌مبنا برای بهبود حذف نویز در داده‌های ابر نقاط لایدار

نوع مقاله : مقاله پژوهشی

نویسندگان
1 دانشجوی دکتری سنجش از دور، مرکز مطالعات سنجش از دور و GIS، دانشکده علوم زمین، دانشگاه شهید بهشتی تهران، ایران
2 استاد مرکز مطالعات سنجش از دور و GIS دانشکده علوم زمین دانشگاه شهید بهشتی، تهران، ایران
چکیده
داده‌های لایدار به عنوان ابزاری قدرتمند برای سنجش از دور سه‌بعدی و تحلیل‌های مکانی دقیق، به ویژه در محیط‌های شهری، شناخته می‌شوند. با این حال، این داده‌ها غالباً به دلیل شرایط جوی نامساعد، ویژگی‌های سطحی و خصوصیات سنسورها حاوی نویزهای متفاوتی هستند که این امر می‌تواند کیفیت داده‌ها را کاهش داده و بر دقت تحلیل‌های مبتنی بر آن‌ها تأثیر منفی بگذارد. بنابراین، حذف نویز از داده‌های لایدار ضروری است تا کیفیت داده‌ها بهبود یابد و جزئیات و ویژگی‌های کلیدی آن‌ها حفظ شود. در پژوهش حاضر، یک رویکرد ترکیبی شامل فیلتر هدایت‌شده و الگوریتم خوشه‌بندی چگالی‌مبنا برای حذف نویز از داده‌های ابر نقاط لایدار پیشنهاد شده است. فیلتر هدایت‌شده با بهره‌گیری از تنظیم پارامترها با استفاده از اطلاعات محلی، توانایی مؤثری در کاهش نویز ارتفاعی و حفظ ویژگی‌های مهم دارد. در ادامه به منظور بهبود نتایج حذف نویز، از الگوریتم خوشه ­بندی چگالی­ مبنا برای حذف نقاط پرت بر اساس تراکم پایین، آنها را شناسایی و حذف می‌کند. نتایج تحقیق نشان می‌دهند که این رویکرد ترکیبی به‌طور قابل توجهی عملکرد بهتری نسبت به روش‌های سنتی مانند فیلترهای آماری و مکانی و یا فیلتر هدایت شده به صورت مجزا داشته و ضمن حذف نویز، جزئیات ساختاری داده‌ها را حفظ می‌کند. ارزیابی‌های نتایج با استفاده از مقایسه مدل ارتفاعی رقومی، تحلیل پارامترهای آماری و نمایش گرافیکی ابر نقاط قبل و بعد از فیلتر انجام شده است. الگوریتم پیشنهادی با حذف کمترین تعداد نقطه و حفظ ویژگی­ های ساختاری داده، در تمامی بخش­ های داده موجب کاهش قابل توجه واریانس و انحراف معیار پس از اجرای فیلتر شده که نشان‌دهنده حذف مؤثر نویز و هموارسازی داده است. این روش با وجود زمان محاسبات پایین و سادگی مراحل اجرا، توانسته است به‌طور موثری نویز را کاهش دهد و جزئیات ساختاری داده‌ها را حفظ کند.
کلیدواژه‌ها

موضوعات


عنوان مقاله English

Evaluation of a hybrid approach using guided filter and density-based clustering algorithm for improve noise removal in LiDAR point cloud data

نویسندگان English

Vahid Ahmadi 1
Ali Akbar Matkan 2
1 PhD student in remote sensing & GIS research center, Faculty of earth sciences, Shahid Beheshti University, Tehran, Iran
2 Professor in remote sensing & GIS research center, Faculty of earth sciences, Shahid Beheshti University, Tehran, Iran
چکیده English

Extended Abstract
Introduction
LiDAR (Light Detection and Ranging) technology has emerged as an essential tool in 3D remote sensing and spatial analysis, particularly in urban environments where accurate modeling is crucial. This technology enables precise mapping of terrain and urban structures by capturing high-density point cloud data. However, despite its precision, LiDAR data is often affected by noise introduced by environmental conditions, sensor inaccuracies, and surface properties. This noise degrades the quality of the data, impacting its usability in various applications, including urban planning, forestry, and hazard assessment. Effective noise removal methods are therefore essential for enhancing data reliability while preserving its structural integrity.
Materials & Methods
This study introduces a hybrid approach for noise removal in LiDAR point cloud data by integrating a guided filter with the Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm. The guided filter is leveraged for its edge-preserving smoothing capabilities, which reduce elevation noise while maintaining critical features. Unlike traditional filters, which often compromise structural details, the guided filter ensures that essential features like building edges and vegetation patterns are retained. Parameters such as neighborhood radius and smoothing strength are optimized to balance noise reduction with detail preservation. Complementing the guided filter, the DBSCAN algorithm is employed to identify and remove outliers. DBSCAN operates by analyzing the density of points within a specified radius (epsilon) and identifying clusters based on the density threshold. Points that do not belong to any cluster are classified as noise and removed. This dual-method approach ensures a comprehensive noise removal process, targeting both widespread elevation noise and sparse outliers that traditional filters might overlook. To enhance the efficiency and adaptability of the hybrid method, Bayesian optimization is utilized for parameter tuning. This optimization technique systematically searches for the optimal parameter values, reducing the reliance on trial-and-error methods and ensuring the approach is tailored to the specific characteristics of the dataset. Key parameters optimized include the neighborhood radius and epsilon for DBSCAN and the smoothing parameters for the guided filter. The dataset for this study comprises aerial LiDAR scans collected from the coastal region of Duck, North Carolina, USA. The data includes high-resolution 3D point clouds with attributes such as elevation and reflectance intensity. Quantitative evaluations were conducted using statistical metrics like variance and standard deviation, while qualitative assessments involved visual inspections of digital elevation models (DEMs), triangulated irregular networks (TINs), and elevation profiles of flat surfaces.
Results & Discussion
Results indicate that the hybrid approach outperforms traditional methods such as mean, median, and standalone guided filtering. The guided filter effectively reduces elevation noise on flat surfaces like rooftops and roads, preserving critical structural features. Concurrently, DBSCAN identifies and removes residual outliers in low-density regions, which are often missed by other methods. Statistical analyses demonstrate significant reductions in variance and standard deviation, confirming enhanced data homogeneity. Visual inspections further validate these findings, showcasing smoother DEMs and more coherent TINs with fewer artifacts. One of the major advantages of this hybrid approach is its computational efficiency. The integration of the guided filter and DBSCAN ensures effective noise removal without excessive processing time, making the method scalable for large datasets. Additionally, the flexibility of DBSCAN allows it to adapt to diverse datasets without requiring prior assumptions about point distribution. This adaptability, combined with the systematic parameter tuning provided by Bayesian optimization, enhances the method's robustness and applicability across various contexts. Beyond noise removal, the proposed approach has broader implications for LiDAR data processing. By preserving structural integrity and minimizing point loss, the method supports high-accuracy spatial analyses crucial for applications like urban development, forest management, and disaster risk assessment. For instance, in urban planning, accurate LiDAR data can facilitate the creation of detailed 3D models, enabling better infrastructure planning and monitoring. Similarly, in forestry, the method can improve canopy height estimation and biomass calculations by ensuring clean and reliable data.
Conclusion
In conclusion, the hybrid approach combining the guided filter and DBSCAN algorithm represents a robust, efficient, and adaptable solution for noise removal in LiDAR point cloud data. By addressing both elevation noise and sparse outliers, the method improves data quality while preserving essential features, making it suitable for a wide range of applications. Its balance of computational efficiency and data accuracy ensures its relevance in both academic research and practical implementations. Future advancements in parameter optimization and integration with machine learning are likely to further enhance the utility and scalability of this approach.

کلیدواژه‌ها English

LiDAR point clouds
Guided filter
DBSCAN
Noise removal
Remote sensing
1- Aghighi, F., Ebadati, O.M., Aghighi, H. (2022) Presenting an automated approach for detecting outliers in Lidar point clouds using SVM-CRF and boxplot. Journal of Remote Sensing and GIS Iran, 109-91, 14 (2)
2- Alcayaga, L. (2020). Filtering of pulsed LiDAR data using spatial information and a clustering algorithm Atmospheric Measurement Techniques, 13(11), 6237-6254.
3- Balestrieri, E., Daponte, P., De Vito, L., & Lamonaca, F. (2021). Sensors and measurements for unmanned systems: An overview. Sensors, 21(4), 1518.
4- Balin, I. (2004). Measurement and analysis of aerosols, cirrus-contrails, water vapor and temperature in the upper troposphere with the Jungfraujoch LiDAR system (No. 2975). EPFL.
5- Baltsavias, E. P. (1999). Airborne laser scanning: Existing systems and firms and other resources. ISPRS Journal of Photogrammetry and Remote Sensing, 54(2-3), 112-122.
6- Bilik, I. (2022). Comparative analysis of radar and LiDAR technologies for automotive applications. IEEE Intelligent Transportation Systems Magazine, 15(1), 244-269.
7- Cheng, D., Zhao, D., Zhang, J., Wei, C., & Tian, D. (2021). PCA-based denoising algorithm for outdoor LiDAR point cloud data. Sensors, 21(11), 3703.
8- Di Stefano, F., Chiappini, S., Gorreja, A., Balestra, M., & Pierdicca, R. (2021). Mobile 3D scan LiDAR: A literature review. Geomatics, natural hazards and risk, 12(1), 2387-2429.
9- Ester, M., Kriegel, H. P., Sander, J., & Xu, X. (1996). A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd (Vol. 96, No. 34, pp. 226-231).
10- Farhani, G., Sica, R. J., & Daley, M. J. (2021). Classification of LiDAR measurements using supervised and unsupervised machine learning methods. Atmospheric Measurement Techniques, 14(1), 391-402.
11- Favorskaya, M. N., Jain, L. C., Favorskaya, M. N., & Jain, L. C. (2017). Overview of LiDAR technologies and equipment for land cover scanning. Handbook on advances in remote sensing and geographic information systems: Paradigms and applications in forest landscape modeling, 19-68.
12- Feng, Z. A., & Han, X. F. (2023). Guided normal filter for 3D point clouds. Multimedia Tools and Applications, 82(9), 13797-13810.
13- Hameed, M., Yang, F., Bazai, S. U., Ghafoor, M. I., Alshehri, A., Khan, I., ... & Andualem, M. (2022). Convolutional Autoencoder Based Deep Learning Approach for Aerosol Emission Detection Using LiDAR Dataset. Journal of Sensors(1) 3690312.
14- Hayduk, E. A. (2012). Using LiDAR Data to Estimate Effective Leaf Area Index, Determine Biometrics and Visualize Canopy Structure in a Central Oregon Forest with Complex Terrain (Doctoral dissertation, Evergreen State College).
15- He, K., Sun, J., & Tang, X. (2013). Guided image filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(6), 1397-1409.
16- Hebel, M., & Stilla, U. (2011). Simultaneous calibration of ALS systems and alignment of multiview LiDAR scans of urban areas. IEEE Transactions on Geoscience and Remote Sensing, 50(6), 2364-2379.
17- Heinzler, R., Piewak, F., Schindler, P., & Stork, W. (2020). Cnn-based LiDAR point cloud denoising in adverse weather. IEEE Robotics and Automation Letters, 5(2), 2514-2521.
18- Heritage, G. L., & Large, A. R. (2009). Laser Scanning for the Environmental Sciences.
19- Huang, H., Yan, X., Yang, J., Cao, Y., and Zhang, X.(2023). LIDSOR: A FILTER FOR REMOVING RAIN AND SNOW Noise points from LiDAR point clouds in rainy and snowy weather, Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XLVIII-1/W2-2023, 733–740
20- Kolapo, P. (2019). Towards a Short-Range Laboratory for Testing the Accuracy of Terrestrial 3D Laser Scanning (TLS) Technologies (Doctoral dissertation, University of Witwatersrand).
21- Li, Y., & Ibanez-Guzman, J. (2020). LiDAR for autonomous driving: The principles, challenges, and trends for automotive LiDAR and perception systems. IEEE Signal Processing Magazine, 37(4), 50-61.
22- Mallet, C., & Bretar, F. (2009). Full-waveform topographic LiDAR: State-of-the-art. ISPRS Journal of photogrammetry and remote sensing, 64(1), 1-16.
23- Meshcheryakov, R., Iskhakov, A., Mamchenko, M., Romanova, M., Uvaysov, S., Amirgaliyev, Y., & Gromaszek, K. (2022). A probabilistic approach to estimating allowed SNR values for automotive LiDARs in “smart cities” under various external influences. Sensors, 22(2), 609.
24- Mirzaei, K., Arashpour, M., Asadi, E., Masoumi, H., Bai, Y., & Behnood, A. (2022). 3D point cloud data processing with machine learning for construction and infrastructure applications: A comprehensive review. Advanced Engineering Informatics, 51, 101501.
25- Muhadi, N. A., Abdullah, A. F., Bejo, S. K., Mahadi, M. R., & Mijic, A. (2020). The use of LiDAR-derived DEM in flood applications: A review. Remote Sensing, 12(14), 2308.
26- Næsset, E. (2015). Vertical height errors in digital terrain models derived from airborne laser scanner data in a boreal-alpine ecotone in Norway. Remote Sensing, 7(4), 4702-4725.
27- Okyay, U., Telling, J., Glennie, C. L., & Dietrich, W. E. (2019). Airborne LiDAR change detection: An overview of Earth sciences applications. Earth-Science Reviews, 198, 102929.
28- Raparthi, M., & Agarwal, A. (2023). Machine Learning Based Deep Cloud Model to Enhance Robustness and Noise Interference. Journal of Engineering, Science and Mathematics (JESM), 20-20.
29- Ren, Y., Li, T., Xu, J., Hong, W., Zheng, Y., & Fu, B. (2021). Overall filtering algorithm for multiscale noise removal from point cloud data. IEEE Access, 9, 110723-110734.
30- Reutebuch, S. E., Andersen, H. E., & McGaughey, R. J. (2005). Light detection and ranging (LIDAR): an emerging tool for multiple resource inventory. Journal of forestry, 103(6), 286-292.
31- Roberts, K. C., Lindsay, J. B., & Berg, A. A. (2019). An analysis of ground-point classifiers for terrestrial LiDAR. Remote Sensing, 11(16), 1915.
32- Roman-Rivera, L. R., Pedraza-Ortega, J. C., Sotelo-Rodríguez, I., Guevara-González, R. G., & Toledano-Ayala, M. (2023). 3D Point Cloud Outliers and Noise Reduction Using Neural Networks. In International Congress of Telematics and Computing (pp. 323-341). Cham: Springer Nature Switzerland.
33- Roussel, R., Edelen, A. L., Boltz, T., Kennedy, D., Zhang, Z., Ji, F., ... & Neiswanger, W. (2024). Bayesian optimization algorithms for accelerator physics. Physical Review Accelerators and Beams, 27(8), 084801.
34- Selmer, P., Yorks, J. E., Nowottnick, E. P., Cresanti, A., & Christian, K. E. (2024). A Deep Learning LiDAR Denoising Approach for Improving Atmospheric Feature Detection. Remote Sensing, 16(15), 2735.
35- Stephens, D., Smith, A., Redfern, T., Talbot, A., Lessnoff, A., & Dempsey, K. (2020). Using three dimensional convolutional neural networks for denoising echosounder point cloud data. Applied Computing and Geosciences, 5, 100016.
36- Stilla, U., & Xu, Y. (2023). Change detection of urban objects using 3D point clouds: A review. ISPRS Journal of Photogrammetry and Remote Sensing, 197, 228-255.
37- Stular, B., & Lozić, E. (2020). Comparison of filters for archaeology-specific ground extraction from airborne LiDAR point clouds. Remote Sensing, 12(18), 3025.
38- Szostak, M. (2020). Automated land cover change detection and forest succession monitoring using LiDAR Point Clouds and GIS analyses. Geosciences, 10(8), 321.
39- Wallace, A. M., Halimi, A., & Buller, G. S. (2020). Full waveform LiDAR for adverse weather conditions. IEEE transactions on vehicular technology, 69(7), 7064-7077.
40- Wang, D., Yu, J., Liu, F., & Li, Q. (2024). ICESat-2 single photon laser point cloud denoising algorithm based on improved DBSCAN clustering. Earth, Planets and Space, 76(1), 1-16.
41- Wang, H., Yang, T., & Wang, Z. (2020). Development of a coupled aerosol LiDAR data quality assurance and control scheme with Monte Carlo analysis and bilateral filtering. Science of The Total Environment, 728, 138844.
42- Wehr, A., & Lohr, U. (1999). Airborne laser scanning—An introduction and overview. ISPRS Journal of Photogrammetry and Remote Sensing, 54(2-3), 68-82.
43- Wu, G., Luo, S., & Yang, Z. (2020). Optimal weighted bilateral filter with dual range kernel for Gaussian noise removal. IET Image Processing, 14(9), 1840-1850.
44- Wu, Y., Wang, Y., Zhang, S., & Ogai, H. (2020). Deep 3D object detection networks using LiDAR data: A review. IEEE Sensors Journal, 21(2), 1152-1171.
45- Yan, W. Y. (2023). Airborne LiDAR data artifacts: What we know thus far. IEEE Geoscience and Remote Sensing Magazine.
46- Yang, S., Xing, Y., Wang, D., & Deng, H. (2024). A Novel Point Cloud Adaptive Filtering Algorithm for LiDAR SLAM in Forest Environments Based on Guidance Information. Remote Sensing, 16(15), 2714.
47- Yun, T., Jiang, K., Li, G., Eichhorn, M. P., Fan, J., Liu, F., ... & Cao, L. (2021). Individual tree crown segmentation from airborne LiDAR data using a novel Gaussian filter and energy function minimization-based approach. Remote Sensing of Environment, 256, 112307.
48- Zhang, X. (2016). LiDAR-Based Change Detection for Earthquake Surface Ruptures. In Geoscience and Remote Sensing Symposium (IGARSS), 2162-2165.
49- Zhao, Y., Bai, L., Zhang, Z., & Huang, X. (2021). A surface geometry model for LiDAR depth completion. IEEE Robotics and Automation Letters, 6(3), 4457-4464.
50- Zhao, Z., Zhou, W., Liang, D., Liu, J., & Lee, X. (2024). Denoising Method Based on Improved DBSCAN for LiDAR Point Cloud. IEEE Access.
51- Zheng, J., Yang, S., Wang, X., Xiao, Y., & Li, T. (2021). Background noise filtering and clustering with 3D LiDAR deployed in roadside of urban environments. IEEE sensors journal, 21(18), 20629-20639.
52- Zhu, R., Ma, S., & Xu, D. (2020). Guided filter simplification method for noisy point cloud data. In 2020 Chinese automation congress (CAC) (pp. 6951-6955). IEEE.