Articles | Volume 13, issue 1
https://doi.org/10.5194/jsss-13-123-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Special issue:
https://doi.org/10.5194/jsss-13-123-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Integration and evaluation of the high-precision MotionCam-3D into a 3D thermography system
Miguel-David Méndez-Bohórquez
CORRESPONDING AUTHOR
Department of Measurement and Control, University of Kassel, 34125 Kassel, Germany
Sebastian Schramm
Department of Measurement and Control, University of Kassel, 34125 Kassel, Germany
Robert Schmoll
Department of Measurement and Control, University of Kassel, 34125 Kassel, Germany
Andreas Kroll
Department of Measurement and Control, University of Kassel, 34125 Kassel, Germany
Related authors
Miguel-David Mendez-Bohorquez, Robert Schmoll, and Andreas Kroll
J. Sens. Sens. Syst., 15, 155–166, https://doi.org/10.5194/jsss-15-155-2026, https://doi.org/10.5194/jsss-15-155-2026, 2026
Short summary
Short summary
The size-of-source effect (SSE) is a systematic error requiring slow labor-intensive measurements. We propose a continuous approach using an iris diaphragm. Our method matched the accuracy of the traditional discrete method while providing more data and a reduction in measurement time. The method has no significant sensitivity to frame rate changes. Transient responses were observed using a neutral density filter, raising questions on how to measure and correct SSE in such configurations.
Miguel-David Mendez-Bohorquez, Robert Schmoll, and Andreas Kroll
J. Sens. Sens. Syst., 15, 155–166, https://doi.org/10.5194/jsss-15-155-2026, https://doi.org/10.5194/jsss-15-155-2026, 2026
Short summary
Short summary
The size-of-source effect (SSE) is a systematic error requiring slow labor-intensive measurements. We propose a continuous approach using an iris diaphragm. Our method matched the accuracy of the traditional discrete method while providing more data and a reduction in measurement time. The method has no significant sensitivity to frame rate changes. Transient responses were observed using a neutral density filter, raising questions on how to measure and correct SSE in such configurations.
Lars Kistner, Robert Schmoll, and Andreas Kroll
J. Sens. Sens. Syst., 13, 211–218, https://doi.org/10.5194/jsss-13-211-2024, https://doi.org/10.5194/jsss-13-211-2024, 2024
Short summary
Short summary
An airborne measurement system with an onboard computer for data processing and recording that does not require constant radio communication for inspection and maintenance is presented. It detects, locates, and quantifies methane leaks using a gimbal-mounted sensor. A model that correlates wind speed with drone attitude is presented and compared to measurements made with an anemometer. The quantification of methane emissions was evaluated in a laboratory setup and at an open-area test site.
Robert Schmoll, Sebastian Schramm, Tom Breitenstein, and Andreas Kroll
J. Sens. Sens. Syst., 11, 41–49, https://doi.org/10.5194/jsss-11-41-2022, https://doi.org/10.5194/jsss-11-41-2022, 2022
Short summary
Short summary
The method of non-contact temperature measurement in conjunction with a 3D sensor described in this paper can be used to determine the heat loss of technical devices and industrial plants. This measurement tool thus helps to optimize the energy efficiency of these devices and plants.
Sebastian Schramm, Jannik Ebert, Johannes Rangel, Robert Schmoll, and Andreas Kroll
J. Sens. Sens. Syst., 10, 207–218, https://doi.org/10.5194/jsss-10-207-2021, https://doi.org/10.5194/jsss-10-207-2021, 2021
Short summary
Short summary
During the geometric calibration of infrared cameras, the parameters that describe where object points are mapped onto thermal images are determined. The required reference data is obtained by capturing so-called calibration targets. In established approaches, it is difficult to estimate the lens distortions precisely. A newly developed target and its evaluation algorithm make it possible to increase the sensitivity of the calibration by finding reference points close to image borders.
Cited articles
Alexiou, E. and Ebrahimi, T.: On subjective and objective quality evaluation of point cloud geometry, in: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 1–3, IEEE, https://doi.org/10.1109/QoMEX.2017.7965681, 2017. a
Bin, Z., Jianxin, Q., Yunkang, S., Wentao, H., and Longqiu, L.: In situ monitoring of flip chip package process using thermal resistance network method and active thermography, Int. J. Heat Mass Tran., 225, 125402, https://doi.org/10.1016/j.ijheatmasstransfer.2024.125402, 2024. a
Campione, I., Lucchi, F., Santopuoli, N., and Seccia, L.: 3D Thermal Imaging System with Decoupled Acquisition for Industrial and Cultural Heritage Applications, Appl. Sci., 10, 828, https://doi.org/10.3390/app10030828, 2020. a
Costanzo, A., Minasi, M., Casula, G., Musacchio, M., and Buongiorno, M.: Combined Use of Terrestrial Laser Scanning and IR Thermography Applied to a Historical Building, Sensors, 15, 194–213, https://doi.org/10.3390/s150100194, 2014. a, b
Dumic, E., Duarte, C. R., and da Silva Cruz, L. A.: Subjective evaluation and objective measures for point clouds – State of the art, in: 2018 First International Colloquium on Smart Grid Metrology (SmaGriMet), 1–5, IEEE, https://doi.org/10.23919/SMAGRIMET.2018.8369848, 2018. a
Gardner, J., Stelter, C., Sauti, G., Kim, J.-W., Yashin, E., Wincheski, R., Schniepp, H., and Siochi, E.: Environment control in additive manufacturing of high-performance thermoplastics, The Int. J. Adv. Manufact. Technol., 119, 1–11, https://doi.org/10.1007/s00170-020-05538-w, 2022. a
Greeshma, J., Iven, J., and Sujatha, S.: Breast cancer detection: A comparative review on passive and active thermography, Infrared Phys. Techn., 134, 104932, https://doi.org/10.1016/j.infrared.2023.104932, 2023. a
Grubišić, I., Gjenero, L., Lipić, T., Sović, I., and Skala, T.: Active 3D scanning based 3D thermography system and medical applications, in: 2011 Proceedings of the 34th International Convention MIPRO, 269–273, IEEE, https://ieeexplore.ieee.org/abstract/document/5967063 (last access: 27 May 2024), 2011. a
Hackel, T., Wegner, J. D., and Schindler, K.: Fast semantic segmentation of 3D point clouds with strongly varying density, ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., III-3, 177–184, https://doi.org/10.5194/isprsannals-III-3-177-2016, 2016. a
Ham, Y. and Golparvar-Fard, M.: An automated vision-based method for rapid 3D energy performance modeling of existing buildings using thermal and digital imagery, Adv. Eng. Inform., 27, 395–409, https://doi.org/10.1016/j.aei.2013.03.005, 2013. a
Hellstein, P. and Szwedo, M.: 3D thermography in non-destructive testing of composite structures, Meas. Sci. Technol., 27, 124006, https://doi.org/10.1088/0957-0233/27/12/124006, 2016. a
Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., and Stuetzle, W.: Surface Reconstruction from Unorganized Points, SIGGRAPH Comput. Graph., 26, 71–78, https://doi.org/10.1145/142920.134011, 1992. a
Intel-RealSense: Intel RealSense: Product Family D400 Series, https://www.intelrealsense.com/wp-content/uploads/2023/07/Intel-RealSense-D400-Series-Datasheet-July-2023.pdf (last access: 27 May 2024), 2023. a
International Telecommunication Union/ITU-R Radiocommunication Sector of ITU: Methodology for the subjective assessment of the quality of television pictures, ITU-R BT.500-13, https://www.itu.int/dms_pubrec/itu-r/rec/bt/R-REC-BT.500-13-201201-I!!PDF-E.pdf (last access: 27 May 2024), 2012. a
Jutzi, B. and Gross, H.: Nearest Neighbor classification on Laser point clouds to gain object structures from buildings. High-resolution earth imaging for geospatial information, in: International Archives of Photogrammetry and Remote Sensing, Vol. 38, Copernicus Publications, publisher: Copernicus Publications, ISSN 1682-1777, 2009. a
Keller, M., Lefloch, D., Lambers, M., Izadi, S., Weyrich, T., and Kolb, A.: Real-Time 3D Reconstruction in Dynamic Scenes Using Point-Based Fusion, in: 2013 International Conference on 3D Vision – 3DV 2013, 1–8, IEEE, https://doi.org/10.1109/3DV.2013.9, 2013. a
Lagüela, S., Martínez, J., Armesto, J., and Arias, P.: Energy efficiency studies through 3D laser scanning and thermographic technologies, Energ. Buildings, 43, 1216–1221, https://doi.org/10.1016/j.enbuild.2010.12.031, 2011. a
Mallet, C., Bretar, F., Roux, M., Soergel, U., and Heipke, C.: Relevance assessment of full-waveform lidar data for urban area classification, ISPRS J. Photogramm., 66, S71–S84, https://doi.org/10.1016/j.isprsjprs.2011.09.008, 2011. a
Mekuria, R. and Cesar, P.: MP3DG-PCC, Open Source Software Framework for Implementation and Evaluation of Point Cloud Compression, in: Proceedings of the 24th ACM International Conference on Multimedia, MM '16, 1222–1226, Association for Computing Machinery, New York, NY, USA, ISBN 9781450336031, https://doi.org/10.1145/2964284.2973806, 2016. a
Mendez, M.: MT-MRT/JSSS-3DTS-Processing_Code: First version, 3D-Thermograms, Zenodo [code], https://doi.org/10.5281/zenodo.11355331, 2024. a
Mendez, M. and Schramm, S.: Datasets obtained from the 3DTS with the RealSense version (RS) and the MotionCam (MC3D), Zenodo, https://doi.org/10.5281/zenodo.8391050, 2023. a
Mendez, M., Schramm, S., Schmoll, R., and Kroll, A.: Integration of a High-Precision 3D Sensor into a Thermography System, in: Sensor and Measurement Science International, AMA Association for Sensors and Measurement, https://doi.org/10.5162/SMSI2023/E5.2, 2023. a
Ng, Y. and Du, R.: Acquisition of 3D surface temperature distribution of a car body, in: 2005 IEEE International Conference on Information Acquisition, 16–20, IEEE, ISBN 978-0-7803-9303-5, https://doi.org/10.1109/ICIA.2005.1635046, 2005. a
Optris-GmbH: Technical details – Infrared camera optris Pl400i/Pl 450i, https://www.optris.de/infrarotkamera-optris-pi400i-pi450i (last access: 27 May 2024), 2024. a
Ordóñez Müller, A. and Kroll, A.: Generating High Fidelity 3-D Thermograms With a Handheld Real-Time Thermal Imaging System, IEEE Sens. J., 17, 774–783, https://doi.org/10.1109/JSEN.2016.2621166, 2017. a, b
Pauly, M., Gross, M., and Kobbelt, L.: Efficient simplification of point-sampled surfaces, in: IEEE Visualization 2002, 163–170, IEEE, https://doi.org/10.1109/VISUAL.2002.1183771, 2002. a, b
Pfister, H., Zwicker, M., Van-Baar, J., and Gross, M.: Surfels: surface elements as rendering primitives, in: SIGGRAPH00: The 27th Internationl Conference on Computer Graphics and Interactive Techniques Conference, 335–342, ACM Press/Addison-Wesley Publishing Co., https://doi.org/10.1145/344779.344936, 2000. a
Photoneo: MotionCam-3D M, https://www.photoneo.com/es/products/motioncam-3d-m/ (last access: 27 May 2024), 2024. a
Prisacariu, V. A., Kähler, O., Golodetz, S., Sapienza, M., Cavallari, T., Torr, P. H. S., and Murray, D. W.: InfiniTAM v3: A Framework for Large-Scale 3D Reconstruction with Loop Closure, CoRR, abs/1708.00783, http://arxiv.org/abs/1708.00783 (last access: 27 May 2024), 2017. a
Rangel, J. and Soldan, S.: 3D Thermal Imaging: Fusion of Thermography and Depth Cameras, in: Proceedings of the 2014 International Conference on Quantitative InfraRed Thermography, QIRT Council, https://doi.org/10.21611/qirt.2014.035, 2014. a
Rusu, R. B.: Semantic 3D object maps for everyday manipulation in human living environments, Ph.D. thesis, Technical University Munich, Germany, https://d-nb.info/997527676/34 (last access: 27 May 2024), 2009. a
Salas-Moreno, R. F., Glocken, B., Kelly, P. H. J., and Davison, A. J.: Dense planar SLAM, in: 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 157–164, IEEE, https://doi.org/10.1109/ISMAR.2014.6948422, 2014. a
Schmoll, R., Schramm, S., Breitenstein, T., and Kroll, A.: Method and experimental investigation of surface heat dissipation measurement using 3D thermography, J. Sens. Sens. Syst., 11, 41–49, https://doi.org/10.5194/jsss-11-41-2022, 2022. a, b
Schramm, S. and Ebert, J.: MT-MRT/MRT-Coded-Calibration-Target: First release, v1.0.0, Zenodo [code], https://doi.org/10.5281/zenodo.4596313, 2021. a
Schramm, S., Osterhold, P., Schmoll, R., and Kroll, A.: Generation of Large-Scale 3D Thermograms in Real-Time Using Depth and Infrared Cameras, in: Proceedings of the 2020 International Conference on Quantitative InfraRed Thermography, QIRT Council, https://doi.org/10.21611/qirt.2020.008, 2020. a, b, c, d, e, f, g, h
Schramm, S., Ebert, J., Rangel, J., Schmoll, R., and Kroll, A.: Iterative feature detection of a coded checkerboard target for the geometric calibration of infrared cameras, J. Sens. Sens. Syst., 10, 207–218, https://doi.org/10.5194/jsss-10-207-2021, 2021a. a, b, c
Schramm, S., Rangel, J., Aguirre, D., Schmoll, R., and Kroll, A.: Target Analysis for the Multispectral Geometric Calibration of Cameras in Visual and Infrared Spectral Range, IEEE Sens. J., 21, 2159–2168, https://doi.org/10.1109/JSEN.2020.3019959, 2021b. a, b, c, d
Schramm, S., Rangel, J., Aguirre, D., and Schmoll, R.: MT-MRT/MRT-Camera-Calibration-Toolbox: v1.1.1, v1.1.1, Zenodo [code], https://doi.org/10.5281/zenodo.11367429, 2024. a
Sels, S., Verspeek, S., Ribbens, B., Bogaerts, B., Vanlanduit, S., Penne, R., and Steenackers, G.: A CAD matching method for 3D thermography of complex objects, Infrared Phys. Techn., 99, 152–157, https://doi.org/10.1016/j.infrared.2019.04.014, 2019. a
Tian, D., Ochimizu, H., Feng, C., Cohen, R., and Vetro, A.: Geometric distortion metrics for point cloud compression, in: 2017 IEEE International Conference on Image Processing (ICIP), 3460–3464, IEEE, https://doi.org/10.1109/ICIP.2017.8296925, 2017. a
Vidas, S. and Moghadam, P.: HeatWave: A handheld 3D thermography system for energy auditing, Energ. Buildings, 66, 445–460, https://doi.org/10.1016/j.enbuild.2013.07.030, 2013. a
Vidas, S., Moghadam, P., and Bosse, M.: 3D thermal mapping of building interiors using an RGB-D and thermal camera, in: 2013 IEEE International Conference on Robotics and Automation, 2311–2318, IEEE, ISBN 978-1-4673-5643-5 978-1-4673-5641-1, https://doi.org/10.1109/ICRA.2013.6630890, 2013. a
Vidas, S., Moghadam, P., and Sridharan, S.: Real-Time Mobile 3D Temperature Mapping, IEEE Sens. J., 15, 1145–1152, https://doi.org/10.1109/JSEN.2014.2360709, 2015. a
Wang, C., Cho, Y. K., and Gai, M.: As-Is 3D Thermal Modeling for Existing Building Envelopes Using a Hybrid LIDAR System, J. Comput. Civil Eng., 27, 645–656, https://doi.org/10.1061/(ASCE)CP.1943-5487.0000273, 2013. a
Weinmann, M., Jutzi, B., and Mallet, C.: Feature relevance assessment for the semantic interpretation of 3D point cloud data, ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., II-5/W2, 313–318, https://doi.org/10.5194/isprsannals-II-5-W2-313-2013, 2013. a
Weise, T., Wismer, T., Leibe, B., and Van Gool, L.: In-hand scanning with online loop closure, in: 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, 1630–1637, IEEE, https://doi.org/10.1109/ICCVW.2009.5457479, 2009. a
Whelan, T., Kaess, M., Johannsson, H., Fallon, M., Leonard, J. J., and McDonald, J.: Real-time large-scale dense RGB-D SLAM with volumetric fusion, The Int. J. Robot. Res., 34, 598–626, https://doi.org/10.1177/0278364914551008, 2015a. a
Whelan, T., Leutenegger, S., Salas Moreno, R., Glocker, B., and Davison, A.: ElasticFusion: Dense SLAM Without A Pose Graph, in: Robotics: Science and Systems XI, Robotics: Science and Systems Foundation, https://doi.org/10.15607/RSS.2015.XI.001, 2015b. a, b
Zhang, J., Huang, W., Zhu, X., and Hwang, J.-N.: A subjective quality evaluation for 3D point cloud models, in: 2014 International Conference on Audio, Language and Image Processing, 827–831, IEEE, https://doi.org/10.1109/ICALIP.2014.7009910, 2014. a
Zhang, Z., Sun, W., Min, X., Wang, T., Lu, W., and Zhai, G.: No-Reference Quality Assessment for 3D Colored Point Cloud and Mesh Models, IEEE Trans. Circuits Syst. Video Technol., 32, 7618–7631, https://doi.org/10.1109/TCSVT.2022.3186894, 2022. a, b, c
Short summary
3D thermograms are a good alternative when a single traditional 2D thermal image does not reveal enough information to analyze a complex object. However, the 3D thermography field is still under exploration. This paper shows a comparison of a thermography system operated with two different 3D sensors. The results indicate that the depth sensor with more accurate measurements captures the object geometry better, and therefore the interpretation of the 3D thermograms is improved.
3D thermograms are a good alternative when a single traditional 2D thermal image does not reveal...
Special issue