Articles | Volume 14, issue 1
https://doi.org/10.5194/jsss-14-37-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Special issue:
https://doi.org/10.5194/jsss-14-37-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Regular research article
| 
18 Feb 2025
Regular research article |
| 18 Feb 2025
| 18 Feb 2025
Enhancing human–robot collaboration with thermal images and deep neural networks: the unique thermal industrial dataset WLRI-HRC and evaluation of convolutional neural networks
Work-Life Robotics Institute, University of Applied Sciences Offenburg, Offenburg, Germany
Katrin-Misel Ponomarjova
Work-Life Robotics Institute, University of Applied Sciences Offenburg, Offenburg, Germany
Thomas M. Wendt
Work-Life Robotics Institute, University of Applied Sciences Offenburg, Offenburg, Germany
Stefan J. Rupitsch
Laboratory for Electrical Instrumentation and Embedded Systems, Department of Microsystems Engineering, University of Freiburg, 79110 Freiburg, Germany
Related authors
No articles found.
Anke Fischer, Thomas M. Wendt, Lukas Stiglmeier, Philipp Gawron, and Kristof Van Laerhoven
J. Sens. Sens. Syst., 12, 103–109, https://doi.org/10.5194/jsss-12-103-2023, https://doi.org/10.5194/jsss-12-103-2023, 2023
Short summary
Short summary
In this work, we investigated whether artificial feedback in the form of vibration has an effect on the accuracy and precision of eye tracking glasses. The results enabled the development of design proposals for vibrotactile feedback in gaze-based control systems for robotic arms.
Related subject area
Sensor principles and phenomena: Optical and infrared sensors
Miniaturized two-chamber photoacoustic CO2 sensor with a wafer-bonded MEMS (micro-electro-mechanical systems) detector
Concatenated Bragg grating fiber-optic sensors for simultaneous measurement of curvature, temperature, and axial pressure
Optical and tactile measurements on SiC sample defects
Investigation of the degree of cross-linking of polyethylene and thermosets using absolute optical spectroscopy and Raman microscopy
Compact silicon-based attenuated total reflection (ATR) sensor module for liquid analysis
Real-time active-gas imaging of small gas leaks
Non-invasive blood sugar detection by cost-effective capacitance spectroscopy
Resonant photoacoustic cells for laser-based methane detection
Fabrication of integrated polysilicon waveguides for mid-infrared absorption sensing
Near-infrared LED system to recognize road surface conditions for autonomous vehicles
Characterization of specular freeform surfaces from reflected ray directions using experimental ray tracing
Iterative feature detection of a coded checkerboard target for the geometric calibration of infrared cameras
The size-of-source effect in thermography
Method for fast determination of the angle of ionizing radiation incidence from data measured by a Timepix3 detector
Comparison of laser-based photoacoustic and optical detection of methane
Metrological characterization and calibration of thermographic cameras for quantitative temperature measurement
Detection of plastics in water based on their fluorescence behavior
Analysis of photoelastic properties of monocrystalline silicon
Evaluation of optical fibre sensors in the electrical domain
Infrared-based sensor system for contactless monitoring of wetness and ice
Miniaturized photoacoustic detection of organofluorine-based refrigerants
Characterization, calibration and validation of an industrial emissometer
Measurement of the absolute spectral responsivity in the mid-infrared based on the cryogenic electrical substitution radiometer and an optimized thermopile detector
Quantitative measurement of combustion gases in harsh environments using NDIR spectroscopy
Validation of three-component wind lidar sensor for traceable highly resolved wind vector measurements
Comparison between different fiber coatings and adhesives on steel surfaces for distributed optical strain measurements based on Rayleigh backscattering
Crack luminescence as an innovative method for detection of fatigue damage
Temperature sensing in underground facilities by Raman optical frequency domain reflectometry using fiber-optic communication cables
Evaluation of the pH-sensitive swelling of a hydrogel by means of a plasmonic sensor substrate
Temperature reconstruction of infrared images with motion deblurring
TSA infrared measurements for stress distribution on car elements
Transmitted light pH optode for small sample volumes
Purity monitoring in medical gas supply lines with quantum cascade laser technology
Efficient thermal infrared emitter with high radiant power
Refractive index sensing of gases based on a one-dimensional photonic crystal nanocavity
Development of a portable active long-path differential optical absorption spectroscopy system for volcanic gas measurements
Thermal imaging as a modern form of pyrometry
Multi-channel IR sensor system for determination of oil degradation
Simon Gaßner, Simon Essing, David Tumpold, Katrin Schmitt, and Jürgen Wöllenstein
J. Sens. Sens. Syst., 13, 219–226, https://doi.org/10.5194/jsss-13-219-2024, https://doi.org/10.5194/jsss-13-219-2024, 2024
Short summary
Short summary
This article describes a small prototype sensor designed to sense carbon dioxide (CO2) levels for indoor air quality monitoring. The device uses a photoacoustic detector fabricated using a wafer-bonding process. This allows for high-volume production of the sensors. The prototype presented is small in size and can detect CO2 levels as low as 81 ppm with a response time of 53 s. Our results show suitability for application in indoor air quality control systems.
Sohrab Shojaei Khatouni, Sven Zakowski, Reza Hosseini Vedad, Mustafa Masjedi, Akram Askar, Jan Christian Eli Ewald, and Hoc Khiem Trieu
J. Sens. Sens. Syst., 13, 147–155, https://doi.org/10.5194/jsss-13-147-2024, https://doi.org/10.5194/jsss-13-147-2024, 2024
Short summary
Short summary
This study introduces four sensors utilizing multiple fiber Bragg grating constellations embedded in a silicon dioxide single-mode fiber for simultaneous pressure, temperature, and bending curvature measurement. By varying grating constellation, dimensions, and materials, researchers optimized sensor performance. Results indicate that the optimal configuration involves a high cladding-to-coating ratio, less-stiff coating, and the combination of two gratings to form a Fabry–Pérot interferometer.
Jana Grundmann, Bernd Bodermann, Elena Ermilova, Matthias Weise, Andreas Hertwig, Petr Klapetek, Jila Rafighdoost, and Silvania F. Pereira
J. Sens. Sens. Syst., 13, 109–121, https://doi.org/10.5194/jsss-13-109-2024, https://doi.org/10.5194/jsss-13-109-2024, 2024
Short summary
Short summary
In power electronics, materials like silicon carbide (SiC) are increasingly being used instead of silicon. They have a lot of advantages but also require defect inspection with high accuracy. Different defect types on SiC samples are measured with various methods to determine which one is most suitable for which defect. In conclusion, each examined measurement method is sensitive to the studied defects, although they differ in speed and specialized application fields.
Florian Bergmann, Norbert Halmen, Claudia Scalfi-Happ, Dominik Reitzle, Alwin Kienle, Linda Mittelberg, Benjamin Baudrit, Thomas Hochrein, and Martin Bastian
J. Sens. Sens. Syst., 12, 175–185, https://doi.org/10.5194/jsss-12-175-2023, https://doi.org/10.5194/jsss-12-175-2023, 2023
Short summary
Short summary
In this work, the determination of the degree of cross-linking was investigated using absolute optical measurements with an integrating sphere and Raman spectroscopy. PE-Xc, on the basis of HDPE and UHMWPE and various thermosets, was examined. Laboratory methods (e.g. wet chemical analysis, DSC, and DEA) were used for comparison. A good correlation of the results of the optical methods with those of the laboratory methods could be shown and serves as a basis for further investigations.
Armin Lambrecht, Carsten Bolwien, Hendrik Fuhr, Gerd Sulz, Annett Isserstedt-Trinke, André Magi, Steffen Biermann, and Jürgen Wöllenstein
J. Sens. Sens. Syst., 12, 123–131, https://doi.org/10.5194/jsss-12-123-2023, https://doi.org/10.5194/jsss-12-123-2023, 2023
Short summary
Short summary
Infrared spectroscopy is great for determining the composition of liquids. Combined with attenuated total reflection (ATR), one can just put the sample on the sensitive surface. We made a compact device with a diamond-coated silicon ATR crystal to protect the surface against aggressive fluids. Silicon crystal, light source and detector are hermetically sealed in a housing. Our tests show that the diamond coating enhanced the sensitivity compared to uncoated ATR elements as predicted by theory.
Max Bergau, Thomas Strahl, Benjamin Scherer, and Jürgen Wöllenstein
J. Sens. Sens. Syst., 12, 61–68, https://doi.org/10.5194/jsss-12-61-2023, https://doi.org/10.5194/jsss-12-61-2023, 2023
Short summary
Short summary
Imaging of greenhouse gases is of great interest due to global warming. A spectroscopic method, using an active illumination of the scene, is presented. It allows for imaging and concentration measurements of much smaller gas plumes and leaks than current state-of-the-art gas cameras (optical gas imaging cameras). A real-time camera is realized and validated using known methane concentrations.
Shazzad Rassel, Md Rejvi Kaysir, Abdulrahman Aloraynan, and Dayan Ban
J. Sens. Sens. Syst., 12, 21–36, https://doi.org/10.5194/jsss-12-21-2023, https://doi.org/10.5194/jsss-12-21-2023, 2023
Short summary
Short summary
Diabetes Mellitus (DM) is one of the very common diseases with no viable cure. However, it can be controlled by regulating the daily sugar intake. Diabetic patients need to prick their fingers a few times a day for monitoring sugar levels. To find an alternative, researchers have been working for decades on the development of a true non-invasive technique. In this effort, we developed a cost-effective non-invasive technique for measuring blood sugar levels using capacitance spectroscopy.
Katrin Schmitt, Mara Sendelbach, Christian Weber, Jürgen Wöllenstein, and Thomas Strahl
J. Sens. Sens. Syst., 12, 37–44, https://doi.org/10.5194/jsss-12-37-2023, https://doi.org/10.5194/jsss-12-37-2023, 2023
Short summary
Short summary
We present a photoacoustic sensor enabling fast, inexpensive, and highly sensitive methane detection in environmental monitoring applications. Six different T-cell designs were both theoretically and experimentally investigated. The aim was to understand the photoacoustic signal generation and resonances in relation to the different cell geometries, and determine the long-term stability and the detection limits for methane. These were below the methane background concentration in air of 1.8 ppm.
Gerald Stocker, Cristina Consani, Pooja Thakkar, Clement Fleury, Andreas Tortschanoff, Khaoula-Farah Ourak, Gerald Pühringer, Reyhaneh Jannesari, Parviz Saeidi, Elmar Aschauer, Ulf Bartl, Christoph Kovatsch, Thomas Grille, and Bernhard Jakoby
J. Sens. Sens. Syst., 11, 225–231, https://doi.org/10.5194/jsss-11-225-2022, https://doi.org/10.5194/jsss-11-225-2022, 2022
Short summary
Short summary
We motivate how integrated waveguides (WGs) can be part of an on-chip non-dispersive infrared sensor system for environmental sensing. We report the hurdles in maintaining WG quality when integrating emitter and detector structures on the same chip. Thus, we introduce the concept of how to determine the intrinsic loss and a process scheme to protect WG structures from damage caused during fabrication. This could pave the way to systems for environmental sensing with a minimal footprint.
Hongyi Zhang, Shéhérazade Azouigui, Rabia Sehab, and Moussa Boukhnifer
J. Sens. Sens. Syst., 11, 187–199, https://doi.org/10.5194/jsss-11-187-2022, https://doi.org/10.5194/jsss-11-187-2022, 2022
Short summary
Short summary
In this paper, a near-infrared LED system is proposed for autonomous vehicles to distinguish between weather-induced road surface conditions (dry, wet, snow, ice, water). For the LED spectra, the influence of the LED bandwidth is investigated. To assess the performance of the system for a long detection range, experiments with large incident angles are conducted. The feasibility of this system is proved via a laboratory experiment with three near-infrared LEDs and a camera.
Tobias Binkele, David Hilbig, Mahmoud Essameldin, Thomas Henning, Friedrich Fleischmann, and Walter Lang
J. Sens. Sens. Syst., 10, 261–270, https://doi.org/10.5194/jsss-10-261-2021, https://doi.org/10.5194/jsss-10-261-2021, 2021
Short summary
Short summary
The development of optical design is characterized by the desire for more applications and better performance. The latest result of this development is freeform optics offering almost unlimited possibilities for the designers. However, an optical component has also to be manufactured and tested by metrology. We propose a measurement technique for the surface characterization of freeform optical components and highlight the possible error sources and their influence on the measurement result.
Sebastian Schramm, Jannik Ebert, Johannes Rangel, Robert Schmoll, and Andreas Kroll
J. Sens. Sens. Syst., 10, 207–218, https://doi.org/10.5194/jsss-10-207-2021, https://doi.org/10.5194/jsss-10-207-2021, 2021
Short summary
Short summary
During the geometric calibration of infrared cameras, the parameters that describe where object points are mapped onto thermal images are determined. The required reference data is obtained by capturing so-called calibration targets. In established approaches, it is difficult to estimate the lens distortions precisely. A newly developed target and its evaluation algorithm make it possible to increase the sensitivity of the calibration by finding reference points close to image borders.
Helmut Budzier and Gerald Gerlach
J. Sens. Sens. Syst., 10, 179–184, https://doi.org/10.5194/jsss-10-179-2021, https://doi.org/10.5194/jsss-10-179-2021, 2021
Short summary
Short summary
In thermometry, the displayed temperature value of an object depends on the size of the object. This behaviour, the size-of-source effect, might be a major cause of measurement uncertainty in a thermoscene. The influence of diffraction and digitization can be described advantageously with the modulation transfer function. Especially with very small objects the displayed temperatures are too low. When imaging large objects, not only the edge areas are affected, but also the entire image.
Felix Lehner, Jürgen Roth, Oliver Hupe, Marc Kassubeck, Benedikt Bergmann, Petr Mánek, and Marcus Magnor
J. Sens. Sens. Syst., 10, 63–70, https://doi.org/10.5194/jsss-10-63-2021, https://doi.org/10.5194/jsss-10-63-2021, 2021
Thomas Strahl, Johannes Herbst, Eric Maier, Sven Rademacher, Christian Weber, Hans-Fridtjof Pernau, Armin Lambrecht, and Jürgen Wöllenstein
J. Sens. Sens. Syst., 10, 25–35, https://doi.org/10.5194/jsss-10-25-2021, https://doi.org/10.5194/jsss-10-25-2021, 2021
Short summary
Short summary
For safety, environmental and economic reasons, methane leak detection is one of the most requested tasks for gas measurement devices. This paper compares the performance of a laser-based optical and acoustical detection scheme at different wavelengths and laser types, respectively. This forms a good basis for further developments of methane leak detection devices or can help to choose the right configuration for a certain methane leak detection application.
Sebastian König, Berndt Gutschwager, Richard Dieter Taubert, and Jörg Hollandt
J. Sens. Sens. Syst., 9, 425–442, https://doi.org/10.5194/jsss-9-425-2020, https://doi.org/10.5194/jsss-9-425-2020, 2020
Short summary
Short summary
We present the metrological characterization and calibration of three different types of thermographic cameras for quantitative temperature measurement traceable to the International Temperature Scale (ITS-90). Relevant technical specifications are determined according to the requirements given in the series of Technical Directives VDI/VDE 5585. For the IETD and the NU, we also show how a significant improvement in the parameters can be achieved with the help of the data reference method.
Maximilian Wohlschläger and Martin Versen
J. Sens. Sens. Syst., 9, 337–343, https://doi.org/10.5194/jsss-9-337-2020, https://doi.org/10.5194/jsss-9-337-2020, 2020
Markus Stoehr, Gerald Gerlach, Thomas Härtling, and Stephan Schoenfelder
J. Sens. Sens. Syst., 9, 209–217, https://doi.org/10.5194/jsss-9-209-2020, https://doi.org/10.5194/jsss-9-209-2020, 2020
Short summary
Short summary
Photoelasticity is considered a useful measurement tool for non-destructive and contactless determination of mechanical stresses or strains in the production of silicon wafers. In this work, a detailed derivation for the anisotropic stress-optic law is presented, and the corresponding stress-optical parameters are measured.
Ulrich Nordmeyer, Niels Neumann, Xiaozhou Wang, Dirk Plettemeier, Torsten Thiel, and Konstantin Kojucharow
J. Sens. Sens. Syst., 9, 199–208, https://doi.org/10.5194/jsss-9-199-2020, https://doi.org/10.5194/jsss-9-199-2020, 2020
Short summary
Short summary
A completely new evaluation method for optical sensors is investigated in this paper. It originates from research that integrates optical sensors into radio-over-fibre networks. The laboratory-based experimental set-up is explained, and the findings are validated by a comparison to the conventional evaluation scheme. Finally, the work provides a detailed mathematical model to understand the implications of this new read-out method for practical applications.
Lakshan Tharmakularajah, Jakob Döring, and Karl-Ludwig Krieger
J. Sens. Sens. Syst., 9, 133–141, https://doi.org/10.5194/jsss-9-133-2020, https://doi.org/10.5194/jsss-9-133-2020, 2020
Short summary
Short summary
In order to differentiate between a wet and a dry road surface, the water film height should be measured by using an infrared-based sensor system. By means of different wavelengths, it is also possible to distinguish between ice and water. In this article, a sensor system for the determination of the physical state of water on different surfaces using infrared LEDs and one photodiode is presented. This shall serve as a basis for the calculation of the road condition.
Mahmoud El-Safoury, Christian Weber, Olaf Kiesewetter, Yvonne Hespos, André Eberhardt, Katrin Schmitt, and Jürgen Wöllenstein
J. Sens. Sens. Syst., 9, 89–97, https://doi.org/10.5194/jsss-9-89-2020, https://doi.org/10.5194/jsss-9-89-2020, 2020
Short summary
Short summary
The refrigerant R134a is classified as a greenhouse gas and was banned from use (in vehicles) by the European Union in 2017 due to its contribution to global warming. The more expensive alternative refrigerant R1234yf is considered an environmentally less harmful alternative owing to its significantly lower global warming potential. Our newly developed gas detector can detect both refrigerants separately and, thus, help prevent the use of illegal gas mixtures that contain both refrigerants.
Elena Kononogova, Albert Adibekyan, Christian Monte, and Jörg Hollandt
J. Sens. Sens. Syst., 8, 233–242, https://doi.org/10.5194/jsss-8-233-2019, https://doi.org/10.5194/jsss-8-233-2019, 2019
Tobias Pohl, Peter Meindl, Uwe Johannsen, Dieter Taubert, and Lutz Werner
J. Sens. Sens. Syst., 8, 195–205, https://doi.org/10.5194/jsss-8-195-2019, https://doi.org/10.5194/jsss-8-195-2019, 2019
Short summary
Short summary
The Physikalisch-Technische Bundesanstalt (PTB) expanded its capabilities in the International System of Units (SI)-traceable absolute measurement of radiant power into the spectral range of the mid-infrared (MIR) by implementing additional MIR laser radiation sources at one of the PTB's cryogenic electrical substitution radiometer facilities. This extension enables absolute calibrations of the spectral responsivity of detectors in the MIR with low uncertainty.
Christian Niklas, Stephan Bauke, Fabian Müller, Kai Golibrzuch, Hainer Wackerbarth, and Georgios Ctistis
J. Sens. Sens. Syst., 8, 123–132, https://doi.org/10.5194/jsss-8-123-2019, https://doi.org/10.5194/jsss-8-123-2019, 2019
Short summary
Short summary
We present in our paper two types of optical sensors that are capable of measuring the environmentally significant gases such as carbon oxide and dioxide as well as methane and water through absorption of light even in harsh environments of high temperature and pressure. Thus the sensors render it possible to measure inside combustion engines or in civilian fireplaces, which is necessary to meet the increasing demands of environmental protection regulations.
Stefan Oertel, Michael Eggert, Christian Gutsmuths, Paul Wilhelm, Harald Müller, and Helmut Többen
J. Sens. Sens. Syst., 8, 9–17, https://doi.org/10.5194/jsss-8-9-2019, https://doi.org/10.5194/jsss-8-9-2019, 2019
Short summary
Short summary
Traceable wind velocity measurements with high resolution play a critical role in the field of wind energy. In this article we present a novel bistatic wind lidar system that has a high spatial and temporal resolution and a reduced measurement uncertainty compared to conventional systems as evidenced by comparison measurements. A first validation measurement in a wind tunnel with a laser Doppler anemometer as a flow velocity reference confirms the high accuracy of the bistatic lidar system.
Martin Weisbrich and Klaus Holschemacher
J. Sens. Sens. Syst., 7, 601–608, https://doi.org/10.5194/jsss-7-601-2018, https://doi.org/10.5194/jsss-7-601-2018, 2018
Short summary
Short summary
The study describes how distributed optical strain measurement can be applied to steel surfaces. With the method presented, strain transfers from the substrate to the fiber core can be achieved that are almost identical to those of the reference measurement, especially with Ormocer® and polyimide coating.
The research results are to be used in the future for strain measurement in concrete construction on reinforcing steel.
Ruben Makris, Falk Hille, Marc Thiele, Dirk Kirschberger, and Damian Sowietzki
J. Sens. Sens. Syst., 7, 259–266, https://doi.org/10.5194/jsss-7-259-2018, https://doi.org/10.5194/jsss-7-259-2018, 2018
Short summary
Short summary
In structural parts under vibrational loading fatigue cracks can initiate and grow, which can lead to structural failure. Conventional non-destructive testing methods for crack detection provide just a snapshot of fatigue crack evolution, whereas crack luminescence coating realizes clear visibility of the entire crack formation. Fatigue causing cyclic tensile tests and examinations on special test bodies allowing control of the crack opening width demonstrate a high sensitivity of the coating.
Markus Brüne, Wilhelm Furian, Wieland Hill, and Andreas Pflitsch
J. Sens. Sens. Syst., 7, 85–90, https://doi.org/10.5194/jsss-7-85-2018, https://doi.org/10.5194/jsss-7-85-2018, 2018
Short summary
Short summary
The climate conditions in underground transportation facilities, especially the current airflow in terms of direction and speed, are the key factor driving smoke propagation in the case of a tunnel fire. Sensing this airflow is cost-intensive. Therefore, this paper focuses on gaining the information from temperature sensing along the tunnels using already installed optical fibers normally used for communications. This technique can replace thousands of temperature sensors.
Christoph Kroh, Roland Wuchrer, Margarita Günther, Thomas Härtling, and Gerald Gerlach
J. Sens. Sens. Syst., 7, 51–55, https://doi.org/10.5194/jsss-7-51-2018, https://doi.org/10.5194/jsss-7-51-2018, 2018
Short summary
Short summary
The inline monitoring of parameters in aqueous liquids is facing an increasing demand in many application areas. In this paper we report on an optical monitoring of the pH value in liquids by means of a sensitive hydrogel, which can be applied in the physiological range. Our results indicate a nearly linear dependency between pH value and hydrogel swelling. Furthermore, we show an improvement of the response time by a factor of 2 in comparison to other systems exploiting this kind of hydrogel.
Beate Oswald-Tranta
J. Sens. Sens. Syst., 7, 13–20, https://doi.org/10.5194/jsss-7-13-2018, https://doi.org/10.5194/jsss-7-13-2018, 2018
Short summary
Short summary
Images of an infrared camera show blurring effects while recording a moving object. Not only the contrast is corrupted by the motion but also the object temperature seems to be lower. It is shown how such images and the true temperature with a good approximation can be restored. Since the detection mechanism of an infrared camera is different from usual digital cameras, also the restoration is different. Examples are presented for motion deblurring used to restore images with different motions.
Roberto Marsili and Gianluca Rossi
J. Sens. Sens. Syst., 6, 361–365, https://doi.org/10.5194/jsss-6-361-2017, https://doi.org/10.5194/jsss-6-361-2017, 2017
Short summary
Short summary
The car production industry is being subjected to more and more pressing technological challenges. In this framework the use of an advanced measurement technique such as thermoelasticity allows the engineers to have a fast and reliable tool for experimental investigation, optimization and validation of the FEM models. In this work it is shown how the thermoelastic measurement technique can be used to optimize a Ferrari car frame.
Christian Rogge, Steffen Zinn, Paolo Prosposito, Roberto Francini, and Andreas H. Foitzik
J. Sens. Sens. Syst., 6, 351–359, https://doi.org/10.5194/jsss-6-351-2017, https://doi.org/10.5194/jsss-6-351-2017, 2017
Short summary
Short summary
This work presents a cost-effective optical-based sensor for pH monitoring of sample volumes less than 150 µL. As part of a bigger project to develop a stand-alone micro bioreactor system, measurements carried out with phenol red and DMEM reported a standard error of calibration in the physiologic pH range (6.5–7.5) of pH ±0.04. Compared to other accessible optical-based sensors this reported system is a good alternative regarding the overall costs of less than EUR 50.
Henrik Zimmermann, Mathias Wiese, Luigi Fiorani, and Alessandro Ragnoni
J. Sens. Sens. Syst., 6, 155–161, https://doi.org/10.5194/jsss-6-155-2017, https://doi.org/10.5194/jsss-6-155-2017, 2017
Short summary
Short summary
Because of their direct impact on patients, medical supply lines are under strict regulations and have to be monitored in terms of purity on a regular basis. State-of-the-art measurement solutions do not allow for continuous bedside monitoring. The aim of the presented work is to provide a compact multispecies monitoring system based on the latest quantum cascade laser technologies allowing for the continuous bedside monitoring of medical gases.
T. Ott, M. Schossig, V. Norkus, and G. Gerlach
J. Sens. Sens. Syst., 4, 313–319, https://doi.org/10.5194/jsss-4-313-2015, https://doi.org/10.5194/jsss-4-313-2015, 2015
M. Mohebbi
J. Sens. Sens. Syst., 4, 209–215, https://doi.org/10.5194/jsss-4-209-2015, https://doi.org/10.5194/jsss-4-209-2015, 2015
F. Vita, C. Kern, and S. Inguaggiato
J. Sens. Sens. Syst., 3, 355–367, https://doi.org/10.5194/jsss-3-355-2014, https://doi.org/10.5194/jsss-3-355-2014, 2014
U. Kienitz
J. Sens. Sens. Syst., 3, 265–271, https://doi.org/10.5194/jsss-3-265-2014, https://doi.org/10.5194/jsss-3-265-2014, 2014
T. Bley, E. Pignanelli, and A. Schütze
J. Sens. Sens. Syst., 3, 121–132, https://doi.org/10.5194/jsss-3-121-2014, https://doi.org/10.5194/jsss-3-121-2014, 2014
Cited articles
Alatise, M. B. and Hancke, G. P.: A Review on Challenges of Autonomous Mobile Robot and Sensor Fusion Methods, IEEE Access, 8, 39830–39846, https://doi.org/10.1109/ACCESS.2020.2975643, 2020. a
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., and Zisserman, A.: The Pascal Visual Object Classes (VOC) Challenge, Int. J. Comput. Vis., 88, 303–338, https://doi.org/10.1007/s11263-009-0275-4, 2010. a, b, c
FLIR, C. S.: FLIR T420 & T440, FLIR Commercial Systems, http://www.flirmedia.com/MMC/THG/Brochures/IND_003/IND_003_EN.pdf (last access: 6 August 2024), 2013. a
Fraden, J.: Handbook of Modern Sensors: Physics, Designs, and Applications, Springer International Publishing, Cham, ISBN 978-3-319-19302-1 978-3-319-19303-8, https://doi.org/10.1007/978-3-319-19303-8, 2016. a
Gebhardt, E. and Wolf, M.: CAMEL Dataset for Visual and Thermal Infrared Multiple Object Detection and Tracking, in: 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 1–6 pp., https://doi.org/10.1109/AVSS.2018.8639094, 2018. a
Girshick, R.: Fast R-CNN, in: Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), ICCV '15, 1440–1448 pp., IEEE Computer Society, USA, ISBN 978-1-4673-8391-2, https://doi.org/10.1109/ICCV.2015.169, 2015. a
Girshick, R., Donahue, J., Darrell, T., and Malik, J.: Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation, in: 2014 IEEE Conference on Computer Vision and Pattern Recognition, 580–587 pp., https://doi.org/10.1109/CVPR.2014.81, ISSN 1063-6919, 2014. a
Han, Y.: Comparison on Object Detection Algorithms: A Taxonomy, in: 2022 3rd International Conference on Electronic Communication and Artificial Intelligence (IWECAI), 204–208 pp., https://doi.org/10.1109/IWECAI55315.2022.00047, 2022. a
Hanson, N., Pyatski, B., Hibbard, S., DiMarzio, C., and Padır, T.: Hyper-Drive: Visible-Short Wave Infrared Hyperspectral Imaging Datasets for Robots in Unstructured Environments, in: 2023 13th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS), 1–5 pp., https://doi.org/10.1109/WHISPERS61460.2023.10430802, ISSN: 2158-6276, 2023. a
He, K., Zhang, X., Ren, S., and Sun, J.: Deep Residual Learning for Image Recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770–778 pp., https://doi.org/10.1109/CVPR.2016.90, ISSN 1063-6919, 2016a. a, b
He, K., Zhang, X., Ren, S., and Sun, J.: Identity Mappings in Deep Residual Networks, in: Computer Vision – ECCV 2016, edited by: Leibe, B., Matas, J., Sebe, N., and Welling, M., 630–645 pp., Springer International Publishing, Cham, ISBN 978-3-319-46493-0, https://doi.org/10.1007/978-3-319-46493-0_38, 2016b. a
Himmelsbach, U. B., Süme, S., and Wendt, T. M.: Classification of Thermal Images for Human-Machine Differentiation in Human-Robot Collaboration Using Convolutional Neural Networks, in: 2023 20th International Conference on Ubiquitous Robots (UR), 730–734 pp., IEEE, Honolulu, HI, USA, ISBN 9798350335170, https://doi.org/10.1109/UR57808.2023.10202384, 2023. a
Khosravy, M., Gupta, N., Pasquali, A., Dey, N., Crespo, R. G., and Witkowski, O.: Human-Collaborative Artificial Intelligence Along With Social Values in Industry 5.0: A Survey of the State-of-the-Art, IEEE T. Cog. Develop. Syst., 16, 165–176, https://doi.org/10.1109/TCDS.2023.3326192, 2024. a
Lapuschkin, S., Wäldchen, S., Binder, A., Montavon, G., Samek, W., and Müller, K.-R.: Unmasking Clever Hans predictors and assessing what machines really learn, Nature Publishing Group, Nat. Commun., 10, 1096, https://doi.org/10.1038/s41467-019-08987-4, 2019. a
Lee, A. J., Cho, Y., Shin, Y.-s., Kim, A., and Myung, H.: ViViD++: Vision for Visibility Dataset, IEEE Robot. Auto. Lett., 7, 6282–6289, https://doi.org/10.1109/LRA.2022.3168335, 2022. a
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., and Dollár, P.: Microsoft COCO: Common Objects in Context, http://arxiv.org/abs/1405.0312 (last access: 26 August 2024), 2015. a
Maningo, J. M., Amoroso, M. C. C., Atienza, K. R., Ladera, R. K., Menodiado, N. M., Ambata, L. U., Cabatuan, M. K., Sybingco, E., Bandala, A., Española, J., and Vicerra, R. R.: Thermal Imaging Dataset for Human Presence Detection, in: 2023 8th International Conference on Business and Industrial Research (ICBIR), 1159–1164 pp., https://doi.org/10.1109/ICBIR57571.2023.10147404, 2023. a
Noh, D., Sung, C., Uhm, T., Lee, W., Lim, H., Choi, J., Lee, K., Hong, D., Um, D., Chung, I., Shin, H., Kim, M., Kim, H.-R., Baek, S., and Myung, H.: X-MAS: Extremely Large-Scale Multi-Modal Sensor Dataset for Outdoor Surveillance in Real Environments, IEEE Robo. Auto. Lett., 8, 1093–1100, https://doi.org/10.1109/LRA.2023.3236569, 2023. a
Padilla, R., Netto, S. L., and Da Silva, E. A. B.: A Survey on Performance Metrics for Object-Detection Algorithms, in: 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), 237–242 pp., IEEE, Niterói, Brazil, ISBN 978-1-72817-539-3, https://doi.org/10.1109/IWSSIP48289.2020.9145130, 2020. a, b
Proia, S., Carli, R., Cavone, G., and Dotoli, M.: Control Techniques for Safe, Ergonomic, and Efficient Human-Robot Collaboration in the Digital Industry: A Survey, IEEE T. Auto. Sci. Eng., 19, 1798–1819, https://doi.org/10.1109/TASE.2021.3131011, 2022. a
Redmon, J. and Farhadi, A.: YOLO9000: Better, Faster, Stronger, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 6517–6525 pp., https://doi.org/10.1109/CVPR.2017.690, ISSN 1063-6919, 2017. a
Redmon, J. and Farhadi, A.: YOLOv3: An Incremental Improvement, CoRR, abs/1804.02767, https://doi.org/10.48550/arXiv.1804.02767, 2018. a
Redmon, J., Divvala, S., Girshick, R., and Farhadi, A.: You Only Look Once: Unified, Real-Time Object Detection, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 779–788 pp., https://doi.org/10.1109/CVPR.2016.91, ISSN 1063-6919, 2016. a
Ren, S., He, K., Girshick, R., and Sun, J.: Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks, IEEE Trans. Pattern Anal. Mach. Intell., 39, 1137–1149, https://doi.org/10.1109/TPAMI.2016.2577031, 2015. a
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., and Fei-Fei, L.: ImageNet Large Scale Visual Recognition Challenge, Int. J. Comput. Vision, 115, 211–252, https://doi.org/10.1007/s11263-015-0816-y, 2015. a
Salton, G. and McGill, M. J.: Introduction to modern information retrieval, McGraw-Hill computer science series, McGraw-Hill, New York, ISBN 978-0-07-054484-0, 1983. a
Shf, P. and Zhao, C.: Review on Deep based Object Detection, in: 2020 International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI), 372–377 pp., https://doi.org/10.1109/ICHCI51889.2020.00085, 2020. a, b
Simonyan, K. and Zisserman, A.: Very deep convolutional networks for large-scale image recognition, 3rd International Conference on Learning Representations (ICLR 2015), https://ora.ox.ac.uk/objects/uuid:60713f18-a6d1-4d97-8f45-b60ad8aebbce (last access: 18 August 2024), 2015. a
Süme, S.: “WLRI-HRC” – A Dataset of Infrared Images for Human-Robot Collaboration in Manufacturing Environment, Sensors and Measuring Systems; 21th ITG/GMA-Symposium, Zenodo [data set], https://doi.org/10.5281/zenodo.14228565, 2024. a
Süme, S., Ponomarjova, K.-M., Wendt, T. M., and Rupitsch, S. J.: A1.3 – Differentiation of Human and Robots with Thermal Images and Convolutional Neural Network for Human-Robot Collaboration, Vorträge, 32–36 pp., https://doi.org/10.5162/sensoren2024/A1.3, 2024a. a, b
Ultralytics: YOLOv5: A state-of-the-art real-time object detection system, https://docs.ultralytics.com (last access: 8 August 2024), 2021. a
Varghese, R. and M., S.: YOLOv8: A Novel Object Detection Algorithm with Enhanced Performance and Robustness, in: 2024 International Conference on Advances in Data Engineering and Intelligent Computing Systems (ADICS), 1–6, https://doi.org/10.1109/ADICS58448.2024.10533619, 2 pp.024. a
Wang, A., Chen, H., Liu, L., Chen, K., Lin, Z., Han, J., and Ding, G.: YOLOv10: Real-Time End-to-End Object Detection, ArXiv, https://doi.org/10.48550/arXiv.2405.14458, 2024. a
Wang, C.-Y., Yeh, I.-H., and Liao, H.-Y. M.: YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information, ArXiv, https://doi.org/10.48550/arXiv.2402.13616, 2024. a
Xu, X., Wei, X., Xu, Y., Zhang, Z., Gong, K., Li, H., and Xiao, L.: InfPose: Real-Time Infrared Multi-Human Pose Estimation for Edge Devices Based on Encoder-Decoder CNN Architecture, IEEE Robo. Auto. Lett., 9, 3672–3679, https://doi.org/10.1109/LRA.2023.3303070, 2024. a
Zou, Z., Chen, K., Shi, Z., Guo, Y., and Ye, J.: Object Detection in 20 Years: A Survey, Proc. IEEE, 111, 257–276, https://doi.org/10.1109/JPROC.2023.3238524, 2023. a
Short summary
This contribution deals with the exploration of human–robot collaboration using an infrared sensor and artificial intelligence (AI) to improve the safety and efficiency of the collaboration. The main contribution is the unique thermal dataset WLRI-HRC generated in a manufacturing environment and the evaluation of the dataset using different AI network methods.
This contribution deals with the exploration of human–robot collaboration using an infrared...
Special issue