Book a demo

Cut patent&paper research from weeks to hours with PatSnap Eureka AI!

Try now

Multi-spectral thermal imaging for PV fault detection

Multi-Spectral Thermal Imaging for PV Fault Detection — PatSnap Insights
Energy Technology

Multi-spectral thermal imaging deployed via UAVs, combined with AI-driven analytics, is transforming early fault detection in utility-scale photovoltaic string monitoring — reducing inspection time at a 30 MW plant from 210 days to hours while achieving over 90% fault classification accuracy. Drawing on more than 50 patents and peer-reviewed studies from 2015–2024, this article maps the dominant technical approaches and leading innovators shaping the field.

PatSnap Insights Team Innovation Intelligence Analysts 11 min read
Share
Reviewed by the PatSnap Insights editorial team ·

How thermal signatures reveal PV faults before electrical degradation is visible

Infrared thermography detects photovoltaic faults by capturing the spatial distribution of radiant heat across module surfaces — cells operating under degraded conditions dissipate electrical energy as heat rather than converting it to power, producing characteristic thermal signatures detectable well before electrical performance visibly degrades. A power balance equation applied to IR temperature maps, as demonstrated by the University of Naples Federico II (2021), enables cell-level estimation of electrical power generated or dissipated — a quantitative diagnostic that goes beyond simple thermal contrast thresholding and was validated against 3D numerical simulations of malfunctioning panels.

50+
Patents & peer-reviewed studies analysed (2015–2024)
17,142
PV modules in the largest on-site thermographic defect study (Univ. of Valladolid, 2019)
4.3M
IR images in Forschungszentrum Jülich’s AI training dataset (2021)
99.3%
Of 35,084 modules georeferenced automatically via structure-from-motion (Jülich, 2022)

The taxonomy of thermographic fault signatures was established empirically by the University of Valladolid (2019) in a comprehensive on-site study covering 17,142 monocrystalline modules. Five distinct defect modes were classified: hotspot in a cell, bypass circuit overheating, hotspot in the junction box, hotspot at the busbar connection, and general module degradation. This signature taxonomy is foundational for any automated classification system built on top of thermal imagery.

Research from the University of Valladolid (2019), covering 17,142 monocrystalline PV modules, classified five distinct thermographic defect modes: hotspot in a cell, bypass circuit overheating, hotspot in the junction box, hotspot at the busbar connection, and general module degradation.

Complementary findings from Universidad de Valladolid (2020) showed that illuminated and dark-condition thermography provide complementary diagnostic information for the same defect types — a result with direct implications for utility-scale inspection scheduling, since different lighting conditions expose different fault signatures in the same module.

The most dangerous fault category — low-resistance hotspots caused by crystal defects — is analysed in depth by Yangzhou University (2022). Crystal defects create a shunt resistance path that, under partial shading, drives severe localised temperature rises capable of accelerating ageing and igniting fires. Detection of such low-resistance faults before they cause irreversible damage requires both thermal imaging sensitivity and correlation with I-V curve analysis — illustrating why multi-spectral, multi-parameter approaches outperform single-modality inspection.

What is a low-resistance hotspot?

A low-resistance hotspot occurs when crystal defects in a PV cell create a shunt resistance path. Under partial shading, this drives severe localised temperature rises capable of accelerating module ageing and, in extreme cases, igniting fires. These faults require both thermal imaging and I-V curve correlation to detect reliably before irreversible damage occurs.

Figure 1 — Five thermographic defect modes in photovoltaic modules (University of Valladolid, 2019)
Five thermographic defect modes classified in photovoltaic module inspection — PV fault detection taxonomy 4 3 2 1 0 Detection Priority Highest High Medium Medium Lower Hotspot in Cell Bypass Circuit Overheating Junction Box Hotspot Busbar Hotspot General Degradation Five defect modes classified across 17,142 modules · University of Valladolid, 2019
The University of Valladolid’s on-site study across 17,142 monocrystalline modules established five distinct thermographic defect modes, providing the foundational taxonomy for automated PV fault classification systems. Detection priority reflects fire risk and production impact as described in the source study.

A critical insight from the University of Oslo (2020), combining aerial IR thermography with inverter production data across two utility-scale plants, is that the most critical determinant of string-level production loss is the number of module substrings containing thermal anomalies — not simply the magnitude of individual hotspot temperatures. This finding directly motivates systematic multi-module, string-resolved thermal monitoring rather than spot checks of peak-temperature modules alone.

The University of Oslo (2020) found that string-level production loss in utility-scale PV plants is determined by the number of module substrings containing thermal anomalies — not the peak temperature of individual hotspots — making systematic multi-module thermal mapping across full strings essential.

UAV multi-modal deployment: compressing 210 days of inspection into hours

UAV-mounted thermal systems reduce plant-wide hotspot inspection at a 30 MW facility from up to 210 days — the time required using conventional ground-level methods across 126,000 modules and 60 hectares — to hours or days, while enabling real-time georeferenced anomaly mapping. This scale problem, quantified by Universitas Indonesia (2020), is the central economic driver behind aerial multi-spectral inspection at utility scale.

“A 30 MW plant with 126,000 modules and 60 hectares requires up to 210 days for complete hotspot inspection using conventional methods. UAV-mounted thermal systems reduce this to hours or days while enabling real-time georeferenced anomaly mapping.”

The integration of optical RGB and thermal infrared sensors on a single UAV platform is the dominant multi-spectral deployment strategy. Chungbuk National University (2019) demonstrated that simultaneous optical and thermal infrared imaging allows production of orthographic thermal maps with accurate spatial coordinates, enabling precise localisation of faults within large string arrays. The complementarity of the two spectral modalities — RGB for structural context and soiling detection, IR for thermal anomaly identification — was explicitly leveraged by Sogang University (2019), which demonstrated improved fault localisation accuracy relative to single-sensor approaches.

Explore the full patent landscape for UAV-based PV inspection technologies in PatSnap Eureka.

Search PV Inspection Patents in PatSnap Eureka →

A two-stage inspection strategy that combines the speed advantages of aerial IR with the resolution advantages of ground-level imaging was formalised by the University of Cádiz (2022). Stage one uses UAV-based thermal imaging for rapid plant-wide fault detection and localisation; stage two deploys ground-level high-resolution inspection only on flagged modules. This hierarchical multi-spectral approach substantially reduces total inspection time and cost at utility scale while maintaining diagnostic resolution for critical faults.

Figure 2 — Two-stage hierarchical PV inspection workflow (University of Cádiz, 2022)
Two-stage hierarchical photovoltaic inspection workflow — UAV thermal imaging and ground-level fault resolution Stage 1 UAV Aerial IR Survey Plant-wide triage Flag anomalous modules Stage 2 Ground-level HR inspection of flagged Speed: hours/days RGB + IR fusion Resolution: cell-level
The University of Cádiz’s two-stage strategy uses rapid UAV aerial IR for plant-wide triage, then targets ground-level high-resolution imaging only on flagged modules — substantially reducing total inspection time and cost while preserving diagnostic resolution.

Hyperspectral imaging extends multi-spectral capability beyond the thermal band. China Southern Power Grid Energy Efficiency and Clean Energy Co. (2023) demonstrated that constrained energy minimization (CEM) and orthogonal subspace projection (OSP) applied to hyperspectral UAV imagery can detect surface stains on PV modules by exploiting known spectral signatures of clean versus contaminated panel surfaces — a capability invisible to single-band thermal cameras. This work, reported by IEEE-affiliated researchers, represents the leading edge of multi-spectral PV inspection beyond the thermal band.

Hyperspectral UAV imaging using constrained energy minimization (CEM) and orthogonal subspace projection (OSP), demonstrated by China Southern Power Grid Energy Efficiency and Clean Energy Co. (2023), can detect surface stains on PV modules that are invisible to single-band thermal cameras.

Georeferencing of large-scale thermal inspection data was addressed by Forschungszentrum Jülich (2022), which used structure-from-motion to automatically assign geocoordinates to 99.3% of 35,084 modules across four large-scale plants, extracting over 2.2 million module-level IR images. This automated spatial indexing is a prerequisite for integrating aerial thermal data with plant management systems and for tracking fault evolution over successive inspection cycles.

AI-driven fault classification: from million-image datasets to 90%+ accuracy

Deep learning classifiers trained on million-image infrared datasets now achieve over 90% test accuracy across ten fault categories in utility-scale PV inspection — a capability that transforms aerial thermal data from raw imagery into actionable string-level diagnostics. The volume of imagery generated by utility-scale aerial IR inspections demands automated fault classification; manual review of millions of module images per inspection cycle is operationally infeasible.

Forschungszentrum Jülich (2021) curated a dataset of 4.3 million IR images from 107,842 PV modules across seven plants and trained a ResNet-50 classifier to identify ten common module anomalies with over 90% test accuracy. According to Nature Energy research on solar asset management, the scale of this dataset — unprecedented at time of publication — underscores the data infrastructure requirements of robust AI-driven thermal fault classification at utility scale.

Key finding: AI classification at scale

A ResNet-50 classifier trained on 4.3 million IR images from 107,842 PV modules across seven plants achieved over 90% test accuracy identifying ten common module anomalies (Forschungszentrum Jülich, 2021). The dataset of 4.3 million images was unprecedented at time of publication.

Università Politecnica delle Marche (2020) proposed a mask R-CNN architecture for anomaly cell detection in UAV-acquired thermal images, enabling pixel-level segmentation of fault regions within modules without manual intervention. Ghent University / imec (2022) contributed a region-based CNN for PV anomaly detection in aerial imagery, addressing the foundational step of automated panel segmentation in complex backgrounds. These architectures collectively enable the pipeline from raw UAV thermal video to string-level fault maps without human review of individual frames.

Figure 3 — AI model scale: training dataset sizes for PV thermal fault classification
Training dataset sizes for AI-driven photovoltaic thermal fault classification — multi-spectral PV inspection 4M 3M 2M 1M 0 IR Images (millions) 4.3M 2.2M 107K modules Jülich ResNet-50 Classifier (2021) Jülich Structure- from-Motion (2022) Ghent/imec R-CNN (2022) IR image dataset Module-level IR images Module count
Forschungszentrum Jülich’s 2021 ResNet-50 study used 4.3 million IR images from 107,842 modules across seven plants — the largest published training dataset for PV thermal fault classification at the time — achieving over 90% test accuracy across ten fault categories.

Lightweight inference models for real-time deployment in resource-constrained UAV systems were addressed by Xinjiang University (2022), which replaced YOLOv5’s feature extraction backbone with the ShuffleNetv2-based Focus structure to reduce parameter count while maintaining detection accuracy on IR image datasets. This reflects a broader trend toward edge-deployable AI for onboard UAV fault detection, reducing dependency on ground-station processing latency.

For string-level electrical anomaly detection without imaging, the University of Malaya (2019) demonstrated a wireless sensor network (WSN) that monitors real-time module operating voltage across each string, detecting faulty modules exhibiting anomalously low voltage — providing a complementary electrical diagnostic channel to thermal imaging. UAE University (2020) fused PV panel junction temperatures with electrical parameters from inverters to achieve fault nature and location identification in a dual-layer diagnostic, addressing limitations of purely thermal or purely electrical approaches at utility scale. Standards for such sensor network deployments are increasingly informed by guidelines from IEC technical committees on photovoltaic systems.

Analyse AI and deep learning patents for PV fault detection using PatSnap Eureka’s full dataset.

Explore PV AI Patents in PatSnap Eureka →

“Multi-layered fusion of thermal signatures with real-time electrical parameters from inverters enables fault localization that neither method achieves independently.” — UAE University, 2020

Key innovators and the patent landscape shaping PV thermal monitoring

Huawei Technologies is the most active patent filer in this domain, with at least three active patents (EP 2021, EP 2023, US 2024) focused on image quality optimisation and fault type identification for PV modules using light-emitting state imaging and signal-to-noise ratio (SNR) control. Huawei’s SNR optimisation method — which maximises image definition prior to fault classification — is a critical preprocessing step that reduces false positives and processing workload in automated PV fault detection systems, as protected in the US 2024 patent.

Sungrow Power Supply Co. holds active EP patents (2016, 2018) protecting current characteristic curve-based string fault identification algorithms that automate severity classification without human intervention — a key commercial capability for inverter-integrated monitoring at utility scale. These algorithms enable automated string-state determination through tangent slope differencing of current characteristic curves, without requiring thermal imaging when electrical signatures are sufficient.

Huawei Technologies holds at least three active patents (EP 2021, EP 2023, US 2024) on signal-to-noise ratio optimisation for PV module fault detection imaging. Sungrow Power Supply holds active EP patents (2016, 2018) on current characteristic curve-based string fault identification algorithms that automate severity classification without human intervention.

Academic institutions have driven the evidence base for the field. Forschungszentrum Jülich / HI ERN contributed both the large-scale IR video dataset with ResNet-50 classification (2021) and the structure-from-motion georeferencing method (2022), establishing the infrastructure for scalable automated aerial IR inspection. The University of Cádiz formalised the two-stage aerial/ground thermographic inspection strategy (2022). The University of Oslo provided the first rigorous quantitative link between thermal anomaly distribution and string-level production loss at utility scale (2020). Universidad de Valladolid produced the largest published on-site thermographic defect classification study — 17,142 modules — in 2019.

China Southern Power Grid Energy Efficiency and Clean Energy Co. is the sole assignee in this dataset deploying hyperspectral UAV imaging (2023) for stain detection using CEM and OSP spectral unmixing — representing the leading edge of multi-spectral (beyond thermal) PV inspection. Innovation trends across the dataset show a clear trajectory from single-sensor manual inspection toward multi-modal (RGB + IR + hyperspectral), AI-automated, UAV-deployed, string-resolved monitoring systems, with patent activity shifting from algorithmic fault classification toward hardware-software integration and SNR-optimised image acquisition. This trajectory aligns with broader renewable energy digitisation frameworks tracked by organisations such as IRENA in their annual innovation reports.

Honeywell International holds an EP patent (2022) covering solar panel inspection by unmanned aerial vehicle, indicating that large industrial conglomerates are entering a space previously dominated by specialist solar and academic players. The convergence of UAV hardware, multi-spectral sensors, and AI inference at the edge — as described in patent filings reviewed through EPO databases — points toward fully autonomous, continuous PV string health monitoring as the near-term commercial endpoint for this technology cluster.

Innovation trajectory: where the field is heading

Patent activity across the 2015–2024 dataset is shifting from algorithmic fault classification toward hardware-software integration and SNR-optimised image acquisition. The endpoint trajectory points toward fully autonomous, continuous PV string health monitoring combining UAV platforms, multi-spectral sensors (RGB + IR + hyperspectral), and edge-deployable AI inference.

Frequently asked questions

Multi-spectral thermal imaging for PV fault detection — key questions answered

Still have questions? Let PatSnap Eureka answer them for you.

Ask PatSnap Eureka for a deeper answer →

References

  1. Using EMPHASIS for the Thermography-Based Fault Detection in Photovoltaic Plants — University of Naples Federico II, 2021
  2. Hotspot Detection Method in Large Capacity Photovoltaic (PV) Farm — Universitas Indonesia, 2020
  3. How much power is lost in a hot-spot? A case study quantifying the effect of thermal anomalies in two utility scale PV power plants — University of Oslo, 2020
  4. Analysis and characterization of PV module defects by thermographic inspection — University of Valladolid, 2019
  5. Infrared Thermography for the Detection and Characterization of Photovoltaic Defects: Comparison between Illumination and Dark Conditions — Universidad de Valladolid, 2020
  6. Low Resistance Hot-Spot Diagnosis and Suppression of Photovoltaic Module Based on I-U Characteristic Analysis — Yangzhou University, 2022
  7. Strategy Based on Two Stages for IR Thermographic Inspections of Photovoltaic Plants — University of Cádiz, 2022
  8. Stain Detection Based on Unmanned Aerial Vehicle Hyperspectral Photovoltaic Module — China Southern Power Grid Energy Efficiency and Clean Energy Co., 2023
  9. Developing Inspection Methodology of Solar Energy Plants by Thermal Infrared Sensor on Board Unmanned Aerial Vehicles — Chungbuk National University, 2019
  10. Precise Inspection Method of Solar Photovoltaic Panel Using Optical and Thermal Infrared Sensor Image Taken by Drones — Sogang University, 2019
  11. Automatic Faults Detection of Photovoltaic Farms: solAIr, a Deep Learning-Based System for Thermal Images — Università Politecnica delle Marche, 2020
  12. Computer vision tool for detection, mapping, and fault classification of photovoltaics modules in aerial IR videos — Forschungszentrum Jülich / HI ERN, 2021
  13. Georeferencing of photovoltaic modules from aerial infrared videos using structure-from-motion — Forschungszentrum Jülich / HI ERN, 2022
  14. Lightweight Hot-Spot Fault Detection Model of Photovoltaic Panels in UAV Remote-Sensing Image — Xinjiang University, 2022
  15. Analysis of Photovoltaic String Failure and Health Monitoring with Module Fault Identification — University of Malaya, 2019
  16. An Online Novel Two-Layered Photovoltaic Fault Monitoring Technique Based Upon the Thermal Signatures — UAE University, 2020
  17. Fault detection method and fault detection apparatus for photovoltaic assembly — Huawei Technologies Co., Ltd., EP 2023
  18. Fault detection method, fault detection apparatus for photovoltaic module and computer-readable storage medium — Huawei Technologies Co., Ltd., US 2024
  19. Photovoltaic string fault identification method, apparatus and system — Sungrow Power Supply Co., Ltd., EP 2016
  20. Photovoltaic string fault identification method, apparatus and system — Sungrow Power Supply Co., Ltd., EP 2018
  21. Region-Based CNN for Anomaly Detection in PV Power Plants Using Aerial Imagery — Ghent University / imec, 2022
  22. Solar Panel Detection within Complex Backgrounds Using Thermal Images Acquired by UAVs — Ghent University, 2020
  23. Automatic Inspection of Photovoltaic Power Plants Using Aerial Infrared Thermography: A Review — Amirkabir University of Technology, 2022
  24. On Field Infrared Thermography Sensing for PV System Efficiency Assessment: Results and Comparison with Electrical Models — University of L’Aquila, 2020
  25. Solar panel inspection by unmanned aerial vehicle — Honeywell International Inc., EP 2022
  26. European Patent Office (EPO) — Patent database for PV inspection technologies
  27. International Renewable Energy Agency (IRENA) — Renewable energy innovation reports
  28. International Electrotechnical Commission (IEC) — Standards for photovoltaic systems and sensor networks

All data and statistics in this article are sourced from the references above and from PatSnap‘s proprietary innovation intelligence platform.

Your Agentic AI Partner
for Smarter Innovation

PatSnap fuses the world’s largest proprietary innovation dataset with cutting-edge AI to
supercharge R&D, IP strategy, materials science, and drug discovery.

Book a demo