Ensuring the performance of object detection systems in dynamic environments requires not only accurate predictions but also the ability to assess the certainty of those predictions. This paper proposes an interpretable framework for monitoring the Operational Design Domain (ODD) of real-time object detectors through visual feature-based certainty evaluation. Using a dual-path architecture, the system combines a standard object detection pipeline with a parallel branch that extracts visual features and classifier predictions as Certain or Uncertain using decision rules learned via Decision Trees (DTs). A Cumulative Feature Ranking (CFR) strategy ensures robust selection of discriminative features across perturbed and real-world datasets. Extensive experiments on the Pedestrian and Wheelchair object categories demonstrate the system’s ability to detect prediction uncertainty under a variety of visual conditions. The interpretable nature of the learned rules provides transparency, while the low false alarm rate demonstrates the effectiveness of the ODD checker in supporting safe and explainable perception for indoor smart mobility applications.

eXplainable Checker of Video Analytics Performance in Indoor Smart Mobility

Samandari, Ahmad;Carlevaro, Alberto;Mongelli, Maurizio
2025-01-01

Abstract

Ensuring the performance of object detection systems in dynamic environments requires not only accurate predictions but also the ability to assess the certainty of those predictions. This paper proposes an interpretable framework for monitoring the Operational Design Domain (ODD) of real-time object detectors through visual feature-based certainty evaluation. Using a dual-path architecture, the system combines a standard object detection pipeline with a parallel branch that extracts visual features and classifier predictions as Certain or Uncertain using decision rules learned via Decision Trees (DTs). A Cumulative Feature Ranking (CFR) strategy ensures robust selection of discriminative features across perturbed and real-world datasets. Extensive experiments on the Pedestrian and Wheelchair object categories demonstrate the system’s ability to detect prediction uncertainty under a variety of visual conditions. The interpretable nature of the learned rules provides transparency, while the low false alarm rate demonstrates the effectiveness of the ODD checker in supporting safe and explainable perception for indoor smart mobility applications.
2025
9783031999642
9783031999659
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11567/1272017
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact