Outlier detection in non-stationary time series applied to sewer network monitoring - Archive ouverte HAL Access content directly
Journal Articles Internet of Things Year : 2023

Outlier detection in non-stationary time series applied to sewer network monitoring

(1) , (1) , (2) , (3) , , ,
1
2
3
Ali Shakil
  • Function : Author
Mohammad Ali Khalighi
Dominique Laplace
  • Function : Author
François Hamon
  • Function : Author
Alexandre Boudonne
  • Function : Author

Abstract

We consider the case of data processing for a sewer infrastructure where water drains are equipped with wastelevel sensors, which frequently send the related data to a data processing unit. In order to understand the dynamics of waste accumulation within the whole drain network, the collected data should first be pre-processed by removing the unreliable (or, in other words, noisy) measurements. As we show, the evolution of the waste inside a drain can be modeled by a non-stationary discontinuous time series model. Due to the chaotic aspect of the waste and the hostile conditions under which the sensor should operate, the observed time series can include outliers in the form of peaks, which should be removed from the raw data prior to any data processing. This paper proposes an efficient data cleaning algorithm that makes a good compromise between computational complexity and performance. This latter is evaluated in terms of the probabilities of peak detection (i.e., detecting actual outliers) and false detection (i.e., incorrectly denoting measurements as outliers). A trade-off between these two criteria should be made by setting appropriately the detection threshold (which, in the proposed method, does not depend on the mean or variance of the data). For instance, for a threshold of 2.5, the algorithm provides a correct outlier detection probability of 0.85 and a false detection probability of 2.5×10 −2. The efficiency of the proposed algorithm is demonstrated by applying it to real measurement data.
Fichier principal
Vignette du fichier
IEEE_IoT_Shakil_HAL.pdf (9.86 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03934419 , version 1 (11-01-2023)

Identifiers

Cite

Ali Shakil, Mohammad Ali Khalighi, Pierre Pudlo, Cyril Leclerc, Dominique Laplace, et al.. Outlier detection in non-stationary time series applied to sewer network monitoring. Internet of Things, 2023, 21, pp.100654. ⟨10.1016/j.iot.2022.100654⟩. ⟨hal-03934419⟩
0 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More