Sensor data preprocessing pipeline for grain temperature monitoring and forecasting datasets in drying systems

Abstract

Relevance. The quality of training data significantly affects the reliability of data-driven grain temperature forecasting systems. Sensor networks used in grain drying environments generate missing observations, measurement drift, and anomalous values caused by communication failures and sensor degradation. The absence of standardized preprocessing procedures reduces reproducibility and limits the practical applicability of predictive approaches. Purpose. The purpose of the study is to develop a methodology for sensor data collection and preprocessing intended for formation of datasets for grain temperature forecasting under continuous drying conditions. Objectives. The objectives include development of a multi-source monitoring architecture, justification of spatial sensor deployment, construction of a preprocessing pipeline for anomaly handling and missing value restoration, formation of feature vectors, and definition of a dataset partitioning strategy preserving temporal dependencies. Methods. The proposed methodology integrates digital temperature sensors, humidity sensors, carbon dioxide sensors based on non-dispersive infrared measurement, and meteorological data sources. Preprocessing consists of physical range validation, anomaly detection using the Isolation Forest algorithm, hierarchical missing value imputation, min-max normalization, cyclic temporal encoding, and chronological partitioning of datasets. Scientific novelty lies in the formalization of a topologic-spatiotemporal data validation framework that distinguishes local transducer degradation from collective thermal process transitions in non-stationary agricultural environments. This is achieved via a coupled multivariate Isolation Forest and neighbourhood graph co-occurrence heuristic that preserves high-frequency operational dynamics during continuous aeration adjustments. Practical significance. The methodology may be applied in monitoring systems for grain storage and drying installations and adapted to different silo geometries, sensor configurations, and environmental monitoring sources. Results. A monitoring architecture consisting of twelve temperature sensors arranged in three azimuthal rows and four depth levels was developed. The preprocessing procedure retained 92.5 percent of observations after anomaly filtering and missing value processing. The resulting dataset contained 34,984 usable epochs in the training partition and sixty-four features representing temperature history, neighbouring sensor values, meteorological variables, and cyclic temporal characteristics. Isolation Forest analysis identified 4.08 percent anomalous observations, of which 87.3 percent corresponded to isolated sensor faults. Conclusions. The developed methodology establishes a reproducible procedure for preparation of datasets intended for grain temperature forecasting tasks and reduces risks associated with temporal leakage, sensor faults, and inconsistent preprocessing of monitoring data. The proposed approach may serve as a basis for further development of predictive models for grain drying systems.