بررسی شبکه عصبی فوریه مبتنی بر ترانسفورمرها به‌منظور پیش‌بینی شاخص FDSD (مطالعه موردی: استان ایلام)

نوع مقاله : مقاله پژوهشی

نویسندگان

1 گروه مهندسی احیاء مناطق خشک و کوهستانی، دانشکده منابع طبیعی، دانشگاه تهران

2 استادیار، گروه مهندسی احیاء مناطق خشک و کوهستانی، دانشکده منابع طبیعی، دانشگاه تهران، کرج، ایران.

‎10.22052/deej.2026.258310.1137

چکیده

طوفان‌های گردوغبار به‌عنوان یکی از انواع اصلی پدیده‌هایِ حدی اقلیمی شدید به‌ویژه در مناطق خشک و نیمه‌خشک محسوب می‌شوند و تأثیرات قابل‌توجهی بر سلامت، محیط‌زیست و مدیریت منابع طبیعی دارند. پیش‌بینی دقیق این پدیده همچنان با دشواری‌های جدی مواجه است. مطالعه حاضر قابلیت مدل‌هایِ یادگیریِ عمیق مدرن برای پیش‌بینیِ طوفان‌هایِ گردوغبار را با مقایسه عملکرد دو مدل انفرادی، Autoformer، FNO و یک چارچوب هیبریدی بر اساس ترکیب دو مدل برای مقیاس‌های زمانی مختلف بررسی کرد. باتوجه به نتایج به‌دست‌آمده، مدل هیبریدیِ FNO-AutoFormer بالاترین دقت پیش‌بینی را در تمامی شاخص‌های ارزیابی ارائه داد. مقادیر شاخص NS بالای 932/0، مقدار همبستگی بیش از 914/0 و همچنین کاهش قابل‌توجه خطاهای RMSE و MAE و ثبت مقادیر خطای 265/0 و 179/0 به ترتیب برای شاخص‌ها، عملکرد بهتر مدل‌های ترکیبی به نسبت مدل‌های انفرادی در پیش‌بینی پدیده‌های حدی اقلیمی نشان داد. همچنین یافته‌های پژوهش حاضر ثابت کرد که به‌منظور پیش‌بینی طوفان‌های گردوغبار برای نقاطی که عامل خارجی باعث گردوغبار می‌شود، ترکیب‌های زمانی کوتاه‌مدت به‌ویژه ترکیب پیش‌بینی با یک فصل تأخیر، بهترین عملکرد دارند و دقت پیش‌بینی با افزایش تأخیر زمانی کاهش می‌یابد.

کلیدواژه‌ها

موضوعات


عنوان مقاله [English]

Investigation of a Transformer-Based Fourier Neural Network for FDSD Index Prediction in Ilam Province

نویسندگان [English]

  • Ramtin Tavoosi Rad 1
  • Mohammad Ansari Ghojghar 2
  • Hassan Khosravi 1
1 Department of Reclamation of Arid and Mountainous regions Engineering, Faculty of Natural Resources, University of Tehran
2 Assistant professor, Department of reclamation of arid and mountainous regions Engineering, Faculty of Natural Resources, University of Tehran, Karaj, Iran.
چکیده [English]

Introduction: Dust storms are considered one of the most significant extreme climate phenomena in arid and semi-arid regions, with widespread consequences for health, the environment, and natural resource management. Despite extensive research efforts, accurately predicting the occurrence and intensity of dust storms remains a substantial scientific challenge due to the nonlinear, multiscale, and highly dynamic interactions among atmospheric, land surface, and climatic factors. Traditional numerical and statistical models often struggle to capture such complex relationships, leading to considerable uncertainties in forecasts. In this context, recent advances in deep learning have opened new avenues for modeling complex environmental phenomena. Deep learning models, particularly those capable of learning long-term temporal dependencies and spatial patterns, offer promising tools for improving dust storm prediction. This research, which aims to evaluate the capabilities of novel deep learning models for predicting dust storms, investigated the performance of two individual models—Autoformer and Fourier Neural Operator (FNO)—as well as a hybrid framework based on the combination of these two models across several temporal configurations.
Materials and Methods: This research aims to improve the accuracy of dust storm forecasting by evaluating the predictive performance of advanced deep learning models under different temporal input structures. Two modern architectures were selected for this purpose: the Autoformer model, known for its ability to capture long-term temporal dependencies in time series data, and the Fourier Neural Operator (FNO), which is specifically designed to learn complex spatial-spectral patterns through frequency-domain representations. In addition to assessing these models individually, a hybrid FNO-Autoformer framework was developed to combine their complementary strengths. The dust storm intensity index, representing the severity and frequency of dust events, was selected as the target variable. Ilam Province was chosen as the case study area due to its high exposure to dust storm activity and its climatic vulnerability. To investigate the influence of temporal input structure on model performance, four distinct temporal configurations were designed, ranging from short-term to long-term forecasting horizons. These configurations included time lags from one season up to one year, enabling a comprehensive analysis of how prediction horizon affects model accuracy. Following appropriate pre-processing, the data were divided into training (80%) and testing (20%) sets. Model performance was evaluated using the following statistical metrics: Nash–Sutcliffe efficiency (NS), root mean square error (RMSE), mean absolute error (MAE), and correlation coefficient (R).
Results: The results of this study revealed that the Autoformer model exhibited the weakest performance in predicting the FDSD index across all temporal configurations and was associated with relatively high error in reproducing extreme variations in dust storms. Although the FNO model performed better than Autoformer in extracting spatio-temporal patterns, as a standalone model it still did not achieve acceptable forecasting accuracy and showed no significant difference from Autoformer. In contrast, the hybrid FNO-Autoformer model, by integrating the strengths of FNO in learning spatio-spectral patterns and the capability of Autoformer in modeling long-term temporal dependencies, demonstrably provided the best performance across all evaluation metrics. High values of the NS index, a significant reduction in RMSE and MAE errors, and an increase in the correlation coefficient confirmed the clear superiority of this hybrid framework over the individual models. The results also indicated that short-term temporal configurations, particularly forecasts with a one-season lag, achieved the highest accuracy, and that the models' forecasting accuracy decreased with increasing time lag. This finding highlights the sensitivity of data-driven models to the temporal structure of inputs and the importance of selecting an optimal prediction horizon in dust storm modeling.
Discussion and conclusion: Overall, the findings of this research emphasize the crucial role of hybrid spatio-temporal frameworks in predicting extreme climate events and demonstrate that integrating Fourier Neural Operators with transformer-based models can represent an effective step toward developing more accurate forecasting systems and reducing uncertainty in dust hazard management. The study also highlights the strong influence of temporal input configuration on forecasting outcomes, suggesting that careful consideration of time lag selection is essential for optimizing model performance. From a practical perspective, improved dust storm prediction can contribute to more effective early warning systems, risk mitigation strategies, and sustainable environmental management. Moreover, the successful integration of spectral neural operators with transformer-based architectures represents a promising direction for future research in climate hazard modeling. Such hybrid approaches have the potential to reduce predictive uncertainty, support decision-making processes, and enhance resilience to extreme climatic events in vulnerable regions.

کلیدواژه‌ها [English]

  • Dust
  • Data-driven models
  • Hybrid models
  • FNO
  1. Ansari ghojghar, M., Piri, S., Rad, R.T., Malekian, A. 2025. Predicting the dust storms using three‑hybrid metamodels for integrated dust storm management (case study: Khuzestan Province, Iran). International Journal of Environmental Science and Technology 23:81.

 https://doi.org/10.1007/s13762-25-06944 - x

  1. Ansari ghojghar, M., Pourmohammad, P., 2025. Comparative Analysis of Dust Storm Frequency Modeling Using the XGBoost Machine Learning Model and the Element-Free Galerkin Method (Case study: Ilam Province). Iranian Journal of Soil and Water Research 56(6), 1421-1436(in persian). doi:10.22059/ijswr.2025.392122.669904
  2. Ansari ghojghar, M., bazrafshan, J., Araghinejad, S., 2022. Evaluating the Efficiency of Hybrid Metamodels of Machine Learning and Box Jenkins in Order to Model Dust Storms (Case Study: Khuzestan Province). Iranian Journal of Soil and Water Research 53(8), 1695-1714(in persian). doi:10.22059/ijswr.2022.346694.669335
  3. Alshammari, R. K., Alrwais, O., Aksoy, M. S.2024. Machine Learning Forecast of Dust Storm Frequency in Saudi Arabia Using Multiple Features. Atmosphere 15(5), 520. https://doi.org/10.3390/atmos15050520
  4. Bahrami, H.A., Jalali, M., Darvishi Boloorani, A., Azizi, R., 2014. Spatial-temporal modeling of dust storms in Khuzestan Province. Iranian Journal of Remote Sensing and GIS 5(2), 95-114(in persian).
  5. Caetano, R., Oliveira, J. M., Ramos, P., 2025. Transformer-Based Models for Probabilistic Time Series Forecasting with Explanatory Variables. Mathematics 13(5), 814. https://doi.org/10.3390/math13050814
  6. Choubin, B., Hosseini, F. S., Rahmati, O., Youshanloei, M. M., & Jalali, M. (2023). Mapping of salty aeolian dust-source potential areas: Ensemble model or benchmark models?. Science of The Total Environment, 877, 163419. http://dx.doi.org/10.1016/j.scitotenv.2023.163419
  7. Costa Rocha, P. A., Thé, J. V. G., Oliveira Santos, V., Gharabaghi, B., 2025. Deep Learning for Atmospheric Modeling: A Proof of Concept Using a Fourier Neural Operator on WRF Data to Accelerate Transient Wind Forecasting at Multiple Altitudes. Atmosphere 16(4), 394. https://doi.org/10.3390/atmos16040394
  8. Duruisseaux, V., Kossaifi, J., Anandkumar, A.2025. Fourier Neural Operators Explained: A Practical Perspective. https://doi.org/10.48550/arXiv.2512.01421
  9. Gou, Z.H., Li, H.B., 2025. MgFNO: Multi-grid Architecture Fourier Neural Operator for Parametric Partial Differential Equations. arXiv:2407.08615v3
  10. Kossaifi, J., Kovachki, N., Azizzadenesheli, K., Anandkumar, A., 2023. Multi-Grid Tensorized Fourier Neural Operator for HighResolution PDEs. https://doi.org/10.48550/arXiv.2310.00120
  11. Li, Z., Kovachki, N., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A., Anandkumar, A., 2021. Fourier Neural Operator for Parametric Partial Differential Equations. https://doi.org/10.48550/arXiv.2010.08895
  12. Li, Z., Zhengyu Huang, D., Liu, B., Anandkumar, A., 2024. Fourier Neural Operator with Learned Deformations for PDEs on General Geometries. https://doi.org/10.48550/arXiv.2207.05209
  13. Mahesh, A., D.Collins, W., Bonev, B et al.2025. Huge ensembles – Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators. GMD, 18(17), 5575–5603. https://doi.org/10.5194/gmd-18-5575-2025
  14. O’Loingsigh, T., McTainsh, G. H., Tews, E. K., Strong, C. L., Leys, J. F., Shinkfield, P., Tapper, N. J., 2014. The Dust Storm Index (DSI): a method for monitoring broadscale wind erosion using meteorological records. Aeolian Research,12, 29-40.

 

  1. Papi, R., Argany, M., Moradipour, S., Soleimani, M., 2021. Modeling the potential of Sand and Dust Storm sources formation using time series of remote sensing data, fuzzy logic and artificial neural network (A Case study of Euphrates basin). jgit8(3),61-82(in persian).
  2. Pourgholam-Amiji,M. , ansarighojghar,M. , Araghinejad,S., Babaeian,I., 2021. Modeling the Relationship between Dust Storms and Extreme and Average Temperature Variables in the Western Half of Iran. Journal of Climate Research 1400(45), 113-126(in persian).
  3. Sinha, S., Benton, B., Emami, P., 2025. On the effectiveness of neural operators at zero-shot weather downscaling. Environmental Data Science, 4, 21. doi:10.1017/eds.2025.11
  4. Tavoosi Rad, R., Piri, S., Ansari ghojghar, M., Azarnivand, H., 2025. Evaluating the performance of metaheuristic algorithms for optimizing input data to model dust storms (A case study of Sistan and Baluchestan province). Climate Change Research 6 (24), 73-88 (in persian). doi: 10.30488 /ccr.2025.552548.1307
  5. Vatanparast Galeh Juq,F. , Salahi,B., Zeinali,B., 2025. Forecasting the Occurrence of Dust Storms using the Accuracy Assessment of Artificial Neural Networks in Selected Stations in the Western Half of Iran. Geography 23(84), 21-39(in persian). doi:10.22034/jiga.2025.2046840.1356
  6. Yarmohamadi, M., Alesheikh, A. A., Sharif, M. 2025. Using Hybrid Deep Learning Models to Predict Dust Storm Pathways with Enhanced Accuracy. Climate, 13(1), 16. https://doi.org/10.3390/cli13010016
  7. Wu, H., Xu, J., Wang, J., Long, M., 2021. Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting. 35th Conference on Neural Information Processing Systems. https://doi.org/10.48550/arXiv.2106.13008.