Advancing Interpretability in Sequential Models Through Generative AI Rationalization Using GPT-4

Mohammed Rasol Al Saidat; Khaled Shaalan; Suliman Yemria

Advancing Interpretability in Sequential Models Through Generative AI Rationalization Using GPT-4

Date

2025

Authors

Mohammed Rasol Al Saidat

Khaled Shaalan

Suliman Yemria

Publisher

Springer Cham

Abstract

In this study, we investigate the role of Generative Pre-trained Transformer 4 (GPT-4) in enhancing interpretability of sequential predictions in Natural Language Processing (NLP). Our study introduces a hybrid model that integrates traditional sequential prediction models with GPT-4, aiming to generate detailed, context-sensitive explanations for model outputs. This approach is rooted in the use of advanced transformer architectures and a specialized tokenization method that maintains semantic coherence, allowing for deep contextual analysis by GPT-4. Additionally, we devise a rationale generation algorithm that achieves a balance between succinctness and informativeness. Our experimental validation spans across various high-dimensional datasets, including financial time-series and multilingual texts, employing both qualitative and quantitative metrics to evaluate the model’s performance. These metrics focus on the plausibility and consistency of the rationales, as well as the model’s predictive accuracy. Preliminary results demonstrate that our approach not only enhances the accuracy of sequential predictions but also significantly improves their interpretability. This finding highlights the potential of generative AI to bridge the gap between complex AI decision-making processes. This research underscores the viability of employing generative AI to elucidate the underlying mechanisms of sequential prediction models, paving the way for more transparent AI systems.

Citation

Al Saidat, M.R., Shaalan, K., Yemria, S. (2025). Advancing Interpretability in Sequential Models Through Generative AI Rationalization Using GPT-4. In: Al Marri, K., Mir, F.A., Awad, A., Abubakar, A. (eds) BUiD Doctoral Research Conference 2024. BDRC 2024. Lecture Notes in Civil Engineering, vol 587. Springer, Cham. https://doi.org/10.1007/978-3-031-84371-6_3