The emergence of transformers in 2017 raised the standard of neural networks. Until now, the core concept of transformers has been rebounded and remixed in multiple models. The results concluded that it surpassed the state-of-the-art benchmarks on several machine learning applications.  Nevertheless,…