Transformer architecture have revolutionized the area of natural text processing. These sophisticated networks, pioneered in 2017, discard the traditional recurrent approach in favor of a mechanism known as self-attention , enabling them to handle sequences of data in parallel. This feature allow