this repo for my workshop Pie & AI: Baghdad - Under the Hood of Transformer Network https://www.eventbrite.com/e/pie-ai-baghdad-under-the-hood-of-transformer-network-tickets-165821465467
the recored videos for implminting the topics of the workshop in this url https://www.youtube.com/playlist?list=PLsu_bT2-wUK6c8ZL_bScPUS1TGKTxGXgf
1- the repo contain block code for transformer implmention from zero
2- bert with tensorflow on Natural Language Processing with Disaster Tweets also can be found on kaggle via this link https://www.kaggle.com/iraqai/tf-bert-tweet-classifaction-lb0-82 / https://github.com/mamonraab/transformers-workshop-bert-Vit-Detr/blob/main/tf-bert-tweet-classifaction-lb0-82.ipynb
3- DeIT-facebook-pytorch-lightning-aug+tpu+gpu Python notebook using data from RANZCR CLiP - Catheter and Line Position Challenge notebook can be found also on kaggle https://www.kaggle.com/iraqai/deit-facebook-pytorch-lightning-aug-tpu-gpu / https://github.com/mamonraab/transformers-workshop-bert-Vit-Detr/blob/main/deit-facebook-pytorch-lightning-aug-tpu-gpu.ipynb