Awesome fast.ai

A personal curated list for learning fast.ai and the related

Table of Contents

• Courses

• Videos and Lectures

• Papers

• Tutorials

• Websites

• Datasets

• Frameworks

• Tools

  • Research Papers
  • Cheat Sheets

• Miscellaneous

Courses

Videos and Lectures

Papers

You can also find the most cited deep learning papers from here

1. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

   • BERT Explained: State of the art language model for NLP
   • Paper Dissected: “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding” Explained
   • BERT – State of the Art Language Model for NLP
   • in Chinese: 从Word Embedding到Bert模型—自然语言处理中的预训练技术发展史

2. Attention Is All You Need

   • Transformer: A Novel Neural Network Architecture for Language Understanding
   • Paper Dissected: “Attention is All You Need” Explained
   • Attention Augmented Convolutional Networks
   • The Illustrated Transformer
   • Video: [Transformer] Attention Is All You Need | AISC Foundational
   • Transformer Architecture: Attention Is All You Need
   • Paper in Two minutes: Attention Is All You Need
   • Let’s build ‘Attention is all you need’ — 1/2
   • Let’s build ‘Attention is all you need’ — 2/2

3. Real-time Personalization using Embeddings for Search Ranking at Airbnb

   • Fantastic Embedding
   • in Chinese: 不一样的论文解读2018 KDD best paper: Embeddings at Airbnb

4. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer

Tutorials

1. Official Pytorch Tutorial
2. Pytorch Tutorial by Yunjey Choi

WebSites

1. fast.ai The official fast.ai website
2. Machine Learning Explained Deep learning, python, data wrangling and other machine learning related topics explained for practitioners
3. lyrn.ai DEEP LEARNING EXPLAINED
4. Papers with Code a free and open resource with Machine Learning papers, code and evaluation tables
5. Jay Alammar's Tech Blog Visualizing machine learning one concept at a time
6. mc.ai Aggregated news around AI and co

Datasets

Frameworks

1. PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration

Tools

Research Papers

1. Arxiv Sanity Preserver Built in spare time by @karpathy to accelerate research
2. Deep Learning Monitor help you to focus on your own research while monitoring the research field you care about
3. SciHive a free, open-source tool that is built by researchers for researchers
4. IMPORT AI Import AI is a weekly newsletter about artificial intelligence

Cheat Sheets

1. Python Cheatsheet
2. Python Crash Course - Cheat Sheets
3. Data Science Cheatsheets
4. 7+ Python Cheat Sheets for Beginners and Experts

Miscellaneous