Tag: Pytorch

Carlo Lepelaars

Transformer, Attention is all you need

Transformer Deep Dive blog post

“If you want to learn something well, explain it.” – Richard Feynman Over the Christmas break I wrote a deep dive about the fundamental building block of so many awesome AI models nowadays (GPT-3, DALL-E, etc.): Transformers! Includes background, PyTorch code and formulas. Hope you learn as much from it as I did writing it!…
Read more

Kaggle, Deepfake, Face detection

79st Place Silver Solution in Kaggle’s Deepfake Detection Competition!

Happy to say that our team got 79st place in Kaggle’s Deepfake Detection competition! This is sufficient for a silver medal. In this blog post I will give an overview of our solution. In essence, we tried to include as much model diversity in our ensemble as possible in order to survive a leaderboard shakeup.…
Read more

Recent Comments

    @carlolepelaars

    ©  2024 Carlo Lepelaars.