Tag: natural language processing

Carlo Lepelaars

Transformer, Attention is all you need

Transformer Deep Dive blog post

“If you want to learn something well, explain it.” – Richard Feynman Over the Christmas break I wrote a deep dive about the fundamental building block of so many awesome AI models nowadays (GPT-3, DALL-E, etc.): Transformers! Includes background, PyTorch code and formulas. Hope you learn as much from it as I did writing it!…
Read more

jigsaw, kaggle, silver, nlp, natural language processing

29th place silver in Jigsaw’s toxic comment classification competition

The Jigsaw Toxic Comment competition on Kaggle is finalized! Our team “No Comment” finished on 29th place out of 1,621 teams. It was loads of fun to work on this competition with Ryan Chesler and Maximilian Jeblick. Learned a lot of new things about NLP and ensembling.

Recent Comments

    @carlolepelaars

    ©  2024 Carlo Lepelaars.