119 points ibobev 1 hour ago 12 comments
prideout 1 hour ago | parent
My favorite little book is François Fleuret's: The Little Book of Deep Learning
https://fleuret.org/francois/lbdl.html
arcanemachiner 1 hour ago | parent
I love how that site offers a phone-formatted PDF as an option. How thoughtful!
CamperBob2 1 hour ago | parent
It's a nice treatment of the subject, but I wish he would post a conventionally-formatted .PDF that puts every page on a full sheet of standard printer paper.
bscphil 42 minutes ago | parent
I immediately wanted the same thing, so I made it. The book is licensed Creative Commons BY-NC-SA 4.0 International License, so here you go.
https://cdn.filepost.dev/file/filepost/uploads/15/1578f21219...
CamperBob2 18 minutes ago | parent
Thanks!
amplifydev 1 hour ago | parent
Interesting!
Is there any one who have recommended books on the attention architecture specifically? I have been interested in that for a long time but never gotten around to actually studying it.
achandra03 1 hour ago | parent
Not a book, but 3blue1brown's video on attention is pretty great: https://www.youtube.com/watch?v=eMlx5fFNoYc
horseloverthin 49 minutes ago | parent
formal algorithms for transformers provides perhaps the most succinct introduction to attention I can imagine
https://arxiv.org/pdf/2207.09238
nblgbg 26 minutes ago | parent
Are there any deep learning books with some problems to solve ?
p1esk 25 minutes ago | parent
Wow, this book is surprisingly readable! I like how he starts from basics of linear algebra.