It's a nice treatment of the subject, but I wish he would post a conventionally-formatted .PDF that puts every on a full sheet of standard printer paper.
Is there any one who have recommended books on the attention architecture specifically? I have been interested in that for a long time but never gotten around to actually studying it.
My favorite little book is François Fleuret's: The Little Book of Deep Learning https://fleuret.org/francois/lbdl.html
I love how that site offers a phone-formatted PDF as an option. How thoughtful!
It's a nice treatment of the subject, but I wish he would post a conventionally-formatted .PDF that puts every on a full sheet of standard printer paper.
Interesting!
Is there any one who have recommended books on the attention architecture specifically? I have been interested in that for a long time but never gotten around to actually studying it.
Not a book, but 3blue1brown's video on attention is pretty great: https://www.youtube.com/watch?v=eMlx5fFNoYc