Ask HN: What Neural Networks/Deep Learning Books Should I Read?

I recommend reading http://aima.cs.berkeley.edu/

This is also useful, but harder to read than the previous ones: https://web.stanford.edu/~hastie/Papers/ESLII.pdf

Also Bishop 'Pattern Recognition and Machine Learning' is a classic reference but even older.

And the book is excellent.

I second this as well! ITILA is not just outstanding but offers a timeless perspective to statistical and uncertainty modeling

second the Mackay book recommendation!

'Information Theory, Inference and Learning Algorithms' has a chapter on neural networks. It is an outstanding book: a labour of love from a very smart person.

The Goodfellow book is the obvious one.

Deep Learning Book by Ian Goodfellow et al. is a great starting point, giving a lot of overview. Though, it requires a lot of interest in maths.

I would read the Goodfellow book (though it is exactly as you describe).

This for actual methods: http://www.deeplearningbook.org/

Seems like 'Deep Learning' [0] might suit for your first type of book.

Have you considered giving Goodfellow another shot, but trying to re-derive the results therein as a form of exercise?

For your category 2 book I would recommend: The Master Algorithm: How the Quest for the Ultimate Learning Machine

Type 2: The Master Algorithm by Pedro Domingos

The Pedro Domingos book the Master Algorithm tries to address this itch / may be less philosophical that you want.

+1 for this book. Such a pleasure to read and to work through the samples.

This is a really excellent book - I'm currently reading it

I loved Deep Learning with Python by François Chollet

I recommend "Deep Learning in Python" by Francois Chollet as it provides a good overview of practical deep learning.

'Machine Learning: A probabilistic perspective' by Kevin Murphy, which does have exercises

maybe The Book of Why (Judea Pearl) could be interesting reading for you.

For the second type of book, may I suggest 'The Book of Why' by Judea Pearl.

Neural Networks and Deep Learning (Michael Nielsen)

The Michael Nielsen online text is very well-regarded

I thought this was a great book

1. Grokking Deep Learning (Andrew W. Trask)

"Mathematics for Machine Learning" by Marc Peter Deisenroth, A Aldo Faisal, and Cheng Soon Ong.

This for the background: https://mml-book.github.io/