I am not a fan of your category (1) books before getting the intuition about the underlying concepts. However while searching for such a book i came across the following which might be to your taste (note that i have not read it); * Neural Networks and Deep Learning: A Textbook by Charu Aggarwal - https://www.amazon.com/Neural-Networks-Deep-Learning-Textboo... (https://www.amazon.com/Neural-Networks-Deep-Learning-Textbook/dp/3030068560/ref=sr_1_1?keywords=neural+networks+charu&qid=1565616070&s=books&sr=1-1) The author (from IBM Watson Research center) also has written several other books on related domains. Under your category (2) though not a pop-science book, i found the following old book (hence no DL) very good to really understand the intuition behind ANNs. * Neural Networks for Applied Sciences and Engineering: From Fundamentals to Complex Pattern Recognition by Sandhya Samarasinghe - https://www.amazon.com/Neural-Networks-Applied-Sciences-Engi... (https://www.amazon.com/Neural-Networks-Applied-Sciences-Engineering-dp-084933375X/dp/084933375X/ref=mt_hardcover?_encoding=UTF8&me=&qid=1565616264)
Also recommended in this reply