This work is dedicated to my wife, Jen Dodd, whose love, integrity, and support made the book (and all else I do) possible.
The book grew out of a set of notes I prepared for an online study group on ニューラルネットワークと深層学習. Many thanks to all the participants in that study group: Paul Bloore, Chris Dawson, Andrew Doherty, Ilya Grigorik, Alex Kosorukoff, Chris Olah, and Rob Spekkens. I learned a lot from all of you. I am particularly grateful to Rob, for providing so many insightful questions and ideas, and to Chris, who has continued to share his rapidly expanding knowledge of neural networks. Thanks also to Yoshua Bengio, who read and provided feedback on a chapter.