Unlike a lot of folks here I mostly agree with the list - I'm a self-taught programmer as well. But don't stop with the The Little Schemer - grab The Seasoned Schemer as well, and if you can make it through The Reasoned Schemer you'll learn quite a few things that many programmers know nothing about.

I still think that Rich Hickey's list, http://www.amazon.com/Clojure-Bookshelf/lm/R3LG3ZBZS4GCTH is the best collection of self-taught programmer must reads I've encountered.