The most-mentioned books on r/mathematics.
Looking for more? Similar subreddits are algorithms, cryptography, medicalschool, medicine, and rstats.