For a natural number $b$, let $N(b)$ denote the number of natural numbers $a$ for which the equation $x^2 + ax + b = 0$ has integer roots. What is the smallest value of $b$ for which $N(b) = 20$?

Let's think step by step and output the final answer within \boxed{}.
user