How many positive integer factors of $2020$ have more than $3$ factors? (As an example, $12$ has $6$ factors, namely $1,2,3,4,6,$ and $12.$) Provide your answer as an integer.

Let's think step by step and output the final answer within \boxed{}.
user