Suppose we have four integers, no two of which are congruent $\pmod 6$. Let $N$ be the product of the four integers.

If $N$ is not a multiple of $6$, then what is the remainder of $N$ when $N$ is divided by $6$?

Let's think step by step and output the final answer within \boxed{}.
user