Consider the numbers $\{24, 27, 55, 64, x\}$. Given that the mean of these five numbers is prime and the median is a multiple of $3$, compute the sum of all possible positive integral values of $x$.

Let's think step by step and output the final answer within \boxed{}.
user