Suppose $a$ and $b$ are real numbers. When the polynomial $x^3+x^2+ax+b$ is divided by $x-1$ , the remainder is $4$ . When the polynomial is divided by $x-2$ , the remainder is $6$ . What is $b-a$ ?