(b)
Let $\alpha\$and $\beta$ be the roots, then
$\alpha + \beta = (a - 2)$ and $\alpha\beta = - (a + 1)$
Now, $\alpha^{2} + \beta^{2} = (\alpha + \beta)^{2} - 2\alpha\beta$
$= (a - 2)^{2} + 2(a + 1)$
$= (a - 1)^{2} + 5$
$\Rightarrow \ \alpha^{2} + \beta^{2} \geq 5$
Thus, the minimum value of $\alpha^{2} + \beta^{2}$ is 5 at $a = 1$