(c)
$\therefore\tan^{- 1}{x - \tan^{- 1}{y = 0 \Rightarrow x = y}}$
Also, $\cos^{- 1}{x + \cos^{- 1}{y = \frac{\pi}{2} \Rightarrow 2\cos^{- 1}{x = \frac{\pi}{2}}}}$
$\Rightarrow \cos^{- 1}{x = \frac{\pi}{4} \Rightarrow x = \frac{1}{\sqrt{2}} \Rightarrow x^{2} = \frac{1}{2}}$
Hence, $x^{2} + xy + y^{2} = 3x^{2} = \frac{3}{2}$