Non-linear transformation

The transformation used in the figure above is $(x_1, x_2) \rightarrow (z_1, z_2) = (x_1^2, x_2^2)$, the boundary we get, after linear regression, is $az_1 + bz_2 + c = 0$, which when expressed using the original coordinates, is just an ellipse.