Question

Why is mean square error a bad measure of model performance? What would you suggest instead?

Answer 1

Mean Squared Error (MSE) gives a relatively high weight to large errors — therefore, MSE tends to put too much emphasis on large deviations. A more robust alternative is MAE (mean absolute deviation).