If the two variables are highly correlated, then you should keep the one that is more predictive. If the correlation is not as strong, then you should keep both variables and let the model choose which one is more predictive.
