robust overfitting

Maximizing the robust margin provably overfits on noiseless data

We show that the robust max-margin solution overfits even on noiseless data yielding a worse performance than ridge regularized and early stopped robust logistic regression.

Konstantin Donhauser, Alexandru Țifrea, Michael Aerni, Reinhard Heckel, Fanny Yang