How to Avoid the Hangover from Overdoing It on Data