How to Mess Up an Association Without Breaking a Sweat