Deep learning models are flexible, but this flexibility comes at high (computational) costs