Limiting cholesterol in your diet might be bad for health because it could cut down on important nutrients like choline, which helps babies' brains grow properly during pregnancy. Not getting enough choline might raise the chance of birth defects.