IV. The perverse turn even their fasting into sin
This adversary's wiles then let us beware of, not only in the enticements of the palate, but also in our purpose of abstinence. For he who knew how to bring death upon mankind by means of food, knows also how to harm us through our very fasting, and using the Manichæans as his tools, as he once drove men to take what was forbidden, so in the opposite direction he prompts them to avoid what is allowed. It is indeed a helpful observance, which accustoms one to scanty diet, and checks the appetite for dainties: but woe to the dogmatizing of those whose very fasting is turned to sin.
For they condemn the creature's nature to the Creator's injury, and maintain that they are defiled by eating those things of which they contend the devil, not God, is the author: although absolutely nothing that exists is evil, nor is anything in nature included in the actually bad. For the good Creator made all things good and the Maker of the universe is one, “Who made the heaven and the earth, the sea and all that is in them.” Of which whatever is granted to man for food and drink, is holy and clean after its kind.
But if it is taken with immoderate greed, it is the excess that disgraces the eaters and drinkers, not the nature of the food or drink that defiles them. “For all things,” as the Apostle says, “are clean to the clean. But to the defiled and unbelieving nothing is clean, but their mind and conscience is defiled.”
Source: Sermons (New Advent)