This ignorance can often be imputed to personal responsibility. This is the case when a man "takes little trouble to find out what is true and good, or when conscience is by degrees almost blinded through the habit of committing sin." In such cases, the person is culpable for the evil he commits.
Source: Catechism of the Catholic Church (Vatican.va)