Ignoring IRS collection letters can lead to penalties, tax liens, wage garnishments, bank levies, and other serious consequences.