Self forgiveness isn't really a biblical concept. The real issues are shame, guilt, and condemnation. If you have honestly confessed before God and your wife and repented of your sin, then you have no reason to continue in shame, guilt, and condemnation. You are believing the lies of the enemy...