The best would be to go for counselling with your wife. You never really moved passed the affair and every time those emotions of anger, deceit and grief always come back to you. You need to deal with it by talking to someone who will be able to understand you and give you professional advise, only then will you be able to stop looking back at the past and concentrate on the future with your wife and two beautiful kids. All the best.