Well if hes still attracted to you then I see no point in not trying - a fresh start perhaps. Try to create a new relationship with him thats better than the previous one.

The ex, and the relationship with the ex - are two different things. You could always try to re-initiate a new relationship - one that avoids all the problems of the previous one.

It seems like you guys could actually benefit from couples counselling.

That could help you guys in finding out whats the issues in your relationship and find resolve.

Ultimately its about both of your confidence in the relationship - both of you must feel confident about it. Try to prevent things that kills confidence in the relationship. It can help.