It depends on the circumstances and the number of years difference for me. The older the two are, the better (i.e. 50 and 64 versus 20 and 34). The more they actually love each other as opposed to it just being about sex and/or money, the better.
I can't say specifically at what point I would condemn the relationship because it is difficult to draw a line.