I don't think it can be a broad general statement to say all INTPs and INFJs don't get along because.. Well.. My boyfriend of 5.5 years is an INTP and we're a very smart match.
Perhaps you just don't like their inability to express feelings or their failures at time management? Those are often...