I think it should be pointed out that continuing to bring her friend into his fantasies around her is incredibly disrespectful and should stop. However, I agree that it's a little unfair to him to just change everything that made them sexually compatible in the first place and expect him to be completely okay with it.