I don't know if having kids is 'selfish'. My perspective on it sure changed after I had a kid.
But if having a kid is selfish, then working hard for someone you love is selfish and maybe everything is selfish.
But ok - there is no right answer.
We don't have a choice here, time is up for us if we don't conceive in the next few months, that's how the process goes.
You don't have to explain yourself to anyone.