Wrong question.
The default is to allow people freedom. If that is to be restricted then there must be justification.
So why should abortion be restricted?
I can't see any reason other than the metaphysical beliefs of some individuals.
That is not good enough to justify restrictions.
I agree with your first premise. But what freedom are you allowing the unborn child? Do they have no rights, to their own body or otherwise? And the woman's rights unrestricted? Read my other responses, you'll see my reasoning as it's revealed.