The argument as I understand it goes beyond that. It states that they should be (should have been in this case) kept within their culture and their community. Often that wasn't an option.
You're saying it wasn't an option, but that's saying every last family in their culture or community were dangerous. I don't buy that for a second.