Neither Settler Nor Native: The Making and Unmaking of Permanent Minorities