Our understanding of "magic" as something supernatural depends on believing that we have a good understanding of the boundaries of what is natural.
So yeah, without modern science, everyone can do magic, but some better than others.
Or, as Arthur C Clarke famously put it, "any sufficiently advanced technology is indistinguishable from magic".