Good question! The difference will be more in the perspective of how you look at magic.
A mage thinks scientifically
a priest thinks in a theological sense
Both physics and religion want to explain creation, one side theologically, the other empirically.