I would like some opinions:

In my fantasy series, I am heavily considering having witches as a completely different species from human but looking the same, like elves. However, I am also aware that there are real witches, such as pagans and wiccans and the like. Is it ok to have them represented as such in the series, or would it just cause more problems in the actual community?