Animal people. Like cat people, dog people, and etc. They are slaves created by the elves. Possibly a few independent villages of former slaves.
Hopefully tonight or tomorrow I will be able to start refining and assembling the setting. Now that I have the majority of the ideas laid out.