Although i would say Ebay is the best place to find cheap 'incomplete' sets such as horseless cavalry, i'd say make sure you have the right sizes when looking at pictures.
Scaling up is different for companies, where a normal infantry model from Mirliton is the same size as an old GW model, their horses are not big enough and their dragons are tiny compared to a GW dragon. A cheap metal Mirliton rider will never fit on a GW horse.
if you don't mind using plastics, GW sells/sold quite a few sets where the buyer has to choose to make his model on foot or riding. the empire general plastic for example. if you make it infantry then you have a spare riderlegs, which ends up in your bits box.torsos heads and arms are easy to get in bits boxes, so if you get a hores you can finish the model! (so check out someones bitbox)
If you find something and are not sure about the size, just ask over here
