They got stumps out with horses making the original Erie canal and most likely others around the world. I don't have a link or couldn't totally figure how the device worked. It looked like it had two big wheels with a large log/axle between then a wheel almost as big to wrap a line around for the horses to pull on. The line to the stump went directly on the axle of much less diameter. My description may have some errors. Probably could search something up not sure how I ran across it.
You're right, Franny. I ran across this video a while back. It's definitely on the slow side, but a very cool old horse driven stump puller nonetheless: