It is a good idea if you wish to make money - BUT there are so many other ways to make money you dont necessarily need to drop LW if you like it.
For example - Selling cloth. If you find a place that drops high amounts of linen/wool/silk/mageweave ect. Farm away! You said you are a level 23 - I dont know if you are alliance or horde. (And i dont know much about the alliance side of the game)
Go find a place with humanoids around your level and kill away. Im assuming currently your in hillsbrad - Go to the Hillsbrad farmers location and just keep killing away. (You should have alot of quests to do there too)
OR - Pick up something like fishing. Fishing always sells for good money especially in Hillsbrad - You will find oily blackmouth, firefin snappers, or you can go to rachet or wailing caverns and farm deviate fish. You can make TONS of money on these. Generally on most servers deviate fish go for around 1g a peice (sometimes more sometimes less).
Fishing should be able to support you to get your first mount no problem. I have never done it, but i know people who have.
What else... You could farm lower level instances in a few more levels. Once you hit 30-35 you could farm Wailing Caverns or Possibly Deadmines (I have never done it before so i dont know how hard it is).
Just some tips, Hunters are great soloers (I have a 60) and You should easily be able to accomplish any of these tasks! I hope that helps