Well I'm thinking you can Joey, if you go to the guy that teaches you Swordsmith it says something about unlearning swordsmith, so I'm thinking you can do it, though just like changing your talent tree, I think it would get pretty pricy
Hope that helps