Do you have to be able to draw to work as a 3d modeller or animator?

As long as you can make proper models you can likely have some success. A lot of storyboard artists, for example, do little more than draw stick figures in each panel (though they have things like perspective down pat).