Hmm, I wouldn't think so. You can get yourself cursed later in the game and whilst cursed you can harm the ghosts. Ghosts also drop weapons that allow you to harm them, if I recall. Cursed weapons work too I think?