While I don't think that the Traveler is evil, I personally think the Speaker is. I mean, he's voiced by Bill Nighy. He doesn't have a face. He's pretty much got all the power since he's the only one who can "speak" to the Traveler