I don't think they'll follow him because he had Force powers, but I do think the clones would follow him. Palpatine knew the way of the Sith: even if he did plan to rule for as long as he could, he could see Anakin would reach levels he could only dream of.
People would be terrified of Vader. He wouldn't have ruled the same way as the Emperor; I'm sure the Rebellion would have caused more havoc for Vader than it did for Palpy, but again, I truly believe Vader would have eventually been able to sway everything his way with his unheard of affinity for the Force.
"Everything I tell you is a lie. Every question I ask you is a trick. You will find no truth in me."
―Vergere to Jacen Solo