He wasn't asking voters so much to "join Arnold" -- his inclusive recall message -- as to choose sides. And in California, his side -- the Republican side -- is greatly outnumbered by Democrats and political independents.
A Republican speechwriter adds:
Schwarzenegger's approach "worked well in the recall....The problem is that it didn't wear very well over a period of time. After a while he was a governor, not an actor, and it's quite a different role."