I think before we go to a full re-count mechanism, I'd definitely support a anonymized public posting of private votes. Whether at the end of the election, or as they come in, I think posting the vote as well as the exact timestamp of the vote would go a long way. 

This way, if individuals see that their private vote didn't show up or was tampered with, they can easily call that affair out without any mystery. Having been in a few places where this system is in place, it's rather effective and generally cuts down on any discontent on potential rigged elections.

Regarding the current status of EC's, I think that there's not much issue of a single person doing the primary organizing of it as long as there's clear oversight of the situation that ensures that any potential corruption doesn't get swept under the rug.