Early voting began on Thursday for the 3rd Congressional District seat to replace the late Walter B. Jones, with four candidates in the mix.