The election board in your county probably doesn't do anything to check, so you're unlikely to hear from them. You can ask them to check if you're registered. Being registered to vote, but not voting, isn't really an issue if you didn't register knowingly. If you can get proof that you de-registered, that'd be very good for you when you go to your naturalization interview.