You need to give up your green card on your oath date, but not at the interview. You still have your green card in hand if you travel after interview.
Also, there are several questions on the back of the oath notice, one of those is "have you travelled outside the country since interview"...