You can attach copy with N-400 and bring originals to interview if you fall under one of the categories that requires you to present evidence of tax transcripts (failed to pay taxes in past, owe amount to IRS, presumed break in continuous residence, proof of marriage union)