Yes. If one is not required to file then they have not "failed to file". Taxes are only an issue when 1.) you have a problem with them, 2.) you are proving ties to the U.S. during a long ansence, or 3.) you are applying as a spouse of a USC. For most N-400 applicants they are irrelevant.