If in fact you got married in 2004, yes you were suppose to file income tax returns either as married filing jointly or married filing seperately, but in any case not as single, go back and amend those returns (2004/2005), there is a strong chance that immigration officer might question this if he/she happens to glance at those years