Absolutely yes - with SSA,banks, driver license etc. Not sure what you mean "with the new passport". You probably meant for the "US passport" since you never had one. If that is the case, you do not need the name change document since you will have to submit your naturalization certificate with...