Yes, a conditional permenant resident can travel abroad, and more importantly return back in the USA.
To travel you need your green card and valid passport, plus if your surname on your greencard is different from your passport due to marriage, take your marriage certificate with you.
