JaxGC,
I never did it myself and so can not speak from personal experience. But, the stamp on your passport is explicitly for this reason that you should be able to travel unhindered until you get your plastic. So, travel on a GC stamped passport is safe enough. In any case, until you get your plastic, carry the relevant documents (or in some cases their copies) so that you can answer any questions at the POE.