NO you cannot do this..
You cannot leave USA without showing the GC to the check-in agent of your airline, you don't have the GC after your Oath so you cannot do this. I am not sure of the laws and applications in Australia but keep in mind after your oath you are not an Australian citizen ( unless Australia automatically grant you the dual citizenship ) and in most countries it is illegal what is described here..
Another option would be leaving with your australian passport and apply for a US passport at a US consulate there, however, it takes about 2 weeks and you'd be borderline again... And while leaving the US on a foreign passport is easy, having a US passport when you enter the US is a must.Otherwise you can always postpone it.
You cannot leave USA without showing the GC to the check-in agent of your airline, you don't have the GC after your Oath so you cannot do this. I am not sure of the laws and applications in Australia but keep in mind after your oath you are not an Australian citizen ( unless Australia automatically grant you the dual citizenship ) and in most countries it is illegal what is described here..