Whatever you do, make sure you are 100% informed about the decision and know that you will be comfortable with it 6 years down the line.
Now, given that you are from india, you can't bank on getting a GC fast these days. So the usual way of doing a primary care or hospitalist job for 2 years, get your GC and move to fellowship later is not quite available.
Read through a lot of stuff on this forum to fully undertand the predicament you put yourself into by accepting a J1. Realistically, you are blocking yourself from becoming a citizen for the next 10 years (2 year fellowship, 3 year waiver, 5 year PR). Also, you are limiting your career opportunities after fellowship to positions that are able to give you a waiver. Usually, that either means working for the VA or some place where people grow corn for a living.
As for 'life circumstances' limiting the ability to do a fellowship. 'Life circumstances' are usually expensive wifes and kids. If both of you go into the job-->GC-->fellowship deal in the understanding that the RDM (real doctor money) you will make during that time won't be spent on that new Acura MDX but that you rather live like a resident and bank the cash for fellowship, then the 'life circumstances' won't kill you financially.