My Take
I am assuming that you did a J1 waiver in the VA also. Since your committment is complete your I-485 is approvable, and generally in the past that would have meant you would get your green card in about 6 months or so.
The problem now is that your priority date is May 2004 and the EB2 priority date for India is now Jan 2003.
I am faced with a similar situation as you. In the past, all but the most astute lawyers were telling us we could file NIW at any time during the J1 waiver and it would not make a difference, not necessarily advising us to fix an early priority date. At that time Visa numbers were freely available in view of the then recently passed visa recapture legislation AC21.
I recently saw a post by someone who was suggesting that the priority date for these sorts of cases might be considered as the start of the 5yr period (which it would be for those that filed it transferring from H1b initially or those who filed it ASAP after starting their waiver).
http://immigrationportal.com/showthread.php?t=214692
However as far as my research goes for those in your type of situation, the approval will have to wait until the priority date is current.
So, though I am not entirely sure how this will work for you, I am definitely very interested in finding out, since I will be in the same situation next year without some EB immigration legislative relief. Please keep us posted on developments.
However my new lawyer (I fired my old one) who is big in physician immigration assures me that once I do complete the 5 yrs I should be able to move about on EAD into any internist job without much difficulty.