I have changed J1 waiver job without any trouble in past (04/2004).
Here is what I would do. Find a second job, if possible with county clinic / federal health centers (to minimize risk of abuse). Once that is fixed then talk to a reputed lawyer, prepare case for hardship / unfavourable...