There are few facts you (and others) should know-
[1] Always get opinions from at least 4-5 attorneys than completely (blindly) relying from one attorney alone.
[2] Many attorneys do provide consultation/opinion over the phone than in person which you might like to take advantage of.
[3] Many attorneys don't charge for initial consultation. Thus, you might consider to take advantage of their generosity especially when you are just looking for their opinion than a representation (hiring them).
[4] Always avoid attorneys who would say that they cannot give their opinion over the phone because they don't know you or your case/situation at all. Because it's just a trick to get you to their office so that they can make money out of you even though they would willing to provide a free consultation in person. And then there are attorneys who charge $50-$300 for an hour consultation by saying that this money would be deducted if you would choose to retain them. I'm sure there are many people who think/say that you shouldn't think about money because expertise costs money. Or they might say that you rather pay this much money on these kinds of attorneys than being sorry in the end. Then only thing I would say is that going to these kinds of attorneys should be the last option unless you have extra money to spend.
[5] You will never find the consistency in the opinions given by attorneys because each attorney has his/her own take-on on a given situation. Why is it like that? Because each person in this world is unique and different being individual. So obviously they have their own mind to think/act. Thereby, don't be surprised or think negatively about any of attorney if you get different opinions from them. That's why I previously said that it's always advisable to get opinion from at least 4-5 attorneys so that you could be sure on something.
[6] I've said more than once that never ever assume the outcome of your case based upon the outcome of other people even if other people's situation might have been similiar to yours. Why? Because each officer is different and unique being individual. Meaning some officers are tougher than others. Just because there wasn't a problem for others who were in a similar situation like yours then that doesn't mean you won't have a problem either. I've seen hundreds of cases on this board wherein some people were able to become US citizen without a hitch, while other people were drilled for so long about their past or even were denied. Also, many people have been struck in 'name check' nonsense for many months/years. Does that mean you would also be struck in this name check thing if you like to assume the outcome of your case based upon others??
Let me tell you about some cases from here which show/prove that some officers are tougher than others and they do act differently. In a case USCIS found out during an interview for Naturalization that applicant came here on a student visa but never went to school here; rather he started working. After some time later he met a US citizen and got married and obtained a GC thru that marriage. After 3 yrs later he filed for citizenship and thought his citizenship interview would be a breeze like it was during the time of obtaining green card, but to his surprise his case got denied and he was about to face the possible deportation. He came on here to get help. I advised him to appeal the denial on the ground that there wasn't any immigrant intent on his part when he landed here on a nonimmigrant visa based upon some circumstantial situtaions of him which he said over this board. He appeared in a hearing for appeal with his attorney and was able to reverse the denial on his citizenship appoication and eventually his application for citizenship got approved. However, luck was his side too because if the officer on his appeal-hearing wasn't a nice officer, he would have been definately facing a deportation based upon his immigration past.
Similarly, there was a case wherein interviewing officer came to know during the interview that applicant was married before but got divorce in order to get married with a US citizen and obtained a green card thru marrying with US citizen but lived during all this time with the first husband. And after obtaining green card, she married back to her first husband so that he could get a green card. Officer denied the case under marriage fraud. And in another case officer found out that a guy was single for many years as per his citizenship application but after careful review of his tax returns officer found that he had been filing his tax-returns as married so that he could get advantage of tax break. Also, there was a case wherein officer approved a citizenship application for a woman in NJ knowing well that she was convicted for shoplifting. I mean, as per immigration laws and reported court cases, conviction on shoplifting crime is a deportable crime even if immigrants are charged for misdemenor for shoplifting in state court. But instead of deporting her, officer chose to make her US citizen. I'm 100% sure that her case can easily be reopened if someone would report to USCIS and then not only her but also her parents would be deported who obtained US citizenship based upon her as she sponsored them right after becoming a US citizen. Nevertheless, I'm not here to say what was wrong and what was right; rather I'm here to mention that each officer acts differently.
These are just few cases out of hundeds. All I just want you to know that some officers are tougher than others. Otherwise how many officers even care to look carefully in these kind of info. Thereby, you should never assume the outcome of your case based upon others. You most probably won't get the same officer who interviewed others.
As for your case then you are looking a revocation of your green card and a possible deportation. Your spouse is a derived beneficiary then your spouse would also loose the green card as a result of your action. If you would have worked (or have switched your job) with a different employer in the same kind of field/duties after obtaining a green card then it could have been a different senario because then you would have something to argue with USCIS/Immigration courts about your intent by saying that either company was not paying you the prevailing wages or you found a better opportunity with other employer. I mean, you would have something to justify in your case then. You have to know that sometimes immigration officers do use their discretionary authority to approve a citizenship application despite of knowing well that applicant switched the job to a different employer right away after obtaining the green card or never worked for the employer who initially sponsored even though law states that applicant cannot quit CERTAIN jobs before 18 months.
After how long of filing I-485 you obained your green card could also have been considered to justify your move if you would have changed your job in the same field with another employer. But since you didn't work at all then you have nothing to argue to defend yourself.
Some people might say to you that you might have a hope to get approval on your citizenship application because some people on this board who were in a similar situation like yours were able to become a US citizen, but then keep it in mind that some officers are tougher than others. And modus operandi of each officer is different. Some officer don't even care to ask anything, while others would drill you and pick on you on even little-little things. It could be possible that officer might completely overlook this critical fact in your case, or probably won't even care but can you honestly tell that that's how it would 100% turn out??
If you want to take a risk then go for it. But if you say that you rather live and work here than being deported then both of you (you and your spouse) must withdraw the pending naturalization application. You can choose to refile it after few yrs later (at least 8-10 yrs) since this issue most probably won't come up by then, or you can choose to remain just a permanent resident.
As for your husband's case then it is highly unsual for USCIS to ask him about your job history. I personally don't think even for a second that USCIS would question him about your job or your job history to make a decision on his citizenship application even though he obtained his green card based on yours. They have no possible and whatsoever reason to suspect about your situation in order to decide his case unless they check his tax returns and would find out that you haven't worked for the employer who sponsored you. But the possibility of them to check your work history thru his tax-returns is very slim because tax returns are required to see/check about applicant's situation than applicant's spouse. But I cannot rule this out either.
The best thing for you guys to do is to withdraw the applications. And the best way to withdaw the application is by going personally to local office on the day of interview. They won't ask why you are withdrawing because people do change their mind at the last moment because of various reasons. Sending them letter in the mail is not a good idea even if you might think to send a certified mail because you will hardly receive a confirmation on your request then. Not appearing for an interview is another way to get rid of the application but then it would be considered as DENIED because of abandonment of it than withdrawing which might not look good in the future.
Good luck