I think you can based on the fact that either of the 2 conditions are met.
a. you AND your spouse, both are not working on the EAD, in this scenario your spouse H1 & your H4 are still valid and allows you to go outside USA and return.
b. If you OR your Spouse, has used the EAD to work, then you need an Advance Parole to outside USA & return, because your H4 is invalidated when you use EAD.
I hope this helps.