You need a valid visa stamp ONLY if you are planning on passing through the port of entry (coming into US). If you are planning on not going out of the country, as long as you have the I-94 card that came with the approval notice, stapled to your passport, you should be fine.