You will be fine. Grant of asylum is a waiver of your two year residency rule.
See 8 CFR 209.2(b)
"An applicant for adjustment under this part who has had the status of an exchange alien nonimmigrant under section 101(a)(15)(J) of the Act, and who is subject to the foreign resident requirement of section 212(e) of the Act, shall be eligible for adjustment without regard to the foreign residence requirement if otherwise eligible for adjustment."