Actually some countries do not accept refugee travel documents, ex UAE, so you are left with no choice but to get in with your visa, besides, having refugee status still means your a citizen of your country, it's just that you can't go back while you are still a citizen, so i guess you answered...