My 2 cents
Hi Ebhola,
Please consult your lawyer for confirmation.
To the best my knowledge, on a H!b visa, you need a Canadian Visa to enter Canada. As for your visa status, You will have no issues entering or leaving Canada, but on the US side, they may object not having the H1b stamped...