Canada immigration are not interested. As long as you have some form of ID (RTD, passport), they will let you in. In the past, you only needed a state ID to get in.
Its the CBP that will give you a hard time............
this is what I wrote about my experience of going to Canada:
Traveled to Canada in 2017. Drove. Waved through by Canadian immigration...no issues. Coming back, CBP officer asks: Why do you have the RTD? Why don't you have your country passport? Why are you a refugee? AEFATEYHwaqo r9iygasvljkdw!!! This me being patient, answering those stupid questions.