You have to stay in Canada for 2 years out of LAST 5 years to maintain your PR status.
Since you landed in Canada on Aug 19 2004, you should move back to Canada latest by Aug 18, 2007 (and stay in Canada until Aug 19, 2009) to have your 2 years residency in last 5 years.
I am landed immigration staying in USA. I have landed on 19 Aug 2004...stayed in Canada for 3 days and returned to USA. My question is how long can I stay in USA before moving to Canada to maintain my PR status?